2024-01-20T07:57:04.319 INFO:root:teuthology version: 0.0.1.dev249+gcd45576 2024-01-20T07:57:04.319 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi --description fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} --archive /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412 --verbose -- /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/orig.config.yaml 2024-01-20T07:57:04.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T07:57:04.447 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412 branch: main description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} email: yweinste@redhat.com first_in_suite: false job_id: '7522412' kernel: client: branch: testing kdb: true sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 seed: 450 sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlrLNzBn88jFP2X1n6kxVC2c1uK3V5PoWfN2hhwa0xRva16SJ8jrcjQlFqFAsBr4NLSNKsS8NQpDYCRXpV392Y= smithi110.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFT2tsvTwJsCuCnLOw6OilTH6tN0pKxMSQvbzBE+jougwKWG72e6msyNu/hF5UnlGcrh3L0ZQb1wrDbW+/Hw5I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_multifs_auth teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: cd45576300487d997e5a85abed65500b9f5d143b timestamp: 2024-01-19_15:24:44 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-01-20T07:57:04.447 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa; will attempt to use it 2024-01-20T07:57:04.448 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks 2024-01-20T07:57:04.448 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-01-20T07:57:04.450 INFO:teuthology.task.internal:Checking packages... 2024-01-20T07:57:04.474 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167' 2024-01-20T07:57:04.474 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-01-20T07:57:04.474 INFO:teuthology.packaging:ref: None 2024-01-20T07:57:04.474 INFO:teuthology.packaging:tag: None 2024-01-20T07:57:04.474 INFO:teuthology.packaging:branch: main 2024-01-20T07:57:04.474 INFO:teuthology.packaging:sha1: a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T07:57:04.474 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-01-20T07:57:04.654 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-772.gd7e2a322 2024-01-20T07:57:04.656 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-01-20T07:57:04.662 INFO:teuthology.task.internal:no buildpackages task found 2024-01-20T07:57:04.662 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-01-20T07:57:04.685 INFO:teuthology.task.internal:Saving configuration 2024-01-20T07:57:04.701 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-01-20T07:57:04.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T07:57:04.732 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.272212', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlrLNzBn88jFP2X1n6kxVC2c1uK3V5PoWfN2hhwa0xRva16SJ8jrcjQlFqFAsBr4NLSNKsS8NQpDYCRXpV392Y='} 2024-01-20T07:57:04.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.273389', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFT2tsvTwJsCuCnLOw6OilTH6tN0pKxMSQvbzBE+jougwKWG72e6msyNu/hF5UnlGcrh3L0ZQb1wrDbW+/Hw5I='} 2024-01-20T07:57:04.757 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-01-20T07:57:04.764 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-01-20T07:57:04.764 INFO:teuthology.task.internal:roles: ubuntu@smithi110.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2024-01-20T07:57:04.764 INFO:teuthology.run_tasks:Running task console_log... 2024-01-20T07:57:04.861 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7efd5737a3a0>, signals=[15]) 2024-01-20T07:57:04.861 INFO:teuthology.run_tasks:Running task internal.connect... 2024-01-20T07:57:04.869 INFO:teuthology.task.internal:Opening connections... 2024-01-20T07:57:04.869 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T07:57:04.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T07:57:04.963 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T07:57:04.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T07:57:05.082 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-01-20T07:57:05.157 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2024-01-20T07:57:05.175 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2024-01-20T07:57:05.176 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="CentOS Stream" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="9" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:ID="centos" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="rhel fedora" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="9" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el9" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:LOGO="fedora-logo-icon" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://centos.org/" 2024-01-20T07:57:05.233 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T07:57:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-20T07:57:05.234 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-20T07:57:05.234 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2024-01-20T07:57:05.281 DEBUG:teuthology.orchestra.run.smithi110:> uname -m 2024-01-20T07:57:05.298 INFO:teuthology.orchestra.run.smithi110.stdout:x86_64 2024-01-20T07:57:05.298 DEBUG:teuthology.orchestra.run.smithi110:> cat /etc/os-release 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:NAME="CentOS Stream" 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION="9" 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:ID="centos" 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:ID_LIKE="rhel fedora" 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:VERSION_ID="9" 2024-01-20T07:57:05.355 INFO:teuthology.orchestra.run.smithi110.stdout:PLATFORM_ID="platform:el9" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:PRETTY_NAME="CentOS Stream 9" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:ANSI_COLOR="0;31" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:LOGO="fedora-logo-icon" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:HOME_URL="https://centos.org/" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-01-20T07:57:05.356 INFO:teuthology.orchestra.run.smithi110.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-01-20T07:57:05.356 INFO:teuthology.lock.ops:Updating smithi110.front.sepia.ceph.com on lock server 2024-01-20T07:57:05.379 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-01-20T07:57:05.393 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-01-20T07:57:05.406 INFO:teuthology.task.internal:Checking for old test directory... 2024-01-20T07:57:05.406 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2024-01-20T07:57:05.409 DEBUG:teuthology.orchestra.run.smithi110:> test '!' -e /home/ubuntu/cephtest 2024-01-20T07:57:05.425 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-01-20T07:57:05.433 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-01-20T07:57:05.433 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2024-01-20T07:57:05.465 DEBUG:teuthology.orchestra.run.smithi110:> test -z $(ls -A /var/lib/ceph) 2024-01-20T07:57:05.497 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-01-20T07:57:05.554 INFO:teuthology.run_tasks:Running task kernel... 2024-01-20T07:57:05.569 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2024-01-20T07:57:05.569 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}} 2024-01-20T07:57:05.569 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-01-20T07:57:05.569 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-20T07:57:05.570 DEBUG:teuthology.orchestra.run.smithi110:> test -f /run/.containerenv -o -f /.dockerenv 2024-01-20T07:57:05.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T07:57:05.586 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-01-20T07:57:05.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T07:57:05.590 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2024-01-20T07:57:05.800 DEBUG:teuthology.task.kernel:sha1 for client.1 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:05.800 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-20T07:57:05.800 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-01-20T07:57:05.802 DEBUG:teuthology.task.kernel:sha1 for client.0 is 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:05.802 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "06652275eb934672217aaf9d4180f4a90395eb16"... 2024-01-20T07:57:05.802 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-01-20T07:57:05.819 INFO:teuthology.orchestra.run.smithi110.stdout:5.14.0-361.el9.x86_64 2024-01-20T07:57:05.819 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:05.819 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-20T07:57:05.820 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum upgrade -y linux-firmware 2024-01-20T07:57:05.821 INFO:teuthology.orchestra.run.smithi100.stdout:5.14.0-361.el9.x86_64 2024-01-20T07:57:05.821 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:05.821 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-01-20T07:57:05.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2024-01-20T07:57:07.885 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2024-01-20T07:57:07.934 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2024-01-20T07:57:09.318 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 6.2 MB/s | 2.0 MB 00:00 2024-01-20T07:57:09.560 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-01-20T07:57:10.934 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 6.2 MB/s | 8.0 MB 00:01 2024-01-20T07:57:11.143 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.0 MB 00:01 2024-01-20T07:57:14.502 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 8.7 MB/s | 19 MB 00:02 2024-01-20T07:57:18.636 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 7.9 MB/s | 5.9 MB 00:00 2024-01-20T07:57:20.161 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2024-01-20T07:57:20.975 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 19 MB 00:08 2024-01-20T07:57:21.488 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2024-01-20T07:57:25.634 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 4.7 MB/s | 5.9 MB 00:01 2024-01-20T07:57:26.388 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-01-20T07:57:27.518 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 15 kB 00:00 2024-01-20T07:57:28.683 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-01-20T07:57:28.688 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-20T07:57:28.688 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-01-20T07:57:28.688 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 1 Package 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 375 M 2024-01-20T07:57:28.689 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-01-20T07:57:29.847 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 20 MB 00:02 2024-01-20T07:57:34.728 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-01-20T07:57:36.922 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-01-20T07:57:36.936 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware noarch 20240109-142.el9 CentOS-BaseOS 375 M 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:================================================================================ 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 1 Package 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 375 M 2024-01-20T07:57:36.937 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-01-20T07:57:46.121 INFO:teuthology.orchestra.run.smithi110.stdout:linux-firmware-20240109-142.el9.noarch.rpm 41 MB/s | 375 MB 00:09 2024-01-20T07:57:46.121 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-01-20T07:57:46.122 INFO:teuthology.orchestra.run.smithi110.stdout:Total 41 MB/s | 375 MB 00:09 2024-01-20T07:57:46.122 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-01-20T07:57:46.211 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-01-20T07:57:46.211 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-01-20T07:57:48.520 INFO:teuthology.orchestra.run.smithi100.stdout:linux-firmware-20240109-142.el9.noarch.rpm 19 MB/s | 375 MB 00:19 2024-01-20T07:57:48.521 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-01-20T07:57:48.522 INFO:teuthology.orchestra.run.smithi100.stdout:Total 19 MB/s | 375 MB 00:19 2024-01-20T07:57:48.522 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-01-20T07:57:48.607 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-01-20T07:57:48.607 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-01-20T07:57:48.650 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-01-20T07:57:48.650 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-01-20T07:57:50.980 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-01-20T07:57:50.981 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-01-20T07:57:54.884 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-01-20T07:57:55.102 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T07:57:55.186 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:56.518 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:56.519 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T07:57:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:56.911 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:57:56.911 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-01-20T07:57:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: linux-firmware-20240109-142.el9.noarch 2024-01-20T07:57:56.912 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:57:56.912 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-01-20T07:57:57.190 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-20T07:57:57.191 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:57.335 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-01-20T07:57:57.415 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ 2024-01-20T07:57:57.415 DEBUG:teuthology.orchestra.run.smithi110:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ --input-file=- 2024-01-20T07:57:57.418 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi110.front.sepia.ceph.com to complete... 2024-01-20T07:57:57.562 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T07:57:57.645 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:58.785 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:58.786 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20240109-142.el9.noarch 1/2 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout: linux-firmware-20240109-142.el9.noarch 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:57:59.203 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-01-20T07:57:59.513 INFO:teuthology.task.kernel:Downloading kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-20T07:57:59.513 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=06652275eb934672217aaf9d4180f4a90395eb16 2024-01-20T07:57:59.776 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ 2024-01-20T07:57:59.776 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.7.0_g06652275eb93-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/ --input-file=- 2024-01-20T07:57:59.779 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2024-01-20T07:58:12.375 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20 07:58:12 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [330048165/330048165] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-20T07:58:12.376 INFO:teuthology.orchestra.run.smithi110.stderr:FINISHED --2024-01-20 07:58:12-- 2024-01-20T07:58:12.376 INFO:teuthology.orchestra.run.smithi110.stderr:Total wall clock time: 15s 2024-01-20T07:58:12.376 INFO:teuthology.orchestra.run.smithi110.stderr:Downloaded: 1 files, 315M in 15s (21.5 MB/s) 2024-01-20T07:58:12.378 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.1... 2024-01-20T07:58:12.378 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-20T07:58:14.280 INFO:teuthology.orchestra.run.smithi110.stdout:Verifying... ######################################## 2024-01-20T07:58:14.395 INFO:teuthology.orchestra.run.smithi110.stdout:Preparing... ######################################## 2024-01-20T07:58:14.473 INFO:teuthology.orchestra.run.smithi110.stdout:Updating / installing... 2024-01-20T07:58:21.899 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-20T07:58:37.891 INFO:teuthology.orchestra.run.smithi110.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-20T07:58:43.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20 07:58:43 URL:https://1.chacra.ceph.com/r/kernel/testing/06652275eb934672217aaf9d4180f4a90395eb16/centos/9/flavors/default/x86_64/kernel-6.7.0_g06652275eb93-1.x86_64.rpm [330048165/330048165] -> "/tmp/kernel.x86_64.rpm" [1] 2024-01-20T07:58:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2024-01-20 07:58:43-- 2024-01-20T07:58:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 44s 2024-01-20T07:58:43.973 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 315M in 44s (7.19 MB/s) 2024-01-20T07:58:43.976 INFO:teuthology.task.kernel:Installing kernel 06652275eb934672217aaf9d4180f4a90395eb16 on client.0... 2024-01-20T07:58:43.976 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-01-20T07:58:45.870 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2024-01-20T07:58:46.045 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2024-01-20T07:58:46.124 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2024-01-20T07:58:53.463 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.7.0_g06652275eb93-1 ######################################## 2024-01-20T07:59:00.014 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi110.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-20T07:59:00.014 DEBUG:teuthology.orchestra.run.smithi110:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-20T07:59:00.088 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-20T07:59:00.088 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-20T07:59:00.088 INFO:teuthology.orchestra.run.smithi110.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-20T07:59:00.089 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-20T07:59:00.090 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-20T07:59:00.091 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-20T07:59:00.092 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-20T07:59:00.093 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-20T07:59:00.094 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-20T07:59:00.095 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-20T07:59:00.096 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-20T07:59:00.097 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-20T07:59:00.098 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-20T07:59:00.099 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-20T07:59:00.100 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-20T07:59:00.101 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-20T07:59:00.102 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-20T07:59:00.103 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-20T07:59:00.104 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-20T07:59:00.105 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-20T07:59:00.106 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-20T07:59:00.107 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-20T07:59:00.108 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-20T07:59:00.109 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-20T07:59:00.110 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-20T07:59:00.111 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-20T07:59:00.112 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-20T07:59:00.113 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-20T07:59:00.114 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-20T07:59:00.115 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-20T07:59:00.116 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-20T07:59:00.117 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-20T07:59:00.118 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-20T07:59:00.119 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-20T07:59:00.120 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-20T07:59:00.121 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-20T07:59:00.122 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-20T07:59:00.123 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-20T07:59:00.124 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-20T07:59:00.125 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-20T07:59:00.126 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-20T07:59:00.127 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-20T07:59:00.128 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-20T07:59:00.129 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-20T07:59:00.130 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-20T07:59:00.131 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-20T07:59:00.132 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-20T07:59:00.133 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-20T07:59:00.134 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-20T07:59:00.135 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-20T07:59:00.136 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-20T07:59:00.137 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-20T07:59:00.138 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-20T07:59:00.139 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-20T07:59:00.140 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-20T07:59:00.141 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-20T07:59:00.142 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-20T07:59:00.143 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-20T07:59:00.144 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-20T07:59:00.145 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-20T07:59:00.146 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-20T07:59:00.147 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-20T07:59:00.148 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-20T07:59:00.149 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-20T07:59:00.150 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-20T07:59:00.151 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-20T07:59:00.152 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-20T07:59:00.153 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-20T07:59:00.154 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-20T07:59:00.155 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-20T07:59:00.156 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-20T07:59:00.157 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-20T07:59:00.158 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-20T07:59:00.159 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-20T07:59:00.160 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-20T07:59:00.161 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-20T07:59:00.162 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-20T07:59:00.163 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-20T07:59:00.164 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-20T07:59:00.165 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-20T07:59:00.166 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-20T07:59:00.167 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-20T07:59:00.168 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-20T07:59:00.169 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-20T07:59:00.170 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-20T07:59:00.171 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-20T07:59:00.172 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-20T07:59:00.173 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-20T07:59:00.174 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-20T07:59:00.175 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-20T07:59:00.176 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-20T07:59:00.177 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-20T07:59:00.178 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-20T07:59:00.179 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-20T07:59:00.180 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-20T07:59:00.181 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-20T07:59:00.182 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-20T07:59:00.183 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-20T07:59:00.184 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-20T07:59:00.185 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-20T07:59:00.186 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-20T07:59:00.187 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-20T07:59:00.188 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-20T07:59:00.189 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-20T07:59:00.190 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-20T07:59:00.191 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-20T07:59:00.192 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-20T07:59:00.193 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-20T07:59:00.194 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-20T07:59:00.195 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-20T07:59:00.196 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-20T07:59:00.197 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-20T07:59:00.198 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-20T07:59:00.199 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-20T07:59:00.200 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-20T07:59:00.201 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-20T07:59:00.202 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-20T07:59:00.203 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-20T07:59:00.204 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-20T07:59:00.205 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-20T07:59:00.206 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-20T07:59:00.207 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-20T07:59:00.208 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-20T07:59:00.209 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-20T07:59:00.210 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-20T07:59:00.211 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-20T07:59:00.212 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-20T07:59:00.213 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-20T07:59:00.214 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-20T07:59:00.215 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-20T07:59:00.216 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-20T07:59:00.217 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-20T07:59:00.218 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-20T07:59:00.219 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-20T07:59:00.220 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-20T07:59:00.221 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-20T07:59:00.222 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-20T07:59:00.223 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-20T07:59:00.224 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-20T07:59:00.225 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-20T07:59:00.226 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-20T07:59:00.227 INFO:teuthology.orchestra.run.smithi110.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-20T07:59:00.228 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-20T07:59:00.228 DEBUG:teuthology.orchestra.run.smithi110:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-20T07:59:00.250 INFO:teuthology.orchestra.run.smithi110.stdout:postinstall scriptlet (using /bin/sh): 2024-01-20T07:59:00.250 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-20T07:59:00.250 INFO:teuthology.orchestra.run.smithi110.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-20T07:59:00.251 INFO:teuthology.orchestra.run.smithi110.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-20T07:59:00.252 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-01-20T07:59:00.252 INFO:teuthology.orchestra.run.smithi110.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-20T07:59:00.252 INFO:teuthology.orchestra.run.smithi110.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-20T07:59:00.252 INFO:teuthology.orchestra.run.smithi110.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-20T07:59:00.252 INFO:teuthology.orchestra.run.smithi110.stdout:fi 2024-01-20T07:59:00.253 DEBUG:teuthology.orchestra.run.smithi110:> sudo rpm -qi grub2-tools 2024-01-20T07:59:00.328 INFO:teuthology.orchestra.run.smithi110.stdout:Name : grub2-tools 2024-01-20T07:59:00.328 INFO:teuthology.orchestra.run.smithi110.stdout:Epoch : 1 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Version : 2.06 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Release : 68.el9 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Architecture: x86_64 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Group : Unspecified 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Size : 8264254 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:License : GPLv3+ 2024-01-20T07:59:00.329 INFO:teuthology.orchestra.run.smithi110.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Packager : builder@centos.org 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Vendor : CentOS 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Summary : Support tools for GRUB. 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout:Description : 2024-01-20T07:59:00.330 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout:hardware devices. 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T07:59:00.331 INFO:teuthology.orchestra.run.smithi110.stdout:This subpackage provides tools for support of all platforms. 2024-01-20T07:59:00.333 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-20T07:59:00.333 INFO:teuthology.task.kernel:Updating grub on smithi110 to boot 6.7.0-g06652275eb93 2024-01-20T07:59:00.333 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-20T07:59:00.990 INFO:teuthology.orchestra.run.smithi110.stderr:Generating grub configuration file ... 2024-01-20T07:59:02.383 INFO:teuthology.orchestra.run.smithi110.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-20T07:59:02.414 INFO:teuthology.orchestra.run.smithi110.stderr:done 2024-01-20T07:59:02.426 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-20T07:59:02.441 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.vsfA41BPXF 2024-01-20T07:59:02.441 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.vsfA41BPXF 2024-01-20T07:59:02.509 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.vsfA41BPXF 2024-01-20T07:59:02.655 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.vsfA41BPXF is 6KB 2024-01-20T07:59:02.704 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.vsfA41BPXF 2024-01-20T07:59:02.718 DEBUG:teuthology.orchestra.run.smithi110:> sudo /bin/ls /boot/loader/entries || true 2024-01-20T07:59:02.790 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-20T07:59:02.790 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-20T07:59:02.790 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-20T07:59:02.790 INFO:teuthology.orchestra.run.smithi110.stdout:15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93.conf 2024-01-20T07:59:02.791 DEBUG:teuthology.orchestra.run.smithi110:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93 2024-01-20T07:59:02.947 DEBUG:teuthology.orchestra.run.smithi110:> sudo shutdown -r now 2024-01-20T07:59:07.879 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-01-20T07:59:30.132 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-01-20T07:59:30.132 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.7.0-g06652275eb93 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.7.0-g06652275eb93 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.7.0-g06652275eb93 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86 2024-01-20T07:59:30.218 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crc32c-intel.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-avx2.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-01-20T07:59:30.219 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-amd.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm-intel.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/arch/x86/kvm/kvm.ko 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto 2024-01-20T07:59:30.220 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ansi_cprng.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/anubis.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/arc4.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_memcpy.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_pq.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_raid6_recov.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_tx.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/async_xor.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/async_tx/raid6test.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authenc.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/authencesn.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blake2b_generic.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_common.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/blowfish_generic.ko 2024-01-20T07:59:30.221 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/camellia_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast5_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast6_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cast_common.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/ccm.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cmac.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crc32_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_engine.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/crypto_user.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/cts.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/des_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/dh_generic.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/echainiv.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/essiv.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/fcrypt.ko 2024-01-20T07:59:30.222 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/khazad.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/lz4hc.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/md4.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/michael_mic.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcbc.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/pcrypt.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/rmd160.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/seed.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/serpent_generic.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tcrypt.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/tea.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_common.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/twofish_generic.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/vmac.ko 2024-01-20T07:59:30.223 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/wp512.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xcbc.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xor.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/crypto/xxhash_generic.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_ipmi.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/acpi_pad.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/custom_method.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/ec_sys.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/platform_profile.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbs.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/sbshc.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/acpi/video.ko 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata 2024-01-20T07:59:30.224 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/acard-ahci.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ahci_platform.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/ata_generic.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/libahci_platform.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_acpi.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ali.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_amd.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_artop.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atiixp.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_atp867x.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd640.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cmd64x.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_cypress.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_efar.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt366.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt37x.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x2n.ko 2024-01-20T07:59:30.225 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_hpt3x3.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it8213.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_it821x.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_jmicron.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_marvell.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_mpiix.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_netcell.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ninja32.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87410.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_ns87415.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_oldpiix.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_opti.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_optidma.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pcmcia.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc2027x.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-01-20T07:59:30.226 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_piccolo.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_rdc.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sch.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_serverworks.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sil680.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sis.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_sl82c105.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_triflex.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pata_via.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/pdc_adma.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_inic162x.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_mv.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_nv.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_promise.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_qstor.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil.ko 2024-01-20T07:59:30.227 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sil24.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sis.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_svw.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_sx4.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_uli.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_via.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ata/sata_vsc.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/auxdisplay/ks0108.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-i2c.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/base/regmap/regmap-mmio.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/bcma/bcma.ko 2024-01-20T07:59:30.228 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/aoe/aoe.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/brd.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/drbd/drbd.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/floppy.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/loop.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/nbd.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/null_blk/null_blk.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/pktcdvd.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/rbd.ko 2024-01-20T07:59:30.229 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/virtio_blk.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/xen-blkfront.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/block/zram/zram.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hangcheck-timer.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/amd-rng.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/intel-rng.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/via-rng.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/hw_random/virtio-rng.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-01-20T07:59:30.230 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_si.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/lp.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/mwave/mwave.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/ppdev.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tlclk.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_atmel.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_infineon.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_nsc.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-01-20T07:59:30.231 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/uv_mmtimer.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/char/virtio_console.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/p4-clockmod.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/powernow-k8.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/cpufreq/speedstep-lib.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/ccp/ccp.ko 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat 2024-01-20T07:59:30.232 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-aes.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/padlock-sha.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dca/dca.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/dw/dw_dmac.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/dma/ioat/ioatdma.ko 2024-01-20T07:59:30.233 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/amd64_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/e752x_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/edac_mce_amd.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3000_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i3200_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5100_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i5400_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7300_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i7core_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/i82975x_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/ie31200_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/sb_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/edac/x38_edac.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/edd.ko 2024-01-20T07:59:30.234 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/firmware/iscsi_ibft.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-ich.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/gpio/gpio-viperboard.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-appleir.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-aureal.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-axff.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-dr.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elecom.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-elo.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-emsff.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gaff.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gt683r.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-gyration.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-kbd.ko 2024-01-20T07:59:30.235 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtek-mouse.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-holtekff.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-hyperv.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-icade.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-keytouch.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-kye.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lcpower.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-led.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-lenovo.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-dj.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-multitouch.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-ortek.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-penmount.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-petalynx.ko 2024-01-20T07:59:30.236 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-picolcd.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-pl.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-plantronics.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-primax.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-rmi.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-arvo.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-common.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-isku.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kone.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-konepure.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-lua.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-pyra.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-ryos.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat-savu.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-roccat.ko 2024-01-20T07:59:30.237 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-saitek.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-samsung.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sensor-hub.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sjoy.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sony.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-speedlink.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-steelseries.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-sunplus.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-thrustmaster.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tivo.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-tmff.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-topseed.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-twinhan.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-uclogic.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-waltop.ko 2024-01-20T07:59:30.238 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-wiimote.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-xinmo.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zpff.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/hid-zydacron.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/uhid.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hid/wacom.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_balloon.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_utils.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hv/hv_vmbus.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/abituguru3.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/acpi_power_meter.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7414.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ad7418.ko 2024-01-20T07:59:30.239 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adc128d818.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1025.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1026.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1029.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm1031.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adm9240.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ads7828.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7410.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7411.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7462.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7470.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7475.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/adt7x10.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/amc6821.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/applesmc.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asb100.ko 2024-01-20T07:59:30.240 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asc7621.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/asus_atk0110.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/atxp1.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/coretemp.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/dme1737.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds1621.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ds620.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc1403.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/emc6w201.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71805f.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f71882fg.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/f75375s.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fam15h_power.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/fschmd.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g760a.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/g762.ko 2024-01-20T07:59:30.241 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl518sm.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/gl520sm.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/hwmon-vid.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5500_temp.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/i5k_amb.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmaem.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ibmpex.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina209.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ina2xx.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/it87.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k10temp.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/k8temp.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lineage-pem.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm63.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm73.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm75.ko 2024-01-20T07:59:30.242 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm77.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm78.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm80.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm83.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm85.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm87.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm90.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm92.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm93.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95234.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95241.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/lm95245.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc2945.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4151.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4215.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4222.ko 2024-01-20T07:59:30.243 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4245.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4260.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/ltc4261.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max16065.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1619.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max1668.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max197.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6639.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6650.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/max6697.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/mcp3021.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6683.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775-core.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct6775.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/nct7802.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87360.ko 2024-01-20T07:59:30.244 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pc87427.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pcf8591.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max16064.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max34440.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/max8688.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/powr1220.ko 2024-01-20T07:59:30.245 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5627.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch5636.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sch56xx-common.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht15.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sht21.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/shtc1.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/sis5595.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47b397.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m1.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/smsc47m192.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/thmc50.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp102.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp103.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp401.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/tmp421.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via-cputemp.ko 2024-01-20T07:59:30.246 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/via686a.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt1211.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/vt8231.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627ehf.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83627hf.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83781d.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83791d.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83792d.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83793.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83795.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l785ts.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/hwmon/w83l786ng.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-01-20T07:59:30.247 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-i801.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-isch.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-parport.ko 2024-01-20T07:59:30.248 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-via.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-dev.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-mux.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-smbus.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/i2c/i2c-stub.ko 2024-01-20T07:59:30.249 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_cm.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_core.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_umad.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/iw_cm.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_cm.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5 2024-01-20T07:59:30.250 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input 2024-01-20T07:59:30.251 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/fm801-gp.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/gameport/gameport.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/joydev.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/keyboard/gpio_keys.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/appletouch.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/bcm5974.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/cyapatp.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/elan_i2c.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/sermouse.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-01-20T07:59:30.252 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/synaptics_usb.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/mouse/vsxxxaa.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/rmi4/rmi_core.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/altera_ps2.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/arc_ps2.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/serio/serio_raw.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/input/sparse-keymap.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-blinkm.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lm3530.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-lp3944.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/leds-ss4200.ko 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger 2024-01-20T07:59:30.253 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/bcache/bcache.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-bio-prison.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache-smq.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-cache.ko 2024-01-20T07:59:30.254 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-crypt.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-delay.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-flakey.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-log-userspace.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-multipath.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-queue-length.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-raid.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-round-robin.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-service-time.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-switch.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-thin-pool.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/dm-verity.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/faulty.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/linear.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/multipath.ko 2024-01-20T07:59:30.255 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid0.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid1.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid10.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/md/raid456.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptbase.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptctl.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptfc.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptlan.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptsas.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptscsih.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/message/fusion/mptspi.ko 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd 2024-01-20T07:59:30.256 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_ich.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/lpc_sch.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/mfd-core.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/sm501.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/viperboard.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/vx855.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/mfd/wl1273-core.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds9802als.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/apds990x.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/bh1770glc.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/cb710/cb710.ko 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom 2024-01-20T07:59:30.257 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/at24.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/eeprom/max6875.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/enclosure.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/hpilo.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29003.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/isl29020.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-me.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei-txe.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/mei/mei.ko 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru 2024-01-20T07:59:30.258 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-gru/gru.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xp.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpc.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_7xx1.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tifm_core.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/tsl2550.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_balloon.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/bonding/bonding.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/b53/b53_common.ko 2024-01-20T07:59:30.259 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/bcm-sf2.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6060.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/dummy.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/eql.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/8390.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-01-20T07:59:30.260 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/agere/et131x.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx 2024-01-20T07:59:30.261 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-01-20T07:59:30.262 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic 2024-01-20T07:59:30.263 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/dnet.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-01-20T07:59:30.264 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ethoc.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/fealnx.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e100.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-01-20T07:59:30.265 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/jme.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/skge.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5 2024-01-20T07:59:30.266 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-01-20T07:59:30.267 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/atp.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-01-20T07:59:30.268 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis190.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sis/sis900.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac 2024-01-20T07:59:30.269 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/cassini.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/niu.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sungem.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/ti/tlan.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-01-20T07:59:30.270 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/geneve.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ieee802154/fakelb.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ifb.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ipvlan/ipvlan.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvlan.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/macvtap.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-01-20T07:59:30.271 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mdio/mdio-regmap.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/mii.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/net_failover.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/netconsole.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/nlmon.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs-lynx.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/amd.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm7xxx.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/bcm87xx.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/broadcom.ko 2024-01-20T07:59:30.272 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/cicada.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/davicom.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/dp83640.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/et1011c.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/icplus.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/lxt.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/marvell.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/micrel.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/national.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/phylink.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/qsemi.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/realtek.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/smsc.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/ste10Xp.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/phy/vitesse.ko 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp 2024-01-20T07:59:30.273 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/bsd_comp.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_async.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_deflate.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_generic.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_mppe.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/ppp_synctty.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppoe.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pppox.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/ppp/pptp.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slhc.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/slip/slip.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/sungem_phy.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tap.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team.ko 2024-01-20T07:59:30.274 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_activebackup.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_broadcast.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_random.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/tun.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/veth.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/virtio_net.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/vxlan/vxlan.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netback/xen-netback.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/net/xen-netfront.ko 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb 2024-01-20T07:59:30.275 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ntb/ntb.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme-core.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/nvme/host/nvme.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_cs.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_pc.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/parport/parport_serial.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/pcie/aer_inject.ko 2024-01-20T07:59:30.276 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pci/xen-pcifront.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/i82092.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/pd6729.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pcmcia/yenta_socket.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acer-wmi.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/acerhdf.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/apple-gmux.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-laptop.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/asus-wmi.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/classmate-laptop.ko 2024-01-20T07:59:30.277 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/hdaps.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/intel_ips.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/msi-wmi.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/mxm-wmi.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-laptop.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/samsung-q10.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/topstar-laptop.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/toshiba_haps.ko 2024-01-20T07:59:30.278 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi-bmof.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/platform/x86/wmi.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_common.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/powercap/intel_rapl_msr.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-gpio.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps-ldisc.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/clients/pps_parport.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/pps/pps_core.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ptp/ptp_kvm.ko 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc 2024-01-20T07:59:30.279 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-bq32k.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1286.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1307.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1374.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1511.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1553.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1672.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds1742.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds2404.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-ds3232.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-em3027.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-fm3130.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl12022.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-isl1208.ko 2024-01-20T07:59:30.280 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m41t80.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t35.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-m48t59.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-max6900.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-msm6242.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf2127.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf85063.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8523.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8563.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-pcf8583.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rp5c01.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rs5c372.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8025.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-rx8581.ko 2024-01-20T07:59:30.281 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/rtc/rtc-x1205.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-9xxx.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-sas.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/3w-xxxx.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/BusLogic.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/a100u2w.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aacraid/aacraid.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/advansys.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-01-20T07:59:30.282 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/am53c974.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/atp870u.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bfa/bfa.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ch.ko 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor 2024-01-20T07:59:30.283 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/csiostor/csiostor.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dc395x.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/dmx3191d.ko 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r 2024-01-20T07:59:30.284 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esas2r/esas2r.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/esp_scsi.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/fcoe.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/fnic/fnic.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hpsa.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hptiop.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/hv_storvsc.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/initio.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ipr.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ips.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/isci/isci.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/iscsi_tcp.ko 2024-01-20T07:59:30.285 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libfc/libfc.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libiscsi_tcp.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/libsas/libsas.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/lpfc/lpfc.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas 2024-01-20T07:59:30.286 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvsas/mvsas.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/mvumi.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/pmcraid.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla1280.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/raid_class.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_debug.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_fc.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_sas.ko 2024-01-20T07:59:30.287 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_spi.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/scsi_transport_srp.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/ses.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/st.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/stex.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/virtio_scsi.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/vmw_pvscsi.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/scsi/wd719x.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ssb/ssb.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-01-20T07:59:30.288 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/loopback/tcm_loop.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_file.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_iblock.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_mod.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_pscsi.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/target_core_user.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-01-20T07:59:30.289 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-01-20T07:59:30.290 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_gsm.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/n_hdlc.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/nozomi.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/arc_uart.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/tty/serial/jsm/jsm.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/core/ufshcd-core.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio.ko 2024-01-20T07:59:30.291 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_aec.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_cif.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_pci_generic.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/uio/uio_sercos3.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-acm.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/cdc-wdm.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usblp.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/class/usbtmc.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/host/sl811-hcd.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/mdc800.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/image/microtek.ko 2024-01-20T07:59:30.292 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/adutux.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/appledisplay.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi26.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/emi62.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ezusb.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/idmouse.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/iowarrior.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/isight_firmware.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/ldusb.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/legousbtower.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/trancevibrator.ko 2024-01-20T07:59:30.293 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usb3503.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usblcd.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/usbsevseg.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/uss720.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/misc/yurex.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/phy/phy-generic.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/aircable.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ark3116.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/belkin_sa.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ch341.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cp210x.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cyberjack.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/cypress_m8.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/digi_acceleport.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/empeg.ko 2024-01-20T07:59:30.294 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ftdi_sio.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/garmin_gps.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_edgeport.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/io_ti.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipaq.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ipw.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ir-usb.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/keyspan_pda.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kl5kusb105.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/kobil_sct.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mct_u232.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7720.ko 2024-01-20T07:59:30.295 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/mos7840.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/navman.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/omninet.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/opticon.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/option.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/oti6858.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/pl2303.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcaux.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/qcserial.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/quatech2.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/safe_serial.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/sierra.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/spcp8x5.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ssu100.ko 2024-01-20T07:59:30.296 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/symbolserial.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_debug.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/usb_wwan.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/visor.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/whiteheat.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/serial/xsens_mt.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/uas.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-alauda.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-cypress.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-datafab.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-freecom.ko 2024-01-20T07:59:30.297 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-isd200.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-karma.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-onetouch.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-realtek.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr09.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-sddr55.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/ums-usbat.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/storage/usb-storage.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-core.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/usbip-host.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci 2024-01-20T07:59:30.298 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/pci/vfio-pci.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_iotlb.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_net.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/vhost/vhost_scsi.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/apple_bl.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/lcd.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/video/backlight/platform_lcd.ko 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio 2024-01-20T07:59:30.299 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_balloon.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_mmio.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/virtio/virtio_ring.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2482.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/masters/ds2490.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-01-20T07:59:30.300 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_smem.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/slaves/w1_therm.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/w1/wire.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim1535_wdt.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/alim7101_wdt.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/f71808e_wdt.ko 2024-01-20T07:59:30.301 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/hpwdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/i6300esb.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/iTCO_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ib700wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ibmasr.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it8712f_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/it87_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/machzwd.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/nv_tco.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_pci.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/pcwd_usb.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sch311x_wdt.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/softdog.ko 2024-01-20T07:59:30.302 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/sp5100_tco.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/via_wdt.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83877f_wdt.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/w83977f_wdt.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/wdt_pci.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/watchdog/xen_wdt.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-acpi-processor.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-evtchn.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntalloc.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-gntdev.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xen-privcmd.ko 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs 2024-01-20T07:59:30.303 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/drivers/xen/xenfs/xenfs.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/9p/9p.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/affs/affs.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/befs/befs.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/binfmt_misc.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/btrfs/btrfs.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cachefiles/cachefiles.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ceph/ceph.ko 2024-01-20T07:59:30.304 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/coda/coda.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/cramfs/cramfs.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/dlm/dlm.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ecryptfs/ecryptfs.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/f2fs/f2fs.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/fat.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/msdos.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fat/vfat.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fscache/fscache.ko 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse 2024-01-20T07:59:30.305 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/cuse.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/fuse/fuse.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/gfs2/gfs2.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfs/hfs.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/hfsplus/hfsplus.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/isofs/isofs.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/jfs/jfs.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/lockd/lockd.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/minix/minix.ko 2024-01-20T07:59:30.306 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/netfs/netfs.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfs.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv3.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs/nfsv4.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/grace.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfs_common/nfs_acl.ko 2024-01-20T07:59:30.307 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nfsd/nfsd.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nilfs2/nilfs2.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-celtic.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-centeuro.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-croatian.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-cyrillic.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-gaelic.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-greek.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-iceland.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-inuit.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-roman.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-romanian.ko 2024-01-20T07:59:30.308 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/mac-turkish.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1250.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1251.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp1255.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp737.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp775.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp850.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp852.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp855.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp857.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp860.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp861.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp862.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp863.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp864.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp865.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp866.ko 2024-01-20T07:59:30.309 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp869.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp874.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp932.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp936.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp949.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_cp950.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_euc-jp.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-1.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-13.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-14.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-15.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-2.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-3.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-4.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-5.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-6.ko 2024-01-20T07:59:30.310 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-7.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_iso8859-9.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-r.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-ru.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_koi8-u.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_ucs2_utils.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/nls/nls_utf8.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-01-20T07:59:30.311 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/overlayfs/overlay.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/pstore/ramoops.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/reiserfs/reiserfs.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/romfs/romfs.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/client/cifs.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_arc4.ko 2024-01-20T07:59:30.312 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/smb/common/cifs_md4.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/squashfs/squashfs.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/sysv/sysv.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/udf/udf.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/ufs/ufs.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/fs/xfs/xfs.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/rcu/rcutorture.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/torture.ko 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace 2024-01-20T07:59:30.313 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/asn1_encoder.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc-itu-t.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crc8.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libarc4.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/crypto/libdes.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/libcrc32c.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lru_cache.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4_compress.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/lz4/lz4hc_compress.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/math/cordic.ko 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6 2024-01-20T07:59:30.314 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/raid6/raid6_pq.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/reed_solomon/reed_solomon.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_bm.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_fsm.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/ts_kmp.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/lib/zstd/zstd_compress.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/mm/hwpoison-inject.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/6lowpan.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_dest.ko 2024-01-20T07:59:30.315 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_fragment.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_hop.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_ipv6.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_mobility.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_routing.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/6lowpan/nhc_udp.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/garp.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/mrp.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/p8022.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/psnap.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/802/stp.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/8021q/8021q.ko 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p 2024-01-20T07:59:30.316 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_fd.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_rdma.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/9p/9pnet_virtio.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/batman-adv/batman-adv.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/br_netfilter.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/bridge.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_among.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arp.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-01-20T07:59:30.317 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_limit.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_log.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_snat.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_stp.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/ebtables.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-01-20T07:59:30.318 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ceph/libceph.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/failover.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/core/pktgen.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_diag.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv4.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dccp/dccp_ipv6.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dns_resolver/dns_resolver.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/dsa_core.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_brcm.ko 2024-01-20T07:59:30.319 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_dsa.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_none.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/dsa/tag_trailer.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ieee802154/ieee802154_socket.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ah4.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/esp4.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/fou.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/gre.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/inet_diag.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_gre.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_tunnel.ko 2024-01-20T07:59:30.320 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ip_vti.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipcomp.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/ipip.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arp_tables.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/iptable_security.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-01-20T07:59:30.321 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_bic.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_dctcp.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_diag.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_highspeed.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_htcp.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_hybla.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_illinois.ko 2024-01-20T07:59:30.322 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_lp.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_scalable.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_vegas.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_veno.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_westwood.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tcp_yeah.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/tunnel4.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_diag.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/udp_tunnel.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv4/xfrm4_tunnel.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ah6.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/esp6.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/fou6.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_tunnel.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ip6_vti.ko 2024-01-20T07:59:30.323 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/ipcomp6.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-01-20T07:59:30.324 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/sit.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/tunnel6.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/ipv6/xfrm6_tunnel.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/key/af_key.ko 2024-01-20T07:59:30.325 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_core.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_debugfs.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_eth.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ip6.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_netlink.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/l2tp/l2tp_ppp.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/llc/llc.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mac802154/mac802154.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/mpls/mpls_gso.ko 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset 2024-01-20T07:59:30.326 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-01-20T07:59:30.327 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conncount.ko 2024-01-20T07:59:30.328 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_h323.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_irc.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sane.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_sip.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_dup_netdev.ko 2024-01-20T07:59:30.329 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_flow_table_inet.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_log_syslog.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_amanda.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_ftp.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_irc.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_sip.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_nat_tftp.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_synproxy_core.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nf_tables.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_acct.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_log.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_osf.ko 2024-01-20T07:59:30.330 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nfnetlink_queue.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_chain_nat.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_compat.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_ct.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_dup_netdev.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fib.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_fwd_netdev.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_hash.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_limit.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_log.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_masq.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_nat.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_numgen.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_queue.ko 2024-01-20T07:59:30.331 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_quota.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_redir.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_reject_inet.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_socket.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/nft_tunnel.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_AUDIT.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CHECKSUM.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CLASSIFY.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_CT.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_DSCP.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HL.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_HMARK.ko 2024-01-20T07:59:30.332 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_IDLETIMER.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LED.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_LOG.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_MASQUERADE.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NETMAP.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFLOG.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_NFQUEUE.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_RATEEST.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_REDIRECT.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_SECMARK.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPMSS.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TEE.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TPROXY.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_TRACE.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_addrtype.ko 2024-01-20T07:59:30.333 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_bpf.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cgroup.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cluster.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_comment.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connbytes.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlabel.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connlimit.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_connmark.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_conntrack.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_cpu.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dccp.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_devgroup.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_dscp.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ecn.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_esp.ko 2024-01-20T07:59:30.334 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hashlimit.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_helper.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_hl.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipcomp.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_iprange.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_ipvs.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_l2tp.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_length.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_limit.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mac.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_mark.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_multiport.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nat.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_nfacct.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_osf.ko 2024-01-20T07:59:30.335 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_owner.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_physdev.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_pkttype.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_policy.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_quota.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_rateest.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_realm.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_recent.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_sctp.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_set.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_socket.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_state.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_statistic.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_string.ko 2024-01-20T07:59:30.336 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_tcpmss.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_time.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netfilter/xt_u32.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/netlink/netlink_diag.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/nsh/nsh.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/openvswitch.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-geneve.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-gre.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/openvswitch/vport-vxlan.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/packet/af_packet_diag.ko 2024-01-20T07:59:30.337 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_rdma.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/rds/rds_tcp.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_csum.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_gact.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_ipt.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_mirred.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_nat.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_pedit.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_police.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_simple.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_skbedit.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/act_vlan.ko 2024-01-20T07:59:30.338 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_basic.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_bpf.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_flow.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_fw.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_route.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/cls_u32.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_cmp.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_ipset.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_meta.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_nbyte.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_text.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/em_u32.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_choke.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_codel.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_drr.ko 2024-01-20T07:59:30.339 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_fq.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_gred.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hfsc.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_hhf.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_htb.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_ingress.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_mqprio_lib.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_multiq.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_netem.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_pie.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_plug.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_prio.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_qfq.ko 2024-01-20T07:59:30.340 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_red.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfb.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_sfq.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_tbf.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sched/sch_teql.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sctp/sctp_diag.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/sunrpc.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-01-20T07:59:30.341 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/diag.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/tipc/tipc.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/unix/unix_diag.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_diag.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/vmw_vsock/vsock_loopback.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/net/xfrm/xfrm_ipcomp.ko 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys 2024-01-20T07:59:30.342 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/security/keys/trusted-keys/trusted.ko 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/kernel/virt/lib/irqbypass.ko 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.alias.bin 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.alias.bin 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.bin 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.builtin.modinfo 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.dep.bin 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.devname 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.order 2024-01-20T07:59:30.343 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.softdep 2024-01-20T07:59:30.344 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols 2024-01-20T07:59:30.344 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.7.0-g06652275eb93/modules.symbols.bin 2024-01-20T07:59:30.344 DEBUG:teuthology.task.kernel:get_image_version: 6.7.0-g06652275eb93 2024-01-20T07:59:30.344 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.7.0-g06652275eb93 -a -r /boot/System.map-6.7.0-g06652275eb93 ]; then 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/vmlinuz-6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/System.map-6.7.0-g06652275eb93 /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/vmlinuz-6.7.0-g06652275eb93 /boot/System.map-6.7.0-g06652275eb93 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/installkernel 6.7.0-g06652275eb93 /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/.vmlinuz-6.7.0-g06652275eb93-rpm /boot/.System.map-6.7.0-g06652275eb93-rpm 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-01-20T07:59:30.366 INFO:teuthology.orchestra.run.smithi100.stdout:new-kernel-pkg --remove 6.7.0-g06652275eb93 --rminitrd --initrdfile=/boot/initramfs-6.7.0-g06652275eb93.img 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.7.0-g06652275eb93 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:postuninstall scriptlet (using /bin/sh): 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/update-bootloader ]; then 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/update-bootloader --remove 6.7.0-g06652275eb93 2024-01-20T07:59:30.367 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2024-01-20T07:59:30.368 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.06 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 68.el9 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Group : Unspecified 2024-01-20T07:59:30.454 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 8264254 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : builder@centos.org 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : CentOS 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T07:59:30.455 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2024-01-20T07:59:30.456 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-01-20T07:59:30.456 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.7.0-g06652275eb93 2024-01-20T07:59:30.457 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-01-20T07:59:31.014 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2024-01-20T07:59:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-01-20T07:59:32.497 INFO:teuthology.orchestra.run.smithi100.stderr:done 2024-01-20T07:59:32.506 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T07:59:32.521 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.52FquNghBd 2024-01-20T07:59:32.521 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.52FquNghBd 2024-01-20T07:59:32.596 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.52FquNghBd 2024-01-20T07:59:32.730 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.52FquNghBd is 6KB 2024-01-20T07:59:32.778 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.52FquNghBd 2024-01-20T07:59:32.792 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2024-01-20T07:59:32.864 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-01-20T07:59:32.864 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-01-20T07:59:32.864 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-01-20T07:59:32.864 INFO:teuthology.orchestra.run.smithi100.stdout:15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93.conf 2024-01-20T07:59:32.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.7.0-g06652275eb93 2024-01-20T07:59:32.950 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-01-20T07:59:32.950 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-20T07:59:32.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T07:59:33.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2024-01-20T08:00:03.056 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-01-20T08:00:03.056 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-20T08:00:03.057 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:00:32.983 DEBUG:teuthology.orchestra.remote:timed out 2024-01-20T08:00:41.987 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-20T08:00:41.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:00:49.550 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-20T08:00:50.173 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-20T08:00:50.174 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.7.0-g06652275eb93"... 2024-01-20T08:00:50.174 DEBUG:teuthology.orchestra.run.smithi110:> uname -r 2024-01-20T08:00:50.213 INFO:teuthology.orchestra.run.smithi110.stdout:6.7.0-g06652275eb93 2024-01-20T08:00:50.213 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-20T08:00:50.213 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-20T08:00:50.213 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-20T08:00:51.217 DEBUG:teuthology.parallel:result is None 2024-01-20T08:01:03.060 DEBUG:teuthology.orchestra.remote:timed out 2024-01-20T08:01:12.061 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-20T08:01:12.062 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:01:13.601 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-01-20T08:01:14.362 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-20T08:01:14.362 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.7.0-g06652275eb93"... 2024-01-20T08:01:14.363 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2024-01-20T08:01:14.416 INFO:teuthology.orchestra.run.smithi100.stdout:6.7.0-g06652275eb93 2024-01-20T08:01:14.416 DEBUG:teuthology.task.kernel:current kernel version is 6.7.0-g06652275eb93 vs 6.7.0-g06652275eb93 2024-01-20T08:01:14.416 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-01-20T08:01:14.416 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-01-20T08:01:15.420 DEBUG:teuthology.parallel:result is None 2024-01-20T08:01:15.421 INFO:teuthology.run_tasks:Running task internal.base... 2024-01-20T08:01:15.429 INFO:teuthology.task.internal:Creating test directory... 2024-01-20T08:01:15.430 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-20T08:01:15.434 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-01-20T08:01:15.494 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-01-20T08:01:15.500 INFO:teuthology.run_tasks:Running task internal.archive... 2024-01-20T08:01:15.507 INFO:teuthology.task.internal:Creating archive directory... 2024-01-20T08:01:15.508 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-20T08:01:15.516 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-01-20T08:01:15.592 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-01-20T08:01:15.598 INFO:teuthology.task.internal:Enabling coredump saving... 2024-01-20T08:01:15.598 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-20T08:01:15.603 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-01-20T08:01:15.759 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T08:01:15.767 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T08:01:15.822 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T08:01:15.827 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-01-20T08:01:15.830 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-01-20T08:01:15.837 INFO:teuthology.task.internal:Configuring sudo... 2024-01-20T08:01:15.837 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-20T08:01:15.841 DEBUG:teuthology.orchestra.run.smithi110:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-01-20T08:01:15.934 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-01-20T08:01:15.943 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-01-20T08:01:15.943 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-20T08:01:15.947 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-01-20T08:01:16.000 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T08:01:16.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T08:01:16.180 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T08:01:16.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T08:01:16.338 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:01:16.338 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-20T08:01:16.413 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T08:01:16.499 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-01-20T08:01:16.615 DEBUG:teuthology.orchestra.run.smithi110:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T08:01:16.701 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-01-20T08:01:16.798 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:01:16.798 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-01-20T08:01:16.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2024-01-20T08:01:16.896 DEBUG:teuthology.orchestra.run.smithi110:> sudo service rsyslog restart 2024-01-20T08:01:17.006 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T08:01:17.057 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T08:01:17.539 INFO:teuthology.run_tasks:Running task internal.timer... 2024-01-20T08:01:17.546 INFO:teuthology.task.internal:Starting timer... 2024-01-20T08:01:17.547 INFO:teuthology.run_tasks:Running task pcp... 2024-01-20T08:01:17.555 INFO:teuthology.run_tasks:Running task selinux... 2024-01-20T08:01:17.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2024-01-20T08:01:17.673 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2024-01-20T08:01:17.677 DEBUG:teuthology.orchestra.run.smithi110:> sudo service auditd rotate 2024-01-20T08:01:17.817 INFO:teuthology.orchestra.run.smithi110.stdout:Rotating logs: 2024-01-20T08:01:17.822 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-01-20T08:01:17.822 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2024-01-20T08:01:17.875 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2024-01-20T08:01:17.876 DEBUG:teuthology.orchestra.run.smithi110:> /usr/sbin/getenforce 2024-01-20T08:01:17.944 INFO:teuthology.orchestra.run.smithi110.stdout:Permissive 2024-01-20T08:01:17.944 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi110.front.sepia.ceph.com': 'permissive'} 2024-01-20T08:01:17.945 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T08:01:18.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:01:18.033 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T08:01:18.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:01:18.129 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-01-20T08:01:18.129 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2024-01-20T08:01:18.213 DEBUG:teuthology.orchestra.run.smithi110:> sudo /usr/sbin/setenforce permissive 2024-01-20T08:01:18.306 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-01-20T08:01:18.316 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-01-20T08:01:18.321 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-01-20T08:01:18.466 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-01-20T08:01:18.480 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-01-20T08:01:18.481 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi100.front.sepia.ceph.com,smithi110.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-01-20T08:06:55.116 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi110.front.sepia.ceph.com')] 2024-01-20T08:06:55.117 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-20T08:06:55.118 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:06:55.266 DEBUG:teuthology.orchestra.run.smithi100:> true 2024-01-20T08:06:55.423 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2024-01-20T08:06:55.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-20T08:06:55.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi110.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-01-20T08:06:55.583 DEBUG:teuthology.orchestra.run.smithi110:> true 2024-01-20T08:06:55.741 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi110.front.sepia.ceph.com' 2024-01-20T08:06:55.741 INFO:teuthology.run_tasks:Running task clock... 2024-01-20T08:06:55.754 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-01-20T08:06:55.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-20T08:06:55.754 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T08:06:55.762 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-01-20T08:06:55.763 DEBUG:teuthology.orchestra.run.smithi110:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T08:06:55.852 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-20T08:06:55.868 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-01-20T08:06:55.903 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-20T08:06:55.922 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-01-20T08:06:55.997 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2024-01-20T08:06:56.015 INFO:teuthology.orchestra.run.smithi110.stderr:sudo: ntpd: command not found 2024-01-20T08:06:56.039 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2024-01-20T08:06:56.054 INFO:teuthology.orchestra.run.smithi110.stdout:506 Cannot talk to daemon 2024-01-20T08:06:56.091 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-20T08:06:56.106 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-01-20T08:06:56.148 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-20T08:06:56.160 INFO:teuthology.orchestra.run.smithi110.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-01-20T08:06:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.280 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.284 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.291 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:06:56.292 INFO:teuthology.run_tasks:Running task install... 2024-01-20T08:06:56.300 DEBUG:teuthology.task.install:project ceph 2024-01-20T08:06:56.300 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}} 2024-01-20T08:06:56.300 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'} 2024-01-20T08:06:56.301 INFO:teuthology.task.install:Using flavor: default 2024-01-20T08:06:56.306 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-01-20T08:06:56.306 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-01-20T08:06:56.306 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'tag': None, 'wait_for_package': False} 2024-01-20T08:06:56.307 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T08:06:56.310 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'tag': None, 'wait_for_package': False} 2024-01-20T08:06:56.311 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T08:06:56.528 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/ 2024-01-20T08:06:56.529 INFO:teuthology.task.install.rpm:Package version is 19.0.0-763.ga00c9940 2024-01-20T08:06:56.542 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/ 2024-01-20T08:06:56.542 INFO:teuthology.task.install.rpm:Package version is 19.0.0-763.ga00c9940 2024-01-20T08:06:56.649 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-20T08:06:56.649 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:06:56.649 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-20T08:06:56.657 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/main/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-01-20T08:06:56.657 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:06:56.657 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-01-20T08:06:56.744 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-20T08:06:56.745 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-20T08:06:56.754 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-01-20T08:06:56.755 DEBUG:teuthology.orchestra.run.smithi110:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a00c9940991c5e1e9ab595faa3f6e1281d8ae167/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-01-20T08:06:56.880 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-20T08:06:56.892 DEBUG:teuthology.orchestra.run.smithi110:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-01-20T08:06:57.005 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-20T08:06:57.023 DEBUG:teuthology.orchestra.run.smithi110:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-01-20T08:06:57.095 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2024-01-20T08:06:57.099 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2024-01-20T08:06:57.113 INFO:teuthology.orchestra.run.smithi110.stdout:check_obsoletes = 1 2024-01-20T08:06:57.118 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum clean all 2024-01-20T08:06:57.443 INFO:teuthology.orchestra.run.smithi100.stdout:73 files removed 2024-01-20T08:06:57.472 INFO:teuthology.orchestra.run.smithi110.stdout:73 files removed 2024-01-20T08:06:57.483 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-20T08:06:57.511 DEBUG:teuthology.orchestra.run.smithi110:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-01-20T08:06:58.530 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 148 kB/s | 80 kB 00:00 2024-01-20T08:06:58.556 INFO:teuthology.orchestra.run.smithi110.stdout:ceph packages for x86_64 146 kB/s | 80 kB 00:00 2024-01-20T08:06:59.007 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 25 kB/s | 9.5 kB 00:00 2024-01-20T08:06:59.157 INFO:teuthology.orchestra.run.smithi110.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2024-01-20T08:06:59.498 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2024-01-20T08:06:59.766 INFO:teuthology.orchestra.run.smithi110.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2024-01-20T08:07:00.409 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - AppStream 7.6 MB/s | 6.4 MB 00:00 2024-01-20T08:07:00.610 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.4 MB 00:00 2024-01-20T08:07:02.202 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-01-20T08:07:02.395 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2024-01-20T08:07:03.498 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - BaseOS 9.0 MB/s | 8.0 MB 00:00 2024-01-20T08:07:04.132 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - BaseOS 6.0 MB/s | 8.0 MB 00:01 2024-01-20T08:07:07.042 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - AppStream 11 MB/s | 19 MB 00:01 2024-01-20T08:07:12.356 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - CRB 3.9 MB/s | 5.9 MB 00:01 2024-01-20T08:07:13.902 INFO:teuthology.orchestra.run.smithi110.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 15 kB 00:00 2024-01-20T08:07:18.356 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - AppStream 1.4 MB/s | 19 MB 00:13 2024-01-20T08:07:23.623 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 5.9 MB 00:01 2024-01-20T08:07:25.215 INFO:teuthology.orchestra.run.smithi100.stdout:CentOS Stream 9 - Extras packages 44 kB/s | 15 kB 00:00 2024-01-20T08:07:25.744 INFO:teuthology.orchestra.run.smithi110.stdout:Extra Packages for Enterprise Linux 1.7 MB/s | 20 MB 00:11 2024-01-20T08:07:27.833 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 8.3 MB/s | 20 MB 00:02 2024-01-20T08:07:31.402 INFO:teuthology.orchestra.run.smithi110.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-01-20T08:07:33.559 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-01-20T08:07:34.012 INFO:teuthology.orchestra.run.smithi110.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T08:07:34.013 INFO:teuthology.orchestra.run.smithi110.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T08:07:34.035 INFO:teuthology.orchestra.run.smithi110.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-20T08:07:34.036 INFO:teuthology.orchestra.run.smithi110.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-20T08:07:34.038 INFO:teuthology.orchestra.run.smithi110.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-20T08:07:34.039 INFO:teuthology.orchestra.run.smithi110.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-20T08:07:34.042 INFO:teuthology.orchestra.run.smithi110.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-20T08:07:34.046 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-20T08:07:34.047 INFO:teuthology.orchestra.run.smithi110.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-20T08:07:34.128 INFO:teuthology.orchestra.run.smithi110.stdout:Dependencies resolved. 2024-01-20T08:07:34.146 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-01-20T08:07:34.146 INFO:teuthology.orchestra.run.smithi110.stdout: Package Arch Version Repository Size 2024-01-20T08:07:34.146 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-01-20T08:07:34.146 INFO:teuthology.orchestra.run.smithi110.stdout:Installing: 2024-01-20T08:07:34.146 INFO:teuthology.orchestra.run.smithi110.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph x86_64 2:19.0.0-763.ga00c9940.el9 ceph 6.6 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base x86_64 2:19.0.0-763.ga00c9940.el9 ceph 5.1 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 886 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-763.ga00c9940.el9 ceph 145 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr x86_64 2:19.0.0-763.ga00c9940.el9 ceph 1.5 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 133 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 1.7 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 7.4 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 51 k 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 8.6 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test x86_64 2:19.0.0-763.ga00c9940.el9 ceph 46 M 2024-01-20T08:07:34.147 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 262 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 742 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 217 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell x86_64 2:19.0.0-763.ga00c9940.el9 ceph 27 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 18 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 31 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 742 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 127 k 2024-01-20T08:07:34.148 INFO:teuthology.orchestra.run.smithi110.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs x86_64 2:19.0.0-763.ga00c9940.el9 ceph 162 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados x86_64 2:19.0.0-763.ga00c9940.el9 ceph 320 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 297 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 99 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 85 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 170 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-20T08:07:34.149 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrading: 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: librados2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.4 M 2024-01-20T08:07:34.150 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout:Installing dependencies: 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 19 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 28 k 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds x86_64 2:19.0.0-763.ga00c9940.el9 ceph 2.1 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 245 k 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.7 M 2024-01-20T08:07:34.151 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 17 M 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 15 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux x86_64 2:19.0.0-763.ga00c9940.el9 ceph 25 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite x86_64 2:19.0.0-763.ga00c9940.el9 ceph 163 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-20T08:07:34.152 INFO:teuthology.orchestra.run.smithi110.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 499 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.8 M 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-20T08:07:34.153 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-20T08:07:34.154 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 45 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 130 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-20T08:07:34.155 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-20T08:07:34.156 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-20T08:07:34.157 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-20T08:07:34.158 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-20T08:07:34.159 INFO:teuthology.orchestra.run.smithi110.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction Summary 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout:=========================================================================================== 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout:Install 139 Packages 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout:Upgrade 16 Packages 2024-01-20T08:07:34.160 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout:Total download size: 209 M 2024-01-20T08:07:34.161 INFO:teuthology.orchestra.run.smithi110.stdout:Downloading Packages: 2024-01-20T08:07:35.179 INFO:teuthology.orchestra.run.smithi110.stdout:(1/155): ceph-19.0.0-763.ga00c9940.el9.x86_64.r 26 kB/s | 6.6 kB 00:00 2024-01-20T08:07:35.438 INFO:teuthology.orchestra.run.smithi110.stdout:(2/155): ceph-fuse-19.0.0-763.ga00c9940.el9.x86 3.4 MB/s | 886 kB 00:00 2024-01-20T08:07:35.913 INFO:teuthology.orchestra.run.smithi110.stdout:(3/155): ceph-immutable-object-cache-19.0.0-763 306 kB/s | 145 kB 00:00 2024-01-20T08:07:36.247 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T08:07:36.248 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-01-20T08:07:36.269 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-01-20T08:07:36.271 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-01-20T08:07:36.272 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-01-20T08:07:36.273 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-01-20T08:07:36.276 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-01-20T08:07:36.279 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-01-20T08:07:36.281 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-01-20T08:07:36.355 INFO:teuthology.orchestra.run.smithi110.stdout:(4/155): ceph-common-19.0.0-763.ga00c9940.el9.x 14 MB/s | 19 MB 00:01 2024-01-20T08:07:36.364 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2024-01-20T08:07:36.383 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================== 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================== 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-763.ga00c9940.el9 ceph 6.6 k 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-763.ga00c9940.el9 ceph 5.1 M 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 886 k 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-763.ga00c9940.el9 ceph 145 k 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-763.ga00c9940.el9 ceph 1.5 M 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 133 k 2024-01-20T08:07:36.384 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 1.7 M 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 7.4 M 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 51 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 8.6 M 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-763.ga00c9940.el9 ceph 46 M 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 262 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 742 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 217 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell x86_64 2:19.0.0-763.ga00c9940.el9 ceph 27 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 18 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 CentOS-AppStream 20 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 31 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 742 k 2024-01-20T08:07:36.385 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-763.ga00c9940.el9 ceph 127 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:3.0.7-25.el9 CentOS-AppStream 3.0 M 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-763.ga00c9940.el9 ceph 162 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-763.ga00c9940.el9 ceph 320 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 297 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-763.ga00c9940.el9 ceph 99 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 85 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 170 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 CentOS-AppStream 87 k 2024-01-20T08:07:36.386 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager x86_64 1:1.45.10-1.el9 CentOS-BaseOS 2.2 M 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm x86_64 1:1.45.10-1.el9 CentOS-BaseOS 1.8 M 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team x86_64 1:1.45.10-1.el9 CentOS-BaseOS 42 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui x86_64 1:1.45.10-1.el9 CentOS-BaseOS 246 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 CentOS-BaseOS 35 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf x86_64 0.190-2.el9 CentOS-BaseOS 191 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs x86_64 0.190-2.el9 CentOS-BaseOS 254 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.4 M 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 3.1 M 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:3.0.7-25.el9 CentOS-BaseOS 1.2 M 2024-01-20T08:07:36.387 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:3.0.7-25.el9 CentOS-BaseOS 2.1 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs x86_64 6.3.0-1.el9 CentOS-BaseOS 1.1 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 19 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 28 k 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-763.ga00c9940.el9 ceph 2.1 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 245 k 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.7 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-763.ga00c9940.el9 ceph 17 M 2024-01-20T08:07:36.388 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-763.ga00c9940.el9 ceph-noarch 15 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-763.ga00c9940.el9 ceph 25 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_64 1.6-16.el9 CentOS-BaseOS 186 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-763.ga00c9940.el9 ceph 163 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 11.4.1-3.el9 CentOS-BaseOS 802 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 11.4.1-3.el9 CentOS-BaseOS 194 k 2024-01-20T08:07:36.389 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 499 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-763.ga00c9940.el9 ceph 4.8 M 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-BaseOS 217 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-01-20T08:07:36.390 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-763.ga00c9940.el9 ceph 45 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-763.ga00c9940.el9 ceph 130 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-01-20T08:07:36.391 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:2.26.0-1.el9 epel 202 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-01-20T08:07:36.392 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-01-20T08:07:36.393 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-01-20T08:07:36.394 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-01-20T08:07:36.395 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================== 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout:Install 139 Packages 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 16 Packages 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:07:36.396 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 209 M 2024-01-20T08:07:36.397 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2024-01-20T08:07:36.447 INFO:teuthology.orchestra.run.smithi110.stdout:(5/155): ceph-mds-19.0.0-763.ga00c9940.el9.x86_ 4.0 MB/s | 2.1 MB 00:00 2024-01-20T08:07:36.530 INFO:teuthology.orchestra.run.smithi110.stdout:(6/155): ceph-mgr-19.0.0-763.ga00c9940.el9.x86_ 8.5 MB/s | 1.5 MB 00:00 2024-01-20T08:07:36.797 INFO:teuthology.orchestra.run.smithi110.stdout:(7/155): ceph-base-19.0.0-763.ga00c9940.el9.x86 2.7 MB/s | 5.1 MB 00:01 2024-01-20T08:07:37.089 INFO:teuthology.orchestra.run.smithi110.stdout:(8/155): ceph-mon-19.0.0-763.ga00c9940.el9.x86_ 7.3 MB/s | 4.7 MB 00:00 2024-01-20T08:07:37.156 INFO:teuthology.orchestra.run.smithi110.stdout:(9/155): ceph-selinux-19.0.0-763.ga00c9940.el9. 383 kB/s | 25 kB 00:00 2024-01-20T08:07:37.302 INFO:teuthology.orchestra.run.smithi100.stdout:(1/155): ceph-19.0.0-763.ga00c9940.el9.x86_64.r 14 kB/s | 6.6 kB 00:00 2024-01-20T08:07:37.590 INFO:teuthology.orchestra.run.smithi110.stdout:(10/155): ceph-osd-19.0.0-763.ga00c9940.el9.x86 16 MB/s | 17 MB 00:01 2024-01-20T08:07:37.665 INFO:teuthology.orchestra.run.smithi110.stdout:(11/155): cephfs-mirror-19.0.0-763.ga00c9940.el 2.9 MB/s | 217 kB 00:00 2024-01-20T08:07:37.724 INFO:teuthology.orchestra.run.smithi110.stdout:(12/155): cephfs-shell-19.0.0-763.ga00c9940.el9 470 kB/s | 27 kB 00:00 2024-01-20T08:07:37.760 INFO:teuthology.orchestra.run.smithi100.stdout:(2/155): ceph-fuse-19.0.0-763.ga00c9940.el9.x86 1.9 MB/s | 886 kB 00:00 2024-01-20T08:07:37.782 INFO:teuthology.orchestra.run.smithi110.stdout:(13/155): libcephfs-devel-19.0.0-763.ga00c9940. 541 kB/s | 31 kB 00:00 2024-01-20T08:07:37.836 INFO:teuthology.orchestra.run.smithi100.stdout:(3/155): ceph-immutable-object-cache-19.0.0-763 1.9 MB/s | 145 kB 00:00 2024-01-20T08:07:37.924 INFO:teuthology.orchestra.run.smithi110.stdout:(14/155): libcephfs2-19.0.0-763.ga00c9940.el9.x 5.1 MB/s | 742 kB 00:00 2024-01-20T08:07:38.051 INFO:teuthology.orchestra.run.smithi110.stdout:(15/155): libcephsqlite-19.0.0-763.ga00c9940.el 1.3 MB/s | 163 kB 00:00 2024-01-20T08:07:38.125 INFO:teuthology.orchestra.run.smithi110.stdout:(16/155): librados-devel-19.0.0-763.ga00c9940.e 1.7 MB/s | 127 kB 00:00 2024-01-20T08:07:38.225 INFO:teuthology.orchestra.run.smithi110.stdout:(17/155): libradosstriper1-19.0.0-763.ga00c9940 4.9 MB/s | 499 kB 00:00 2024-01-20T08:07:38.278 INFO:teuthology.orchestra.run.smithi100.stdout:(4/155): ceph-mds-19.0.0-763.ga00c9940.el9.x86_ 4.8 MB/s | 2.1 MB 00:00 2024-01-20T08:07:38.734 INFO:teuthology.orchestra.run.smithi110.stdout:(18/155): librgw2-19.0.0-763.ga00c9940.el9.x86_ 9.4 MB/s | 4.8 MB 00:00 2024-01-20T08:07:38.817 INFO:teuthology.orchestra.run.smithi110.stdout:(19/155): python3-ceph-argparse-19.0.0-763.ga00 548 kB/s | 45 kB 00:00 2024-01-20T08:07:38.844 INFO:teuthology.orchestra.run.smithi100.stdout:(5/155): ceph-base-19.0.0-763.ga00c9940.el9.x86 2.6 MB/s | 5.1 MB 00:01 2024-01-20T08:07:38.884 INFO:teuthology.orchestra.run.smithi110.stdout:(20/155): python3-ceph-common-19.0.0-763.ga00c9 1.9 MB/s | 130 kB 00:00 2024-01-20T08:07:38.968 INFO:teuthology.orchestra.run.smithi110.stdout:(21/155): python3-cephfs-19.0.0-763.ga00c9940.e 1.9 MB/s | 162 kB 00:00 2024-01-20T08:07:38.986 INFO:teuthology.orchestra.run.smithi100.stdout:(6/155): ceph-mgr-19.0.0-763.ga00c9940.el9.x86_ 2.1 MB/s | 1.5 MB 00:00 2024-01-20T08:07:39.127 INFO:teuthology.orchestra.run.smithi110.stdout:(22/155): ceph-radosgw-19.0.0-763.ga00c9940.el9 3.7 MB/s | 8.6 MB 00:02 2024-01-20T08:07:39.160 INFO:teuthology.orchestra.run.smithi110.stdout:(23/155): python3-rados-19.0.0-763.ga00c9940.el 1.6 MB/s | 320 kB 00:00 2024-01-20T08:07:39.260 INFO:teuthology.orchestra.run.smithi110.stdout:(24/155): python3-rgw-19.0.0-763.ga00c9940.el9. 998 kB/s | 99 kB 00:00 2024-01-20T08:07:39.304 INFO:teuthology.orchestra.run.smithi110.stdout:(25/155): python3-rbd-19.0.0-763.ga00c9940.el9. 1.6 MB/s | 297 kB 00:00 2024-01-20T08:07:39.346 INFO:teuthology.orchestra.run.smithi110.stdout:(26/155): rbd-fuse-19.0.0-763.ga00c9940.el9.x86 1.0 MB/s | 85 kB 00:00 2024-01-20T08:07:39.447 INFO:teuthology.orchestra.run.smithi110.stdout:(27/155): rbd-nbd-19.0.0-763.ga00c9940.el9.x86_ 1.7 MB/s | 170 kB 00:00 2024-01-20T08:07:39.547 INFO:teuthology.orchestra.run.smithi110.stdout:(28/155): ceph-grafana-dashboards-19.0.0-763.ga 285 kB/s | 28 kB 00:00 2024-01-20T08:07:39.647 INFO:teuthology.orchestra.run.smithi110.stdout:(29/155): ceph-mgr-cephadm-19.0.0-763.ga00c9940 1.3 MB/s | 133 kB 00:00 2024-01-20T08:07:39.653 INFO:teuthology.orchestra.run.smithi100.stdout:(7/155): ceph-mon-19.0.0-763.ga00c9940.el9.x86_ 5.8 MB/s | 4.7 MB 00:00 2024-01-20T08:07:39.923 INFO:teuthology.orchestra.run.smithi110.stdout:(30/155): ceph-mgr-dashboard-19.0.0-763.ga00c99 6.3 MB/s | 1.7 MB 00:00 2024-01-20T08:07:40.364 INFO:teuthology.orchestra.run.smithi110.stdout:(31/155): rbd-mirror-19.0.0-763.ga00c9940.el9.x 2.9 MB/s | 3.1 MB 00:01 2024-01-20T08:07:40.723 INFO:teuthology.orchestra.run.smithi110.stdout:(32/155): ceph-mgr-modules-core-19.0.0-763.ga00 685 kB/s | 245 kB 00:00 2024-01-20T08:07:40.906 INFO:teuthology.orchestra.run.smithi110.stdout:(33/155): ceph-mgr-diskprediction-local-19.0.0- 7.5 MB/s | 7.4 MB 00:00 2024-01-20T08:07:40.932 INFO:teuthology.orchestra.run.smithi110.stdout:(34/155): ceph-mgr-rook-19.0.0-763.ga00c9940.el 244 kB/s | 51 kB 00:00 2024-01-20T08:07:40.962 INFO:teuthology.orchestra.run.smithi100.stdout:(8/155): ceph-common-19.0.0-763.ga00c9940.el9.x 4.7 MB/s | 19 MB 00:04 2024-01-20T08:07:40.965 INFO:teuthology.orchestra.run.smithi110.stdout:(35/155): ceph-prometheus-alerts-19.0.0-763.ga0 261 kB/s | 15 kB 00:00 2024-01-20T08:07:41.004 INFO:teuthology.orchestra.run.smithi100.stdout:(9/155): ceph-selinux-19.0.0-763.ga00c9940.el9. 623 kB/s | 25 kB 00:00 2024-01-20T08:07:41.082 INFO:teuthology.orchestra.run.smithi110.stdout:(36/155): cephadm-19.0.0-763.ga00c9940.el9.noar 6.3 MB/s | 742 kB 00:00 2024-01-20T08:07:41.127 INFO:teuthology.orchestra.run.smithi110.stdout:(37/155): ceph-volume-19.0.0-763.ga00c9940.el9. 1.3 MB/s | 262 kB 00:00 2024-01-20T08:07:41.149 INFO:teuthology.orchestra.run.smithi110.stdout:(38/155): cephfs-top-19.0.0-763.ga00c9940.el9.n 274 kB/s | 18 kB 00:00 2024-01-20T08:07:41.583 INFO:teuthology.orchestra.run.smithi110.stdout:(39/155): automake-1.16.2-8.el9.noarch.rpm 1.4 MB/s | 662 kB 00:00 2024-01-20T08:07:41.668 INFO:teuthology.orchestra.run.smithi110.stdout:(40/155): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 920 kB 00:00 2024-01-20T08:07:41.696 INFO:teuthology.orchestra.run.smithi100.stdout:(10/155): ceph-radosgw-19.0.0-763.ga00c9940.el9 4.2 MB/s | 8.6 MB 00:02 2024-01-20T08:07:41.700 INFO:teuthology.orchestra.run.smithi110.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 932 kB/s | 106 kB 00:00 2024-01-20T08:07:41.742 INFO:teuthology.orchestra.run.smithi110.stdout:(42/155): elfutils-libelf-devel-0.190-2.el9.x86 503 kB/s | 20 kB 00:00 2024-01-20T08:07:41.763 INFO:teuthology.orchestra.run.smithi100.stdout:(11/155): cephfs-mirror-19.0.0-763.ga00c9940.el 3.2 MB/s | 217 kB 00:00 2024-01-20T08:07:41.784 INFO:teuthology.orchestra.run.smithi110.stdout:(43/155): flex-2.6.4-9.el9.x86_64.rpm 3.7 MB/s | 307 kB 00:00 2024-01-20T08:07:41.809 INFO:teuthology.orchestra.run.smithi110.stdout:(44/155): flexiblas-3.0.4-8.el9.x86_64.rpm 496 kB/s | 32 kB 00:00 2024-01-20T08:07:41.813 INFO:teuthology.orchestra.run.smithi100.stdout:(12/155): cephfs-shell-19.0.0-763.ga00c9940.el9 551 kB/s | 27 kB 00:00 2024-01-20T08:07:41.864 INFO:teuthology.orchestra.run.smithi100.stdout:(13/155): libcephfs-devel-19.0.0-763.ga00c9940. 634 kB/s | 31 kB 00:00 2024-01-20T08:07:41.885 INFO:teuthology.orchestra.run.smithi110.stdout:(45/155): flexiblas-openblas-openmp-3.0.4-8.el9 243 kB/s | 17 kB 00:00 2024-01-20T08:07:41.952 INFO:teuthology.orchestra.run.smithi110.stdout:(46/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 18 MB/s | 3.0 MB 00:00 2024-01-20T08:07:41.977 INFO:teuthology.orchestra.run.smithi110.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 112 kB/s | 10 kB 00:00 2024-01-20T08:07:42.002 INFO:teuthology.orchestra.run.smithi110.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.2 MB/s | 159 kB 00:00 2024-01-20T08:07:42.005 INFO:teuthology.orchestra.run.smithi100.stdout:(14/155): libcephfs2-19.0.0-763.ga00c9940.el9.x 5.1 MB/s | 742 kB 00:00 2024-01-20T08:07:42.027 INFO:teuthology.orchestra.run.smithi110.stdout:(49/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 920 kB/s | 44 kB 00:00 2024-01-20T08:07:42.064 INFO:teuthology.orchestra.run.smithi100.stdout:(15/155): libcephsqlite-19.0.0-763.ga00c9940.el 2.8 MB/s | 163 kB 00:00 2024-01-20T08:07:42.069 INFO:teuthology.orchestra.run.smithi110.stdout:(50/155): librdkafka-1.6.1-102.el9.x86_64.rpm 9.9 MB/s | 661 kB 00:00 2024-01-20T08:07:42.120 INFO:teuthology.orchestra.run.smithi110.stdout:(51/155): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2024-01-20T08:07:42.122 INFO:teuthology.orchestra.run.smithi100.stdout:(16/155): librados-devel-19.0.0-763.ga00c9940.e 2.2 MB/s | 127 kB 00:00 2024-01-20T08:07:42.145 INFO:teuthology.orchestra.run.smithi110.stdout:(52/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 350 kB/s | 24 kB 00:00 2024-01-20T08:07:42.170 INFO:teuthology.orchestra.run.smithi110.stdout:(53/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 944 kB/s | 46 kB 00:00 2024-01-20T08:07:42.204 INFO:teuthology.orchestra.run.smithi110.stdout:(54/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-01-20T08:07:42.237 INFO:teuthology.orchestra.run.smithi110.stdout:(55/155): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-01-20T08:07:42.239 INFO:teuthology.orchestra.run.smithi100.stdout:(17/155): libradosstriper1-19.0.0-763.ga00c9940 4.2 MB/s | 499 kB 00:00 2024-01-20T08:07:42.271 INFO:teuthology.orchestra.run.smithi110.stdout:(56/155): openblas-0.3.21-2.el9.x86_64.rpm 511 kB/s | 34 kB 00:00 2024-01-20T08:07:42.596 INFO:teuthology.orchestra.run.smithi110.stdout:(57/155): openblas-openmp-0.3.21-2.el9.x86_64.r 13 MB/s | 4.7 MB 00:00 2024-01-20T08:07:42.680 INFO:teuthology.orchestra.run.smithi110.stdout:(58/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 3.0 MB 00:00 2024-01-20T08:07:42.739 INFO:teuthology.orchestra.run.smithi110.stdout:(59/155): postgresql-13.11-1.el9.x86_64.rpm 11 MB/s | 1.5 MB 00:00 2024-01-20T08:07:42.789 INFO:teuthology.orchestra.run.smithi110.stdout:(60/155): postgresql-contrib-13.11-1.el9.x86_64 8.3 MB/s | 811 kB 00:00 2024-01-20T08:07:42.840 INFO:teuthology.orchestra.run.smithi110.stdout:(61/155): postgresql-private-libs-13.11-1.el9.x 1.4 MB/s | 134 kB 00:00 2024-01-20T08:07:42.957 INFO:teuthology.orchestra.run.smithi100.stdout:(18/155): librgw2-19.0.0-763.ga00c9940.el9.x86_ 6.7 MB/s | 4.8 MB 00:00 2024-01-20T08:07:43.007 INFO:teuthology.orchestra.run.smithi100.stdout:(19/155): python3-ceph-argparse-19.0.0-763.ga00 923 kB/s | 45 kB 00:00 2024-01-20T08:07:43.031 INFO:teuthology.orchestra.run.smithi110.stdout:(62/155): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-01-20T08:07:43.056 INFO:teuthology.orchestra.run.smithi110.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 384 kB/s | 78 kB 00:00 2024-01-20T08:07:43.074 INFO:teuthology.orchestra.run.smithi100.stdout:(20/155): python3-ceph-common-19.0.0-763.ga00c9 1.9 MB/s | 130 kB 00:00 2024-01-20T08:07:43.141 INFO:teuthology.orchestra.run.smithi100.stdout:(21/155): python3-cephfs-19.0.0-763.ga00c9940.e 2.4 MB/s | 162 kB 00:00 2024-01-20T08:07:43.241 INFO:teuthology.orchestra.run.smithi100.stdout:(22/155): python3-rados-19.0.0-763.ga00c9940.el 3.2 MB/s | 320 kB 00:00 2024-01-20T08:07:43.274 INFO:teuthology.orchestra.run.smithi110.stdout:(64/155): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2024-01-20T08:07:43.299 INFO:teuthology.orchestra.run.smithi110.stdout:(65/155): python3-jinja2-2.11.3-4.el9.noarch.rp 1.0 MB/s | 228 kB 00:00 2024-01-20T08:07:43.316 INFO:teuthology.orchestra.run.smithi100.stdout:(23/155): python3-rbd-19.0.0-763.ga00c9940.el9. 3.9 MB/s | 297 kB 00:00 2024-01-20T08:07:43.324 INFO:teuthology.orchestra.run.smithi110.stdout:(66/155): python3-jsonpatch-1.21-16.el9.noarch. 502 kB/s | 24 kB 00:00 2024-01-20T08:07:43.349 INFO:teuthology.orchestra.run.smithi110.stdout:(67/155): python3-jsonpointer-2.0-4.el9.noarch. 368 kB/s | 18 kB 00:00 2024-01-20T08:07:43.375 INFO:teuthology.orchestra.run.smithi110.stdout:(68/155): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2024-01-20T08:07:43.375 INFO:teuthology.orchestra.run.smithi100.stdout:(24/155): python3-rgw-19.0.0-763.ga00c9940.el9. 1.7 MB/s | 99 kB 00:00 2024-01-20T08:07:43.400 INFO:teuthology.orchestra.run.smithi110.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 655 kB/s | 32 kB 00:00 2024-01-20T08:07:43.434 INFO:teuthology.orchestra.run.smithi100.stdout:(25/155): rbd-fuse-19.0.0-763.ga00c9940.el9.x86 1.4 MB/s | 85 kB 00:00 2024-01-20T08:07:43.534 INFO:teuthology.orchestra.run.smithi110.stdout:(70/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2024-01-20T08:07:43.567 INFO:teuthology.orchestra.run.smithi110.stdout:(71/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.4 MB/s | 217 kB 00:00 2024-01-20T08:07:43.842 INFO:teuthology.orchestra.run.smithi100.stdout:(26/155): rbd-mirror-19.0.0-763.ga00c9940.el9.x 7.6 MB/s | 3.1 MB 00:00 2024-01-20T08:07:44.059 INFO:teuthology.orchestra.run.smithi110.stdout:(72/155): ceph-test-19.0.0-763.ga00c9940.el9.x8 6.6 MB/s | 46 MB 00:06 2024-01-20T08:07:44.068 INFO:teuthology.orchestra.run.smithi100.stdout:(27/155): ceph-osd-19.0.0-763.ga00c9940.el9.x86 3.3 MB/s | 17 MB 00:05 2024-01-20T08:07:44.084 INFO:teuthology.orchestra.run.smithi110.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 318 kB/s | 174 kB 00:00 2024-01-20T08:07:44.101 INFO:teuthology.orchestra.run.smithi100.stdout:(28/155): rbd-nbd-19.0.0-763.ga00c9940.el9.x86_ 661 kB/s | 170 kB 00:00 2024-01-20T08:07:44.109 INFO:teuthology.orchestra.run.smithi110.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 76 kB/s | 41 kB 00:00 2024-01-20T08:07:44.143 INFO:teuthology.orchestra.run.smithi110.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-01-20T08:07:44.151 INFO:teuthology.orchestra.run.smithi100.stdout:(29/155): ceph-grafana-dashboards-19.0.0-763.ga 344 kB/s | 28 kB 00:00 2024-01-20T08:07:44.168 INFO:teuthology.orchestra.run.smithi110.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-01-20T08:07:44.193 INFO:teuthology.orchestra.run.smithi100.stdout:(30/155): ceph-mgr-cephadm-19.0.0-763.ga00c9940 1.4 MB/s | 133 kB 00:00 2024-01-20T08:07:44.194 INFO:teuthology.orchestra.run.smithi110.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 590 kB/s | 47 kB 00:00 2024-01-20T08:07:44.227 INFO:teuthology.orchestra.run.smithi110.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 744 kB/s | 43 kB 00:00 2024-01-20T08:07:44.402 INFO:teuthology.orchestra.run.smithi110.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 193 kB/s | 39 kB 00:00 2024-01-20T08:07:44.645 INFO:teuthology.orchestra.run.smithi110.stdout:(80/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-01-20T08:07:44.669 INFO:teuthology.orchestra.run.smithi110.stdout:(81/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 95 kB/s | 41 kB 00:00 2024-01-20T08:07:44.703 INFO:teuthology.orchestra.run.smithi110.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-01-20T08:07:44.728 INFO:teuthology.orchestra.run.smithi110.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-01-20T08:07:44.754 INFO:teuthology.orchestra.run.smithi110.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.1 MB/s | 87 kB 00:00 2024-01-20T08:07:44.779 INFO:teuthology.orchestra.run.smithi110.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 853 kB/s | 63 kB 00:00 2024-01-20T08:07:44.804 INFO:teuthology.orchestra.run.smithi110.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 900 kB/s | 44 kB 00:00 2024-01-20T08:07:44.830 INFO:teuthology.orchestra.run.smithi110.stdout:(87/155): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2024-01-20T08:07:44.844 INFO:teuthology.orchestra.run.smithi100.stdout:(31/155): ceph-mgr-dashboard-19.0.0-763.ga00c99 2.5 MB/s | 1.7 MB 00:00 2024-01-20T08:07:44.855 INFO:teuthology.orchestra.run.smithi110.stdout:(88/155): jq-1.6-16.el9.x86_64.rpm 2.4 MB/s | 186 kB 00:00 2024-01-20T08:07:44.897 INFO:teuthology.orchestra.run.smithi110.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 8.7 MB/s | 802 kB 00:00 2024-01-20T08:07:44.922 INFO:teuthology.orchestra.run.smithi110.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 2.2 MB/s | 194 kB 00:00 2024-01-20T08:07:44.955 INFO:teuthology.orchestra.run.smithi110.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2024-01-20T08:07:44.989 INFO:teuthology.orchestra.run.smithi110.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 241 kB 00:00 2024-01-20T08:07:45.031 INFO:teuthology.orchestra.run.smithi110.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-01-20T08:07:45.081 INFO:teuthology.orchestra.run.smithi110.stdout:(94/155): python3-ply-3.11-14.el9.noarch.rpm 826 kB/s | 103 kB 00:00 2024-01-20T08:07:45.106 INFO:teuthology.orchestra.run.smithi110.stdout:(95/155): python3-pycparser-2.20-6.el9.noarch.r 1.1 MB/s | 124 kB 00:00 2024-01-20T08:07:45.140 INFO:teuthology.orchestra.run.smithi110.stdout:(96/155): python3-urllib3-1.26.5-5.el9.noarch.r 3.3 MB/s | 187 kB 00:00 2024-01-20T08:07:45.165 INFO:teuthology.orchestra.run.smithi110.stdout:(97/155): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2024-01-20T08:07:45.369 INFO:teuthology.orchestra.run.smithi100.stdout:(32/155): ceph-test-19.0.0-763.ga00c9940.el9.x8 10 MB/s | 46 MB 00:04 2024-01-20T08:07:45.403 INFO:teuthology.orchestra.run.smithi100.stdout:(33/155): ceph-mgr-modules-core-19.0.0-763.ga00 438 kB/s | 245 kB 00:00 2024-01-20T08:07:45.545 INFO:teuthology.orchestra.run.smithi100.stdout:(34/155): ceph-mgr-diskprediction-local-19.0.0- 5.5 MB/s | 7.4 MB 00:01 2024-01-20T08:07:45.562 INFO:teuthology.orchestra.run.smithi100.stdout:(35/155): ceph-prometheus-alerts-19.0.0-763.ga0 96 kB/s | 15 kB 00:00 2024-01-20T08:07:45.587 INFO:teuthology.orchestra.run.smithi100.stdout:(36/155): ceph-mgr-rook-19.0.0-763.ga00c9940.el 234 kB/s | 51 kB 00:00 2024-01-20T08:07:45.629 INFO:teuthology.orchestra.run.smithi100.stdout:(37/155): cephfs-top-19.0.0-763.ga00c9940.el9.n 448 kB/s | 18 kB 00:00 2024-01-20T08:07:45.716 INFO:teuthology.orchestra.run.smithi110.stdout:(98/155): python3-devel-3.9.17-2.el9.x86_64.rpm 405 kB/s | 245 kB 00:00 2024-01-20T08:07:45.737 INFO:teuthology.orchestra.run.smithi100.stdout:(38/155): ceph-volume-19.0.0-763.ga00c9940.el9. 1.3 MB/s | 262 kB 00:00 2024-01-20T08:07:45.749 INFO:teuthology.orchestra.run.smithi110.stdout:(99/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 530 kB/s | 309 kB 00:00 2024-01-20T08:07:45.780 INFO:teuthology.orchestra.run.smithi100.stdout:(39/155): cephadm-19.0.0-763.ga00c9940.el9.noar 3.3 MB/s | 742 kB 00:00 2024-01-20T08:07:45.858 INFO:teuthology.orchestra.run.smithi110.stdout:(100/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 241 kB/s | 26 kB 00:00 2024-01-20T08:07:45.900 INFO:teuthology.orchestra.run.smithi110.stdout:(101/155): lua-devel-5.4.4-4.el9.x86_64.rpm 29 kB/s | 22 kB 00:00 2024-01-20T08:07:45.958 INFO:teuthology.orchestra.run.smithi110.stdout:(102/155): liboath-2.6.7-2.el9.x86_64.rpm 487 kB/s | 49 kB 00:00 2024-01-20T08:07:45.997 INFO:teuthology.orchestra.run.smithi100.stdout:(40/155): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2024-01-20T08:07:46.030 INFO:teuthology.orchestra.run.smithi100.stdout:(41/155): boost-program-options-1.75.0-8.el9.x8 424 kB/s | 106 kB 00:00 2024-01-20T08:07:46.067 INFO:teuthology.orchestra.run.smithi110.stdout:(103/155): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-01-20T08:07:46.081 INFO:teuthology.orchestra.run.smithi100.stdout:(42/155): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2024-01-20T08:07:46.106 INFO:teuthology.orchestra.run.smithi100.stdout:(43/155): elfutils-libelf-devel-0.190-2.el9.x86 192 kB/s | 20 kB 00:00 2024-01-20T08:07:46.131 INFO:teuthology.orchestra.run.smithi100.stdout:(44/155): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 307 kB 00:00 2024-01-20T08:07:46.157 INFO:teuthology.orchestra.run.smithi100.stdout:(45/155): flexiblas-3.0.4-8.el9.x86_64.rpm 437 kB/s | 32 kB 00:00 2024-01-20T08:07:46.182 INFO:teuthology.orchestra.run.smithi100.stdout:(46/155): flexiblas-openblas-openmp-3.0.4-8.el9 352 kB/s | 17 kB 00:00 2024-01-20T08:07:46.275 INFO:teuthology.orchestra.run.smithi110.stdout:(104/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-01-20T08:07:46.301 INFO:teuthology.orchestra.run.smithi110.stdout:(105/155): libunwind-1.6.2-1.el9.x86_64.rpm 170 kB/s | 67 kB 00:00 2024-01-20T08:07:46.324 INFO:teuthology.orchestra.run.smithi100.stdout:(47/155): libaio-devel-0.3.111-13.el9.x86_64.rp 61 kB/s | 10 kB 00:00 2024-01-20T08:07:46.365 INFO:teuthology.orchestra.run.smithi100.stdout:(48/155): libpmemobj-1.12.1-1.el9.x86_64.rpm 881 kB/s | 159 kB 00:00 2024-01-20T08:07:46.384 INFO:teuthology.orchestra.run.smithi110.stdout:(106/155): python3-asyncssh-2.13.2-3.el9.noarch 5.0 MB/s | 548 kB 00:00 2024-01-20T08:07:46.409 INFO:teuthology.orchestra.run.smithi110.stdout:(107/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 403 kB/s | 43 kB 00:00 2024-01-20T08:07:46.460 INFO:teuthology.orchestra.run.smithi110.stdout:(108/155): python3-cachetools-4.2.4-1.el9.noarc 434 kB/s | 32 kB 00:00 2024-01-20T08:07:46.493 INFO:teuthology.orchestra.run.smithi110.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 180 kB/s | 15 kB 00:00 2024-01-20T08:07:46.549 INFO:teuthology.orchestra.run.smithi100.stdout:(49/155): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.2 MB/s | 3.0 MB 00:00 2024-01-20T08:07:46.583 INFO:teuthology.orchestra.run.smithi100.stdout:(50/155): librabbitmq-0.11.0-7.el9.x86_64.rpm 173 kB/s | 44 kB 00:00 2024-01-20T08:07:46.594 INFO:teuthology.orchestra.run.smithi110.stdout:(110/155): libarrow-9.0.0-10.el9.x86_64.rpm 5.0 MB/s | 4.4 MB 00:00 2024-01-20T08:07:46.624 INFO:teuthology.orchestra.run.smithi100.stdout:(51/155): librdkafka-1.6.1-102.el9.x86_64.rpm 2.5 MB/s | 661 kB 00:00 2024-01-20T08:07:46.627 INFO:teuthology.orchestra.run.smithi110.stdout:(111/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.0 MB/s | 172 kB 00:00 2024-01-20T08:07:46.666 INFO:teuthology.orchestra.run.smithi100.stdout:(52/155): libtool-2.4.6-45.el9.x86_64.rpm 5.1 MB/s | 578 kB 00:00 2024-01-20T08:07:46.692 INFO:teuthology.orchestra.run.smithi100.stdout:(53/155): libuuid-devel-2.37.4-15.el9.x86_64.rp 401 kB/s | 24 kB 00:00 2024-01-20T08:07:46.694 INFO:teuthology.orchestra.run.smithi110.stdout:(112/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-01-20T08:07:46.719 INFO:teuthology.orchestra.run.smithi110.stdout:(113/155): python3-colorama-0.4.4-12.el9.noarch 387 kB/s | 35 kB 00:00 2024-01-20T08:07:46.738 INFO:teuthology.orchestra.run.smithi100.stdout:(54/155): libzstd-devel-1.5.1-2.el9.x86_64.rpm 434 kB/s | 46 kB 00:00 2024-01-20T08:07:46.753 INFO:teuthology.orchestra.run.smithi110.stdout:(114/155): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2024-01-20T08:07:46.776 INFO:teuthology.orchestra.run.smithi100.stdout:(55/155): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 282 kB 00:00 2024-01-20T08:07:46.787 INFO:teuthology.orchestra.run.smithi110.stdout:(115/155): python3-google-auth-2.26.0-1.el9.noa 2.2 MB/s | 202 kB 00:00 2024-01-20T08:07:46.801 INFO:teuthology.orchestra.run.smithi100.stdout:(56/155): openblas-0.3.21-2.el9.x86_64.rpm 577 kB/s | 34 kB 00:00 2024-01-20T08:07:46.812 INFO:teuthology.orchestra.run.smithi110.stdout:(116/155): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-01-20T08:07:46.834 INFO:teuthology.orchestra.run.smithi100.stdout:(57/155): lua-5.4.4-4.el9.x86_64.rpm 2.0 MB/s | 187 kB 00:00 2024-01-20T08:07:46.837 INFO:teuthology.orchestra.run.smithi110.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2024-01-20T08:07:46.871 INFO:teuthology.orchestra.run.smithi110.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 277 kB/s | 23 kB 00:00 2024-01-20T08:07:46.896 INFO:teuthology.orchestra.run.smithi110.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 233 kB/s | 19 kB 00:00 2024-01-20T08:07:46.921 INFO:teuthology.orchestra.run.smithi110.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 236 kB/s | 20 kB 00:00 2024-01-20T08:07:47.014 INFO:teuthology.orchestra.run.smithi110.stdout:(121/155): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-01-20T08:07:47.039 INFO:teuthology.orchestra.run.smithi110.stdout:(122/155): python3-logutils-0.3.5-21.el9.noarch 327 kB/s | 46 kB 00:00 2024-01-20T08:07:47.064 INFO:teuthology.orchestra.run.smithi110.stdout:(123/155): python3-more-itertools-8.12.0-2.el9. 558 kB/s | 79 kB 00:00 2024-01-20T08:07:47.089 INFO:teuthology.orchestra.run.smithi110.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 773 kB/s | 58 kB 00:00 2024-01-20T08:07:47.139 INFO:teuthology.orchestra.run.smithi110.stdout:(125/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-01-20T08:07:47.156 INFO:teuthology.orchestra.run.smithi110.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 180 kB/s | 16 kB 00:00 2024-01-20T08:07:47.182 INFO:teuthology.orchestra.run.smithi110.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 982 kB/s | 90 kB 00:00 2024-01-20T08:07:47.224 INFO:teuthology.orchestra.run.smithi110.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 338 kB/s | 28 kB 00:00 2024-01-20T08:07:47.226 INFO:teuthology.orchestra.run.smithi100.stdout:(58/155): postgresql-13.11-1.el9.x86_64.rpm 3.9 MB/s | 1.5 MB 00:00 2024-01-20T08:07:47.241 INFO:teuthology.orchestra.run.smithi110.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 370 kB/s | 31 kB 00:00 2024-01-20T08:07:47.300 INFO:teuthology.orchestra.run.smithi110.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-01-20T08:07:47.301 INFO:teuthology.orchestra.run.smithi100.stdout:(59/155): openssl-devel-3.0.7-25.el9.x86_64.rpm 6.0 MB/s | 3.0 MB 00:00 2024-01-20T08:07:47.333 INFO:teuthology.orchestra.run.smithi110.stdout:(131/155): python3-rsa-4.9-2.el9.noarch.rpm 547 kB/s | 59 kB 00:00 2024-01-20T08:07:47.358 INFO:teuthology.orchestra.run.smithi110.stdout:(132/155): python3-tempora-5.0.0-2.el9.noarch.r 306 kB/s | 36 kB 00:00 2024-01-20T08:07:47.400 INFO:teuthology.orchestra.run.smithi110.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 514 kB/s | 51 kB 00:00 2024-01-20T08:07:47.410 INFO:teuthology.orchestra.run.smithi100.stdout:(60/155): openblas-openmp-0.3.21-2.el9.x86_64.r 7.5 MB/s | 4.7 MB 00:00 2024-01-20T08:07:47.442 INFO:teuthology.orchestra.run.smithi110.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-01-20T08:07:47.452 INFO:teuthology.orchestra.run.smithi100.stdout:(61/155): postgresql-contrib-13.11-1.el9.x86_64 3.6 MB/s | 811 kB 00:00 2024-01-20T08:07:47.467 INFO:teuthology.orchestra.run.smithi110.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 828 kB/s | 90 kB 00:00 2024-01-20T08:07:47.478 INFO:teuthology.orchestra.run.smithi100.stdout:(62/155): postgresql-private-libs-13.11-1.el9.x 802 kB/s | 134 kB 00:00 2024-01-20T08:07:47.501 INFO:teuthology.orchestra.run.smithi110.stdout:(136/155): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-01-20T08:07:47.511 INFO:teuthology.orchestra.run.smithi100.stdout:(63/155): python3-attrs-20.3.0-7.el9.noarch.rpm 1.4 MB/s | 78 kB 00:00 2024-01-20T08:07:47.526 INFO:teuthology.orchestra.run.smithi110.stdout:(137/155): python3-zc-lockfile-2.0-10.el9.noarc 240 kB/s | 20 kB 00:00 2024-01-20T08:07:47.568 INFO:teuthology.orchestra.run.smithi110.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-01-20T08:07:47.745 INFO:teuthology.orchestra.run.smithi100.stdout:(64/155): postgresql-server-13.11-1.el9.x86_64. 20 MB/s | 5.7 MB 00:00 2024-01-20T08:07:47.827 INFO:teuthology.orchestra.run.smithi110.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 4.9 MB/s | 1.6 MB 00:00 2024-01-20T08:07:47.868 INFO:teuthology.orchestra.run.smithi110.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-01-20T08:07:47.903 INFO:teuthology.orchestra.run.smithi100.stdout:(65/155): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2024-01-20T08:07:47.937 INFO:teuthology.orchestra.run.smithi100.stdout:(66/155): python3-jinja2-2.11.3-4.el9.noarch.rp 554 kB/s | 228 kB 00:00 2024-01-20T08:07:47.954 INFO:teuthology.orchestra.run.smithi100.stdout:(67/155): python3-jsonpatch-1.21-16.el9.noarch. 124 kB/s | 24 kB 00:00 2024-01-20T08:07:47.969 INFO:teuthology.orchestra.run.smithi110.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 23 MB/s | 2.2 MB 00:00 2024-01-20T08:07:47.971 INFO:teuthology.orchestra.run.smithi100.stdout:(68/155): python3-jsonpointer-2.0-4.el9.noarch. 280 kB/s | 18 kB 00:00 2024-01-20T08:07:47.988 INFO:teuthology.orchestra.run.smithi100.stdout:(69/155): python3-markupsafe-1.1.1-12.el9.x86_6 983 kB/s | 32 kB 00:00 2024-01-20T08:07:48.044 INFO:teuthology.orchestra.run.smithi110.stdout:(142/155): librados2-19.0.0-763.ga00c9940.el9.x 6.5 MB/s | 3.4 MB 00:00 2024-01-20T08:07:48.046 INFO:teuthology.orchestra.run.smithi100.stdout:(70/155): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2024-01-20T08:07:48.111 INFO:teuthology.orchestra.run.smithi110.stdout:(143/155): NetworkManager-libnm-1.45.10-1.el9.x 13 MB/s | 1.8 MB 00:00 2024-01-20T08:07:48.136 INFO:teuthology.orchestra.run.smithi110.stdout:(144/155): NetworkManager-team-1.45.10-1.el9.x8 533 kB/s | 42 kB 00:00 2024-01-20T08:07:48.170 INFO:teuthology.orchestra.run.smithi110.stdout:(145/155): NetworkManager-tui-1.45.10-1.el9.x86 4.2 MB/s | 246 kB 00:00 2024-01-20T08:07:48.180 INFO:teuthology.orchestra.run.smithi100.stdout:(71/155): python3-numpy-1.20.1-5.el9.x86_64.rpm 23 MB/s | 4.8 MB 00:00 2024-01-20T08:07:48.195 INFO:teuthology.orchestra.run.smithi110.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2024-01-20T08:07:48.205 INFO:teuthology.orchestra.run.smithi100.stdout:(72/155): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.0 MB/s | 217 kB 00:00 2024-01-20T08:07:48.220 INFO:teuthology.orchestra.run.smithi110.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 721 kB/s | 35 kB 00:00 2024-01-20T08:07:48.230 INFO:teuthology.orchestra.run.smithi100.stdout:(73/155): python3-oauthlib-3.1.1-5.el9.noarch.r 1.0 MB/s | 174 kB 00:00 2024-01-20T08:07:48.256 INFO:teuthology.orchestra.run.smithi100.stdout:(74/155): python3-prettytable-0.7.2-27.el9.noar 1.7 MB/s | 41 kB 00:00 2024-01-20T08:07:48.287 INFO:teuthology.orchestra.run.smithi110.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 2.1 MB/s | 191 kB 00:00 2024-01-20T08:07:48.289 INFO:teuthology.orchestra.run.smithi100.stdout:(75/155): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-01-20T08:07:48.315 INFO:teuthology.orchestra.run.smithi100.stdout:(76/155): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 211 kB 00:00 2024-01-20T08:07:48.329 INFO:teuthology.orchestra.run.smithi110.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 254 kB 00:00 2024-01-20T08:07:48.331 INFO:teuthology.orchestra.run.smithi100.stdout:(77/155): python3-pytz-2021.1-5.el9.noarch.rpm 656 kB/s | 47 kB 00:00 2024-01-20T08:07:48.355 INFO:teuthology.orchestra.run.smithi110.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 341 kB/s | 22 kB 00:00 2024-01-20T08:07:48.365 INFO:teuthology.orchestra.run.smithi100.stdout:(78/155): python3-requests-oauthlib-1.3.0-12.el 878 kB/s | 43 kB 00:00 2024-01-20T08:07:48.413 INFO:teuthology.orchestra.run.smithi110.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 14 MB/s | 1.2 MB 00:00 2024-01-20T08:07:48.482 INFO:teuthology.orchestra.run.smithi100.stdout:(79/155): python3-toml-0.10.2-6.el9.noarch.rpm 259 kB/s | 39 kB 00:00 2024-01-20T08:07:48.497 INFO:teuthology.orchestra.run.smithi110.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 16 MB/s | 2.1 MB 00:00 2024-01-20T08:07:48.530 INFO:teuthology.orchestra.run.smithi110.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.0 MB/s | 321 kB 00:00 2024-01-20T08:07:48.581 INFO:teuthology.orchestra.run.smithi110.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-20T08:07:48.733 INFO:teuthology.orchestra.run.smithi100.stdout:(80/155): python3-scipy-1.6.2-8.el9.x86_64.rpm 38 MB/s | 16 MB 00:00 2024-01-20T08:07:48.758 INFO:teuthology.orchestra.run.smithi100.stdout:(81/155): python3-wcwidth-0.2.5-8.el9.noarch.rp 108 kB/s | 41 kB 00:00 2024-01-20T08:07:48.782 INFO:teuthology.orchestra.run.smithi100.stdout:(82/155): socat-1.7.4.1-5.el9.x86_64.rpm 1.0 MB/s | 300 kB 00:00 2024-01-20T08:07:48.808 INFO:teuthology.orchestra.run.smithi100.stdout:(83/155): uuid-1.6.2-55.el9.x86_64.rpm 787 kB/s | 56 kB 00:00 2024-01-20T08:07:48.833 INFO:teuthology.orchestra.run.smithi100.stdout:(84/155): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-01-20T08:07:48.840 INFO:teuthology.orchestra.run.smithi110.stdout:(155/155): librbd1-19.0.0-763.ga00c9940.el9.x86 2.5 MB/s | 3.1 MB 00:01 2024-01-20T08:07:48.855 INFO:teuthology.orchestra.run.smithi110.stdout:-------------------------------------------------------------------------------- 2024-01-20T08:07:48.856 INFO:teuthology.orchestra.run.smithi110.stdout:Total 14 MB/s | 209 MB 00:14 2024-01-20T08:07:48.858 INFO:teuthology.orchestra.run.smithi100.stdout:(85/155): xmlstarlet-1.6.1-20.el9.x86_64.rpm 846 kB/s | 63 kB 00:00 2024-01-20T08:07:48.909 INFO:teuthology.orchestra.run.smithi100.stdout:(86/155): zlib-devel-1.2.11-40.el9.x86_64.rpm 448 kB/s | 44 kB 00:00 2024-01-20T08:07:48.943 INFO:teuthology.orchestra.run.smithi100.stdout:(87/155): jq-1.6-16.el9.x86_64.rpm 2.2 MB/s | 186 kB 00:00 2024-01-20T08:07:48.943 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction check 2024-01-20T08:07:48.984 INFO:teuthology.orchestra.run.smithi100.stdout:(88/155): fuse-2.9.9-15.el9.x86_64.rpm 633 kB/s | 79 kB 00:00 2024-01-20T08:07:49.026 INFO:teuthology.orchestra.run.smithi100.stdout:(89/155): libgfortran-11.4.1-3.el9.x86_64.rpm 6.8 MB/s | 802 kB 00:00 2024-01-20T08:07:49.060 INFO:teuthology.orchestra.run.smithi100.stdout:(90/155): libquadmath-11.4.1-3.el9.x86_64.rpm 1.7 MB/s | 194 kB 00:00 2024-01-20T08:07:49.093 INFO:teuthology.orchestra.run.smithi100.stdout:(91/155): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-01-20T08:07:49.119 INFO:teuthology.orchestra.run.smithi100.stdout:(92/155): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 241 kB 00:00 2024-01-20T08:07:49.169 INFO:teuthology.orchestra.run.smithi100.stdout:(93/155): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-01-20T08:07:49.194 INFO:teuthology.orchestra.run.smithi100.stdout:(94/155): python3-pycparser-2.20-6.el9.noarch.r 1.9 MB/s | 124 kB 00:00 2024-01-20T08:07:49.220 INFO:teuthology.orchestra.run.smithi100.stdout:(95/155): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 103 kB 00:00 2024-01-20T08:07:49.253 INFO:teuthology.orchestra.run.smithi100.stdout:(96/155): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2024-01-20T08:07:49.280 INFO:teuthology.orchestra.run.smithi100.stdout:(97/155): python3-urllib3-1.26.5-5.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2024-01-20T08:07:49.281 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction check succeeded. 2024-01-20T08:07:49.281 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction test 2024-01-20T08:07:49.548 INFO:teuthology.orchestra.run.smithi100.stdout:(98/155): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.1 MB/s | 309 kB 00:00 2024-01-20T08:07:49.581 INFO:teuthology.orchestra.run.smithi100.stdout:(99/155): lua-devel-5.4.4-4.el9.x86_64.rpm 74 kB/s | 22 kB 00:00 2024-01-20T08:07:49.681 INFO:teuthology.orchestra.run.smithi100.stdout:(100/155): python3-devel-3.9.17-2.el9.x86_64.rp 535 kB/s | 245 kB 00:00 2024-01-20T08:07:49.698 INFO:teuthology.orchestra.run.smithi100.stdout:(101/155): libarrow-doc-9.0.0-10.el9.noarch.rpm 224 kB/s | 26 kB 00:00 2024-01-20T08:07:49.815 INFO:teuthology.orchestra.run.smithi100.stdout:(102/155): libarrow-9.0.0-10.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-01-20T08:07:49.832 INFO:teuthology.orchestra.run.smithi100.stdout:(103/155): liboath-2.6.7-2.el9.x86_64.rpm 325 kB/s | 49 kB 00:00 2024-01-20T08:07:49.858 INFO:teuthology.orchestra.run.smithi100.stdout:(104/155): libunwind-1.6.2-1.el9.x86_64.rpm 426 kB/s | 67 kB 00:00 2024-01-20T08:07:49.883 INFO:teuthology.orchestra.run.smithi100.stdout:(105/155): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-01-20T08:07:49.933 INFO:teuthology.orchestra.run.smithi100.stdout:(106/155): python3-bcrypt-3.2.2-1.el9.x86_64.rp 883 kB/s | 43 kB 00:00 2024-01-20T08:07:49.983 INFO:teuthology.orchestra.run.smithi100.stdout:(107/155): python3-cachetools-4.2.4-1.el9.noarc 654 kB/s | 32 kB 00:00 2024-01-20T08:07:50.025 INFO:teuthology.orchestra.run.smithi100.stdout:(108/155): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 838 kB 00:00 2024-01-20T08:07:50.042 INFO:teuthology.orchestra.run.smithi100.stdout:(109/155): python3-certifi-2021.10.8-2.el9.noar 259 kB/s | 15 kB 00:00 2024-01-20T08:07:50.084 INFO:teuthology.orchestra.run.smithi100.stdout:(110/155): python3-asyncssh-2.13.2-3.el9.noarch 2.4 MB/s | 548 kB 00:00 2024-01-20T08:07:50.117 INFO:teuthology.orchestra.run.smithi100.stdout:(111/155): python3-cheroot-8.6.0-4.el9.noarch.r 1.8 MB/s | 172 kB 00:00 2024-01-20T08:07:50.151 INFO:teuthology.orchestra.run.smithi100.stdout:(112/155): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-01-20T08:07:50.209 INFO:teuthology.orchestra.run.smithi100.stdout:(113/155): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.4 MB/s | 303 kB 00:00 2024-01-20T08:07:50.243 INFO:teuthology.orchestra.run.smithi100.stdout:(114/155): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2024-01-20T08:07:50.269 INFO:teuthology.orchestra.run.smithi100.stdout:(115/155): python3-jaraco-8.2.1-3.el9.noarch.rp 183 kB/s | 11 kB 00:00 2024-01-20T08:07:50.302 INFO:teuthology.orchestra.run.smithi100.stdout:(116/155): python3-google-auth-2.26.0-1.el9.noa 1.3 MB/s | 202 kB 00:00 2024-01-20T08:07:50.328 INFO:teuthology.orchestra.run.smithi100.stdout:(117/155): python3-jaraco-classes-3.2.1-5.el9.n 213 kB/s | 18 kB 00:00 2024-01-20T08:07:50.355 INFO:teuthology.orchestra.run.smithi100.stdout:(118/155): python3-jaraco-collections-3.0.0-8.e 278 kB/s | 23 kB 00:00 2024-01-20T08:07:50.378 INFO:teuthology.orchestra.run.smithi100.stdout:(119/155): python3-jaraco-functools-3.5.0-2.el9 261 kB/s | 19 kB 00:00 2024-01-20T08:07:50.403 INFO:teuthology.orchestra.run.smithi100.stdout:(120/155): python3-jaraco-text-3.2.0-6.el9.noar 400 kB/s | 20 kB 00:00 2024-01-20T08:07:50.437 INFO:teuthology.orchestra.run.smithi100.stdout:(121/155): python3-logutils-0.3.5-21.el9.noarch 798 kB/s | 46 kB 00:00 2024-01-20T08:07:50.462 INFO:teuthology.orchestra.run.smithi100.stdout:(122/155): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-01-20T08:07:50.504 INFO:teuthology.orchestra.run.smithi100.stdout:(123/155): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-01-20T08:07:50.529 INFO:teuthology.orchestra.run.smithi100.stdout:(124/155): python3-natsort-7.1.1-5.el9.noarch.r 631 kB/s | 58 kB 00:00 2024-01-20T08:07:50.563 INFO:teuthology.orchestra.run.smithi100.stdout:(125/155): python3-pecan-1.4.2-3.el9.noarch.rpm 2.7 MB/s | 272 kB 00:00 2024-01-20T08:07:50.580 INFO:teuthology.orchestra.run.smithi100.stdout:(126/155): python3-portend-3.1.0-2.el9.noarch.r 218 kB/s | 16 kB 00:00 2024-01-20T08:07:50.614 INFO:teuthology.orchestra.run.smithi100.stdout:(127/155): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2024-01-20T08:07:50.673 INFO:teuthology.orchestra.run.smithi100.stdout:(128/155): python3-pyperclip-1.8.2-2.el9.noarch 260 kB/s | 28 kB 00:00 2024-01-20T08:07:50.698 INFO:teuthology.orchestra.run.smithi100.stdout:(129/155): python3-repoze-lru-0.7-16.el9.noarch 263 kB/s | 31 kB 00:00 2024-01-20T08:07:50.731 INFO:teuthology.orchestra.run.smithi100.stdout:(130/155): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2024-01-20T08:07:50.756 INFO:teuthology.orchestra.run.smithi100.stdout:(131/155): python3-tempora-5.0.0-2.el9.noarch.r 624 kB/s | 36 kB 00:00 2024-01-20T08:07:50.782 INFO:teuthology.orchestra.run.smithi100.stdout:(132/155): python3-rsa-4.9-2.el9.noarch.rpm 714 kB/s | 59 kB 00:00 2024-01-20T08:07:50.807 INFO:teuthology.orchestra.run.smithi100.stdout:(133/155): python3-typing-extensions-4.4.0-2.el 683 kB/s | 51 kB 00:00 2024-01-20T08:07:50.841 INFO:teuthology.orchestra.run.smithi100.stdout:(134/155): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-01-20T08:07:50.866 INFO:teuthology.orchestra.run.smithi100.stdout:(135/155): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-01-20T08:07:50.899 INFO:teuthology.orchestra.run.smithi100.stdout:(136/155): python3-zc-lockfile-2.0-10.el9.noarc 345 kB/s | 20 kB 00:00 2024-01-20T08:07:50.942 INFO:teuthology.orchestra.run.smithi100.stdout:(137/155): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-01-20T08:07:50.967 INFO:teuthology.orchestra.run.smithi100.stdout:(138/155): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-01-20T08:07:51.109 INFO:teuthology.orchestra.run.smithi100.stdout:(139/155): thrift-0.15.0-2.el9.x86_64.rpm 7.6 MB/s | 1.6 MB 00:00 2024-01-20T08:07:51.151 INFO:teuthology.orchestra.run.smithi100.stdout:(140/155): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2024-01-20T08:07:51.251 INFO:teuthology.orchestra.run.smithi100.stdout:(141/155): NetworkManager-1.45.10-1.el9.x86_64. 23 MB/s | 2.2 MB 00:00 2024-01-20T08:07:51.343 INFO:teuthology.orchestra.run.smithi100.stdout:(142/155): NetworkManager-libnm-1.45.10-1.el9.x 20 MB/s | 1.8 MB 00:00 2024-01-20T08:07:51.376 INFO:teuthology.orchestra.run.smithi100.stdout:(143/155): NetworkManager-team-1.45.10-1.el9.x8 1.3 MB/s | 42 kB 00:00 2024-01-20T08:07:51.419 INFO:teuthology.orchestra.run.smithi100.stdout:(144/155): NetworkManager-tui-1.45.10-1.el9.x86 5.9 MB/s | 246 kB 00:00 2024-01-20T08:07:51.497 INFO:teuthology.orchestra.run.smithi110.stdout:Transaction test succeeded. 2024-01-20T08:07:51.498 INFO:teuthology.orchestra.run.smithi110.stdout:Running transaction 2024-01-20T08:07:51.526 INFO:teuthology.orchestra.run.smithi100.stdout:(145/155): librbd1-19.0.0-763.ga00c9940.el9.x86 5.6 MB/s | 3.1 MB 00:00 2024-01-20T08:07:51.553 INFO:teuthology.orchestra.run.smithi100.stdout:(146/155): acl-2.3.1-4.el9.x86_64.rpm 517 kB/s | 69 kB 00:00 2024-01-20T08:07:51.578 INFO:teuthology.orchestra.run.smithi100.stdout:(147/155): elfutils-debuginfod-client-0.190-2.e 702 kB/s | 35 kB 00:00 2024-01-20T08:07:51.611 INFO:teuthology.orchestra.run.smithi100.stdout:(148/155): elfutils-libelf-0.190-2.el9.x86_64.r 3.3 MB/s | 191 kB 00:00 2024-01-20T08:07:51.645 INFO:teuthology.orchestra.run.smithi100.stdout:(149/155): elfutils-libs-0.190-2.el9.x86_64.rpm 3.9 MB/s | 254 kB 00:00 2024-01-20T08:07:51.670 INFO:teuthology.orchestra.run.smithi100.stdout:(150/155): libacl-2.3.1-4.el9.x86_64.rpm 391 kB/s | 22 kB 00:00 2024-01-20T08:07:51.720 INFO:teuthology.orchestra.run.smithi100.stdout:(151/155): openssl-3.0.7-25.el9.x86_64.rpm 15 MB/s | 1.2 MB 00:00 2024-01-20T08:07:51.796 INFO:teuthology.orchestra.run.smithi100.stdout:(152/155): openssl-libs-3.0.7-25.el9.x86_64.rpm 19 MB/s | 2.1 MB 00:00 2024-01-20T08:07:51.829 INFO:teuthology.orchestra.run.smithi100.stdout:(153/155): xfsdump-3.1.12-4.el9.x86_64.rpm 3.3 MB/s | 321 kB 00:00 2024-01-20T08:07:51.879 INFO:teuthology.orchestra.run.smithi100.stdout:(154/155): xfsprogs-6.3.0-1.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-01-20T08:07:56.529 INFO:teuthology.orchestra.run.smithi100.stdout:(155/155): librados2-19.0.0-763.ga00c9940.el9.x 615 kB/s | 3.4 MB 00:05 2024-01-20T08:07:56.537 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2024-01-20T08:07:56.537 INFO:teuthology.orchestra.run.smithi100.stdout:Total 10 MB/s | 209 MB 00:20 2024-01-20T08:07:56.618 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2024-01-20T08:07:56.949 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2024-01-20T08:07:56.950 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2024-01-20T08:07:57.891 INFO:teuthology.orchestra.run.smithi110.stdout: Preparing : 1/1 2024-01-20T08:07:57.979 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-20T08:07:58.063 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-20T08:07:58.165 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-20T08:07:58.215 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-20T08:07:58.255 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-20T08:07:58.339 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-20T08:07:58.738 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-20T08:07:58.804 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:07:58.950 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:07:58.980 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:07:59.101 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:07:59.138 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2024-01-20T08:07:59.138 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2024-01-20T08:07:59.140 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T08:07:59.298 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-20T08:07:59.407 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-20T08:07:59.675 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-20T08:07:59.727 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-20T08:07:59.753 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T08:07:59.899 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T08:07:59.929 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T08:08:00.013 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T08:08:00.318 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-20T08:08:00.514 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T08:08:00.599 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T08:08:00.805 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:00.846 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:01.306 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:01.351 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-20T08:08:01.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-20T08:08:01.523 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-20T08:08:01.555 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-20T08:08:01.609 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-20T08:08:01.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-20T08:08:01.774 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-20T08:08:01.822 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-20T08:08:01.866 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-20T08:08:01.899 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-20T08:08:02.010 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-20T08:08:02.045 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 31/171 2024-01-20T08:08:02.098 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 32/171 2024-01-20T08:08:02.144 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 33/171 2024-01-20T08:08:02.262 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-20T08:08:02.360 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-20T08:08:02.539 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-20T08:08:02.598 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-20T08:08:03.280 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-20T08:08:03.370 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-20T08:08:03.410 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-20T08:08:03.461 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-20T08:08:03.501 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 42/171 2024-01-20T08:08:03.562 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-20T08:08:03.749 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-20T08:08:03.798 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-20T08:08:03.936 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-20T08:08:03.984 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-20T08:08:04.051 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-20T08:08:04.136 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-20T08:08:04.380 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-20T08:08:04.424 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-20T08:08:04.506 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-20T08:08:04.551 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-20T08:08:04.616 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-20T08:08:04.680 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-20T08:08:04.870 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-20T08:08:04.923 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-20T08:08:04.976 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-20T08:08:05.036 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-20T08:08:05.176 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-20T08:08:05.208 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 61/171 2024-01-20T08:08:05.264 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-20T08:08:05.300 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-20T08:08:05.456 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-20T08:08:05.505 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-20T08:08:05.573 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-20T08:08:05.653 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-20T08:08:05.656 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2024-01-20T08:08:05.761 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/171 2024-01-20T08:08:05.836 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/171 2024-01-20T08:08:05.920 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-20T08:08:05.928 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/171 2024-01-20T08:08:05.979 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/171 2024-01-20T08:08:05.982 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-20T08:08:06.012 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/171 2024-01-20T08:08:06.113 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/171 2024-01-20T08:08:06.160 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-20T08:08:06.206 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-20T08:08:06.246 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-20T08:08:06.287 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-20T08:08:06.327 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-20T08:08:06.363 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-20T08:08:06.414 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-20T08:08:06.481 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-20T08:08:06.539 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/171 2024-01-20T08:08:06.558 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-20T08:08:06.594 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:08:06.612 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-20T08:08:06.660 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T08:08:06.752 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:08:06.786 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:08:06.797 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-20T08:08:06.846 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-20T08:08:06.872 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-20T08:08:06.907 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:08:06.927 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-20T08:08:06.953 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T08:08:06.966 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-20T08:08:07.108 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-20T08:08:07.156 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-20T08:08:07.164 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/171 2024-01-20T08:08:07.292 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 12/171 2024-01-20T08:08:07.316 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-20T08:08:07.380 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-20T08:08:07.591 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 13/171 2024-01-20T08:08:07.653 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-13.11-1.el9.x86_64 14/171 2024-01-20T08:08:07.677 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T08:08:07.828 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 15/171 2024-01-20T08:08:07.861 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T08:08:07.943 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 16/171 2024-01-20T08:08:08.262 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 17/171 2024-01-20T08:08:08.339 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-20T08:08:08.395 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-20T08:08:08.428 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-20T08:08:08.465 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T08:08:08.484 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-20T08:08:08.562 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 18/171 2024-01-20T08:08:08.596 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-20T08:08:08.649 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-20T08:08:08.793 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:08.844 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:08.881 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-20T08:08:08.921 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-20T08:08:09.018 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-20T08:08:09.268 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.45.10-1.el9.x86_64 19/171 2024-01-20T08:08:09.324 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 20/171 2024-01-20T08:08:09.439 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/171 2024-01-20T08:08:09.505 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 22/171 2024-01-20T08:08:09.545 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 23/171 2024-01-20T08:08:09.602 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 24/171 2024-01-20T08:08:09.647 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 25/171 2024-01-20T08:08:09.747 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 26/171 2024-01-20T08:08:09.796 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 27/171 2024-01-20T08:08:09.808 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-20T08:08:09.842 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/171 2024-01-20T08:08:09.882 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/171 2024-01-20T08:08:09.935 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-20T08:08:09.997 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/171 2024-01-20T08:08:10.035 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 31/171 2024-01-20T08:08:10.087 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 32/171 2024-01-20T08:08:10.125 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 33/171 2024-01-20T08:08:10.244 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/171 2024-01-20T08:08:10.359 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/171 2024-01-20T08:08:10.528 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 36/171 2024-01-20T08:08:10.589 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 37/171 2024-01-20T08:08:11.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el9.noarch 38/171 2024-01-20T08:08:11.402 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 39/171 2024-01-20T08:08:11.452 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 40/171 2024-01-20T08:08:11.464 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-20T08:08:11.537 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 41/171 2024-01-20T08:08:11.571 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-20T08:08:11.577 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 42/171 2024-01-20T08:08:11.606 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-20T08:08:11.629 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-20T08:08:11.638 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 43/171 2024-01-20T08:08:11.839 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 44/171 2024-01-20T08:08:11.935 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 45/171 2024-01-20T08:08:11.948 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-20T08:08:11.983 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T08:08:12.090 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : re2-1:20211101-3.el9.x86_64 46/171 2024-01-20T08:08:12.094 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T08:08:12.121 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 107/171 2024-01-20T08:08:12.124 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 47/171 2024-01-20T08:08:12.175 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-20T08:08:12.185 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/171 2024-01-20T08:08:12.276 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 49/171 2024-01-20T08:08:12.318 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 50/171 2024-01-20T08:08:12.389 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 51/171 2024-01-20T08:08:12.462 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 52/171 2024-01-20T08:08:12.524 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 53/171 2024-01-20T08:08:12.589 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 54/171 2024-01-20T08:08:12.648 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-20T08:08:12.655 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 55/171 2024-01-20T08:08:12.677 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T08:08:12.793 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T08:08:12.821 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 111/171 2024-01-20T08:08:12.851 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 56/171 2024-01-20T08:08:12.912 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 57/171 2024-01-20T08:08:12.951 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 58/171 2024-01-20T08:08:13.009 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 59/171 2024-01-20T08:08:13.147 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 60/171 2024-01-20T08:08:13.194 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:2.26.0-1.el9.noarch 61/171 2024-01-20T08:08:13.265 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 62/171 2024-01-20T08:08:13.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 63/171 2024-01-20T08:08:13.457 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 64/171 2024-01-20T08:08:13.515 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 65/171 2024-01-20T08:08:13.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ply-3.11-14.el9.noarch 66/171 2024-01-20T08:08:13.665 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 67/171 2024-01-20T08:08:13.927 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 68/171 2024-01-20T08:08:13.994 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 69/171 2024-01-20T08:08:14.163 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 70/171 2024-01-20T08:08:14.208 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 71/171 2024-01-20T08:08:14.257 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 72/171 2024-01-20T08:08:14.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 73/171 2024-01-20T08:08:14.347 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.6-16.el9.x86_64 74/171 2024-01-20T08:08:14.384 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.9-15.el9.x86_64 75/171 2024-01-20T08:08:14.425 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 76/171 2024-01-20T08:08:14.485 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 77/171 2024-01-20T08:08:14.584 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-55.el9.x86_64 78/171 2024-01-20T08:08:14.647 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 79/171 2024-01-20T08:08:14.694 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T08:08:14.812 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 81/171 2024-01-20T08:08:14.863 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 82/171 2024-01-20T08:08:14.897 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 83/171 2024-01-20T08:08:14.978 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 84/171 2024-01-20T08:08:15.036 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 85/171 2024-01-20T08:08:15.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 86/171 2024-01-20T08:08:15.233 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 87/171 2024-01-20T08:08:15.296 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:15.334 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:15.375 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 88/171 2024-01-20T08:08:15.437 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 89/171 2024-01-20T08:08:15.933 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:15.972 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T08:08:16.175 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T08:08:16.175 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-20T08:08:16.175 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-20T08:08:16.175 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:16.214 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T08:08:16.418 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 90/171 2024-01-20T08:08:16.471 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 91/171 2024-01-20T08:08:16.504 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 92/171 2024-01-20T08:08:16.562 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 93/171 2024-01-20T08:08:16.682 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 94/171 2024-01-20T08:08:16.721 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 95/171 2024-01-20T08:08:16.953 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.21-2.el9.x86_64 96/171 2024-01-20T08:08:16.977 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 97/171 2024-01-20T08:08:17.068 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 98/171 2024-01-20T08:08:17.876 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 99/171 2024-01-20T08:08:17.995 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 100/171 2024-01-20T08:08:19.511 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 101/171 2024-01-20T08:08:19.602 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 102/171 2024-01-20T08:08:19.638 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 103/171 2024-01-20T08:08:19.673 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 104/171 2024-01-20T08:08:20.072 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 105/171 2024-01-20T08:08:20.098 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T08:08:20.242 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 106/171 2024-01-20T08:08:20.279 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 107/171 2024-01-20T08:08:20.333 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 108/171 2024-01-20T08:08:20.805 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 109/171 2024-01-20T08:08:20.851 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T08:08:20.941 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 110/171 2024-01-20T08:08:20.970 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 111/171 2024-01-20T08:08:23.432 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:23.466 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:24.062 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 112/171 2024-01-20T08:08:24.111 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T08:08:24.268 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 113/171 2024-01-20T08:08:24.269 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-01-20T08:08:24.269 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-01-20T08:08:24.269 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:24.304 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /sys 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /proc 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /mnt 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /var/tmp 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /home 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /root 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout:skipping the directory /tmp 2024-01-20T08:08:28.767 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:28.988 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T08:08:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T08:08:29.034 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:29.034 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-20T08:08:29.034 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:30.659 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T08:08:30.739 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T08:08:30.739 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:30.739 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-20T08:08:30.739 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T08:08:30.739 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T08:08:30.740 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:30.967 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T08:08:31.035 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T08:08:31.035 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:31.035 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-20T08:08:31.035 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T08:08:31.035 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T08:08:31.036 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:31.509 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T08:08:31.575 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T08:08:31.582 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:31.582 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-20T08:08:31.582 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T08:08:31.582 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T08:08:31.582 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:31.687 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-20T08:08:32.286 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T08:08:32.317 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T08:08:32.347 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 121/171 2024-01-20T08:08:32.405 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 122/171 2024-01-20T08:08:32.438 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T08:08:32.722 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T08:08:32.756 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T08:08:33.831 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T08:08:33.864 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T08:08:34.007 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T08:08:34.177 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 126/171 2024-01-20T08:08:34.208 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T08:08:34.275 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:34.325 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T08:08:34.362 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T08:08:34.415 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 129/171 2024-01-20T08:08:35.292 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-20T08:08:35.328 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T08:08:35.397 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T08:08:35.397 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:35.397 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-20T08:08:35.397 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T08:08:35.397 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T08:08:35.398 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:35.445 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T08:08:35.513 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T08:08:35.513 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:35.513 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-20T08:08:35.513 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:35.580 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T08:08:35.655 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T08:08:35.655 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:35.655 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-20T08:08:35.655 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T08:08:35.656 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T08:08:35.656 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:36.022 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T08:08:36.092 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:36.947 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 114/171 2024-01-20T08:08:36.947 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2024-01-20T08:08:36.947 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /root 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2024-01-20T08:08:36.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:37.170 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T08:08:37.219 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 115/171 2024-01-20T08:08:37.219 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:37.219 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-01-20T08:08:37.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:38.789 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T08:08:38.867 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 116/171 2024-01-20T08:08:38.868 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:38.868 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-01-20T08:08:38.868 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T08:08:38.868 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-01-20T08:08:38.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:39.098 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T08:08:39.162 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 117/171 2024-01-20T08:08:39.163 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:39.163 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-01-20T08:08:39.163 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T08:08:39.163 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-01-20T08:08:39.163 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:39.657 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T08:08:39.724 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 118/171 2024-01-20T08:08:39.725 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:39.725 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-01-20T08:08:39.725 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T08:08:39.725 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-01-20T08:08:39.725 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:39.834 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.2-8.el9.noarch 119/171 2024-01-20T08:08:40.421 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T08:08:40.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 120/171 2024-01-20T08:08:40.527 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 121/171 2024-01-20T08:08:40.640 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 122/171 2024-01-20T08:08:40.672 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T08:08:40.728 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 135/171 2024-01-20T08:08:40.784 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 136/171 2024-01-20T08:08:40.839 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 137/171 2024-01-20T08:08:40.877 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-20T08:08:40.918 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-20T08:08:40.986 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 123/171 2024-01-20T08:08:41.023 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T08:08:41.211 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T08:08:41.343 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-20T08:08:41.390 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T08:08:41.446 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 143/171 2024-01-20T08:08:41.489 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-20T08:08:41.537 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-20T08:08:41.650 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T08:08:41.712 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-20T08:08:41.751 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-20T08:08:42.153 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 124/171 2024-01-20T08:08:42.189 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T08:08:42.334 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 125/171 2024-01-20T08:08:42.502 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 126/171 2024-01-20T08:08:42.541 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T08:08:42.612 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 127/171 2024-01-20T08:08:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-01-20T08:08:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T08:08:42.613 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-01-20T08:08:42.613 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:42.643 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:42.683 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:42.691 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T08:08:42.727 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 128/171 2024-01-20T08:08:42.771 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:42.815 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 129/171 2024-01-20T08:08:42.834 INFO:teuthology.orchestra.run.smithi110.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-20T08:08:43.684 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/171 2024-01-20T08:08:43.719 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 131/171 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-01-20T08:08:43.790 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:43.845 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T08:08:43.922 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-763.ga00c99 132/171 2024-01-20T08:08:43.922 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:43.922 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-01-20T08:08:43.922 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:44.013 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T08:08:44.087 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 133/171 2024-01-20T08:08:44.088 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:44.088 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-01-20T08:08:44.088 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T08:08:44.088 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-01-20T08:08:44.088 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:44.167 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 151/171 2024-01-20T08:08:44.256 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-20T08:08:44.304 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-20T08:08:44.429 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-20T08:08:44.455 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T08:08:44.467 INFO:teuthology.orchestra.run.smithi110.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-20T08:08:44.492 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-20T08:08:44.526 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T08:08:44.526 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 134/171 2024-01-20T08:08:44.526 INFO:teuthology.orchestra.run.smithi100.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-01-20T08:08:44.527 INFO:teuthology.orchestra.run.smithi100.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-01-20T08:08:44.527 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T08:08:44.527 INFO:teuthology.orchestra.run.smithi100.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-01-20T08:08:44.527 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-20T08:08:44.576 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T08:08:44.715 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T08:08:44.768 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-20T08:08:44.815 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-20T08:08:44.856 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-20T08:08:44.889 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-20T08:08:44.889 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T08:08:45.019 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T08:08:45.049 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-20T08:08:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:45.085 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:45.415 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:45.416 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T08:08:45.548 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T08:08:45.585 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-20T08:08:45.624 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-20T08:08:45.670 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-20T08:08:45.788 INFO:teuthology.orchestra.run.smithi110.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T08:08:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T08:08:46.046 INFO:teuthology.orchestra.run.smithi110.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-20T08:08:46.046 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:49.202 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 135/171 2024-01-20T08:08:49.270 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 136/171 2024-01-20T08:08:49.335 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 137/171 2024-01-20T08:08:49.369 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 138/171 2024-01-20T08:08:49.408 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 139/171 2024-01-20T08:08:49.706 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T08:08:49.836 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 141/171 2024-01-20T08:08:49.873 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T08:08:49.907 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 143/171 2024-01-20T08:08:49.946 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 144/171 2024-01-20T08:08:49.991 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-team-1:1.45.10-1.el9.x86_64 145/171 2024-01-20T08:08:50.147 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : NetworkManager-tui-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T08:08:50.201 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 147/171 2024-01-20T08:08:50.234 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 148/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 1/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 3/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 4/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 5/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 6/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 7/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 11/171 2024-01-20T08:08:50.907 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 12/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 13/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 14/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 15/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 16/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 17/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 18/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 19/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 20/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 21/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 22/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 23/171 2024-01-20T08:08:50.908 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 24/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 25/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 26/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 27/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 28/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 29/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 30/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 31/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 32/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 33/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 34/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 35/171 2024-01-20T08:08:50.909 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 36/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 37/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 38/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 39/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-20T08:08:50.910 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-20T08:08:50.911 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-20T08:08:50.912 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-20T08:08:50.913 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-20T08:08:50.914 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 115/171 2024-01-20T08:08:50.915 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-20T08:08:50.916 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T08:08:50.917 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-20T08:08:50.918 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-20T08:08:50.919 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-20T08:08:50.920 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-20T08:08:51.107 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:51.156 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:51.239 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 149/171 2024-01-20T08:08:51.309 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 150/171 2024-01-20T08:08:52.643 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 151/171 2024-01-20T08:08:52.712 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 152/171 2024-01-20T08:08:52.766 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 153/171 2024-01-20T08:08:52.891 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.4-9.el9.x86_64 154/171 2024-01-20T08:08:52.932 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.7.4-5.el9.x86_64 155/171 2024-01-20T08:08:52.965 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 156/171 2024-01-20T08:08:52.999 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T08:08:53.039 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 158/171 2024-01-20T08:08:53.040 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T08:08:53.082 INFO:teuthology.orchestra.run.smithi110.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-20T08:08:53.082 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:53.082 INFO:teuthology.orchestra.run.smithi110.stdout:Upgraded: 2024-01-20T08:08:53.082 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: acl-2.3.1-4.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.083 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout:Installed: 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: automake-1.16.2-8.el9.noarch 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: bison-3.7.4-5.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.084 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-immutable-object-cache-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.085 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: flex-2.6.4-9.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-20T08:08:53.086 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: jq-1.6-16.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.087 INFO:teuthology.orchestra.run.smithi110.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-20T08:08:53.088 INFO:teuthology.orchestra.run.smithi110.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: lua-5.4.4-4.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-13.11-1.el9.x86_64 2024-01-20T08:08:53.089 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-20T08:08:53.090 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-20T08:08:53.091 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-20T08:08:53.092 INFO:teuthology.orchestra.run.smithi110.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-ply-3.11-14.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-20T08:08:53.093 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-20T08:08:53.094 INFO:teuthology.orchestra.run.smithi110.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: re2-1:20211101-3.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-20T08:08:53.095 INFO:teuthology.orchestra.run.smithi110.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-20T08:08:53.096 INFO:teuthology.orchestra.run.smithi110.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-20T08:08:53.096 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:08:53.096 INFO:teuthology.orchestra.run.smithi110.stdout:Complete! 2024-01-20T08:08:53.190 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/171 2024-01-20T08:08:53.241 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 160/171 2024-01-20T08:08:53.288 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 161/171 2024-01-20T08:08:53.329 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 162/171 2024-01-20T08:08:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 163/171 2024-01-20T08:08:53.362 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T08:08:53.491 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 164/171 2024-01-20T08:08:53.563 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 165/171 2024-01-20T08:08:53.600 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:53.600 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:53.728 DEBUG:teuthology.parallel:result is None 2024-01-20T08:08:53.921 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 166/171 2024-01-20T08:08:53.922 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T08:08:54.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 167/171 2024-01-20T08:08:54.100 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 168/171 2024-01-20T08:08:54.148 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 169/171 2024-01-20T08:08:54.201 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 170/171 2024-01-20T08:08:54.321 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T08:08:54.597 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 171/171 2024-01-20T08:08:54.597 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-01-20T08:08:54.597 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-763.ga00c9940.el9.x86_64 1/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 3/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 4/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-763.ga00c99 5/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 6/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 7/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 8/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 9/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 10/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 11/171 2024-01-20T08:08:59.535 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 12/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 13/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 14/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_6 15/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 16/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 17/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 18/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_ 19/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 20/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9 21/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x 22/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 23/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 24/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 25/171 2024-01-20T08:08:59.536 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 26/171 2024-01-20T08:08:59.537 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 27/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 28/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 29/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.e 30/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noar 31/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.no 32/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c 33/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9 34/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 35/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el 36/171 2024-01-20T08:08:59.550 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 37/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-763.ga00c9940.el9.noarch 38/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 39/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 43/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/171 2024-01-20T08:08:59.551 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 57/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 58/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 59/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/171 2024-01-20T08:08:59.552 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/171 2024-01-20T08:08:59.553 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 84/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.6-16.el9.x86_64 88/171 2024-01-20T08:08:59.554 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 91/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 92/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 93/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ply-3.11-14.el9.noarch 94/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 95/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 96/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 97/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 98/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 99/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 100/171 2024-01-20T08:08:59.555 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 101/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 102/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 103/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 104/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 105/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 106/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 107/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 108/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 109/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 110/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 111/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 112/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 113/171 2024-01-20T08:08:59.556 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 114/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:2.26.0-1.el9.noarch 115/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 116/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 117/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 118/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 119/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 120/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/171 2024-01-20T08:08:59.557 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-763.ga00c9940.el9.x86_64 140/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 142/171 2024-01-20T08:08:59.558 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.45.10-1.el9.x86_64 146/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 147/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.45.10-1.el9.x86_64 148/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 149/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.45.10-1.el9.x86_64 150/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 151/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.45.10-1.el9.x86_64 152/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 153/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.3.1-4.el9.x86_64 154/171 2024-01-20T08:08:59.559 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : acl-2.3.1-3.el9.x86_64 155/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 156/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 157/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 158/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 159/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 160/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 161/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 162/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 163/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 164/171 2024-01-20T08:08:59.560 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 165/171 2024-01-20T08:08:59.561 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 166/171 2024-01-20T08:08:59.561 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 167/171 2024-01-20T08:08:59.561 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 168/171 2024-01-20T08:08:59.561 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 169/171 2024-01-20T08:08:59.561 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 170/171 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 171/171 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-1:1.45.10-1.el9.x86_64 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-libnm-1:1.45.10-1.el9.x86_64 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-team-1:1.45.10-1.el9.x86_64 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-tui-1:1.45.10-1.el9.x86_64 2024-01-20T08:09:01.871 INFO:teuthology.orchestra.run.smithi100.stdout: acl-2.3.1-4.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-2.3.1-4.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:3.0.7-25.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2024-01-20T08:09:01.872 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.2-8.el9.noarch 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.7.4-5.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.873 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-shell-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-763.ga00c9940.el9.noarch 2024-01-20T08:09:01.874 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.4-9.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.9-15.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.6-16.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-9.0.0-10.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.7-2.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-45.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.6.2-1.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-01-20T08:09:01.876 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: lua-5.4.4-4.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.9.2-1.el9.noarch 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.21-2.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-13.11-1.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-13.11-1.el9.x86_64 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-01-20T08:09:01.877 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.9.1-2.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-01-20T08:09:01.878 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:2.26.0-1.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.11.3-4.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.1.4-6.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-01-20T08:09:01.879 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ply-3.11-14.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-3.1.0-2.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.20-6.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-01-20T08:09:01.880 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2021.1-5.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-2.25.1-7.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.5.1-5.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-toml-0.10.2-6.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-01-20T08:09:01.881 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.7-6.el9.noarch 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-763.ga00c9940.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: re2-1:20211101-3.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-5.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.15.0-2.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-55.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-01-20T08:09:01.882 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-01-20T08:09:01.883 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-01-20T08:09:01.883 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:01.883 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2024-01-20T08:09:02.415 DEBUG:teuthology.parallel:result is None 2024-01-20T08:09:02.416 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T08:09:02.562 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-20T08:09:02.617 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-763.ga00c9940.el9 2024-01-20T08:09:02.618 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-763.ga00c9940.el9 2024-01-20T08:09:02.618 INFO:teuthology.task.install:The correct ceph version 19.0.0-763.ga00c9940 is installed. 2024-01-20T08:09:02.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a00c9940991c5e1e9ab595faa3f6e1281d8ae167 2024-01-20T08:09:02.837 DEBUG:teuthology.orchestra.run.smithi110:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-01-20T08:09:02.913 INFO:teuthology.orchestra.run.smithi110.stdout:19.0.0-763.ga00c9940.el9 2024-01-20T08:09:02.913 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-763.ga00c9940.el9 2024-01-20T08:09:02.914 INFO:teuthology.task.install:The correct ceph version 19.0.0-763.ga00c9940 is installed. 2024-01-20T08:09:02.915 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-01-20T08:09:02.916 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:02.916 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-20T08:09:03.003 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:03.003 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-01-20T08:09:03.107 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-01-20T08:09:03.108 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:03.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2024-01-20T08:09:03.192 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-20T08:09:03.305 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:03.305 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/daemon-helper 2024-01-20T08:09:03.403 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-01-20T08:09:03.541 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-01-20T08:09:03.541 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:03.541 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-20T08:09:03.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-20T08:09:03.733 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:03.733 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/adjust-ulimits 2024-01-20T08:09:03.834 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-01-20T08:09:03.972 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-01-20T08:09:03.972 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:03.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2024-01-20T08:09:04.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-20T08:09:04.157 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:04.157 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/usr/bin/stdin-killer 2024-01-20T08:09:04.255 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-01-20T08:09:04.345 INFO:teuthology.run_tasks:Running task ceph... 2024-01-20T08:09:04.434 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-01-20T08:09:04.434 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /var/log/ceph 2024-01-20T08:09:04.439 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 777 /var/log/ceph 2024-01-20T08:09:04.539 INFO:tasks.ceph:Disabling ceph logrotate... 2024-01-20T08:09:04.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-20T08:09:04.543 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/logrotate.d/ceph 2024-01-20T08:09:04.638 INFO:tasks.ceph:Creating extra log directories... 2024-01-20T08:09:04.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-20T08:09:04.642 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-01-20T08:09:04.743 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-01-20T08:09:04.744 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-01-20T08:09:04.744 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-01-20T08:09:04.744 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:04.744 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-20T08:09:04.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:05.004 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:05.074 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:05.074 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-01-20T08:09:05.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:05.404 DEBUG:teuthology.orchestra.run.smithi110:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:05.510 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-01-20T08:09:05.510 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-01-20T08:09:05.510 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'branch': 'main', 'description': 'fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7522412', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'seed': 450, 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi100.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlrLNzBn88jFP2X1n6kxVC2c1uK3V5PoWfN2hhwa0xRva16SJ8jrcjQlFqFAsBr4NLSNKsS8NQpDYCRXpV392Y=', 'smithi110.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFT2tsvTwJsCuCnLOw6OilTH6tN0pKxMSQvbzBE+jougwKWG72e6msyNu/hF5UnlGcrh3L0ZQb1wrDbW+/Hw5I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a00c9940991c5e1e9ab595faa3f6e1281d8ae167', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_multifs_auth']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'cd45576300487d997e5a85abed65500b9f5d143b', 'timestamp': '2024-01-19_15:24:44', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-01-20T08:09:05.511 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-20T08:09:05.518 DEBUG:teuthology.orchestra.run.smithi110:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-01-20T08:09:05.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m0777 -- /var/run/ceph 2024-01-20T08:09:05.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo install -d -m0777 -- /var/run/ceph 2024-01-20T08:09:05.677 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:05.677 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2024-01-20T08:09:05.718 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-20T08:09:05.719 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-20 08:08:55.036609238 +0000 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-20 08:06:23.796082686 +0000 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-20 08:06:23.796082686 +0000 2024-01-20T08:09:05.797 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-20 08:06:23.796082686 +0000 2024-01-20T08:09:05.798 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-20T08:09:05.906 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-20T08:09:05.907 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-20T08:09:05.907 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000354447 s, 1.4 MB/s 2024-01-20T08:09:05.909 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-20T08:09:05.950 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2024-01-20T08:09:06.031 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-20T08:09:06.031 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:06.031 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 651 Links: 1 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-20 08:08:55.037609210 +0000 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-20 08:06:24.376066280 +0000 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-20 08:06:24.376066280 +0000 2024-01-20T08:09:06.032 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-20 08:06:24.376066280 +0000 2024-01-20T08:09:06.032 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-20T08:09:06.139 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-20T08:09:06.139 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-20T08:09:06.139 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000339287 s, 1.5 MB/s 2024-01-20T08:09:06.142 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-20T08:09:06.182 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2024-01-20T08:09:06.270 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-20 08:08:55.037609210 +0000 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-20 08:06:24.953049957 +0000 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-20 08:06:24.953049957 +0000 2024-01-20T08:09:06.271 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-20 08:06:24.953049957 +0000 2024-01-20T08:09:06.271 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-20T08:09:06.382 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-20T08:09:06.382 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-20T08:09:06.382 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000255383 s, 2.0 MB/s 2024-01-20T08:09:06.385 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-20T08:09:06.427 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2024-01-20T08:09:06.515 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-20T08:09:06.515 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:06.515 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 689 Links: 1 2024-01-20T08:09:06.515 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:06.515 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:06.516 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2024-01-20 08:08:55.038609182 +0000 2024-01-20T08:09:06.516 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2024-01-20 08:06:25.528033692 +0000 2024-01-20T08:09:06.516 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2024-01-20 08:06:25.528033692 +0000 2024-01-20T08:09:06.516 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2024-01-20 08:06:25.528033692 +0000 2024-01-20T08:09:06.516 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-20T08:09:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2024-01-20T08:09:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2024-01-20T08:09:06.626 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000266691 s, 1.9 MB/s 2024-01-20T08:09:06.628 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-20T08:09:06.668 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:06.668 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:06.668 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/scratch_devs of=/dev/stdout 2024-01-20T08:09:06.726 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-01-20T08:09:06.726 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_1 2024-01-20T08:09:06.779 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-20 08:08:46.480983258 +0000 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-20 08:06:23.077397376 +0000 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-20 08:06:23.077397376 +0000 2024-01-20T08:09:06.780 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-01-20 08:06:23.077397376 +0000 2024-01-20T08:09:06.780 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-01-20T08:09:06.869 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-20T08:09:06.869 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-20T08:09:06.869 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000226662 s, 2.3 MB/s 2024-01-20T08:09:06.873 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-01-20T08:09:06.928 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_2 2024-01-20T08:09:06.978 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-20 08:08:46.480983258 +0000 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-20 08:06:23.598387562 +0000 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-20 08:06:23.598387562 +0000 2024-01-20T08:09:06.979 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-01-20 08:06:23.598387562 +0000 2024-01-20T08:09:06.979 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-01-20T08:09:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-20T08:09:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-20T08:09:07.068 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000248029 s, 2.1 MB/s 2024-01-20T08:09:07.073 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-01-20T08:09:07.124 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_3 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 670 Links: 1 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-20 08:08:46.481983240 +0000 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-20 08:06:24.144377276 +0000 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-20 08:06:24.144377276 +0000 2024-01-20T08:09:07.173 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-01-20 08:06:24.144377276 +0000 2024-01-20T08:09:07.174 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-01-20T08:09:07.258 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-20T08:09:07.259 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-20T08:09:07.259 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000202768 s, 2.5 MB/s 2024-01-20T08:09:07.263 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-01-20T08:09:07.320 DEBUG:teuthology.orchestra.run.smithi110:> stat /dev/vg_nvme/lv_4 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Context: system_u:object_r:device_t:s0 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Access: 2024-01-20 08:08:46.482983221 +0000 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Modify: 2024-01-20 08:06:24.693366934 +0000 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout:Change: 2024-01-20 08:06:24.693366934 +0000 2024-01-20T08:09:07.370 INFO:teuthology.orchestra.run.smithi110.stdout: Birth: 2024-01-20 08:06:24.693366934 +0000 2024-01-20T08:09:07.371 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-01-20T08:09:07.460 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records in 2024-01-20T08:09:07.460 INFO:teuthology.orchestra.run.smithi110.stderr:1+0 records out 2024-01-20T08:09:07.460 INFO:teuthology.orchestra.run.smithi110.stderr:512 bytes copied, 0.000256335 s, 2.0 MB/s 2024-01-20T08:09:07.464 DEBUG:teuthology.orchestra.run.smithi110:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-01-20T08:09:07.523 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:07.523 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-20T08:09:07.523 INFO:tasks.ceph:Generating config... 2024-01-20T08:09:07.524 INFO:tasks.ceph:[client] client mount timeout = 600 2024-01-20T08:09:07.524 INFO:tasks.ceph:[client] debug client = 20 2024-01-20T08:09:07.524 INFO:tasks.ceph:[client] debug ms = 1 2024-01-20T08:09:07.524 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-01-20T08:09:07.525 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-01-20T08:09:07.525 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] debug mds = 20 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] debug ms = 1 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] mds debug frag = True 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-01-20T08:09:07.525 INFO:tasks.ceph:[mgr] debug ms = 1 2024-01-20T08:09:07.526 INFO:tasks.ceph:[mon] debug mon = 20 2024-01-20T08:09:07.526 INFO:tasks.ceph:[mon] debug ms = 1 2024-01-20T08:09:07.526 INFO:tasks.ceph:[mon] debug paxos = 20 2024-01-20T08:09:07.526 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] bdev async discard = True 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] debug ms = 1 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] debug osd = 20 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-01-20T08:09:07.526 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-01-20T08:09:07.527 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-01-20T08:09:07.527 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-01-20T08:09:07.527 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-01-20T08:09:07.527 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-01-20T08:09:07.527 INFO:tasks.ceph:Setting up mon.a... 2024-01-20T08:09:07.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-01-20T08:09:07.662 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.keyring 2024-01-20T08:09:07.670 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-01-20T08:09:07.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T08:09:07.865 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.100'), ('mon.b', '172.21.15.110'), ('mon.c', '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]')] 2024-01-20T08:09:07.865 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.100,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-01-20T08:09:07.866 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:07.866 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-01-20T08:09:07.915 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.100 --add b 172.21.15.110 --addv c '[v2:172.21.15.110:3301,v1:172.21.15.110:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: generated fsid 10ce7bd0-b73e-4b66-b126-32ffded4722e 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:setting min_mon_release = quincy 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:epoch 0 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:fsid 10ce7bd0-b73e-4b66-b126-32ffded4722e 2024-01-20T08:09:08.063 INFO:teuthology.orchestra.run.smithi100.stdout:last_changed 2024-01-20T08:09:08.061742+0000 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:created 2024-01-20T08:09:08.061742+0000 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:min_mon_release 17 (quincy) 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:election_strategy: 1 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:0: [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon.a 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:1: [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] mon.b 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:2: [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] mon.c 2024-01-20T08:09:08.064 INFO:teuthology.orchestra.run.smithi100.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-01-20T08:09:08.066 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-01-20T08:09:08.115 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 10ce7bd0-b73e-4b66-b126-32ffded4722e... 2024-01-20T08:09:08.116 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-20T08:09:08.121 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout:[global] 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: chdir = "" 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: auth supported = cephx 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: filestore xattr use omap = true 2024-01-20T08:09:08.278 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: mon clock drift allowed = 1.000 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: osd crush chooseleaf type = 0 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: auth debug = true 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on old message = true 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on bug = true 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: mon pg warn max object skew = 0 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: # disable pg_autoscaler by default for new pools 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-20T08:09:08.279 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default size = 2 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow primary affinity = true 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd allow pg remap = true 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on legacy crush tunables = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on crush straw calc version zero = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on no sortbitwise = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on osd down out interval zero = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon warn on too few osds = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: mon_allow_pool_size_one = true 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.280 INFO:teuthology.orchestra.run.smithi100.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: osd default data pool replay window = 5 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: mon allow pool delete = true 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: mon cluster log file level = debug 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: debug asserts on shutdown = true 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: mon health detail to clog = false 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: mon host = "172.21.15.100,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: ms die on skipped message = False 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: fsid = 10ce7bd0-b73e-4b66-b126-32ffded4722e 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout:[osd] 2024-01-20T08:09:08.281 INFO:teuthology.orchestra.run.smithi100.stdout: osd journal size = 100 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub load threshold = 5.0 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd scrub max interval = 600 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd mclock profile = high_recovery_ops 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd recover clone overlap = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd recovery max chunk = 1048576 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug shutdown = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug op order = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug verify stray on activate = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug trim objects = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd open classes on start = true 2024-01-20T08:09:08.282 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug pg log writeout = true 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: osd deep scrub update digest min age = 30 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: osd map max advance = 10 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: journal zero on create = true 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: filestore ondisk finisher threads = 3 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: filestore apply finisher threads = 3 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: bdev debug aio = true 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: osd debug misdirected ops = true 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: bdev async discard = True 2024-01-20T08:09:08.283 INFO:teuthology.orchestra.run.smithi100.stdout: bdev enable discard = True 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore allocator = bitmap 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore block size = 96636764160 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: bluestore fsck on mount = True 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluefs = 1/20 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: debug bluestore = 1/20 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: debug osd = 20 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: debug rocksdb = 4/10 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd backfillfull_ratio = 0.85 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd full ratio = 0.9 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd nearfull ratio = 0.8 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: osd failsafe full ratio = 0.95 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: osd objectstore = bluestore 2024-01-20T08:09:08.284 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr] 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug mgr = 20 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: mgr/telemetry/nag = false 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout:[mon] 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug mon = 20 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug paxos = 20 2024-01-20T08:09:08.285 INFO:teuthology.orchestra.run.smithi100.stdout: debug auth = 20 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon data avail warn = 5 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon mgr mkfs grace = 240 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min pgs per osd = 4 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd reporter subtree level = osd 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon osd prime pg temp = true 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon reweight min bytes per osd = 10 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: auth mon ticket ttl = 660 # 11m 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: auth service ticket ttl = 240 # 4m 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: # don't complain about insecure global_id in the test suite 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-20T08:09:08.286 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: # 1m isn't quite enough 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: mon_down_mkfs_grace = 2m 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: mon_warn_on_filestore_osds = false 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: mon op complaint time = 120 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout:[client] 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: rgw cache enabled = true 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable ops log = true 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: rgw enable usage log = true 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: client mount timeout = 600 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: debug client = 20 2024-01-20T08:09:08.287 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.a] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.b] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mon.c] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout:[mds] 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds = 20 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: debug mds balancer = 20 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: debug ms = 1 2024-01-20T08:09:08.288 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug frag = True 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: mds debug scatterstat = True 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: mds op complaint time = 180 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: mds verify scatter = True 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: osd op complaint time = 180 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: rados mon op timeout = 900 2024-01-20T08:09:08.289 INFO:teuthology.orchestra.run.smithi100.stdout: rados osd op timeout = 900 2024-01-20T08:09:08.291 INFO:teuthology.orchestra.run.smithi110.stdout:[global] 2024-01-20T08:09:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: chdir = "" 2024-01-20T08:09:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-01-20T08:09:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: auth supported = cephx 2024-01-20T08:09:08.291 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: filestore xattr use omap = true 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: mon clock drift allowed = 1.000 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: osd crush chooseleaf type = 0 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: auth debug = true 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on old message = true 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on bug = true 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: mon max pg per osd = 10000 # >= luminous 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: mon pg warn max object skew = 0 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.292 INFO:teuthology.orchestra.run.smithi110.stdout: # disable pg_autoscaler by default for new pools 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd_pool_default_pg_autoscale_mode = off 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default size = 2 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow primary affinity = true 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd allow pg remap = true 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on legacy crush tunables = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on crush straw calc version zero = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on no sortbitwise = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on osd down out interval zero = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon warn on too few osds = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_pool_no_redundancy = false 2024-01-20T08:09:08.293 INFO:teuthology.orchestra.run.smithi110.stdout: mon_allow_pool_size_one = true 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: osd default data pool replay window = 5 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon allow pool delete = true 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon cluster log file level = debug 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: debug asserts on shutdown = true 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon health detail to clog = false 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: mon host = "172.21.15.100,172.21.15.110,[v2:172.21.15.110:3301,v1:172.21.15.110:6790]" 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: ms die on skipped message = False 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: fsid = 10ce7bd0-b73e-4b66-b126-32ffded4722e 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.294 INFO:teuthology.orchestra.run.smithi110.stdout:[osd] 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd journal size = 100 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub load threshold = 5.0 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd scrub max interval = 600 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd mclock profile = high_recovery_ops 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd recover clone overlap = true 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd recovery max chunk = 1048576 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug shutdown = true 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug op order = true 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug verify stray on activate = true 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug trim objects = true 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.295 INFO:teuthology.orchestra.run.smithi110.stdout: osd open classes on start = true 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug pg log writeout = true 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd deep scrub update digest min age = 30 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd map max advance = 10 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: journal zero on create = true 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: filestore ondisk finisher threads = 3 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: filestore apply finisher threads = 3 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: bdev debug aio = true 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: osd debug misdirected ops = true 2024-01-20T08:09:08.296 INFO:teuthology.orchestra.run.smithi110.stdout: bdev async discard = True 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: bdev enable discard = True 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore allocator = bitmap 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore block size = 96636764160 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: bluestore fsck on mount = True 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluefs = 1/20 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: debug bluestore = 1/20 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: debug osd = 20 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: debug rocksdb = 4/10 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd backfillfull_ratio = 0.85 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd full ratio = 0.9 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd nearfull ratio = 0.8 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: osd failsafe full ratio = 0.95 2024-01-20T08:09:08.297 INFO:teuthology.orchestra.run.smithi110.stdout: osd objectstore = bluestore 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr] 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug mgr = 20 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: mgr/telemetry/nag = false 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout:[mon] 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug mon = 20 2024-01-20T08:09:08.298 INFO:teuthology.orchestra.run.smithi110.stdout: debug paxos = 20 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: debug auth = 20 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon data avail warn = 5 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon mgr mkfs grace = 240 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min pgs per osd = 4 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd reporter subtree level = osd 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon osd prime pg temp = true 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon reweight min bytes per osd = 10 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: auth mon ticket ttl = 660 # 11m 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: auth service ticket ttl = 240 # 4m 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: # don't complain about insecure global_id in the test suite 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-01-20T08:09:08.299 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: # 1m isn't quite enough 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon_down_mkfs_grace = 2m 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon_warn_on_filestore_osds = false 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: mon op complaint time = 120 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout:[client] 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: rgw cache enabled = true 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable ops log = true 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: rgw enable usage log = true 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: client mount timeout = 600 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug client = 20 2024-01-20T08:09:08.300 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.a] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.b] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mon.c] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout:[mds] 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds = 20 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug mds balancer = 20 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: debug ms = 1 2024-01-20T08:09:08.301 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug frag = True 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: mds debug scatterstat = True 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: mds op complaint time = 180 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: mds verify scatter = True 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: osd op complaint time = 180 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: rados mon op timeout = 900 2024-01-20T08:09:08.302 INFO:teuthology.orchestra.run.smithi110.stdout: rados osd op timeout = 900 2024-01-20T08:09:08.335 INFO:tasks.ceph:Creating admin key on mon.a... 2024-01-20T08:09:08.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-01-20T08:09:08.478 INFO:tasks.ceph:Copying monmap to all nodes... 2024-01-20T08:09:08.479 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:08.479 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-01-20T08:09:08.529 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:08.530 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-01-20T08:09:08.577 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:09:08.578 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:08.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-20T08:09:08.578 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T08:09:08.766 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:08.766 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:08.861 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:09:08.861 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:08.861 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd of=/etc/ceph/ceph.keyring 2024-01-20T08:09:08.861 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-01-20T08:09:09.015 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:09.015 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:09.111 INFO:tasks.ceph:Setting up mon nodes... 2024-01-20T08:09:09.112 INFO:tasks.ceph:Setting up mgr nodes... 2024-01-20T08:09:09.112 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-01-20T08:09:09.295 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-01-20T08:09:09.306 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-01-20T08:09:09.512 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-01-20T08:09:09.523 INFO:tasks.ceph:Setting up mds nodes... 2024-01-20T08:09:09.524 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-01-20T08:09:09.706 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-01-20T08:09:09.715 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-01-20T08:09:09.813 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-01-20T08:09:09.982 INFO:teuthology.orchestra.run.smithi100.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-01-20T08:09:09.991 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-01-20T08:09:10.085 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-01-20T08:09:10.270 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-01-20T08:09:10.279 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-01-20T08:09:10.375 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-01-20T08:09:10.555 INFO:teuthology.orchestra.run.smithi110.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-01-20T08:09:10.565 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-01-20T08:09:10.655 INFO:tasks.ceph_client:Setting up client nodes... 2024-01-20T08:09:10.655 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-01-20T08:09:10.782 INFO:teuthology.orchestra.run.smithi100.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-01-20T08:09:10.839 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-01-20T08:09:10.967 INFO:teuthology.orchestra.run.smithi110.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-01-20T08:09:11.023 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-01-20T08:09:11.024 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi100.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi110.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-01-20T08:09:11.024 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-01-20T08:09:11.114 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:11.114 INFO:tasks.ceph:role: osd.0 2024-01-20T08:09:11.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:09:11.115 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-20T08:09:11.208 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:11.208 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:11.209 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:11.703 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-20T08:09:11.710 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-20T08:09:11.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-01-20T08:09:11.870 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-01-20T08:09:11.965 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-01-20T08:09:12.042 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:12.042 INFO:tasks.ceph:role: osd.1 2024-01-20T08:09:12.042 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:09:12.042 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:12.136 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:12.137 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:12.137 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:12.137 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:12.596 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-20T08:09:12.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-20T08:09:12.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-01-20T08:09:12.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-01-20T08:09:12.826 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-01-20T08:09:12.909 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:12.909 INFO:tasks.ceph:role: osd.2 2024-01-20T08:09:12.909 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:09:12.910 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-20T08:09:13.000 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:13.000 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:13.000 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:13.000 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:13.001 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:13.514 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-20T08:09:13.520 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-20T08:09:13.520 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-01-20T08:09:13.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-01-20T08:09:13.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-01-20T08:09:13.916 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:13.916 INFO:tasks.ceph:role: osd.3 2024-01-20T08:09:13.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:09:13.917 DEBUG:teuthology.orchestra.run.smithi100:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-20T08:09:14.013 INFO:teuthology.orchestra.run.smithi100.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:14.014 INFO:teuthology.orchestra.run.smithi100.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:14.473 INFO:teuthology.orchestra.run.smithi100.stdout:Discarding blocks...Done. 2024-01-20T08:09:14.478 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi100.front.sepia.ceph.com -o noatime 2024-01-20T08:09:14.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-01-20T08:09:14.626 DEBUG:teuthology.orchestra.run.smithi100:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-01-20T08:09:14.720 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:14.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.865+0000 7ff38fe21640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-01-20T08:09:14.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.867+0000 7ff38fe21640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-01-20T08:09:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.867+0000 7ff38fe21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T08:09:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.867+0000 7ff38fe21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T08:09:14.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.867+0000 7ff38fe21640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-01-20T08:09:14.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:14.874+0000 7ff38fe21640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-01-20T08:09:18.045 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-01-20T08:09:18.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:18.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.276+0000 7f65c2519640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-01-20T08:09:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.276+0000 7f65c2519640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-01-20T08:09:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.276+0000 7f65c2519640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T08:09:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.277+0000 7f65c2519640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T08:09:18.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.277+0000 7f65c2519640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-01-20T08:09:18.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:18.279+0000 7f65c2519640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-01-20T08:09:21.463 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-01-20T08:09:21.555 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:21.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.692+0000 7febc7619640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-01-20T08:09:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.693+0000 7febc7619640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-01-20T08:09:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.693+0000 7febc7619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T08:09:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.693+0000 7febc7619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T08:09:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.693+0000 7febc7619640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-01-20T08:09:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:21.695+0000 7febc7619640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-01-20T08:09:24.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-01-20T08:09:24.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.107+0000 7feadf824640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-01-20T08:09:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.107+0000 7feadf824640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-01-20T08:09:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.107+0000 7feadf824640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T08:09:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.107+0000 7feadf824640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T08:09:25.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.107+0000 7feadf824640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-01-20T08:09:25.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:25.109+0000 7feadf824640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-01-20T08:09:28.283 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-01-20T08:09:28.380 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-01-20T08:09:28.479 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:28.479 INFO:tasks.ceph:role: osd.4 2024-01-20T08:09:28.479 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:09:28.479 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-01-20T08:09:28.570 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:28.570 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:28.570 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:28.571 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:28.604 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-01-20T08:09:28.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-20T08:09:28.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-01-20T08:09:28.720 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-01-20T08:09:28.801 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-01-20T08:09:28.884 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:28.884 INFO:tasks.ceph:role: osd.5 2024-01-20T08:09:28.884 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:09:28.884 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-01-20T08:09:28.971 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:28.972 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:29.005 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-01-20T08:09:29.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-20T08:09:29.013 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-01-20T08:09:29.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-01-20T08:09:29.201 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-01-20T08:09:29.291 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:29.292 INFO:tasks.ceph:role: osd.6 2024-01-20T08:09:29.292 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:09:29.292 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-01-20T08:09:29.377 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:29.377 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:29.377 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:29.377 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:29.377 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:29.378 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:29.378 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:29.378 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:29.378 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:29.378 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:29.411 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-01-20T08:09:29.416 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-20T08:09:29.416 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-01-20T08:09:29.519 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-01-20T08:09:29.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-01-20T08:09:29.700 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-01-20T08:09:29.700 INFO:tasks.ceph:role: osd.7 2024-01-20T08:09:29.700 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:09:29.700 DEBUG:teuthology.orchestra.run.smithi110:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-01-20T08:09:29.787 INFO:teuthology.orchestra.run.smithi110.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 attr=2, projid32bit=1 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout: = sunit=0 swidth=0 blks 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-01-20T08:09:29.788 INFO:teuthology.orchestra.run.smithi110.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-01-20T08:09:29.821 INFO:teuthology.orchestra.run.smithi110.stdout:Discarding blocks...Done. 2024-01-20T08:09:29.826 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi110.front.sepia.ceph.com -o noatime 2024-01-20T08:09:29.827 DEBUG:teuthology.orchestra.run.smithi110:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-01-20T08:09:29.931 DEBUG:teuthology.orchestra.run.smithi110:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-01-20T08:09:30.018 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:30.163 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.161+0000 7f4905b6f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-01-20T08:09:30.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.161+0000 7f4905b6f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-01-20T08:09:30.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.161+0000 7f4905b6f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T08:09:30.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.161+0000 7f4905b6f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T08:09:30.164 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.162+0000 7f4905b6f640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-01-20T08:09:30.166 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:30.164+0000 7f4905b6f640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-01-20T08:09:33.343 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-01-20T08:09:33.434 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:33.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.568+0000 7fc2d1a11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-01-20T08:09:33.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.569+0000 7fc2d1a11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-01-20T08:09:33.571 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.569+0000 7fc2d1a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T08:09:33.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.569+0000 7fc2d1a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T08:09:33.572 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.569+0000 7fc2d1a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-01-20T08:09:33.573 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:33.571+0000 7fc2d1a11640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-01-20T08:09:35.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:35.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:09:36.752 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-01-20T08:09:36.850 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.984+0000 7fedc0ed5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-01-20T08:09:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.984+0000 7fedc0ed5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-01-20T08:09:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.984+0000 7fedc0ed5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T08:09:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.985+0000 7fedc0ed5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T08:09:36.987 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.985+0000 7fedc0ed5640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-01-20T08:09:36.988 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:36.986+0000 7fedc0ed5640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-01-20T08:09:40.160 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-01-20T08:09:40.254 DEBUG:teuthology.orchestra.run.smithi110:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:40.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.388+0000 7f38e2e0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-01-20T08:09:40.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.388+0000 7f38e2e0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-01-20T08:09:40.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.388+0000 7f38e2e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T08:09:40.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.388+0000 7f38e2e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T08:09:40.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.388+0000 7f38e2e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-01-20T08:09:40.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:40.390+0000 7f38e2e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-01-20T08:09:43.572 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-01-20T08:09:43.667 INFO:tasks.ceph:Reading keys from all nodes... 2024-01-20T08:09:43.667 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:43.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-01-20T08:09:43.769 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:43.769 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-01-20T08:09:43.863 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:43.863 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-01-20T08:09:43.956 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:43.956 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-01-20T08:09:44.046 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:44.046 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-01-20T08:09:44.141 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:44.141 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-01-20T08:09:44.232 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:44.232 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-01-20T08:09:44.331 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.332 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-01-20T08:09:44.429 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.429 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-01-20T08:09:44.523 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.523 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-01-20T08:09:44.616 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.616 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-01-20T08:09:44.703 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-01-20T08:09:44.840 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.840 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-01-20T08:09:44.937 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:44.937 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-01-20T08:09:45.029 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:45.029 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-01-20T08:09:45.084 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:45.084 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-01-20T08:09:45.140 INFO:tasks.ceph:Adding keys to all mons... 2024-01-20T08:09:45.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-20T08:09:45.148 DEBUG:teuthology.orchestra.run.smithi110:> sudo tee -a /etc/ceph/ceph.keyring 2024-01-20T08:09:45.233 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.y] 2024-01-20T08:09:45.233 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQClf6tlFW6MERAAzJBCQ7yx6sLPN6cv75rbhg== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.a] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQClf6tl1DYBKhAAW3E/HAERBMsGrC4rMf53bQ== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.c] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQClf6tl/QN8OhAAToAKaEXXyxtgsbnP4CK9lg== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.0] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCqf6tlONOfMxAAUv9z4O2m2+OR+OlKEVTAyQ== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.1] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCuf6tlpdWGEBAA4XbJMFejMXMzlZtAcFI1rQ== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.2] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCxf6tlH+NYKRAAp4T2SRL9Hb7JzDT7AbAzzA== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.3] 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC1f6tlxVV0BhAAzktBoqojfG876bmIT8vaHg== 2024-01-20T08:09:45.234 INFO:teuthology.orchestra.run.smithi100.stdout:[mgr.x] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQClf6tlWV55HhAAm9X0Xnf67LjDKy4V1A8DvQ== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.b] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tl3YX/DxAAznFmYWhRluqcjxkZ5aIzOQ== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[mds.d] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tlJS3/IBAAyxDTy7tcAxzFhe/cO0LaAQ== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.4] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC6f6tl+4ikCRAA1btg/3+O5ZPGTIUHPT8vgw== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.5] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQC9f6tlEsDvIRAAFJKBssqBywoRFRWZFtHraA== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.6] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDAf6tl8W63OhAA/8jrYsmX0b/Jyf/bdIcR2A== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[osd.7] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDEf6tldmY8FxAA5SaAQB68UYfSJ3zFBwesuQ== 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-01-20T08:09:45.235 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA== 2024-01-20T08:09:45.236 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-01-20T08:09:45.236 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw== 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.y] 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQClf6tlFW6MERAAzJBCQ7yx6sLPN6cv75rbhg== 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.a] 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQClf6tl1DYBKhAAW3E/HAERBMsGrC4rMf53bQ== 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.c] 2024-01-20T08:09:45.240 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQClf6tl/QN8OhAAToAKaEXXyxtgsbnP4CK9lg== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.0] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCqf6tlONOfMxAAUv9z4O2m2+OR+OlKEVTAyQ== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.1] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCuf6tlpdWGEBAA4XbJMFejMXMzlZtAcFI1rQ== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.2] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCxf6tlH+NYKRAAp4T2SRL9Hb7JzDT7AbAzzA== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.3] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC1f6tlxVV0BhAAzktBoqojfG876bmIT8vaHg== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[mgr.x] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQClf6tlWV55HhAAm9X0Xnf67LjDKy4V1A8DvQ== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.b] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCmf6tl3YX/DxAAznFmYWhRluqcjxkZ5aIzOQ== 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout:[mds.d] 2024-01-20T08:09:45.241 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCmf6tlJS3/IBAAyxDTy7tcAxzFhe/cO0LaAQ== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.4] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC6f6tl+4ikCRAA1btg/3+O5ZPGTIUHPT8vgw== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.5] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQC9f6tlEsDvIRAAFJKBssqBywoRFRWZFtHraA== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.6] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDAf6tl8W63OhAA/8jrYsmX0b/Jyf/bdIcR2A== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[osd.7] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQDEf6tldmY8FxAA5SaAQB68UYfSJ3zFBwesuQ== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[client.0] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA== 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout:[client.1] 2024-01-20T08:09:45.242 INFO:teuthology.orchestra.run.smithi110.stdout: key = AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw== 2024-01-20T08:09:45.244 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T08:09:45.286 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T08:09:45.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:45.438 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:45.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:45.580 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:45.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:45.730 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:45.871 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:45.880 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.019 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.025 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.171 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.306 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T08:09:46.311 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-01-20T08:09:46.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:46.457 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:46.601 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:46.609 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-01-20T08:09:46.748 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.754 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:46.898 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:47.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:47.044 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:47.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:47.193 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-01-20T08:09:47.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T08:09:47.340 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T08:09:47.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T08:09:47.493 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-01-20T08:09:47.637 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-01-20T08:09:47.637 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-01-20T08:09:47.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T08:09:47.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-01-20T08:09:47.961 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-01-20T08:09:48.061 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T08:09:48.219 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-01-20T08:09:48.298 DEBUG:teuthology.orchestra.run.smithi110:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-01-20T08:09:48.389 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-01-20T08:09:48.542 DEBUG:teuthology.orchestra.run.smithi110:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-01-20T08:09:48.631 DEBUG:teuthology.orchestra.run.smithi100:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:48.639 DEBUG:teuthology.orchestra.run.smithi110:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-01-20T08:09:48.691 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-01-20T08:09:48.692 INFO:tasks.ceph.mon.a:Restarting daemon 2024-01-20T08:09:48.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-01-20T08:09:48.697 INFO:tasks.ceph.mon.a:Started 2024-01-20T08:09:48.697 INFO:tasks.ceph.mon.b:Restarting daemon 2024-01-20T08:09:48.697 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-01-20T08:09:48.704 INFO:tasks.ceph.mon.b:Started 2024-01-20T08:09:48.704 INFO:tasks.ceph.mon.c:Restarting daemon 2024-01-20T08:09:48.704 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-01-20T08:09:48.711 INFO:tasks.ceph.mon.c:Started 2024-01-20T08:09:48.712 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-01-20T08:09:48.712 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-01-20T08:09:48.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-01-20T08:09:48.718 INFO:tasks.ceph.mgr.y:Started 2024-01-20T08:09:48.719 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-01-20T08:09:48.719 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-01-20T08:09:48.723 INFO:tasks.ceph.mgr.x:Started 2024-01-20T08:09:48.724 INFO:tasks.ceph:Setting crush tunables to default 2024-01-20T08:09:48.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph osd crush tunables default 2024-01-20T08:09:48.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.895+0000 7f2a9ec00640 1 Processor -- start 2024-01-20T08:09:48.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.896+0000 7f2a9ec00640 1 -- start start 2024-01-20T08:09:48.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9ec00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 0x7f2a98070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9ec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980c2260 con 0x7f2a9806d130 2024-01-20T08:09:48.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a980c2540 con 0x7f2a9806cd10 2024-01-20T08:09:48.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9ec00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a9806c510 con 0x7f2a9815c240 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a97e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 0x7f2a98070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9cc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2a9806d130 0x7f2a981635d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50334/0 (socket says 172.21.15.100:50334) 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.897+0000 7f2a9cc00640 1 -- 172.21.15.100:0/3303914882 learned_addr learned my addr 172.21.15.100:0/3303914882 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.898+0000 7f2a97e00640 1 -- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 msgr2=0x7f2a98070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.898+0000 7f2a97e00640 1 -- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 msgr2=0x7f2a98070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.898+0000 7f2a97e00640 1 --2- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 0x7f2a98070190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-01-20T08:09:48.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.898+0000 7f2a97e00640 1 --2- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 0x7f2a98070190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-01-20T08:09:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.905+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336748056 0 0) 0x7f2a980c2260 con 0x7f2a9806d130 2024-01-20T08:09:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.905+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a78003520 con 0x7f2a9806d130 2024-01-20T08:09:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335959411 0 0) 0x7f2a980c2540 con 0x7f2a9806cd10 2024-01-20T08:09:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a980c2260 con 0x7f2a9806cd10 2024-01-20T08:09:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1360321032 0 0) 0x7f2a78003520 con 0x7f2a9806d130 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 msgr2=0x7f2a98070190 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 --2- 172.21.15.100:0/3303914882 >> v2:172.21.15.110:3300/0 conn(0x7f2a9815c240 0x7f2a98070190 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 >> v1:172.21.15.110:6789/0 conn(0x7f2a9806cd10 legacy=0x7f2a9815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9806c7f0 con 0x7f2a9806d130 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f2a900019f0 con 0x7f2a9806d130 2024-01-20T08:09:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 >> v1:172.21.15.100:6789/0 conn(0x7f2a9806d130 legacy=0x7f2a981635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a78003b50 0x7f2a78003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a780047c0 0x7f2a78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9806c510 con 0x7f2a78003b50 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7800c1a0 con 0x7f2a78005250 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a7800c360 con 0x7f2a780047c0 2024-01-20T08:09:48.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.906+0000 7f2a9cc00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a97400640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a780047c0 0x7f2a78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a97e00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a78003b50 0x7f2a78003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a9cc00640 1 -- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a780047c0 msgr2=0x7f2a78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a9cc00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a780047c0 0x7f2a78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a9cc00640 1 -- 172.21.15.100:0/3303914882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a78003b50 msgr2=0x7f2a78003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a9cc00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a78003b50 0x7f2a78003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.907+0000 7f2a9cc00640 1 -- 172.21.15.100:0/3303914882 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a78003520 con 0x7f2a78005250 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.908+0000 7f2a9cc00640 1 -- 172.21.15.100:0/3303914882 reap_dead start 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.908+0000 7f2a9cc00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a7800b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000a700 tx=0x7f2a780057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=259c77a57074f038 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.908+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a90034630 con 0x7f2a78005250 2024-01-20T08:09:48.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.908+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9002f070 con 0x7f2a78005250 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.908+0000 7f2a96a00640 1 -- 172.21.15.100:0/3303914882 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a900349d0 con 0x7f2a78005250 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 -- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 msgr2=0x7f2a7800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a7800b980 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2a9000a700 tx=0x7f2a780057f0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 -- 172.21.15.100:0/3303914882 shutdown_connections 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/3303914882 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a7800b980 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 -- 172.21.15.100:0/3303914882 >> 172.21.15.100:0/3303914882 conn(0x7f2a980c2940 msgr2=0x7f2a980c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 -- 172.21.15.100:0/3303914882 shutdown_connections 2024-01-20T08:09:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.909+0000 7f2a9ec00640 1 -- 172.21.15.100:0/3303914882 wait complete. 2024-01-20T08:09:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.911+0000 7f2a9ec00640 1 Processor -- start 2024-01-20T08:09:48.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.911+0000 7f2a9ec00640 1 -- start start 2024-01-20T08:09:48.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a9815b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a980c4f00 0x7f2a9814d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9814d590 con 0x7f2a9815bbd0 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9815aa50 con 0x7f2a78005250 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a9815af80 con 0x7f2a980c4f00 2024-01-20T08:09:48.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a97400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a97e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a9815b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a97400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52804/0 (socket says 172.21.15.100:52804) 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a97400640 1 -- 172.21.15.100:0/722809708 learned_addr learned my addr 172.21.15.100:0/722809708 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.912+0000 7f2a9cc00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a980c4f00 0x7f2a9814d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 -- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a980c4f00 msgr2=0x7f2a9814d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a980c4f00 0x7f2a9814d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 -- 172.21.15.100:0/722809708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 msgr2=0x7f2a9814ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 -- 172.21.15.100:0/722809708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a9814d260 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97400640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a97e00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a9815b4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800f490 tx=0x7f2a8800f890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a88004440 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a88003610 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a9815aca0 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a880039a0 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.913+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a9814dde0 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.914+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f2a8801f460 con 0x7f2a78005250 2024-01-20T08:09:48.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.914+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2a880156d0 con 0x7f2a78005250 2024-01-20T08:09:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.914+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a9804e970 con 0x7f2a78005250 2024-01-20T08:09:48.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.918+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f2a88015890 con 0x7f2a78005250 2024-01-20T08:09:48.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.988+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f2a980c1490 con 0x7f2a78005250 2024-01-20T08:09:48.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.995+0000 7f2a8fe00640 1 -- 172.21.15.100:0/722809708 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f2a88015a30 con 0x7f2a78005250 2024-01-20T08:09:48.997 INFO:teuthology.orchestra.run.smithi100.stderr:adjusted tunables profile to default 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 msgr2=0x7f2a9815b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a9815b4f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2a8800f490 tx=0x7f2a8800f890 comp rx=0 tx=0).stop 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 shutdown_connections 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a980c4f00 0x7f2a9814d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a9815bbd0 0x7f2a9814ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 --2- 172.21.15.100:0/722809708 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a78005250 0x7f2a9815b4f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.996+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 >> 172.21.15.100:0/722809708 conn(0x7f2a980c2940 msgr2=0x7f2a9814a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.997+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 shutdown_connections 2024-01-20T08:09:48.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:48.997+0000 7f2a9ec00640 1 -- 172.21.15.100:0/722809708 wait complete. 2024-01-20T08:09:49.016 INFO:tasks.ceph:check_enable_crimson: False 2024-01-20T08:09:49.017 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-01-20T08:09:49.017 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:49.017 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-01-20T08:09:49.100 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:49.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-01-20T08:09:49.221 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:49.221 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-01-20T08:09:49.348 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:09:49.349 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-01-20T08:09:49.473 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:49.473 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-01-20T08:09:49.562 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:49.563 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-01-20T08:09:49.650 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:49.650 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-01-20T08:09:49.653 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:49.649+0000 7fe6e700d040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-20T08:09:49.655 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:49.654+0000 7f63ab216040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-01-20T08:09:49.720 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:49.717+0000 7fe6e700d040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-20T08:09:49.721 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:49.720+0000 7f63ab216040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-01-20T08:09:49.736 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:09:49.736 DEBUG:teuthology.orchestra.run.smithi110:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-01-20T08:09:49.862 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 45a7d8b8-6221-4bc2-8530-fc57c333c2bd 0 2024-01-20T08:09:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.090+0000 7f00ce800640 1 Processor -- start 2024-01-20T08:09:50.093 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.090+0000 7f00ce800640 1 -- start start 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.091+0000 7f00ce800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.091+0000 7f00ce800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80c9100 con 0x7f00c80c7ff0 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.091+0000 7f00ce800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c80c84f0 con 0x7f00c806b520 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.091+0000 7f00ce800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c806b9d0 con 0x7f00c806b140 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.091+0000 7f00c7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34424/0 (socket says 172.21.15.110:34424) 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7400640 1 -- 172.21.15.110:0/1341251234 learned_addr learned my addr 172.21.15.110:0/1341251234 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:50.095 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7e00640 1 --1- 172.21.15.110:0/1341251234 >> v1:172.21.15.110:6789/0 conn(0x7f00c806b520 0x7f00c81565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54800/0 (socket says 172.21.15.110:54800) 2024-01-20T08:09:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7400640 1 -- 172.21.15.110:0/1341251234 >> v1:172.21.15.110:6789/0 conn(0x7f00c806b520 legacy=0x7f00c81565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7400640 1 -- 172.21.15.110:0/1341251234 >> v1:172.21.15.100:6789/0 conn(0x7f00c80c7ff0 legacy=0x7f00c8155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:50.096 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.092+0000 7f00c7400640 1 -- 172.21.15.110:0/1341251234 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c80c87d0 con 0x7f00c806b140 2024-01-20T08:09:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.093+0000 7f00c7400640 1 --2- 172.21.15.110:0/1341251234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009eb0 tx=0x7f00b802bc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf05acedbf59ff4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.093+0000 7f00c6000640 1 -- 172.21.15.110:0/1341251234 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b802c770 con 0x7f00c806b140 2024-01-20T08:09:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.093+0000 7f00c6000640 1 -- 172.21.15.110:0/1341251234 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b802c8d0 con 0x7f00c806b140 2024-01-20T08:09:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.093+0000 7f00c6000640 1 -- 172.21.15.110:0/1341251234 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b802cc60 con 0x7f00c806b140 2024-01-20T08:09:50.098 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 -- 172.21.15.110:0/1341251234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 msgr2=0x7f00c8154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 --2- 172.21.15.110:0/1341251234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009eb0 tx=0x7f00b802bc50 comp rx=0 tx=0).stop 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 -- 172.21.15.110:0/1341251234 shutdown_connections 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 --2- 172.21.15.110:0/1341251234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c806b140 0x7f00c8154810 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 -- 172.21.15.110:0/1341251234 >> 172.21.15.110:0/1341251234 conn(0x7f00c80abc80 msgr2=0x7f00c80ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 -- 172.21.15.110:0/1341251234 shutdown_connections 2024-01-20T08:09:50.099 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.094+0000 7f00ce800640 1 -- 172.21.15.110:0/1341251234 wait complete. 2024-01-20T08:09:50.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.096+0000 7f00ce800640 1 Processor -- start 2024-01-20T08:09:50.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.096+0000 7f00ce800640 1 -- start start 2024-01-20T08:09:50.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.102 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c806b520 0x7f00c81481e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 0x7f00c8148720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c80bdf30 con 0x7f00c806b520 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c81ee540 con 0x7f00c806b140 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00ce800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c814c7f0 con 0x7f00c80c7ff0 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 0x7f00c8148720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:32992/0 (socket says 172.21.15.110:32992) 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 -- 172.21.15.110:0/1120597021 learned_addr learned my addr 172.21.15.110:0/1120597021 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 -- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 msgr2=0x7f00c8148720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 0x7f00c8148720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 -- 172.21.15.110:0/1120597021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c806b520 msgr2=0x7f00c81481e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c806b520 0x7f00c81481e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.103 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7400640 1 -- 172.21.15.110:0/1120597021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009b30 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.097+0000 7f00c7e00640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 0x7f00c8148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00c7400640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009eb0 tx=0x7f00b8004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8009510 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b8007a30 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c81ea930 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8007de0 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c81edc10 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f00b803e450 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.098+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f00b8048720 con 0x7f00c806b140 2024-01-20T08:09:50.104 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.099+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c804e970 con 0x7f00c806b140 2024-01-20T08:09:50.105 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.101+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f00b8043020 con 0x7f00c806b140 2024-01-20T08:09:50.182 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.179+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "45a7d8b8-6221-4bc2-8530-fc57c333c2bd", "id": 0} v 0) v1 -- 0x7f00c804e970 con 0x7f00c806b140 2024-01-20T08:09:50.191 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.188+0000 7f00bf400640 1 -- 172.21.15.110:0/1120597021 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "45a7d8b8-6221-4bc2-8530-fc57c333c2bd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f00b8048930 con 0x7f00c806b140 2024-01-20T08:09:50.191 INFO:teuthology.orchestra.run.smithi110.stdout:0 2024-01-20T08:09:50.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 msgr2=0x7f00c80ab160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009eb0 tx=0x7f00b8004a40 comp rx=0 tx=0).stop 2024-01-20T08:09:50.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 shutdown_connections 2024-01-20T08:09:50.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00c80c7ff0 0x7f00c8148720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.193 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00c806b520 0x7f00c81481e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.189+0000 7f00ce800640 1 --2- 172.21.15.110:0/1120597021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00c806b140 0x7f00c80ab160 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.190+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 >> 172.21.15.110:0/1120597021 conn(0x7f00c80abc80 msgr2=0x7f00c8155eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.190+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 shutdown_connections 2024-01-20T08:09:50.194 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.190+0000 7f00ce800640 1 -- 172.21.15.110:0/1120597021 wait complete. 2024-01-20T08:09:50.208 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new f97f7eb3-6d69-48a2-9d79-04d22d7207a5 1 2024-01-20T08:09:50.311 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.309+0000 7f63ab216040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-20T08:09:50.329 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.325+0000 7fe6e700d040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-01-20T08:09:50.371 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.369+0000 7f63ab216040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-20T08:09:50.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.378+0000 7f094a000640 1 Processor -- start 2024-01-20T08:09:50.382 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.379+0000 7f094a000640 1 -- start start 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f094a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f094a000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0944158b80 con 0x7f0944151d90 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f094a000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09440c8510 con 0x7f0944154950 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f094a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0944152170 con 0x7f09440c4880 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f093be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.384 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f0949600640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0944154950 0x7f0944154de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54808/0 (socket says 172.21.15.110:54808) 2024-01-20T08:09:50.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f0949600640 1 -- 172.21.15.110:0/2509708849 learned_addr learned my addr 172.21.15.110:0/2509708849 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:50.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f093be00640 1 -- 172.21.15.110:0/2509708849 >> v1:172.21.15.110:6789/0 conn(0x7f0944154950 legacy=0x7f0944154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f0943e00640 1 -- 172.21.15.110:0/2509708849 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185875341 0 0) 0x7f09440c8510 con 0x7f0944154950 2024-01-20T08:09:50.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f093be00640 1 -- 172.21.15.110:0/2509708849 >> v1:172.21.15.100:6789/0 conn(0x7f0944151d90 legacy=0x7f09440c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.385 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.381+0000 7f093be00640 1 -- 172.21.15.110:0/2509708849 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0944157c90 con 0x7f09440c4880 2024-01-20T08:09:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.382+0000 7f093be00640 1 --2- 172.21.15.110:0/2509708849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440c4ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f092c0097d0 tx=0x7f092c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d039ce6ac559d202 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.383+0000 7f0943e00640 1 -- 172.21.15.110:0/2509708849 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c031800 con 0x7f09440c4880 2024-01-20T08:09:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.383+0000 7f0943e00640 1 -- 172.21.15.110:0/2509708849 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092c031960 con 0x7f09440c4880 2024-01-20T08:09:50.386 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.383+0000 7f0943e00640 1 -- 172.21.15.110:0/2509708849 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c031cf0 con 0x7f09440c4880 2024-01-20T08:09:50.387 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 -- 172.21.15.110:0/2509708849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 msgr2=0x7f09440c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 --2- 172.21.15.110:0/2509708849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440c4ce0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f092c0097d0 tx=0x7f092c02b8a0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 -- 172.21.15.110:0/2509708849 shutdown_connections 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 --2- 172.21.15.110:0/2509708849 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440c4ce0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 -- 172.21.15.110:0/2509708849 >> 172.21.15.110:0/2509708849 conn(0x7f0944071ef0 msgr2=0x7f0944072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 -- 172.21.15.110:0/2509708849 shutdown_connections 2024-01-20T08:09:50.388 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.384+0000 7f094a000640 1 -- 172.21.15.110:0/2509708849 wait complete. 2024-01-20T08:09:50.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.385+0000 7f094a000640 1 Processor -- start 2024-01-20T08:09:50.389 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 -- start start 2024-01-20T08:09:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0944151d90 0x7f0944153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0944154950 0x7f09441ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.391 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09441e9f30 con 0x7f0944151d90 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.386+0000 7f094a000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09440ae770 con 0x7f0944154950 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f094a000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09440aea50 con 0x7f09440c4880 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34450/0 (socket says 172.21.15.110:34450) 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 -- 172.21.15.110:0/376096853 learned_addr learned my addr 172.21.15.110:0/376096853 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0949600640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0944154950 0x7f09441ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f093be00640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0944151d90 0x7f0944153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 -- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0944154950 msgr2=0x7f09441ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0944154950 0x7f09441ea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 -- 172.21.15.110:0/376096853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0944151d90 msgr2=0x7f0944153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0944151d90 0x7f0944153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 -- 172.21.15.110:0/376096853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f092c009400 con 0x7f09440c4880 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.387+0000 7f0948c00640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f093400c450 tx=0x7f093400c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.392 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09340052d0 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0934005430 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0934012870 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09440aed30 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09441542f0 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f0934012d50 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.388+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f093401b7a0 con 0x7f09440c4880 2024-01-20T08:09:50.393 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.389+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09441ea070 con 0x7f09440c4880 2024-01-20T08:09:50.395 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.392+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f09441ea070 con 0x7f09440c4880 2024-01-20T08:09:50.395 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.392+0000 7fe6e700d040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-01-20T08:09:50.423 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.422+0000 7f63ab216040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-20T08:09:50.449 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.445+0000 7fe6e700d040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-01-20T08:09:50.476 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.470+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f97f7eb3-6d69-48a2-9d79-04d22d7207a5", "id": 1} v 0) v1 -- 0x7f09440c86a0 con 0x7f09440c4880 2024-01-20T08:09:50.481 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.478+0000 7f0941600640 1 -- 172.21.15.110:0/376096853 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f97f7eb3-6d69-48a2-9d79-04d22d7207a5", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f093401ba30 con 0x7f09440c4880 2024-01-20T08:09:50.481 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 msgr2=0x7f09440acb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f093400c450 tx=0x7f093400c910 comp rx=0 tx=0).stop 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 shutdown_connections 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0944154950 0x7f09441ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0944151d90 0x7f0944153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 --2- 172.21.15.110:0/376096853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09440c4880 0x7f09440acb40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 >> 172.21.15.110:0/376096853 conn(0x7f0944071ef0 msgr2=0x7f09440c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.483 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 shutdown_connections 2024-01-20T08:09:50.484 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.479+0000 7f094a000640 1 -- 172.21.15.110:0/376096853 wait complete. 2024-01-20T08:09:50.486 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.485+0000 7f63ab216040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-20T08:09:50.499 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 16394a8b-fa50-4339-8c92-559e237186f3 2 2024-01-20T08:09:50.515 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.511+0000 7fe6e700d040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-01-20T08:09:50.536 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.534+0000 7f63ab216040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-20T08:09:50.567 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.564+0000 7fe6e700d040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-01-20T08:09:50.648 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.647+0000 7f63ab216040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-20T08:09:50.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.679+0000 7f8929200640 1 Processor -- start 2024-01-20T08:09:50.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.679+0000 7f8929200640 1 -- start start 2024-01-20T08:09:50.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8929200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f892406f6c0 0x7f892406a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.685 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8929200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924155c50 con 0x7f892406a5e0 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8929200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8924155f30 con 0x7f89240a84a0 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8929200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89240a9fc0 con 0x7f892406f6c0 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8921400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f892406f6c0 0x7f892406a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8922800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f89240a84a0 0x7f89241563c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54820/0 (socket says 172.21.15.110:54820) 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8922800640 1 -- 172.21.15.110:0/2777098150 learned_addr learned my addr 172.21.15.110:0/2777098150 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.681+0000 7f8921400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f892406f6c0 0x7f892406a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33012/0 (socket says 172.21.15.110:33012) 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.682+0000 7f8921400640 1 -- 172.21.15.110:0/2777098150 >> v1:172.21.15.110:6789/0 conn(0x7f89240a84a0 legacy=0x7f89241563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.682+0000 7f8921400640 1 -- 172.21.15.110:0/2777098150 >> v1:172.21.15.100:6789/0 conn(0x7f892406a5e0 legacy=0x7f89240c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.686 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.682+0000 7f8921400640 1 -- 172.21.15.110:0/2777098150 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240c36e0 con 0x7f892406f6c0 2024-01-20T08:09:50.687 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8921400640 1 --2- 172.21.15.110:0/2777098150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f892406f6c0 0x7f892406a9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f890c0097a0 tx=0x7f890c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb1f82c237092773 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8920a00640 1 -- 172.21.15.110:0/2777098150 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c02e070 con 0x7f892406f6c0 2024-01-20T08:09:50.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8920a00640 1 -- 172.21.15.110:0/2777098150 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890c0315a0 con 0x7f892406f6c0 2024-01-20T08:09:50.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8920a00640 1 -- 172.21.15.110:0/2777098150 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890c031930 con 0x7f892406f6c0 2024-01-20T08:09:50.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8929200640 1 -- 172.21.15.110:0/2777098150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f892406f6c0 msgr2=0x7f892406a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.688 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.683+0000 7f8929200640 1 --2- 172.21.15.110:0/2777098150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f892406f6c0 0x7f892406a9c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f890c0097a0 tx=0x7f890c02b840 comp rx=0 tx=0).stop 2024-01-20T08:09:50.688 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.684+0000 7fe6e700d040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-01-20T08:09:50.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.684+0000 7f8929200640 1 -- 172.21.15.110:0/2777098150 shutdown_connections 2024-01-20T08:09:50.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.684+0000 7f8929200640 1 --2- 172.21.15.110:0/2777098150 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f892406f6c0 0x7f892406a9c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.691 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.684+0000 7f8929200640 1 -- 172.21.15.110:0/2777098150 >> 172.21.15.110:0/2777098150 conn(0x7f89240c39c0 msgr2=0x7f89240c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.684+0000 7f8929200640 1 -- 172.21.15.110:0/2777098150 shutdown_connections 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.684+0000 7f8929200640 1 -- 172.21.15.110:0/2777098150 wait complete. 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.685+0000 7f8929200640 1 Processor -- start 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.685+0000 7f8929200640 1 -- start start 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 0x7f89241404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 0x7f89241ea3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892414bc90 con 0x7f892406a5e0 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8924140e70 con 0x7f89240a84a0 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8929200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89240ad010 con 0x7f892406f6c0 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8922800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.692 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.686+0000 7f8921400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 0x7f89241ea3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33014/0 (socket says 172.21.15.110:33014) 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 -- 172.21.15.110:0/2429157812 learned_addr learned my addr 172.21.15.110:0/2429157812 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8921e00640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 0x7f89241404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 -- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 msgr2=0x7f89241ea3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 0x7f89241ea3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 -- 172.21.15.110:0/2429157812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 msgr2=0x7f89241404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 0x7f89241404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 -- 172.21.15.110:0/2429157812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c009400 con 0x7f89240a84a0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8921400640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 0x7f89241ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8921e00640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 0x7f89241404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f8922800640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f891c00ca80 tx=0x7f891c00cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c00ac30 con 0x7f89240a84a0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f891c00ad90 con 0x7f89240a84a0 2024-01-20T08:09:50.693 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.687+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891c012600 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.688+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89241eda80 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.688+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89241edd20 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.688+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f891c012ae0 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.688+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f891c01ce40 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.689+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8924067b60 con 0x7f89240a84a0 2024-01-20T08:09:50.694 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.692+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f891c021060 con 0x7f89240a84a0 2024-01-20T08:09:50.728 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.726+0000 7f63ab216040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-20T08:09:50.771 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.767+0000 7fe6e700d040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-01-20T08:09:50.772 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.769+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "16394a8b-fa50-4339-8c92-559e237186f3", "id": 2} v 0) v1 -- 0x7f89241edf60 con 0x7f89240a84a0 2024-01-20T08:09:50.779 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.776+0000 7f891a000640 1 -- 172.21.15.110:0/2429157812 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "16394a8b-fa50-4339-8c92-559e237186f3", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89241edf60 con 0x7f89240a84a0 2024-01-20T08:09:50.779 INFO:teuthology.orchestra.run.smithi110.stdout:2 2024-01-20T08:09:50.781 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.777+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 msgr2=0x7f89241ee240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.777+0000 7f8929200640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f891c00ca80 tx=0x7f891c00cf40 comp rx=0 tx=0).stop 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 shutdown_connections 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89240a84a0 0x7f89241ee240 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f892406f6c0 0x7f89241ea3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 --2- 172.21.15.110:0/2429157812 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f892406a5e0 0x7f89241404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 >> 172.21.15.110:0/2429157812 conn(0x7f89240c39c0 msgr2=0x7f892406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 shutdown_connections 2024-01-20T08:09:50.782 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:50.778+0000 7f8929200640 1 -- 172.21.15.110:0/2429157812 wait complete. 2024-01-20T08:09:50.783 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.780+0000 7f63ab216040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-20T08:09:50.796 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new d606a683-b901-4652-bd41-93926fee5710 3 2024-01-20T08:09:50.828 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.824+0000 7fe6e700d040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-01-20T08:09:50.841 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.839+0000 7f63ab216040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-20T08:09:50.892 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.888+0000 7fe6e700d040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-01-20T08:09:50.895 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:50.893+0000 7f63ab216040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-20T08:09:50.950 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:50.947+0000 7fe6e700d040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-01-20T08:09:51.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.007+0000 7f7196200640 1 Processor -- start 2024-01-20T08:09:51.010 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.007+0000 7f7196200640 1 -- start start 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f7196200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f71900c7ff0 0x7f7190154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f7196200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900c9100 con 0x7f719006b140 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f7196200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71900c84f0 con 0x7f719006b520 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f7196200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f719006b9d0 con 0x7f71900c7ff0 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f718fe00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f719006b520 0x7f71901565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54832/0 (socket says 172.21.15.110:54832) 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.008+0000 7f718fe00640 1 -- 172.21.15.110:0/1033466378 learned_addr learned my addr 172.21.15.110:0/1033466378 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f7187e00640 1 --2- 172.21.15.110:0/1033466378 >> v2:172.21.15.100:3300/0 conn(0x7f71900c7ff0 0x7f7190154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2467499785 0 0) 0x7f71900c84f0 con 0x7f719006b520 2024-01-20T08:09:51.012 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7170003520 con 0x7f719006b520 2024-01-20T08:09:51.015 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v1:172.21.15.110:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1540126589 0 0) 0x7f7170003520 con 0x7f719006b520 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 >> v2:172.21.15.100:3300/0 conn(0x7f71900c7ff0 msgr2=0x7f7190154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 --2- 172.21.15.110:0/1033466378 >> v2:172.21.15.100:3300/0 conn(0x7f71900c7ff0 0x7f7190154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 >> v1:172.21.15.100:6789/0 conn(0x7f719006b140 legacy=0x7f7190155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 --> v1:172.21.15.110:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71900c87d0 con 0x7f719006b520 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v1:172.21.15.110:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f71880019f0 con 0x7f719006b520 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 >> v1:172.21.15.110:6789/0 conn(0x7f719006b520 legacy=0x7f71901565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7170003970 0x7f7170003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 0x7f7170004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71700052a0 0x7f717000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719006b9d0 con 0x7f7170003970 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717000c170 con 0x7f71700047c0 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.009+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717000c330 con 0x7f71700052a0 2024-01-20T08:09:51.016 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 0x7f7170004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f718fe00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71700052a0 0x7f717000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f718f400640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7170003970 0x7f7170003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 -- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71700052a0 msgr2=0x7f717000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71700052a0 0x7f717000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 -- 172.21.15.110:0/1033466378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7170003970 msgr2=0x7f7170003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7170003970 0x7f7170003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f7187e00640 1 -- 172.21.15.110:0/1033466378 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7170003520 con 0x7f71700047c0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f718fe00640 1 -- 172.21.15.110:0/1033466378 reap_dead start 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.010+0000 7f718f400640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7170003970 0x7f7170003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.011+0000 7f7187e00640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 0x7f7170004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f71900c8420 tx=0x7f71700057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4102fbf351cb7686 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.011+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717802c660 con 0x7f71700047c0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.011+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f717802c7c0 con 0x7f71700047c0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.011+0000 7f718ea00640 1 -- 172.21.15.110:0/1033466378 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717802cb50 con 0x7f71700047c0 2024-01-20T08:09:51.017 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 -- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 msgr2=0x7f7170004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 0x7f7170004c40 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f71900c8420 tx=0x7f71700057f0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 -- 172.21.15.110:0/1033466378 shutdown_connections 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 --2- 172.21.15.110:0/1033466378 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f71700047c0 0x7f7170004c40 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 -- 172.21.15.110:0/1033466378 >> 172.21.15.110:0/1033466378 conn(0x7f71900abc80 msgr2=0x7f71900ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 -- 172.21.15.110:0/1033466378 shutdown_connections 2024-01-20T08:09:51.018 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.012+0000 7f7196200640 1 -- 172.21.15.110:0/1033466378 wait complete. 2024-01-20T08:09:51.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.014+0000 7f7196200640 1 Processor -- start 2024-01-20T08:09:51.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.014+0000 7f7196200640 1 -- start start 2024-01-20T08:09:51.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700047c0 0x7f719014a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190153aa0 0x7f7190150f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7190150bb0 con 0x7f71700047c0 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71901eaae0 con 0x7f7190153aa0 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7196200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719014f4c0 con 0x7f71901ea600 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34478/0 (socket says 172.21.15.110:34478) 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 -- 172.21.15.110:0/2080519081 learned_addr learned my addr 172.21.15.110:0/2080519081 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f718f400640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700047c0 0x7f719014a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.021 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 -- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190153aa0 msgr2=0x7f7190150f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190153aa0 0x7f7190150f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 -- 172.21.15.110:0/2080519081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700047c0 msgr2=0x7f719014a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700047c0 0x7f719014a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.015+0000 7f7187e00640 1 -- 172.21.15.110:0/2080519081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f719014de50 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7187e00640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7178009b80 tx=0x7f7178004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178003810 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7178003970 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7178003d20 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71900af990 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.016+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f719014ace0 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.017+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f717803b050 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.017+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7178049d10 con 0x7f71901ea600 2024-01-20T08:09:51.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.017+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71900afeb0 con 0x7f71901ea600 2024-01-20T08:09:51.023 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.020+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f7178068cf0 con 0x7f71901ea600 2024-01-20T08:09:51.101 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.098+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d606a683-b901-4652-bd41-93926fee5710", "id": 3} v 0) v1 -- 0x7f719004e970 con 0x7f71901ea600 2024-01-20T08:09:51.107 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.104+0000 7f7187400640 1 -- 172.21.15.110:0/2080519081 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d606a683-b901-4652-bd41-93926fee5710", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7178057030 con 0x7f71901ea600 2024-01-20T08:09:51.108 INFO:teuthology.orchestra.run.smithi110.stdout:3 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.105+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 msgr2=0x7f7190153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.105+0000 7f7196200640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7178009b80 tx=0x7f7178004730 comp rx=0 tx=0).stop 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 shutdown_connections 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7190153aa0 0x7f7190150f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f71901ea600 0x7f7190153560 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 --2- 172.21.15.110:0/2080519081 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f71700047c0 0x7f719014a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.109 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 >> 172.21.15.110:0/2080519081 conn(0x7f71900abc80 msgr2=0x7f71900ab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 shutdown_connections 2024-01-20T08:09:51.110 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.106+0000 7f7196200640 1 -- 172.21.15.110:0/2080519081 wait complete. 2024-01-20T08:09:51.126 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 8da735fb-0b76-4a5c-957e-b9a5b40f8ea4 4 2024-01-20T08:09:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.311+0000 7f1956600640 1 Processor -- start 2024-01-20T08:09:51.315 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.312+0000 7f1956600640 1 -- start start 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1956600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1956600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 0x7f19500c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1956600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950158b80 con 0x7f1950154950 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1956600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950152170 con 0x7f19500c4880 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1956600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500bd840 con 0x7f1950151d90 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1955200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1947e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 0x7f19500c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1955200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34494/0 (socket says 172.21.15.110:34494) 2024-01-20T08:09:51.317 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1955200640 1 -- 172.21.15.110:0/416568276 learned_addr learned my addr 172.21.15.110:0/416568276 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.313+0000 7f1947e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 0x7f19500c4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33042/0 (socket says 172.21.15.110:33042) 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.314+0000 7f1955200640 1 -- 172.21.15.110:0/416568276 >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 msgr2=0x7f19500c4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.314+0000 7f1955200640 1 --2- 172.21.15.110:0/416568276 >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 0x7f19500c4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.314+0000 7f1955200640 1 -- 172.21.15.110:0/416568276 >> v1:172.21.15.110:6789/0 conn(0x7f1950154950 legacy=0x7f1950154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.314+0000 7f1955200640 1 -- 172.21.15.110:0/416568276 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950157c90 con 0x7f1950151d90 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.315+0000 7f1955200640 1 --2- 172.21.15.110:0/416568276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1940009870 tx=0x7f194002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc3349bca591d5df server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.318 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.315+0000 7f194fe00640 1 -- 172.21.15.110:0/416568276 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940031640 con 0x7f1950151d90 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.315+0000 7f194fe00640 1 -- 172.21.15.110:0/416568276 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400317a0 con 0x7f1950151d90 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.315+0000 7f194fe00640 1 -- 172.21.15.110:0/416568276 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940031b30 con 0x7f1950151d90 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 -- 172.21.15.110:0/416568276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 msgr2=0x7f19500c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 --2- 172.21.15.110:0/416568276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1940009870 tx=0x7f194002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 -- 172.21.15.110:0/416568276 shutdown_connections 2024-01-20T08:09:51.319 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 --2- 172.21.15.110:0/416568276 >> v2:172.21.15.110:3300/0 conn(0x7f19500c4880 0x7f19500c4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 --2- 172.21.15.110:0/416568276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950151d90 0x7f19500c7e00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 -- 172.21.15.110:0/416568276 >> 172.21.15.110:0/416568276 conn(0x7f1950071ef0 msgr2=0x7f1950072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 -- 172.21.15.110:0/416568276 shutdown_connections 2024-01-20T08:09:51.320 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.316+0000 7f1956600640 1 -- 172.21.15.110:0/416568276 wait complete. 2024-01-20T08:09:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.318+0000 7f1956600640 1 Processor -- start 2024-01-20T08:09:51.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.318+0000 7f1956600640 1 -- start start 2024-01-20T08:09:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1950151d90 0x7f19500c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950154950 0x7f19500c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950148e40 con 0x7f1950151d90 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950148fb0 con 0x7f19500c4880 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1956600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1950152fa0 con 0x7f1950154950 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950154950 0x7f19500c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33048/0 (socket says 172.21.15.110:33048) 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 -- 172.21.15.110:0/4063036677 learned_addr learned my addr 172.21.15.110:0/4063036677 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1947e00640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1950151d90 0x7f19500c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 -- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950154950 msgr2=0x7f19500c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950154950 0x7f19500c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.324 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 -- 172.21.15.110:0/4063036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1950151d90 msgr2=0x7f19500c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1950151d90 0x7f19500c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.319+0000 7f1955200640 1 -- 172.21.15.110:0/4063036677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19400094d0 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f1955200640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1940009870 tx=0x7f19400046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194003a930 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194003aa90 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19501ee3c0 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194003ae40 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19501497c0 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f194002f050 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.320+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1940044a90 con 0x7f19500c4880 2024-01-20T08:09:51.325 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.321+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1950073fb0 con 0x7f19500c4880 2024-01-20T08:09:51.326 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.323+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f1940035020 con 0x7f19500c4880 2024-01-20T08:09:51.345 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.343+0000 7f63ab216040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-20T08:09:51.404 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.401+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8da735fb-0b76-4a5c-957e-b9a5b40f8ea4", "id": 4} v 0) v1 -- 0x7f195004e970 con 0x7f19500c4880 2024-01-20T08:09:51.412 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.409+0000 7f194d600640 1 -- 172.21.15.110:0/4063036677 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8da735fb-0b76-4a5c-957e-b9a5b40f8ea4", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f194002d040 con 0x7f19500c4880 2024-01-20T08:09:51.413 INFO:teuthology.orchestra.run.smithi110.stdout:4 2024-01-20T08:09:51.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.410+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 msgr2=0x7f19501ed910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.410+0000 7f1956600640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f1940009870 tx=0x7f19400046c0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 shutdown_connections 2024-01-20T08:09:51.414 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1950154950 0x7f19500c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1950151d90 0x7f19500c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 --2- 172.21.15.110:0/4063036677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c4880 0x7f19501ed910 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 >> 172.21.15.110:0/4063036677 conn(0x7f1950071ef0 msgr2=0x7f19500ca2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 shutdown_connections 2024-01-20T08:09:51.415 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.411+0000 7f1956600640 1 -- 172.21.15.110:0/4063036677 wait complete. 2024-01-20T08:09:51.427 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:51.424+0000 7fe6e700d040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-01-20T08:09:51.431 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new d1a24abc-b22b-4a3d-8889-ec81f6a54726 5 2024-01-20T08:09:51.504 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.501+0000 7f63ab216040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-20T08:09:51.593 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:51.589+0000 7fe6e700d040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-01-20T08:09:51.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.616+0000 7f0053e00640 1 Processor -- start 2024-01-20T08:09:51.619 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.616+0000 7f0053e00640 1 -- start start 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 0x7f00540c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0054158b80 con 0x7f0054151d90 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00540c8510 con 0x7f0054154950 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0054152170 con 0x7f00540c4880 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f004be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 0x7f00540c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0054154950 0x7f0054154de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54856/0 (socket says 172.21.15.110:54856) 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.617+0000 7f0053400640 1 -- 172.21.15.110:0/3117230638 learned_addr learned my addr 172.21.15.110:0/3117230638 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.618+0000 7f004be00640 1 -- 172.21.15.110:0/3117230638 >> v1:172.21.15.110:6789/0 conn(0x7f0054154950 legacy=0x7f0054154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.621 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.618+0000 7f004be00640 1 -- 172.21.15.110:0/3117230638 >> v1:172.21.15.100:6789/0 conn(0x7f0054151d90 legacy=0x7f00540c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.618+0000 7f0052000640 1 -- 172.21.15.110:0/3117230638 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1225772867 0 0) 0x7f00540c8510 con 0x7f0054154950 2024-01-20T08:09:51.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.618+0000 7f004be00640 1 -- 172.21.15.110:0/3117230638 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0054157c90 con 0x7f00540c4880 2024-01-20T08:09:51.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.619+0000 7f004be00640 1 --2- 172.21.15.110:0/3117230638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 0x7f00540c4ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097d0 tx=0x7f003c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4bf79101a82703 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.619+0000 7f0052000640 1 -- 172.21.15.110:0/3117230638 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c031800 con 0x7f00540c4880 2024-01-20T08:09:51.622 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.619+0000 7f0052000640 1 -- 172.21.15.110:0/3117230638 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c031960 con 0x7f00540c4880 2024-01-20T08:09:51.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.619+0000 7f0052000640 1 -- 172.21.15.110:0/3117230638 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c031cf0 con 0x7f00540c4880 2024-01-20T08:09:51.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 -- 172.21.15.110:0/3117230638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 msgr2=0x7f00540c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.623 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 --2- 172.21.15.110:0/3117230638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 0x7f00540c4ce0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097d0 tx=0x7f003c02b8a0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 -- 172.21.15.110:0/3117230638 shutdown_connections 2024-01-20T08:09:51.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 --2- 172.21.15.110:0/3117230638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00540c4880 0x7f00540c4ce0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 -- 172.21.15.110:0/3117230638 >> 172.21.15.110:0/3117230638 conn(0x7f0054071ef0 msgr2=0x7f0054072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 -- 172.21.15.110:0/3117230638 shutdown_connections 2024-01-20T08:09:51.624 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.620+0000 7f0053e00640 1 -- 172.21.15.110:0/3117230638 wait complete. 2024-01-20T08:09:51.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.621+0000 7f0053e00640 1 Processor -- start 2024-01-20T08:09:51.625 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 -- start start 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00540c4880 0x7f00540acb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054154950 0x7f00541ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00541e9f30 con 0x7f0054154950 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00540ae770 con 0x7f00540c4880 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.622+0000 7f0053e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00540aea50 con 0x7f0054151d90 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.627 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34524/0 (socket says 172.21.15.110:34524) 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 -- 172.21.15.110:0/3205192004 learned_addr learned my addr 172.21.15.110:0/3205192004 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f0052a00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00540c4880 0x7f00540acb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f0053400640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054154950 0x7f00541ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 -- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00540c4880 msgr2=0x7f00540acb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00540c4880 0x7f00540acb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 -- 172.21.15.110:0/3205192004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054154950 msgr2=0x7f00541ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054154950 0x7f00541ea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 -- 172.21.15.110:0/3205192004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c009400 con 0x7f0054151d90 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.623+0000 7f004be00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097d0 tx=0x7f003c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c03bd80 con 0x7f0054151d90 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0453f0 con 0x7f0054151d90 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0457a0 con 0x7f0054151d90 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00540aed30 con 0x7f0054151d90 2024-01-20T08:09:51.628 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00541542f0 con 0x7f0054151d90 2024-01-20T08:09:51.629 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.624+0000 7f63ab216040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-20T08:09:51.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f003c045900 con 0x7f0054151d90 2024-01-20T08:09:51.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.624+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f003c02e070 con 0x7f0054151d90 2024-01-20T08:09:51.629 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.625+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00541ea070 con 0x7f0054151d90 2024-01-20T08:09:51.630 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.627+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f00541ea070 con 0x7f0054151d90 2024-01-20T08:09:51.679 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.677+0000 7f63ab216040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-20T08:09:51.708 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.705+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d1a24abc-b22b-4a3d-8889-ec81f6a54726", "id": 5} v 0) v1 -- 0x7f00540c86a0 con 0x7f0054151d90 2024-01-20T08:09:51.717 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.714+0000 7f004aa00640 1 -- 172.21.15.110:0/3205192004 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d1a24abc-b22b-4a3d-8889-ec81f6a54726", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f003c035020 con 0x7f0054151d90 2024-01-20T08:09:51.717 INFO:teuthology.orchestra.run.smithi110.stdout:5 2024-01-20T08:09:51.718 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 msgr2=0x7f0054153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f003c0097d0 tx=0x7f003c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 shutdown_connections 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0054154950 0x7f00541ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0054151d90 0x7f0054153db0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 --2- 172.21.15.110:0/3205192004 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00540c4880 0x7f00540acb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 >> 172.21.15.110:0/3205192004 conn(0x7f0054071ef0 msgr2=0x7f00540c7e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 shutdown_connections 2024-01-20T08:09:51.719 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.715+0000 7f0053e00640 1 -- 172.21.15.110:0/3205192004 wait complete. 2024-01-20T08:09:51.727 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:51.724+0000 7fe6e700d040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-01-20T08:09:51.735 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b 6 2024-01-20T08:09:51.784 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:51.780+0000 7fe6e700d040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-01-20T08:09:51.788 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.786+0000 7f63ab216040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-20T08:09:51.896 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:51.895+0000 7f63ab216040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-20T08:09:51.897 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:51.894+0000 7fe6e700d040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-01-20T08:09:51.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.920+0000 7f9e39800640 1 Processor -- start 2024-01-20T08:09:51.923 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.920+0000 7f9e39800640 1 -- start start 2024-01-20T08:09:51.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e39800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e3406b140 0x7f9e34154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e39800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b520 0x7f9e341565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e39800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e340c9100 con 0x7f9e340c7ff0 2024-01-20T08:09:51.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e39800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3406b9d0 con 0x7f9e3406b140 2024-01-20T08:09:51.924 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e39800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340c84f0 con 0x7f9e3406b520 2024-01-20T08:09:51.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e32a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e3406b140 0x7f9e34154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e33400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b520 0x7f9e341565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e2be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f9e340c7ff0 0x7f9e34155eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54870/0 (socket says 172.21.15.110:54870) 2024-01-20T08:09:51.925 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e2be00640 1 -- 172.21.15.110:0/1722633805 learned_addr learned my addr 172.21.15.110:0/1722633805 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.921+0000 7f9e32a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e3406b140 0x7f9e34154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33056/0 (socket says 172.21.15.110:33056) 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.922+0000 7f9e32a00640 1 -- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b520 msgr2=0x7f9e341565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.922+0000 7f9e32a00640 1 --2- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b520 0x7f9e341565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.922+0000 7f9e32a00640 1 -- 172.21.15.110:0/1722633805 >> v1:172.21.15.110:6789/0 conn(0x7f9e340c7ff0 legacy=0x7f9e34155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.922+0000 7f9e32a00640 1 -- 172.21.15.110:0/1722633805 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e340c87d0 con 0x7f9e3406b140 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.922+0000 7f9e32000640 1 -- 172.21.15.110:0/1722633805 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966101890 0 0) 0x7f9e340c9100 con 0x7f9e340c7ff0 2024-01-20T08:09:51.926 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.923+0000 7f9e32a00640 1 --2- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b140 0x7f9e34154810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e240097a0 tx=0x7f9e2402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=711cd439f2f0c309 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e32000640 1 -- 172.21.15.110:0/1722633805 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24031780 con 0x7f9e3406b140 2024-01-20T08:09:51.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e32000640 1 -- 172.21.15.110:0/1722633805 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240318e0 con 0x7f9e3406b140 2024-01-20T08:09:51.927 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e32000640 1 -- 172.21.15.110:0/1722633805 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24031c70 con 0x7f9e3406b140 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e39800640 1 -- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b140 msgr2=0x7f9e34154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e39800640 1 --2- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b140 0x7f9e34154810 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9e240097a0 tx=0x7f9e2402b820 comp rx=0 tx=0).stop 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.924+0000 7f9e39800640 1 -- 172.21.15.110:0/1722633805 shutdown_connections 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.925+0000 7f9e39800640 1 --2- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b520 0x7f9e341565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.925+0000 7f9e39800640 1 --2- 172.21.15.110:0/1722633805 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b140 0x7f9e34154810 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.925+0000 7f9e39800640 1 -- 172.21.15.110:0/1722633805 >> 172.21.15.110:0/1722633805 conn(0x7f9e340abc80 msgr2=0x7f9e340ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.925+0000 7f9e39800640 1 -- 172.21.15.110:0/1722633805 shutdown_connections 2024-01-20T08:09:51.928 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.925+0000 7f9e39800640 1 -- 172.21.15.110:0/1722633805 wait complete. 2024-01-20T08:09:51.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.926+0000 7f9e39800640 1 Processor -- start 2024-01-20T08:09:51.929 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.926+0000 7f9e39800640 1 -- start start 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b520 0x7f9e340c2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 0x7f9e340c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340bf1f0 con 0x7f9e340c7ff0 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340bdfe0 con 0x7f9e3406b520 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e39800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e340c0760 con 0x7f9e3406b140 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.927+0000 7f9e32a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e2be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b520 0x7f9e340c2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.932 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.110:34538/0 (socket says 172.21.15.110:34538) 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 -- 172.21.15.110:0/3688193876 learned_addr learned my addr 172.21.15.110:0/3688193876 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e33400640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 0x7f9e340c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 -- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b520 msgr2=0x7f9e340c2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b520 0x7f9e340c2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 -- 172.21.15.110:0/3688193876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 msgr2=0x7f9e340c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 0x7f9e340c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 -- 172.21.15.110:0/3688193876 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009400 con 0x7f9e3406b140 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e33400640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 0x7f9e340c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.928+0000 7f9e32a00640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034040 tx=0x7f9e240046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24032820 con 0x7f9e3406b140 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e24032980 con 0x7f9e3406b140 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24032d30 con 0x7f9e3406b140 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e340c0a40 con 0x7f9e3406b140 2024-01-20T08:09:51.933 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e34153e80 con 0x7f9e3406b140 2024-01-20T08:09:51.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f9e24005990 con 0x7f9e3406b140 2024-01-20T08:09:51.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.929+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f9e24005c40 con 0x7f9e3406b140 2024-01-20T08:09:51.934 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.930+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e340c2730 con 0x7f9e3406b140 2024-01-20T08:09:51.935 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:51.932+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f9e240066b0 con 0x7f9e3406b140 2024-01-20T08:09:52.013 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.009+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd new", "uuid": "447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b", "id": 6} v 0) v1 -- 0x7f9e3404e970 con 0x7f9e3406b140 2024-01-20T08:09:52.013 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:52.010+0000 7fe6e700d040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-01-20T08:09:52.020 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.017+0000 7f9e2aa00640 1 -- 172.21.15.110:0/3688193876 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9e24006850 con 0x7f9e3406b140 2024-01-20T08:09:52.020 INFO:teuthology.orchestra.run.smithi110.stdout:6 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 msgr2=0x7f9e34153940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9e24034040 tx=0x7f9e240046c0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 shutdown_connections 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e340c7ff0 0x7f9e340c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e3406b520 0x7f9e340c2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 --2- 172.21.15.110:0/3688193876 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e3406b140 0x7f9e34153940 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 >> 172.21.15.110:0/3688193876 conn(0x7f9e340abc80 msgr2=0x7f9e340aae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 shutdown_connections 2024-01-20T08:09:52.022 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.018+0000 7f9e39800640 1 -- 172.21.15.110:0/3688193876 wait complete. 2024-01-20T08:09:52.037 DEBUG:teuthology.orchestra.run.smithi110:> sudo ceph --cluster ceph osd new 48a0b0ee-c9c6-4e78-8012-ae89b737cc41 7 2024-01-20T08:09:52.058 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:52.055+0000 7f63ab216040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-20T08:09:52.106 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:52.104+0000 7f63ab216040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-20T08:09:52.181 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:52.178+0000 7fe6e700d040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-01-20T08:09:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.219+0000 7f96b8c00640 1 Processor -- start 2024-01-20T08:09:52.222 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.219+0000 7f96b8c00640 1 -- start start 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.220+0000 7f96b8c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f96b4151d90 0x7f96b40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.220+0000 7f96b8c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b4158b80 con 0x7f96b40c4880 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.220+0000 7f96b8c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96b4157c90 con 0x7f96b40c4ce0 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.220+0000 7f96b8c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96b40c5150 con 0x7f96b4151d90 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f96b40c4ce0 0x7f96b4155060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.110:54886/0 (socket says 172.21.15.110:54886) 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3e00640 1 -- 172.21.15.110:0/1304391130 learned_addr learned my addr 172.21.15.110:0/1304391130 (peer_addr_for_me v1:172.21.15.110:0/0) 2024-01-20T08:09:52.224 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3400640 1 --2- 172.21.15.110:0/1304391130 >> v2:172.21.15.100:3300/0 conn(0x7f96b4151d90 0x7f96b40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b2000640 1 -- 172.21.15.110:0/1304391130 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014944598 0 0) 0x7f96b4157c90 con 0x7f96b40c4ce0 2024-01-20T08:09:52.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b2000640 1 -- 172.21.15.110:0/1304391130 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9694003520 con 0x7f96b40c4ce0 2024-01-20T08:09:52.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3400640 1 -- 172.21.15.110:0/1304391130 >> v1:172.21.15.110:6789/0 conn(0x7f96b40c4ce0 legacy=0x7f96b4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3400640 1 -- 172.21.15.110:0/1304391130 >> v1:172.21.15.100:6789/0 conn(0x7f96b40c4880 legacy=0x7f96b4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.225 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.221+0000 7f96b3400640 1 -- 172.21.15.110:0/1304391130 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b4157f70 con 0x7f96b4151d90 2024-01-20T08:09:52.226 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.223+0000 7f96b3400640 1 --2- 172.21.15.110:0/1304391130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b4151d90 0x7f96b40c7e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96a40097a0 tx=0x7f96a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3aa41ff4f23e12 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.223+0000 7f96b2000640 1 -- 172.21.15.110:0/1304391130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4031830 con 0x7f96b4151d90 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.223+0000 7f96b2000640 1 -- 172.21.15.110:0/1304391130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96a4031990 con 0x7f96b4151d90 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.223+0000 7f96b2000640 1 -- 172.21.15.110:0/1304391130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96a4031d20 con 0x7f96b4151d90 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 -- 172.21.15.110:0/1304391130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b4151d90 msgr2=0x7f96b40c7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1304391130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b4151d90 0x7f96b40c7e00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f96a40097a0 tx=0x7f96a402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 -- 172.21.15.110:0/1304391130 shutdown_connections 2024-01-20T08:09:52.228 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1304391130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b4151d90 0x7f96b40c7e00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 -- 172.21.15.110:0/1304391130 >> 172.21.15.110:0/1304391130 conn(0x7f96b4071ef0 msgr2=0x7f96b4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 -- 172.21.15.110:0/1304391130 shutdown_connections 2024-01-20T08:09:52.229 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.224+0000 7f96b8c00640 1 -- 172.21.15.110:0/1304391130 wait complete. 2024-01-20T08:09:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.225+0000 7f96b8c00640 1 Processor -- start 2024-01-20T08:09:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.226+0000 7f96b8c00640 1 -- start start 2024-01-20T08:09:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.226+0000 7f96b8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c4880 0x7f96b4153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.226+0000 7f96b8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.232 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b8c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 0x7f96b41eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4152cd0 con 0x7f96b40c4880 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b8c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96b4153270 con 0x7f96b40c4ce0 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b8c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96b41ee040 con 0x7f96b4151d90 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 0x7f96b41eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.110:33074/0 (socket says 172.21.15.110:33074) 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 -- 172.21.15.110:0/1541707806 learned_addr learned my addr 172.21.15.110:0/1541707806 (peer_addr_for_me v2:172.21.15.110:0/0) 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b3400640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c4880 0x7f96b4153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 -- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 msgr2=0x7f96b41eda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 0x7f96b41eda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 -- 172.21.15.110:0/1541707806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c4880 msgr2=0x7f96b4153e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c4880 0x7f96b4153e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b2a00640 1 -- 172.21.15.110:0/1541707806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96a4009400 con 0x7f96b40c4ce0 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.227+0000 7f96b3e00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 0x7f96b41eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:52.233 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96b2a00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f969c00c3c0 tx=0x7f969c00c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c0052d0 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f969c005450 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f969c007260 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b4152f90 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b40c3670 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f969c0067d0 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.228+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f969c003c80 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.229+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96b404e970 con 0x7f96b40c4ce0 2024-01-20T08:09:52.234 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:52.230+0000 7fe6e700d040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-01-20T08:09:52.235 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.231+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f969c020060 con 0x7f96b40c4ce0 2024-01-20T08:09:52.264 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:52.261+0000 7f63ab216040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-20T08:09:52.312 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.308+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd new", "uuid": "48a0b0ee-c9c6-4e78-8012-ae89b737cc41", "id": 7} v 0) v1 -- 0x7f96b406c9d0 con 0x7f96b40c4ce0 2024-01-20T08:09:52.321 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.317+0000 7f96ab400640 1 -- 172.21.15.110:0/1541707806 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48a0b0ee-c9c6-4e78-8012-ae89b737cc41", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f969c0035f0 con 0x7f96b40c4ce0 2024-01-20T08:09:52.321 INFO:teuthology.orchestra.run.smithi110.stdout:7 2024-01-20T08:09:52.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.318+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 msgr2=0x7f96b41ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.318+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f969c00c3c0 tx=0x7f969c00c880 comp rx=0 tx=0).stop 2024-01-20T08:09:52.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 shutdown_connections 2024-01-20T08:09:52.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96b4151d90 0x7f96b41eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.322 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f96b40c4ce0 0x7f96b41ed4c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 --2- 172.21.15.110:0/1541707806 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96b40c4880 0x7f96b4153e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 >> 172.21.15.110:0/1541707806 conn(0x7f96b4071ef0 msgr2=0x7f96b414f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:52.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 shutdown_connections 2024-01-20T08:09:52.323 INFO:teuthology.orchestra.run.smithi110.stderr:2024-01-20T08:09:52.319+0000 7f96b8c00640 1 -- 172.21.15.110:0/1541707806 wait complete. 2024-01-20T08:09:52.338 INFO:tasks.ceph.osd.0:Restarting daemon 2024-01-20T08:09:52.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-01-20T08:09:52.346 INFO:tasks.ceph.osd.0:Started 2024-01-20T08:09:52.346 INFO:tasks.ceph.osd.1:Restarting daemon 2024-01-20T08:09:52.346 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-01-20T08:09:52.353 INFO:tasks.ceph.osd.1:Started 2024-01-20T08:09:52.354 INFO:tasks.ceph.osd.2:Restarting daemon 2024-01-20T08:09:52.354 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-01-20T08:09:52.359 INFO:tasks.ceph.osd.2:Started 2024-01-20T08:09:52.359 INFO:tasks.ceph.osd.3:Restarting daemon 2024-01-20T08:09:52.359 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-01-20T08:09:52.364 INFO:tasks.ceph.osd.3:Started 2024-01-20T08:09:52.364 INFO:tasks.ceph.osd.4:Restarting daemon 2024-01-20T08:09:52.364 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-01-20T08:09:52.369 INFO:tasks.ceph.osd.4:Started 2024-01-20T08:09:52.369 INFO:tasks.ceph.osd.5:Restarting daemon 2024-01-20T08:09:52.369 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-01-20T08:09:52.373 INFO:tasks.ceph.osd.5:Started 2024-01-20T08:09:52.373 INFO:tasks.ceph.osd.6:Restarting daemon 2024-01-20T08:09:52.374 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-01-20T08:09:52.379 INFO:tasks.ceph.osd.6:Started 2024-01-20T08:09:52.379 INFO:tasks.ceph.osd.7:Restarting daemon 2024-01-20T08:09:52.379 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-01-20T08:09:52.384 INFO:tasks.ceph.osd.7:Started 2024-01-20T08:09:52.384 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:09:52.403 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:52.400+0000 7fe6e700d040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-01-20T08:09:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.587+0000 7f5937e00640 1 Processor -- start 2024-01-20T08:09:52.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.587+0000 7f5937e00640 1 -- start start 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 0x7f59380720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 0x7f5938154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5938158560 con 0x7f5938071d10 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59380c5640 con 0x7f59380c7e30 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59380c50a0 con 0x7f59380bd5c0 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5936a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5938071d10 0x7f5938154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55626/0 (socket says 172.21.15.100:55626) 2024-01-20T08:09:52.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5936a00640 1 -- 172.21.15.100:0/1581676099 learned_addr learned my addr 172.21.15.100:0/1581676099 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:09:52.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5936000640 1 --2- 172.21.15.100:0/1581676099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 0x7f59380720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.588+0000 7f5937400640 1 --2- 172.21.15.100:0/1581676099 >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 0x7f5938154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5935600640 1 -- 172.21.15.100:0/1581676099 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3045057261 0 0) 0x7f5938158560 con 0x7f5938071d10 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5935600640 1 -- 172.21.15.100:0/1581676099 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5918003520 con 0x7f5938071d10 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5936000640 1 -- 172.21.15.100:0/1581676099 >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 msgr2=0x7f5938154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5936000640 1 --2- 172.21.15.100:0/1581676099 >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 0x7f5938154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5936000640 1 -- 172.21.15.100:0/1581676099 >> v1:172.21.15.100:6789/0 conn(0x7f5938071d10 legacy=0x7f5938154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5936000640 1 -- 172.21.15.100:0/1581676099 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593806cb90 con 0x7f59380bd5c0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.589+0000 7f5937400640 1 --2- 172.21.15.100:0/1581676099 >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 0x7f5938154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.590+0000 7f5936000640 1 --2- 172.21.15.100:0/1581676099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 0x7f59380720f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3ec2a5ddbf62583 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.590+0000 7f5935600640 1 -- 172.21.15.100:0/1581676099 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59200316f0 con 0x7f59380bd5c0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.590+0000 7f5935600640 1 -- 172.21.15.100:0/1581676099 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5920031850 con 0x7f59380bd5c0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.590+0000 7f5935600640 1 -- 172.21.15.100:0/1581676099 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920031be0 con 0x7f59380bd5c0 2024-01-20T08:09:52.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 -- 172.21.15.100:0/1581676099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 msgr2=0x7f59380720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 --2- 172.21.15.100:0/1581676099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 0x7f59380720f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59200097a0 tx=0x7f592002b790 comp rx=0 tx=0).stop 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 -- 172.21.15.100:0/1581676099 shutdown_connections 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 --2- 172.21.15.100:0/1581676099 >> v2:172.21.15.110:3300/0 conn(0x7f59380c7e30 0x7f5938154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 --2- 172.21.15.100:0/1581676099 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59380bd5c0 0x7f59380720f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 -- 172.21.15.100:0/1581676099 >> 172.21.15.100:0/1581676099 conn(0x7f59380c9f30 msgr2=0x7f59380ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 -- 172.21.15.100:0/1581676099 shutdown_connections 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.591+0000 7f5937e00640 1 -- 172.21.15.100:0/1581676099 wait complete. 2024-01-20T08:09:52.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.592+0000 7f5937e00640 1 Processor -- start 2024-01-20T08:09:52.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 -- start start 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5938071d10 0x7f5938148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 0x7f59381e9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5938154110 con 0x7f59380bd5c0 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59381543f0 con 0x7f59380c7e30 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.593+0000 7f5937e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59381eaa60 con 0x7f5938071d10 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42036/0 (socket says 172.21.15.100:42036) 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 -- 172.21.15.100:0/1893796311 learned_addr learned my addr 172.21.15.100:0/1893796311 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:09:52.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5937400640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 0x7f59381e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936a00640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5938071d10 0x7f5938148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 -- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5938071d10 msgr2=0x7f5938148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5938071d10 0x7f5938148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 -- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 msgr2=0x7f59381e9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 0x7f59381e9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5936000640 1 -- 172.21.15.100:0/1893796311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5930009a70 con 0x7f59380bd5c0 2024-01-20T08:09:52.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.594+0000 7f5937400640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 0x7f59381e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f5936000640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f59200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920034680 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59200347e0 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5920034b90 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5920009400 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.595+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5938148ec0 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.596+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f592003b040 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.596+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f5920049cc0 con 0x7f59380bd5c0 2024-01-20T08:09:52.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.596+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59381eaf80 con 0x7f59380bd5c0 2024-01-20T08:09:52.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.599+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f592004e060 con 0x7f59380bd5c0 2024-01-20T08:09:52.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.660+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59380749e0 con 0x7f59380bd5c0 2024-01-20T08:09:52.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.661+0000 7f592ea00640 1 -- 172.21.15.100:0/1893796311 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f5920044070 con 0x7f59380bd5c0 2024-01-20T08:09:52.664 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:09:52.664 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":10,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:09:52.311489+0000","last_up_change":"0.000000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:09:52.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 msgr2=0x7f593814a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:52.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5920000c00 tx=0x7f59200046c0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 shutdown_connections 2024-01-20T08:09:52.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59380c7e30 0x7f59381e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59380bd5c0 0x7f593814a4e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 --2- 172.21.15.100:0/1893796311 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5938071d10 0x7f5938148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:52.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.662+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 >> 172.21.15.100:0/1893796311 conn(0x7f59380c9f30 msgr2=0x7f59380ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:52.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.663+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 shutdown_connections 2024-01-20T08:09:52.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:09:52.663+0000 7f5937e00640 1 -- 172.21.15.100:0/1893796311 wait complete. 2024-01-20T08:09:52.682 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-01-20T08:09:52.682 INFO:tasks.ceph:Waiting for OSDs to come up 2024-01-20T08:09:53.052 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-20T08:09:53.049+0000 7f23fd624640 -1 Falling back to public interface 2024-01-20T08:09:53.059 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-20T08:09:53.056+0000 7f7897401640 -1 Falling back to public interface 2024-01-20T08:09:53.071 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-20T08:09:53.068+0000 7ff97c424640 -1 Falling back to public interface 2024-01-20T08:09:53.079 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-20T08:09:53.076+0000 7f8eea30d640 -1 Falling back to public interface 2024-01-20T08:09:53.079 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-20T08:09:53.077+0000 7f4b0a817640 -1 Falling back to public interface 2024-01-20T08:09:53.080 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-20T08:09:53.078+0000 7f8ee8e00640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6810/0: (98) Address already in use 2024-01-20T08:09:53.083 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-20T08:09:53.080+0000 7f569dc0f640 -1 Falling back to public interface 2024-01-20T08:09:53.083 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-20T08:09:53.081+0000 7f77f040d640 -1 Falling back to public interface 2024-01-20T08:09:53.100 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-20T08:09:53.097+0000 7f0c752a8640 -1 Falling back to public interface 2024-01-20T08:09:53.373 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:53.370+0000 7f63ab216040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-20T08:09:53.429 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:53.425+0000 7fe6e700d040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-01-20T08:09:53.487 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-20T08:09:53.667 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.664+0000 7f3837200640 1 Processor -- start 2024-01-20T08:09:53.667 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.664+0000 7f3837200640 1 -- start start 2024-01-20T08:09:53.668 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3837200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f383014fb60 0x7f38300c27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3837200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3830156a30 con 0x7f3830155ed0 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3837200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383006df90 con 0x7f38300a70f0 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3837200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383006dd80 con 0x7f383014fb60 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3836800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3830155ed0 0x7f3830156320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55638/0 (socket says 172.21.15.100:55638) 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3836800640 1 -- 172.21.15.100:0/1827978049 learned_addr learned my addr 172.21.15.100:0/1827978049 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:09:53.669 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3835e00640 1 --2- 172.21.15.100:0/1827978049 >> v2:172.21.15.110:3300/0 conn(0x7f383014fb60 0x7f38300c27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:53.670 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.666+0000 7f3834a00640 1 -- 172.21.15.100:0/1827978049 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3449362401 0 0) 0x7f3830156a30 con 0x7f3830155ed0 2024-01-20T08:09:53.670 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.667+0000 7f3835e00640 1 -- 172.21.15.100:0/1827978049 >> v1:172.21.15.110:6789/0 conn(0x7f38300a70f0 legacy=0x7f38300ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.670 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.667+0000 7f3835e00640 1 -- 172.21.15.100:0/1827978049 >> v1:172.21.15.100:6789/0 conn(0x7f3830155ed0 legacy=0x7f3830156320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.670 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.667+0000 7f3835e00640 1 -- 172.21.15.100:0/1827978049 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38300c75c0 con 0x7f383014fb60 2024-01-20T08:09:53.670 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.668+0000 7f3835e00640 1 --2- 172.21.15.100:0/1827978049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383014fb60 0x7f38300c27a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3820009d90 tx=0x7f382002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93a603ed2201cc80 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:53.671 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.668+0000 7f3834a00640 1 -- 172.21.15.100:0/1827978049 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382002cbd0 con 0x7f383014fb60 2024-01-20T08:09:53.671 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.668+0000 7f3834a00640 1 -- 172.21.15.100:0/1827978049 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f382002cd30 con 0x7f383014fb60 2024-01-20T08:09:53.671 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.668+0000 7f3834a00640 1 -- 172.21.15.100:0/1827978049 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382002cea0 con 0x7f383014fb60 2024-01-20T08:09:53.671 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 -- 172.21.15.100:0/1827978049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383014fb60 msgr2=0x7f38300c27a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 --2- 172.21.15.100:0/1827978049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383014fb60 0x7f38300c27a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3820009d90 tx=0x7f382002be20 comp rx=0 tx=0).stop 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 -- 172.21.15.100:0/1827978049 shutdown_connections 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 --2- 172.21.15.100:0/1827978049 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383014fb60 0x7f38300c27a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 -- 172.21.15.100:0/1827978049 >> 172.21.15.100:0/1827978049 conn(0x7f38300c7da0 msgr2=0x7f38300c8180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 -- 172.21.15.100:0/1827978049 shutdown_connections 2024-01-20T08:09:53.672 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.669+0000 7f3837200640 1 -- 172.21.15.100:0/1827978049 wait complete. 2024-01-20T08:09:53.673 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.670+0000 7f3837200640 1 Processor -- start 2024-01-20T08:09:53.673 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 -- start start 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383014fb60 0x7f38301e8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 0x7f38301e9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38300ad6c0 con 0x7f38300a70f0 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38301e9e40 con 0x7f3830155ed0 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.671+0000 7f3837200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383014cd90 con 0x7f383014fb60 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:53.675 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42050/0 (socket says 172.21.15.100:42050) 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 -- 172.21.15.100:0/4036507630 learned_addr learned my addr 172.21.15.100:0/4036507630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3836800640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 0x7f38301e9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835400640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383014fb60 0x7f38301e8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 -- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383014fb60 msgr2=0x7f38301e8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383014fb60 0x7f38301e8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 -- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 msgr2=0x7f38301e9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 0x7f38301e9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 -- 172.21.15.100:0/4036507630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3820009a70 con 0x7f38300a70f0 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3836800640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 0x7f38301e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:09:53.676 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.672+0000 7f3835e00640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3820037040 tx=0x7f3820004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:09:53.677 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f382002cea0 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3820003bb0 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3820004030 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38301e9b60 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38300c4270 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 1) v1 ==== 799+0+0 (secure 0 0 0) 0x7f3820004190 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.673+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f3820049bd0 con 0x7f38300a70f0 2024-01-20T08:09:53.678 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.674+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38301e99c0 con 0x7f38300a70f0 2024-01-20T08:09:53.679 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.676+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72921 (secure 0 0 0) 0x7f38301e99c0 con 0x7f38300a70f0 2024-01-20T08:09:53.684 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:53.681+0000 7f63ab216040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-20T08:09:53.734 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:53.731+0000 7fe6e700d040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-01-20T08:09:53.744 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:53.741+0000 7f63ab216040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-20T08:09:53.745 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.742+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3830074a50 con 0x7f38300a70f0 2024-01-20T08:09:53.746 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.743+0000 7f382e000640 1 -- 172.21.15.100:0/4036507630 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7058 (secure 0 0 0) 0x7f3820044070 con 0x7f38300a70f0 2024-01-20T08:09:53.746 INFO:teuthology.misc.health.smithi100.stdout: 2024-01-20T08:09:53.746 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":10,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:09:52.311489+0000","last_up_change":"0.000000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:09:53.747 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 msgr2=0x7f38300c3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3820037040 tx=0x7f3820004a40 comp rx=0 tx=0).stop 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 shutdown_connections 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3830155ed0 0x7f38301e9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383014fb60 0x7f38301e8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 --2- 172.21.15.100:0/4036507630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38300a70f0 0x7f38300c3d30 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 >> 172.21.15.100:0/4036507630 conn(0x7f38300c7da0 msgr2=0x7f38300c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 shutdown_connections 2024-01-20T08:09:53.748 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:09:53.745+0000 7f3837200640 1 -- 172.21.15.100:0/4036507630 wait complete. 2024-01-20T08:09:53.760 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-01-20T08:09:53.793 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:53.789+0000 7fe6e700d040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-01-20T08:09:53.857 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:53.854+0000 7f63ab216040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-20T08:09:53.908 INFO:tasks.ceph.mgr.x.smithi110.stderr:2024-01-20T08:09:53.905+0000 7fe6e700d040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-01-20T08:09:54.913 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:54.909+0000 7f634be00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-01-20T08:09:54.913 INFO:tasks.ceph.mgr.y.smithi100.stderr:2024-01-20T08:09:54.910+0000 7f634be00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-01-20T08:09:56.583 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-20T08:09:56.579+0000 7f23fd624640 -1 osd.6 0 log_to_monitors true 2024-01-20T08:09:56.623 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-20T08:09:56.618+0000 7f7897401640 -1 osd.5 0 log_to_monitors true 2024-01-20T08:09:56.642 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-20T08:09:56.639+0000 7f569dc0f640 -1 osd.7 0 log_to_monitors true 2024-01-20T08:09:56.647 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-20T08:09:56.644+0000 7f0c752a8640 -1 osd.4 0 log_to_monitors true 2024-01-20T08:09:56.676 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-20T08:09:56.673+0000 7f8eea30d640 -1 osd.3 0 log_to_monitors true 2024-01-20T08:09:56.676 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-20T08:09:56.674+0000 7f4b0a817640 -1 osd.2 0 log_to_monitors true 2024-01-20T08:09:56.677 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-20T08:09:56.674+0000 7f77f040d640 -1 osd.0 0 log_to_monitors true 2024-01-20T08:09:56.848 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-20T08:09:56.845+0000 7ff97c424640 -1 osd.1 0 log_to_monitors true 2024-01-20T08:09:59.635 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-20T08:09:59.632+0000 7f5697a00640 -1 osd.7 0 waiting for initial osdmap 2024-01-20T08:09:59.641 INFO:tasks.ceph.osd.7.smithi110.stderr:2024-01-20T08:09:59.638+0000 7f568e400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:09:59.644 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-20T08:09:59.642+0000 7f7891800640 -1 osd.5 0 waiting for initial osdmap 2024-01-20T08:09:59.654 INFO:tasks.ceph.osd.5.smithi110.stderr:2024-01-20T08:09:59.651+0000 7f7888200640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:09:59.660 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-20T08:09:59.657+0000 7f0c6f800640 -1 osd.4 0 waiting for initial osdmap 2024-01-20T08:09:59.667 INFO:tasks.ceph.osd.4.smithi110.stderr:2024-01-20T08:09:59.664+0000 7f0c66200640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:09:59.782 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-20T08:09:59.780+0000 7f23f7600640 -1 osd.6 0 waiting for initial osdmap 2024-01-20T08:09:59.789 INFO:tasks.ceph.osd.6.smithi110.stderr:2024-01-20T08:09:59.787+0000 7f23ee000640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:10:00.545 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-20T08:10:00.542+0000 7f4b04800640 -1 osd.2 0 waiting for initial osdmap 2024-01-20T08:10:00.557 INFO:tasks.ceph.osd.2.smithi100.stderr:2024-01-20T08:10:00.554+0000 7f4afb200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:10:00.567 DEBUG:teuthology.orchestra.run.smithi100:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:00.567 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-20T08:10:00.564+0000 7f8ee4800640 -1 osd.3 0 waiting for initial osdmap 2024-01-20T08:10:00.575 INFO:tasks.ceph.osd.3.smithi100.stderr:2024-01-20T08:10:00.572+0000 7f8edb200640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:10:00.580 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-20T08:10:00.578+0000 7f77ea200640 -1 osd.0 0 waiting for initial osdmap 2024-01-20T08:10:00.589 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-20T08:10:00.587+0000 7ff978600640 -1 osd.1 0 waiting for initial osdmap 2024-01-20T08:10:00.592 INFO:tasks.ceph.osd.0.smithi100.stderr:2024-01-20T08:10:00.589+0000 7f77e0c00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:10:00.595 INFO:tasks.ceph.osd.1.smithi100.stderr:2024-01-20T08:10:00.592+0000 7ff96d200640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-01-20T08:10:00.722 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.719+0000 7f151cc00640 1 Processor -- start 2024-01-20T08:10:00.722 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.719+0000 7f151cc00640 1 -- start start 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.720+0000 7f151cc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15180c7720 0x7f1518153040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.720+0000 7f151cc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f15180c4ee0 0x7f15180c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.720+0000 7f151cc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15180aba20 con 0x7f15180ac330 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.720+0000 7f151cc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15180c47c0 con 0x7f15180c7720 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.720+0000 7f151cc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15181560a0 con 0x7f15180c4ee0 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15180c7720 0x7f1518153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f15180ac330 0x7f1518156530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49114/0 (socket says 172.21.15.100:49114) 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515400640 1 -- 172.21.15.100:0/3692100991 learned_addr learned my addr 172.21.15.100:0/3692100991 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:00.724 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1516800640 1 --2- 172.21.15.100:0/3692100991 >> v2:172.21.15.110:3300/0 conn(0x7f15180c4ee0 0x7f15180c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1514a00640 1 -- 172.21.15.100:0/3692100991 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1522559287 0 0) 0x7f1500001110 con 0x7f15180ac330 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1514a00640 1 -- 172.21.15.100:0/3692100991 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14f8003520 con 0x7f15180ac330 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515e00640 1 -- 172.21.15.100:0/3692100991 >> v2:172.21.15.110:3300/0 conn(0x7f15180c4ee0 msgr2=0x7f15180c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515e00640 1 --2- 172.21.15.100:0/3692100991 >> v2:172.21.15.110:3300/0 conn(0x7f15180c4ee0 0x7f15180c52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515e00640 1 -- 172.21.15.100:0/3692100991 >> v1:172.21.15.100:6789/0 conn(0x7f15180ac330 legacy=0x7f1518156530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.725 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.721+0000 7f1515e00640 1 -- 172.21.15.100:0/3692100991 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518153580 con 0x7f15180c7720 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.722+0000 7f1515e00640 1 --2- 172.21.15.100:0/3692100991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f1518153040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15180ab770 tx=0x7f150802b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a9d6258db0e263 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.722+0000 7f1514a00640 1 -- 172.21.15.100:0/3692100991 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508031710 con 0x7f15180c7720 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.722+0000 7f1514a00640 1 -- 172.21.15.100:0/3692100991 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f150802f050 con 0x7f15180c7720 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.722+0000 7f1514a00640 1 -- 172.21.15.100:0/3692100991 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508031a90 con 0x7f15180c7720 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 -- 172.21.15.100:0/3692100991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 msgr2=0x7f1518153040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 --2- 172.21.15.100:0/3692100991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f1518153040 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f15180ab770 tx=0x7f150802b7b0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.726 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 -- 172.21.15.100:0/3692100991 shutdown_connections 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 --2- 172.21.15.100:0/3692100991 >> v2:172.21.15.110:3300/0 conn(0x7f15180c4ee0 0x7f15180c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 --2- 172.21.15.100:0/3692100991 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f1518153040 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 -- 172.21.15.100:0/3692100991 >> 172.21.15.100:0/3692100991 conn(0x7f151806aa10 msgr2=0x7f151806ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 -- 172.21.15.100:0/3692100991 shutdown_connections 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.723+0000 7f151cc00640 1 -- 172.21.15.100:0/3692100991 wait complete. 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.725+0000 7f151cc00640 1 Processor -- start 2024-01-20T08:10:00.727 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.725+0000 7f151cc00640 1 -- start start 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 0x7f1518070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15180c4ee0 0x7f15181ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15181dee10 con 0x7f15180c7720 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15181ee3c0 con 0x7f15180ac330 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f151cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15181ee0e0 con 0x7f15180c4ee0 2024-01-20T08:10:00.730 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47628/0 (socket says 172.21.15.100:47628) 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 -- 172.21.15.100:0/1497926665 learned_addr learned my addr 172.21.15.100:0/1497926665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1515e00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 0x7f1518070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1515400640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15180c4ee0 0x7f15181ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 -- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15180c4ee0 msgr2=0x7f15181ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15180c4ee0 0x7f15181ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.726+0000 7f1516800640 1 -- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 msgr2=0x7f1518070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f1516800640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 0x7f1518070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f1516800640 1 -- 172.21.15.100:0/1497926665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1508009400 con 0x7f15180c7720 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f1515e00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 0x7f1518070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f1516800640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f151000cd70 tx=0x7f151000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510003b90 con 0x7f15180c7720 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1510003cf0 con 0x7f15180c7720 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510004240 con 0x7f15180c7720 2024-01-20T08:10:00.731 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15181dbd50 con 0x7f15180c7720 2024-01-20T08:10:00.732 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.727+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15181edc30 con 0x7f15180c7720 2024-01-20T08:10:00.732 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.728+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15181edeb0 con 0x7f15180c7720 2024-01-20T08:10:00.732 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.729+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f15100043a0 con 0x7f15180c7720 2024-01-20T08:10:00.733 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.730+0000 7f150e000640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 0x7f14f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:00.733 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.730+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f1510012070 con 0x7f15180c7720 2024-01-20T08:10:00.733 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.730+0000 7f1515e00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 0x7f14f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:00.733 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.731+0000 7f1515e00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 0x7f14f006d300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1508035000 tx=0x7f1508008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:00.737 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.735+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1510054ed0 con 0x7f15180c7720 2024-01-20T08:10:00.917 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.914+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15181dcb60 con 0x7f15180c7720 2024-01-20T08:10:00.919 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.916+0000 7f150e000640 1 -- 172.21.15.100:0/1497926665 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10885 (secure 0 0 0) 0x7f15181dcb60 con 0x7f15180c7720 2024-01-20T08:10:00.919 INFO:teuthology.misc.health.smithi100.stdout: 2024-01-20T08:10:00.919 INFO:teuthology.misc.health.smithi100.stdout:{"epoch":13,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:00.643994+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 msgr2=0x7f14f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 0x7f14f006d300 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1508035000 tx=0x7f1508008030 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 msgr2=0x7f15181dce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f151000cd70 tx=0x7f151000a660 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 shutdown_connections 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15180c7720 0x7f15181dce40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f14f006ae40 0x7f14f006d300 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15180c4ee0 0x7f15181ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.918+0000 7f151cc00640 1 --2- 172.21.15.100:0/1497926665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15180ac330 0x7f1518070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.919+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 >> 172.21.15.100:0/1497926665 conn(0x7f151806aa10 msgr2=0x7f15180c1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.919+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 shutdown_connections 2024-01-20T08:10:00.922 INFO:teuthology.misc.health.smithi100.stderr:2024-01-20T08:10:00.919+0000 7f151cc00640 1 -- 172.21.15.100:0/1497926665 wait complete. 2024-01-20T08:10:00.934 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-01-20T08:10:00.934 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-01-20T08:10:00.935 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T08:10:00.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T08:10:00.984 INFO:tasks.ceph.mds.a:Started 2024-01-20T08:10:00.984 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T08:10:00.984 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T08:10:00.992 INFO:tasks.ceph.mds.c:Started 2024-01-20T08:10:00.992 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T08:10:00.992 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T08:10:01.000 INFO:tasks.ceph.mds.b:Started 2024-01-20T08:10:01.000 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T08:10:01.000 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T08:10:01.008 INFO:tasks.ceph.mds.d:Started 2024-01-20T08:10:01.008 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-01-20T08:10:01.010 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:01.140 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-20T08:10:01.147 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:10:01.159 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:10:01.180 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-20T08:10:01.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.186+0000 7f6b71800640 1 Processor -- start 2024-01-20T08:10:01.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.187+0000 7f6b71800640 1 -- start start 2024-01-20T08:10:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b71800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6b6c0c7fb0 0x7f6b6c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b71800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6b6c06b660 0x7f6b6c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b71800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b6c0c5310 con 0x7f6b6c151f40 2024-01-20T08:10:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b71800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c06bf90 con 0x7f6b6c0c7fb0 2024-01-20T08:10:01.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b71800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b6c0c4ff0 con 0x7f6b6c06b660 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6b6c151f40 0x7f6b6c1551d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49120/0 (socket says 172.21.15.100:49120) 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6aa00640 1 -- 172.21.15.100:0/4169198509 learned_addr learned my addr 172.21.15.100:0/4169198509 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6b400640 1 --2- 172.21.15.100:0/4169198509 >> v2:172.21.15.110:3300/0 conn(0x7f6b6c06b660 0x7f6b6c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b61e00640 1 --2- 172.21.15.100:0/4169198509 >> v2:172.21.15.100:3300/0 conn(0x7f6b6c0c7fb0 0x7f6b6c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6a000640 1 -- 172.21.15.100:0/4169198509 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2237250190 0 0) 0x7f6b6c0c5310 con 0x7f6b6c151f40 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6a000640 1 -- 172.21.15.100:0/4169198509 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b4c003520 con 0x7f6b6c151f40 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6b400640 1 -- 172.21.15.100:0/4169198509 >> v2:172.21.15.100:3300/0 conn(0x7f6b6c0c7fb0 msgr2=0x7f6b6c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6b400640 1 --2- 172.21.15.100:0/4169198509 >> v2:172.21.15.100:3300/0 conn(0x7f6b6c0c7fb0 0x7f6b6c06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6b400640 1 -- 172.21.15.100:0/4169198509 >> v1:172.21.15.100:6789/0 conn(0x7f6b6c151f40 legacy=0x7f6b6c1551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.188+0000 7f6b6b400640 1 -- 172.21.15.100:0/4169198509 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0c55d0 con 0x7f6b6c06b660 2024-01-20T08:10:01.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.189+0000 7f6b6b400640 1 --2- 172.21.15.100:0/4169198509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c0c60b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c074570 tx=0x7f6b6402bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80eb225a168e4bcc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b6a000640 1 -- 172.21.15.100:0/4169198509 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6402cd00 con 0x7f6b6c06b660 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b6a000640 1 -- 172.21.15.100:0/4169198509 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6402ce60 con 0x7f6b6c06b660 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b6a000640 1 -- 172.21.15.100:0/4169198509 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64034640 con 0x7f6b6c06b660 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 -- 172.21.15.100:0/4169198509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 msgr2=0x7f6b6c0c60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 --2- 172.21.15.100:0/4169198509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c0c60b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c074570 tx=0x7f6b6402bf50 comp rx=0 tx=0).stop 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 -- 172.21.15.100:0/4169198509 shutdown_connections 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 --2- 172.21.15.100:0/4169198509 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c0c60b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 --2- 172.21.15.100:0/4169198509 >> v2:172.21.15.100:3300/0 conn(0x7f6b6c0c7fb0 0x7f6b6c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 -- 172.21.15.100:0/4169198509 >> 172.21.15.100:0/4169198509 conn(0x7f6b6c0ca0b0 msgr2=0x7f6b6c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.190+0000 7f6b71800640 1 -- 172.21.15.100:0/4169198509 shutdown_connections 2024-01-20T08:10:01.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.191+0000 7f6b71800640 1 -- 172.21.15.100:0/4169198509 wait complete. 2024-01-20T08:10:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.192+0000 7f6b71800640 1 Processor -- start 2024-01-20T08:10:01.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.192+0000 7f6b71800640 1 -- start start 2024-01-20T08:10:01.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c1ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 0x7f6b6c0c33e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0c08e0 con 0x7f6b6c151f40 2024-01-20T08:10:01.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c1ea520 con 0x7f6b6c06b660 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b71800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0c0b30 con 0x7f6b6c0c7fb0 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b6b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b6b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47696/0 (socket says 172.21.15.100:47696) 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.193+0000 7f6b6b400640 1 -- 172.21.15.100:0/856330341 learned_addr learned my addr 172.21.15.100:0/856330341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b61e00640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 0x7f6b6c0c33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6aa00640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c1ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 -- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 msgr2=0x7f6b6c0c33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 0x7f6b6c0c33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 -- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 msgr2=0x7f6b6c1ea9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c1ea9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 -- 172.21.15.100:0/856330341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b64009a70 con 0x7f6b6c151f40 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b61e00640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 0x7f6b6c0c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b6b400640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009e80 tx=0x7f6b64004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64009450 con 0x7f6b6c151f40 2024-01-20T08:10:01.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b64003e10 con 0x7f6b6c151f40 2024-01-20T08:10:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c1e9ed0 con 0x7f6b6c151f40 2024-01-20T08:10:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64040450 con 0x7f6b6c151f40 2024-01-20T08:10:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.194+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c0c0e10 con 0x7f6b6c151f40 2024-01-20T08:10:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.195+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c0c0fd0 con 0x7f6b6c151f40 2024-01-20T08:10:01.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.196+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f6b640405b0 con 0x7f6b6c151f40 2024-01-20T08:10:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.197+0000 7f6b63400640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 0x7f6b4406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.198+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6b640aba30 con 0x7f6b6c151f40 2024-01-20T08:10:01.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.198+0000 7f6b6aa00640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 0x7f6b4406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.198+0000 7f6b6aa00640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 0x7f6b4406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c007fd0 tx=0x7f6b5c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.202+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6b64076ed0 con 0x7f6b6c151f40 2024-01-20T08:10:01.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.378+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b6c1ea6b0 con 0x7f6b6c151f40 2024-01-20T08:10:01.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.380+0000 7f6b63400640 1 -- 172.21.15.100:0/856330341 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10885 (secure 0 0 0) 0x7f6b64047360 con 0x7f6b6c151f40 2024-01-20T08:10:01.384 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:01.384 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":13,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:00.643994+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.382+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 msgr2=0x7f6b4406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.382+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 0x7f6b4406d300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c007fd0 tx=0x7f6b5c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:01.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.382+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 msgr2=0x7f6b6c153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.382+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6b64009e80 tx=0x7f6b64004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 shutdown_connections 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b6c151f40 0x7f6b6c153610 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b4406ae40 0x7f6b4406d300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6b6c0c7fb0 0x7f6b6c0c33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 --2- 172.21.15.100:0/856330341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6b6c06b660 0x7f6b6c1ea9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 >> 172.21.15.100:0/856330341 conn(0x7f6b6c0ca0b0 msgr2=0x7f6b6c1511b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:01.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 shutdown_connections 2024-01-20T08:10:01.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.383+0000 7f6b71800640 1 -- 172.21.15.100:0/856330341 wait complete. 2024-01-20T08:10:01.402 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-01-20T08:10:01.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.593+0000 7efe2c800640 1 Processor -- start 2024-01-20T08:10:01.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.593+0000 7efe2c800640 1 -- start start 2024-01-20T08:10:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.594+0000 7efe2c800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efe24151f60 0x7efe240abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.594+0000 7efe2c800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe240c1670 con 0x7efe24070370 2024-01-20T08:10:01.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.594+0000 7efe2c800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe24070800 con 0x7efe24147f20 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe2c800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe240c2210 con 0x7efe24151f60 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe29400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efe24151f60 0x7efe240abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe2a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efe24070370 0x7efe240c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49134/0 (socket says 172.21.15.100:49134) 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe2a800640 1 -- 172.21.15.100:0/1869074013 learned_addr learned my addr 172.21.15.100:0/1869074013 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe29400640 1 -- 172.21.15.100:0/1869074013 >> v1:172.21.15.110:6789/0 conn(0x7efe24147f20 legacy=0x7efe240c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe29400640 1 -- 172.21.15.100:0/1869074013 >> v1:172.21.15.100:6789/0 conn(0x7efe24070370 legacy=0x7efe240c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe29400640 1 -- 172.21.15.100:0/1869074013 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240c0d40 con 0x7efe24151f60 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.595+0000 7efe28a00640 1 -- 172.21.15.100:0/1869074013 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 506032305 0 0) 0x7efe240c1670 con 0x7efe24070370 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.596+0000 7efe29400640 1 --2- 172.21.15.100:0/1869074013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24151f60 0x7efe240abfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e46205202d0a497 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.596+0000 7efe28a00640 1 -- 172.21.15.100:0/1869074013 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c030610 con 0x7efe24151f60 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.596+0000 7efe28a00640 1 -- 172.21.15.100:0/1869074013 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe0c030770 con 0x7efe24151f60 2024-01-20T08:10:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.596+0000 7efe28a00640 1 -- 172.21.15.100:0/1869074013 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe0c030b00 con 0x7efe24151f60 2024-01-20T08:10:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 -- 172.21.15.100:0/1869074013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24151f60 msgr2=0x7efe240abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 --2- 172.21.15.100:0/1869074013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24151f60 0x7efe240abfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097a0 tx=0x7efe0c02b960 comp rx=0 tx=0).stop 2024-01-20T08:10:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 -- 172.21.15.100:0/1869074013 shutdown_connections 2024-01-20T08:10:01.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 --2- 172.21.15.100:0/1869074013 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24151f60 0x7efe240abfd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 -- 172.21.15.100:0/1869074013 >> 172.21.15.100:0/1869074013 conn(0x7efe2406a5e0 msgr2=0x7efe2406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 -- 172.21.15.100:0/1869074013 shutdown_connections 2024-01-20T08:10:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.597+0000 7efe2c800640 1 -- 172.21.15.100:0/1869074013 wait complete. 2024-01-20T08:10:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.599+0000 7efe2c800640 1 Processor -- start 2024-01-20T08:10:01.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.599+0000 7efe2c800640 1 -- start start 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe24147f20 0x7efe2414b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe24151f60 0x7efe24153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241ebf40 con 0x7efe24070370 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe24153650 con 0x7efe24151f60 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2c800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe24148900 con 0x7efe24147f20 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47706/0 (socket says 172.21.15.100:47706) 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 -- 172.21.15.100:0/474066062 learned_addr learned my addr 172.21.15.100:0/474066062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe2a800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe24151f60 0x7efe24153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29400640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe24147f20 0x7efe2414b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 -- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe24147f20 msgr2=0x7efe2414b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe24147f20 0x7efe2414b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 -- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe24151f60 msgr2=0x7efe24153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe24151f60 0x7efe24153ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.600+0000 7efe29e00640 1 -- 172.21.15.100:0/474066062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe0c009400 con 0x7efe24070370 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe29e00640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c450 tx=0x7efe1400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140052d0 con 0x7efe24070370 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe14005430 con 0x7efe24070370 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14012870 con 0x7efe24070370 2024-01-20T08:10:01.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe24155400 con 0x7efe24070370 2024-01-20T08:10:01.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.601+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe241532e0 con 0x7efe24070370 2024-01-20T08:10:01.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.602+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe24155260 con 0x7efe24070370 2024-01-20T08:10:01.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.603+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7efe140129d0 con 0x7efe24070370 2024-01-20T08:10:01.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.604+0000 7efe22000640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 0x7efdfc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:01.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.604+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4471+0+0 (secure 0 0 0) 0x7efe14088b70 con 0x7efe24070370 2024-01-20T08:10:01.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.604+0000 7efe29400640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 0x7efdfc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:01.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.605+0000 7efe29400640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 0x7efdfc06d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe0c036000 tx=0x7efe0c03b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:01.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.609+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efe24155260 con 0x7efe24070370 2024-01-20T08:10:01.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.826+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efe24155260 con 0x7efe24070370 2024-01-20T08:10:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.827+0000 7efe22000640 1 -- 172.21.15.100:0/474066062 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7efe24155260 con 0x7efe24070370 2024-01-20T08:10:01.830 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:01.830 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2024-01-20T08:10:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 2 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 msgr2=0x7efdfc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 0x7efdfc06d300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7efe0c036000 tx=0x7efe0c03b040 comp rx=0 tx=0).stop 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 msgr2=0x7efe2414c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c450 tx=0x7efe1400c910 comp rx=0 tx=0).stop 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 shutdown_connections 2024-01-20T08:10:01.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe24151f60 0x7efe24153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efdfc06ae40 0x7efdfc06d300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe24147f20 0x7efe2414b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 --2- 172.21.15.100:0/474066062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe24070370 0x7efe2414c6a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 >> 172.21.15.100:0/474066062 conn(0x7efe2406a5e0 msgr2=0x7efe24146ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 shutdown_connections 2024-01-20T08:10:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:01.829+0000 7efe2c800640 1 -- 172.21.15.100:0/474066062 wait complete. 2024-01-20T08:10:03.850 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:04.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.057+0000 7f6059800640 1 Processor -- start 2024-01-20T08:10:04.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.057+0000 7f6059800640 1 -- start start 2024-01-20T08:10:04.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.058+0000 7f6059800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60540c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.058+0000 7f6059800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540c2970 con 0x7f60540c37a0 2024-01-20T08:10:04.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.058+0000 7f6059800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60540c5f70 con 0x7f60540709e0 2024-01-20T08:10:04.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.058+0000 7f6059800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c1fc0 con 0x7f60540c2e00 2024-01-20T08:10:04.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6053400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f60540c37a0 0x7f6054157df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49150/0 (socket says 172.21.15.100:49150) 2024-01-20T08:10:04.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6053400640 1 -- 172.21.15.100:0/2101448482 learned_addr learned my addr 172.21.15.100:0/2101448482 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:04.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6052000640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60540c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2525468890 0 0) 0x7f60540c2970 con 0x7f60540c37a0 2024-01-20T08:10:04.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6034003520 con 0x7f60540c37a0 2024-01-20T08:10:04.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088968659 0 0) 0x7f6034003520 con 0x7f60540c37a0 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 msgr2=0x7f60540c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60540c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.059+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 >> v1:172.21.15.110:6789/0 conn(0x7f60540709e0 legacy=0x7f60540c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6054070dc0 con 0x7f60540c37a0 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f604c0019f0 con 0x7f60540c37a0 2024-01-20T08:10:04.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 >> v1:172.21.15.100:6789/0 conn(0x7f60540c37a0 legacy=0x7f6054157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60340039a0 0x7f6034003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6034004d00 0x7f6034005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c1fc0 con 0x7f6034004d00 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f603400ba30 con 0x7f60340039a0 2024-01-20T08:10:04.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603400bbf0 con 0x7f60540c2e00 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6053400640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6034004d00 0x7f6034005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6052a00640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60340039a0 0x7f6034003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.060+0000 7f6052000640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.061+0000 7f6053400640 1 -- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 msgr2=0x7f60340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.061+0000 7f6053400640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f60540c2e00 0x7f60340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.061+0000 7f6053400640 1 -- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60340039a0 msgr2=0x7f6034003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.061+0000 7f6053400640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60340039a0 0x7f6034003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.061+0000 7f6053400640 1 -- 172.21.15.100:0/2101448482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6034003520 con 0x7f6034004d00 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6053400640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6034004d00 0x7f6034005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f60340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71c31da1bac6427 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0072d0 con 0x7f6034004d00 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c02f070 con 0x7f6034004d00 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6051600640 1 -- 172.21.15.100:0/2101448482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c007690 con 0x7f6034004d00 2024-01-20T08:10:04.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6059800640 1 -- 172.21.15.100:0/2101448482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6034004d00 msgr2=0x7f6034005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6059800640 1 --2- 172.21.15.100:0/2101448482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6034004d00 0x7f6034005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f604c00a7f0 tx=0x7f60340057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.062+0000 7f6053400640 1 -- 172.21.15.100:0/2101448482 reap_dead start 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.063+0000 7f6059800640 1 -- 172.21.15.100:0/2101448482 shutdown_connections 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.063+0000 7f6059800640 1 -- 172.21.15.100:0/2101448482 >> 172.21.15.100:0/2101448482 conn(0x7f605406e770 msgr2=0x7f6054066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.063+0000 7f6059800640 1 -- 172.21.15.100:0/2101448482 shutdown_connections 2024-01-20T08:10:04.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.063+0000 7f6059800640 1 -- 172.21.15.100:0/2101448482 wait complete. 2024-01-20T08:10:04.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.064+0000 7f6059800640 1 Processor -- start 2024-01-20T08:10:04.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.064+0000 7f6059800640 1 -- start start 2024-01-20T08:10:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6034004d00 0x7f60541ed830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60540a83b0 0x7f6054153c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540aa570 con 0x7f6054154160 2024-01-20T08:10:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540aaaa0 con 0x7f60540a83b0 2024-01-20T08:10:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.065+0000 7f6059800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540a7f20 con 0x7f6034004d00 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47714/0 (socket says 172.21.15.100:47714) 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 -- 172.21.15.100:0/1635996559 learned_addr learned my addr 172.21.15.100:0/1635996559 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6052000640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60540a83b0 0x7f6054153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 -- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6034004d00 msgr2=0x7f60541ed830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6034004d00 0x7f60541ed830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 -- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60540a83b0 msgr2=0x7f6054153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60540a83b0 0x7f6054153c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 -- 172.21.15.100:0/1635996559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540aa7c0 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f6053400640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f604c001cb0 tx=0x7f60540c7460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.066+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c004d60 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.067+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c001250 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.067+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c0072d0 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.067+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60541ee100 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.067+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60541ee3e0 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.068+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605404e970 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.069+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f604c031030 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.070+0000 7f604aa00640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.070+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f604c0aa300 con 0x7f6054154160 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.070+0000 7f6052a00640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.070+0000 7f6052a00640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 0x7f602c06d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6044007fd0 tx=0x7f6044009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.075+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f604c0755e0 con 0x7f6054154160 2024-01-20T08:10:04.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.307+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60540a8060 con 0x7f6054154160 2024-01-20T08:10:04.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.308+0000 7f604aa00640 1 -- 172.21.15.100:0/1635996559 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3703 (secure 0 0 0) 0x7f604c078c00 con 0x7f6054154160 2024-01-20T08:10:04.311 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:04.311 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4245,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2024-01-20T08:10:04.312 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 3 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 msgr2=0x7f602c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 0x7f602c06d330 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f6044007fd0 tx=0x7f6044009040 comp rx=0 tx=0).stop 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 msgr2=0x7f60540a89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f604c001cb0 tx=0x7f60540c7460 comp rx=0 tx=0).stop 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 shutdown_connections 2024-01-20T08:10:04.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6054154160 0x7f60540a89f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f60540a83b0 0x7f6054153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f602c06ae70 0x7f602c06d330 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 --2- 172.21.15.100:0/1635996559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6034004d00 0x7f60541ed830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 >> 172.21.15.100:0/1635996559 conn(0x7f605406e770 msgr2=0x7f605414d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 shutdown_connections 2024-01-20T08:10:04.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.311+0000 7f6059800640 1 -- 172.21.15.100:0/1635996559 wait complete. 2024-01-20T08:10:04.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:04.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.539+0000 7fac3da00640 1 Processor -- start 2024-01-20T08:10:04.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.539+0000 7fac3da00640 1 -- start start 2024-01-20T08:10:04.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.540+0000 7fac3da00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac38072320 0x7fac3814f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac3da00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380c1720 con 0x7fac380c3240 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac3da00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac380a4f30 con 0x7fac3806dd90 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac3da00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac380c20a0 con 0x7fac38072320 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac38072320 0x7fac3814f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac38072320 0x7fac3814f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47724/0 (socket says 172.21.15.100:47724) 2024-01-20T08:10:04.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 -- 172.21.15.100:0/3330848916 learned_addr learned my addr 172.21.15.100:0/3330848916 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 -- 172.21.15.100:0/3330848916 >> v1:172.21.15.110:6789/0 conn(0x7fac3806dd90 legacy=0x7fac38155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 -- 172.21.15.100:0/3330848916 >> v1:172.21.15.100:6789/0 conn(0x7fac380c3240 legacy=0x7fac38156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.541+0000 7fac37e00640 1 -- 172.21.15.100:0/3330848916 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac380c19e0 con 0x7fac38072320 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.542+0000 7fac37e00640 1 --2- 172.21.15.100:0/3330848916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac3814f5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac28009870 tx=0x7fac2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1f41c835b5bca7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac36a00640 1 -- 172.21.15.100:0/3330848916 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28031870 con 0x7fac38072320 2024-01-20T08:10:04.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac36a00640 1 -- 172.21.15.100:0/3330848916 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac280319d0 con 0x7fac38072320 2024-01-20T08:10:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac36a00640 1 -- 172.21.15.100:0/3330848916 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac28031d60 con 0x7fac38072320 2024-01-20T08:10:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 -- 172.21.15.100:0/3330848916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 msgr2=0x7fac3814f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 --2- 172.21.15.100:0/3330848916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac3814f5d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac28009870 tx=0x7fac2802b910 comp rx=0 tx=0).stop 2024-01-20T08:10:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 -- 172.21.15.100:0/3330848916 shutdown_connections 2024-01-20T08:10:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 --2- 172.21.15.100:0/3330848916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac3814f5d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 -- 172.21.15.100:0/3330848916 >> 172.21.15.100:0/3330848916 conn(0x7fac380c2590 msgr2=0x7fac380c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 -- 172.21.15.100:0/3330848916 shutdown_connections 2024-01-20T08:10:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.543+0000 7fac3da00640 1 -- 172.21.15.100:0/3330848916 wait complete. 2024-01-20T08:10:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.545+0000 7fac3da00640 1 Processor -- start 2024-01-20T08:10:04.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.546+0000 7fac3da00640 1 -- start start 2024-01-20T08:10:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac3806dd90 0x7fac381ee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac380c3240 0x7fac3814d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac38145740 con 0x7fac38072320 2024-01-20T08:10:04.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac381eb1d0 con 0x7fac3806dd90 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac3da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac381ee910 con 0x7fac380c3240 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47726/0 (socket says 172.21.15.100:47726) 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 -- 172.21.15.100:0/2293340550 learned_addr learned my addr 172.21.15.100:0/2293340550 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37e00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac3806dd90 0x7fac381ee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 -- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac380c3240 msgr2=0x7fac3814d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac380c3240 0x7fac3814d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 -- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac3806dd90 msgr2=0x7fac381ee3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac3806dd90 0x7fac381ee3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.547+0000 7fac37400640 1 -- 172.21.15.100:0/2293340550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280094d0 con 0x7fac38072320 2024-01-20T08:10:04.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac37400640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac2000b420 tx=0x7fac2000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20011830 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20011990 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20011d40 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac381ea5c0 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.548+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac381eab80 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.549+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac380749e0 con 0x7fac38072320 2024-01-20T08:10:04.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.550+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7fac2001b460 con 0x7fac38072320 2024-01-20T08:10:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.551+0000 7fac2fe00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 0x7fac1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.551+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fac20088d70 con 0x7fac38072320 2024-01-20T08:10:04.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.551+0000 7fac37e00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 0x7fac1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:04.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.552+0000 7fac37e00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 0x7fac1006d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac28036000 tx=0x7fac2803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:04.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.556+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fac20054060 con 0x7fac38072320 2024-01-20T08:10:04.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.753+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac381eb310 con 0x7fac38072320 2024-01-20T08:10:04.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.754+0000 7fac2fe00640 1 -- 172.21.15.100:0/2293340550 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12840 (secure 0 0 0) 0x7fac20057680 con 0x7fac38072320 2024-01-20T08:10:04.758 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:04.758 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":17,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:04.679162+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:04.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 msgr2=0x7fac1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 0x7fac1006d330 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fac28036000 tx=0x7fac2803c040 comp rx=0 tx=0).stop 2024-01-20T08:10:04.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 msgr2=0x7fac38152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:04.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fac2000b420 tx=0x7fac2000b8e0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 shutdown_connections 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac1006ae70 0x7fac1006d330 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac380c3240 0x7fac3814d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac38072320 0x7fac38152970 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 --2- 172.21.15.100:0/2293340550 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac3806dd90 0x7fac381ee3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 >> 172.21.15.100:0/2293340550 conn(0x7fac380c2590 msgr2=0x7fac380c5f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 shutdown_connections 2024-01-20T08:10:04.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:04.757+0000 7fac3da00640 1 -- 172.21.15.100:0/2293340550 wait complete. 2024-01-20T08:10:04.777 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:04.777 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:05.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.001+0000 7ff15c200640 1 Processor -- start 2024-01-20T08:10:05.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.001+0000 7ff15c200640 1 -- start start 2024-01-20T08:10:05.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.002+0000 7ff15c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 0x7ff1541547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.002+0000 7ff15c200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15414ecd0 con 0x7ff15406d970 2024-01-20T08:10:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.002+0000 7ff15c200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff154157e70 con 0x7ff15414e8f0 2024-01-20T08:10:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.002+0000 7ff15c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff154154e10 con 0x7ff154158a10 2024-01-20T08:10:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.003+0000 7ff158e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff15406d970 0x7ff154158300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49158/0 (socket says 172.21.15.100:49158) 2024-01-20T08:10:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.003+0000 7ff158e00640 1 -- 172.21.15.100:0/487220361 learned_addr learned my addr 172.21.15.100:0/487220361 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:05.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.003+0000 7ff15a200640 1 --2- 172.21.15.100:0/487220361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 0x7ff1541547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.003+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 115116345 0 0) 0x7ff15414ecd0 con 0x7ff15406d970 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.003+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff134003520 con 0x7ff15406d970 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.004+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 431068453 0 0) 0x7ff154157e70 con 0x7ff15414e8f0 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.004+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff15414ecd0 con 0x7ff15414e8f0 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.004+0000 7ff15a200640 1 -- 172.21.15.100:0/487220361 >> v1:172.21.15.110:6789/0 conn(0x7ff15414e8f0 legacy=0x7ff15406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.004+0000 7ff15a200640 1 -- 172.21.15.100:0/487220361 >> v1:172.21.15.100:6789/0 conn(0x7ff15406d970 legacy=0x7ff154158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.004+0000 7ff15a200640 1 -- 172.21.15.100:0/487220361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1541550f0 con 0x7ff154158a10 2024-01-20T08:10:05.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.005+0000 7ff15a200640 1 --2- 172.21.15.100:0/487220361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 0x7ff1541547c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009dc0 tx=0x7ff14c02be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cbd98c833fdd720 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.006+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c02cc30 con 0x7ff154158a10 2024-01-20T08:10:05.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.006+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c02cd90 con 0x7ff154158a10 2024-01-20T08:10:05.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.006+0000 7ff153e00640 1 -- 172.21.15.100:0/487220361 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c034640 con 0x7ff154158a10 2024-01-20T08:10:05.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 -- 172.21.15.100:0/487220361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 msgr2=0x7ff1541547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 --2- 172.21.15.100:0/487220361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 0x7ff1541547c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009dc0 tx=0x7ff14c02be80 comp rx=0 tx=0).stop 2024-01-20T08:10:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 -- 172.21.15.100:0/487220361 shutdown_connections 2024-01-20T08:10:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 --2- 172.21.15.100:0/487220361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff154158a10 0x7ff1541547c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 -- 172.21.15.100:0/487220361 >> 172.21.15.100:0/487220361 conn(0x7ff1540c3170 msgr2=0x7ff1540c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 -- 172.21.15.100:0/487220361 shutdown_connections 2024-01-20T08:10:05.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.007+0000 7ff15c200640 1 -- 172.21.15.100:0/487220361 wait complete. 2024-01-20T08:10:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.009+0000 7ff15c200640 1 Processor -- start 2024-01-20T08:10:05.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.009+0000 7ff15c200640 1 -- start start 2024-01-20T08:10:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 0x7ff1541546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff15414e8f0 0x7ff1540ab950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff154150370 con 0x7ff154158a10 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff154151590 con 0x7ff15406d970 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1541eac30 con 0x7ff15414e8f0 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47754/0 (socket says 172.21.15.100:47754) 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 -- 172.21.15.100:0/161831780 learned_addr learned my addr 172.21.15.100:0/161831780 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff159800640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 0x7ff1541546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 -- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff15414e8f0 msgr2=0x7ff1540ab950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff15414e8f0 0x7ff1540ab950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 -- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 msgr2=0x7ff1541546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 0x7ff1541546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff15a200640 1 -- 172.21.15.100:0/161831780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c009a70 con 0x7ff154158a10 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.010+0000 7ff159800640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 0x7ff1541546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff15a200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009ee0 tx=0x7ff14c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c007000 con 0x7ff154158a10 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c040670 con 0x7ff154158a10 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c040a20 con 0x7ff154158a10 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1541505c0 con 0x7ff154158a10 2024-01-20T08:10:05.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.011+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15414ef20 con 0x7ff154158a10 2024-01-20T08:10:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.012+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15404e970 con 0x7ff154158a10 2024-01-20T08:10:05.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.013+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7ff14c040b80 con 0x7ff154158a10 2024-01-20T08:10:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.014+0000 7ff151600640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 0x7ff12c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.014+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff14c0abc50 con 0x7ff154158a10 2024-01-20T08:10:05.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.014+0000 7ff159800640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 0x7ff12c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.015+0000 7ff159800640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 0x7ff12c06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1440016b0 tx=0x7ff144009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.019+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff14c077000 con 0x7ff154158a10 2024-01-20T08:10:05.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.213+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff154066750 con 0x7ff154158a10 2024-01-20T08:10:05.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.213+0000 7ff151600640 1 -- 172.21.15.100:0/161831780 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff14c009450 con 0x7ff154158a10 2024-01-20T08:10:05.216 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 msgr2=0x7ff12c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 0x7ff12c06d330 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff1440016b0 tx=0x7ff144009040 comp rx=0 tx=0).stop 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 msgr2=0x7ff1540a6d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff14c009ee0 tx=0x7ff14c004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 shutdown_connections 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff154158a10 0x7ff1540a6d40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff12c06ae70 0x7ff12c06d330 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff15414e8f0 0x7ff1540ab950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 --2- 172.21.15.100:0/161831780 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff15406d970 0x7ff1541546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 >> 172.21.15.100:0/161831780 conn(0x7ff1540c3170 msgr2=0x7ff1541569b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:05.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 shutdown_connections 2024-01-20T08:10:05.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.216+0000 7ff15c200640 1 -- 172.21.15.100:0/161831780 wait complete. 2024-01-20T08:10:05.236 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:10:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.425+0000 7f555ce00640 1 Processor -- start 2024-01-20T08:10:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.425+0000 7f555ce00640 1 -- start start 2024-01-20T08:10:05.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.426+0000 7f555ce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 0x7f55580c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.426+0000 7f555ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55580c4a50 0x7f5558155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.426+0000 7f555ce00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55580c9f30 con 0x7f5558155d00 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.426+0000 7f555ce00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f555806c5a0 con 0x7f55580c4a50 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.426+0000 7f555ce00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55581557d0 con 0x7f5558151e40 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55580c4a50 0x7f5558155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55580c4a50 0x7f5558155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47764/0 (socket says 172.21.15.100:47764) 2024-01-20T08:10:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 -- 172.21.15.100:0/3052676205 learned_addr learned my addr 172.21.15.100:0/3052676205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f5555e00640 1 --2- 172.21.15.100:0/3052676205 >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 0x7f55580c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 -- 172.21.15.100:0/3052676205 >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 msgr2=0x7f55580c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 --2- 172.21.15.100:0/3052676205 >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 0x7f55580c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 -- 172.21.15.100:0/3052676205 >> v1:172.21.15.110:6789/0 conn(0x7f5558155d00 legacy=0x7f555806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f554fe00640 1 -- 172.21.15.100:0/3052676205 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580c87a0 con 0x7f55580c4a50 2024-01-20T08:10:05.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.427+0000 7f5555e00640 1 --2- 172.21.15.100:0/3052676205 >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 0x7f55580c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:05.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.428+0000 7f554fe00640 1 --2- 172.21.15.100:0/3052676205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558155290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55580c7560 tx=0x7f554002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee843e639e2aba0e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.429+0000 7f5555400640 1 -- 172.21.15.100:0/3052676205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400317e0 con 0x7f55580c4a50 2024-01-20T08:10:05.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.429+0000 7f5555400640 1 -- 172.21.15.100:0/3052676205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540031940 con 0x7f55580c4a50 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.429+0000 7f5555400640 1 -- 172.21.15.100:0/3052676205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540031cd0 con 0x7f55580c4a50 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.429+0000 7f555ce00640 1 -- 172.21.15.100:0/3052676205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 msgr2=0x7f5558155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.429+0000 7f555ce00640 1 --2- 172.21.15.100:0/3052676205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558155290 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f55580c7560 tx=0x7f554002b880 comp rx=0 tx=0).stop 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 -- 172.21.15.100:0/3052676205 shutdown_connections 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 --2- 172.21.15.100:0/3052676205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558155290 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 --2- 172.21.15.100:0/3052676205 >> v2:172.21.15.110:3300/0 conn(0x7f5558151e40 0x7f55580c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 -- 172.21.15.100:0/3052676205 >> 172.21.15.100:0/3052676205 conn(0x7f55580abde0 msgr2=0x7f55580ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 -- 172.21.15.100:0/3052676205 shutdown_connections 2024-01-20T08:10:05.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.430+0000 7f555ce00640 1 -- 172.21.15.100:0/3052676205 wait complete. 2024-01-20T08:10:05.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.431+0000 7f555ce00640 1 Processor -- start 2024-01-20T08:10:05.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.431+0000 7f555ce00640 1 -- start start 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 0x7f5558153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 0x7f5558153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555814e870 con 0x7f55580c4a50 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55581e9cb0 con 0x7f5558151e40 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.432+0000 7f555ce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5558148da0 con 0x7f5558155d00 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47768/0 (socket says 172.21.15.100:47768) 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 -- 172.21.15.100:0/363612661 learned_addr learned my addr 172.21.15.100:0/363612661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f554fe00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 0x7f5558153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 -- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 msgr2=0x7f5558153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5556800640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 0x7f5558153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 0x7f5558153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 -- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 msgr2=0x7f5558153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 0x7f5558153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 -- 172.21.15.100:0/363612661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55400094d0 con 0x7f55580c4a50 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f554fe00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 0x7f5558153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5556800640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 0x7f5558153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.433+0000 7f5555e00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f554800c820 tx=0x7f554800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.434+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5548007a30 con 0x7f55580c4a50 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.434+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5548007b90 con 0x7f55580c4a50 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.434+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5558154170 con 0x7f55580c4a50 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.434+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800ce70 con 0x7f55580c4a50 2024-01-20T08:10:05.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.434+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f555814cbb0 con 0x7f55580c4a50 2024-01-20T08:10:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.435+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f555814cdd0 con 0x7f55580c4a50 2024-01-20T08:10:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.436+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f55480113f0 con 0x7f55580c4a50 2024-01-20T08:10:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.437+0000 7f554e000640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 0x7f553006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.437+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55480893b0 con 0x7f55580c4a50 2024-01-20T08:10:05.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.441+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5548054610 con 0x7f55580c4a50 2024-01-20T08:10:05.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.450+0000 7f554fe00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 0x7f553006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.450+0000 7f554fe00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 0x7f553006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5540036000 tx=0x7f554003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.640+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f555804e970 con 0x7f55580c4a50 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.641+0000 7f554e000640 1 -- 172.21.15.100:0/363612661 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5548057c30 con 0x7f55580c4a50 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:05.644 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 msgr2=0x7f553006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 0x7f553006d300 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5540036000 tx=0x7f554003d040 comp rx=0 tx=0).stop 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 msgr2=0x7f5558148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f554800c820 tx=0x7f554800cc20 comp rx=0 tx=0).stop 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 shutdown_connections 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f553006ae40 0x7f553006d300 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5558155d00 0x7f5558153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5558151e40 0x7f5558153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 --2- 172.21.15.100:0/363612661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55580c4a50 0x7f5558148860 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 >> 172.21.15.100:0/363612661 conn(0x7f55580abde0 msgr2=0x7f5558156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:05.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 shutdown_connections 2024-01-20T08:10:05.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.643+0000 7f555ce00640 1 -- 172.21.15.100:0/363612661 wait complete. 2024-01-20T08:10:05.661 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T08:10:05.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T08:10:05.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:10:05.711 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:10:05.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.845+0000 7f5460e00640 1 Processor -- start 2024-01-20T08:10:05.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.845+0000 7f5460e00640 1 -- start start 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f5460e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f5460e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f545c0c70b0 0x7f545c0c7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f5460e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f545c155840 con 0x7f545c155d70 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f5460e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f545c0c9e90 con 0x7f545c0c70b0 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f5460e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c06b6a0 con 0x7f545c151fe0 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f545a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f545c0c70b0 0x7f545c0c7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f545a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f545c0c70b0 0x7f545c0c7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47774/0 (socket says 172.21.15.100:47774) 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.846+0000 7f545a800640 1 -- 172.21.15.100:0/2625313687 learned_addr learned my addr 172.21.15.100:0/2625313687 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.847+0000 7f5459e00640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.847+0000 7f545a800640 1 -- 172.21.15.100:0/2625313687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 msgr2=0x7f545c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.847+0000 7f545a800640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.847+0000 7f545a800640 1 -- 172.21.15.100:0/2625313687 >> v1:172.21.15.110:6789/0 conn(0x7f545c155d70 legacy=0x7f545c0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:05.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.847+0000 7f545a800640 1 -- 172.21.15.100:0/2625313687 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f545c06b980 con 0x7f545c0c70b0 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.848+0000 7f545a800640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c0c7540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e50 tx=0x7f545402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f19a2b2dbaaccf42 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.848+0000 7f5459400640 1 -- 172.21.15.100:0/2625313687 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f545402c9e0 con 0x7f545c0c70b0 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.848+0000 7f5459400640 1 -- 172.21.15.100:0/2625313687 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f545402cb40 con 0x7f545c0c70b0 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.848+0000 7f5459400640 1 -- 172.21.15.100:0/2625313687 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54540343f0 con 0x7f545c0c70b0 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 -- 172.21.15.100:0/2625313687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 msgr2=0x7f545c0c7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c0c7540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5454009e50 tx=0x7f545402be40 comp rx=0 tx=0).stop 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 -- 172.21.15.100:0/2625313687 shutdown_connections 2024-01-20T08:10:05.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c0c7540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 --2- 172.21.15.100:0/2625313687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 -- 172.21.15.100:0/2625313687 >> 172.21.15.100:0/2625313687 conn(0x7f545c0ac010 msgr2=0x7f545c0ac420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 -- 172.21.15.100:0/2625313687 shutdown_connections 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.849+0000 7f5460e00640 1 -- 172.21.15.100:0/2625313687 wait complete. 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.851+0000 7f5460e00640 1 Processor -- start 2024-01-20T08:10:05.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.851+0000 7f5460e00640 1 -- start start 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.851+0000 7f5460e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5460e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5460e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f545c155d70 0x7f545c0c2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5460e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0c6200 con 0x7f545c0c70b0 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5460e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c0c5f00 con 0x7f545c155d70 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5460e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f545c14b470 con 0x7f545c151fe0 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47784/0 (socket says 172.21.15.100:47784) 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 -- 172.21.15.100:0/36522412 learned_addr learned my addr 172.21.15.100:0/36522412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 -- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 msgr2=0x7f545c147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 -- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f545c155d70 msgr2=0x7f545c0c2c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f545c155d70 0x7f545c0c2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 -- 172.21.15.100:0/36522412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009b30 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.852+0000 7f5459e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f544c00d830 tx=0x7f544c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.853+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00b6c0 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.853+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544c00b820 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.853+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c148620 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.853+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00bbb0 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.853+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c0c1250 con 0x7f545c0c70b0 2024-01-20T08:10:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.854+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f545c074300 con 0x7f545c0c70b0 2024-01-20T08:10:05.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.855+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 4) v1 ==== 89142+0+0 (secure 0 0 0) 0x7f544c01e460 con 0x7f545c0c70b0 2024-01-20T08:10:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.856+0000 7f5452000640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 0x7f543406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.856+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f544c0899d0 con 0x7f545c0c70b0 2024-01-20T08:10:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.856+0000 7f5453e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 0x7f543406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.857+0000 7f5453e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 0x7f543406d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f545c0c1020 tx=0x7f54440079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:05.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:05.860+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f544c054cc0 con 0x7f545c0c70b0 2024-01-20T08:10:06.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.056+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f545c0c6040 con 0x7f545c0c70b0 2024-01-20T08:10:06.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.714+0000 7f5452000640 1 -- 172.21.15.100:0/36522412 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7f545c0c6040 con 0x7f545c0c70b0 2024-01-20T08:10:06.717 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-20T08:10:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.718+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 msgr2=0x7f543406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.718+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 0x7f543406d300 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f545c0c1020 tx=0x7f54440079b0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 msgr2=0x7f545c148870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f544c00d830 tx=0x7f544c00dcf0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 shutdown_connections 2024-01-20T08:10:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f545c155d70 0x7f545c0c2c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f543406ae40 0x7f543406d300 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f545c151fe0 0x7f545c147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 --2- 172.21.15.100:0/36522412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c0c70b0 0x7f545c148870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 >> 172.21.15.100:0/36522412 conn(0x7f545c0ac010 msgr2=0x7f545c150310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 shutdown_connections 2024-01-20T08:10:06.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.719+0000 7f5460e00640 1 -- 172.21.15.100:0/36522412 wait complete. 2024-01-20T08:10:06.751 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:10:06.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.945+0000 7fd787600640 1 Processor -- start 2024-01-20T08:10:06.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.946+0000 7fd787600640 1 -- start start 2024-01-20T08:10:06.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd787600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7800c8060 0x7fd780154860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd787600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800c8560 con 0x7fd7801560c0 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd787600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7800c8840 con 0x7fd780157960 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd787600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd780152360 con 0x7fd7800c8060 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd785600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd7801560c0 0x7fd7801564d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49164/0 (socket says 172.21.15.100:49164) 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.947+0000 7fd785600640 1 -- 172.21.15.100:0/3543035072 learned_addr learned my addr 172.21.15.100:0/3543035072 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77fe00640 1 --2- 172.21.15.100:0/3543035072 >> v2:172.21.15.110:3300/0 conn(0x7fd7800c8060 0x7fd780154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3280849873 0 0) 0x7fd7800c8560 con 0x7fd7801560c0 2024-01-20T08:10:06.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd760003520 con 0x7fd7801560c0 2024-01-20T08:10:06.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2077144286 0 0) 0x7fd760003520 con 0x7fd7801560c0 2024-01-20T08:10:06.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 >> v2:172.21.15.110:3300/0 conn(0x7fd7800c8060 msgr2=0x7fd780154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:06.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 --2- 172.21.15.100:0/3543035072 >> v2:172.21.15.110:3300/0 conn(0x7fd7800c8060 0x7fd780154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 >> v1:172.21.15.110:6789/0 conn(0x7fd780157960 legacy=0x7fd78006b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800c8b20 con 0x7fd7801560c0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fd7780019f0 con 0x7fd7801560c0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 >> v1:172.21.15.100:6789/0 conn(0x7fd7801560c0 legacy=0x7fd7801564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.948+0000 7fd77f400640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd760003970 0x7fd760003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77f400640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7600047c0 0x7fd760004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77f400640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 0x7fd76000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd780152360 con 0x7fd7600052a0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76000c170 con 0x7fd760003970 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76000c330 con 0x7fd7600047c0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 0x7fd76000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd784c00640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd760003970 0x7fd760003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd77fe00640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7600047c0 0x7fd760004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 -- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7600047c0 msgr2=0x7fd760004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7600047c0 0x7fd760004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 -- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd760003970 msgr2=0x7fd760003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd760003970 0x7fd760003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd785600640 1 -- 172.21.15.100:0/3543035072 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd760003520 con 0x7fd7600052a0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.949+0000 7fd784c00640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd760003970 0x7fd760003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.950+0000 7fd785600640 1 -- 172.21.15.100:0/3543035072 reap_dead start 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.950+0000 7fd785600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 0x7fd76000b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd77800a800 tx=0x7fd7600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a2862321c955f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7780072d0 con 0x7fd7600052a0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd77802f070 con 0x7fd7600052a0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd77f400640 1 -- 172.21.15.100:0/3543035072 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd778007670 con 0x7fd7600052a0 2024-01-20T08:10:06.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 -- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 msgr2=0x7fd76000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 0x7fd76000b980 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd77800a800 tx=0x7fd7600057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 -- 172.21.15.100:0/3543035072 shutdown_connections 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 --2- 172.21.15.100:0/3543035072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7600052a0 0x7fd76000b980 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 -- 172.21.15.100:0/3543035072 >> 172.21.15.100:0/3543035072 conn(0x7fd7800abcd0 msgr2=0x7fd7800ac0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 -- 172.21.15.100:0/3543035072 shutdown_connections 2024-01-20T08:10:06.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.951+0000 7fd787600640 1 -- 172.21.15.100:0/3543035072 wait complete. 2024-01-20T08:10:06.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.953+0000 7fd787600640 1 Processor -- start 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.953+0000 7fd787600640 1 -- start start 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7600052a0 0x7fd7800c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 0x7fd7801ec6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800c1630 con 0x7fd7800c3e70 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800c1350 con 0x7fd7600052a0 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd787600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7800c2350 con 0x7fd7801ebb10 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd77fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47814/0 (socket says 172.21.15.100:47814) 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd77fe00640 1 -- 172.21.15.100:0/3325138433 learned_addr learned my addr 172.21.15.100:0/3325138433 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd785600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 0x7fd7801ec6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.954+0000 7fd784c00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7600052a0 0x7fd7800c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 -- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 msgr2=0x7fd7801ec6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 0x7fd7801ec6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 -- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7600052a0 msgr2=0x7fd7800c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7600052a0 0x7fd7800c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 -- 172.21.15.100:0/3325138433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7800c9fd0 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd785600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 0x7fd7801ec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77fe00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd768011590 tx=0x7fd768011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768004220 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd768004380 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd768015930 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7800c2630 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.955+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd780154500 con 0x7fd7800c3e70 2024-01-20T08:10:06.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.957+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd780067640 con 0x7fd7800c3e70 2024-01-20T08:10:06.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.957+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd768015a90 con 0x7fd7800c3e70 2024-01-20T08:10:06.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.958+0000 7fd77cc00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 0x7fd75806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:06.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.958+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd768089920 con 0x7fd7800c3e70 2024-01-20T08:10:06.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.959+0000 7fd784c00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 0x7fd75806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:06.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.959+0000 7fd784c00640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 0x7fd75806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd770005450 tx=0x7fd770009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:06.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:06.964+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd7680549c0 con 0x7fd7800c3e70 2024-01-20T08:10:07.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.163+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd7800c27c0 con 0x7fd7800c3e70 2024-01-20T08:10:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.740+0000 7fd77cc00640 1 -- 172.21.15.100:0/3325138433 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd7680220d0 con 0x7fd7800c3e70 2024-01-20T08:10:07.743 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-20T08:10:07.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.745+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 msgr2=0x7fd75806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.745+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 0x7fd75806d3c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd770005450 tx=0x7fd770009040 comp rx=0 tx=0).stop 2024-01-20T08:10:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.745+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 msgr2=0x7fd7801eb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.745+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd768011590 tx=0x7fd768011a50 comp rx=0 tx=0).stop 2024-01-20T08:10:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 shutdown_connections 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd75806af00 0x7fd75806d3c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7801ebb10 0x7fd7801ec6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7800c3e70 0x7fd7801eb5d0 secure :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd768011590 tx=0x7fd768011a50 comp rx=0 tx=0).stop 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 --2- 172.21.15.100:0/3325138433 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7600052a0 0x7fd7800c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.746+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 >> 172.21.15.100:0/3325138433 conn(0x7fd7800abcd0 msgr2=0x7fd780154bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.747+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 shutdown_connections 2024-01-20T08:10:07.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.747+0000 7fd787600640 1 -- 172.21.15.100:0/3325138433 wait complete. 2024-01-20T08:10:07.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T08:10:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.958+0000 7ff724c00640 1 Processor -- start 2024-01-20T08:10:07.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.958+0000 7ff724c00640 1 -- start start 2024-01-20T08:10:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.959+0000 7ff724c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.959+0000 7ff724c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff72006cd10 0x7ff72015c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.959+0000 7ff724c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200c2260 con 0x7ff72006d130 2024-01-20T08:10:07.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.959+0000 7ff724c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200c2540 con 0x7ff72006cd10 2024-01-20T08:10:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.959+0000 7ff724c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72006c510 con 0x7ff72015c240 2024-01-20T08:10:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff72006cd10 0x7ff72015c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff72006cd10 0x7ff72015c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47822/0 (socket says 172.21.15.100:47822) 2024-01-20T08:10:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff71e800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7ff72006d130 0x7ff720158c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:56348/0 (socket says 172.21.15.100:56348) 2024-01-20T08:10:07.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 -- 172.21.15.100:0/599031348 learned_addr learned my addr 172.21.15.100:0/599031348 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff71de00640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 -- 172.21.15.100:0/599031348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 msgr2=0x7ff720070190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720070190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 -- 172.21.15.100:0/599031348 >> v1:172.21.15.110:6789/0 conn(0x7ff72006d130 legacy=0x7ff720158c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.960+0000 7ff715200640 1 -- 172.21.15.100:0/599031348 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72006c7f0 con 0x7ff72006cd10 2024-01-20T08:10:07.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.961+0000 7ff715200640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72015c620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609aefcbb5801ea9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.961+0000 7ff71d400640 1 -- 172.21.15.100:0/599031348 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708031640 con 0x7ff72006cd10 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff71d400640 1 -- 172.21.15.100:0/599031348 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7080317a0 con 0x7ff72006cd10 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff71d400640 1 -- 172.21.15.100:0/599031348 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff708031b30 con 0x7ff72006cd10 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 -- 172.21.15.100:0/599031348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 msgr2=0x7ff72015c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72015c620 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff708009870 tx=0x7ff70802b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 -- 172.21.15.100:0/599031348 shutdown_connections 2024-01-20T08:10:07.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72015c620 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 --2- 172.21.15.100:0/599031348 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720070190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 -- 172.21.15.100:0/599031348 >> 172.21.15.100:0/599031348 conn(0x7ff7200c2940 msgr2=0x7ff7200c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:07.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 -- 172.21.15.100:0/599031348 shutdown_connections 2024-01-20T08:10:07.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.962+0000 7ff724c00640 1 -- 172.21.15.100:0/599031348 wait complete. 2024-01-20T08:10:07.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.964+0000 7ff724c00640 1 Processor -- start 2024-01-20T08:10:07.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.964+0000 7ff724c00640 1 -- start start 2024-01-20T08:10:07.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff72006d130 0x7ff72014e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720142080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72015bac0 con 0x7ff72006cd10 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72014d1d0 con 0x7ff72006d130 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff724c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff72014d4b0 con 0x7ff72015c240 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff71de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff71de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47826/0 (socket says 172.21.15.100:47826) 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff71de00640 1 -- 172.21.15.100:0/4162910879 learned_addr learned my addr 172.21.15.100:0/4162910879 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff71e800640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720142080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.965+0000 7ff715200640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff72006d130 0x7ff72014e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 -- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 msgr2=0x7ff720142080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720142080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 -- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff72006d130 msgr2=0x7ff72014e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff72006d130 0x7ff72014e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 -- 172.21.15.100:0/4162910879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7080094d0 con 0x7ff72006cd10 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71e800640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:07.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff71de00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff71000c7f0 tx=0x7ff71000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710004220 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff710004380 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72015bcd0 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff710007840 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.966+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72014d880 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.968+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff72014d670 con 0x7ff72006cd10 2024-01-20T08:10:07.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.968+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff710007bb0 con 0x7ff72006cd10 2024-01-20T08:10:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.969+0000 7ff716a00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 0x7ff6f806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.970+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7ff710089470 con 0x7ff72006cd10 2024-01-20T08:10:07.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.970+0000 7ff715200640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 0x7ff6f806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:07.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.970+0000 7ff715200640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 0x7ff6f806d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff708036000 tx=0x7ff70803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:07.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:07.975+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff710054440 con 0x7ff72006cd10 2024-01-20T08:10:08.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.210+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff72004e970 con 0x7ff72006cd10 2024-01-20T08:10:08.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.978+0000 7ff716a00640 1 -- 172.21.15.100:0/4162910879 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff710007e60 con 0x7ff72006cd10 2024-01-20T08:10:08.982 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 2 and data pool 3 2024-01-20T08:10:08.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 msgr2=0x7ff6f806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:08.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 0x7ff6f806d390 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff708036000 tx=0x7ff70803c040 comp rx=0 tx=0).stop 2024-01-20T08:10:08.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 msgr2=0x7ff72014e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff71000c7f0 tx=0x7ff71000ccb0 comp rx=0 tx=0).stop 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 shutdown_connections 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6f806aed0 0x7ff6f806d390 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff72015c240 0x7ff720142080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff72006d130 0x7ff72014e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 --2- 172.21.15.100:0/4162910879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff72006cd10 0x7ff72014e040 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.982+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 >> 172.21.15.100:0/4162910879 conn(0x7ff7200c2940 msgr2=0x7ff720070750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.983+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 shutdown_connections 2024-01-20T08:10:08.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:08.983+0000 7ff724c00640 1 -- 172.21.15.100:0/4162910879 wait complete. 2024-01-20T08:10:09.011 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.188+0000 7fcba8800640 1 Processor -- start 2024-01-20T08:10:09.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.188+0000 7fcba8800640 1 -- start start 2024-01-20T08:10:09.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.190+0000 7fcba8800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.190+0000 7fcba8800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 0x7fcba01581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.190+0000 7fcba8800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcba00c23b0 con 0x7fcba0071260 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.190+0000 7fcba8800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcba0152400 con 0x7fcba00c36f0 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.190+0000 7fcba8800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba00c2650 con 0x7fcba0152020 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.191+0000 7fcba5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.191+0000 7fcba5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47142/0 (socket says 172.21.15.100:47142) 2024-01-20T08:10:09.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.191+0000 7fcba5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 0x7fcba01581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.191+0000 7fcba5e00640 1 -- 172.21.15.100:0/3052477359 learned_addr learned my addr 172.21.15.100:0/3052477359 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.192+0000 7fcba5e00640 1 -- 172.21.15.100:0/3052477359 >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 msgr2=0x7fcba01581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.191+0000 7fcba4a00640 1 -- 172.21.15.100:0/3052477359 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2666125017 0 0) 0x7fcba00c23b0 con 0x7fcba0071260 2024-01-20T08:10:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.192+0000 7fcba5e00640 1 --2- 172.21.15.100:0/3052477359 >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 0x7fcba01581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.192+0000 7fcba5e00640 1 -- 172.21.15.100:0/3052477359 >> v1:172.21.15.110:6789/0 conn(0x7fcba0071260 legacy=0x7fcba01586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.192+0000 7fcba5e00640 1 -- 172.21.15.100:0/3052477359 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba00c2930 con 0x7fcba0152020 2024-01-20T08:10:09.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.192+0000 7fcba5400640 1 --2- 172.21.15.100:0/3052477359 >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 0x7fcba01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:09.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.193+0000 7fcba5e00640 1 --2- 172.21.15.100:0/3052477359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb9002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a17cd6118fb53a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba4a00640 1 -- 172.21.15.100:0/3052477359 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90031640 con 0x7fcba0152020 2024-01-20T08:10:09.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba4a00640 1 -- 172.21.15.100:0/3052477359 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900317a0 con 0x7fcba0152020 2024-01-20T08:10:09.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba4a00640 1 -- 172.21.15.100:0/3052477359 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90031b30 con 0x7fcba0152020 2024-01-20T08:10:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 -- 172.21.15.100:0/3052477359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 msgr2=0x7fcba006a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 --2- 172.21.15.100:0/3052477359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fcb90009870 tx=0x7fcb9002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 -- 172.21.15.100:0/3052477359 shutdown_connections 2024-01-20T08:10:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 --2- 172.21.15.100:0/3052477359 >> v2:172.21.15.110:3300/0 conn(0x7fcba00c36f0 0x7fcba01581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 --2- 172.21.15.100:0/3052477359 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba0152020 0x7fcba006a5e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 -- 172.21.15.100:0/3052477359 >> 172.21.15.100:0/3052477359 conn(0x7fcba006bd20 msgr2=0x7fcba00c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.194+0000 7fcba8800640 1 -- 172.21.15.100:0/3052477359 shutdown_connections 2024-01-20T08:10:09.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.195+0000 7fcba8800640 1 -- 172.21.15.100:0/3052477359 wait complete. 2024-01-20T08:10:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.196+0000 7fcba8800640 1 Processor -- start 2024-01-20T08:10:09.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.196+0000 7fcba8800640 1 -- start start 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba00c36f0 0x7fcba00c6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba0152020 0x7fcba00c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01ed2c0 con 0x7fcba0071260 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01ede00 con 0x7fcba0152020 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba8800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01ed4d0 con 0x7fcba00c36f0 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.197+0000 7fcba5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57664/0 (socket says 172.21.15.100:57664) 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 -- 172.21.15.100:0/61376299 learned_addr learned my addr 172.21.15.100:0/61376299 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5400640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba00c36f0 0x7fcba00c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba6800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba0152020 0x7fcba00c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 -- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba00c36f0 msgr2=0x7fcba00c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba00c36f0 0x7fcba00c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 -- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba0152020 msgr2=0x7fcba00c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba0152020 0x7fcba00c4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 -- 172.21.15.100:0/61376299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb88009400 con 0x7fcba0071260 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.198+0000 7fcba5e00640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb900090b0 tx=0x7fcb900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.199+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90004230 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.199+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb900043b0 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.199+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90004520 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.199+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb900094d0 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.199+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba01eda90 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.200+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba01ed610 con 0x7fcba0071260 2024-01-20T08:10:09.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.201+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcb90042070 con 0x7fcba0071260 2024-01-20T08:10:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.201+0000 7fcb9e000640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 0x7fcb7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.202+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb900ab400 con 0x7fcba0071260 2024-01-20T08:10:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.202+0000 7fcba5400640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 0x7fcb7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.202+0000 7fcba5400640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 0x7fcb7806d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcba014f0c0 tx=0x7fcb88008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.206+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcba01ed610 con 0x7fcba0071260 2024-01-20T08:10:09.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.399+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcba01ed610 con 0x7fcba0071260 2024-01-20T08:10:09.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.402+0000 7fcb9e000640 1 -- 172.21.15.100:0/61376299 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16495 (secure 0 0 0) 0x7fcba01ed610 con 0x7fcba0071260 2024-01-20T08:10:09.406 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:09.406 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:08.211901+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 msgr2=0x7fcb7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 0x7fcb7806d390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fcba014f0c0 tx=0x7fcb88008040 comp rx=0 tx=0).stop 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 msgr2=0x7fcba0157100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcb900090b0 tx=0x7fcb900046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 shutdown_connections 2024-01-20T08:10:09.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcba0152020 0x7fcba00c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb7806aed0 0x7fcb7806d390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcba00c36f0 0x7fcba00c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 --2- 172.21.15.100:0/61376299 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcba0071260 0x7fcba0157100 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.405+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 >> 172.21.15.100:0/61376299 conn(0x7fcba006bd20 msgr2=0x7fcba00c0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.406+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 shutdown_connections 2024-01-20T08:10:09.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.406+0000 7fcba8800640 1 -- 172.21.15.100:0/61376299 wait complete. 2024-01-20T08:10:09.427 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.631+0000 7fe423200640 1 Processor -- start 2024-01-20T08:10:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.631+0000 7fe423200640 1 -- start start 2024-01-20T08:10:09.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe423200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 0x7fe41c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe423200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe41c151f60 0x7fe41c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe423200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe41c0c1670 con 0x7fe41c0c1b00 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe423200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c1524b0 con 0x7fe41c151f60 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe423200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0c0d40 con 0x7fe41c147f20 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe413200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe41c151f60 0x7fe41c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe421200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe41c0c1b00 0x7fe41c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55492/0 (socket says 172.21.15.100:55492) 2024-01-20T08:10:09.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe421200640 1 -- 172.21.15.100:0/2262756503 learned_addr learned my addr 172.21.15.100:0/2262756503 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.633+0000 7fe41be00640 1 --2- 172.21.15.100:0/2262756503 >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 0x7fe41c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe41b400640 1 -- 172.21.15.100:0/2262756503 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417748745 0 0) 0x7fe41c0c1670 con 0x7fe41c0c1b00 2024-01-20T08:10:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe41b400640 1 -- 172.21.15.100:0/2262756503 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3fc005730 con 0x7fe41c0c1b00 2024-01-20T08:10:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe413200640 1 -- 172.21.15.100:0/2262756503 >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 msgr2=0x7fe41c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:09.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe413200640 1 --2- 172.21.15.100:0/2262756503 >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 0x7fe41c0abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe413200640 1 -- 172.21.15.100:0/2262756503 >> v1:172.21.15.100:6789/0 conn(0x7fe41c0c1b00 legacy=0x7fe41c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe413200640 1 -- 172.21.15.100:0/2262756503 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c0c1020 con 0x7fe41c151f60 2024-01-20T08:10:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.634+0000 7fe41be00640 1 --2- 172.21.15.100:0/2262756503 >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 0x7fe41c0abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe413200640 1 --2- 172.21.15.100:0/2262756503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c151f60 0x7fe41c070370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06e5d0 tx=0x7fe40c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d276356d53e1f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe41b400640 1 -- 172.21.15.100:0/2262756503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c031830 con 0x7fe41c151f60 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe41b400640 1 -- 172.21.15.100:0/2262756503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c031990 con 0x7fe41c151f60 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe41b400640 1 -- 172.21.15.100:0/2262756503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c031d00 con 0x7fe41c151f60 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe423200640 1 -- 172.21.15.100:0/2262756503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c151f60 msgr2=0x7fe41c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.635+0000 7fe423200640 1 --2- 172.21.15.100:0/2262756503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c151f60 0x7fe41c070370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe41c06e5d0 tx=0x7fe40c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 -- 172.21.15.100:0/2262756503 shutdown_connections 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 --2- 172.21.15.100:0/2262756503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c151f60 0x7fe41c070370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 --2- 172.21.15.100:0/2262756503 >> v2:172.21.15.110:3300/0 conn(0x7fe41c147f20 0x7fe41c0abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 -- 172.21.15.100:0/2262756503 >> 172.21.15.100:0/2262756503 conn(0x7fe41c06a5e0 msgr2=0x7fe41c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 -- 172.21.15.100:0/2262756503 shutdown_connections 2024-01-20T08:10:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.636+0000 7fe423200640 1 -- 172.21.15.100:0/2262756503 wait complete. 2024-01-20T08:10:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.637+0000 7fe423200640 1 Processor -- start 2024-01-20T08:10:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.637+0000 7fe423200640 1 -- start start 2024-01-20T08:10:09.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 0x7fe41c14e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 0x7fe41c14e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c1eaee0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c153ed0 con 0x7fe41c147f20 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.638+0000 7fe423200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c152c10 con 0x7fe41c151f60 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57674/0 (socket says 172.21.15.100:57674) 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 -- 172.21.15.100:0/1247665404 learned_addr learned my addr 172.21.15.100:0/1247665404 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe413200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 0x7fe41c14e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe421200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 0x7fe41c14e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 -- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 msgr2=0x7fe41c14e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 0x7fe41c14e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 -- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 msgr2=0x7fe41c14e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 0x7fe41c14e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 -- 172.21.15.100:0/1247665404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe40c009400 con 0x7fe41c0c1b00 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe413200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 0x7fe41c14e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe421200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 0x7fe41c14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.639+0000 7fe41be00640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e790 tx=0x7fe40400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.640+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe404004230 con 0x7fe41c0c1b00 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.640+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe404004390 con 0x7fe41c0c1b00 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.640+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe41c152970 con 0x7fe41c0c1b00 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.640+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40400c8f0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.640+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c154fd0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.641+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c04e970 con 0x7fe41c0c1b00 2024-01-20T08:10:09.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.642+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe40400ca50 con 0x7fe41c0c1b00 2024-01-20T08:10:09.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.643+0000 7fe418c00640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 0x7fe3f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:09.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.643+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe404089370 con 0x7fe41c0c1b00 2024-01-20T08:10:09.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.643+0000 7fe413200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 0x7fe3f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:09.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.643+0000 7fe413200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 0x7fe3f406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe40c036000 tx=0x7fe40c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:09.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.647+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe4040541a0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.846+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c0a94d0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.848+0000 7fe418c00640 1 -- 172.21.15.100:0/1247665404 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fe4040577c0 con 0x7fe41c0c1b00 2024-01-20T08:10:09.851 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:09.851 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 msgr2=0x7fe3f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 0x7fe3f406d390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe40c036000 tx=0x7fe40c03c040 comp rx=0 tx=0).stop 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 msgr2=0x7fe41c1545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe40400e790 tx=0x7fe40400ec50 comp rx=0 tx=0).stop 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 shutdown_connections 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe3f406aed0 0x7fe3f406d390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe41c151f60 0x7fe41c14e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe41c147f20 0x7fe41c14e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 --2- 172.21.15.100:0/1247665404 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe41c0c1b00 0x7fe41c1545d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:09.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 >> 172.21.15.100:0/1247665404 conn(0x7fe41c06a5e0 msgr2=0x7fe41c151130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:09.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 shutdown_connections 2024-01-20T08:10:09.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:09.851+0000 7fe423200640 1 -- 172.21.15.100:0/1247665404 wait complete. 2024-01-20T08:10:09.873 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T08:10:10.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.078+0000 7f12c9600640 1 Processor -- start 2024-01-20T08:10:10.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.078+0000 7f12c9600640 1 -- start start 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12c9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12c40c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12c9600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c4158b80 con 0x7f12c40c4880 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12c9600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12c4157c90 con 0x7f12c40c4ce0 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12c9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4152170 con 0x7f12c4151d90 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12bbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f12c40c4880 0x7f12c4154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55500/0 (socket says 172.21.15.100:55500) 2024-01-20T08:10:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.080+0000 7f12bbe00640 1 -- 172.21.15.100:0/2468052852 learned_addr learned my addr 172.21.15.100:0/2468052852 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:10.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3e00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12c40c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112074568 0 0) 0x7f12c4158b80 con 0x7f12c40c4880 2024-01-20T08:10:10.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12a4003520 con 0x7f12c40c4880 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1440253333 0 0) 0x7f12a4003520 con 0x7f12c40c4880 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 msgr2=0x7f12c40c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12c40c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 >> v1:172.21.15.110:6789/0 conn(0x7f12c40c4ce0 legacy=0x7f12c4155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c4157f70 con 0x7f12c40c4880 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f12ac001670 con 0x7f12c40c4880 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 >> v1:172.21.15.100:6789/0 conn(0x7f12c40c4880 legacy=0x7f12c4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40039a0 0x7f12a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12a40047c0 0x7f12a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12a40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c4152170 con 0x7f12a40047c0 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a400bab0 con 0x7f12a40039a0 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.081+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a400bc70 con 0x7f12c4151d90 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12a40047c0 0x7f12a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12c3e00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40039a0 0x7f12a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12c8c00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12a40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 -- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 msgr2=0x7f12a40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c4151d90 0x7f12a40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 -- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40039a0 msgr2=0x7f12a4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40039a0 0x7f12a4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.082+0000 7f12bbe00640 1 -- 172.21.15.100:0/2468052852 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a4003520 con 0x7f12a40047c0 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.083+0000 7f12bbe00640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12a40047c0 0x7f12a4004c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c240 tx=0x7f12a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973155a1f31855c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.083+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac005ad0 con 0x7f12a40047c0 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.083+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12ac005c50 con 0x7f12a40047c0 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.083+0000 7f12c3400640 1 -- 172.21.15.100:0/2468052852 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12ac02c8b0 con 0x7f12a40047c0 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 -- 172.21.15.100:0/2468052852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12a40047c0 msgr2=0x7f12a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 --2- 172.21.15.100:0/2468052852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12a40047c0 0x7f12a4004c40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00c240 tx=0x7f12a40057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c8c00640 1 -- 172.21.15.100:0/2468052852 reap_dead start 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 -- 172.21.15.100:0/2468052852 shutdown_connections 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 -- 172.21.15.100:0/2468052852 >> 172.21.15.100:0/2468052852 conn(0x7f12c4071ef0 msgr2=0x7f12c4072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 -- 172.21.15.100:0/2468052852 shutdown_connections 2024-01-20T08:10:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.084+0000 7f12c9600640 1 -- 172.21.15.100:0/2468052852 wait complete. 2024-01-20T08:10:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.086+0000 7f12c9600640 1 Processor -- start 2024-01-20T08:10:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.086+0000 7f12c9600640 1 -- start start 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40047c0 0x7f12c4156560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c414e550 0x7f12c41ed490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40afc30 con 0x7f12c414de70 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40acb40 con 0x7f12a40047c0 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12c40ad020 con 0x7f12c414e550 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57684/0 (socket says 172.21.15.100:57684) 2024-01-20T08:10:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 -- 172.21.15.100:0/2467380625 learned_addr learned my addr 172.21.15.100:0/2467380625 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 -- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c414e550 msgr2=0x7f12c41ed490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c414e550 0x7f12c41ed490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 -- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40047c0 msgr2=0x7f12c4156560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40047c0 0x7f12c4156560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.087+0000 7f12c8c00640 1 -- 172.21.15.100:0/2467380625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c40acd90 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c8c00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12c40c0f80 tx=0x7f12bc00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003970 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12bc003af0 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12bc003ea0 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12c40af950 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.088+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12c41edf10 con 0x7f12c414de70 2024-01-20T08:10:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.089+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12c41ed010 con 0x7f12c414de70 2024-01-20T08:10:10.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.090+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f12bc0050d0 con 0x7f12c414de70 2024-01-20T08:10:10.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.091+0000 7f12c0c00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 0x7f129c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:10.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.091+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12bc0893f0 con 0x7f12c414de70 2024-01-20T08:10:10.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.091+0000 7f12c3e00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 0x7f129c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:10.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.092+0000 7f12c3e00640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 0x7f129c06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009910 tx=0x7f12b4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.095+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f12c41ed010 con 0x7f12c414de70 2024-01-20T08:10:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.327+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f12c41ed010 con 0x7f12c414de70 2024-01-20T08:10:11.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:10.999+0000 7f12c0c00640 1 -- 172.21.15.100:0/2467380625 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f12c41ed010 con 0x7f12c414de70 2024-01-20T08:10:11.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 msgr2=0x7f129c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 0x7f129c06d390 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f12b4009910 tx=0x7f12b4008040 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 msgr2=0x7f12c41ed9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f12c40c0f80 tx=0x7f12bc00ec10 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 shutdown_connections 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f12c414de70 0x7f12c41ed9d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f129c06aed0 0x7f129c06d390 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f12c414e550 0x7f12c41ed490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 --2- 172.21.15.100:0/2467380625 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f12a40047c0 0x7f12c4156560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 >> 172.21.15.100:0/2467380625 conn(0x7f12c4071ef0 msgr2=0x7f12c40c81d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:11.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.004+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 shutdown_connections 2024-01-20T08:10:11.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.005+0000 7f12c9600640 1 -- 172.21.15.100:0/2467380625 wait complete. 2024-01-20T08:10:11.027 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:10:11.027 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T08:10:11.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.234+0000 7f13bd200640 1 Processor -- start 2024-01-20T08:10:11.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.234+0000 7f13bd200640 1 -- start start 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.235+0000 7f13bd200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13b8151d50 0x7f13b81551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.235+0000 7f13bd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b5a0 0x7f13b80c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13bd200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b80c5880 con 0x7f13b806b140 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13bd200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b806ba10 con 0x7f13b8151d50 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13bd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c4a60 con 0x7f13b806b5a0 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13b8151d50 0x7f13b81551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13b8151d50 0x7f13b81551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57698/0 (socket says 172.21.15.100:57698) 2024-01-20T08:10:11.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 -- 172.21.15.100:0/3291762186 learned_addr learned my addr 172.21.15.100:0/3291762186 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 -- 172.21.15.100:0/3291762186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b5a0 msgr2=0x7f13b80c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 --2- 172.21.15.100:0/3291762186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b5a0 0x7f13b80c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 -- 172.21.15.100:0/3291762186 >> v1:172.21.15.110:6789/0 conn(0x7f13b806b140 legacy=0x7f13b80c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:11.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.236+0000 7f13b5e00640 1 -- 172.21.15.100:0/3291762186 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b80c9a40 con 0x7f13b8151d50 2024-01-20T08:10:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.238+0000 7f13b5e00640 1 --2- 172.21.15.100:0/3291762186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b81551e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009e50 tx=0x7f13a802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ac4c1490bc9efdd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:11.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.238+0000 7f13b4a00640 1 -- 172.21.15.100:0/3291762186 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a802c9e0 con 0x7f13b8151d50 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.238+0000 7f13b4a00640 1 -- 172.21.15.100:0/3291762186 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a802cb40 con 0x7f13b8151d50 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.238+0000 7f13b4a00640 1 -- 172.21.15.100:0/3291762186 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a80343f0 con 0x7f13b8151d50 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 -- 172.21.15.100:0/3291762186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 msgr2=0x7f13b81551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 --2- 172.21.15.100:0/3291762186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b81551e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f13a8009e50 tx=0x7f13a802be40 comp rx=0 tx=0).stop 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 -- 172.21.15.100:0/3291762186 shutdown_connections 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 --2- 172.21.15.100:0/3291762186 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b5a0 0x7f13b80c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 --2- 172.21.15.100:0/3291762186 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b81551e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 -- 172.21.15.100:0/3291762186 >> 172.21.15.100:0/3291762186 conn(0x7f13b80ca0e0 msgr2=0x7f13b80ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 -- 172.21.15.100:0/3291762186 shutdown_connections 2024-01-20T08:10:11.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.239+0000 7f13bd200640 1 -- 172.21.15.100:0/3291762186 wait complete. 2024-01-20T08:10:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.241+0000 7f13bd200640 1 Processor -- start 2024-01-20T08:10:11.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.241+0000 7f13bd200640 1 -- start start 2024-01-20T08:10:11.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b140 0x7f13b814ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13b806b5a0 0x7f13b81545e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c0a40 con 0x7f13b8151d50 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80c1630 con 0x7f13b806b5a0 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13bd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b81580f0 con 0x7f13b806b140 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57710/0 (socket says 172.21.15.100:57710) 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.242+0000 7f13b6800640 1 -- 172.21.15.100:0/2404184416 learned_addr learned my addr 172.21.15.100:0/2404184416 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b5400640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13b806b5a0 0x7f13b81545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b5e00640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b140 0x7f13b814ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 -- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b140 msgr2=0x7f13b814ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b140 0x7f13b814ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 -- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13b806b5a0 msgr2=0x7f13b81545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13b806b5a0 0x7f13b81545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 -- 172.21.15.100:0/2404184416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a8009b30 con 0x7f13b8151d50 2024-01-20T08:10:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13b6800640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b450 tx=0x7f13b000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:11.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0011890 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b00119f0 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b0011d80 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.243+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b80c1350 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.244+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b814d3d0 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.245+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b80c1b50 con 0x7f13b8151d50 2024-01-20T08:10:11.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.246+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f13b001a400 con 0x7f13b8151d50 2024-01-20T08:10:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.247+0000 7f13ae000640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 0x7f139006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.247+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13b0089940 con 0x7f13b8151d50 2024-01-20T08:10:11.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.248+0000 7f13b5e00640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 0x7f139006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:11.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.248+0000 7f13b5e00640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 0x7f139006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13a8035000 tx=0x7f13a8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:11.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.252+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f13b80c1b50 con 0x7f13b8151d50 2024-01-20T08:10:11.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:11.484+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13b80c3620 con 0x7f13b8151d50 2024-01-20T08:10:12.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.009+0000 7f13ae000640 1 -- 172.21.15.100:0/2404184416 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13b80c3620 con 0x7f13b8151d50 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 msgr2=0x7f139006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 0x7f139006d3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13a8035000 tx=0x7f13a8030000 comp rx=0 tx=0).stop 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 msgr2=0x7f13b80c3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f13b000b450 tx=0x7f13b000b910 comp rx=0 tx=0).stop 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 shutdown_connections 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13b8151d50 0x7f13b80c3900 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f13b806b5a0 0x7f13b81545e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f139006af00 0x7f139006d3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 --2- 172.21.15.100:0/2404184416 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f13b806b140 0x7f13b814ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 >> 172.21.15.100:0/2404184416 conn(0x7f13b80ca0e0 msgr2=0x7f13b81501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 shutdown_connections 2024-01-20T08:10:12.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.013+0000 7f13bd200640 1 -- 172.21.15.100:0/2404184416 wait complete. 2024-01-20T08:10:12.038 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T08:10:12.039 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:12.169 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-01-20T08:10:12.166+0000 7f33e8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:10:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.239+0000 7f983b200640 1 Processor -- start 2024-01-20T08:10:12.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.239+0000 7f983b200640 1 -- start start 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.240+0000 7f983b200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9834147f20 0x7f98340abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.240+0000 7f983b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9834070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.240+0000 7f983b200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98340c1670 con 0x7f98340c1b00 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.240+0000 7f983b200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98341524b0 con 0x7f9834147f20 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.240+0000 7f983b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c0d40 con 0x7f9834151f60 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9839200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f98340c1b00 0x7f98340c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55502/0 (socket says 172.21.15.100:55502) 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9839200640 1 -- 172.21.15.100:0/2909685069 learned_addr learned my addr 172.21.15.100:0/2909685069 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833e00640 1 --2- 172.21.15.100:0/2909685069 >> v2:172.21.15.110:3300/0 conn(0x7f9834147f20 0x7f98340abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f982b200640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9834070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2333755900 0 0) 0x7f98340c1670 con 0x7f98340c1b00 2024-01-20T08:10:12.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9814003520 con 0x7f98340c1b00 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1178274996 0 0) 0x7f9814003520 con 0x7f98340c1b00 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 msgr2=0x7f9834070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.241+0000 7f9833400640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9834070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 >> v2:172.21.15.110:3300/0 conn(0x7f9834147f20 msgr2=0x7f98340abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 --2- 172.21.15.100:0/2909685069 >> v2:172.21.15.110:3300/0 conn(0x7f9834147f20 0x7f98340abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340c1020 con 0x7f98340c1b00 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f982c0019f0 con 0x7f98340c1b00 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 >> v1:172.21.15.100:6789/0 conn(0x7f98340c1b00 legacy=0x7f98340c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9814003970 0x7f9814003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9814005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98341524b0 con 0x7f9814003970 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c0d40 con 0x7f98140047c0 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f981400db90 con 0x7f9834151f60 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833e00640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9814003970 0x7f9814003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f982b200640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9839200640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9814005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833e00640 1 -- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 msgr2=0x7f9814005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833e00640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9834151f60 0x7f9814005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.242+0000 7f9833e00640 1 -- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98140047c0 msgr2=0x7f9814004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.243+0000 7f9833e00640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f98140047c0 0x7f9814004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.243+0000 7f9833e00640 1 -- 172.21.15.100:0/2909685069 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9814003520 con 0x7f9814003970 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.244+0000 7f9833e00640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9814003970 0x7f9814003d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9824009ac0 tx=0x7f98140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43539bf13ef8b252 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.244+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402c710 con 0x7f9814003970 2024-01-20T08:10:12.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.244+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982402c870 con 0x7f9814003970 2024-01-20T08:10:12.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.244+0000 7f9833400640 1 -- 172.21.15.100:0/2909685069 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982402cc00 con 0x7f9814003970 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 -- 172.21.15.100:0/2909685069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9814003970 msgr2=0x7f9814003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 --2- 172.21.15.100:0/2909685069 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9814003970 0x7f9814003d90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9824009ac0 tx=0x7f98140057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f9839200640 1 -- 172.21.15.100:0/2909685069 reap_dead start 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 -- 172.21.15.100:0/2909685069 shutdown_connections 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 -- 172.21.15.100:0/2909685069 >> 172.21.15.100:0/2909685069 conn(0x7f983406a5e0 msgr2=0x7f983406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 -- 172.21.15.100:0/2909685069 shutdown_connections 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.245+0000 7f983b200640 1 -- 172.21.15.100:0/2909685069 wait complete. 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.247+0000 7f983b200640 1 Processor -- start 2024-01-20T08:10:12.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.247+0000 7f983b200640 1 -- start start 2024-01-20T08:10:12.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 0x7f98341e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98341e7960 0x7f98341e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9834141d30 con 0x7f98340bffe0 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98340c4690 con 0x7f9814003970 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f983b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98341ea9a0 con 0x7f98341e7960 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57716/0 (socket says 172.21.15.100:57716) 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 -- 172.21.15.100:0/1629049394 learned_addr learned my addr 172.21.15.100:0/1629049394 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9833e00640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 0x7f98341e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 -- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98341e7960 msgr2=0x7f98341e9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f982b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98341e7960 0x7f98341e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98341e7960 0x7f98341e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 -- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 msgr2=0x7f98341e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 0x7f98341e7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9839200640 1 -- 172.21.15.100:0/1629049394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98340c48f0 con 0x7f98340bffe0 2024-01-20T08:10:12.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.248+0000 7f9833e00640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 0x7f98341e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f9839200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f982c0013d0 tx=0x7f982c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c007a80 con 0x7f98340bffe0 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00ee20 con 0x7f98340bffe0 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c013660 con 0x7f98340bffe0 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98340c4bd0 con 0x7f98340bffe0 2024-01-20T08:10:12.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.249+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98340c5190 con 0x7f98340bffe0 2024-01-20T08:10:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.250+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98340c5320 con 0x7f98340bffe0 2024-01-20T08:10:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.251+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f982c0137c0 con 0x7f98340bffe0 2024-01-20T08:10:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.252+0000 7f9830c00640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 0x7f980c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.252+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f982c089c10 con 0x7f98340bffe0 2024-01-20T08:10:12.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.252+0000 7f9833e00640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 0x7f980c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.253+0000 7f9833e00640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 0x7f980c06d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9824036000 tx=0x7f9824030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.256+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f982c054a40 con 0x7f98340bffe0 2024-01-20T08:10:12.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.488+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98340a91b0 con 0x7f98340bffe0 2024-01-20T08:10:12.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.489+0000 7f9830c00640 1 -- 172.21.15.100:0/1629049394 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f982c058060 con 0x7f98340bffe0 2024-01-20T08:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:12.492 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:12.492 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:12.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 msgr2=0x7f980c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 0x7f980c06d390 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9824036000 tx=0x7f9824030000 comp rx=0 tx=0).stop 2024-01-20T08:10:12.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 msgr2=0x7f98341ea460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f982c0013d0 tx=0x7f982c00e530 comp rx=0 tx=0).stop 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 shutdown_connections 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98340bffe0 0x7f98341ea460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f980c06aed0 0x7f980c06d390 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98341e7960 0x7f98341e9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 --2- 172.21.15.100:0/1629049394 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9814003970 0x7f98341e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 >> 172.21.15.100:0/1629049394 conn(0x7f983406a5e0 msgr2=0x7f9834146c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.491+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 shutdown_connections 2024-01-20T08:10:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.492+0000 7f983b200640 1 -- 172.21.15.100:0/1629049394 wait complete. 2024-01-20T08:10:12.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:12.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.701+0000 7fb943e00640 1 Processor -- start 2024-01-20T08:10:12.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.701+0000 7fb943e00640 1 -- start start 2024-01-20T08:10:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.702+0000 7fb943e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb94414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.702+0000 7fb943e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb94406dd90 0x7fb94414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.702+0000 7fb943e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9440c1720 con 0x7fb9440c3240 2024-01-20T08:10:12.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.702+0000 7fb943e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9440c20a0 con 0x7fb94406dd90 2024-01-20T08:10:12.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.702+0000 7fb943e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb94406c7c0 con 0x7fb944072320 2024-01-20T08:10:12.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb943400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb9440c3240 0x7fb944155b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55506/0 (socket says 172.21.15.100:55506) 2024-01-20T08:10:12.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb943400640 1 -- 172.21.15.100:0/3561927399 learned_addr learned my addr 172.21.15.100:0/3561927399 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:12.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942a00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb94414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb939e00640 1 --2- 172.21.15.100:0/3561927399 >> v2:172.21.15.110:3300/0 conn(0x7fb94406dd90 0x7fb94414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215377319 0 0) 0x7fb9440c1720 con 0x7fb9440c3240 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb924003520 con 0x7fb9440c3240 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1749018110 0 0) 0x7fb924003520 con 0x7fb9440c3240 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 msgr2=0x7fb94414f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.703+0000 7fb942000640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb94414f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 >> v2:172.21.15.110:3300/0 conn(0x7fb94406dd90 msgr2=0x7fb94414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 --2- 172.21.15.100:0/3561927399 >> v2:172.21.15.110:3300/0 conn(0x7fb94406dd90 0x7fb94414fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9440a4f30 con 0x7fb9440c3240 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fb93c0019f0 con 0x7fb9440c3240 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 >> v1:172.21.15.100:6789/0 conn(0x7fb9440c3240 legacy=0x7fb944155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924003970 0x7fb924003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb924004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb924005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9440c20a0 con 0x7fb9240047c0 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92400b980 con 0x7fb924003970 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92400bac0 con 0x7fb944072320 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb924004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb942a00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924003970 0x7fb924003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb943400640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb924005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 -- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 msgr2=0x7fb924005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb924005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 -- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924003970 msgr2=0x7fb924003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb924003970 0x7fb924003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb939e00640 1 -- 172.21.15.100:0/3561927399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb924003520 con 0x7fb9240047c0 2024-01-20T08:10:12.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.704+0000 7fb943400640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb944072320 0x7fb924005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.705+0000 7fb939e00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb924004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009ac0 tx=0x7fb9240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9761551790b0061d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02c6d0 con 0x7fb9240047c0 2024-01-20T08:10:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb92c02c830 con 0x7fb9240047c0 2024-01-20T08:10:12.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb942000640 1 -- 172.21.15.100:0/3561927399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb92c02cbc0 con 0x7fb9240047c0 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943e00640 1 -- 172.21.15.100:0/3561927399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 msgr2=0x7fb924004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943e00640 1 --2- 172.21.15.100:0/3561927399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb924004c40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb92c009ac0 tx=0x7fb9240057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943400640 1 -- 172.21.15.100:0/3561927399 reap_dead start 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943e00640 1 -- 172.21.15.100:0/3561927399 shutdown_connections 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943e00640 1 -- 172.21.15.100:0/3561927399 >> 172.21.15.100:0/3561927399 conn(0x7fb9440c2590 msgr2=0x7fb9440c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.706+0000 7fb943e00640 1 -- 172.21.15.100:0/3561927399 shutdown_connections 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.707+0000 7fb943e00640 1 -- 172.21.15.100:0/3561927399 wait complete. 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.708+0000 7fb943e00640 1 Processor -- start 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.708+0000 7fb943e00640 1 -- start start 2024-01-20T08:10:12.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9440c0d70 0x7fb944071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9441eda40 0x7fb9440719d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9440bfa30 con 0x7fb9240047c0 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9441447c0 con 0x7fb9441eda40 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb943e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb944144a10 con 0x7fb9440c0d70 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb942a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.709+0000 7fb942a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57728/0 (socket says 172.21.15.100:57728) 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 -- 172.21.15.100:0/2006373325 learned_addr learned my addr 172.21.15.100:0/2006373325 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb943400640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9441eda40 0x7fb9440719d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb939e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9440c0d70 0x7fb944071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 -- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9440c0d70 msgr2=0x7fb944071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9440c0d70 0x7fb944071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 -- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9441eda40 msgr2=0x7fb9440719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9441eda40 0x7fb9440719d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 -- 172.21.15.100:0/2006373325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9441edf80 con 0x7fb9240047c0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb942a00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb934011630 tx=0x7fb934011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400f8c0 con 0x7fb9240047c0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb93400fa20 con 0x7fb9240047c0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb93400fd90 con 0x7fb9240047c0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.710+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9440bfe50 con 0x7fb9240047c0 2024-01-20T08:10:12.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.711+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb944144cf0 con 0x7fb9240047c0 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.712+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9440bf7b0 con 0x7fb9240047c0 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.713+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb934015460 con 0x7fb9240047c0 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.713+0000 7fb93b400640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.714+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb934089d60 con 0x7fb9240047c0 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.714+0000 7fb939e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:12.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.714+0000 7fb939e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 0x7fb91c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb92c036000 tx=0x7fb92c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:12.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.718+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb934054c20 con 0x7fb9240047c0 2024-01-20T08:10:12.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.909+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb94414ffd0 con 0x7fb9240047c0 2024-01-20T08:10:12.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.911+0000 7fb93b400640 1 -- 172.21.15.100:0/2006373325 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fb934058240 con 0x7fb9240047c0 2024-01-20T08:10:12.914 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:12.914 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 msgr2=0x7fb91c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 0x7fb91c06d3c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb92c036000 tx=0x7fb92c030000 comp rx=0 tx=0).stop 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 msgr2=0x7fb9441ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fb934011630 tx=0x7fb934011af0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 shutdown_connections 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb9441eda40 0x7fb9440719d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb91c06af00 0x7fb91c06d3c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9440c0d70 0x7fb944071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 --2- 172.21.15.100:0/2006373325 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9240047c0 0x7fb9441ed500 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:12.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 >> 172.21.15.100:0/2006373325 conn(0x7fb9440c2590 msgr2=0x7fb94414d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:12.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 shutdown_connections 2024-01-20T08:10:12.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:12.914+0000 7fb943e00640 1 -- 172.21.15.100:0/2006373325 wait complete. 2024-01-20T08:10:12.935 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:10:12.935 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:10:13.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.133+0000 7f510f400640 1 Processor -- start 2024-01-20T08:10:13.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.134+0000 7f510f400640 1 -- start start 2024-01-20T08:10:13.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51080ac440 0x7f51081526e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510f400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080ad510 con 0x7f51081555b0 2024-01-20T08:10:13.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510f400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51080ac990 con 0x7f5108153fb0 2024-01-20T08:10:13.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510f400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51080acc70 con 0x7f51080ac440 2024-01-20T08:10:13.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510ca00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f51081555b0 0x7f51080c8450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55516/0 (socket says 172.21.15.100:55516) 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.135+0000 7f510ca00640 1 -- 172.21.15.100:0/3445243830 learned_addr learned my addr 172.21.15.100:0/3445243830 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107e00640 1 --2- 172.21.15.100:0/3445243830 >> v2:172.21.15.110:3300/0 conn(0x7f51080ac440 0x7f51081526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1541625597 0 0) 0x7f50f8001110 con 0x7f51081555b0 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50e8003520 con 0x7f51081555b0 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2336763197 0 0) 0x7f50e8003520 con 0x7f51081555b0 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 >> v2:172.21.15.110:3300/0 conn(0x7f51080ac440 msgr2=0x7f51081526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 --2- 172.21.15.100:0/3445243830 >> v2:172.21.15.110:3300/0 conn(0x7f51080ac440 0x7f51081526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 >> v1:172.21.15.110:6789/0 conn(0x7f5108153fb0 legacy=0x7f5108154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51080acf50 con 0x7f51081555b0 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f50f8001800 con 0x7f51081555b0 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 >> v1:172.21.15.100:6789/0 conn(0x7f51081555b0 legacy=0x7f51080c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50e8003970 0x7f50e8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e80047c0 0x7f50e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 0x7f50e800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51080acc70 con 0x7f50e8005180 2024-01-20T08:10:13.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e800c020 con 0x7f50e8003970 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e800c1e0 con 0x7f50e80047c0 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.136+0000 7f510d400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 0x7f50e800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f5107e00640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e80047c0 0x7f50e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510d400640 1 -- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e80047c0 msgr2=0x7f50e8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510d400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e80047c0 0x7f50e8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510d400640 1 -- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50e8003970 msgr2=0x7f50e8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510ca00640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50e8003970 0x7f50e8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510d400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50e8003970 0x7f50e8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510d400640 1 -- 172.21.15.100:0/3445243830 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e8003520 con 0x7f50e8005180 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.137+0000 7f510ca00640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50e8003970 0x7f50e8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:13.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.138+0000 7f510d400640 1 -- 172.21.15.100:0/3445243830 reap_dead start 2024-01-20T08:10:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.138+0000 7f510d400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 0x7f50e800b980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5100001750 tx=0x7f50e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3512514336e1c1c0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.138+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51000052d0 con 0x7f50e8005180 2024-01-20T08:10:13.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.138+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f510002e050 con 0x7f50e8005180 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.138+0000 7f5107400640 1 -- 172.21.15.100:0/3445243830 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100003830 con 0x7f50e8005180 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 -- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 msgr2=0x7f50e800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 0x7f50e800b980 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5100001750 tx=0x7f50e80057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 -- 172.21.15.100:0/3445243830 shutdown_connections 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 --2- 172.21.15.100:0/3445243830 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50e8005180 0x7f50e800b980 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 -- 172.21.15.100:0/3445243830 >> 172.21.15.100:0/3445243830 conn(0x7f5108066760 msgr2=0x7f5108066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 -- 172.21.15.100:0/3445243830 shutdown_connections 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.139+0000 7f510f400640 1 -- 172.21.15.100:0/3445243830 wait complete. 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.141+0000 7f510f400640 1 Processor -- start 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.141+0000 7f510f400640 1 -- start start 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.141+0000 7f510f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 0x7f510814a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.141+0000 7f510f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51081edb90 0x7f5108150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510814aae0 con 0x7f51081ee010 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510814d690 con 0x7f51081edb90 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5108152950 con 0x7f50e8005180 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57740/0 (socket says 172.21.15.100:57740) 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 -- 172.21.15.100:0/4023354536 learned_addr learned my addr 172.21.15.100:0/4023354536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510ca00640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 0x7f510814a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 -- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 msgr2=0x7f510814a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 0x7f510814a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 -- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51081edb90 msgr2=0x7f5108150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51081edb90 0x7f5108150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 -- 172.21.15.100:0/4023354536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51081ee540 con 0x7f51081ee010 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510ca00640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 0x7f510814a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:13.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.142+0000 7f510d400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f510002bd00 tx=0x7f5100001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.143+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100039070 con 0x7f51081ee010 2024-01-20T08:10:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.143+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5100007a30 con 0x7f51081ee010 2024-01-20T08:10:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.143+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510814a300 con 0x7f51081ee010 2024-01-20T08:10:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.143+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5100007230 con 0x7f51081ee010 2024-01-20T08:10:13.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.143+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51080708f0 con 0x7f51081ee010 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.144+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5108067b60 con 0x7f51081ee010 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.145+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5100007390 con 0x7f51081ee010 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.146+0000 7f5104c00640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 0x7f50e006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.146+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51000a9a60 con 0x7f51081ee010 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.146+0000 7f510ca00640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 0x7f50e006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.147+0000 7f510ca00640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 0x7f50e006d3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001930 tx=0x7f50f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.151+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5100074b50 con 0x7f51081ee010 2024-01-20T08:10:13.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.323+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f51081524f0 con 0x7f50e006af20 2024-01-20T08:10:13.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.347+0000 7f5104c00640 1 -- 172.21.15.100:0/4023354536 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264443 (secure 0 0 0) 0x7f50f800d040 con 0x7f50e006af20 2024-01-20T08:10:13.354 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:13.356 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.352+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 msgr2=0x7f50e006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.352+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 0x7f50e006d3e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001930 tx=0x7f50f8009040 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.352+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 msgr2=0x7f5108151220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.352+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f510002bd00 tx=0x7f5100001120 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 shutdown_connections 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f51081ee010 0x7f5108151220 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51081edb90 0x7f5108150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50e006af20 0x7f50e006d3e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 --2- 172.21.15.100:0/4023354536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50e8005180 0x7f510814a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 >> 172.21.15.100:0/4023354536 conn(0x7f5108066760 msgr2=0x7f51080a8a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 shutdown_connections 2024-01-20T08:10:13.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.353+0000 7f510f400640 1 -- 172.21.15.100:0/4023354536 wait complete. 2024-01-20T08:10:13.373 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-20T08:10:11.886509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236244,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738476,"statfs":{"total":773094113280,"available":772852199424,"internally_reserved":0,"allocated":3088384,"data_stored":1830660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":80,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.169767"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193298+0000","last_change":"2024-01-20T08:10:08.794516+0000","last_active":"2024-01-20T08:10:10.193298+0000","last_peered":"2024-01-20T08:10:10.193298+0000","last_clean":"2024-01-20T08:10:10.193298+0000","last_became_active":"2024-01-20T08:10:08.794118+0000","last_became_peered":"2024-01-20T08:10:08.794118+0000","last_unstale":"2024-01-20T08:10:10.193298+0000","last_undegraded":"2024-01-20T08:10:10.193298+0000","last_fullsized":"2024-01-20T08:10:10.193298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188560+0000","last_change":"2024-01-20T08:10:08.778488+0000","last_active":"2024-01-20T08:10:10.188560+0000","last_peered":"2024-01-20T08:10:10.188560+0000","last_clean":"2024-01-20T08:10:10.188560+0000","last_became_active":"2024-01-20T08:10:08.778115+0000","last_became_peered":"2024-01-20T08:10:08.778115+0000","last_unstale":"2024-01-20T08:10:10.188560+0000","last_undegraded":"2024-01-20T08:10:10.188560+0000","last_fullsized":"2024-01-20T08:10:10.188560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.783518+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.780866+0000","last_became_peered":"2024-01-20T08:10:08.780866+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188914+0000","last_change":"2024-01-20T08:10:08.783382+0000","last_active":"2024-01-20T08:10:10.188914+0000","last_peered":"2024-01-20T08:10:10.188914+0000","last_clean":"2024-01-20T08:10:10.188914+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.188914+0000","last_undegraded":"2024-01-20T08:10:10.188914+0000","last_fullsized":"2024-01-20T08:10:10.188914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191839+0000","last_change":"2024-01-20T08:10:08.776063+0000","last_active":"2024-01-20T08:10:10.191839+0000","last_peered":"2024-01-20T08:10:10.191839+0000","last_clean":"2024-01-20T08:10:10.191839+0000","last_became_active":"2024-01-20T08:10:08.775617+0000","last_became_peered":"2024-01-20T08:10:08.775617+0000","last_unstale":"2024-01-20T08:10:10.191839+0000","last_undegraded":"2024-01-20T08:10:10.191839+0000","last_fullsized":"2024-01-20T08:10:10.191839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187876+0000","last_change":"2024-01-20T08:10:08.782346+0000","last_active":"2024-01-20T08:10:10.187876+0000","last_peered":"2024-01-20T08:10:10.187876+0000","last_clean":"2024-01-20T08:10:10.187876+0000","last_became_active":"2024-01-20T08:10:08.782015+0000","last_became_peered":"2024-01-20T08:10:08.782015+0000","last_unstale":"2024-01-20T08:10:10.187876+0000","last_undegraded":"2024-01-20T08:10:10.187876+0000","last_fullsized":"2024-01-20T08:10:10.187876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192165+0000","last_change":"2024-01-20T08:10:08.780591+0000","last_active":"2024-01-20T08:10:10.192165+0000","last_peered":"2024-01-20T08:10:10.192165+0000","last_clean":"2024-01-20T08:10:10.192165+0000","last_became_active":"2024-01-20T08:10:08.780333+0000","last_became_peered":"2024-01-20T08:10:08.780333+0000","last_unstale":"2024-01-20T08:10:10.192165+0000","last_undegraded":"2024-01-20T08:10:10.192165+0000","last_fullsized":"2024-01-20T08:10:10.192165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754474+0000","last_change":"2024-01-20T08:10:08.780476+0000","last_active":"2024-01-20T08:10:09.754474+0000","last_peered":"2024-01-20T08:10:09.754474+0000","last_clean":"2024-01-20T08:10:09.754474+0000","last_became_active":"2024-01-20T08:10:08.780055+0000","last_became_peered":"2024-01-20T08:10:08.780055+0000","last_unstale":"2024-01-20T08:10:09.754474+0000","last_undegraded":"2024-01-20T08:10:09.754474+0000","last_fullsized":"2024-01-20T08:10:09.754474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193268+0000","last_change":"2024-01-20T08:10:08.780635+0000","last_active":"2024-01-20T08:10:10.193268+0000","last_peered":"2024-01-20T08:10:10.193268+0000","last_clean":"2024-01-20T08:10:10.193268+0000","last_became_active":"2024-01-20T08:10:08.780253+0000","last_became_peered":"2024-01-20T08:10:08.780253+0000","last_unstale":"2024-01-20T08:10:10.193268+0000","last_undegraded":"2024-01-20T08:10:10.193268+0000","last_fullsized":"2024-01-20T08:10:10.193268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192006+0000","last_change":"2024-01-20T08:10:08.790551+0000","last_active":"2024-01-20T08:10:10.192006+0000","last_peered":"2024-01-20T08:10:10.192006+0000","last_clean":"2024-01-20T08:10:10.192006+0000","last_became_active":"2024-01-20T08:10:08.790180+0000","last_became_peered":"2024-01-20T08:10:08.790180+0000","last_unstale":"2024-01-20T08:10:10.192006+0000","last_undegraded":"2024-01-20T08:10:10.192006+0000","last_fullsized":"2024-01-20T08:10:10.192006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191485+0000","last_change":"2024-01-20T08:10:08.792788+0000","last_active":"2024-01-20T08:10:10.191485+0000","last_peered":"2024-01-20T08:10:10.191485+0000","last_clean":"2024-01-20T08:10:10.191485+0000","last_became_active":"2024-01-20T08:10:08.791594+0000","last_became_peered":"2024-01-20T08:10:08.791594+0000","last_unstale":"2024-01-20T08:10:10.191485+0000","last_undegraded":"2024-01-20T08:10:10.191485+0000","last_fullsized":"2024-01-20T08:10:10.191485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756031+0000","last_change":"2024-01-20T08:10:08.791553+0000","last_active":"2024-01-20T08:10:09.756031+0000","last_peered":"2024-01-20T08:10:09.756031+0000","last_clean":"2024-01-20T08:10:09.756031+0000","last_became_active":"2024-01-20T08:10:08.789326+0000","last_became_peered":"2024-01-20T08:10:08.789326+0000","last_unstale":"2024-01-20T08:10:09.756031+0000","last_undegraded":"2024-01-20T08:10:09.756031+0000","last_fullsized":"2024-01-20T08:10:09.756031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:59.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755024+0000","last_change":"2024-01-20T08:10:08.783923+0000","last_active":"2024-01-20T08:10:09.755024+0000","last_peered":"2024-01-20T08:10:09.755024+0000","last_clean":"2024-01-20T08:10:09.755024+0000","last_became_active":"2024-01-20T08:10:08.783605+0000","last_became_peered":"2024-01-20T08:10:08.783605+0000","last_unstale":"2024-01-20T08:10:09.755024+0000","last_undegraded":"2024-01-20T08:10:09.755024+0000","last_fullsized":"2024-01-20T08:10:09.755024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186481+0000","last_change":"2024-01-20T08:10:08.786608+0000","last_active":"2024-01-20T08:10:10.186481+0000","last_peered":"2024-01-20T08:10:10.186481+0000","last_clean":"2024-01-20T08:10:10.186481+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.186481+0000","last_undegraded":"2024-01-20T08:10:10.186481+0000","last_fullsized":"2024-01-20T08:10:10.186481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187982+0000","last_change":"2024-01-20T08:10:08.790598+0000","last_active":"2024-01-20T08:10:10.187982+0000","last_peered":"2024-01-20T08:10:10.187982+0000","last_clean":"2024-01-20T08:10:10.187982+0000","last_became_active":"2024-01-20T08:10:08.790298+0000","last_became_peered":"2024-01-20T08:10:08.790298+0000","last_unstale":"2024-01-20T08:10:10.187982+0000","last_undegraded":"2024-01-20T08:10:10.187982+0000","last_fullsized":"2024-01-20T08:10:10.187982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187500+0000","last_change":"2024-01-20T08:10:08.782029+0000","last_active":"2024-01-20T08:10:10.187500+0000","last_peered":"2024-01-20T08:10:10.187500+0000","last_clean":"2024-01-20T08:10:10.187500+0000","last_became_active":"2024-01-20T08:10:08.781132+0000","last_became_peered":"2024-01-20T08:10:08.781132+0000","last_unstale":"2024-01-20T08:10:10.187500+0000","last_undegraded":"2024-01-20T08:10:10.187500+0000","last_fullsized":"2024-01-20T08:10:10.187500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190735+0000","last_change":"2024-01-20T08:10:08.787165+0000","last_active":"2024-01-20T08:10:10.190735+0000","last_peered":"2024-01-20T08:10:10.190735+0000","last_clean":"2024-01-20T08:10:10.190735+0000","last_became_active":"2024-01-20T08:10:08.786862+0000","last_became_peered":"2024-01-20T08:10:08.786862+0000","last_unstale":"2024-01-20T08:10:10.190735+0000","last_undegraded":"2024-01-20T08:10:10.190735+0000","last_fullsized":"2024-01-20T08:10:10.190735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758174+0000","last_change":"2024-01-20T08:10:08.795799+0000","last_active":"2024-01-20T08:10:09.758174+0000","last_peered":"2024-01-20T08:10:09.758174+0000","last_clean":"2024-01-20T08:10:09.758174+0000","last_became_active":"2024-01-20T08:10:08.795565+0000","last_became_peered":"2024-01-20T08:10:08.795565+0000","last_unstale":"2024-01-20T08:10:09.758174+0000","last_undegraded":"2024-01-20T08:10:09.758174+0000","last_fullsized":"2024-01-20T08:10:09.758174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190974+0000","last_change":"2024-01-20T08:10:08.772099+0000","last_active":"2024-01-20T08:10:10.190974+0000","last_peered":"2024-01-20T08:10:10.190974+0000","last_clean":"2024-01-20T08:10:10.190974+0000","last_became_active":"2024-01-20T08:10:08.771805+0000","last_became_peered":"2024-01-20T08:10:08.771805+0000","last_unstale":"2024-01-20T08:10:10.190974+0000","last_undegraded":"2024-01-20T08:10:10.190974+0000","last_fullsized":"2024-01-20T08:10:10.190974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190191+0000","last_change":"2024-01-20T08:10:08.797402+0000","last_active":"2024-01-20T08:10:10.190191+0000","last_peered":"2024-01-20T08:10:10.190191+0000","last_clean":"2024-01-20T08:10:10.190191+0000","last_became_active":"2024-01-20T08:10:08.797026+0000","last_became_peered":"2024-01-20T08:10:08.797026+0000","last_unstale":"2024-01-20T08:10:10.190191+0000","last_undegraded":"2024-01-20T08:10:10.190191+0000","last_fullsized":"2024-01-20T08:10:10.190191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186861+0000","last_change":"2024-01-20T08:10:08.796525+0000","last_active":"2024-01-20T08:10:10.186861+0000","last_peered":"2024-01-20T08:10:10.186861+0000","last_clean":"2024-01-20T08:10:10.186861+0000","last_became_active":"2024-01-20T08:10:08.796194+0000","last_became_peered":"2024-01-20T08:10:08.796194+0000","last_unstale":"2024-01-20T08:10:10.186861+0000","last_undegraded":"2024-01-20T08:10:10.186861+0000","last_fullsized":"2024-01-20T08:10:10.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188827+0000","last_change":"2024-01-20T08:10:08.786863+0000","last_active":"2024-01-20T08:10:10.188827+0000","last_peered":"2024-01-20T08:10:10.188827+0000","last_clean":"2024-01-20T08:10:10.188827+0000","last_became_active":"2024-01-20T08:10:08.786412+0000","last_became_peered":"2024-01-20T08:10:08.786412+0000","last_unstale":"2024-01-20T08:10:10.188827+0000","last_undegraded":"2024-01-20T08:10:10.188827+0000","last_fullsized":"2024-01-20T08:10:10.188827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754903+0000","last_change":"2024-01-20T08:10:08.788906+0000","last_active":"2024-01-20T08:10:09.754903+0000","last_peered":"2024-01-20T08:10:09.754903+0000","last_clean":"2024-01-20T08:10:09.754903+0000","last_became_active":"2024-01-20T08:10:08.788531+0000","last_became_peered":"2024-01-20T08:10:08.788531+0000","last_unstale":"2024-01-20T08:10:09.754903+0000","last_undegraded":"2024-01-20T08:10:09.754903+0000","last_fullsized":"2024-01-20T08:10:09.754903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188113+0000","last_change":"2024-01-20T08:10:08.782233+0000","last_active":"2024-01-20T08:10:10.188113+0000","last_peered":"2024-01-20T08:10:10.188113+0000","last_clean":"2024-01-20T08:10:10.188113+0000","last_became_active":"2024-01-20T08:10:08.781895+0000","last_became_peered":"2024-01-20T08:10:08.781895+0000","last_unstale":"2024-01-20T08:10:10.188113+0000","last_undegraded":"2024-01-20T08:10:10.188113+0000","last_fullsized":"2024-01-20T08:10:10.188113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755626+0000","last_change":"2024-01-20T08:10:08.789012+0000","last_active":"2024-01-20T08:10:09.755626+0000","last_peered":"2024-01-20T08:10:09.755626+0000","last_clean":"2024-01-20T08:10:09.755626+0000","last_became_active":"2024-01-20T08:10:08.788686+0000","last_became_peered":"2024-01-20T08:10:08.788686+0000","last_unstale":"2024-01-20T08:10:09.755626+0000","last_undegraded":"2024-01-20T08:10:09.755626+0000","last_fullsized":"2024-01-20T08:10:09.755626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192597+0000","last_change":"2024-01-20T08:10:08.796945+0000","last_active":"2024-01-20T08:10:10.192597+0000","last_peered":"2024-01-20T08:10:10.192597+0000","last_clean":"2024-01-20T08:10:10.192597+0000","last_became_active":"2024-01-20T08:10:08.796510+0000","last_became_peered":"2024-01-20T08:10:08.796510+0000","last_unstale":"2024-01-20T08:10:10.192597+0000","last_undegraded":"2024-01-20T08:10:10.192597+0000","last_fullsized":"2024-01-20T08:10:10.192597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187326+0000","last_change":"2024-01-20T08:10:08.781890+0000","last_active":"2024-01-20T08:10:10.187326+0000","last_peered":"2024-01-20T08:10:10.187326+0000","last_clean":"2024-01-20T08:10:10.187326+0000","last_became_active":"2024-01-20T08:10:08.781584+0000","last_became_peered":"2024-01-20T08:10:08.781584+0000","last_unstale":"2024-01-20T08:10:10.187326+0000","last_undegraded":"2024-01-20T08:10:10.187326+0000","last_fullsized":"2024-01-20T08:10:10.187326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755750+0000","last_change":"2024-01-20T08:10:08.789316+0000","last_active":"2024-01-20T08:10:09.755750+0000","last_peered":"2024-01-20T08:10:09.755750+0000","last_clean":"2024-01-20T08:10:09.755750+0000","last_became_active":"2024-01-20T08:10:08.788713+0000","last_became_peered":"2024-01-20T08:10:08.788713+0000","last_unstale":"2024-01-20T08:10:09.755750+0000","last_undegraded":"2024-01-20T08:10:09.755750+0000","last_fullsized":"2024-01-20T08:10:09.755750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187162+0000","last_change":"2024-01-20T08:10:08.785197+0000","last_active":"2024-01-20T08:10:10.187162+0000","last_peered":"2024-01-20T08:10:10.187162+0000","last_clean":"2024-01-20T08:10:10.187162+0000","last_became_active":"2024-01-20T08:10:08.784924+0000","last_became_peered":"2024-01-20T08:10:08.784924+0000","last_unstale":"2024-01-20T08:10:10.187162+0000","last_undegraded":"2024-01-20T08:10:10.187162+0000","last_fullsized":"2024-01-20T08:10:10.187162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188330+0000","last_change":"2024-01-20T08:10:08.783898+0000","last_active":"2024-01-20T08:10:10.188330+0000","last_peered":"2024-01-20T08:10:10.188330+0000","last_clean":"2024-01-20T08:10:10.188330+0000","last_became_active":"2024-01-20T08:10:08.783616+0000","last_became_peered":"2024-01-20T08:10:08.783616+0000","last_unstale":"2024-01-20T08:10:10.188330+0000","last_undegraded":"2024-01-20T08:10:10.188330+0000","last_fullsized":"2024-01-20T08:10:10.188330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757513+0000","last_change":"2024-01-20T08:10:08.777383+0000","last_active":"2024-01-20T08:10:09.757513+0000","last_peered":"2024-01-20T08:10:09.757513+0000","last_clean":"2024-01-20T08:10:09.757513+0000","last_became_active":"2024-01-20T08:10:08.777063+0000","last_became_peered":"2024-01-20T08:10:08.777063+0000","last_unstale":"2024-01-20T08:10:09.757513+0000","last_undegraded":"2024-01-20T08:10:09.757513+0000","last_fullsized":"2024-01-20T08:10:09.757513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188697+0000","last_change":"2024-01-20T08:10:08.786427+0000","last_active":"2024-01-20T08:10:10.188697+0000","last_peered":"2024-01-20T08:10:10.188697+0000","last_clean":"2024-01-20T08:10:10.188697+0000","last_became_active":"2024-01-20T08:10:08.786064+0000","last_became_peered":"2024-01-20T08:10:08.786064+0000","last_unstale":"2024-01-20T08:10:10.188697+0000","last_undegraded":"2024-01-20T08:10:10.188697+0000","last_fullsized":"2024-01-20T08:10:10.188697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755478+0000","last_change":"2024-01-20T08:10:08.779140+0000","last_active":"2024-01-20T08:10:09.755478+0000","last_peered":"2024-01-20T08:10:09.755478+0000","last_clean":"2024-01-20T08:10:09.755478+0000","last_became_active":"2024-01-20T08:10:08.778789+0000","last_became_peered":"2024-01-20T08:10:08.778789+0000","last_unstale":"2024-01-20T08:10:09.755478+0000","last_undegraded":"2024-01-20T08:10:09.755478+0000","last_fullsized":"2024-01-20T08:10:09.755478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755123+0000","last_change":"2024-01-20T08:10:07.773775+0000","last_active":"2024-01-20T08:10:09.755123+0000","last_peered":"2024-01-20T08:10:09.755123+0000","last_clean":"2024-01-20T08:10:09.755123+0000","last_became_active":"2024-01-20T08:10:07.773480+0000","last_became_peered":"2024-01-20T08:10:07.773480+0000","last_unstale":"2024-01-20T08:10:09.755123+0000","last_undegraded":"2024-01-20T08:10:09.755123+0000","last_fullsized":"2024-01-20T08:10:09.755123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187214+0000","last_change":"2024-01-20T08:10:08.789715+0000","last_active":"2024-01-20T08:10:10.187214+0000","last_peered":"2024-01-20T08:10:10.187214+0000","last_clean":"2024-01-20T08:10:10.187214+0000","last_became_active":"2024-01-20T08:10:08.789077+0000","last_became_peered":"2024-01-20T08:10:08.789077+0000","last_unstale":"2024-01-20T08:10:10.187214+0000","last_undegraded":"2024-01-20T08:10:10.187214+0000","last_fullsized":"2024-01-20T08:10:10.187214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189547+0000","last_change":"2024-01-20T08:10:07.779298+0000","last_active":"2024-01-20T08:10:10.189547+0000","last_peered":"2024-01-20T08:10:10.189547+0000","last_clean":"2024-01-20T08:10:10.189547+0000","last_became_active":"2024-01-20T08:10:07.776952+0000","last_became_peered":"2024-01-20T08:10:07.776952+0000","last_unstale":"2024-01-20T08:10:10.189547+0000","last_undegraded":"2024-01-20T08:10:10.189547+0000","last_fullsized":"2024-01-20T08:10:10.189547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754848+0000","last_change":"2024-01-20T08:10:07.771726+0000","last_active":"2024-01-20T08:10:09.754848+0000","last_peered":"2024-01-20T08:10:09.754848+0000","last_clean":"2024-01-20T08:10:09.754848+0000","last_became_active":"2024-01-20T08:10:07.771478+0000","last_became_peered":"2024-01-20T08:10:07.771478+0000","last_unstale":"2024-01-20T08:10:09.754848+0000","last_undegraded":"2024-01-20T08:10:09.754848+0000","last_fullsized":"2024-01-20T08:10:09.754848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754395+0000","last_change":"2024-01-20T08:10:08.778862+0000","last_active":"2024-01-20T08:10:09.754395+0000","last_peered":"2024-01-20T08:10:09.754395+0000","last_clean":"2024-01-20T08:10:09.754395+0000","last_became_active":"2024-01-20T08:10:08.778602+0000","last_became_peered":"2024-01-20T08:10:08.778602+0000","last_unstale":"2024-01-20T08:10:09.754395+0000","last_undegraded":"2024-01-20T08:10:09.754395+0000","last_fullsized":"2024-01-20T08:10:09.754395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187787+0000","last_change":"2024-01-20T08:10:07.782188+0000","last_active":"2024-01-20T08:10:10.187787+0000","last_peered":"2024-01-20T08:10:10.187787+0000","last_clean":"2024-01-20T08:10:10.187787+0000","last_became_active":"2024-01-20T08:10:07.781848+0000","last_became_peered":"2024-01-20T08:10:07.781848+0000","last_unstale":"2024-01-20T08:10:10.187787+0000","last_undegraded":"2024-01-20T08:10:10.187787+0000","last_fullsized":"2024-01-20T08:10:10.187787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187824+0000","last_change":"2024-01-20T08:10:08.771016+0000","last_active":"2024-01-20T08:10:10.187824+0000","last_peered":"2024-01-20T08:10:10.187824+0000","last_clean":"2024-01-20T08:10:10.187824+0000","last_became_active":"2024-01-20T08:10:08.770684+0000","last_became_peered":"2024-01-20T08:10:08.770684+0000","last_unstale":"2024-01-20T08:10:10.187824+0000","last_undegraded":"2024-01-20T08:10:10.187824+0000","last_fullsized":"2024-01-20T08:10:10.187824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192570+0000","last_change":"2024-01-20T08:10:07.783230+0000","last_active":"2024-01-20T08:10:10.192570+0000","last_peered":"2024-01-20T08:10:10.192570+0000","last_clean":"2024-01-20T08:10:10.192570+0000","last_became_active":"2024-01-20T08:10:07.782491+0000","last_became_peered":"2024-01-20T08:10:07.782491+0000","last_unstale":"2024-01-20T08:10:10.192570+0000","last_undegraded":"2024-01-20T08:10:10.192570+0000","last_fullsized":"2024-01-20T08:10:10.192570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190746+0000","last_change":"2024-01-20T08:10:08.790309+0000","last_active":"2024-01-20T08:10:10.190746+0000","last_peered":"2024-01-20T08:10:10.190746+0000","last_clean":"2024-01-20T08:10:10.190746+0000","last_became_active":"2024-01-20T08:10:08.790047+0000","last_became_peered":"2024-01-20T08:10:08.790047+0000","last_unstale":"2024-01-20T08:10:10.190746+0000","last_undegraded":"2024-01-20T08:10:10.190746+0000","last_fullsized":"2024-01-20T08:10:10.190746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190087+0000","last_change":"2024-01-20T08:10:07.786339+0000","last_active":"2024-01-20T08:10:10.190087+0000","last_peered":"2024-01-20T08:10:10.190087+0000","last_clean":"2024-01-20T08:10:10.190087+0000","last_became_active":"2024-01-20T08:10:07.786034+0000","last_became_peered":"2024-01-20T08:10:07.786034+0000","last_unstale":"2024-01-20T08:10:10.190087+0000","last_undegraded":"2024-01-20T08:10:10.190087+0000","last_fullsized":"2024-01-20T08:10:10.190087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188010+0000","last_change":"2024-01-20T08:10:08.792377+0000","last_active":"2024-01-20T08:10:10.188010+0000","last_peered":"2024-01-20T08:10:10.188010+0000","last_clean":"2024-01-20T08:10:10.188010+0000","last_became_active":"2024-01-20T08:10:08.792096+0000","last_became_peered":"2024-01-20T08:10:08.792096+0000","last_unstale":"2024-01-20T08:10:10.188010+0000","last_undegraded":"2024-01-20T08:10:10.188010+0000","last_fullsized":"2024-01-20T08:10:10.188010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187591+0000","last_change":"2024-01-20T08:10:07.782717+0000","last_active":"2024-01-20T08:10:10.187591+0000","last_peered":"2024-01-20T08:10:10.187591+0000","last_clean":"2024-01-20T08:10:10.187591+0000","last_became_active":"2024-01-20T08:10:07.782484+0000","last_became_peered":"2024-01-20T08:10:07.782484+0000","last_unstale":"2024-01-20T08:10:10.187591+0000","last_undegraded":"2024-01-20T08:10:10.187591+0000","last_fullsized":"2024-01-20T08:10:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756143+0000","last_change":"2024-01-20T08:10:08.781928+0000","last_active":"2024-01-20T08:10:09.756143+0000","last_peered":"2024-01-20T08:10:09.756143+0000","last_clean":"2024-01-20T08:10:09.756143+0000","last_became_active":"2024-01-20T08:10:08.781472+0000","last_became_peered":"2024-01-20T08:10:08.781472+0000","last_unstale":"2024-01-20T08:10:09.756143+0000","last_undegraded":"2024-01-20T08:10:09.756143+0000","last_fullsized":"2024-01-20T08:10:09.756143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:26.656512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190465+0000","last_change":"2024-01-20T08:10:07.782772+0000","last_active":"2024-01-20T08:10:10.190465+0000","last_peered":"2024-01-20T08:10:10.190465+0000","last_clean":"2024-01-20T08:10:10.190465+0000","last_became_active":"2024-01-20T08:10:07.780824+0000","last_became_peered":"2024-01-20T08:10:07.780824+0000","last_unstale":"2024-01-20T08:10:10.190465+0000","last_undegraded":"2024-01-20T08:10:10.190465+0000","last_fullsized":"2024-01-20T08:10:10.190465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190013+0000","last_change":"2024-01-20T08:10:08.786404+0000","last_active":"2024-01-20T08:10:10.190013+0000","last_peered":"2024-01-20T08:10:10.190013+0000","last_clean":"2024-01-20T08:10:10.190013+0000","last_became_active":"2024-01-20T08:10:08.786120+0000","last_became_peered":"2024-01-20T08:10:08.786120+0000","last_unstale":"2024-01-20T08:10:10.190013+0000","last_undegraded":"2024-01-20T08:10:10.190013+0000","last_fullsized":"2024-01-20T08:10:10.190013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187474+0000","last_change":"2024-01-20T08:10:07.763023+0000","last_active":"2024-01-20T08:10:10.187474+0000","last_peered":"2024-01-20T08:10:10.187474+0000","last_clean":"2024-01-20T08:10:10.187474+0000","last_became_active":"2024-01-20T08:10:07.762445+0000","last_became_peered":"2024-01-20T08:10:07.762445+0000","last_unstale":"2024-01-20T08:10:10.187474+0000","last_undegraded":"2024-01-20T08:10:10.187474+0000","last_fullsized":"2024-01-20T08:10:10.187474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186810+0000","last_change":"2024-01-20T08:10:08.788158+0000","last_active":"2024-01-20T08:10:10.186810+0000","last_peered":"2024-01-20T08:10:10.186810+0000","last_clean":"2024-01-20T08:10:10.186810+0000","last_became_active":"2024-01-20T08:10:08.787042+0000","last_became_peered":"2024-01-20T08:10:08.787042+0000","last_unstale":"2024-01-20T08:10:10.186810+0000","last_undegraded":"2024-01-20T08:10:10.186810+0000","last_fullsized":"2024-01-20T08:10:10.186810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188550+0000","last_change":"2024-01-20T08:10:07.780955+0000","last_active":"2024-01-20T08:10:10.188550+0000","last_peered":"2024-01-20T08:10:10.188550+0000","last_clean":"2024-01-20T08:10:10.188550+0000","last_became_active":"2024-01-20T08:10:07.780635+0000","last_became_peered":"2024-01-20T08:10:07.780635+0000","last_unstale":"2024-01-20T08:10:10.188550+0000","last_undegraded":"2024-01-20T08:10:10.188550+0000","last_fullsized":"2024-01-20T08:10:10.188550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:54.165646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192151+0000","last_change":"2024-01-20T08:10:08.783000+0000","last_active":"2024-01-20T08:10:10.192151+0000","last_peered":"2024-01-20T08:10:10.192151+0000","last_clean":"2024-01-20T08:10:10.192151+0000","last_became_active":"2024-01-20T08:10:08.782683+0000","last_became_peered":"2024-01-20T08:10:08.782683+0000","last_unstale":"2024-01-20T08:10:10.192151+0000","last_undegraded":"2024-01-20T08:10:10.192151+0000","last_fullsized":"2024-01-20T08:10:10.192151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189278+0000","last_change":"2024-01-20T08:10:07.775311+0000","last_active":"2024-01-20T08:10:10.189278+0000","last_peered":"2024-01-20T08:10:10.189278+0000","last_clean":"2024-01-20T08:10:10.189278+0000","last_became_active":"2024-01-20T08:10:07.771006+0000","last_became_peered":"2024-01-20T08:10:07.771006+0000","last_unstale":"2024-01-20T08:10:10.189278+0000","last_undegraded":"2024-01-20T08:10:10.189278+0000","last_fullsized":"2024-01-20T08:10:10.189278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189142+0000","last_change":"2024-01-20T08:10:08.779813+0000","last_active":"2024-01-20T08:10:10.189142+0000","last_peered":"2024-01-20T08:10:10.189142+0000","last_clean":"2024-01-20T08:10:10.189142+0000","last_became_active":"2024-01-20T08:10:08.778962+0000","last_became_peered":"2024-01-20T08:10:08.778962+0000","last_unstale":"2024-01-20T08:10:10.189142+0000","last_undegraded":"2024-01-20T08:10:10.189142+0000","last_fullsized":"2024-01-20T08:10:10.189142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757296+0000","last_change":"2024-01-20T08:10:07.773757+0000","last_active":"2024-01-20T08:10:09.757296+0000","last_peered":"2024-01-20T08:10:09.757296+0000","last_clean":"2024-01-20T08:10:09.757296+0000","last_became_active":"2024-01-20T08:10:07.773422+0000","last_became_peered":"2024-01-20T08:10:07.773422+0000","last_unstale":"2024-01-20T08:10:09.757296+0000","last_undegraded":"2024-01-20T08:10:09.757296+0000","last_fullsized":"2024-01-20T08:10:09.757296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192502+0000","last_change":"2024-01-20T08:10:08.787377+0000","last_active":"2024-01-20T08:10:10.192502+0000","last_peered":"2024-01-20T08:10:10.192502+0000","last_clean":"2024-01-20T08:10:10.192502+0000","last_became_active":"2024-01-20T08:10:08.787064+0000","last_became_peered":"2024-01-20T08:10:08.787064+0000","last_unstale":"2024-01-20T08:10:10.192502+0000","last_undegraded":"2024-01-20T08:10:10.192502+0000","last_fullsized":"2024-01-20T08:10:10.192502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756111+0000","last_change":"2024-01-20T08:10:07.759594+0000","last_active":"2024-01-20T08:10:09.756111+0000","last_peered":"2024-01-20T08:10:09.756111+0000","last_clean":"2024-01-20T08:10:09.756111+0000","last_became_active":"2024-01-20T08:10:07.759092+0000","last_became_peered":"2024-01-20T08:10:07.759092+0000","last_unstale":"2024-01-20T08:10:09.756111+0000","last_undegraded":"2024-01-20T08:10:09.756111+0000","last_fullsized":"2024-01-20T08:10:09.756111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192462+0000","last_change":"2024-01-20T08:10:08.787171+0000","last_active":"2024-01-20T08:10:10.192462+0000","last_peered":"2024-01-20T08:10:10.192462+0000","last_clean":"2024-01-20T08:10:10.192462+0000","last_became_active":"2024-01-20T08:10:08.786910+0000","last_became_peered":"2024-01-20T08:10:08.786910+0000","last_unstale":"2024-01-20T08:10:10.192462+0000","last_undegraded":"2024-01-20T08:10:10.192462+0000","last_fullsized":"2024-01-20T08:10:10.192462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758344+0000","last_change":"2024-01-20T08:10:07.768872+0000","last_active":"2024-01-20T08:10:09.758344+0000","last_peered":"2024-01-20T08:10:09.758344+0000","last_clean":"2024-01-20T08:10:09.758344+0000","last_became_active":"2024-01-20T08:10:07.768410+0000","last_became_peered":"2024-01-20T08:10:07.768410+0000","last_unstale":"2024-01-20T08:10:09.758344+0000","last_undegraded":"2024-01-20T08:10:09.758344+0000","last_fullsized":"2024-01-20T08:10:09.758344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:31:17.868223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193451+0000","last_change":"2024-01-20T08:10:08.788993+0000","last_active":"2024-01-20T08:10:10.193451+0000","last_peered":"2024-01-20T08:10:10.193451+0000","last_clean":"2024-01-20T08:10:10.193451+0000","last_became_active":"2024-01-20T08:10:08.788676+0000","last_became_peered":"2024-01-20T08:10:08.788676+0000","last_unstale":"2024-01-20T08:10:10.193451+0000","last_undegraded":"2024-01-20T08:10:10.193451+0000","last_fullsized":"2024-01-20T08:10:10.193451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188374+0000","last_change":"2024-01-20T08:10:07.770092+0000","last_active":"2024-01-20T08:10:10.188374+0000","last_peered":"2024-01-20T08:10:10.188374+0000","last_clean":"2024-01-20T08:10:10.188374+0000","last_became_active":"2024-01-20T08:10:07.769349+0000","last_became_peered":"2024-01-20T08:10:07.769349+0000","last_unstale":"2024-01-20T08:10:10.188374+0000","last_undegraded":"2024-01-20T08:10:10.188374+0000","last_fullsized":"2024-01-20T08:10:10.188374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188541+0000","last_change":"2024-01-20T08:10:08.780078+0000","last_active":"2024-01-20T08:10:10.188541+0000","last_peered":"2024-01-20T08:10:10.188541+0000","last_clean":"2024-01-20T08:10:10.188541+0000","last_became_active":"2024-01-20T08:10:08.778811+0000","last_became_peered":"2024-01-20T08:10:08.778811+0000","last_unstale":"2024-01-20T08:10:10.188541+0000","last_undegraded":"2024-01-20T08:10:10.188541+0000","last_fullsized":"2024-01-20T08:10:10.188541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757909+0000","last_change":"2024-01-20T08:10:07.782606+0000","last_active":"2024-01-20T08:10:09.757909+0000","last_peered":"2024-01-20T08:10:09.757909+0000","last_clean":"2024-01-20T08:10:09.757909+0000","last_became_active":"2024-01-20T08:10:07.782208+0000","last_became_peered":"2024-01-20T08:10:07.782208+0000","last_unstale":"2024-01-20T08:10:09.757909+0000","last_undegraded":"2024-01-20T08:10:09.757909+0000","last_fullsized":"2024-01-20T08:10:09.757909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190352+0000","last_change":"2024-01-20T08:10:08.793744+0000","last_active":"2024-01-20T08:10:10.190352+0000","last_peered":"2024-01-20T08:10:10.190352+0000","last_clean":"2024-01-20T08:10:10.190352+0000","last_became_active":"2024-01-20T08:10:08.793434+0000","last_became_peered":"2024-01-20T08:10:08.793434+0000","last_unstale":"2024-01-20T08:10:10.190352+0000","last_undegraded":"2024-01-20T08:10:10.190352+0000","last_fullsized":"2024-01-20T08:10:10.190352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T08:10:08.753995+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:10:08.753995+0000","last_peered":"2024-01-20T08:10:08.753995+0000","last_clean":"2024-01-20T08:10:08.753995+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:10:08.753995+0000","last_undegraded":"2024-01-20T08:10:08.753995+0000","last_fullsized":"2024-01-20T08:10:08.753995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187608+0000","last_change":"2024-01-20T08:10:07.781232+0000","last_active":"2024-01-20T08:10:10.187608+0000","last_peered":"2024-01-20T08:10:10.187608+0000","last_clean":"2024-01-20T08:10:10.187608+0000","last_became_active":"2024-01-20T08:10:07.780629+0000","last_became_peered":"2024-01-20T08:10:07.780629+0000","last_unstale":"2024-01-20T08:10:10.187608+0000","last_undegraded":"2024-01-20T08:10:10.187608+0000","last_fullsized":"2024-01-20T08:10:10.187608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755289+0000","last_change":"2024-01-20T08:10:08.780899+0000","last_active":"2024-01-20T08:10:09.755289+0000","last_peered":"2024-01-20T08:10:09.755289+0000","last_clean":"2024-01-20T08:10:09.755289+0000","last_became_active":"2024-01-20T08:10:08.780569+0000","last_became_peered":"2024-01-20T08:10:08.780569+0000","last_unstale":"2024-01-20T08:10:09.755289+0000","last_undegraded":"2024-01-20T08:10:09.755289+0000","last_fullsized":"2024-01-20T08:10:09.755289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188706+0000","last_change":"2024-01-20T08:10:07.772607+0000","last_active":"2024-01-20T08:10:10.188706+0000","last_peered":"2024-01-20T08:10:10.188706+0000","last_clean":"2024-01-20T08:10:10.188706+0000","last_became_active":"2024-01-20T08:10:07.772327+0000","last_became_peered":"2024-01-20T08:10:07.772327+0000","last_unstale":"2024-01-20T08:10:10.188706+0000","last_undegraded":"2024-01-20T08:10:10.188706+0000","last_fullsized":"2024-01-20T08:10:10.188706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186426+0000","last_change":"2024-01-20T08:10:08.789696+0000","last_active":"2024-01-20T08:10:10.186426+0000","last_peered":"2024-01-20T08:10:10.186426+0000","last_clean":"2024-01-20T08:10:10.186426+0000","last_became_active":"2024-01-20T08:10:08.789380+0000","last_became_peered":"2024-01-20T08:10:08.789380+0000","last_unstale":"2024-01-20T08:10:10.186426+0000","last_undegraded":"2024-01-20T08:10:10.186426+0000","last_fullsized":"2024-01-20T08:10:10.186426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757606+0000","last_change":"2024-01-20T08:10:07.770872+0000","last_active":"2024-01-20T08:10:09.757606+0000","last_peered":"2024-01-20T08:10:09.757606+0000","last_clean":"2024-01-20T08:10:09.757606+0000","last_became_active":"2024-01-20T08:10:07.770607+0000","last_became_peered":"2024-01-20T08:10:07.770607+0000","last_unstale":"2024-01-20T08:10:09.757606+0000","last_undegraded":"2024-01-20T08:10:09.757606+0000","last_fullsized":"2024-01-20T08:10:09.757606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.774148+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.773809+0000","last_became_peered":"2024-01-20T08:10:08.773809+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188851+0000","last_change":"2024-01-20T08:10:07.772528+0000","last_active":"2024-01-20T08:10:10.188851+0000","last_peered":"2024-01-20T08:10:10.188851+0000","last_clean":"2024-01-20T08:10:10.188851+0000","last_became_active":"2024-01-20T08:10:07.769568+0000","last_became_peered":"2024-01-20T08:10:07.769568+0000","last_unstale":"2024-01-20T08:10:10.188851+0000","last_undegraded":"2024-01-20T08:10:10.188851+0000","last_fullsized":"2024-01-20T08:10:10.188851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755908+0000","last_change":"2024-01-20T08:10:08.781307+0000","last_active":"2024-01-20T08:10:09.755908+0000","last_peered":"2024-01-20T08:10:09.755908+0000","last_clean":"2024-01-20T08:10:09.755908+0000","last_became_active":"2024-01-20T08:10:08.779605+0000","last_became_peered":"2024-01-20T08:10:08.779605+0000","last_unstale":"2024-01-20T08:10:09.755908+0000","last_undegraded":"2024-01-20T08:10:09.755908+0000","last_fullsized":"2024-01-20T08:10:09.755908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:02.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188853+0000","last_change":"2024-01-20T08:10:07.771605+0000","last_active":"2024-01-20T08:10:10.188853+0000","last_peered":"2024-01-20T08:10:10.188853+0000","last_clean":"2024-01-20T08:10:10.188853+0000","last_became_active":"2024-01-20T08:10:07.771371+0000","last_became_peered":"2024-01-20T08:10:07.771371+0000","last_unstale":"2024-01-20T08:10:10.188853+0000","last_undegraded":"2024-01-20T08:10:10.188853+0000","last_fullsized":"2024-01-20T08:10:10.188853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190748+0000","last_change":"2024-01-20T08:10:08.784437+0000","last_active":"2024-01-20T08:10:10.190748+0000","last_peered":"2024-01-20T08:10:10.190748+0000","last_clean":"2024-01-20T08:10:10.190748+0000","last_became_active":"2024-01-20T08:10:08.784168+0000","last_became_peered":"2024-01-20T08:10:08.784168+0000","last_unstale":"2024-01-20T08:10:10.190748+0000","last_undegraded":"2024-01-20T08:10:10.190748+0000","last_fullsized":"2024-01-20T08:10:10.190748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191198+0000","last_change":"2024-01-20T08:10:07.774618+0000","last_active":"2024-01-20T08:10:10.191198+0000","last_peered":"2024-01-20T08:10:10.191198+0000","last_clean":"2024-01-20T08:10:10.191198+0000","last_became_active":"2024-01-20T08:10:07.774350+0000","last_became_peered":"2024-01-20T08:10:07.774350+0000","last_unstale":"2024-01-20T08:10:10.191198+0000","last_undegraded":"2024-01-20T08:10:10.191198+0000","last_fullsized":"2024-01-20T08:10:10.191198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188744+0000","last_change":"2024-01-20T08:10:08.774147+0000","last_active":"2024-01-20T08:10:10.188744+0000","last_peered":"2024-01-20T08:10:10.188744+0000","last_clean":"2024-01-20T08:10:10.188744+0000","last_became_active":"2024-01-20T08:10:08.773823+0000","last_became_peered":"2024-01-20T08:10:08.773823+0000","last_unstale":"2024-01-20T08:10:10.188744+0000","last_undegraded":"2024-01-20T08:10:10.188744+0000","last_fullsized":"2024-01-20T08:10:10.188744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188657+0000","last_change":"2024-01-20T08:10:07.774279+0000","last_active":"2024-01-20T08:10:10.188657+0000","last_peered":"2024-01-20T08:10:10.188657+0000","last_clean":"2024-01-20T08:10:10.188657+0000","last_became_active":"2024-01-20T08:10:07.774002+0000","last_became_peered":"2024-01-20T08:10:07.774002+0000","last_unstale":"2024-01-20T08:10:10.188657+0000","last_undegraded":"2024-01-20T08:10:10.188657+0000","last_fullsized":"2024-01-20T08:10:10.188657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755901+0000","last_change":"2024-01-20T08:10:08.775836+0000","last_active":"2024-01-20T08:10:09.755901+0000","last_peered":"2024-01-20T08:10:09.755901+0000","last_clean":"2024-01-20T08:10:09.755901+0000","last_became_active":"2024-01-20T08:10:08.770776+0000","last_became_peered":"2024-01-20T08:10:08.770776+0000","last_unstale":"2024-01-20T08:10:09.755901+0000","last_undegraded":"2024-01-20T08:10:09.755901+0000","last_fullsized":"2024-01-20T08:10:09.755901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192752+0000","last_change":"2024-01-20T08:10:07.777758+0000","last_active":"2024-01-20T08:10:10.192752+0000","last_peered":"2024-01-20T08:10:10.192752+0000","last_clean":"2024-01-20T08:10:10.192752+0000","last_became_active":"2024-01-20T08:10:07.773502+0000","last_became_peered":"2024-01-20T08:10:07.773502+0000","last_unstale":"2024-01-20T08:10:10.192752+0000","last_undegraded":"2024-01-20T08:10:10.192752+0000","last_fullsized":"2024-01-20T08:10:10.192752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186956+0000","last_change":"2024-01-20T08:10:08.782036+0000","last_active":"2024-01-20T08:10:10.186956+0000","last_peered":"2024-01-20T08:10:10.186956+0000","last_clean":"2024-01-20T08:10:10.186956+0000","last_became_active":"2024-01-20T08:10:08.781743+0000","last_became_peered":"2024-01-20T08:10:08.781743+0000","last_unstale":"2024-01-20T08:10:10.186956+0000","last_undegraded":"2024-01-20T08:10:10.186956+0000","last_fullsized":"2024-01-20T08:10:10.186956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188450+0000","last_change":"2024-01-20T08:10:07.775094+0000","last_active":"2024-01-20T08:10:10.188450+0000","last_peered":"2024-01-20T08:10:10.188450+0000","last_clean":"2024-01-20T08:10:10.188450+0000","last_became_active":"2024-01-20T08:10:07.774836+0000","last_became_peered":"2024-01-20T08:10:07.774836+0000","last_unstale":"2024-01-20T08:10:10.188450+0000","last_undegraded":"2024-01-20T08:10:10.188450+0000","last_fullsized":"2024-01-20T08:10:10.188450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755687+0000","last_change":"2024-01-20T08:10:08.785065+0000","last_active":"2024-01-20T08:10:09.755687+0000","last_peered":"2024-01-20T08:10:09.755687+0000","last_clean":"2024-01-20T08:10:09.755687+0000","last_became_active":"2024-01-20T08:10:08.782610+0000","last_became_peered":"2024-01-20T08:10:08.782610+0000","last_unstale":"2024-01-20T08:10:09.755687+0000","last_undegraded":"2024-01-20T08:10:09.755687+0000","last_fullsized":"2024-01-20T08:10:09.755687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188086+0000","last_change":"2024-01-20T08:10:07.770741+0000","last_active":"2024-01-20T08:10:10.188086+0000","last_peered":"2024-01-20T08:10:10.188086+0000","last_clean":"2024-01-20T08:10:10.188086+0000","last_became_active":"2024-01-20T08:10:07.770315+0000","last_became_peered":"2024-01-20T08:10:07.770315+0000","last_unstale":"2024-01-20T08:10:10.188086+0000","last_undegraded":"2024-01-20T08:10:10.188086+0000","last_fullsized":"2024-01-20T08:10:10.188086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754531+0000","last_change":"2024-01-20T08:10:08.775245+0000","last_active":"2024-01-20T08:10:09.754531+0000","last_peered":"2024-01-20T08:10:09.754531+0000","last_clean":"2024-01-20T08:10:09.754531+0000","last_became_active":"2024-01-20T08:10:08.774956+0000","last_became_peered":"2024-01-20T08:10:08.774956+0000","last_unstale":"2024-01-20T08:10:09.754531+0000","last_undegraded":"2024-01-20T08:10:09.754531+0000","last_fullsized":"2024-01-20T08:10:09.754531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188622+0000","last_change":"2024-01-20T08:10:07.772612+0000","last_active":"2024-01-20T08:10:10.188622+0000","last_peered":"2024-01-20T08:10:10.188622+0000","last_clean":"2024-01-20T08:10:10.188622+0000","last_became_active":"2024-01-20T08:10:07.772238+0000","last_became_peered":"2024-01-20T08:10:07.772238+0000","last_unstale":"2024-01-20T08:10:10.188622+0000","last_undegraded":"2024-01-20T08:10:10.188622+0000","last_fullsized":"2024-01-20T08:10:10.188622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755280+0000","last_change":"2024-01-20T08:10:08.780781+0000","last_active":"2024-01-20T08:10:09.755280+0000","last_peered":"2024-01-20T08:10:09.755280+0000","last_clean":"2024-01-20T08:10:09.755280+0000","last_became_active":"2024-01-20T08:10:08.780502+0000","last_became_peered":"2024-01-20T08:10:08.780502+0000","last_unstale":"2024-01-20T08:10:09.755280+0000","last_undegraded":"2024-01-20T08:10:09.755280+0000","last_fullsized":"2024-01-20T08:10:09.755280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192526+0000","last_change":"2024-01-20T08:10:07.769908+0000","last_active":"2024-01-20T08:10:10.192526+0000","last_peered":"2024-01-20T08:10:10.192526+0000","last_clean":"2024-01-20T08:10:10.192526+0000","last_became_active":"2024-01-20T08:10:07.769315+0000","last_became_peered":"2024-01-20T08:10:07.769315+0000","last_unstale":"2024-01-20T08:10:10.192526+0000","last_undegraded":"2024-01-20T08:10:10.192526+0000","last_fullsized":"2024-01-20T08:10:10.192526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189995+0000","last_change":"2024-01-20T08:10:08.789928+0000","last_active":"2024-01-20T08:10:10.189995+0000","last_peered":"2024-01-20T08:10:10.189995+0000","last_clean":"2024-01-20T08:10:10.189995+0000","last_became_active":"2024-01-20T08:10:08.789486+0000","last_became_peered":"2024-01-20T08:10:08.789486+0000","last_unstale":"2024-01-20T08:10:10.189995+0000","last_undegraded":"2024-01-20T08:10:10.189995+0000","last_fullsized":"2024-01-20T08:10:10.189995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190318+0000","last_change":"2024-01-20T08:10:08.788327+0000","last_active":"2024-01-20T08:10:10.190318+0000","last_peered":"2024-01-20T08:10:10.190318+0000","last_clean":"2024-01-20T08:10:10.190318+0000","last_became_active":"2024-01-20T08:10:08.788050+0000","last_became_peered":"2024-01-20T08:10:08.788050+0000","last_unstale":"2024-01-20T08:10:10.190318+0000","last_undegraded":"2024-01-20T08:10:10.190318+0000","last_fullsized":"2024-01-20T08:10:10.190318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192978+0000","last_change":"2024-01-20T08:10:07.783387+0000","last_active":"2024-01-20T08:10:10.192978+0000","last_peered":"2024-01-20T08:10:10.192978+0000","last_clean":"2024-01-20T08:10:10.192978+0000","last_became_active":"2024-01-20T08:10:07.783090+0000","last_became_peered":"2024-01-20T08:10:07.783090+0000","last_unstale":"2024-01-20T08:10:10.192978+0000","last_undegraded":"2024-01-20T08:10:10.192978+0000","last_fullsized":"2024-01-20T08:10:10.192978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188183+0000","last_change":"2024-01-20T08:10:08.788111+0000","last_active":"2024-01-20T08:10:10.188183+0000","last_peered":"2024-01-20T08:10:10.188183+0000","last_clean":"2024-01-20T08:10:10.188183+0000","last_became_active":"2024-01-20T08:10:08.787785+0000","last_became_peered":"2024-01-20T08:10:08.787785+0000","last_unstale":"2024-01-20T08:10:10.188183+0000","last_undegraded":"2024-01-20T08:10:10.188183+0000","last_fullsized":"2024-01-20T08:10:10.188183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190593+0000","last_change":"2024-01-20T08:10:07.773272+0000","last_active":"2024-01-20T08:10:10.190593+0000","last_peered":"2024-01-20T08:10:10.190593+0000","last_clean":"2024-01-20T08:10:10.190593+0000","last_became_active":"2024-01-20T08:10:07.772994+0000","last_became_peered":"2024-01-20T08:10:07.772994+0000","last_unstale":"2024-01-20T08:10:10.190593+0000","last_undegraded":"2024-01-20T08:10:10.190593+0000","last_fullsized":"2024-01-20T08:10:10.190593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187781+0000","last_change":"2024-01-20T08:10:08.792517+0000","last_active":"2024-01-20T08:10:10.187781+0000","last_peered":"2024-01-20T08:10:10.187781+0000","last_clean":"2024-01-20T08:10:10.187781+0000","last_became_active":"2024-01-20T08:10:08.792227+0000","last_became_peered":"2024-01-20T08:10:08.792227+0000","last_unstale":"2024-01-20T08:10:10.187781+0000","last_undegraded":"2024-01-20T08:10:10.187781+0000","last_fullsized":"2024-01-20T08:10:10.187781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755753+0000","last_change":"2024-01-20T08:10:07.753907+0000","last_active":"2024-01-20T08:10:09.755753+0000","last_peered":"2024-01-20T08:10:09.755753+0000","last_clean":"2024-01-20T08:10:09.755753+0000","last_became_active":"2024-01-20T08:10:07.753601+0000","last_became_peered":"2024-01-20T08:10:07.753601+0000","last_unstale":"2024-01-20T08:10:09.755753+0000","last_undegraded":"2024-01-20T08:10:09.755753+0000","last_fullsized":"2024-01-20T08:10:09.755753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:08:42.443428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755706+0000","last_change":"2024-01-20T08:10:08.789390+0000","last_active":"2024-01-20T08:10:09.755706+0000","last_peered":"2024-01-20T08:10:09.755706+0000","last_clean":"2024-01-20T08:10:09.755706+0000","last_became_active":"2024-01-20T08:10:08.789026+0000","last_became_peered":"2024-01-20T08:10:08.789026+0000","last_unstale":"2024-01-20T08:10:09.755706+0000","last_undegraded":"2024-01-20T08:10:09.755706+0000","last_fullsized":"2024-01-20T08:10:09.755706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187992+0000","last_change":"2024-01-20T08:10:07.768390+0000","last_active":"2024-01-20T08:10:10.187992+0000","last_peered":"2024-01-20T08:10:10.187992+0000","last_clean":"2024-01-20T08:10:10.187992+0000","last_became_active":"2024-01-20T08:10:07.768097+0000","last_became_peered":"2024-01-20T08:10:07.768097+0000","last_unstale":"2024-01-20T08:10:10.187992+0000","last_undegraded":"2024-01-20T08:10:10.187992+0000","last_fullsized":"2024-01-20T08:10:10.187992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":827392,"data_stored":671588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3570000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.847}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":80728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":80764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.286}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":80638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0510000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.724}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":835584,"data_stored":671644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:10:13.380 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:10:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.621+0000 7f0bf8c00640 1 Processor -- start 2024-01-20T08:10:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.621+0000 7f0bf8c00640 1 -- start start 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0bf4147f20 0x7f0bf40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0bf4151f60 0x7f0bf4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf40c1b00 0x7f0bf40c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf41524b0 con 0x7f0bf4147f20 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bf40c1670 con 0x7f0bf4151f60 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.622+0000 7f0bf8c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40c0d40 con 0x7f0bf40c1b00 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0bf4147f20 0x7f0bf40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0bf4147f20 0x7f0bf40abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57746/0 (socket says 172.21.15.100:57746) 2024-01-20T08:10:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 -- 172.21.15.100:0/3137817288 learned_addr learned my addr 172.21.15.100:0/3137817288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf2800640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf40c1b00 0x7f0bf40c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bebe00640 1 --2- 172.21.15.100:0/3137817288 >> v2:172.21.15.110:3300/0 conn(0x7f0bf4151f60 0x7f0bf4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 -- 172.21.15.100:0/3137817288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf40c1b00 msgr2=0x7f0bf40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf40c1b00 0x7f0bf40c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 -- 172.21.15.100:0/3137817288 >> v2:172.21.15.110:3300/0 conn(0x7f0bf4151f60 msgr2=0x7f0bf4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3137817288 >> v2:172.21.15.110:3300/0 conn(0x7f0bf4151f60 0x7f0bf4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.623+0000 7f0bf1e00640 1 -- 172.21.15.100:0/3137817288 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf40c1020 con 0x7f0bf4147f20 2024-01-20T08:10:13.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.624+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf40abfd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bf406e550 tx=0x7f0be402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8bdc90a64dbef7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.624+0000 7f0bf1400640 1 -- 172.21.15.100:0/3137817288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4031870 con 0x7f0bf4147f20 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf1400640 1 -- 172.21.15.100:0/3137817288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0be40319d0 con 0x7f0bf4147f20 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf1400640 1 -- 172.21.15.100:0/3137817288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0be4031d60 con 0x7f0bf4147f20 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3137817288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 msgr2=0x7f0bf40abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf40abfd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bf406e550 tx=0x7f0be402b910 comp rx=0 tx=0).stop 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3137817288 shutdown_connections 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf40c1b00 0x7f0bf40c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3137817288 >> v2:172.21.15.110:3300/0 conn(0x7f0bf4151f60 0x7f0bf4070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3137817288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf40abfd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3137817288 >> 172.21.15.100:0/3137817288 conn(0x7f0bf406a5e0 msgr2=0x7f0bf406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3137817288 shutdown_connections 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.625+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3137817288 wait complete. 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.627+0000 7f0bf8c00640 1 Processor -- start 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.627+0000 7f0bf8c00640 1 -- start start 2024-01-20T08:10:13.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 0x7f0bf41e8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 0x7f0bf41eb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf41557e0 con 0x7f0bf4147f20 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf41e9490 con 0x7f0bf40c1b00 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bf8c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf40a9500 con 0x7f0bf4151f60 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57760/0 (socket says 172.21.15.100:57760) 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.628+0000 7f0bebe00640 1 -- 172.21.15.100:0/3941280046 learned_addr learned my addr 172.21.15.100:0/3941280046 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 0x7f0bf41e8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf2800640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 0x7f0bf41eb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 -- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 msgr2=0x7f0bf41eb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 0x7f0bf41eb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 -- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 msgr2=0x7f0bf41e8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 0x7f0bf41e8f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 -- 172.21.15.100:0/3941280046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0be40094d0 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 0x7f0bf41e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf2800640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 0x7f0bf41eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bebe00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00d7d0 tx=0x7f0bdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc018070 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bdc004020 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf41464f0 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bdc0041b0 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.629+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf4146790 con 0x7f0bf4147f20 2024-01-20T08:10:13.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.630+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bf404e970 con 0x7f0bf4147f20 2024-01-20T08:10:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.631+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0bdc004310 con 0x7f0bf4147f20 2024-01-20T08:10:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.632+0000 7f0bea000640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 0x7f0bcc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.632+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bdc0894b0 con 0x7f0bf4147f20 2024-01-20T08:10:13.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.632+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 0x7f0bcc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:13.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.633+0000 7f0bf1e00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 0x7f0bcc06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0be4036000 tx=0x7f0be403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:13.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.636+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0bdc054370 con 0x7f0bf4147f20 2024-01-20T08:10:13.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.810+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bf406e860 con 0x7f0bcc06aed0 2024-01-20T08:10:13.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.820+0000 7f0bea000640 1 -- 172.21.15.100:0/3941280046 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264443 (secure 0 0 0) 0x7f0be4031c40 con 0x7f0bcc06aed0 2024-01-20T08:10:13.827 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:10:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 msgr2=0x7f0bcc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 0x7f0bcc06d390 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0be4036000 tx=0x7f0be403c040 comp rx=0 tx=0).stop 2024-01-20T08:10:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 msgr2=0x7f0bf4146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc00d7d0 tx=0x7f0bdc00dc90 comp rx=0 tx=0).stop 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 shutdown_connections 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0bcc06aed0 0x7f0bcc06d390 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0bf4151f60 0x7f0bf41eb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0bf4147f20 0x7f0bf4146cb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.826+0000 7f0bf8c00640 1 --2- 172.21.15.100:0/3941280046 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0bf40c1b00 0x7f0bf41e8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.827+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 >> 172.21.15.100:0/3941280046 conn(0x7f0bf406a5e0 msgr2=0x7f0bf4144220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.828+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 shutdown_connections 2024-01-20T08:10:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:13.828+0000 7f0bf8c00640 1 -- 172.21.15.100:0/3941280046 wait complete. 2024-01-20T08:10:13.850 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-01-20T08:10:11.886509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":114,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236244,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738476,"statfs":{"total":773094113280,"available":772852199424,"internally_reserved":0,"allocated":3088384,"data_stored":1830660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":80,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.169767"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193298+0000","last_change":"2024-01-20T08:10:08.794516+0000","last_active":"2024-01-20T08:10:10.193298+0000","last_peered":"2024-01-20T08:10:10.193298+0000","last_clean":"2024-01-20T08:10:10.193298+0000","last_became_active":"2024-01-20T08:10:08.794118+0000","last_became_peered":"2024-01-20T08:10:08.794118+0000","last_unstale":"2024-01-20T08:10:10.193298+0000","last_undegraded":"2024-01-20T08:10:10.193298+0000","last_fullsized":"2024-01-20T08:10:10.193298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188560+0000","last_change":"2024-01-20T08:10:08.778488+0000","last_active":"2024-01-20T08:10:10.188560+0000","last_peered":"2024-01-20T08:10:10.188560+0000","last_clean":"2024-01-20T08:10:10.188560+0000","last_became_active":"2024-01-20T08:10:08.778115+0000","last_became_peered":"2024-01-20T08:10:08.778115+0000","last_unstale":"2024-01-20T08:10:10.188560+0000","last_undegraded":"2024-01-20T08:10:10.188560+0000","last_fullsized":"2024-01-20T08:10:10.188560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.783518+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.780866+0000","last_became_peered":"2024-01-20T08:10:08.780866+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188914+0000","last_change":"2024-01-20T08:10:08.783382+0000","last_active":"2024-01-20T08:10:10.188914+0000","last_peered":"2024-01-20T08:10:10.188914+0000","last_clean":"2024-01-20T08:10:10.188914+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.188914+0000","last_undegraded":"2024-01-20T08:10:10.188914+0000","last_fullsized":"2024-01-20T08:10:10.188914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191839+0000","last_change":"2024-01-20T08:10:08.776063+0000","last_active":"2024-01-20T08:10:10.191839+0000","last_peered":"2024-01-20T08:10:10.191839+0000","last_clean":"2024-01-20T08:10:10.191839+0000","last_became_active":"2024-01-20T08:10:08.775617+0000","last_became_peered":"2024-01-20T08:10:08.775617+0000","last_unstale":"2024-01-20T08:10:10.191839+0000","last_undegraded":"2024-01-20T08:10:10.191839+0000","last_fullsized":"2024-01-20T08:10:10.191839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187876+0000","last_change":"2024-01-20T08:10:08.782346+0000","last_active":"2024-01-20T08:10:10.187876+0000","last_peered":"2024-01-20T08:10:10.187876+0000","last_clean":"2024-01-20T08:10:10.187876+0000","last_became_active":"2024-01-20T08:10:08.782015+0000","last_became_peered":"2024-01-20T08:10:08.782015+0000","last_unstale":"2024-01-20T08:10:10.187876+0000","last_undegraded":"2024-01-20T08:10:10.187876+0000","last_fullsized":"2024-01-20T08:10:10.187876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192165+0000","last_change":"2024-01-20T08:10:08.780591+0000","last_active":"2024-01-20T08:10:10.192165+0000","last_peered":"2024-01-20T08:10:10.192165+0000","last_clean":"2024-01-20T08:10:10.192165+0000","last_became_active":"2024-01-20T08:10:08.780333+0000","last_became_peered":"2024-01-20T08:10:08.780333+0000","last_unstale":"2024-01-20T08:10:10.192165+0000","last_undegraded":"2024-01-20T08:10:10.192165+0000","last_fullsized":"2024-01-20T08:10:10.192165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754474+0000","last_change":"2024-01-20T08:10:08.780476+0000","last_active":"2024-01-20T08:10:09.754474+0000","last_peered":"2024-01-20T08:10:09.754474+0000","last_clean":"2024-01-20T08:10:09.754474+0000","last_became_active":"2024-01-20T08:10:08.780055+0000","last_became_peered":"2024-01-20T08:10:08.780055+0000","last_unstale":"2024-01-20T08:10:09.754474+0000","last_undegraded":"2024-01-20T08:10:09.754474+0000","last_fullsized":"2024-01-20T08:10:09.754474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193268+0000","last_change":"2024-01-20T08:10:08.780635+0000","last_active":"2024-01-20T08:10:10.193268+0000","last_peered":"2024-01-20T08:10:10.193268+0000","last_clean":"2024-01-20T08:10:10.193268+0000","last_became_active":"2024-01-20T08:10:08.780253+0000","last_became_peered":"2024-01-20T08:10:08.780253+0000","last_unstale":"2024-01-20T08:10:10.193268+0000","last_undegraded":"2024-01-20T08:10:10.193268+0000","last_fullsized":"2024-01-20T08:10:10.193268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192006+0000","last_change":"2024-01-20T08:10:08.790551+0000","last_active":"2024-01-20T08:10:10.192006+0000","last_peered":"2024-01-20T08:10:10.192006+0000","last_clean":"2024-01-20T08:10:10.192006+0000","last_became_active":"2024-01-20T08:10:08.790180+0000","last_became_peered":"2024-01-20T08:10:08.790180+0000","last_unstale":"2024-01-20T08:10:10.192006+0000","last_undegraded":"2024-01-20T08:10:10.192006+0000","last_fullsized":"2024-01-20T08:10:10.192006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191485+0000","last_change":"2024-01-20T08:10:08.792788+0000","last_active":"2024-01-20T08:10:10.191485+0000","last_peered":"2024-01-20T08:10:10.191485+0000","last_clean":"2024-01-20T08:10:10.191485+0000","last_became_active":"2024-01-20T08:10:08.791594+0000","last_became_peered":"2024-01-20T08:10:08.791594+0000","last_unstale":"2024-01-20T08:10:10.191485+0000","last_undegraded":"2024-01-20T08:10:10.191485+0000","last_fullsized":"2024-01-20T08:10:10.191485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756031+0000","last_change":"2024-01-20T08:10:08.791553+0000","last_active":"2024-01-20T08:10:09.756031+0000","last_peered":"2024-01-20T08:10:09.756031+0000","last_clean":"2024-01-20T08:10:09.756031+0000","last_became_active":"2024-01-20T08:10:08.789326+0000","last_became_peered":"2024-01-20T08:10:08.789326+0000","last_unstale":"2024-01-20T08:10:09.756031+0000","last_undegraded":"2024-01-20T08:10:09.756031+0000","last_fullsized":"2024-01-20T08:10:09.756031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:59.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755024+0000","last_change":"2024-01-20T08:10:08.783923+0000","last_active":"2024-01-20T08:10:09.755024+0000","last_peered":"2024-01-20T08:10:09.755024+0000","last_clean":"2024-01-20T08:10:09.755024+0000","last_became_active":"2024-01-20T08:10:08.783605+0000","last_became_peered":"2024-01-20T08:10:08.783605+0000","last_unstale":"2024-01-20T08:10:09.755024+0000","last_undegraded":"2024-01-20T08:10:09.755024+0000","last_fullsized":"2024-01-20T08:10:09.755024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186481+0000","last_change":"2024-01-20T08:10:08.786608+0000","last_active":"2024-01-20T08:10:10.186481+0000","last_peered":"2024-01-20T08:10:10.186481+0000","last_clean":"2024-01-20T08:10:10.186481+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.186481+0000","last_undegraded":"2024-01-20T08:10:10.186481+0000","last_fullsized":"2024-01-20T08:10:10.186481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187982+0000","last_change":"2024-01-20T08:10:08.790598+0000","last_active":"2024-01-20T08:10:10.187982+0000","last_peered":"2024-01-20T08:10:10.187982+0000","last_clean":"2024-01-20T08:10:10.187982+0000","last_became_active":"2024-01-20T08:10:08.790298+0000","last_became_peered":"2024-01-20T08:10:08.790298+0000","last_unstale":"2024-01-20T08:10:10.187982+0000","last_undegraded":"2024-01-20T08:10:10.187982+0000","last_fullsized":"2024-01-20T08:10:10.187982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187500+0000","last_change":"2024-01-20T08:10:08.782029+0000","last_active":"2024-01-20T08:10:10.187500+0000","last_peered":"2024-01-20T08:10:10.187500+0000","last_clean":"2024-01-20T08:10:10.187500+0000","last_became_active":"2024-01-20T08:10:08.781132+0000","last_became_peered":"2024-01-20T08:10:08.781132+0000","last_unstale":"2024-01-20T08:10:10.187500+0000","last_undegraded":"2024-01-20T08:10:10.187500+0000","last_fullsized":"2024-01-20T08:10:10.187500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190735+0000","last_change":"2024-01-20T08:10:08.787165+0000","last_active":"2024-01-20T08:10:10.190735+0000","last_peered":"2024-01-20T08:10:10.190735+0000","last_clean":"2024-01-20T08:10:10.190735+0000","last_became_active":"2024-01-20T08:10:08.786862+0000","last_became_peered":"2024-01-20T08:10:08.786862+0000","last_unstale":"2024-01-20T08:10:10.190735+0000","last_undegraded":"2024-01-20T08:10:10.190735+0000","last_fullsized":"2024-01-20T08:10:10.190735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758174+0000","last_change":"2024-01-20T08:10:08.795799+0000","last_active":"2024-01-20T08:10:09.758174+0000","last_peered":"2024-01-20T08:10:09.758174+0000","last_clean":"2024-01-20T08:10:09.758174+0000","last_became_active":"2024-01-20T08:10:08.795565+0000","last_became_peered":"2024-01-20T08:10:08.795565+0000","last_unstale":"2024-01-20T08:10:09.758174+0000","last_undegraded":"2024-01-20T08:10:09.758174+0000","last_fullsized":"2024-01-20T08:10:09.758174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190974+0000","last_change":"2024-01-20T08:10:08.772099+0000","last_active":"2024-01-20T08:10:10.190974+0000","last_peered":"2024-01-20T08:10:10.190974+0000","last_clean":"2024-01-20T08:10:10.190974+0000","last_became_active":"2024-01-20T08:10:08.771805+0000","last_became_peered":"2024-01-20T08:10:08.771805+0000","last_unstale":"2024-01-20T08:10:10.190974+0000","last_undegraded":"2024-01-20T08:10:10.190974+0000","last_fullsized":"2024-01-20T08:10:10.190974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190191+0000","last_change":"2024-01-20T08:10:08.797402+0000","last_active":"2024-01-20T08:10:10.190191+0000","last_peered":"2024-01-20T08:10:10.190191+0000","last_clean":"2024-01-20T08:10:10.190191+0000","last_became_active":"2024-01-20T08:10:08.797026+0000","last_became_peered":"2024-01-20T08:10:08.797026+0000","last_unstale":"2024-01-20T08:10:10.190191+0000","last_undegraded":"2024-01-20T08:10:10.190191+0000","last_fullsized":"2024-01-20T08:10:10.190191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186861+0000","last_change":"2024-01-20T08:10:08.796525+0000","last_active":"2024-01-20T08:10:10.186861+0000","last_peered":"2024-01-20T08:10:10.186861+0000","last_clean":"2024-01-20T08:10:10.186861+0000","last_became_active":"2024-01-20T08:10:08.796194+0000","last_became_peered":"2024-01-20T08:10:08.796194+0000","last_unstale":"2024-01-20T08:10:10.186861+0000","last_undegraded":"2024-01-20T08:10:10.186861+0000","last_fullsized":"2024-01-20T08:10:10.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188827+0000","last_change":"2024-01-20T08:10:08.786863+0000","last_active":"2024-01-20T08:10:10.188827+0000","last_peered":"2024-01-20T08:10:10.188827+0000","last_clean":"2024-01-20T08:10:10.188827+0000","last_became_active":"2024-01-20T08:10:08.786412+0000","last_became_peered":"2024-01-20T08:10:08.786412+0000","last_unstale":"2024-01-20T08:10:10.188827+0000","last_undegraded":"2024-01-20T08:10:10.188827+0000","last_fullsized":"2024-01-20T08:10:10.188827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754903+0000","last_change":"2024-01-20T08:10:08.788906+0000","last_active":"2024-01-20T08:10:09.754903+0000","last_peered":"2024-01-20T08:10:09.754903+0000","last_clean":"2024-01-20T08:10:09.754903+0000","last_became_active":"2024-01-20T08:10:08.788531+0000","last_became_peered":"2024-01-20T08:10:08.788531+0000","last_unstale":"2024-01-20T08:10:09.754903+0000","last_undegraded":"2024-01-20T08:10:09.754903+0000","last_fullsized":"2024-01-20T08:10:09.754903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188113+0000","last_change":"2024-01-20T08:10:08.782233+0000","last_active":"2024-01-20T08:10:10.188113+0000","last_peered":"2024-01-20T08:10:10.188113+0000","last_clean":"2024-01-20T08:10:10.188113+0000","last_became_active":"2024-01-20T08:10:08.781895+0000","last_became_peered":"2024-01-20T08:10:08.781895+0000","last_unstale":"2024-01-20T08:10:10.188113+0000","last_undegraded":"2024-01-20T08:10:10.188113+0000","last_fullsized":"2024-01-20T08:10:10.188113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755626+0000","last_change":"2024-01-20T08:10:08.789012+0000","last_active":"2024-01-20T08:10:09.755626+0000","last_peered":"2024-01-20T08:10:09.755626+0000","last_clean":"2024-01-20T08:10:09.755626+0000","last_became_active":"2024-01-20T08:10:08.788686+0000","last_became_peered":"2024-01-20T08:10:08.788686+0000","last_unstale":"2024-01-20T08:10:09.755626+0000","last_undegraded":"2024-01-20T08:10:09.755626+0000","last_fullsized":"2024-01-20T08:10:09.755626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192597+0000","last_change":"2024-01-20T08:10:08.796945+0000","last_active":"2024-01-20T08:10:10.192597+0000","last_peered":"2024-01-20T08:10:10.192597+0000","last_clean":"2024-01-20T08:10:10.192597+0000","last_became_active":"2024-01-20T08:10:08.796510+0000","last_became_peered":"2024-01-20T08:10:08.796510+0000","last_unstale":"2024-01-20T08:10:10.192597+0000","last_undegraded":"2024-01-20T08:10:10.192597+0000","last_fullsized":"2024-01-20T08:10:10.192597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187326+0000","last_change":"2024-01-20T08:10:08.781890+0000","last_active":"2024-01-20T08:10:10.187326+0000","last_peered":"2024-01-20T08:10:10.187326+0000","last_clean":"2024-01-20T08:10:10.187326+0000","last_became_active":"2024-01-20T08:10:08.781584+0000","last_became_peered":"2024-01-20T08:10:08.781584+0000","last_unstale":"2024-01-20T08:10:10.187326+0000","last_undegraded":"2024-01-20T08:10:10.187326+0000","last_fullsized":"2024-01-20T08:10:10.187326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755750+0000","last_change":"2024-01-20T08:10:08.789316+0000","last_active":"2024-01-20T08:10:09.755750+0000","last_peered":"2024-01-20T08:10:09.755750+0000","last_clean":"2024-01-20T08:10:09.755750+0000","last_became_active":"2024-01-20T08:10:08.788713+0000","last_became_peered":"2024-01-20T08:10:08.788713+0000","last_unstale":"2024-01-20T08:10:09.755750+0000","last_undegraded":"2024-01-20T08:10:09.755750+0000","last_fullsized":"2024-01-20T08:10:09.755750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187162+0000","last_change":"2024-01-20T08:10:08.785197+0000","last_active":"2024-01-20T08:10:10.187162+0000","last_peered":"2024-01-20T08:10:10.187162+0000","last_clean":"2024-01-20T08:10:10.187162+0000","last_became_active":"2024-01-20T08:10:08.784924+0000","last_became_peered":"2024-01-20T08:10:08.784924+0000","last_unstale":"2024-01-20T08:10:10.187162+0000","last_undegraded":"2024-01-20T08:10:10.187162+0000","last_fullsized":"2024-01-20T08:10:10.187162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188330+0000","last_change":"2024-01-20T08:10:08.783898+0000","last_active":"2024-01-20T08:10:10.188330+0000","last_peered":"2024-01-20T08:10:10.188330+0000","last_clean":"2024-01-20T08:10:10.188330+0000","last_became_active":"2024-01-20T08:10:08.783616+0000","last_became_peered":"2024-01-20T08:10:08.783616+0000","last_unstale":"2024-01-20T08:10:10.188330+0000","last_undegraded":"2024-01-20T08:10:10.188330+0000","last_fullsized":"2024-01-20T08:10:10.188330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757513+0000","last_change":"2024-01-20T08:10:08.777383+0000","last_active":"2024-01-20T08:10:09.757513+0000","last_peered":"2024-01-20T08:10:09.757513+0000","last_clean":"2024-01-20T08:10:09.757513+0000","last_became_active":"2024-01-20T08:10:08.777063+0000","last_became_peered":"2024-01-20T08:10:08.777063+0000","last_unstale":"2024-01-20T08:10:09.757513+0000","last_undegraded":"2024-01-20T08:10:09.757513+0000","last_fullsized":"2024-01-20T08:10:09.757513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188697+0000","last_change":"2024-01-20T08:10:08.786427+0000","last_active":"2024-01-20T08:10:10.188697+0000","last_peered":"2024-01-20T08:10:10.188697+0000","last_clean":"2024-01-20T08:10:10.188697+0000","last_became_active":"2024-01-20T08:10:08.786064+0000","last_became_peered":"2024-01-20T08:10:08.786064+0000","last_unstale":"2024-01-20T08:10:10.188697+0000","last_undegraded":"2024-01-20T08:10:10.188697+0000","last_fullsized":"2024-01-20T08:10:10.188697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755478+0000","last_change":"2024-01-20T08:10:08.779140+0000","last_active":"2024-01-20T08:10:09.755478+0000","last_peered":"2024-01-20T08:10:09.755478+0000","last_clean":"2024-01-20T08:10:09.755478+0000","last_became_active":"2024-01-20T08:10:08.778789+0000","last_became_peered":"2024-01-20T08:10:08.778789+0000","last_unstale":"2024-01-20T08:10:09.755478+0000","last_undegraded":"2024-01-20T08:10:09.755478+0000","last_fullsized":"2024-01-20T08:10:09.755478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755123+0000","last_change":"2024-01-20T08:10:07.773775+0000","last_active":"2024-01-20T08:10:09.755123+0000","last_peered":"2024-01-20T08:10:09.755123+0000","last_clean":"2024-01-20T08:10:09.755123+0000","last_became_active":"2024-01-20T08:10:07.773480+0000","last_became_peered":"2024-01-20T08:10:07.773480+0000","last_unstale":"2024-01-20T08:10:09.755123+0000","last_undegraded":"2024-01-20T08:10:09.755123+0000","last_fullsized":"2024-01-20T08:10:09.755123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187214+0000","last_change":"2024-01-20T08:10:08.789715+0000","last_active":"2024-01-20T08:10:10.187214+0000","last_peered":"2024-01-20T08:10:10.187214+0000","last_clean":"2024-01-20T08:10:10.187214+0000","last_became_active":"2024-01-20T08:10:08.789077+0000","last_became_peered":"2024-01-20T08:10:08.789077+0000","last_unstale":"2024-01-20T08:10:10.187214+0000","last_undegraded":"2024-01-20T08:10:10.187214+0000","last_fullsized":"2024-01-20T08:10:10.187214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189547+0000","last_change":"2024-01-20T08:10:07.779298+0000","last_active":"2024-01-20T08:10:10.189547+0000","last_peered":"2024-01-20T08:10:10.189547+0000","last_clean":"2024-01-20T08:10:10.189547+0000","last_became_active":"2024-01-20T08:10:07.776952+0000","last_became_peered":"2024-01-20T08:10:07.776952+0000","last_unstale":"2024-01-20T08:10:10.189547+0000","last_undegraded":"2024-01-20T08:10:10.189547+0000","last_fullsized":"2024-01-20T08:10:10.189547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754848+0000","last_change":"2024-01-20T08:10:07.771726+0000","last_active":"2024-01-20T08:10:09.754848+0000","last_peered":"2024-01-20T08:10:09.754848+0000","last_clean":"2024-01-20T08:10:09.754848+0000","last_became_active":"2024-01-20T08:10:07.771478+0000","last_became_peered":"2024-01-20T08:10:07.771478+0000","last_unstale":"2024-01-20T08:10:09.754848+0000","last_undegraded":"2024-01-20T08:10:09.754848+0000","last_fullsized":"2024-01-20T08:10:09.754848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754395+0000","last_change":"2024-01-20T08:10:08.778862+0000","last_active":"2024-01-20T08:10:09.754395+0000","last_peered":"2024-01-20T08:10:09.754395+0000","last_clean":"2024-01-20T08:10:09.754395+0000","last_became_active":"2024-01-20T08:10:08.778602+0000","last_became_peered":"2024-01-20T08:10:08.778602+0000","last_unstale":"2024-01-20T08:10:09.754395+0000","last_undegraded":"2024-01-20T08:10:09.754395+0000","last_fullsized":"2024-01-20T08:10:09.754395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187787+0000","last_change":"2024-01-20T08:10:07.782188+0000","last_active":"2024-01-20T08:10:10.187787+0000","last_peered":"2024-01-20T08:10:10.187787+0000","last_clean":"2024-01-20T08:10:10.187787+0000","last_became_active":"2024-01-20T08:10:07.781848+0000","last_became_peered":"2024-01-20T08:10:07.781848+0000","last_unstale":"2024-01-20T08:10:10.187787+0000","last_undegraded":"2024-01-20T08:10:10.187787+0000","last_fullsized":"2024-01-20T08:10:10.187787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187824+0000","last_change":"2024-01-20T08:10:08.771016+0000","last_active":"2024-01-20T08:10:10.187824+0000","last_peered":"2024-01-20T08:10:10.187824+0000","last_clean":"2024-01-20T08:10:10.187824+0000","last_became_active":"2024-01-20T08:10:08.770684+0000","last_became_peered":"2024-01-20T08:10:08.770684+0000","last_unstale":"2024-01-20T08:10:10.187824+0000","last_undegraded":"2024-01-20T08:10:10.187824+0000","last_fullsized":"2024-01-20T08:10:10.187824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192570+0000","last_change":"2024-01-20T08:10:07.783230+0000","last_active":"2024-01-20T08:10:10.192570+0000","last_peered":"2024-01-20T08:10:10.192570+0000","last_clean":"2024-01-20T08:10:10.192570+0000","last_became_active":"2024-01-20T08:10:07.782491+0000","last_became_peered":"2024-01-20T08:10:07.782491+0000","last_unstale":"2024-01-20T08:10:10.192570+0000","last_undegraded":"2024-01-20T08:10:10.192570+0000","last_fullsized":"2024-01-20T08:10:10.192570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190746+0000","last_change":"2024-01-20T08:10:08.790309+0000","last_active":"2024-01-20T08:10:10.190746+0000","last_peered":"2024-01-20T08:10:10.190746+0000","last_clean":"2024-01-20T08:10:10.190746+0000","last_became_active":"2024-01-20T08:10:08.790047+0000","last_became_peered":"2024-01-20T08:10:08.790047+0000","last_unstale":"2024-01-20T08:10:10.190746+0000","last_undegraded":"2024-01-20T08:10:10.190746+0000","last_fullsized":"2024-01-20T08:10:10.190746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190087+0000","last_change":"2024-01-20T08:10:07.786339+0000","last_active":"2024-01-20T08:10:10.190087+0000","last_peered":"2024-01-20T08:10:10.190087+0000","last_clean":"2024-01-20T08:10:10.190087+0000","last_became_active":"2024-01-20T08:10:07.786034+0000","last_became_peered":"2024-01-20T08:10:07.786034+0000","last_unstale":"2024-01-20T08:10:10.190087+0000","last_undegraded":"2024-01-20T08:10:10.190087+0000","last_fullsized":"2024-01-20T08:10:10.190087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188010+0000","last_change":"2024-01-20T08:10:08.792377+0000","last_active":"2024-01-20T08:10:10.188010+0000","last_peered":"2024-01-20T08:10:10.188010+0000","last_clean":"2024-01-20T08:10:10.188010+0000","last_became_active":"2024-01-20T08:10:08.792096+0000","last_became_peered":"2024-01-20T08:10:08.792096+0000","last_unstale":"2024-01-20T08:10:10.188010+0000","last_undegraded":"2024-01-20T08:10:10.188010+0000","last_fullsized":"2024-01-20T08:10:10.188010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187591+0000","last_change":"2024-01-20T08:10:07.782717+0000","last_active":"2024-01-20T08:10:10.187591+0000","last_peered":"2024-01-20T08:10:10.187591+0000","last_clean":"2024-01-20T08:10:10.187591+0000","last_became_active":"2024-01-20T08:10:07.782484+0000","last_became_peered":"2024-01-20T08:10:07.782484+0000","last_unstale":"2024-01-20T08:10:10.187591+0000","last_undegraded":"2024-01-20T08:10:10.187591+0000","last_fullsized":"2024-01-20T08:10:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756143+0000","last_change":"2024-01-20T08:10:08.781928+0000","last_active":"2024-01-20T08:10:09.756143+0000","last_peered":"2024-01-20T08:10:09.756143+0000","last_clean":"2024-01-20T08:10:09.756143+0000","last_became_active":"2024-01-20T08:10:08.781472+0000","last_became_peered":"2024-01-20T08:10:08.781472+0000","last_unstale":"2024-01-20T08:10:09.756143+0000","last_undegraded":"2024-01-20T08:10:09.756143+0000","last_fullsized":"2024-01-20T08:10:09.756143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:26.656512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190465+0000","last_change":"2024-01-20T08:10:07.782772+0000","last_active":"2024-01-20T08:10:10.190465+0000","last_peered":"2024-01-20T08:10:10.190465+0000","last_clean":"2024-01-20T08:10:10.190465+0000","last_became_active":"2024-01-20T08:10:07.780824+0000","last_became_peered":"2024-01-20T08:10:07.780824+0000","last_unstale":"2024-01-20T08:10:10.190465+0000","last_undegraded":"2024-01-20T08:10:10.190465+0000","last_fullsized":"2024-01-20T08:10:10.190465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190013+0000","last_change":"2024-01-20T08:10:08.786404+0000","last_active":"2024-01-20T08:10:10.190013+0000","last_peered":"2024-01-20T08:10:10.190013+0000","last_clean":"2024-01-20T08:10:10.190013+0000","last_became_active":"2024-01-20T08:10:08.786120+0000","last_became_peered":"2024-01-20T08:10:08.786120+0000","last_unstale":"2024-01-20T08:10:10.190013+0000","last_undegraded":"2024-01-20T08:10:10.190013+0000","last_fullsized":"2024-01-20T08:10:10.190013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187474+0000","last_change":"2024-01-20T08:10:07.763023+0000","last_active":"2024-01-20T08:10:10.187474+0000","last_peered":"2024-01-20T08:10:10.187474+0000","last_clean":"2024-01-20T08:10:10.187474+0000","last_became_active":"2024-01-20T08:10:07.762445+0000","last_became_peered":"2024-01-20T08:10:07.762445+0000","last_unstale":"2024-01-20T08:10:10.187474+0000","last_undegraded":"2024-01-20T08:10:10.187474+0000","last_fullsized":"2024-01-20T08:10:10.187474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186810+0000","last_change":"2024-01-20T08:10:08.788158+0000","last_active":"2024-01-20T08:10:10.186810+0000","last_peered":"2024-01-20T08:10:10.186810+0000","last_clean":"2024-01-20T08:10:10.186810+0000","last_became_active":"2024-01-20T08:10:08.787042+0000","last_became_peered":"2024-01-20T08:10:08.787042+0000","last_unstale":"2024-01-20T08:10:10.186810+0000","last_undegraded":"2024-01-20T08:10:10.186810+0000","last_fullsized":"2024-01-20T08:10:10.186810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188550+0000","last_change":"2024-01-20T08:10:07.780955+0000","last_active":"2024-01-20T08:10:10.188550+0000","last_peered":"2024-01-20T08:10:10.188550+0000","last_clean":"2024-01-20T08:10:10.188550+0000","last_became_active":"2024-01-20T08:10:07.780635+0000","last_became_peered":"2024-01-20T08:10:07.780635+0000","last_unstale":"2024-01-20T08:10:10.188550+0000","last_undegraded":"2024-01-20T08:10:10.188550+0000","last_fullsized":"2024-01-20T08:10:10.188550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:54.165646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192151+0000","last_change":"2024-01-20T08:10:08.783000+0000","last_active":"2024-01-20T08:10:10.192151+0000","last_peered":"2024-01-20T08:10:10.192151+0000","last_clean":"2024-01-20T08:10:10.192151+0000","last_became_active":"2024-01-20T08:10:08.782683+0000","last_became_peered":"2024-01-20T08:10:08.782683+0000","last_unstale":"2024-01-20T08:10:10.192151+0000","last_undegraded":"2024-01-20T08:10:10.192151+0000","last_fullsized":"2024-01-20T08:10:10.192151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189278+0000","last_change":"2024-01-20T08:10:07.775311+0000","last_active":"2024-01-20T08:10:10.189278+0000","last_peered":"2024-01-20T08:10:10.189278+0000","last_clean":"2024-01-20T08:10:10.189278+0000","last_became_active":"2024-01-20T08:10:07.771006+0000","last_became_peered":"2024-01-20T08:10:07.771006+0000","last_unstale":"2024-01-20T08:10:10.189278+0000","last_undegraded":"2024-01-20T08:10:10.189278+0000","last_fullsized":"2024-01-20T08:10:10.189278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189142+0000","last_change":"2024-01-20T08:10:08.779813+0000","last_active":"2024-01-20T08:10:10.189142+0000","last_peered":"2024-01-20T08:10:10.189142+0000","last_clean":"2024-01-20T08:10:10.189142+0000","last_became_active":"2024-01-20T08:10:08.778962+0000","last_became_peered":"2024-01-20T08:10:08.778962+0000","last_unstale":"2024-01-20T08:10:10.189142+0000","last_undegraded":"2024-01-20T08:10:10.189142+0000","last_fullsized":"2024-01-20T08:10:10.189142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757296+0000","last_change":"2024-01-20T08:10:07.773757+0000","last_active":"2024-01-20T08:10:09.757296+0000","last_peered":"2024-01-20T08:10:09.757296+0000","last_clean":"2024-01-20T08:10:09.757296+0000","last_became_active":"2024-01-20T08:10:07.773422+0000","last_became_peered":"2024-01-20T08:10:07.773422+0000","last_unstale":"2024-01-20T08:10:09.757296+0000","last_undegraded":"2024-01-20T08:10:09.757296+0000","last_fullsized":"2024-01-20T08:10:09.757296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192502+0000","last_change":"2024-01-20T08:10:08.787377+0000","last_active":"2024-01-20T08:10:10.192502+0000","last_peered":"2024-01-20T08:10:10.192502+0000","last_clean":"2024-01-20T08:10:10.192502+0000","last_became_active":"2024-01-20T08:10:08.787064+0000","last_became_peered":"2024-01-20T08:10:08.787064+0000","last_unstale":"2024-01-20T08:10:10.192502+0000","last_undegraded":"2024-01-20T08:10:10.192502+0000","last_fullsized":"2024-01-20T08:10:10.192502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756111+0000","last_change":"2024-01-20T08:10:07.759594+0000","last_active":"2024-01-20T08:10:09.756111+0000","last_peered":"2024-01-20T08:10:09.756111+0000","last_clean":"2024-01-20T08:10:09.756111+0000","last_became_active":"2024-01-20T08:10:07.759092+0000","last_became_peered":"2024-01-20T08:10:07.759092+0000","last_unstale":"2024-01-20T08:10:09.756111+0000","last_undegraded":"2024-01-20T08:10:09.756111+0000","last_fullsized":"2024-01-20T08:10:09.756111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192462+0000","last_change":"2024-01-20T08:10:08.787171+0000","last_active":"2024-01-20T08:10:10.192462+0000","last_peered":"2024-01-20T08:10:10.192462+0000","last_clean":"2024-01-20T08:10:10.192462+0000","last_became_active":"2024-01-20T08:10:08.786910+0000","last_became_peered":"2024-01-20T08:10:08.786910+0000","last_unstale":"2024-01-20T08:10:10.192462+0000","last_undegraded":"2024-01-20T08:10:10.192462+0000","last_fullsized":"2024-01-20T08:10:10.192462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758344+0000","last_change":"2024-01-20T08:10:07.768872+0000","last_active":"2024-01-20T08:10:09.758344+0000","last_peered":"2024-01-20T08:10:09.758344+0000","last_clean":"2024-01-20T08:10:09.758344+0000","last_became_active":"2024-01-20T08:10:07.768410+0000","last_became_peered":"2024-01-20T08:10:07.768410+0000","last_unstale":"2024-01-20T08:10:09.758344+0000","last_undegraded":"2024-01-20T08:10:09.758344+0000","last_fullsized":"2024-01-20T08:10:09.758344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:31:17.868223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193451+0000","last_change":"2024-01-20T08:10:08.788993+0000","last_active":"2024-01-20T08:10:10.193451+0000","last_peered":"2024-01-20T08:10:10.193451+0000","last_clean":"2024-01-20T08:10:10.193451+0000","last_became_active":"2024-01-20T08:10:08.788676+0000","last_became_peered":"2024-01-20T08:10:08.788676+0000","last_unstale":"2024-01-20T08:10:10.193451+0000","last_undegraded":"2024-01-20T08:10:10.193451+0000","last_fullsized":"2024-01-20T08:10:10.193451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188374+0000","last_change":"2024-01-20T08:10:07.770092+0000","last_active":"2024-01-20T08:10:10.188374+0000","last_peered":"2024-01-20T08:10:10.188374+0000","last_clean":"2024-01-20T08:10:10.188374+0000","last_became_active":"2024-01-20T08:10:07.769349+0000","last_became_peered":"2024-01-20T08:10:07.769349+0000","last_unstale":"2024-01-20T08:10:10.188374+0000","last_undegraded":"2024-01-20T08:10:10.188374+0000","last_fullsized":"2024-01-20T08:10:10.188374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188541+0000","last_change":"2024-01-20T08:10:08.780078+0000","last_active":"2024-01-20T08:10:10.188541+0000","last_peered":"2024-01-20T08:10:10.188541+0000","last_clean":"2024-01-20T08:10:10.188541+0000","last_became_active":"2024-01-20T08:10:08.778811+0000","last_became_peered":"2024-01-20T08:10:08.778811+0000","last_unstale":"2024-01-20T08:10:10.188541+0000","last_undegraded":"2024-01-20T08:10:10.188541+0000","last_fullsized":"2024-01-20T08:10:10.188541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757909+0000","last_change":"2024-01-20T08:10:07.782606+0000","last_active":"2024-01-20T08:10:09.757909+0000","last_peered":"2024-01-20T08:10:09.757909+0000","last_clean":"2024-01-20T08:10:09.757909+0000","last_became_active":"2024-01-20T08:10:07.782208+0000","last_became_peered":"2024-01-20T08:10:07.782208+0000","last_unstale":"2024-01-20T08:10:09.757909+0000","last_undegraded":"2024-01-20T08:10:09.757909+0000","last_fullsized":"2024-01-20T08:10:09.757909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190352+0000","last_change":"2024-01-20T08:10:08.793744+0000","last_active":"2024-01-20T08:10:10.190352+0000","last_peered":"2024-01-20T08:10:10.190352+0000","last_clean":"2024-01-20T08:10:10.190352+0000","last_became_active":"2024-01-20T08:10:08.793434+0000","last_became_peered":"2024-01-20T08:10:08.793434+0000","last_unstale":"2024-01-20T08:10:10.190352+0000","last_undegraded":"2024-01-20T08:10:10.190352+0000","last_fullsized":"2024-01-20T08:10:10.190352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T08:10:08.753995+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:10:08.753995+0000","last_peered":"2024-01-20T08:10:08.753995+0000","last_clean":"2024-01-20T08:10:08.753995+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:10:08.753995+0000","last_undegraded":"2024-01-20T08:10:08.753995+0000","last_fullsized":"2024-01-20T08:10:08.753995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187608+0000","last_change":"2024-01-20T08:10:07.781232+0000","last_active":"2024-01-20T08:10:10.187608+0000","last_peered":"2024-01-20T08:10:10.187608+0000","last_clean":"2024-01-20T08:10:10.187608+0000","last_became_active":"2024-01-20T08:10:07.780629+0000","last_became_peered":"2024-01-20T08:10:07.780629+0000","last_unstale":"2024-01-20T08:10:10.187608+0000","last_undegraded":"2024-01-20T08:10:10.187608+0000","last_fullsized":"2024-01-20T08:10:10.187608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755289+0000","last_change":"2024-01-20T08:10:08.780899+0000","last_active":"2024-01-20T08:10:09.755289+0000","last_peered":"2024-01-20T08:10:09.755289+0000","last_clean":"2024-01-20T08:10:09.755289+0000","last_became_active":"2024-01-20T08:10:08.780569+0000","last_became_peered":"2024-01-20T08:10:08.780569+0000","last_unstale":"2024-01-20T08:10:09.755289+0000","last_undegraded":"2024-01-20T08:10:09.755289+0000","last_fullsized":"2024-01-20T08:10:09.755289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188706+0000","last_change":"2024-01-20T08:10:07.772607+0000","last_active":"2024-01-20T08:10:10.188706+0000","last_peered":"2024-01-20T08:10:10.188706+0000","last_clean":"2024-01-20T08:10:10.188706+0000","last_became_active":"2024-01-20T08:10:07.772327+0000","last_became_peered":"2024-01-20T08:10:07.772327+0000","last_unstale":"2024-01-20T08:10:10.188706+0000","last_undegraded":"2024-01-20T08:10:10.188706+0000","last_fullsized":"2024-01-20T08:10:10.188706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186426+0000","last_change":"2024-01-20T08:10:08.789696+0000","last_active":"2024-01-20T08:10:10.186426+0000","last_peered":"2024-01-20T08:10:10.186426+0000","last_clean":"2024-01-20T08:10:10.186426+0000","last_became_active":"2024-01-20T08:10:08.789380+0000","last_became_peered":"2024-01-20T08:10:08.789380+0000","last_unstale":"2024-01-20T08:10:10.186426+0000","last_undegraded":"2024-01-20T08:10:10.186426+0000","last_fullsized":"2024-01-20T08:10:10.186426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757606+0000","last_change":"2024-01-20T08:10:07.770872+0000","last_active":"2024-01-20T08:10:09.757606+0000","last_peered":"2024-01-20T08:10:09.757606+0000","last_clean":"2024-01-20T08:10:09.757606+0000","last_became_active":"2024-01-20T08:10:07.770607+0000","last_became_peered":"2024-01-20T08:10:07.770607+0000","last_unstale":"2024-01-20T08:10:09.757606+0000","last_undegraded":"2024-01-20T08:10:09.757606+0000","last_fullsized":"2024-01-20T08:10:09.757606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.774148+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.773809+0000","last_became_peered":"2024-01-20T08:10:08.773809+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188851+0000","last_change":"2024-01-20T08:10:07.772528+0000","last_active":"2024-01-20T08:10:10.188851+0000","last_peered":"2024-01-20T08:10:10.188851+0000","last_clean":"2024-01-20T08:10:10.188851+0000","last_became_active":"2024-01-20T08:10:07.769568+0000","last_became_peered":"2024-01-20T08:10:07.769568+0000","last_unstale":"2024-01-20T08:10:10.188851+0000","last_undegraded":"2024-01-20T08:10:10.188851+0000","last_fullsized":"2024-01-20T08:10:10.188851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755908+0000","last_change":"2024-01-20T08:10:08.781307+0000","last_active":"2024-01-20T08:10:09.755908+0000","last_peered":"2024-01-20T08:10:09.755908+0000","last_clean":"2024-01-20T08:10:09.755908+0000","last_became_active":"2024-01-20T08:10:08.779605+0000","last_became_peered":"2024-01-20T08:10:08.779605+0000","last_unstale":"2024-01-20T08:10:09.755908+0000","last_undegraded":"2024-01-20T08:10:09.755908+0000","last_fullsized":"2024-01-20T08:10:09.755908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:02.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188853+0000","last_change":"2024-01-20T08:10:07.771605+0000","last_active":"2024-01-20T08:10:10.188853+0000","last_peered":"2024-01-20T08:10:10.188853+0000","last_clean":"2024-01-20T08:10:10.188853+0000","last_became_active":"2024-01-20T08:10:07.771371+0000","last_became_peered":"2024-01-20T08:10:07.771371+0000","last_unstale":"2024-01-20T08:10:10.188853+0000","last_undegraded":"2024-01-20T08:10:10.188853+0000","last_fullsized":"2024-01-20T08:10:10.188853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190748+0000","last_change":"2024-01-20T08:10:08.784437+0000","last_active":"2024-01-20T08:10:10.190748+0000","last_peered":"2024-01-20T08:10:10.190748+0000","last_clean":"2024-01-20T08:10:10.190748+0000","last_became_active":"2024-01-20T08:10:08.784168+0000","last_became_peered":"2024-01-20T08:10:08.784168+0000","last_unstale":"2024-01-20T08:10:10.190748+0000","last_undegraded":"2024-01-20T08:10:10.190748+0000","last_fullsized":"2024-01-20T08:10:10.190748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191198+0000","last_change":"2024-01-20T08:10:07.774618+0000","last_active":"2024-01-20T08:10:10.191198+0000","last_peered":"2024-01-20T08:10:10.191198+0000","last_clean":"2024-01-20T08:10:10.191198+0000","last_became_active":"2024-01-20T08:10:07.774350+0000","last_became_peered":"2024-01-20T08:10:07.774350+0000","last_unstale":"2024-01-20T08:10:10.191198+0000","last_undegraded":"2024-01-20T08:10:10.191198+0000","last_fullsized":"2024-01-20T08:10:10.191198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188744+0000","last_change":"2024-01-20T08:10:08.774147+0000","last_active":"2024-01-20T08:10:10.188744+0000","last_peered":"2024-01-20T08:10:10.188744+0000","last_clean":"2024-01-20T08:10:10.188744+0000","last_became_active":"2024-01-20T08:10:08.773823+0000","last_became_peered":"2024-01-20T08:10:08.773823+0000","last_unstale":"2024-01-20T08:10:10.188744+0000","last_undegraded":"2024-01-20T08:10:10.188744+0000","last_fullsized":"2024-01-20T08:10:10.188744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188657+0000","last_change":"2024-01-20T08:10:07.774279+0000","last_active":"2024-01-20T08:10:10.188657+0000","last_peered":"2024-01-20T08:10:10.188657+0000","last_clean":"2024-01-20T08:10:10.188657+0000","last_became_active":"2024-01-20T08:10:07.774002+0000","last_became_peered":"2024-01-20T08:10:07.774002+0000","last_unstale":"2024-01-20T08:10:10.188657+0000","last_undegraded":"2024-01-20T08:10:10.188657+0000","last_fullsized":"2024-01-20T08:10:10.188657+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755901+0000","last_change":"2024-01-20T08:10:08.775836+0000","last_active":"2024-01-20T08:10:09.755901+0000","last_peered":"2024-01-20T08:10:09.755901+0000","last_clean":"2024-01-20T08:10:09.755901+0000","last_became_active":"2024-01-20T08:10:08.770776+0000","last_became_peered":"2024-01-20T08:10:08.770776+0000","last_unstale":"2024-01-20T08:10:09.755901+0000","last_undegraded":"2024-01-20T08:10:09.755901+0000","last_fullsized":"2024-01-20T08:10:09.755901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192752+0000","last_change":"2024-01-20T08:10:07.777758+0000","last_active":"2024-01-20T08:10:10.192752+0000","last_peered":"2024-01-20T08:10:10.192752+0000","last_clean":"2024-01-20T08:10:10.192752+0000","last_became_active":"2024-01-20T08:10:07.773502+0000","last_became_peered":"2024-01-20T08:10:07.773502+0000","last_unstale":"2024-01-20T08:10:10.192752+0000","last_undegraded":"2024-01-20T08:10:10.192752+0000","last_fullsized":"2024-01-20T08:10:10.192752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186956+0000","last_change":"2024-01-20T08:10:08.782036+0000","last_active":"2024-01-20T08:10:10.186956+0000","last_peered":"2024-01-20T08:10:10.186956+0000","last_clean":"2024-01-20T08:10:10.186956+0000","last_became_active":"2024-01-20T08:10:08.781743+0000","last_became_peered":"2024-01-20T08:10:08.781743+0000","last_unstale":"2024-01-20T08:10:10.186956+0000","last_undegraded":"2024-01-20T08:10:10.186956+0000","last_fullsized":"2024-01-20T08:10:10.186956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188450+0000","last_change":"2024-01-20T08:10:07.775094+0000","last_active":"2024-01-20T08:10:10.188450+0000","last_peered":"2024-01-20T08:10:10.188450+0000","last_clean":"2024-01-20T08:10:10.188450+0000","last_became_active":"2024-01-20T08:10:07.774836+0000","last_became_peered":"2024-01-20T08:10:07.774836+0000","last_unstale":"2024-01-20T08:10:10.188450+0000","last_undegraded":"2024-01-20T08:10:10.188450+0000","last_fullsized":"2024-01-20T08:10:10.188450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755687+0000","last_change":"2024-01-20T08:10:08.785065+0000","last_active":"2024-01-20T08:10:09.755687+0000","last_peered":"2024-01-20T08:10:09.755687+0000","last_clean":"2024-01-20T08:10:09.755687+0000","last_became_active":"2024-01-20T08:10:08.782610+0000","last_became_peered":"2024-01-20T08:10:08.782610+0000","last_unstale":"2024-01-20T08:10:09.755687+0000","last_undegraded":"2024-01-20T08:10:09.755687+0000","last_fullsized":"2024-01-20T08:10:09.755687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188086+0000","last_change":"2024-01-20T08:10:07.770741+0000","last_active":"2024-01-20T08:10:10.188086+0000","last_peered":"2024-01-20T08:10:10.188086+0000","last_clean":"2024-01-20T08:10:10.188086+0000","last_became_active":"2024-01-20T08:10:07.770315+0000","last_became_peered":"2024-01-20T08:10:07.770315+0000","last_unstale":"2024-01-20T08:10:10.188086+0000","last_undegraded":"2024-01-20T08:10:10.188086+0000","last_fullsized":"2024-01-20T08:10:10.188086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754531+0000","last_change":"2024-01-20T08:10:08.775245+0000","last_active":"2024-01-20T08:10:09.754531+0000","last_peered":"2024-01-20T08:10:09.754531+0000","last_clean":"2024-01-20T08:10:09.754531+0000","last_became_active":"2024-01-20T08:10:08.774956+0000","last_became_peered":"2024-01-20T08:10:08.774956+0000","last_unstale":"2024-01-20T08:10:09.754531+0000","last_undegraded":"2024-01-20T08:10:09.754531+0000","last_fullsized":"2024-01-20T08:10:09.754531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188622+0000","last_change":"2024-01-20T08:10:07.772612+0000","last_active":"2024-01-20T08:10:10.188622+0000","last_peered":"2024-01-20T08:10:10.188622+0000","last_clean":"2024-01-20T08:10:10.188622+0000","last_became_active":"2024-01-20T08:10:07.772238+0000","last_became_peered":"2024-01-20T08:10:07.772238+0000","last_unstale":"2024-01-20T08:10:10.188622+0000","last_undegraded":"2024-01-20T08:10:10.188622+0000","last_fullsized":"2024-01-20T08:10:10.188622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755280+0000","last_change":"2024-01-20T08:10:08.780781+0000","last_active":"2024-01-20T08:10:09.755280+0000","last_peered":"2024-01-20T08:10:09.755280+0000","last_clean":"2024-01-20T08:10:09.755280+0000","last_became_active":"2024-01-20T08:10:08.780502+0000","last_became_peered":"2024-01-20T08:10:08.780502+0000","last_unstale":"2024-01-20T08:10:09.755280+0000","last_undegraded":"2024-01-20T08:10:09.755280+0000","last_fullsized":"2024-01-20T08:10:09.755280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192526+0000","last_change":"2024-01-20T08:10:07.769908+0000","last_active":"2024-01-20T08:10:10.192526+0000","last_peered":"2024-01-20T08:10:10.192526+0000","last_clean":"2024-01-20T08:10:10.192526+0000","last_became_active":"2024-01-20T08:10:07.769315+0000","last_became_peered":"2024-01-20T08:10:07.769315+0000","last_unstale":"2024-01-20T08:10:10.192526+0000","last_undegraded":"2024-01-20T08:10:10.192526+0000","last_fullsized":"2024-01-20T08:10:10.192526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189995+0000","last_change":"2024-01-20T08:10:08.789928+0000","last_active":"2024-01-20T08:10:10.189995+0000","last_peered":"2024-01-20T08:10:10.189995+0000","last_clean":"2024-01-20T08:10:10.189995+0000","last_became_active":"2024-01-20T08:10:08.789486+0000","last_became_peered":"2024-01-20T08:10:08.789486+0000","last_unstale":"2024-01-20T08:10:10.189995+0000","last_undegraded":"2024-01-20T08:10:10.189995+0000","last_fullsized":"2024-01-20T08:10:10.189995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190318+0000","last_change":"2024-01-20T08:10:08.788327+0000","last_active":"2024-01-20T08:10:10.190318+0000","last_peered":"2024-01-20T08:10:10.190318+0000","last_clean":"2024-01-20T08:10:10.190318+0000","last_became_active":"2024-01-20T08:10:08.788050+0000","last_became_peered":"2024-01-20T08:10:08.788050+0000","last_unstale":"2024-01-20T08:10:10.190318+0000","last_undegraded":"2024-01-20T08:10:10.190318+0000","last_fullsized":"2024-01-20T08:10:10.190318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192978+0000","last_change":"2024-01-20T08:10:07.783387+0000","last_active":"2024-01-20T08:10:10.192978+0000","last_peered":"2024-01-20T08:10:10.192978+0000","last_clean":"2024-01-20T08:10:10.192978+0000","last_became_active":"2024-01-20T08:10:07.783090+0000","last_became_peered":"2024-01-20T08:10:07.783090+0000","last_unstale":"2024-01-20T08:10:10.192978+0000","last_undegraded":"2024-01-20T08:10:10.192978+0000","last_fullsized":"2024-01-20T08:10:10.192978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188183+0000","last_change":"2024-01-20T08:10:08.788111+0000","last_active":"2024-01-20T08:10:10.188183+0000","last_peered":"2024-01-20T08:10:10.188183+0000","last_clean":"2024-01-20T08:10:10.188183+0000","last_became_active":"2024-01-20T08:10:08.787785+0000","last_became_peered":"2024-01-20T08:10:08.787785+0000","last_unstale":"2024-01-20T08:10:10.188183+0000","last_undegraded":"2024-01-20T08:10:10.188183+0000","last_fullsized":"2024-01-20T08:10:10.188183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190593+0000","last_change":"2024-01-20T08:10:07.773272+0000","last_active":"2024-01-20T08:10:10.190593+0000","last_peered":"2024-01-20T08:10:10.190593+0000","last_clean":"2024-01-20T08:10:10.190593+0000","last_became_active":"2024-01-20T08:10:07.772994+0000","last_became_peered":"2024-01-20T08:10:07.772994+0000","last_unstale":"2024-01-20T08:10:10.190593+0000","last_undegraded":"2024-01-20T08:10:10.190593+0000","last_fullsized":"2024-01-20T08:10:10.190593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187781+0000","last_change":"2024-01-20T08:10:08.792517+0000","last_active":"2024-01-20T08:10:10.187781+0000","last_peered":"2024-01-20T08:10:10.187781+0000","last_clean":"2024-01-20T08:10:10.187781+0000","last_became_active":"2024-01-20T08:10:08.792227+0000","last_became_peered":"2024-01-20T08:10:08.792227+0000","last_unstale":"2024-01-20T08:10:10.187781+0000","last_undegraded":"2024-01-20T08:10:10.187781+0000","last_fullsized":"2024-01-20T08:10:10.187781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755753+0000","last_change":"2024-01-20T08:10:07.753907+0000","last_active":"2024-01-20T08:10:09.755753+0000","last_peered":"2024-01-20T08:10:09.755753+0000","last_clean":"2024-01-20T08:10:09.755753+0000","last_became_active":"2024-01-20T08:10:07.753601+0000","last_became_peered":"2024-01-20T08:10:07.753601+0000","last_unstale":"2024-01-20T08:10:09.755753+0000","last_undegraded":"2024-01-20T08:10:09.755753+0000","last_fullsized":"2024-01-20T08:10:09.755753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:08:42.443428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755706+0000","last_change":"2024-01-20T08:10:08.789390+0000","last_active":"2024-01-20T08:10:09.755706+0000","last_peered":"2024-01-20T08:10:09.755706+0000","last_clean":"2024-01-20T08:10:09.755706+0000","last_became_active":"2024-01-20T08:10:08.789026+0000","last_became_peered":"2024-01-20T08:10:08.789026+0000","last_unstale":"2024-01-20T08:10:09.755706+0000","last_undegraded":"2024-01-20T08:10:09.755706+0000","last_fullsized":"2024-01-20T08:10:09.755706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187992+0000","last_change":"2024-01-20T08:10:07.768390+0000","last_active":"2024-01-20T08:10:10.187992+0000","last_peered":"2024-01-20T08:10:10.187992+0000","last_clean":"2024-01-20T08:10:10.187992+0000","last_became_active":"2024-01-20T08:10:07.768097+0000","last_became_peered":"2024-01-20T08:10:07.768097+0000","last_unstale":"2024-01-20T08:10:10.187992+0000","last_undegraded":"2024-01-20T08:10:10.187992+0000","last_fullsized":"2024-01-20T08:10:10.187992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":827392,"data_stored":671588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.008}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.843}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.3570000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.069}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.847}]}]},{"osd":6,"up_from":13,"seq":55834574851,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3819999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.333}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.121}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":80728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2889999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4179999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0529999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4630000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5629999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":80764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1020000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6160000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.153}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9239999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.286}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":80638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0510000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.992}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.292}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.724}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6950000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.452}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":835584,"data_stored":671644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70199999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9870000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:10:13.854 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:10:13.854 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-01-20T08:10:13.854 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-01-20T08:10:13.854 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-01-20T08:10:13.855 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-01-20T08:10:14.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.093+0000 7f7ba7800640 1 Processor -- start 2024-01-20T08:10:14.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.094+0000 7f7ba7800640 1 -- start start 2024-01-20T08:10:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ba0071220 0x7f7ba0071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ba00bfae0 0x7f7ba0151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00c04a0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba00c0fb0 con 0x7f7ba0071220 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba006def0 con 0x7f7ba01521e0 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7b9fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ba00bfae0 0x7f7ba0151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7b9fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ba00bfae0 0x7f7ba0151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57776/0 (socket says 172.21.15.100:57776) 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7b9fe00640 1 -- 172.21.15.100:0/3066993271 learned_addr learned my addr 172.21.15.100:0/3066993271 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba5800640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.095+0000 7f7ba4e00640 1 --2- 172.21.15.100:0/3066993271 >> v2:172.21.15.110:3300/0 conn(0x7f7ba0071220 0x7f7ba0071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.096+0000 7f7b9fe00640 1 -- 172.21.15.100:0/3066993271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 msgr2=0x7f7ba0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.096+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.096+0000 7f7b9fe00640 1 -- 172.21.15.100:0/3066993271 >> v2:172.21.15.110:3300/0 conn(0x7f7ba0071220 msgr2=0x7f7ba0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.096+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/3066993271 >> v2:172.21.15.110:3300/0 conn(0x7f7ba0071220 0x7f7ba0071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.096+0000 7f7b9fe00640 1 -- 172.21.15.100:0/3066993271 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba006e1d0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.097+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba0151ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ba006f920 tx=0x7f7b8802b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537d6f3fd23144bd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.097+0000 7f7b9f400640 1 -- 172.21.15.100:0/3066993271 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88031750 con 0x7f7ba00bfae0 2024-01-20T08:10:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.097+0000 7f7b9f400640 1 -- 172.21.15.100:0/3066993271 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b880318b0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.097+0000 7f7b9f400640 1 -- 172.21.15.100:0/3066993271 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88031c40 con 0x7f7ba00bfae0 2024-01-20T08:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 -- 172.21.15.100:0/3066993271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 msgr2=0x7f7ba0151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba0151ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7ba006f920 tx=0x7f7b8802b7f0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 -- 172.21.15.100:0/3066993271 shutdown_connections 2024-01-20T08:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 --2- 172.21.15.100:0/3066993271 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba0151ca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 --2- 172.21.15.100:0/3066993271 >> v2:172.21.15.110:3300/0 conn(0x7f7ba0071220 0x7f7ba0071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 -- 172.21.15.100:0/3066993271 >> 172.21.15.100:0/3066993271 conn(0x7f7ba006a5e0 msgr2=0x7f7ba006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 -- 172.21.15.100:0/3066993271 shutdown_connections 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.098+0000 7f7ba7800640 1 -- 172.21.15.100:0/3066993271 wait complete. 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.100+0000 7f7ba7800640 1 Processor -- start 2024-01-20T08:10:14.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.100+0000 7f7ba7800640 1 -- start start 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ba0071220 0x7f7ba0153d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba01eac20 con 0x7f7ba00bfae0 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba00abb70 con 0x7f7ba0071220 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba0152eb0 con 0x7f7ba01521e0 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57790/0 (socket says 172.21.15.100:57790) 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 -- 172.21.15.100:0/842447773 learned_addr learned my addr 172.21.15.100:0/842447773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba5800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 -- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 msgr2=0x7f7ba0152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba4e00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ba0071220 0x7f7ba0153d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 -- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ba0071220 msgr2=0x7f7ba0153d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ba0071220 0x7f7ba0153d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7b9fe00640 1 -- 172.21.15.100:0/842447773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880094d0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.101+0000 7f7ba5800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7b9fe00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b88033c80 con 0x7f7ba00bfae0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b88033e00 con 0x7f7ba00bfae0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba00ab1b0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b8803c640 con 0x7f7ba00bfae0 2024-01-20T08:10:14.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.102+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba00ac0a0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.103+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba004e970 con 0x7f7ba00bfae0 2024-01-20T08:10:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.104+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7b8803a040 con 0x7f7ba00bfae0 2024-01-20T08:10:14.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.105+0000 7f7b9cc00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 0x7f7b7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.105+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b880ab1a0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.105+0000 7f7ba4e00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 0x7f7b7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.106+0000 7f7ba4e00640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 0x7f7b7806d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b90006fd0 tx=0x7f7b90008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.109+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7b88076060 con 0x7f7ba00bfae0 2024-01-20T08:10:14.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.353+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7ba014e0e0 con 0x7f7ba00bfae0 2024-01-20T08:10:14.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.358+0000 7f7b9cc00640 1 -- 172.21.15.100:0/842447773 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+170775 (secure 0 0 0) 0x7f7b88079680 con 0x7f7ba00bfae0 2024-01-20T08:10:14.364 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 msgr2=0x7f7b7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 0x7f7b7806d3c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b90006fd0 tx=0x7f7b90008040 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 msgr2=0x7f7ba01ea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7b88000c00 tx=0x7f7b880046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 shutdown_connections 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7b7806af00 0x7f7b7806d3c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ba01521e0 0x7f7ba0152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba00bfae0 0x7f7ba01ea6e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 --2- 172.21.15.100:0/842447773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ba0071220 0x7f7ba0153d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.363+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 >> 172.21.15.100:0/842447773 conn(0x7f7ba006a5e0 msgr2=0x7f7ba0150260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.364+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 shutdown_connections 2024-01-20T08:10:14.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.364+0000 7f7ba7800640 1 -- 172.21.15.100:0/842447773 wait complete. 2024-01-20T08:10:14.385 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":5,"active_gid":4109,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":3001793226},{"type":"v1","addr":"172.21.15.100:6833","nonce":3001793226}]},"active_addr":"172.21.15.100:6833/3001793226","active_change":"2024-01-20T08:09:53.860460+0000","active_mgr_features":4540701272860131327,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540701272860131327,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":3521703161}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":215911357}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":4193859268}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.100:0","nonce":2456994265}]}]} 2024-01-20T08:10:14.388 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-01-20T08:10:14.389 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-01-20T08:10:14.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.586+0000 7f2177800640 1 Processor -- start 2024-01-20T08:10:14.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.586+0000 7f2177800640 1 -- start start 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.587+0000 7f2177800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21700c7fb0 0x7f217006b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.587+0000 7f2177800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f217006b660 0x7f21700c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.587+0000 7f2177800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21700c5310 con 0x7f2170151f40 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.587+0000 7f2177800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f217006bf90 con 0x7f21700c7fb0 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.587+0000 7f2177800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21700c4ff0 con 0x7f217006b660 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f2174e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2170151f40 0x7f21701551d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55524/0 (socket says 172.21.15.100:55524) 2024-01-20T08:10:14.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f2174e00640 1 -- 172.21.15.100:0/2511732550 learned_addr learned my addr 172.21.15.100:0/2511732550 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216fe00640 1 --2- 172.21.15.100:0/2511732550 >> v2:172.21.15.100:3300/0 conn(0x7f21700c7fb0 0x7f217006b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f2175800640 1 --2- 172.21.15.100:0/2511732550 >> v2:172.21.15.110:3300/0 conn(0x7f217006b660 0x7f21700c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216f400640 1 -- 172.21.15.100:0/2511732550 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3242076668 0 0) 0x7f21700c5310 con 0x7f2170151f40 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216f400640 1 -- 172.21.15.100:0/2511732550 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2150003520 con 0x7f2170151f40 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216fe00640 1 -- 172.21.15.100:0/2511732550 >> v2:172.21.15.110:3300/0 conn(0x7f217006b660 msgr2=0x7f21700c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216fe00640 1 --2- 172.21.15.100:0/2511732550 >> v2:172.21.15.110:3300/0 conn(0x7f217006b660 0x7f21700c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216fe00640 1 -- 172.21.15.100:0/2511732550 >> v1:172.21.15.100:6789/0 conn(0x7f2170151f40 legacy=0x7f21701551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.588+0000 7f216fe00640 1 -- 172.21.15.100:0/2511732550 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21700c55d0 con 0x7f21700c7fb0 2024-01-20T08:10:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.589+0000 7f216fe00640 1 --2- 172.21.15.100:0/2511732550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f217006b120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2170074570 tx=0x7f215802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48487aedfc1407a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f216f400640 1 -- 172.21.15.100:0/2511732550 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158030610 con 0x7f21700c7fb0 2024-01-20T08:10:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f216f400640 1 -- 172.21.15.100:0/2511732550 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158030770 con 0x7f21700c7fb0 2024-01-20T08:10:14.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f216f400640 1 -- 172.21.15.100:0/2511732550 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158030b00 con 0x7f21700c7fb0 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 -- 172.21.15.100:0/2511732550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 msgr2=0x7f217006b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 --2- 172.21.15.100:0/2511732550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f217006b120 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2170074570 tx=0x7f215802b960 comp rx=0 tx=0).stop 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 -- 172.21.15.100:0/2511732550 shutdown_connections 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 --2- 172.21.15.100:0/2511732550 >> v2:172.21.15.110:3300/0 conn(0x7f217006b660 0x7f21700c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 --2- 172.21.15.100:0/2511732550 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f217006b120 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 -- 172.21.15.100:0/2511732550 >> 172.21.15.100:0/2511732550 conn(0x7f21700ca0b0 msgr2=0x7f21700ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 -- 172.21.15.100:0/2511732550 shutdown_connections 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.590+0000 7f2177800640 1 -- 172.21.15.100:0/2511732550 wait complete. 2024-01-20T08:10:14.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.592+0000 7f2177800640 1 Processor -- start 2024-01-20T08:10:14.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.592+0000 7f2177800640 1 -- start start 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f217006b660 0x7f21700c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2170151f40 0x7f21700bfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c1950 con 0x7f21700c7fb0 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c4530 con 0x7f217006b660 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f2177800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21700c4250 con 0x7f2170151f40 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f216fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f216fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57806/0 (socket says 172.21.15.100:57806) 2024-01-20T08:10:14.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.593+0000 7f216fe00640 1 -- 172.21.15.100:0/3100293022 learned_addr learned my addr 172.21.15.100:0/3100293022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 -- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2170151f40 msgr2=0x7f21700bfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2170151f40 0x7f21700bfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 -- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f217006b660 msgr2=0x7f21700c1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f217006b660 0x7f21700c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 -- 172.21.15.100:0/3100293022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2158009400 con 0x7f21700c7fb0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216fe00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f215802bf70 tx=0x7f2158004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215803e040 con 0x7f21700c7fb0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2158039cb0 con 0x7f21700c7fb0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21700c1290 con 0x7f21700c7fb0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2158043680 con 0x7f21700c7fb0 2024-01-20T08:10:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.594+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2170153dc0 con 0x7f21700c7fb0 2024-01-20T08:10:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.595+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21700c1bc0 con 0x7f21700c7fb0 2024-01-20T08:10:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.596+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f21580437e0 con 0x7f21700c7fb0 2024-01-20T08:10:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.597+0000 7f216cc00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 0x7f214806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.597+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21580ab820 con 0x7f21700c7fb0 2024-01-20T08:10:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.597+0000 7f2174e00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 0x7f214806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.598+0000 7f2174e00640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 0x7f214806d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2160000f60 tx=0x7f21600078f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.601+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2158076780 con 0x7f21700c7fb0 2024-01-20T08:10:14.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.794+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f217004e970 con 0x7f21700c7fb0 2024-01-20T08:10:14.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.796+0000 7f216cc00640 1 -- 172.21.15.100:0/3100293022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f2158034090 con 0x7f21700c7fb0 2024-01-20T08:10:14.800 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:14.800 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 msgr2=0x7f214806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 0x7f214806d390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2160000f60 tx=0x7f21600078f0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 msgr2=0x7f2170153880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f215802bf70 tx=0x7f2158004730 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 shutdown_connections 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f214806aed0 0x7f214806d390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2170151f40 0x7f21700bfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21700c7fb0 0x7f2170153880 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 --2- 172.21.15.100:0/3100293022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f217006b660 0x7f21700c1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 >> 172.21.15.100:0/3100293022 conn(0x7f21700ca0b0 msgr2=0x7f217014fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:14.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.799+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 shutdown_connections 2024-01-20T08:10:14.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:14.800+0000 7f2177800640 1 -- 172.21.15.100:0/3100293022 wait complete. 2024-01-20T08:10:14.820 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-01-20T08:10:14.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:15.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.030+0000 7fac92a00640 1 Processor -- start 2024-01-20T08:10:15.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.030+0000 7fac92a00640 1 -- start start 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac92a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac8c06b3b0 0x7fac8c155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac92a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c155790 con 0x7fac8c0c8ae0 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac92a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac8c0c8650 con 0x7fac8c1519a0 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac92a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8c0c8070 con 0x7fac8c06b3b0 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac8be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fac8c06b3b0 0x7fac8c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac83200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac8c0c8ae0 0x7fac8c155cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55540/0 (socket says 172.21.15.100:55540) 2024-01-20T08:10:15.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.031+0000 7fac83200640 1 -- 172.21.15.100:0/4227992449 learned_addr learned my addr 172.21.15.100:0/4227992449 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.032+0000 7fac8be00640 1 -- 172.21.15.100:0/4227992449 >> v1:172.21.15.110:6789/0 conn(0x7fac8c1519a0 legacy=0x7fac8c15f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.032+0000 7fac8be00640 1 -- 172.21.15.100:0/4227992449 >> v1:172.21.15.100:6789/0 conn(0x7fac8c0c8ae0 legacy=0x7fac8c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.032+0000 7fac8be00640 1 -- 172.21.15.100:0/4227992449 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac8c0c4dd0 con 0x7fac8c06b3b0 2024-01-20T08:10:15.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.032+0000 7fac8b400640 1 -- 172.21.15.100:0/4227992449 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283490648 0 0) 0x7fac74001110 con 0x7fac8c0c8ae0 2024-01-20T08:10:15.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.033+0000 7fac8be00640 1 --2- 172.21.15.100:0/4227992449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c155250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0097a0 tx=0x7fac7c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=743123e03b91ffd3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.033+0000 7fac8b400640 1 -- 172.21.15.100:0/4227992449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c02e070 con 0x7fac8c06b3b0 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.033+0000 7fac8b400640 1 -- 172.21.15.100:0/4227992449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c0315a0 con 0x7fac8c06b3b0 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.033+0000 7fac8b400640 1 -- 172.21.15.100:0/4227992449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c031930 con 0x7fac8c06b3b0 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 -- 172.21.15.100:0/4227992449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 msgr2=0x7fac8c155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 --2- 172.21.15.100:0/4227992449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c155250 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fac7c0097a0 tx=0x7fac7c02b840 comp rx=0 tx=0).stop 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 -- 172.21.15.100:0/4227992449 shutdown_connections 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 --2- 172.21.15.100:0/4227992449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c155250 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 -- 172.21.15.100:0/4227992449 >> 172.21.15.100:0/4227992449 conn(0x7fac8c0abc00 msgr2=0x7fac8c0ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 -- 172.21.15.100:0/4227992449 shutdown_connections 2024-01-20T08:10:15.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.034+0000 7fac92a00640 1 -- 172.21.15.100:0/4227992449 wait complete. 2024-01-20T08:10:15.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.035+0000 7fac92a00640 1 Processor -- start 2024-01-20T08:10:15.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 -- start start 2024-01-20T08:10:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c8ae0 0x7fac8c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c1519a0 0x7fac8c146d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c147270 con 0x7fac8c06b3b0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c14d3d0 con 0x7fac8c1519a0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.036+0000 7fac92a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8c153690 con 0x7fac8c0c8ae0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57810/0 (socket says 172.21.15.100:57810) 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 -- 172.21.15.100:0/3478859117 learned_addr learned my addr 172.21.15.100:0/3478859117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 -- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c8ae0 msgr2=0x7fac8c1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c8ae0 0x7fac8c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 -- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c1519a0 msgr2=0x7fac8c146d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c1519a0 0x7fac8c146d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 -- 172.21.15.100:0/3478859117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac7c009400 con 0x7fac8c06b3b0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.037+0000 7fac8be00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac7c034040 tx=0x7fac7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.038+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c032900 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.038+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7c032a60 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.038+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7c032e10 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.038+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8c14c290 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.038+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8c14e160 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.039+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac8c1ea060 con 0x7fac8c06b3b0 2024-01-20T08:10:15.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.040+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fac7c03b3f0 con 0x7fac8c06b3b0 2024-01-20T08:10:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.040+0000 7fac88c00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 0x7fac6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.041+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac7c0ab630 con 0x7fac8c06b3b0 2024-01-20T08:10:15.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.041+0000 7fac83200640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 0x7fac6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.041+0000 7fac83200640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 0x7fac6406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac74007fd0 tx=0x7fac74007960 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.045+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fac8c1ea060 con 0x7fac8c06b3b0 2024-01-20T08:10:15.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.238+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac8c14c290 con 0x7fac8c06b3b0 2024-01-20T08:10:15.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.241+0000 7fac88c00640 1 -- 172.21.15.100:0/3478859117 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fac8c14c290 con 0x7fac8c06b3b0 2024-01-20T08:10:15.245 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:15.245 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 msgr2=0x7fac6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 0x7fac6406d390 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fac74007fd0 tx=0x7fac74007960 comp rx=0 tx=0).stop 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 msgr2=0x7fac8c154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fac7c034040 tx=0x7fac7c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 shutdown_connections 2024-01-20T08:10:15.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac8c1519a0 0x7fac8c146d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac6406aed0 0x7fac6406d390 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac8c0c8ae0 0x7fac8c1467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 --2- 172.21.15.100:0/3478859117 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac8c06b3b0 0x7fac8c154f90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 >> 172.21.15.100:0/3478859117 conn(0x7fac8c0abc00 msgr2=0x7fac8c0abfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 shutdown_connections 2024-01-20T08:10:15.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.244+0000 7fac92a00640 1 -- 172.21.15.100:0/3478859117 wait complete. 2024-01-20T08:10:15.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-01-20T08:10:15.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-01-20T08:10:15.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-01-20T08:10:15.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-01-20T08:10:15.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-01-20T08:10:15.266 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-01-20T08:10:15.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-01-20T08:10:15.267 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-01-20T08:10:15.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.551+0000 7fd72ba00640 1 Processor -- start 2024-01-20T08:10:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.552+0000 7fd72ba00640 1 -- start start 2024-01-20T08:10:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.553+0000 7fd72ba00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd724151e40 0x7fd7240c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd72ba00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240c9f30 con 0x7fd724155290 2024-01-20T08:10:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd72ba00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7240c87a0 con 0x7fd7240c4a50 2024-01-20T08:10:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd72ba00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd72406c5a0 con 0x7fd724151e40 2024-01-20T08:10:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd723e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd7240c4a50 0x7fd724155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42338/0 (socket says 172.21.15.100:42338) 2024-01-20T08:10:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd84ea00640 1 Processor -- start 2024-01-20T08:10:15.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.554+0000 7fd723e00640 1 -- 172.21.15.100:0/1359922993 learned_addr learned my addr 172.21.15.100:0/1359922993 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.555+0000 7fd729000640 1 --2- 172.21.15.100:0/1359922993 >> v2:172.21.15.110:3300/0 conn(0x7fd724151e40 0x7fd7240c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.555+0000 7fd84ea00640 1 -- start start 2024-01-20T08:10:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.555+0000 7fd723400640 1 -- 172.21.15.100:0/1359922993 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3369622876 0 0) 0x7fd71c001490 con 0x7fd724155290 2024-01-20T08:10:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.555+0000 7fd723400640 1 -- 172.21.15.100:0/1359922993 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd704003520 con 0x7fd724155290 2024-01-20T08:10:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.555+0000 7fd729000640 1 -- 172.21.15.100:0/1359922993 >> v1:172.21.15.110:6789/0 conn(0x7fd7240c4a50 legacy=0x7fd724155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.556+0000 7fd723400640 1 -- 172.21.15.100:0/1359922993 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2551110779 0 0) 0x7fd704003520 con 0x7fd724155290 2024-01-20T08:10:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.556+0000 7fd84ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd84806b140 0x7fd848154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd84ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 0x7fd84806b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd84ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8480c9100 con 0x7fd848155eb0 2024-01-20T08:10:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd729000640 1 -- 172.21.15.100:0/1359922993 >> v1:172.21.15.100:6789/0 conn(0x7fd724155290 legacy=0x7fd72406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd84ea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8480c84f0 con 0x7fd84806b140 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.558+0000 7fd84ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c87d0 con 0x7fd8480c7ff0 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd847e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd84806b140 0x7fd848154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.557+0000 7fd84ca00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fd848155eb0 0x7fd848156360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42350/0 (socket says 172.21.15.100:42350) 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.558+0000 7fd84ca00640 1 -- 172.21.15.100:0/1638525734 learned_addr learned my addr 172.21.15.100:0/1638525734 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.558+0000 7fd847e00640 1 --2- 172.21.15.100:0/1638525734 >> v2:172.21.15.110:3300/0 conn(0x7fd84806b140 0x7fd848154810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53114/0 (socket says 172.21.15.100:53114) 2024-01-20T08:10:15.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.558+0000 7fd847400640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 0x7fd84806b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.558+0000 7fd729000640 1 -- 172.21.15.100:0/1359922993 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd724156410 con 0x7fd724151e40 2024-01-20T08:10:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd846a00640 1 -- 172.21.15.100:0/1638525734 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733403798 0 0) 0x7fd8480c9100 con 0x7fd848155eb0 2024-01-20T08:10:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd846a00640 1 -- 172.21.15.100:0/1638525734 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd828003520 con 0x7fd848155eb0 2024-01-20T08:10:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd847e00640 1 -- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 msgr2=0x7fd84806b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd847e00640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 0x7fd84806b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd847e00640 1 -- 172.21.15.100:0/1638525734 >> v1:172.21.15.110:6789/0 conn(0x7fd848155eb0 legacy=0x7fd848156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd847e00640 1 -- 172.21.15.100:0/1638525734 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8480c8ab0 con 0x7fd84806b140 2024-01-20T08:10:15.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.559+0000 7fd729000640 1 --2- 172.21.15.100:0/1359922993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724151e40 0x7fd7240c8c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd714009720 tx=0x7fd71402b570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1454a860b2a2a58c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.560+0000 7fd847400640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 0x7fd84806b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:15.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.560+0000 7fd723400640 1 -- 172.21.15.100:0/1359922993 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71c001b80 con 0x7fd724151e40 2024-01-20T08:10:15.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7f6e9fe00640 1 Processor -- start 2024-01-20T08:10:15.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7fd847e00640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84806b140 0x7fd848154810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd840009dc0 tx=0x7fd84002bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1d4296fd88bc282 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.560+0000 7fd723400640 1 -- 172.21.15.100:0/1359922993 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd71402e050 con 0x7fd724151e40 2024-01-20T08:10:15.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7fd72ba00640 1 -- 172.21.15.100:0/1359922993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724151e40 msgr2=0x7fd7240c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7fd72ba00640 1 --2- 172.21.15.100:0/1359922993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724151e40 0x7fd7240c8c30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd714009720 tx=0x7fd71402b570 comp rx=0 tx=0).stop 2024-01-20T08:10:15.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7f6e9fe00640 1 -- start start 2024-01-20T08:10:15.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7fd72ba00640 1 -- 172.21.15.100:0/1359922993 shutdown_connections 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.561+0000 7fd72ba00640 1 --2- 172.21.15.100:0/1359922993 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724151e40 0x7fd7240c8c30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.562+0000 7fd72ba00640 1 -- 172.21.15.100:0/1359922993 >> 172.21.15.100:0/1359922993 conn(0x7fd7240abde0 msgr2=0x7fd7240ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.562+0000 7fd72ba00640 1 -- 172.21.15.100:0/1359922993 shutdown_connections 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.562+0000 7fd72ba00640 1 -- 172.21.15.100:0/1359922993 wait complete. 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.562+0000 7f6e9fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6ea014e690 0x7f6ea01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea0157d00 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ea00c4890 con 0x7f6ea014e690 2024-01-20T08:10:15.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea006cd00 con 0x7f6ea00c7e10 2024-01-20T08:10:15.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7fe0a5400640 1 Processor -- start 2024-01-20T08:10:15.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7fe0a5400640 1 -- start start 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9f400640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f6ea00ca9a0 0x7f6ea01581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42362/0 (socket says 172.21.15.100:42362) 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.563+0000 7f6e9f400640 1 -- 172.21.15.100:0/1912801060 learned_addr learned my addr 172.21.15.100:0/1912801060 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7f6e9d600640 1 -- 172.21.15.100:0/1912801060 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747144711 0 0) 0x7f6ea0157d00 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7f6e9d600640 1 -- 172.21.15.100:0/1912801060 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e80003520 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7f6e9e000640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7fd846a00640 1 -- 172.21.15.100:0/1638525734 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd84002cba0 con 0x7fd84806b140 2024-01-20T08:10:15.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7fd846a00640 1 -- 172.21.15.100:0/1638525734 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84002cd00 con 0x7fd84806b140 2024-01-20T08:10:15.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.564+0000 7f6e9ea00640 1 --2- 172.21.15.100:0/1912801060 >> v2:172.21.15.100:3300/0 conn(0x7f6ea014e690 0x7f6ea01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fd846a00640 1 -- 172.21.15.100:0/1638525734 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840034660 con 0x7fd84806b140 2024-01-20T08:10:15.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fd72ba00640 1 Processor -- start 2024-01-20T08:10:15.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fd72ba00640 1 -- start start 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7f6e9ea00640 1 -- 172.21.15.100:0/1912801060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 msgr2=0x7f6ea00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7f6e9ea00640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 -- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84806b140 msgr2=0x7fd848154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84806b140 0x7fd848154810 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd840009dc0 tx=0x7fd84002bdf0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 -- 172.21.15.100:0/1638525734 shutdown_connections 2024-01-20T08:10:15.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd8480c7ff0 0x7fd84806b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 --2- 172.21.15.100:0/1638525734 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd84806b140 0x7fd848154810 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fd84ea00640 1 -- 172.21.15.100:0/1638525734 >> 172.21.15.100:0/1638525734 conn(0x7fd8480abc80 msgr2=0x7fd8480ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fe0a5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fe0a5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe0a00c4a50 0x7fe0a0155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.565+0000 7fe0a5400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0a00c9f30 con 0x7fe0a0155d00 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fe0a5400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a006c5a0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fe09f200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe0a0155d00 0x7fe0a006b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55554/0 (socket says 172.21.15.100:55554) 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fe09f200640 1 -- 172.21.15.100:0/2679735521 learned_addr learned my addr 172.21.15.100:0/2679735521 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a01557d0 con 0x7fe0a0151e40 2024-01-20T08:10:15.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7f6e9ea00640 1 -- 172.21.15.100:0/1912801060 >> v1:172.21.15.110:6789/0 conn(0x7f6ea00ca9a0 legacy=0x7f6ea01581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.566+0000 7f6e9ea00640 1 -- 172.21.15.100:0/1912801060 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea00c4b50 con 0x7f6ea014e690 2024-01-20T08:10:15.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fd84ea00640 1 -- 172.21.15.100:0/1638525734 shutdown_connections 2024-01-20T08:10:15.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fd84ea00640 1 -- 172.21.15.100:0/1638525734 wait complete. 2024-01-20T08:10:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fe09de00640 1 --2- 172.21.15.100:0/2679735521 >> v2:172.21.15.110:3300/0 conn(0x7fe0a00c4a50 0x7fe0a0155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fc587400640 1 Processor -- start 2024-01-20T08:10:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fe09e800640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.567+0000 7fc587400640 1 -- start start 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 0x7fd7240c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd724151e40 0x7fd7240c34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fe09de00640 1 -- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 msgr2=0x7fe0a00c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fe09de00640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fe09de00640 1 -- 172.21.15.100:0/2679735521 >> v1:172.21.15.100:6789/0 conn(0x7fe0a0155d00 legacy=0x7fe0a006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fe09de00640 1 -- 172.21.15.100:0/2679735521 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a00c87a0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724155290 0x7fd724153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd724156ca0 con 0x7fd724151e40 2024-01-20T08:10:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c3a10 con 0x7fd724155290 2024-01-20T08:10:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd72ba00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7240c1800 con 0x7fd7240c4a50 2024-01-20T08:10:15.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd729000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 0x7fd7240c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd729000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 0x7fd7240c2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47346/0 (socket says 172.21.15.100:47346) 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.568+0000 7fd729000640 1 -- 172.21.15.100:0/2044660175 learned_addr learned my addr 172.21.15.100:0/2044660175 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729a00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724155290 0x7fd724153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7f933f800640 1 Processor -- start 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fc587400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 0x7fc5800c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fc587400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fc587400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5800c9f30 con 0x7fc580151e40 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fc587400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58006c5a0 con 0x7fc5800c4a50 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fc587400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800c87a0 con 0x7fc580155290 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729000640 1 -- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724155290 msgr2=0x7fd724153090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729000640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd724155290 0x7fd724153090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729000640 1 -- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd724151e40 msgr2=0x7fd7240c34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729000640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd724151e40 0x7fd7240c34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7fc585400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.569+0000 7fd729000640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd714009400 con 0x7fd7240c4a50 2024-01-20T08:10:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7fd84ea00640 1 Processor -- start 2024-01-20T08:10:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7fc585400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47354/0 (socket says 172.21.15.100:47354) 2024-01-20T08:10:15.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7fc585400640 1 -- 172.21.15.100:0/2198597054 learned_addr learned my addr 172.21.15.100:0/2198597054 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7f933f800640 1 -- start start 2024-01-20T08:10:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.570+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2198597054 >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 0x7fc5800c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7f6e9ea00640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea014e690 0x7f6ea01550f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097a0 tx=0x7f6e8802b620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca98ea34500faf55 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fe09de00640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a0155290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097a0 tx=0x7fe08802b660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=24c2fbdbe73ec8f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fc585400640 1 -- 172.21.15.100:0/2198597054 >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 msgr2=0x7fc5800c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7f6e9d600640 1 -- 172.21.15.100:0/1912801060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e980019f0 con 0x7f6ea014e690 2024-01-20T08:10:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd729000640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 0x7fd7240c2f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd71402bb80 tx=0x7fd7140046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd714032c80 con 0x7fd7240c4a50 2024-01-20T08:10:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd72414b6b0 con 0x7fd7240c4a50 2024-01-20T08:10:15.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fe09d400640 1 -- 172.21.15.100:0/2679735521 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088030710 con 0x7fe0a00c4a50 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd714032de0 con 0x7fd7240c4a50 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd71403c610 con 0x7fd7240c4a50 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.572+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7240c1520 con 0x7fd7240c4a50 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fd84ea00640 1 -- start start 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7f6e9d600640 1 -- 172.21.15.100:0/1912801060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8802e050 con 0x7f6ea014e690 2024-01-20T08:10:15.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7f6e9d600640 1 -- 172.21.15.100:0/1912801060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88030730 con 0x7f6ea014e690 2024-01-20T08:10:15.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd7240c8150 con 0x7fd7240c4a50 2024-01-20T08:10:15.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.572+0000 7f933f800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380c7ff0 0x7f9338154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.572+0000 7f933f800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380c9100 con 0x7f933806b520 2024-01-20T08:10:15.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f933f800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93380c84f0 con 0x7f933806b140 2024-01-20T08:10:15.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fc585400640 1 --2- 172.21.15.100:0/2198597054 >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 0x7fc5800c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fc585400640 1 -- 172.21.15.100:0/2198597054 >> v1:172.21.15.110:6789/0 conn(0x7fc580151e40 legacy=0x7fc580155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fc585400640 1 -- 172.21.15.100:0/2198597054 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc580156410 con 0x7fc580155290 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.571+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2198597054 >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 0x7fc5800c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.572+0000 7fe09d400640 1 -- 172.21.15.100:0/2679735521 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08802e050 con 0x7fe0a00c4a50 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe09d400640 1 -- 172.21.15.100:0/2679735521 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe088030a90 con 0x7fe0a00c4a50 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 msgr2=0x7fe0a0155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a0155290 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe0880097a0 tx=0x7fe08802b660 comp rx=0 tx=0).stop 2024-01-20T08:10:15.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f933f800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933806b9d0 con 0x7f93380c7ff0 2024-01-20T08:10:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 shutdown_connections 2024-01-20T08:10:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f6e9fe00640 1 -- 172.21.15.100:0/1912801060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea014e690 msgr2=0x7f6ea01550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea014e690 0x7f6ea01550f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097a0 tx=0x7f6e8802b620 comp rx=0 tx=0).stop 2024-01-20T08:10:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a0155290 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 --2- 172.21.15.100:0/2679735521 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 >> 172.21.15.100:0/2679735521 conn(0x7fe0a00abde0 msgr2=0x7fe0a00ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84806b140 0x7fd8480c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 shutdown_connections 2024-01-20T08:10:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f933d800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f933806b520 0x7f93381565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55560/0 (socket says 172.21.15.100:55560) 2024-01-20T08:10:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7f933d800640 1 -- 172.21.15.100:0/3955304191 learned_addr learned my addr 172.21.15.100:0/3955304191 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fc585400640 1 --2- 172.21.15.100:0/2198597054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc578009e50 tx=0x7fc57802bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56160b482a26bb5c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fe0a5400640 1 -- 172.21.15.100:0/2679735521 wait complete. 2024-01-20T08:10:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8480c7ff0 0x7fd8480acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd848155eb0 0x7fd8480ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480c2ee0 con 0x7fd8480c7ff0 2024-01-20T08:10:15.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480afaf0 con 0x7fd848155eb0 2024-01-20T08:10:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.573+0000 7fd84ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8480afdd0 con 0x7fd84806b140 2024-01-20T08:10:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fd84ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd848155eb0 0x7fd8480ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fc57f400640 1 -- 172.21.15.100:0/2198597054 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57802caa0 con 0x7fc580155290 2024-01-20T08:10:15.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fc57f400640 1 -- 172.21.15.100:0/2198597054 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc57802cc00 con 0x7fc580155290 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f6e9fe00640 1 -- 172.21.15.100:0/1912801060 shutdown_connections 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/1912801060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea014e690 0x7f6ea01550f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f6e9fe00640 1 -- 172.21.15.100:0/1912801060 >> 172.21.15.100:0/1912801060 conn(0x7f6ea0072130 msgr2=0x7f6ea0072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fd847400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8480c7ff0 0x7fd8480acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fd847400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8480c7ff0 0x7fd8480acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57838/0 (socket says 172.21.15.100:57838) 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fd847400640 1 -- 172.21.15.100:0/3501024079 learned_addr learned my addr 172.21.15.100:0/3501024079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7fd847e00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84806b140 0x7fd8480c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f9337e00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380c7ff0 0x7f9338154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1128198618 0 0) 0x7f93380c9100 con 0x7f933806b520 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9318003520 con 0x7f933806b520 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.574+0000 7fc57f400640 1 -- 172.21.15.100:0/2198597054 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc57802caa0 con 0x7fc580155290 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f16cd200640 1 Processor -- start 2024-01-20T08:10:15.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f16cd200640 1 -- start start 2024-01-20T08:10:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7fc587400640 1 -- 172.21.15.100:0/2198597054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 msgr2=0x7fc58006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7fc587400640 1 --2- 172.21.15.100:0/2198597054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc578009e50 tx=0x7fc57802bf00 comp rx=0 tx=0).stop 2024-01-20T08:10:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd714039050 con 0x7fd7240c4a50 2024-01-20T08:10:15.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fc587400640 1 -- 172.21.15.100:0/2198597054 shutdown_connections 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fc587400640 1 --2- 172.21.15.100:0/2198597054 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc580155290 0x7fc58006b140 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fc587400640 1 --2- 172.21.15.100:0/2198597054 >> v2:172.21.15.100:3300/0 conn(0x7fc5800c4a50 0x7fc5800c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fc587400640 1 -- 172.21.15.100:0/2198597054 >> 172.21.15.100:0/2198597054 conn(0x7fc5800abde0 msgr2=0x7fc5800ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd847e00640 1 -- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd848155eb0 msgr2=0x7fd8480ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd847e00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd848155eb0 0x7fd8480ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd847e00640 1 -- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8480c7ff0 msgr2=0x7fd8480acd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd847e00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd8480c7ff0 0x7fd8480acd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fd847e00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd840009a70 con 0x7fd84806b140 2024-01-20T08:10:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301282463 0 0) 0x7f9318003520 con 0x7f933806b520 2024-01-20T08:10:15.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7fe0a5400640 1 Processor -- start 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380c7ff0 msgr2=0x7f9338154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380c7ff0 0x7f9338154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 >> v1:172.21.15.110:6789/0 conn(0x7f933806b140 legacy=0x7f9338155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380c87d0 con 0x7f933806b520 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f93300019d0 con 0x7f933806b520 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 >> v1:172.21.15.100:6789/0 conn(0x7f933806b520 legacy=0x7f93381565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93180039c0 0x7f9318003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93180047c0 0x7f9318004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7fd847e00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84806b140 0x7fd8480c5ba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd840033000 tx=0x7fd840004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7fe0a5400640 1 -- start start 2024-01-20T08:10:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7fc587400640 1 -- 172.21.15.100:0/2198597054 shutdown_connections 2024-01-20T08:10:15.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7fc587400640 1 -- 172.21.15.100:0/2198597054 wait complete. 2024-01-20T08:10:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93180052a0 0x7f9318014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933806b9d0 con 0x7f93180052a0 2024-01-20T08:10:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93180149d0 con 0x7f93180039c0 2024-01-20T08:10:15.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.575+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9318005950 con 0x7f93180047c0 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7f933d800640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93180052a0 0x7f9318014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7f9337e00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93180047c0 0x7f9318004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93180039c0 0x7f9318003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 -- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93180047c0 msgr2=0x7f9318004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93180047c0 0x7f9318004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 -- 172.21.15.100:0/3955304191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93180052a0 msgr2=0x7f9318014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93180052a0 0x7f9318014190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f933ce00640 1 -- 172.21.15.100:0/3955304191 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93380c87d0 con 0x7f93180039c0 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f16cd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 0x7f16c8070190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f16cd200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f16c806d130 0x7f16c81635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f16cd200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c80c2260 con 0x7f16c806cd10 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f16cd200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c80c2540 con 0x7f16c806d130 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7f16cd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c806c510 con 0x7f16c815c240 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840040650 con 0x7fd84806b140 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7f16bd200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f16c806cd10 0x7f16c815c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55574/0 (socket says 172.21.15.100:55574) 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7f16bd200640 1 -- 172.21.15.100:0/846504587 learned_addr learned my addr 172.21.15.100:0/846504587 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7f16c5e00640 1 --2- 172.21.15.100:0/846504587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 0x7f16c8070190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7f6e9fe00640 1 -- 172.21.15.100:0/1912801060 shutdown_connections 2024-01-20T08:10:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.576+0000 7f6e9fe00640 1 -- 172.21.15.100:0/1912801060 wait complete. 2024-01-20T08:10:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8400407b0 con 0x7fd84806b140 2024-01-20T08:10:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.577+0000 7fd720c00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6fc06aed0 0x7fd6fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7140ab7f0 con 0x7fd7240c4a50 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd720c00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7fd6fc073070 0x7fd6fc075490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6fc075b40 con 0x7fd6fc073070 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7140abb60 con 0x7fd7240c4a50 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7f16c6800640 1 --2- 172.21.15.100:0/846504587 >> v2:172.21.15.110:3300/0 conn(0x7f16c806d130 0x7f16c81635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8480c3120 con 0x7fd84806b140 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.578+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8480c36e0 con 0x7fd84806b140 2024-01-20T08:10:15.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840040b60 con 0x7fd84806b140 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5400640 1 -- 172.21.15.100:0/846504587 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 227188854 0 0) 0x7f16c80c2260 con 0x7f16c806cd10 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5400640 1 -- 172.21.15.100:0/846504587 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16a8003520 con 0x7f16c806cd10 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5e00640 1 -- 172.21.15.100:0/846504587 >> v2:172.21.15.110:3300/0 conn(0x7f16c806d130 msgr2=0x7f16c81635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5e00640 1 --2- 172.21.15.100:0/846504587 >> v2:172.21.15.110:3300/0 conn(0x7f16c806d130 0x7f16c81635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5e00640 1 -- 172.21.15.100:0/846504587 >> v1:172.21.15.100:6789/0 conn(0x7f16c806cd10 legacy=0x7f16c815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f16c5e00640 1 -- 172.21.15.100:0/846504587 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c806c7f0 con 0x7f16c815c240 2024-01-20T08:10:15.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f6e9fe00640 1 Processor -- start 2024-01-20T08:10:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f933ce00640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93180039c0 0x7f9318003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9320001750 tx=0x7f93180057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2e709bdd0ebe7b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.579+0000 7f6e9fe00640 1 -- start start 2024-01-20T08:10:15.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200052d0 con 0x7f93180039c0 2024-01-20T08:10:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f932002e050 con 0x7f93180039c0 2024-01-20T08:10:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd818001030 con 0x7fd84806b140 2024-01-20T08:10:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f9337400640 1 -- 172.21.15.100:0/3955304191 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200035f0 con 0x7f93180039c0 2024-01-20T08:10:15.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7fd729a00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7fd6fc073070 0x7fd6fc075490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f933f800640 1 -- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93180039c0 msgr2=0x7f9318003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f933f800640 1 --2- 172.21.15.100:0/3955304191 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93180039c0 0x7f9318003de0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9320001750 tx=0x7f93180057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7fd723e00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6fc06aed0 0x7fd6fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7fc587400640 1 Processor -- start 2024-01-20T08:10:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.580+0000 7f933d800640 1 -- 172.21.15.100:0/3955304191 reap_dead start 2024-01-20T08:10:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7f933f800640 1 -- 172.21.15.100:0/3955304191 shutdown_connections 2024-01-20T08:10:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7f933f800640 1 -- 172.21.15.100:0/3955304191 >> 172.21.15.100:0/3955304191 conn(0x7f93380abc80 msgr2=0x7f93380ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7f933f800640 1 -- 172.21.15.100:0/3955304191 shutdown_connections 2024-01-20T08:10:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f933f800640 1 -- 172.21.15.100:0/3955304191 wait complete. 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7fe0a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a00ab310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe0a5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe0a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0a0155d00 0x7fe0a00c5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe0a5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c40f0 con 0x7fe0a0155d00 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe0a5400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c3120 con 0x7fe0a00c4a50 2024-01-20T08:10:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe0a5400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a00c3e10 con 0x7fe0a0151e40 2024-01-20T08:10:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f3a2f400640 1 Processor -- start 2024-01-20T08:10:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea00ca9a0 0x7f6ea01f3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea014e690 0x7f6ea01f40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01f4600 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea01549b0 con 0x7f6ea014e690 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7f6e9fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea00c35a0 con 0x7f6ea00c7e10 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fe09e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a00ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fe09e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a00ab310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53164/0 (socket says 172.21.15.100:53164) 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fe09e800640 1 -- 172.21.15.100:0/3560507209 learned_addr learned my addr 172.21.15.100:0/3560507209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fe09f200640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0a0155d00 0x7fe0a00c5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fd729a00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7fd6fc073070 0x7fd6fc075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.581+0000 7f16c5e00640 1 --2- 172.21.15.100:0/846504587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 0x7f16c8070190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16b00097a0 tx=0x7f16b002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9348320a84b39d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.582+0000 7fc587400640 1 -- start start 2024-01-20T08:10:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fc587400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 0x7fc5800c6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7f6e9ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7f6e9f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea014e690 0x7f6ea01f40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fc587400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc580151e40 0x7fc5800c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7f6e9ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00abd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47386/0 (socket says 172.21.15.100:47386) 2024-01-20T08:10:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7f6e9ea00640 1 -- 172.21.15.100:0/3656454172 learned_addr learned my addr 172.21.15.100:0/3656454172 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fc587400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc580155290 0x7fc580148680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7f6e9e000640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea00ca9a0 0x7f6ea01f3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fc584a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 0x7fc5800c6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fe09e800640 1 -- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 msgr2=0x7fe0a00c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fe09e800640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0a0151e40 0x7fe0a00c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fe09e800640 1 -- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0a0155d00 msgr2=0x7fe0a00c5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fe09e800640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0a0155d00 0x7fe0a00c5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.583+0000 7fd723e00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6fc06aed0 0x7fd6fc06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c007fd0 tx=0x7fd70c0079a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fe09e800640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088009400 con 0x7fe0a00c4a50 2024-01-20T08:10:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc584a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 0x7fc5800c6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47390/0 (socket says 172.21.15.100:47390) 2024-01-20T08:10:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc584a00640 1 -- 172.21.15.100:0/2357732821 learned_addr learned my addr 172.21.15.100:0/2357732821 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014caf0 con 0x7fc580151e40 2024-01-20T08:10:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58014e8f0 con 0x7fc580155290 2024-01-20T08:10:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5800c6e60 con 0x7fc5800c4a50 2024-01-20T08:10:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f933f800640 1 Processor -- start 2024-01-20T08:10:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fc585400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc580155290 0x7fc580148680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f933f800640 1 -- start start 2024-01-20T08:10:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f16c5400640 1 -- 172.21.15.100:0/846504587 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b002e070 con 0x7f16c815c240 2024-01-20T08:10:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== osd.2 v2:172.21.15.100:6810/194905097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd6fc075b40 con 0x7fd6fc073070 2024-01-20T08:10:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f3a2f400640 1 -- start start 2024-01-20T08:10:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f16c5400640 1 -- 172.21.15.100:0/846504587 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b00315a0 con 0x7f16c815c240 2024-01-20T08:10:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f16c5400640 1 -- 172.21.15.100:0/846504587 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0031970 con 0x7f16c815c240 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f6e9e000640 1 -- 172.21.15.100:0/3656454172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 msgr2=0x7f6ea00abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f6e9e000640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea00c7e10 0x7f6ea00abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f6e9e000640 1 -- 172.21.15.100:0/3656454172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea014e690 msgr2=0x7f6ea01f40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f6e9e000640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea014e690 0x7f6ea01f40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.584+0000 7f6e9e000640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009400 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fe09e800640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a00ab310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d830 tx=0x7fe09000dcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f6e9f400640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea014e690 0x7f6ea01f40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc580151e40 0x7fc5800c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f6e9e000640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea00ca9a0 0x7f6ea01f3b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000e850 tx=0x7f6e9000ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc584a00640 1 -- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc580155290 msgr2=0x7fc580148680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc584a00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc580155290 0x7fc580148680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc584a00640 1 -- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc580151e40 msgr2=0x7fc5800c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc584a00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc580151e40 0x7fc5800c65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000b6c0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09000b820 con 0x7fe0a00c4a50 2024-01-20T08:10:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09000bbb0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc584a00640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009400 con 0x7fc5800c4a50 2024-01-20T08:10:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fe0a5400640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a01fa4a0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f16cd200640 1 -- 172.21.15.100:0/846504587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 msgr2=0x7f16c8070190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7f16cd200640 1 --2- 172.21.15.100:0/846504587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 0x7f16c8070190 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f16b00097a0 tx=0x7f16b002b840 comp rx=0 tx=0).stop 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fe0a5400640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a01faa60 con 0x7fe0a00c4a50 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.585+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc580151e40 0x7fc5800c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f16cd200640 1 -- 172.21.15.100:0/846504587 shutdown_connections 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f16cd200640 1 --2- 172.21.15.100:0/846504587 >> v2:172.21.15.110:3300/0 conn(0x7f16c806d130 0x7f16c81635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f16cd200640 1 --2- 172.21.15.100:0/846504587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c815c240 0x7f16c8070190 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f16cd200640 1 -- 172.21.15.100:0/846504587 >> 172.21.15.100:0/846504587 conn(0x7f16c80c2940 msgr2=0x7f16c80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e900095b0 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f16cd200640 1 -- 172.21.15.100:0/846504587 shutdown_connections 2024-01-20T08:10:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9000c940 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9000ccd0 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f3a2f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3a28139b60 0x7f3a28139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd840040cc0 con 0x7fd84806b140 2024-01-20T08:10:15.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fc584a00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 0x7fc5800c6060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c450 tx=0x7fc57000c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5700052d0 con 0x7fc5800c4a50 2024-01-20T08:10:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc570005430 con 0x7fc5800c4a50 2024-01-20T08:10:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.586+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc570012870 con 0x7fc5800c4a50 2024-01-20T08:10:15.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe068001030 con 0x7fe0a00c4a50 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f933f800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 0x7f93381e6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f933f800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93380c4ac0 0x7f93381e6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93381e6b90 0x7f9338157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93381ea2f0 con 0x7f93381e6b90 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933f800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93381e96e0 con 0x7f93380c4ac0 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933f800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93381e99c0 con 0x7f93380aae80 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7fd83fe00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd82006aed0 0x7fd82006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8400ac7c0 con 0x7fd84806b140 2024-01-20T08:10:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 0x7f93381e6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 0x7f93381e6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47406/0 (socket says 172.21.15.100:47406) 2024-01-20T08:10:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f933ce00640 1 -- 172.21.15.100:0/661986971 learned_addr learned my addr 172.21.15.100:0/661986971 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7fd83fe00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7fd8200730f0 0x7fd820075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f9337e00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93380c4ac0 0x7f93381e6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150d60 0x7f3a281511f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a2f400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a28154a20 con 0x7f3a280ab640 2024-01-20T08:10:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f3a2ca00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f3a280ab640 0x7f3a280c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42396/0 (socket says 172.21.15.100:42396) 2024-01-20T08:10:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a2ca00640 1 -- 172.21.15.100:0/1286374929 learned_addr learned my addr 172.21.15.100:0/1286374929 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:15.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea00c3880 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea00c3e40 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6ea00c4240 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f933ce00640 1 -- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93380c4ac0 msgr2=0x7f93381e6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f933ce00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f93380c4ac0 0x7f93381e6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f933ce00640 1 -- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93381e6b90 msgr2=0x7f9338157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f933ce00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f93381e6b90 0x7f9338157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f933ce00640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93381e9ca0 con 0x7f93380aae80 2024-01-20T08:10:15.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a280aba20 con 0x7f3a28139b60 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a28154d00 con 0x7f3a28150d60 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1286374929 >> v2:172.21.15.100:3300/0 conn(0x7f3a28139b60 0x7f3a28139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f3a27400640 1 -- 172.21.15.100:0/1286374929 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411859016 0 0) 0x7f3a28154a20 con 0x7f3a280ab640 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.587+0000 7f16cd200640 1 -- 172.21.15.100:0/846504587 wait complete. 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7f16cd200640 1 Processor -- start 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7f3a27400640 1 -- 172.21.15.100:0/1286374929 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a08003520 con 0x7f3a280ab640 2024-01-20T08:10:15.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7f3a2d400640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150d60 0x7f3a281511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7f933ce00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 0x7f93381e6110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9320005040 tx=0x7f9320001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6e90013470 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd820075bc0 con 0x7fd8200730f0 2024-01-20T08:10:15.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.588+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8400acb70 con 0x7fd84806b140 2024-01-20T08:10:15.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7fd84ca00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7fd8200730f0 0x7fd820075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7fd847400640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd82006aed0 0x7fd82006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200076c0 con 0x7f93380aae80 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93200069e0 con 0x7f93380aae80 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320006d50 con 0x7f93380aae80 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.589+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc578009b30 con 0x7fc5800c4a50 2024-01-20T08:10:15.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58014cd40 con 0x7fc5800c4a50 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f3a27e00640 1 -- 172.21.15.100:0/1286374929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150d60 msgr2=0x7f3a281511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150d60 0x7f3a281511f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f3a27e00640 1 -- 172.21.15.100:0/1286374929 >> v1:172.21.15.110:6789/0 conn(0x7f3a280ab640 legacy=0x7f3a280c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7f3a27e00640 1 -- 172.21.15.100:0/1286374929 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a280716d0 con 0x7f3a28139b60 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.590+0000 7f16cd200640 1 -- start start 2024-01-20T08:10:15.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.592+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc5800c8150 con 0x7fc5800c4a50 2024-01-20T08:10:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.592+0000 7fd847400640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd82006aed0 0x7fd82006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd848155870 tx=0x7fd830008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.592+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93381e9f80 con 0x7f93380aae80 2024-01-20T08:10:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.592+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93380ab260 con 0x7f93380aae80 2024-01-20T08:10:15.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.591+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe09001e460 con 0x7fe0a00c4a50 2024-01-20T08:10:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7fd84ca00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7fd8200730f0 0x7fd820075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f6e96a00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7806afa0 0x7f6e7806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7fe096a00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07806aed0 0x7fe07806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e90089660 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a28139520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097a0 tx=0x7f3a1002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e01dc96207c55f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f6e96a00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f6e780731c0 0x7f6e780755e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f3a27400640 1 -- 172.21.15.100:0/1286374929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031780 con 0x7f3a28139b60 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f3a27400640 1 -- 172.21.15.100:0/1286374929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a100318e0 con 0x7f3a28139b60 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7f3a27400640 1 -- 172.21.15.100:0/1286374929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10031c70 con 0x7f3a28139b60 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 0x7f16c81489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c806d130 0x7f16c8154770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16c815c240 0x7f16c81ee9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81e3e60 con 0x7f16c815c240 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c80ab150 con 0x7f16c806cd10 2024-01-20T08:10:15.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16cd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81e32d0 con 0x7f16c806d130 2024-01-20T08:10:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6e78075c90 con 0x7f6e780731c0 2024-01-20T08:10:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.593+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc5700129d0 con 0x7fc5800c4a50 2024-01-20T08:10:15.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f93381e9b30 con 0x7f93380aae80 2024-01-20T08:10:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f6e9ea00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7806afa0 0x7f6e7806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e9008bbc0 con 0x7f6ea00ca9a0 2024-01-20T08:10:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f6e9f400640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f6e780731c0 0x7f6e780755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe09008a7f0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7f16c5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 0x7f16c81489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 0x7f16c81489e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53218/0 (socket says 172.21.15.100:53218) 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 -- 172.21.15.100:0/853683471 learned_addr learned my addr 172.21.15.100:0/853683471 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c6800640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16c815c240 0x7f16c81ee9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16bd200640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c806d130 0x7f16c8154770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.594+0000 7fe09de00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07806aed0 0x7fe07806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f6e9ea00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7806afa0 0x7f6e7806d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e8802b660 tx=0x7f6e88008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== osd.1 v2:172.21.15.100:6800/1719666364 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fd820075bc0 con 0x7fd8200730f0 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fc57cc00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc55806af00 0x7fc55806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc570089170 con 0x7fc5800c4a50 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fc57cc00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7fc5580730a0 0x7fc5580754c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc558075b70 con 0x7fc5580730a0 2024-01-20T08:10:15.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5700894e0 con 0x7fc5800c4a50 2024-01-20T08:10:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 -- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c806d130 msgr2=0x7f16c8154770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f16c806d130 0x7f16c8154770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f6e9f400640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f6e780731c0 0x7f6e780755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 msgr2=0x7f3a28139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f3a2f400640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a28139520 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097a0 tx=0x7f3a1002b820 comp rx=0 tx=0).stop 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 -- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16c815c240 msgr2=0x7f16c81ee9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f16c815c240 0x7f16c81ee9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.595+0000 7f16c5e00640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b0009400 con 0x7f16c806cd10 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f16c5e00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 0x7f16c81489e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0032840 con 0x7f16c806cd10 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b00329a0 con 0x7f16c806cd10 2024-01-20T08:10:15.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.596+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b0032d50 con 0x7f16c806cd10 2024-01-20T08:10:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7f16cd200640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c81f1f20 con 0x7f16c806cd10 2024-01-20T08:10:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7f16cd200640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81f24e0 con 0x7f16c806cd10 2024-01-20T08:10:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7fe09de00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07806aed0 0x7fe07806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe088034000 tx=0x7fe08802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7fc585400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7fc5580730a0 0x7fc5580754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc55806af00 0x7fc55806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7fe096a00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fe0780730f0 0x7fe078075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe078075bc0 con 0x7fe0780730f0 2024-01-20T08:10:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe09008aba0 con 0x7fe0a00c4a50 2024-01-20T08:10:15.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== osd.0 v2:172.21.15.100:6817/9037251 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f6e78075c90 con 0x7f6e780731c0 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 shutdown_connections 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f3a2f400640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a28150d60 0x7f3a281511f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f3a2f400640 1 --2- 172.21.15.100:0/1286374929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a28139520 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 >> 172.21.15.100:0/1286374929 conn(0x7f3a280c2940 msgr2=0x7f3a280c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.597+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f93200035f0 con 0x7f93380aae80 2024-01-20T08:10:15.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f9334c00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f931006afd0 0x7f931006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f16cd200640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16c814f150 con 0x7f16c806cd10 2024-01-20T08:10:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7fe09f200640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fe0780730f0 0x7fe078075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93200ab6b0 con 0x7f93380aae80 2024-01-20T08:10:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.598+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 shutdown_connections 2024-01-20T08:10:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7fc585400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7fc5580730a0 0x7fc5580754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7f3a2f400640 1 -- 172.21.15.100:0/1286374929 wait complete. 2024-01-20T08:10:15.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7f9334c00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f93100731f0 0x7f9310075610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9310075cc0 con 0x7f93100731f0 2024-01-20T08:10:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f93200aba60 con 0x7f93380aae80 2024-01-20T08:10:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.599+0000 7f9337e00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f931006afd0 0x7f931006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.600+0000 7fc57fe00640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc55806af00 0x7fc55806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc5801514e0 tx=0x7fc568009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.600+0000 7fe09f200640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fe0780730f0 0x7fe078075510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.600+0000 7f933d800640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f93100731f0 0x7f9310075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7f3a2f400640 1 Processor -- start 2024-01-20T08:10:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7f9337e00640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f931006afd0 0x7f931006d490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93380ac240 tx=0x7f9328008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7f933d800640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f93100731f0 0x7f9310075610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== osd.4 v2:172.21.15.110:6824/1116990208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc558075b70 con 0x7fc5580730a0 2024-01-20T08:10:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7f3a2f400640 1 -- start start 2024-01-20T08:10:15.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.602+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== osd.5 v2:172.21.15.110:6808/3843611847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fe078075bc0 con 0x7fe0780730f0 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a280ab640 0x7f3a281e9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a280bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150d60 0x7f3a2814d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.601+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f16b004e430 con 0x7f16c806cd10 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.602+0000 7f16bea00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f16a006afd0 0x7f16a006d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f16b00abc40 con 0x7f16c806cd10 2024-01-20T08:10:15.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f16bea00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7f16a00731f0 0x7f16a0075610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16a0075cc0 con 0x7f16a00731f0 2024-01-20T08:10:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16b00abff0 con 0x7f16c806cd10 2024-01-20T08:10:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281edd30 con 0x7f3a28139b60 2024-01-20T08:10:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a281ea860 con 0x7f3a28150d60 2024-01-20T08:10:15.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a2f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a280aaa10 con 0x7f3a280ab640 2024-01-20T08:10:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f16bd200640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f16a006afd0 0x7f16a006d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== osd.3 v2:172.21.15.100:6808/37037686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f9310075cc0 con 0x7f93100731f0 2024-01-20T08:10:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a280bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a280bf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57928/0 (socket says 172.21.15.100:57928) 2024-01-20T08:10:15.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.603+0000 7f3a27e00640 1 -- 172.21.15.100:0/1911711621 learned_addr learned my addr 172.21.15.100:0/1911711621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f16c6800640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7f16a00731f0 0x7f16a0075610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f3a27e00640 1 -- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a280ab640 msgr2=0x7f3a281e9e90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-20T08:10:15.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3a280ab640 0x7f3a281e9e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f3a27e00640 1 -- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150d60 msgr2=0x7f3a2814d4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3a28150d60 0x7f3a2814d4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.604+0000 7f3a27e00640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a10009400 con 0x7f3a28139b60 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f3a27e00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a280bf270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a10034040 tx=0x7f3a100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100327d0 con 0x7f3a28139b60 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10032930 con 0x7f3a28139b60 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f16c6800640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7f16a00731f0 0x7f16a0075610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f16bd200640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f16a006afd0 0x7f16a006d490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16c8153230 tx=0x7f16b8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.605+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a100327d0 con 0x7f3a28139b60 2024-01-20T08:10:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.606+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 --> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd7240c4f50 con 0x7fd6fc073070 2024-01-20T08:10:15.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.606+0000 7f3a2f400640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a281ed400 con 0x7f3a28139b60 2024-01-20T08:10:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.607+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== osd.7 v2:172.21.15.110:6816/419165616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f16a0075cc0 con 0x7f16a00731f0 2024-01-20T08:10:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.607+0000 7f3a2f400640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a281ed9c0 con 0x7f3a28139b60 2024-01-20T08:10:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.608+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3a280aab80 con 0x7f3a28139b60 2024-01-20T08:10:15.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.612+0000 7fd720c00640 1 -- 172.21.15.100:0/2044660175 <== osd.2 v2:172.21.15.100:6810/194905097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd71c007e40 con 0x7fd6fc073070 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.612+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3a10032aa0 con 0x7f3a28139b60 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.613+0000 7f3a24c00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3a0006af30 0x7f3a0006d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.613+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3a100302d0 con 0x7f3a28139b60 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.613+0000 7f3a2ca00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3a0006af30 0x7f3a0006d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.614+0000 7f3a24c00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7f3a00073db0 0x7f3a00076250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.614+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a00076920 con 0x7f3a00073db0 2024-01-20T08:10:15.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.614+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a1007a0c0 con 0x7f3a28139b60 2024-01-20T08:10:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.615+0000 7f3a2d400640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7f3a00073db0 0x7f3a00076250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.615+0000 7f3a2ca00640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3a0006af30 0x7f3a0006d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000f60 tx=0x7f3a180010a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7fd6fc073070 msgr2=0x7fd6fc075490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7fd6fc073070 0x7fd6fc075490 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7f3a2d400640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7f3a00073db0 0x7f3a00076250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6fc06aed0 msgr2=0x7fd6fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6fc06aed0 0x7fd6fc06d390 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd70c007fd0 tx=0x7fd70c0079a0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 msgr2=0x7fd7240c2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd72ba00640 1 --2- 172.21.15.100:0/2044660175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7240c4a50 0x7fd7240c2f90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd71402bb80 tx=0x7fd7140046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.616+0000 7fd729a00640 1 -- 172.21.15.100:0/2044660175 reap_dead start 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.617+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 shutdown_connections 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.617+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 >> 172.21.15.100:0/2044660175 conn(0x7fd7240abde0 msgr2=0x7fd72414c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.617+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 shutdown_connections 2024-01-20T08:10:15.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.617+0000 7fd72ba00640 1 -- 172.21.15.100:0/2044660175 wait complete. 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.618+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== osd.6 v2:172.21.15.110:6800/2895430222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f3a00076920 con 0x7f3a00073db0 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.624+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 --> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6ea014ea70 con 0x7f6e780731c0 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.625+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 --> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f93380c8d90 con 0x7f93100731f0 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.626+0000 7f9334c00640 1 -- 172.21.15.100:0/661986971 <== osd.3 v2:172.21.15.100:6808/37037686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9330001250 con 0x7f93100731f0 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.626+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f93100731f0 msgr2=0x7f9310075610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.626+0000 7f933f800640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f93100731f0 0x7f9310075610 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.628+0000 7f6e96a00640 1 -- 172.21.15.100:0/3656454172 <== osd.0 v2:172.21.15.100:6817/9037251 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6e78075c90 con 0x7f6e780731c0 2024-01-20T08:10:15.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f6e780731c0 msgr2=0x7f6e780755e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f6e780731c0 0x7f6e780755e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7806afa0 msgr2=0x7f6e7806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7806afa0 0x7f6e7806d460 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6e8802b660 tx=0x7f6e88008030 comp rx=0 tx=0).stop 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea00ca9a0 msgr2=0x7f6ea01f3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.629+0000 7f6e9fe00640 1 --2- 172.21.15.100:0/3656454172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ea00ca9a0 0x7f6ea01f3b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6e9000e850 tx=0x7f6e9000ed10 comp rx=0 tx=0).stop 2024-01-20T08:10:15.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f931006afd0 msgr2=0x7f931006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f6e9f400640 1 -- 172.21.15.100:0/3656454172 reap_dead start 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 shutdown_connections 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 >> 172.21.15.100:0/3656454172 conn(0x7f6ea0072130 msgr2=0x7f6ea014d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f931006afd0 0x7f931006d490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f93380ac240 tx=0x7f9328008040 comp rx=0 tx=0).stop 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 msgr2=0x7f93381e6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 --2- 172.21.15.100:0/661986971 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f93380aae80 0x7f93381e6110 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9320005040 tx=0x7f9320001120 comp rx=0 tx=0).stop 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933d800640 1 -- 172.21.15.100:0/661986971 reap_dead start 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 shutdown_connections 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.630+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 >> 172.21.15.100:0/661986971 conn(0x7f93380abc80 msgr2=0x7f933814d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.631+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 shutdown_connections 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.631+0000 7f933f800640 1 -- 172.21.15.100:0/661986971 wait complete. 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.632+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 --> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc5800c4f50 con 0x7fc5580730a0 2024-01-20T08:10:15.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.633+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 shutdown_connections 2024-01-20T08:10:15.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.633+0000 7fc57cc00640 1 -- 172.21.15.100:0/2357732821 <== osd.4 v2:172.21.15.110:6824/1116990208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc57802ca90 con 0x7fc5580730a0 2024-01-20T08:10:15.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.633+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 --> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd818002d30 con 0x7fd8200730f0 2024-01-20T08:10:15.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.634+0000 7f6e9fe00640 1 -- 172.21.15.100:0/3656454172 wait complete. 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.634+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7fc5580730a0 msgr2=0x7fc5580754c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.634+0000 7fc587400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7fc5580730a0 0x7fc5580754c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc55806af00 msgr2=0x7fc55806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc55806af00 0x7fc55806d3c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc5801514e0 tx=0x7fc568009190 comp rx=0 tx=0).stop 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 msgr2=0x7fc5800c6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 --2- 172.21.15.100:0/2357732821 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc5800c4a50 0x7fc5800c6060 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc57000c450 tx=0x7fc57000c910 comp rx=0 tx=0).stop 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc585400640 1 -- 172.21.15.100:0/2357732821 reap_dead start 2024-01-20T08:10:15.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 shutdown_connections 2024-01-20T08:10:15.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 >> 172.21.15.100:0/2357732821 conn(0x7fc5800abde0 msgr2=0x7fc5800c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fd83fe00640 1 -- 172.21.15.100:0/3501024079 <== osd.1 v2:172.21.15.100:6800/1719666364 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd818002d30 con 0x7fd8200730f0 2024-01-20T08:10:15.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7fd8200730f0 msgr2=0x7fd820075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 shutdown_connections 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.635+0000 7fc587400640 1 -- 172.21.15.100:0/2357732821 wait complete. 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7fd8200730f0 0x7fd820075510 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd82006aed0 msgr2=0x7fd82006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd82006aed0 0x7fd82006d390 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd848155870 tx=0x7fd830008040 comp rx=0 tx=0).stop 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84806b140 msgr2=0x7fd8480c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.636+0000 7fd84ea00640 1 --2- 172.21.15.100:0/3501024079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd84806b140 0x7fd8480c5ba0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd840033000 tx=0x7fd840004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.640+0000 7fd84ca00640 1 -- 172.21.15.100:0/3501024079 reap_dead start 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.640+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 shutdown_connections 2024-01-20T08:10:15.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.640+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 >> 172.21.15.100:0/3501024079 conn(0x7fd8480abc80 msgr2=0x7fd8480c92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.640+0000 7f16cd200640 1 -- 172.21.15.100:0/853683471 --> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f16c8067a10 con 0x7f16a00731f0 2024-01-20T08:10:15.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.641+0000 7f16bea00640 1 -- 172.21.15.100:0/853683471 <== osd.7 v2:172.21.15.110:6816/419165616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f16c8067a10 con 0x7f16a00731f0 2024-01-20T08:10:15.672 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.672 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-01-20T08:10:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7f16a00731f0 msgr2=0x7f16a0075610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7f16a00731f0 0x7f16a0075610 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 --> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe068002d30 con 0x7fe0780730f0 2024-01-20T08:10:15.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 shutdown_connections 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7fd84ea00640 1 -- 172.21.15.100:0/3501024079 wait complete. 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f16a006afd0 msgr2=0x7f16a006d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f16a006afd0 0x7f16a006d490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f16c8153230 tx=0x7f16b8009040 comp rx=0 tx=0).stop 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 msgr2=0x7f16c81489e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.642+0000 7f16b6a00640 1 --2- 172.21.15.100:0/853683471 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f16c806cd10 0x7f16c81489e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f16b0000c00 tx=0x7f16b00046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7f16c6800640 1 -- 172.21.15.100:0/853683471 reap_dead start 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 shutdown_connections 2024-01-20T08:10:15.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 >> 172.21.15.100:0/853683471 conn(0x7f16c80c2940 msgr2=0x7f16c815c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 shutdown_connections 2024-01-20T08:10:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.643+0000 7f16b6a00640 1 -- 172.21.15.100:0/853683471 wait complete. 2024-01-20T08:10:15.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.644+0000 7fe096a00640 1 -- 172.21.15.100:0/3560507209 <== osd.5 v2:172.21.15.110:6808/3843611847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe068002d30 con 0x7fe0780730f0 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.644+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fe0780730f0 msgr2=0x7fe078075510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.644+0000 7fe08fe00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fe0780730f0 0x7fe078075510 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07806aed0 msgr2=0x7fe07806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07806aed0 0x7fe07806d390 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe088034000 tx=0x7fe08802f000 comp rx=0 tx=0).stop 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 msgr2=0x7fe0a00ab310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 --2- 172.21.15.100:0/3560507209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe0a00c4a50 0x7fe0a00ab310 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe09000d830 tx=0x7fe09000dcf0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe09f200640 1 -- 172.21.15.100:0/3560507209 reap_dead start 2024-01-20T08:10:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 shutdown_connections 2024-01-20T08:10:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.645+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 >> 172.21.15.100:0/3560507209 conn(0x7fe0a00abde0 msgr2=0x7fe0a014f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.646+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 shutdown_connections 2024-01-20T08:10:15.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.646+0000 7fe08fe00640 1 -- 172.21.15.100:0/3560507209 wait complete. 2024-01-20T08:10:15.677 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-01-20T08:10:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.656+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 --> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3a28072530 con 0x7f3a00073db0 2024-01-20T08:10:15.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.657+0000 7f3a24c00640 1 -- 172.21.15.100:0/1911711621 <== osd.6 v2:172.21.15.110:6800/2895430222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3a2000aa70 con 0x7f3a00073db0 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7f3a00073db0 msgr2=0x7f3a00076250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7f3a00073db0 0x7f3a00076250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3a0006af30 msgr2=0x7f3a0006d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3a0006af30 0x7f3a0006d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3a18000f60 tx=0x7f3a180010a0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 msgr2=0x7f3a280bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 --2- 172.21.15.100:0/1911711621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3a28139b60 0x7f3a280bf270 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3a10034040 tx=0x7f3a100046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a2d400640 1 -- 172.21.15.100:0/1911711621 reap_dead start 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 shutdown_connections 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.658+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 >> 172.21.15.100:0/1911711621 conn(0x7f3a280c2940 msgr2=0x7f3a2806c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.660+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 shutdown_connections 2024-01-20T08:10:15.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.660+0000 7f3a1e000640 1 -- 172.21.15.100:0/1911711621 wait complete. 2024-01-20T08:10:15.681 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-20T08:10:15.681 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-01-20T08:10:15.682 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-01-20T08:10:15.683 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-20T08:10:15.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-01-20T08:10:15.684 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-01-20T08:10:15.685 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-01-20T08:10:15.686 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:15.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-01-20T08:10:16.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.999+0000 7f46c3c00640 1 Processor -- start 2024-01-20T08:10:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:15.999+0000 7f46c3c00640 1 -- start start 2024-01-20T08:10:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c3c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46bc0c49c0 0x7f46bc0c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c3c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0ca950 con 0x7f46bc0af900 2024-01-20T08:10:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c3c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46bc0cac30 con 0x7f46bc158770 2024-01-20T08:10:16.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c3c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46bc152240 con 0x7f46bc0c49c0 2024-01-20T08:10:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c1200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f46bc0af900 0x7f46bc155c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55586/0 (socket says 172.21.15.100:55586) 2024-01-20T08:10:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.001+0000 7f46c1200640 1 -- 172.21.15.100:0/2119932567 learned_addr learned my addr 172.21.15.100:0/2119932567 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.002+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1555117070 0 0) 0x7f46bc0ca950 con 0x7f46bc0af900 2024-01-20T08:10:16.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f469c003520 con 0x7f46bc0af900 2024-01-20T08:10:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2697649683 0 0) 0x7f469c003520 con 0x7f46bc0af900 2024-01-20T08:10:16.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 >> v2:172.21.15.110:3300/0 conn(0x7f46bc0c49c0 msgr2=0x7f46bc0c4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 --2- 172.21.15.100:0/2119932567 >> v2:172.21.15.110:3300/0 conn(0x7f46bc0c49c0 0x7f46bc0c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 >> v1:172.21.15.110:6789/0 conn(0x7f46bc158770 legacy=0x7f46bc155180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.003+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc154980 con 0x7f46bc0af900 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f46a4001670 con 0x7f46bc0af900 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 >> v1:172.21.15.100:6789/0 conn(0x7f46bc0af900 legacy=0x7f46bc155c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c003970 0x7f469c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f469c0047c0 0x7f469c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 0x7f469c00ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc152240 con 0x7f469c0053d0 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c00c2e0 con 0x7f469c0047c0 2024-01-20T08:10:16.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.004+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469c00c4a0 con 0x7f469c003970 2024-01-20T08:10:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.005+0000 7f46c1c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 0x7f469c00ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.005+0000 7f46c1200640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c003970 0x7f469c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.005+0000 7f46bbe00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f469c0047c0 0x7f469c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.006+0000 7f46c1c00640 1 -- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c003970 msgr2=0x7f469c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.006+0000 7f46c1c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c003970 0x7f469c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.006+0000 7f46c1c00640 1 -- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f469c0047c0 msgr2=0x7f469c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.006+0000 7f46c1c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f469c0047c0 0x7f469c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.006+0000 7f46c1c00640 1 -- 172.21.15.100:0/2119932567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc154980 con 0x7f469c0053d0 2024-01-20T08:10:16.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.009+0000 7f46c1c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 0x7f469c00ba00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009e60 tx=0x7f469c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8ce2ea70d7c4fbd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.009+0000 7f46c1c00640 1 -- 172.21.15.100:0/2119932567 reap_dead start 2024-01-20T08:10:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.010+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b402cdd0 con 0x7f469c0053d0 2024-01-20T08:10:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.010+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b4003970 con 0x7f469c0053d0 2024-01-20T08:10:16.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.010+0000 7f46bb400640 1 -- 172.21.15.100:0/2119932567 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b4003d20 con 0x7f469c0053d0 2024-01-20T08:10:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.011+0000 7f46c3c00640 1 -- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 msgr2=0x7f469c00ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.011+0000 7f46c3c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 0x7f469c00ba00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46b4009e60 tx=0x7f469c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f46c3c00640 1 -- 172.21.15.100:0/2119932567 shutdown_connections 2024-01-20T08:10:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f46c3c00640 1 --2- 172.21.15.100:0/2119932567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f469c0053d0 0x7f469c00ba00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f46c3c00640 1 -- 172.21.15.100:0/2119932567 >> 172.21.15.100:0/2119932567 conn(0x7f46bc072130 msgr2=0x7f46bc072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f46c3c00640 1 -- 172.21.15.100:0/2119932567 shutdown_connections 2024-01-20T08:10:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f46c3c00640 1 -- 172.21.15.100:0/2119932567 wait complete. 2024-01-20T08:10:16.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.012+0000 7f2089000640 1 Processor -- start 2024-01-20T08:10:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.013+0000 7f2089000640 1 -- start start 2024-01-20T08:10:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.014+0000 7f2089000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20840c4a50 0x7f20840c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.014+0000 7f2089000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f208406b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.014+0000 7f2089000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20840c9f30 con 0x7f2084151e40 2024-01-20T08:10:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.014+0000 7f2089000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208406c5a0 con 0x7f20840c4a50 2024-01-20T08:10:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.014+0000 7f2089000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20840c87a0 con 0x7f2084155290 2024-01-20T08:10:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.015+0000 7f46c3c00640 1 Processor -- start 2024-01-20T08:10:16.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.015+0000 7f46c3c00640 1 -- start start 2024-01-20T08:10:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.015+0000 7f2081e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f2084151e40 0x7f2084155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42418/0 (socket says 172.21.15.100:42418) 2024-01-20T08:10:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.015+0000 7f2081e00640 1 -- 172.21.15.100:0/4007378050 learned_addr learned my addr 172.21.15.100:0/4007378050 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.016+0000 7f2081400640 1 --2- 172.21.15.100:0/4007378050 >> v2:172.21.15.110:3300/0 conn(0x7f20840c4a50 0x7f20840c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f2082800640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f208406b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7faac1200640 1 Processor -- start 2024-01-20T08:10:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f46c3c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c0053d0 0x7f46bc151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.018+0000 7f46c3c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.018+0000 7f46c3c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 0x7f46bc0c04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f2081400640 1 -- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 msgr2=0x7f208406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 0x7f46bc0c04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 0x7f46bc0c04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57950/0 (socket says 172.21.15.100:57950) 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46bbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46bbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53266/0 (socket says 172.21.15.100:53266) 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c0053d0 0x7f46bc151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f2081400640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f208406b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c1c00640 1 -- 172.21.15.100:0/17438268 learned_addr learned my addr 172.21.15.100:0/17438268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0bf110 con 0x7f46bc0be7c0 2024-01-20T08:10:16.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0c40c0 con 0x7f46bc0be340 2024-01-20T08:10:16.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46bc0bed20 con 0x7f469c0053d0 2024-01-20T08:10:16.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f2081400640 1 -- 172.21.15.100:0/4007378050 >> v1:172.21.15.110:6789/0 conn(0x7f2084151e40 legacy=0x7f2084155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.017+0000 7f2081400640 1 -- 172.21.15.100:0/4007378050 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2084156410 con 0x7f20840c4a50 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.018+0000 7faac1200640 1 -- start start 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7faac1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7faac1200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 0x7faabc06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7faac1200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faabc0c9f30 con 0x7faabc0c4a50 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7faac1200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faabc06c5a0 con 0x7faabc155290 2024-01-20T08:10:16.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.019+0000 7faac1200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc0c87a0 con 0x7faabc151e40 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f46bbe00640 1 -- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c0053d0 msgr2=0x7f46bc151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f46bbe00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c0053d0 0x7f46bc151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f46bbe00640 1 -- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 msgr2=0x7f46bc0c04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f46bbe00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 0x7f46bc0c04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f46bbe00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc0c3790 con 0x7f46bc0be340 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7f46bbe00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00f570 tx=0x7f46ac00f970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7faab9e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7faab9e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47470/0 (socket says 172.21.15.100:47470) 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7faab9e00640 1 -- 172.21.15.100:0/2359597390 learned_addr learned my addr 172.21.15.100:0/2359597390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faaba800640 1 --2- 172.21.15.100:0/2359597390 >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 0x7faabc06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faab9e00640 1 -- 172.21.15.100:0/2359597390 >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 msgr2=0x7faabc06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.020+0000 7f2081400640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20840c4a50 0x7f20840c8c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20740097a0 tx=0x7f207402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f418f7e75628df6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7f2080a00640 1 -- 172.21.15.100:0/4007378050 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740317c0 con 0x7f20840c4a50 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7f2080a00640 1 -- 172.21.15.100:0/4007378050 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074031920 con 0x7f20840c4a50 2024-01-20T08:10:16.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7f2080a00640 1 -- 172.21.15.100:0/4007378050 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20740317c0 con 0x7f20840c4a50 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac005320 con 0x7f46bc0be340 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faab9400640 1 -- 172.21.15.100:0/2359597390 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1733246884 0 0) 0x7faaa4001110 con 0x7faabc0c4a50 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faab9e00640 1 --2- 172.21.15.100:0/2359597390 >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 0x7faabc06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faab9e00640 1 -- 172.21.15.100:0/2359597390 >> v1:172.21.15.100:6789/0 conn(0x7faabc0c4a50 legacy=0x7faabc155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faab9e00640 1 -- 172.21.15.100:0/2359597390 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faabc156410 con 0x7faabc151e40 2024-01-20T08:10:16.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.021+0000 7faaba800640 1 --2- 172.21.15.100:0/2359597390 >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 0x7faabc06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f7132a00640 1 Processor -- start 2024-01-20T08:10:16.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7fb380000640 1 Processor -- start 2024-01-20T08:10:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f2089000640 1 -- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20840c4a50 msgr2=0x7f20840c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f2089000640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20840c4a50 0x7f20840c8c30 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f20740097a0 tx=0x7f207402b860 comp rx=0 tx=0).stop 2024-01-20T08:10:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46bc0c3a70 con 0x7f46bc0be340 2024-01-20T08:10:16.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46bc151ca0 con 0x7f46bc0be340 2024-01-20T08:10:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac005480 con 0x7f46bc0be340 2024-01-20T08:10:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac007270 con 0x7f46bc0be340 2024-01-20T08:10:16.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 -- 172.21.15.100:0/4007378050 shutdown_connections 2024-01-20T08:10:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7f7132a00640 1 -- start start 2024-01-20T08:10:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.022+0000 7fb380000640 1 -- start start 2024-01-20T08:10:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f208406b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 --2- 172.21.15.100:0/4007378050 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20840c4a50 0x7f20840c8c30 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 -- 172.21.15.100:0/4007378050 >> 172.21.15.100:0/4007378050 conn(0x7f20840abde0 msgr2=0x7f20840ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 -- 172.21.15.100:0/4007378050 shutdown_connections 2024-01-20T08:10:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.023+0000 7f2089000640 1 -- 172.21.15.100:0/4007378050 wait complete. 2024-01-20T08:10:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.024+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f468c005290 con 0x7f46bc0be340 2024-01-20T08:10:16.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.024+0000 7faab9e00640 1 --2- 172.21.15.100:0/2359597390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaac009870 tx=0x7faaac02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef9bef0a0e68fece server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3780c3460 0x7fb378139520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 0x7fb3780ab3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb3780c1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb378154d00 con 0x7fb378139b60 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3780716d0 con 0x7fb3780c3460 2024-01-20T08:10:16.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7fb380000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780719b0 con 0x7fb3780c1850 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7faab9400640 1 -- 172.21.15.100:0/2359597390 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac031640 con 0x7faabc151e40 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7faab9400640 1 -- 172.21.15.100:0/2359597390 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac0317a0 con 0x7faabc151e40 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7faab9400640 1 -- 172.21.15.100:0/2359597390 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac031b30 con 0x7faabc151e40 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7f7132a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f712c0714d0 0x7f712c0c17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7f7132a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c15c150 con 0x7f712c1529f0 2024-01-20T08:10:16.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7f7132a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f712c15cfb0 con 0x7f712c152dd0 2024-01-20T08:10:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.025+0000 7f7132a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f712c15c3a0 con 0x7f712c0714d0 2024-01-20T08:10:16.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7f2089000640 1 Processor -- start 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7faac1200640 1 -- 172.21.15.100:0/2359597390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 msgr2=0x7faabc0c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7faac1200640 1 --2- 172.21.15.100:0/2359597390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faaac009870 tx=0x7faaac02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7faac1200640 1 -- 172.21.15.100:0/2359597390 shutdown_connections 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7faac1200640 1 --2- 172.21.15.100:0/2359597390 >> v2:172.21.15.100:3300/0 conn(0x7faabc155290 0x7faabc06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7faac1200640 1 --2- 172.21.15.100:0/2359597390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc151e40 0x7faabc0c8c30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7faac1200640 1 -- 172.21.15.100:0/2359597390 >> 172.21.15.100:0/2359597390 conn(0x7faabc0abde0 msgr2=0x7faabc0ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7f7130c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f712c0714d0 0x7f712c0c17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7f7132000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f712c152dd0 0x7f712c06beb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42426/0 (socket says 172.21.15.100:42426) 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7f7132000640 1 -- 172.21.15.100:0/1458163286 learned_addr learned my addr 172.21.15.100:0/1458163286 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7f7130c00640 1 -- 172.21.15.100:0/1458163286 >> v1:172.21.15.110:6789/0 conn(0x7f712c152dd0 legacy=0x7f712c06beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7f7130c00640 1 -- 172.21.15.100:0/1458163286 >> v1:172.21.15.100:6789/0 conn(0x7f712c1529f0 legacy=0x7f712c1595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7f7130c00640 1 -- 172.21.15.100:0/1458163286 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f712c15c680 con 0x7f712c0714d0 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7f7130c00640 1 --2- 172.21.15.100:0/1458163286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c0c17c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7124009d90 tx=0x7f712402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9db46d44ec483c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.029+0000 7faac1200640 1 -- 172.21.15.100:0/2359597390 shutdown_connections 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7fb37d600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3780c3460 0x7fb378139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7fb37d600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3780c3460 0x7fb378139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53272/0 (socket says 172.21.15.100:53272) 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.027+0000 7fb37d600640 1 -- 172.21.15.100:0/1040522371 learned_addr learned my addr 172.21.15.100:0/1040522371 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37d600640 1 -- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 msgr2=0x7fb3780c1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37cc00640 1 --2- 172.21.15.100:0/1040522371 >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 0x7fb3780ab3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.026+0000 7fb37e000640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb3780c1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37d600640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb3780c1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37d600640 1 -- 172.21.15.100:0/1040522371 >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 msgr2=0x7fb3780ab3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37d600640 1 --2- 172.21.15.100:0/1040522371 >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 0x7fb3780ab3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37d600640 1 -- 172.21.15.100:0/1040522371 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb378072530 con 0x7fb3780c3460 2024-01-20T08:10:16.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.028+0000 7fb37cc00640 1 --2- 172.21.15.100:0/1040522371 >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 0x7fb3780ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.029+0000 7f2089000640 1 -- start start 2024-01-20T08:10:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7fb37e000640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb3780c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.029+0000 7fcbb9c00640 1 Processor -- start 2024-01-20T08:10:16.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.029+0000 7fcbb9c00640 1 -- start start 2024-01-20T08:10:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f712be00640 1 -- 172.21.15.100:0/1458163286 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f712402cc60 con 0x7f712c0714d0 2024-01-20T08:10:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7faac1200640 1 -- 172.21.15.100:0/2359597390 wait complete. 2024-01-20T08:10:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f712be00640 1 -- 172.21.15.100:0/1458163286 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f712402cdc0 con 0x7f712c0714d0 2024-01-20T08:10:16.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f712be00640 1 -- 172.21.15.100:0/1458163286 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7124034660 con 0x7f712c0714d0 2024-01-20T08:10:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7fb37d600640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378139520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb37806b450 tx=0x7fb36802b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b5e49ad28f678f9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f2089000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20840c4a50 0x7f20840c37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f2089000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 0x7f20840c3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f2089000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.029+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f46ac0073d0 con 0x7f46bc0be340 2024-01-20T08:10:16.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f2089000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20841ef6b0 con 0x7f20840c4a50 2024-01-20T08:10:16.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.030+0000 7f2089000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2084153c10 con 0x7f2084151e40 2024-01-20T08:10:16.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2089000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2084153650 con 0x7f2084155290 2024-01-20T08:10:16.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f7132a00640 1 -- 172.21.15.100:0/1458163286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 msgr2=0x7f712c0c17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f7132a00640 1 --2- 172.21.15.100:0/1458163286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c0c17c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7124009d90 tx=0x7f712402beb0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2082800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2082800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47488/0 (socket says 172.21.15.100:47488) 2024-01-20T08:10:16.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2082800640 1 -- 172.21.15.100:0/2301030344 learned_addr learned my addr 172.21.15.100:0/2301030344 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2081400640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 0x7f20840c3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f7132a00640 1 -- 172.21.15.100:0/1458163286 shutdown_connections 2024-01-20T08:10:16.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f46b8c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 0x7f469406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f7132a00640 1 --2- 172.21.15.100:0/1458163286 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c0c17c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f2081e00640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20840c4a50 0x7f20840c37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb9c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcbb40bd690 0x7fcbb415a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb9c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb4159730 con 0x7fcbb4156240 2024-01-20T08:10:16.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb9c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb4159a10 con 0x7fcbb40bd140 2024-01-20T08:10:16.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb9c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40c9080 con 0x7fcbb40bd690 2024-01-20T08:10:16.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f7132a00640 1 -- 172.21.15.100:0/1458163286 >> 172.21.15.100:0/1458163286 conn(0x7f712c0c28b0 msgr2=0x7f712c0c2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.031+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f46ac088e30 con 0x7f46bc0be340 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f7132a00640 1 -- 172.21.15.100:0/1458163286 shutdown_connections 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f7132a00640 1 -- 172.21.15.100:0/1458163286 wait complete. 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2081400640 1 -- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 msgr2=0x7f2084152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2081400640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2081400640 1 -- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20840c4a50 msgr2=0x7f20840c37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2081400640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20840c4a50 0x7f20840c37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2081400640 1 -- 172.21.15.100:0/2301030344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2074009400 con 0x7f2084151e40 2024-01-20T08:10:16.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f2082800640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:16.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7f46c1200640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 0x7f469406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb2a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcbb4156240 0x7fcbb40c8970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55604/0 (socket says 172.21.15.100:55604) 2024-01-20T08:10:16.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.032+0000 7fcbb2a00640 1 -- 172.21.15.100:0/1442308322 learned_addr learned my addr 172.21.15.100:0/1442308322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:16.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7faac1200640 1 Processor -- start 2024-01-20T08:10:16.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb3400640 1 --2- 172.21.15.100:0/1442308322 >> v2:172.21.15.110:3300/0 conn(0x7fcbb40bd690 0x7fcbb415a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7faac1200640 1 -- start start 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb1600640 1 -- 172.21.15.100:0/1442308322 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314575692 0 0) 0x7fcbb4159730 con 0x7fcbb4156240 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb1600640 1 -- 172.21.15.100:0/1442308322 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb94003520 con 0x7fcbb4156240 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb3400640 1 -- 172.21.15.100:0/1442308322 >> v1:172.21.15.110:6789/0 conn(0x7fcbb40bd140 legacy=0x7fcbb406b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb3400640 1 -- 172.21.15.100:0/1442308322 >> v1:172.21.15.100:6789/0 conn(0x7fcbb4156240 legacy=0x7fcbb40c8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.033+0000 7fcbb3400640 1 -- 172.21.15.100:0/1442308322 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40c8170 con 0x7fcbb40bd690 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.034+0000 7f46c1200640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 0x7f469406d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001120 tx=0x7f46a4000f50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.034+0000 7f2081400640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 0x7f20840c3d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20840c78b0 tx=0x7f20740046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.034+0000 7f7132a00640 1 Processor -- start 2024-01-20T08:10:16.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7f7132a00640 1 -- start start 2024-01-20T08:10:16.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc0c4a50 0x7faabc14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 0x7faabc148e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc1eeb30 con 0x7faabc155290 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faabc154710 con 0x7faabc151e40 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faac1200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faabc154430 con 0x7faabc0c4a50 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faaba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faab3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 0x7faabc148e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faaba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57982/0 (socket says 172.21.15.100:57982) 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faab9e00640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc0c4a50 0x7faabc14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.035+0000 7faaba800640 1 -- 172.21.15.100:0/3982923988 learned_addr learned my addr 172.21.15.100:0/3982923988 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7fcbb3400640 1 --2- 172.21.15.100:0/1442308322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb40bd690 0x7fcbb415a120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac02bec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98debebb2bff7d0d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 0x7f712c1ef760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712c152dd0 0x7f712c1f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0a9580 con 0x7f712c0714d0 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712c154e20 con 0x7f712c1529f0 2024-01-20T08:10:16.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7132a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712c0a92a0 con 0x7f712c152dd0 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faaba800640 1 -- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc0c4a50 msgr2=0x7faabc14af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faaba800640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc0c4a50 0x7faabc14af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faaba800640 1 -- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 msgr2=0x7faabc148e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faaba800640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 0x7faabc148e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faaba800640 1 -- 172.21.15.100:0/3982923988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0094d0 con 0x7faabc155290 2024-01-20T08:10:16.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7c73200640 1 Processor -- start 2024-01-20T08:10:16.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7faab3e00640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 0x7faabc148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:16.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7131600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7131600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57996/0 (socket says 172.21.15.100:57996) 2024-01-20T08:10:16.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7131600640 1 -- 172.21.15.100:0/4289311796 learned_addr learned my addr 172.21.15.100:0/4289311796 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7130c00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 0x7f712c1ef760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.036+0000 7f7c73200640 1 -- start start 2024-01-20T08:10:16.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 -- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712c152dd0 msgr2=0x7f712c1f1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712c152dd0 0x7f712c1f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 -- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 msgr2=0x7f712c1ef760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 0x7f712c1ef760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 -- 172.21.15.100:0/4289311796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124009a70 con 0x7f712c0714d0 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7130c00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 0x7f712c1ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faaba800640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faab400cd50 tx=0x7faab400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7131600640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f711400c400 tx=0x7f711400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71140052d0 con 0x7f712c0714d0 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400f680 con 0x7faabc155290 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faab400f800 con 0x7faabc155290 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faab400fbb0 con 0x7faabc155290 2024-01-20T08:10:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faabc1edd70 con 0x7faabc155290 2024-01-20T08:10:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7114005430 con 0x7f712c0714d0 2024-01-20T08:10:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7114007260 con 0x7f712c0714d0 2024-01-20T08:10:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.038+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f712c1550c0 con 0x7f712c0714d0 2024-01-20T08:10:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.038+0000 7f7c73200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c6404dff0 0x7f7c6404e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.037+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faabc1ee330 con 0x7faabc155290 2024-01-20T08:10:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.038+0000 7f7c73200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c6400f9d0 con 0x7f7c640d7ae0 2024-01-20T08:10:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.038+0000 7f7c73200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c640da4b0 con 0x7f7c6404dae0 2024-01-20T08:10:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.038+0000 7f7c73200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c640da790 con 0x7f7c6404dff0 2024-01-20T08:10:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c6404dff0 0x7f7c6404e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f712c0bb980 con 0x7f712c0714d0 2024-01-20T08:10:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7c6404dff0 0x7f7c6404e7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53308/0 (socket says 172.21.15.100:53308) 2024-01-20T08:10:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 -- 172.21.15.100:0/2241743075 learned_addr learned my addr 172.21.15.100:0/2241743075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faabc0c7ca0 con 0x7faabc155290 2024-01-20T08:10:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 -- 172.21.15.100:0/2241743075 >> v1:172.21.15.110:6789/0 conn(0x7f7c6404dae0 legacy=0x7f7c6404ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 -- 172.21.15.100:0/2241743075 >> v1:172.21.15.100:6789/0 conn(0x7f7c640d7ae0 legacy=0x7f7c640071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f7c71400640 1 -- 172.21.15.100:0/2241743075 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c640daa70 con 0x7f7c6404dff0 2024-01-20T08:10:16.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.039+0000 7f381d400640 1 Processor -- start 2024-01-20T08:10:16.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.040+0000 7f7c71400640 1 --2- 172.21.15.100:0/2241743075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dff0 0x7f7c6404e7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c5402b9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=879ddb937b0049ca server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f712c154c80 con 0x7f712c0714d0 2024-01-20T08:10:16.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7faab400b040 con 0x7faabc155290 2024-01-20T08:10:16.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.040+0000 7f381d400640 1 -- start start 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7f381d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3818154810 0x7f381806b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7f381d400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180c9100 con 0x7f38180c7ff0 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7f381d400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180c84f0 con 0x7f381806b140 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.041+0000 7f381d400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180c87d0 con 0x7f3818154810 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.042+0000 7f380fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f38180c7ff0 0x7f38181565c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55624/0 (socket says 172.21.15.100:55624) 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.042+0000 7f380fe00640 1 -- 172.21.15.100:0/836472057 learned_addr learned my addr 172.21.15.100:0/836472057 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.042+0000 7f3817200640 1 --2- 172.21.15.100:0/836472057 >> v2:172.21.15.100:3300/0 conn(0x7f3818154810 0x7f381806b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.042+0000 7f3817200640 1 -- 172.21.15.100:0/836472057 >> v1:172.21.15.110:6789/0 conn(0x7f381806b140 legacy=0x7f3818155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.043+0000 7f3817200640 1 -- 172.21.15.100:0/836472057 >> v1:172.21.15.100:6789/0 conn(0x7f38180c7ff0 legacy=0x7f38181565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.043+0000 7f3817200640 1 -- 172.21.15.100:0/836472057 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180c8ab0 con 0x7f3818154810 2024-01-20T08:10:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.043+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f71140073c0 con 0x7f712c0714d0 2024-01-20T08:10:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.042+0000 7faab2000640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 0x7faa9406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.043+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faab408a270 con 0x7faabc155290 2024-01-20T08:10:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.043+0000 7faab9e00640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 0x7faa9406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.044+0000 7faab9e00640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 0x7faa9406d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faaac036000 tx=0x7faaac03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.044+0000 7f3817200640 1 --2- 172.21.15.100:0/836472057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818154810 0x7f381806b520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3810009d90 tx=0x7f381002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22045dbe1163770 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.044+0000 7f7129600640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 0x7f710406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.044+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7114088a70 con 0x7f712c0714d0 2024-01-20T08:10:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.044+0000 7f7130c00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 0x7f710406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.045+0000 7f7130c00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 0x7f710406d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7124036000 tx=0x7f7124030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.047+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7faab4055360 con 0x7faabc155290 2024-01-20T08:10:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.048+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f46ac053da0 con 0x7f46bc0be340 2024-01-20T08:10:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7fb377e00640 1 -- 172.21.15.100:0/1040522371 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368030800 con 0x7fb3780c3460 2024-01-20T08:10:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074003a20 con 0x7f2084151e40 2024-01-20T08:10:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7fcbb1600640 1 -- 172.21.15.100:0/1442308322 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac02cc70 con 0x7fcbb40bd690 2024-01-20T08:10:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f7c70a00640 1 -- 172.21.15.100:0/2241743075 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030890 con 0x7f7c6404dff0 2024-01-20T08:10:16.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7fb377e00640 1 -- 172.21.15.100:0/1040522371 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb368030960 con 0x7fb3780c3460 2024-01-20T08:10:16.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7fb377e00640 1 -- 172.21.15.100:0/1040522371 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb368030d30 con 0x7fb3780c3460 2024-01-20T08:10:16.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2084153930 con 0x7f2084151e40 2024-01-20T08:10:16.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2084152510 con 0x7f2084151e40 2024-01-20T08:10:16.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2074040070 con 0x7f2084151e40 2024-01-20T08:10:16.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2074003da0 con 0x7f2084151e40 2024-01-20T08:10:16.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.053+0000 7f7c70a00640 1 -- 172.21.15.100:0/2241743075 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c540309f0 con 0x7f7c6404dff0 2024-01-20T08:10:16.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7fcbb1600640 1 -- 172.21.15.100:0/1442308322 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac02cdd0 con 0x7fcbb40bd690 2024-01-20T08:10:16.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7fcbb1600640 1 -- 172.21.15.100:0/1442308322 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac034640 con 0x7fcbb40bd690 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7fb380000640 1 -- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 msgr2=0x7fb378139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7fb380000640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378139520 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb37806b450 tx=0x7fb36802b940 comp rx=0 tx=0).stop 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7f7c70a00640 1 -- 172.21.15.100:0/2241743075 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54030dc0 con 0x7f7c6404dff0 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7f7c73200640 1 -- 172.21.15.100:0/2241743075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dff0 msgr2=0x7f7c6404e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.054+0000 7f7c73200640 1 --2- 172.21.15.100:0/2241743075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dff0 0x7f7c6404e7d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c5402b9d0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f7c73200640 1 -- 172.21.15.100:0/2241743075 shutdown_connections 2024-01-20T08:10:16.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f7c73200640 1 --2- 172.21.15.100:0/2241743075 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dff0 0x7f7c6404e7d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f7c73200640 1 -- 172.21.15.100:0/2241743075 >> 172.21.15.100:0/2241743075 conn(0x7f7c6404c660 msgr2=0x7f7c6404ca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 -- 172.21.15.100:0/1040522371 shutdown_connections 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb3780c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 --2- 172.21.15.100:0/1040522371 >> v2:172.21.15.100:3300/0 conn(0x7fb378139b60 0x7fb3780ab3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 --2- 172.21.15.100:0/1040522371 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378139520 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 -- 172.21.15.100:0/1040522371 >> 172.21.15.100:0/1040522371 conn(0x7fb3780c2940 msgr2=0x7fb3780c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f7c73200640 1 -- 172.21.15.100:0/2241743075 shutdown_connections 2024-01-20T08:10:16.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 -- 172.21.15.100:0/1040522371 shutdown_connections 2024-01-20T08:10:16.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7fb380000640 1 -- 172.21.15.100:0/1040522371 wait complete. 2024-01-20T08:10:16.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2054005290 con 0x7f2084151e40 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f3815e00640 1 -- 172.21.15.100:0/836472057 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381002cbd0 con 0x7f3818154810 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f3815e00640 1 -- 172.21.15.100:0/836472057 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381002cd30 con 0x7f3818154810 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.055+0000 7f3815e00640 1 -- 172.21.15.100:0/836472057 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381002cea0 con 0x7f3818154810 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7f7c73200640 1 -- 172.21.15.100:0/2241743075 wait complete. 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1442308322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb40bd690 msgr2=0x7fcbb415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1442308322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb40bd690 0x7fcbb415a120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009d90 tx=0x7fcbac02bec0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7f381d400640 1 -- 172.21.15.100:0/836472057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818154810 msgr2=0x7f381806b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7f381d400640 1 --2- 172.21.15.100:0/836472057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818154810 0x7f381806b520 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3810009d90 tx=0x7f381002be20 comp rx=0 tx=0).stop 2024-01-20T08:10:16.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.057+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1442308322 shutdown_connections 2024-01-20T08:10:16.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.057+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1442308322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb40bd690 0x7fcbb415a120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.057+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1442308322 >> 172.21.15.100:0/1442308322 conn(0x7fcbb40abc80 msgr2=0x7fcbb40ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.056+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f712c154c80 con 0x7f712c0714d0 2024-01-20T08:10:16.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7f381d400640 1 -- 172.21.15.100:0/836472057 shutdown_connections 2024-01-20T08:10:16.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7f381d400640 1 --2- 172.21.15.100:0/836472057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3818154810 0x7f381806b520 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7f381d400640 1 -- 172.21.15.100:0/836472057 >> 172.21.15.100:0/836472057 conn(0x7f38180abc80 msgr2=0x7f38180ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.057+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2074005990 con 0x7f2084151e40 2024-01-20T08:10:16.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1442308322 shutdown_connections 2024-01-20T08:10:16.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7f7c73200640 1 Processor -- start 2024-01-20T08:10:16.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.058+0000 7fb380000640 1 Processor -- start 2024-01-20T08:10:16.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.059+0000 7f381d400640 1 -- 172.21.15.100:0/836472057 shutdown_connections 2024-01-20T08:10:16.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.059+0000 7f7c73200640 1 -- start start 2024-01-20T08:10:16.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.059+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1442308322 wait complete. 2024-01-20T08:10:16.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.059+0000 7fb380000640 1 -- start start 2024-01-20T08:10:16.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.060+0000 7f7c73200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dae0 0x7f7c6417a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.060+0000 7f7c73200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.059+0000 7f381d400640 1 -- 172.21.15.100:0/836472057 wait complete. 2024-01-20T08:10:16.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.060+0000 7f207a000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 0x7f205c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.060+0000 7f7c73200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 0x7f7c64180060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2074042070 con 0x7f2084151e40 2024-01-20T08:10:16.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7f7c73200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640dd840 con 0x7f7c6404dff0 2024-01-20T08:10:16.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7f7c73200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6417a6f0 con 0x7f7c6404dae0 2024-01-20T08:10:16.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7f7c73200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c640356b0 con 0x7f7c640d7ae0 2024-01-20T08:10:16.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7fb380000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb37806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7f2081e00640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 0x7f205c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7fcbb9c00640 1 Processor -- start 2024-01-20T08:10:16.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.061+0000 7fb380000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f381d400640 1 Processor -- start 2024-01-20T08:10:16.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f7c71400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f7c71400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58004/0 (socket says 172.21.15.100:58004) 2024-01-20T08:10:16.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f7c71400640 1 -- 172.21.15.100:0/2474332804 learned_addr learned my addr 172.21.15.100:0/2474332804 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f7c71e00640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dae0 0x7f7c6417a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb380000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f381d400640 1 -- start start 2024-01-20T08:10:16.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7f7c72800640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 0x7f7c64180060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fcbb9c00640 1 -- start start 2024-01-20T08:10:16.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb380000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37812f220 con 0x7fb378139b60 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f2081e00640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 0x7f205c06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f207c005c00 tx=0x7f207c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb380000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3780bfdd0 con 0x7fb3780c3460 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb380000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb37814f730 con 0x7fb3780c1850 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb37e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb37e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58010/0 (socket says 172.21.15.100:58010) 2024-01-20T08:10:16.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb37e000640 1 -- 172.21.15.100:0/1840313959 learned_addr learned my addr 172.21.15.100:0/1840313959 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.062+0000 7fb37d600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb37806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7fb37e000640 1 -- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 msgr2=0x7fb37806d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 -- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 msgr2=0x7f7c64180060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 0x7f7c64180060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 -- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dae0 msgr2=0x7f7c6417a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dae0 0x7f7c6417a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 -- 172.21.15.100:0/2474332804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c540094d0 con 0x7f7c6404dff0 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c72800640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 0x7f7c64180060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7fb37e000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb37806d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7fb37e000640 1 -- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 msgr2=0x7fb378152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7f7c71400640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.063+0000 7fb37e000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fb37e000640 1 -- 172.21.15.100:0/1840313959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680094d0 con 0x7fb378139b60 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f381d400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c54039e00 con 0x7f7c6404dff0 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c54043400 con 0x7f7c6404dff0 2024-01-20T08:10:16.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c540437b0 con 0x7f7c6404dff0 2024-01-20T08:10:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c64180ba0 con 0x7f7c6404dff0 2024-01-20T08:10:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fb37d600640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb37806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:16.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f381d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 0x7f3818148300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb40bd690 0x7fcbb4157f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb4156240 0x7fcbb41eecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c4480 con 0x7fcbb40bd140 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c3ec0 con 0x7fcbb4156240 2024-01-20T08:10:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fcbb9c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40c41a0 con 0x7fcbb40bd690 2024-01-20T08:10:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7fb37e000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb37000cef0 tx=0x7fb37000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c640dd1f0 con 0x7f7c6404dff0 2024-01-20T08:10:16.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.064+0000 7f381d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 0x7f38180a9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7fcbb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f381d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180a9a60 con 0x7f38180c7ff0 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f3816800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f3816800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47534/0 (socket says 172.21.15.100:47534) 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f3816800640 1 -- 172.21.15.100:0/2917572548 learned_addr learned my addr 172.21.15.100:0/2917572548 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f380fe00640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 0x7f3818148300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7fcbb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58016/0 (socket says 172.21.15.100:58016) 2024-01-20T08:10:16.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7fcbb2a00640 1 -- 172.21.15.100:0/1028968399 learned_addr learned my addr 172.21.15.100:0/1028968399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180c2770 con 0x7f3818154810 2024-01-20T08:10:16.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38181ea560 con 0x7f381806b140 2024-01-20T08:10:16.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7f3817200640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 0x7f38180a9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.065+0000 7fcbb3400640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb4156240 0x7fcbb41eecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 -- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb40bd690 msgr2=0x7fcbb4157f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-01-20T08:10:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb40bd690 0x7fcbb4157f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 -- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb4156240 msgr2=0x7fcbb41eecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb4156240 0x7fcbb41eecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 -- 172.21.15.100:0/1028968399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009a70 con 0x7fcbb40bd140 2024-01-20T08:10:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000d840 con 0x7fb378139b60 2024-01-20T08:10:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3817200640 1 -- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 msgr2=0x7f38181e76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb37000d9c0 con 0x7fb378139b60 2024-01-20T08:10:16.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb37000dd70 con 0x7fb378139b60 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37812e460 con 0x7fb378139b60 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37812ea20 con 0x7fb378139b60 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7fcbb2a00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c3c0 tx=0x7fcba400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3817200640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3817200640 1 -- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 msgr2=0x7f3818148300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3817200640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 0x7f3818148300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3817200640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3810009a70 con 0x7f3818154810 2024-01-20T08:10:16.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f3816800640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:16.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.066+0000 7f380fe00640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 0x7f3818148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:16.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4005ce0 con 0x7fcbb40bd140 2024-01-20T08:10:16.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba4005e40 con 0x7fcbb40bd140 2024-01-20T08:10:16.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba40072d0 con 0x7fcbb40bd140 2024-01-20T08:10:16.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41ee4b0 con 0x7fcbb40bd140 2024-01-20T08:10:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7f3817200640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 0x7f38180a9ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3810033000 tx=0x7f3810004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.068+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb4158450 con 0x7fcbb40bd140 2024-01-20T08:10:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb41ee310 con 0x7fcbb40bd140 2024-01-20T08:10:16.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.067+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7c54043910 con 0x7f7c6404dff0 2024-01-20T08:10:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7f7c6a000640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 0x7f7c4406d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c64005fa0 con 0x7f7c6404dff0 2024-01-20T08:10:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c5403e070 con 0x7f7c6404dff0 2024-01-20T08:10:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb348005290 con 0x7fb378139b60 2024-01-20T08:10:16.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.069+0000 7f7c71e00640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 0x7f7c4406d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.072+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcba40074f0 con 0x7fcbb40bd140 2024-01-20T08:10:16.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.071+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f20740765c0 con 0x7f2084151e40 2024-01-20T08:10:16.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.072+0000 7f7c71e00640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 0x7f7c4406d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0016e0 tx=0x7f7c5c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fcbaaa00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 0x7fcb8c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.071+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb37001e3b0 con 0x7fb378139b60 2024-01-20T08:10:16.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fb375600640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 0x7fb35006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb37008a0f0 con 0x7fb378139b60 2024-01-20T08:10:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcba4088b00 con 0x7fcbb40bd140 2024-01-20T08:10:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fb37d600640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 0x7fb35006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.073+0000 7fcbb2000640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 0x7fcb8c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.074+0000 7fcbb2000640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 0x7fcb8c06d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000f60 tx=0x7fcb9c0079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.074+0000 7fb37d600640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 0x7fb35006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb36803b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381002cea0 con 0x7f3818154810 2024-01-20T08:10:16.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f381003e610 con 0x7f3818154810 2024-01-20T08:10:16.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7c54034080 con 0x7f7c6404dff0 2024-01-20T08:10:16.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f381003e9e0 con 0x7f3818154810 2024-01-20T08:10:16.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38181ea840 con 0x7f3818154810 2024-01-20T08:10:16.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.077+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38181eae00 con 0x7f3818154810 2024-01-20T08:10:16.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.079+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38180a9bd0 con 0x7f3818154810 2024-01-20T08:10:16.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.082+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f381003b050 con 0x7f3818154810 2024-01-20T08:10:16.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.083+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb370055070 con 0x7fb378139b60 2024-01-20T08:10:16.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.083+0000 7f380ea00640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 0x7f37f006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.083+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38100ac310 con 0x7f3818154810 2024-01-20T08:10:16.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.087+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcbb41ee310 con 0x7fcbb40bd140 2024-01-20T08:10:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.087+0000 7f3816800640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 0x7f37f006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.088+0000 7f3816800640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 0x7f37f006d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3808001b90 tx=0x7f3808009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.094+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3810077520 con 0x7f3818154810 2024-01-20T08:10:16.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.456+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f468c005540 con 0x7f46bc0be340 2024-01-20T08:10:16.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.457+0000 7f46b8c00640 1 -- 172.21.15.100:0/17438268 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46ac01a020 con 0x7f46bc0be340 2024-01-20T08:10:16.460 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.460+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 msgr2=0x7f469406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.460+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 0x7f469406d3c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f46a4001120 tx=0x7f46a4000f50 comp rx=0 tx=0).stop 2024-01-20T08:10:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.460+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 msgr2=0x7f46bc156ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.460+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00f570 tx=0x7f46ac00f970 comp rx=0 tx=0).stop 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 shutdown_connections 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46bc0be7c0 0x7f46bc0c04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46bc0be340 0x7f46bc156ac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f469406af00 0x7f469406d3c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 --2- 172.21.15.100:0/17438268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f469c0053d0 0x7f46bc151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 >> 172.21.15.100:0/17438268 conn(0x7f46bc072130 msgr2=0x7f46bc072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.461+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 shutdown_connections 2024-01-20T08:10:16.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.462+0000 7f46c3c00640 1 -- 172.21.15.100:0/17438268 wait complete. 2024-01-20T08:10:16.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.467+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7faabc04e970 con 0x7faabc155290 2024-01-20T08:10:16.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.468+0000 7faab2000640 1 -- 172.21.15.100:0/3982923988 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faab401d020 con 0x7faabc155290 2024-01-20T08:10:16.474 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.472+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 msgr2=0x7faa9406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.472+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 0x7faa9406d390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faaac036000 tx=0x7faaac03c040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.472+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 msgr2=0x7faabc1ea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.472+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faab400cd50 tx=0x7faab400a650 comp rx=0 tx=0).stop 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 shutdown_connections 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faabc155290 0x7faabc1ea760 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faabc151e40 0x7faabc148e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa9406aed0 0x7faa9406d390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 --2- 172.21.15.100:0/3982923988 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faabc0c4a50 0x7faabc14af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 >> 172.21.15.100:0/3982923988 conn(0x7faabc0abde0 msgr2=0x7faabc14cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 shutdown_connections 2024-01-20T08:10:16.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.473+0000 7faac1200640 1 -- 172.21.15.100:0/3982923988 wait complete. 2024-01-20T08:10:16.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.482+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f712c154c80 con 0x7f712c0714d0 2024-01-20T08:10:16.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.484+0000 7f7129600640 1 -- 172.21.15.100:0/4289311796 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f712c154c80 con 0x7f712c0714d0 2024-01-20T08:10:16.490 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.491 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.2 2024-01-20T08:10:16.491 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.488+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 msgr2=0x7f710406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.488+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 0x7f710406d3c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7124036000 tx=0x7f7124030000 comp rx=0 tx=0).stop 2024-01-20T08:10:16.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.488+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 msgr2=0x7f712c1558c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.488+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f711400c400 tx=0x7f711400c8c0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.488+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 shutdown_connections 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f710406af00 0x7f710406d3c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f712c152dd0 0x7f712c1f1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f712c1529f0 0x7f712c1ef760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 --2- 172.21.15.100:0/4289311796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f712c0714d0 0x7f712c1558c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 >> 172.21.15.100:0/4289311796 conn(0x7f712c0c28b0 msgr2=0x7f712c071960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.489+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 shutdown_connections 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.490+0000 7f7132a00640 1 -- 172.21.15.100:0/4289311796 wait complete. 2024-01-20T08:10:16.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.491+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2054005810 con 0x7f2084151e40 2024-01-20T08:10:16.494 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-20T08:10:16.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.492+0000 7f207a000640 1 -- 172.21.15.100:0/2301030344 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f207404b090 con 0x7f2084151e40 2024-01-20T08:10:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 msgr2=0x7f205c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 0x7f205c06d390 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f207c005c00 tx=0x7f207c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 msgr2=0x7f20840c3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 0x7f20840c3d10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f20840c78b0 tx=0x7f20740046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 shutdown_connections 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f205c06aed0 0x7f205c06d390 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f207c005c00 tx=0x7f207c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2084155290 0x7f2084152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2084151e40 0x7f20840c3d10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 --2- 172.21.15.100:0/2301030344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20840c4a50 0x7f20840c37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.495+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 >> 172.21.15.100:0/2301030344 conn(0x7f20840abde0 msgr2=0x7f20840ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.496+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 shutdown_connections 2024-01-20T08:10:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.496+0000 7f2089000640 1 -- 172.21.15.100:0/2301030344 wait complete. 2024-01-20T08:10:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.498+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f7c64049ec0 con 0x7f7c6404dff0 2024-01-20T08:10:16.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-01-20T08:10:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.500+0000 7f7c6a000640 1 -- 172.21.15.100:0/2474332804 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7c54077990 con 0x7f7c6404dff0 2024-01-20T08:10:16.505 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.506 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.501+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3818067fa0 con 0x7f3818154810 2024-01-20T08:10:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.501+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb348005540 con 0x7fb378139b60 2024-01-20T08:10:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.501+0000 7fb375600640 1 -- 172.21.15.100:0/1840313959 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb370058690 con 0x7fb378139b60 2024-01-20T08:10:16.507 INFO:teuthology.orchestra.run.smithi100.stdout:55834574853 2024-01-20T08:10:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.502+0000 7f380ea00640 1 -- 172.21.15.100:0/2917572548 <== mon.1 v2:172.21.15.110:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3810039020 con 0x7f3818154810 2024-01-20T08:10:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.502+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fcbb41ee9d0 con 0x7fcbb40bd140 2024-01-20T08:10:16.507 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.502+0000 7fcbaaa00640 1 -- 172.21.15.100:0/1028968399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbb41ee9d0 con 0x7fcbb40bd140 2024-01-20T08:10:16.508 INFO:teuthology.orchestra.run.smithi100.stdout:55834574852 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 msgr2=0x7f7c4406d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 0x7f7c4406d460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c0016e0 tx=0x7f7c5c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 msgr2=0x7f7c640333a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009870 tx=0x7f7c54004730 comp rx=0 tx=0).stop 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 shutdown_connections 2024-01-20T08:10:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7c4406afa0 0x7f7c4406d460 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c640d7ae0 0x7f7c64180060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c6404dff0 0x7f7c640333a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 --2- 172.21.15.100:0/2474332804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c6404dae0 0x7f7c6417a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.503+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 >> 172.21.15.100:0/2474332804 conn(0x7f7c6404c660 msgr2=0x7f7c640428c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.504+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 shutdown_connections 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.504+0000 7f7c73200640 1 -- 172.21.15.100:0/2474332804 wait complete. 2024-01-20T08:10:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 msgr2=0x7fb35006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 0x7fb35006d3c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb368036000 tx=0x7fb36803b040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 msgr2=0x7fb3781532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb37000cef0 tx=0x7fb37000a710 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 shutdown_connections 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb378139b60 0x7fb3781532b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3780c3460 0x7fb378152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb35006af00 0x7fb35006d3c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 --2- 172.21.15.100:0/1840313959 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3780c1850 0x7fb37806d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 >> 172.21.15.100:0/1840313959 conn(0x7fb3780c2940 msgr2=0x7fb378145570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 shutdown_connections 2024-01-20T08:10:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.505+0000 7fb380000640 1 -- 172.21.15.100:0/1840313959 wait complete. 2024-01-20T08:10:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 msgr2=0x7fcb8c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 0x7fcb8c06d3e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c000f60 tx=0x7fcb9c0079b0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 msgr2=0x7fcbb40bdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcba400c3c0 tx=0x7fcba400c880 comp rx=0 tx=0).stop 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 shutdown_connections 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcbb4156240 0x7fcbb41eecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb8c06af20 0x7fcb8c06d3e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcbb40bd690 0x7fcbb4157f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 --2- 172.21.15.100:0/1028968399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcbb40bd140 0x7fcbb40bdc20 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 >> 172.21.15.100:0/1028968399 conn(0x7fcbb40abc80 msgr2=0x7fcbb40ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.506+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 shutdown_connections 2024-01-20T08:10:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.507+0000 7fcbb9c00640 1 -- 172.21.15.100:0/1028968399 wait complete. 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 msgr2=0x7f37f006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 0x7f37f006d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3808001b90 tx=0x7f3808009040 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 msgr2=0x7f38180a9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 0x7f38180a9ef0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3810033000 tx=0x7f3810004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 shutdown_connections 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3818154810 0x7f38180a9ef0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f38180c7ff0 0x7f3818148300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f37f006af20 0x7f37f006d3e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 --2- 172.21.15.100:0/2917572548 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f381806b140 0x7f38181e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 >> 172.21.15.100:0/2917572548 conn(0x7f38180abc80 msgr2=0x7f38180ca0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 shutdown_connections 2024-01-20T08:10:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.509+0000 7f381d400640 1 -- 172.21.15.100:0/2917572548 wait complete. 2024-01-20T08:10:16.517 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-01-20T08:10:16.517 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-01-20T08:10:16.521 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-01-20T08:10:16.527 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.530 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.1 2024-01-20T08:10:16.530 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-01-20T08:10:16.532 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.5 2024-01-20T08:10:16.537 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:16.537 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-20T08:10:16.537 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:10:16.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.777+0000 7fd9f7200640 1 Processor -- start 2024-01-20T08:10:16.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.777+0000 7fd9f7200640 1 -- start start 2024-01-20T08:10:16.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.778+0000 7fd9f7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.778+0000 7fd9f7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd9f00c7e30 0x7fd9f0154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.778+0000 7fd9f7200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9f0158560 con 0x7fd9f0071d10 2024-01-20T08:10:16.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.778+0000 7fd9f7200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9f00c5640 con 0x7fd9f00c7e30 2024-01-20T08:10:16.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.778+0000 7fd9f7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c50a0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.779+0000 7fd9f5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.779+0000 7fd9f5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:47548/0 (socket says 172.21.15.100:47548) 2024-01-20T08:10:16.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.779+0000 7fd9f5400640 1 -- 172.21.15.100:0/3543373121 learned_addr learned my addr 172.21.15.100:0/3543373121 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.780+0000 7fd9f5400640 1 -- 172.21.15.100:0/3543373121 >> v2:172.21.15.110:3300/0 conn(0x7fd9f00c7e30 msgr2=0x7fd9f0154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:16.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.780+0000 7fd9f5400640 1 --2- 172.21.15.100:0/3543373121 >> v2:172.21.15.110:3300/0 conn(0x7fd9f00c7e30 0x7fd9f0154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.780+0000 7fd9f5400640 1 -- 172.21.15.100:0/3543373121 >> v1:172.21.15.110:6789/0 conn(0x7fd9f0071d10 legacy=0x7fd9f0154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.780+0000 7fd9f5400640 1 -- 172.21.15.100:0/3543373121 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f006cb90 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.782+0000 7fd9f5400640 1 --2- 172.21.15.100:0/3543373121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009870 tx=0x7fd9d802b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9a575c335198e92 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.782+0000 7fd9f4a00640 1 -- 172.21.15.100:0/3543373121 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80317c0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f4a00640 1 -- 172.21.15.100:0/3543373121 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8031920 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f4a00640 1 -- 172.21.15.100:0/3543373121 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8031cb0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 -- 172.21.15.100:0/3543373121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 msgr2=0x7fd9f00720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 --2- 172.21.15.100:0/3543373121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8009870 tx=0x7fd9d802b860 comp rx=0 tx=0).stop 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 -- 172.21.15.100:0/3543373121 shutdown_connections 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 --2- 172.21.15.100:0/3543373121 >> v2:172.21.15.110:3300/0 conn(0x7fd9f00c7e30 0x7fd9f0154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 --2- 172.21.15.100:0/3543373121 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00bd5c0 0x7fd9f00720f0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 -- 172.21.15.100:0/3543373121 >> 172.21.15.100:0/3543373121 conn(0x7fd9f00c9f30 msgr2=0x7fd9f00ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 -- 172.21.15.100:0/3543373121 shutdown_connections 2024-01-20T08:10:16.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.783+0000 7fd9f7200640 1 -- 172.21.15.100:0/3543373121 wait complete. 2024-01-20T08:10:16.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.785+0000 7fd9f7200640 1 Processor -- start 2024-01-20T08:10:16.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.785+0000 7fd9f7200640 1 -- start start 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 0x7fd9f0144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00c7e30 0x7fd9f00bfdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f00c0300 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0152520 con 0x7fd9f0071d10 2024-01-20T08:10:16.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.786+0000 7fd9f7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f0152800 con 0x7fd9f00c7e30 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58024/0 (socket says 172.21.15.100:58024) 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 -- 172.21.15.100:0/990394127 learned_addr learned my addr 172.21.15.100:0/990394127 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5e00640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 0x7fd9f0144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f6800640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00c7e30 0x7fd9f00bfdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 -- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00c7e30 msgr2=0x7fd9f00bfdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00c7e30 0x7fd9f00bfdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 -- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 msgr2=0x7fd9f0144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 0x7fd9f0144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5400640 1 -- 172.21.15.100:0/990394127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80094d0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.787+0000 7fd9f5e00640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 0x7fd9f0144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9f5400640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000c00 tx=0x7fd9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80329e0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d8032b60 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d80453f0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f0152ae0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.788+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f01530a0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.789+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f0153290 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.790+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd9d804d3f0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.791+0000 7fd9ee000640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 0x7fd9c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.791+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd9d80ab7b0 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.791+0000 7fd9f5e00640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 0x7fd9c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:16.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.792+0000 7fd9f5e00640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 0x7fd9c806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0007fd0 tx=0x7fd9e0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:16.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.795+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd9d8076550 con 0x7fd9f00bd5c0 2024-01-20T08:10:16.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.969+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd9f0152970 con 0x7fd9c806af00 2024-01-20T08:10:16.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.991+0000 7fd9ee000640 1 -- 172.21.15.100:0/990394127 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264407 (secure 0 0 0) 0x7fd9f0152970 con 0x7fd9c806af00 2024-01-20T08:10:16.998 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:17.000 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.995+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 msgr2=0x7fd9c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.995+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 0x7fd9c806d3c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0007fd0 tx=0x7fd9e0009040 comp rx=0 tx=0).stop 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 msgr2=0x7fd9f00bf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9d8000c00 tx=0x7fd9d80046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 shutdown_connections 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9c806af00 0x7fd9c806d3c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd9f00c7e30 0x7fd9f00bfdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd9f00bd5c0 0x7fd9f00bf880 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 --2- 172.21.15.100:0/990394127 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd9f0071d10 0x7fd9f0144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 >> 172.21.15.100:0/990394127 conn(0x7fd9f00c9f30 msgr2=0x7fd9f00aa880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 shutdown_connections 2024-01-20T08:10:17.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:16.996+0000 7fd9f7200640 1 -- 172.21.15.100:0/990394127 wait complete. 2024-01-20T08:10:17.017 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-20T08:10:15.887907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236244,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738476,"statfs":{"total":773094113280,"available":772852199424,"internally_reserved":0,"allocated":3088384,"data_stored":1830660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002357"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193298+0000","last_change":"2024-01-20T08:10:08.794516+0000","last_active":"2024-01-20T08:10:10.193298+0000","last_peered":"2024-01-20T08:10:10.193298+0000","last_clean":"2024-01-20T08:10:10.193298+0000","last_became_active":"2024-01-20T08:10:08.794118+0000","last_became_peered":"2024-01-20T08:10:08.794118+0000","last_unstale":"2024-01-20T08:10:10.193298+0000","last_undegraded":"2024-01-20T08:10:10.193298+0000","last_fullsized":"2024-01-20T08:10:10.193298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188560+0000","last_change":"2024-01-20T08:10:08.778488+0000","last_active":"2024-01-20T08:10:10.188560+0000","last_peered":"2024-01-20T08:10:10.188560+0000","last_clean":"2024-01-20T08:10:10.188560+0000","last_became_active":"2024-01-20T08:10:08.778115+0000","last_became_peered":"2024-01-20T08:10:08.778115+0000","last_unstale":"2024-01-20T08:10:10.188560+0000","last_undegraded":"2024-01-20T08:10:10.188560+0000","last_fullsized":"2024-01-20T08:10:10.188560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.783518+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.780866+0000","last_became_peered":"2024-01-20T08:10:08.780866+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188914+0000","last_change":"2024-01-20T08:10:08.783382+0000","last_active":"2024-01-20T08:10:10.188914+0000","last_peered":"2024-01-20T08:10:10.188914+0000","last_clean":"2024-01-20T08:10:10.188914+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.188914+0000","last_undegraded":"2024-01-20T08:10:10.188914+0000","last_fullsized":"2024-01-20T08:10:10.188914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191839+0000","last_change":"2024-01-20T08:10:08.776063+0000","last_active":"2024-01-20T08:10:10.191839+0000","last_peered":"2024-01-20T08:10:10.191839+0000","last_clean":"2024-01-20T08:10:10.191839+0000","last_became_active":"2024-01-20T08:10:08.775617+0000","last_became_peered":"2024-01-20T08:10:08.775617+0000","last_unstale":"2024-01-20T08:10:10.191839+0000","last_undegraded":"2024-01-20T08:10:10.191839+0000","last_fullsized":"2024-01-20T08:10:10.191839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187876+0000","last_change":"2024-01-20T08:10:08.782346+0000","last_active":"2024-01-20T08:10:10.187876+0000","last_peered":"2024-01-20T08:10:10.187876+0000","last_clean":"2024-01-20T08:10:10.187876+0000","last_became_active":"2024-01-20T08:10:08.782015+0000","last_became_peered":"2024-01-20T08:10:08.782015+0000","last_unstale":"2024-01-20T08:10:10.187876+0000","last_undegraded":"2024-01-20T08:10:10.187876+0000","last_fullsized":"2024-01-20T08:10:10.187876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192165+0000","last_change":"2024-01-20T08:10:08.780591+0000","last_active":"2024-01-20T08:10:10.192165+0000","last_peered":"2024-01-20T08:10:10.192165+0000","last_clean":"2024-01-20T08:10:10.192165+0000","last_became_active":"2024-01-20T08:10:08.780333+0000","last_became_peered":"2024-01-20T08:10:08.780333+0000","last_unstale":"2024-01-20T08:10:10.192165+0000","last_undegraded":"2024-01-20T08:10:10.192165+0000","last_fullsized":"2024-01-20T08:10:10.192165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754474+0000","last_change":"2024-01-20T08:10:08.780476+0000","last_active":"2024-01-20T08:10:09.754474+0000","last_peered":"2024-01-20T08:10:09.754474+0000","last_clean":"2024-01-20T08:10:09.754474+0000","last_became_active":"2024-01-20T08:10:08.780055+0000","last_became_peered":"2024-01-20T08:10:08.780055+0000","last_unstale":"2024-01-20T08:10:09.754474+0000","last_undegraded":"2024-01-20T08:10:09.754474+0000","last_fullsized":"2024-01-20T08:10:09.754474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193268+0000","last_change":"2024-01-20T08:10:08.780635+0000","last_active":"2024-01-20T08:10:10.193268+0000","last_peered":"2024-01-20T08:10:10.193268+0000","last_clean":"2024-01-20T08:10:10.193268+0000","last_became_active":"2024-01-20T08:10:08.780253+0000","last_became_peered":"2024-01-20T08:10:08.780253+0000","last_unstale":"2024-01-20T08:10:10.193268+0000","last_undegraded":"2024-01-20T08:10:10.193268+0000","last_fullsized":"2024-01-20T08:10:10.193268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192006+0000","last_change":"2024-01-20T08:10:08.790551+0000","last_active":"2024-01-20T08:10:10.192006+0000","last_peered":"2024-01-20T08:10:10.192006+0000","last_clean":"2024-01-20T08:10:10.192006+0000","last_became_active":"2024-01-20T08:10:08.790180+0000","last_became_peered":"2024-01-20T08:10:08.790180+0000","last_unstale":"2024-01-20T08:10:10.192006+0000","last_undegraded":"2024-01-20T08:10:10.192006+0000","last_fullsized":"2024-01-20T08:10:10.192006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191485+0000","last_change":"2024-01-20T08:10:08.792788+0000","last_active":"2024-01-20T08:10:10.191485+0000","last_peered":"2024-01-20T08:10:10.191485+0000","last_clean":"2024-01-20T08:10:10.191485+0000","last_became_active":"2024-01-20T08:10:08.791594+0000","last_became_peered":"2024-01-20T08:10:08.791594+0000","last_unstale":"2024-01-20T08:10:10.191485+0000","last_undegraded":"2024-01-20T08:10:10.191485+0000","last_fullsized":"2024-01-20T08:10:10.191485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756031+0000","last_change":"2024-01-20T08:10:08.791553+0000","last_active":"2024-01-20T08:10:09.756031+0000","last_peered":"2024-01-20T08:10:09.756031+0000","last_clean":"2024-01-20T08:10:09.756031+0000","last_became_active":"2024-01-20T08:10:08.789326+0000","last_became_peered":"2024-01-20T08:10:08.789326+0000","last_unstale":"2024-01-20T08:10:09.756031+0000","last_undegraded":"2024-01-20T08:10:09.756031+0000","last_fullsized":"2024-01-20T08:10:09.756031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:59.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755024+0000","last_change":"2024-01-20T08:10:08.783923+0000","last_active":"2024-01-20T08:10:09.755024+0000","last_peered":"2024-01-20T08:10:09.755024+0000","last_clean":"2024-01-20T08:10:09.755024+0000","last_became_active":"2024-01-20T08:10:08.783605+0000","last_became_peered":"2024-01-20T08:10:08.783605+0000","last_unstale":"2024-01-20T08:10:09.755024+0000","last_undegraded":"2024-01-20T08:10:09.755024+0000","last_fullsized":"2024-01-20T08:10:09.755024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186481+0000","last_change":"2024-01-20T08:10:08.786608+0000","last_active":"2024-01-20T08:10:10.186481+0000","last_peered":"2024-01-20T08:10:10.186481+0000","last_clean":"2024-01-20T08:10:10.186481+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.186481+0000","last_undegraded":"2024-01-20T08:10:10.186481+0000","last_fullsized":"2024-01-20T08:10:10.186481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187982+0000","last_change":"2024-01-20T08:10:08.790598+0000","last_active":"2024-01-20T08:10:10.187982+0000","last_peered":"2024-01-20T08:10:10.187982+0000","last_clean":"2024-01-20T08:10:10.187982+0000","last_became_active":"2024-01-20T08:10:08.790298+0000","last_became_peered":"2024-01-20T08:10:08.790298+0000","last_unstale":"2024-01-20T08:10:10.187982+0000","last_undegraded":"2024-01-20T08:10:10.187982+0000","last_fullsized":"2024-01-20T08:10:10.187982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187500+0000","last_change":"2024-01-20T08:10:08.782029+0000","last_active":"2024-01-20T08:10:10.187500+0000","last_peered":"2024-01-20T08:10:10.187500+0000","last_clean":"2024-01-20T08:10:10.187500+0000","last_became_active":"2024-01-20T08:10:08.781132+0000","last_became_peered":"2024-01-20T08:10:08.781132+0000","last_unstale":"2024-01-20T08:10:10.187500+0000","last_undegraded":"2024-01-20T08:10:10.187500+0000","last_fullsized":"2024-01-20T08:10:10.187500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190735+0000","last_change":"2024-01-20T08:10:08.787165+0000","last_active":"2024-01-20T08:10:10.190735+0000","last_peered":"2024-01-20T08:10:10.190735+0000","last_clean":"2024-01-20T08:10:10.190735+0000","last_became_active":"2024-01-20T08:10:08.786862+0000","last_became_peered":"2024-01-20T08:10:08.786862+0000","last_unstale":"2024-01-20T08:10:10.190735+0000","last_undegraded":"2024-01-20T08:10:10.190735+0000","last_fullsized":"2024-01-20T08:10:10.190735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758174+0000","last_change":"2024-01-20T08:10:08.795799+0000","last_active":"2024-01-20T08:10:09.758174+0000","last_peered":"2024-01-20T08:10:09.758174+0000","last_clean":"2024-01-20T08:10:09.758174+0000","last_became_active":"2024-01-20T08:10:08.795565+0000","last_became_peered":"2024-01-20T08:10:08.795565+0000","last_unstale":"2024-01-20T08:10:09.758174+0000","last_undegraded":"2024-01-20T08:10:09.758174+0000","last_fullsized":"2024-01-20T08:10:09.758174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190974+0000","last_change":"2024-01-20T08:10:08.772099+0000","last_active":"2024-01-20T08:10:10.190974+0000","last_peered":"2024-01-20T08:10:10.190974+0000","last_clean":"2024-01-20T08:10:10.190974+0000","last_became_active":"2024-01-20T08:10:08.771805+0000","last_became_peered":"2024-01-20T08:10:08.771805+0000","last_unstale":"2024-01-20T08:10:10.190974+0000","last_undegraded":"2024-01-20T08:10:10.190974+0000","last_fullsized":"2024-01-20T08:10:10.190974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190191+0000","last_change":"2024-01-20T08:10:08.797402+0000","last_active":"2024-01-20T08:10:10.190191+0000","last_peered":"2024-01-20T08:10:10.190191+0000","last_clean":"2024-01-20T08:10:10.190191+0000","last_became_active":"2024-01-20T08:10:08.797026+0000","last_became_peered":"2024-01-20T08:10:08.797026+0000","last_unstale":"2024-01-20T08:10:10.190191+0000","last_undegraded":"2024-01-20T08:10:10.190191+0000","last_fullsized":"2024-01-20T08:10:10.190191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186861+0000","last_change":"2024-01-20T08:10:08.796525+0000","last_active":"2024-01-20T08:10:10.186861+0000","last_peered":"2024-01-20T08:10:10.186861+0000","last_clean":"2024-01-20T08:10:10.186861+0000","last_became_active":"2024-01-20T08:10:08.796194+0000","last_became_peered":"2024-01-20T08:10:08.796194+0000","last_unstale":"2024-01-20T08:10:10.186861+0000","last_undegraded":"2024-01-20T08:10:10.186861+0000","last_fullsized":"2024-01-20T08:10:10.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188827+0000","last_change":"2024-01-20T08:10:08.786863+0000","last_active":"2024-01-20T08:10:10.188827+0000","last_peered":"2024-01-20T08:10:10.188827+0000","last_clean":"2024-01-20T08:10:10.188827+0000","last_became_active":"2024-01-20T08:10:08.786412+0000","last_became_peered":"2024-01-20T08:10:08.786412+0000","last_unstale":"2024-01-20T08:10:10.188827+0000","last_undegraded":"2024-01-20T08:10:10.188827+0000","last_fullsized":"2024-01-20T08:10:10.188827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754903+0000","last_change":"2024-01-20T08:10:08.788906+0000","last_active":"2024-01-20T08:10:09.754903+0000","last_peered":"2024-01-20T08:10:09.754903+0000","last_clean":"2024-01-20T08:10:09.754903+0000","last_became_active":"2024-01-20T08:10:08.788531+0000","last_became_peered":"2024-01-20T08:10:08.788531+0000","last_unstale":"2024-01-20T08:10:09.754903+0000","last_undegraded":"2024-01-20T08:10:09.754903+0000","last_fullsized":"2024-01-20T08:10:09.754903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188113+0000","last_change":"2024-01-20T08:10:08.782233+0000","last_active":"2024-01-20T08:10:10.188113+0000","last_peered":"2024-01-20T08:10:10.188113+0000","last_clean":"2024-01-20T08:10:10.188113+0000","last_became_active":"2024-01-20T08:10:08.781895+0000","last_became_peered":"2024-01-20T08:10:08.781895+0000","last_unstale":"2024-01-20T08:10:10.188113+0000","last_undegraded":"2024-01-20T08:10:10.188113+0000","last_fullsized":"2024-01-20T08:10:10.188113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755626+0000","last_change":"2024-01-20T08:10:08.789012+0000","last_active":"2024-01-20T08:10:09.755626+0000","last_peered":"2024-01-20T08:10:09.755626+0000","last_clean":"2024-01-20T08:10:09.755626+0000","last_became_active":"2024-01-20T08:10:08.788686+0000","last_became_peered":"2024-01-20T08:10:08.788686+0000","last_unstale":"2024-01-20T08:10:09.755626+0000","last_undegraded":"2024-01-20T08:10:09.755626+0000","last_fullsized":"2024-01-20T08:10:09.755626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192597+0000","last_change":"2024-01-20T08:10:08.796945+0000","last_active":"2024-01-20T08:10:10.192597+0000","last_peered":"2024-01-20T08:10:10.192597+0000","last_clean":"2024-01-20T08:10:10.192597+0000","last_became_active":"2024-01-20T08:10:08.796510+0000","last_became_peered":"2024-01-20T08:10:08.796510+0000","last_unstale":"2024-01-20T08:10:10.192597+0000","last_undegraded":"2024-01-20T08:10:10.192597+0000","last_fullsized":"2024-01-20T08:10:10.192597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187326+0000","last_change":"2024-01-20T08:10:08.781890+0000","last_active":"2024-01-20T08:10:10.187326+0000","last_peered":"2024-01-20T08:10:10.187326+0000","last_clean":"2024-01-20T08:10:10.187326+0000","last_became_active":"2024-01-20T08:10:08.781584+0000","last_became_peered":"2024-01-20T08:10:08.781584+0000","last_unstale":"2024-01-20T08:10:10.187326+0000","last_undegraded":"2024-01-20T08:10:10.187326+0000","last_fullsized":"2024-01-20T08:10:10.187326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755750+0000","last_change":"2024-01-20T08:10:08.789316+0000","last_active":"2024-01-20T08:10:09.755750+0000","last_peered":"2024-01-20T08:10:09.755750+0000","last_clean":"2024-01-20T08:10:09.755750+0000","last_became_active":"2024-01-20T08:10:08.788713+0000","last_became_peered":"2024-01-20T08:10:08.788713+0000","last_unstale":"2024-01-20T08:10:09.755750+0000","last_undegraded":"2024-01-20T08:10:09.755750+0000","last_fullsized":"2024-01-20T08:10:09.755750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187162+0000","last_change":"2024-01-20T08:10:08.785197+0000","last_active":"2024-01-20T08:10:10.187162+0000","last_peered":"2024-01-20T08:10:10.187162+0000","last_clean":"2024-01-20T08:10:10.187162+0000","last_became_active":"2024-01-20T08:10:08.784924+0000","last_became_peered":"2024-01-20T08:10:08.784924+0000","last_unstale":"2024-01-20T08:10:10.187162+0000","last_undegraded":"2024-01-20T08:10:10.187162+0000","last_fullsized":"2024-01-20T08:10:10.187162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188330+0000","last_change":"2024-01-20T08:10:08.783898+0000","last_active":"2024-01-20T08:10:10.188330+0000","last_peered":"2024-01-20T08:10:10.188330+0000","last_clean":"2024-01-20T08:10:10.188330+0000","last_became_active":"2024-01-20T08:10:08.783616+0000","last_became_peered":"2024-01-20T08:10:08.783616+0000","last_unstale":"2024-01-20T08:10:10.188330+0000","last_undegraded":"2024-01-20T08:10:10.188330+0000","last_fullsized":"2024-01-20T08:10:10.188330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757513+0000","last_change":"2024-01-20T08:10:08.777383+0000","last_active":"2024-01-20T08:10:09.757513+0000","last_peered":"2024-01-20T08:10:09.757513+0000","last_clean":"2024-01-20T08:10:09.757513+0000","last_became_active":"2024-01-20T08:10:08.777063+0000","last_became_peered":"2024-01-20T08:10:08.777063+0000","last_unstale":"2024-01-20T08:10:09.757513+0000","last_undegraded":"2024-01-20T08:10:09.757513+0000","last_fullsized":"2024-01-20T08:10:09.757513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188697+0000","last_change":"2024-01-20T08:10:08.786427+0000","last_active":"2024-01-20T08:10:10.188697+0000","last_peered":"2024-01-20T08:10:10.188697+0000","last_clean":"2024-01-20T08:10:10.188697+0000","last_became_active":"2024-01-20T08:10:08.786064+0000","last_became_peered":"2024-01-20T08:10:08.786064+0000","last_unstale":"2024-01-20T08:10:10.188697+0000","last_undegraded":"2024-01-20T08:10:10.188697+0000","last_fullsized":"2024-01-20T08:10:10.188697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755478+0000","last_change":"2024-01-20T08:10:08.779140+0000","last_active":"2024-01-20T08:10:09.755478+0000","last_peered":"2024-01-20T08:10:09.755478+0000","last_clean":"2024-01-20T08:10:09.755478+0000","last_became_active":"2024-01-20T08:10:08.778789+0000","last_became_peered":"2024-01-20T08:10:08.778789+0000","last_unstale":"2024-01-20T08:10:09.755478+0000","last_undegraded":"2024-01-20T08:10:09.755478+0000","last_fullsized":"2024-01-20T08:10:09.755478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755123+0000","last_change":"2024-01-20T08:10:07.773775+0000","last_active":"2024-01-20T08:10:09.755123+0000","last_peered":"2024-01-20T08:10:09.755123+0000","last_clean":"2024-01-20T08:10:09.755123+0000","last_became_active":"2024-01-20T08:10:07.773480+0000","last_became_peered":"2024-01-20T08:10:07.773480+0000","last_unstale":"2024-01-20T08:10:09.755123+0000","last_undegraded":"2024-01-20T08:10:09.755123+0000","last_fullsized":"2024-01-20T08:10:09.755123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187214+0000","last_change":"2024-01-20T08:10:08.789715+0000","last_active":"2024-01-20T08:10:10.187214+0000","last_peered":"2024-01-20T08:10:10.187214+0000","last_clean":"2024-01-20T08:10:10.187214+0000","last_became_active":"2024-01-20T08:10:08.789077+0000","last_became_peered":"2024-01-20T08:10:08.789077+0000","last_unstale":"2024-01-20T08:10:10.187214+0000","last_undegraded":"2024-01-20T08:10:10.187214+0000","last_fullsized":"2024-01-20T08:10:10.187214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189547+0000","last_change":"2024-01-20T08:10:07.779298+0000","last_active":"2024-01-20T08:10:10.189547+0000","last_peered":"2024-01-20T08:10:10.189547+0000","last_clean":"2024-01-20T08:10:10.189547+0000","last_became_active":"2024-01-20T08:10:07.776952+0000","last_became_peered":"2024-01-20T08:10:07.776952+0000","last_unstale":"2024-01-20T08:10:10.189547+0000","last_undegraded":"2024-01-20T08:10:10.189547+0000","last_fullsized":"2024-01-20T08:10:10.189547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754848+0000","last_change":"2024-01-20T08:10:07.771726+0000","last_active":"2024-01-20T08:10:09.754848+0000","last_peered":"2024-01-20T08:10:09.754848+0000","last_clean":"2024-01-20T08:10:09.754848+0000","last_became_active":"2024-01-20T08:10:07.771478+0000","last_became_peered":"2024-01-20T08:10:07.771478+0000","last_unstale":"2024-01-20T08:10:09.754848+0000","last_undegraded":"2024-01-20T08:10:09.754848+0000","last_fullsized":"2024-01-20T08:10:09.754848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754395+0000","last_change":"2024-01-20T08:10:08.778862+0000","last_active":"2024-01-20T08:10:09.754395+0000","last_peered":"2024-01-20T08:10:09.754395+0000","last_clean":"2024-01-20T08:10:09.754395+0000","last_became_active":"2024-01-20T08:10:08.778602+0000","last_became_peered":"2024-01-20T08:10:08.778602+0000","last_unstale":"2024-01-20T08:10:09.754395+0000","last_undegraded":"2024-01-20T08:10:09.754395+0000","last_fullsized":"2024-01-20T08:10:09.754395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187787+0000","last_change":"2024-01-20T08:10:07.782188+0000","last_active":"2024-01-20T08:10:10.187787+0000","last_peered":"2024-01-20T08:10:10.187787+0000","last_clean":"2024-01-20T08:10:10.187787+0000","last_became_active":"2024-01-20T08:10:07.781848+0000","last_became_peered":"2024-01-20T08:10:07.781848+0000","last_unstale":"2024-01-20T08:10:10.187787+0000","last_undegraded":"2024-01-20T08:10:10.187787+0000","last_fullsized":"2024-01-20T08:10:10.187787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187824+0000","last_change":"2024-01-20T08:10:08.771016+0000","last_active":"2024-01-20T08:10:10.187824+0000","last_peered":"2024-01-20T08:10:10.187824+0000","last_clean":"2024-01-20T08:10:10.187824+0000","last_became_active":"2024-01-20T08:10:08.770684+0000","last_became_peered":"2024-01-20T08:10:08.770684+0000","last_unstale":"2024-01-20T08:10:10.187824+0000","last_undegraded":"2024-01-20T08:10:10.187824+0000","last_fullsized":"2024-01-20T08:10:10.187824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192570+0000","last_change":"2024-01-20T08:10:07.783230+0000","last_active":"2024-01-20T08:10:10.192570+0000","last_peered":"2024-01-20T08:10:10.192570+0000","last_clean":"2024-01-20T08:10:10.192570+0000","last_became_active":"2024-01-20T08:10:07.782491+0000","last_became_peered":"2024-01-20T08:10:07.782491+0000","last_unstale":"2024-01-20T08:10:10.192570+0000","last_undegraded":"2024-01-20T08:10:10.192570+0000","last_fullsized":"2024-01-20T08:10:10.192570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190746+0000","last_change":"2024-01-20T08:10:08.790309+0000","last_active":"2024-01-20T08:10:10.190746+0000","last_peered":"2024-01-20T08:10:10.190746+0000","last_clean":"2024-01-20T08:10:10.190746+0000","last_became_active":"2024-01-20T08:10:08.790047+0000","last_became_peered":"2024-01-20T08:10:08.790047+0000","last_unstale":"2024-01-20T08:10:10.190746+0000","last_undegraded":"2024-01-20T08:10:10.190746+0000","last_fullsized":"2024-01-20T08:10:10.190746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190087+0000","last_change":"2024-01-20T08:10:07.786339+0000","last_active":"2024-01-20T08:10:10.190087+0000","last_peered":"2024-01-20T08:10:10.190087+0000","last_clean":"2024-01-20T08:10:10.190087+0000","last_became_active":"2024-01-20T08:10:07.786034+0000","last_became_peered":"2024-01-20T08:10:07.786034+0000","last_unstale":"2024-01-20T08:10:10.190087+0000","last_undegraded":"2024-01-20T08:10:10.190087+0000","last_fullsized":"2024-01-20T08:10:10.190087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188010+0000","last_change":"2024-01-20T08:10:08.792377+0000","last_active":"2024-01-20T08:10:10.188010+0000","last_peered":"2024-01-20T08:10:10.188010+0000","last_clean":"2024-01-20T08:10:10.188010+0000","last_became_active":"2024-01-20T08:10:08.792096+0000","last_became_peered":"2024-01-20T08:10:08.792096+0000","last_unstale":"2024-01-20T08:10:10.188010+0000","last_undegraded":"2024-01-20T08:10:10.188010+0000","last_fullsized":"2024-01-20T08:10:10.188010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187591+0000","last_change":"2024-01-20T08:10:07.782717+0000","last_active":"2024-01-20T08:10:10.187591+0000","last_peered":"2024-01-20T08:10:10.187591+0000","last_clean":"2024-01-20T08:10:10.187591+0000","last_became_active":"2024-01-20T08:10:07.782484+0000","last_became_peered":"2024-01-20T08:10:07.782484+0000","last_unstale":"2024-01-20T08:10:10.187591+0000","last_undegraded":"2024-01-20T08:10:10.187591+0000","last_fullsized":"2024-01-20T08:10:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756143+0000","last_change":"2024-01-20T08:10:08.781928+0000","last_active":"2024-01-20T08:10:09.756143+0000","last_peered":"2024-01-20T08:10:09.756143+0000","last_clean":"2024-01-20T08:10:09.756143+0000","last_became_active":"2024-01-20T08:10:08.781472+0000","last_became_peered":"2024-01-20T08:10:08.781472+0000","last_unstale":"2024-01-20T08:10:09.756143+0000","last_undegraded":"2024-01-20T08:10:09.756143+0000","last_fullsized":"2024-01-20T08:10:09.756143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:26.656512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190465+0000","last_change":"2024-01-20T08:10:07.782772+0000","last_active":"2024-01-20T08:10:10.190465+0000","last_peered":"2024-01-20T08:10:10.190465+0000","last_clean":"2024-01-20T08:10:10.190465+0000","last_became_active":"2024-01-20T08:10:07.780824+0000","last_became_peered":"2024-01-20T08:10:07.780824+0000","last_unstale":"2024-01-20T08:10:10.190465+0000","last_undegraded":"2024-01-20T08:10:10.190465+0000","last_fullsized":"2024-01-20T08:10:10.190465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190013+0000","last_change":"2024-01-20T08:10:08.786404+0000","last_active":"2024-01-20T08:10:10.190013+0000","last_peered":"2024-01-20T08:10:10.190013+0000","last_clean":"2024-01-20T08:10:10.190013+0000","last_became_active":"2024-01-20T08:10:08.786120+0000","last_became_peered":"2024-01-20T08:10:08.786120+0000","last_unstale":"2024-01-20T08:10:10.190013+0000","last_undegraded":"2024-01-20T08:10:10.190013+0000","last_fullsized":"2024-01-20T08:10:10.190013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187474+0000","last_change":"2024-01-20T08:10:07.763023+0000","last_active":"2024-01-20T08:10:10.187474+0000","last_peered":"2024-01-20T08:10:10.187474+0000","last_clean":"2024-01-20T08:10:10.187474+0000","last_became_active":"2024-01-20T08:10:07.762445+0000","last_became_peered":"2024-01-20T08:10:07.762445+0000","last_unstale":"2024-01-20T08:10:10.187474+0000","last_undegraded":"2024-01-20T08:10:10.187474+0000","last_fullsized":"2024-01-20T08:10:10.187474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186810+0000","last_change":"2024-01-20T08:10:08.788158+0000","last_active":"2024-01-20T08:10:10.186810+0000","last_peered":"2024-01-20T08:10:10.186810+0000","last_clean":"2024-01-20T08:10:10.186810+0000","last_became_active":"2024-01-20T08:10:08.787042+0000","last_became_peered":"2024-01-20T08:10:08.787042+0000","last_unstale":"2024-01-20T08:10:10.186810+0000","last_undegraded":"2024-01-20T08:10:10.186810+0000","last_fullsized":"2024-01-20T08:10:10.186810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188550+0000","last_change":"2024-01-20T08:10:07.780955+0000","last_active":"2024-01-20T08:10:10.188550+0000","last_peered":"2024-01-20T08:10:10.188550+0000","last_clean":"2024-01-20T08:10:10.188550+0000","last_became_active":"2024-01-20T08:10:07.780635+0000","last_became_peered":"2024-01-20T08:10:07.780635+0000","last_unstale":"2024-01-20T08:10:10.188550+0000","last_undegraded":"2024-01-20T08:10:10.188550+0000","last_fullsized":"2024-01-20T08:10:10.188550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:54.165646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192151+0000","last_change":"2024-01-20T08:10:08.783000+0000","last_active":"2024-01-20T08:10:10.192151+0000","last_peered":"2024-01-20T08:10:10.192151+0000","last_clean":"2024-01-20T08:10:10.192151+0000","last_became_active":"2024-01-20T08:10:08.782683+0000","last_became_peered":"2024-01-20T08:10:08.782683+0000","last_unstale":"2024-01-20T08:10:10.192151+0000","last_undegraded":"2024-01-20T08:10:10.192151+0000","last_fullsized":"2024-01-20T08:10:10.192151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189278+0000","last_change":"2024-01-20T08:10:07.775311+0000","last_active":"2024-01-20T08:10:10.189278+0000","last_peered":"2024-01-20T08:10:10.189278+0000","last_clean":"2024-01-20T08:10:10.189278+0000","last_became_active":"2024-01-20T08:10:07.771006+0000","last_became_peered":"2024-01-20T08:10:07.771006+0000","last_unstale":"2024-01-20T08:10:10.189278+0000","last_undegraded":"2024-01-20T08:10:10.189278+0000","last_fullsized":"2024-01-20T08:10:10.189278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189142+0000","last_change":"2024-01-20T08:10:08.779813+0000","last_active":"2024-01-20T08:10:10.189142+0000","last_peered":"2024-01-20T08:10:10.189142+0000","last_clean":"2024-01-20T08:10:10.189142+0000","last_became_active":"2024-01-20T08:10:08.778962+0000","last_became_peered":"2024-01-20T08:10:08.778962+0000","last_unstale":"2024-01-20T08:10:10.189142+0000","last_undegraded":"2024-01-20T08:10:10.189142+0000","last_fullsized":"2024-01-20T08:10:10.189142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757296+0000","last_change":"2024-01-20T08:10:07.773757+0000","last_active":"2024-01-20T08:10:09.757296+0000","last_peered":"2024-01-20T08:10:09.757296+0000","last_clean":"2024-01-20T08:10:09.757296+0000","last_became_active":"2024-01-20T08:10:07.773422+0000","last_became_peered":"2024-01-20T08:10:07.773422+0000","last_unstale":"2024-01-20T08:10:09.757296+0000","last_undegraded":"2024-01-20T08:10:09.757296+0000","last_fullsized":"2024-01-20T08:10:09.757296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192502+0000","last_change":"2024-01-20T08:10:08.787377+0000","last_active":"2024-01-20T08:10:10.192502+0000","last_peered":"2024-01-20T08:10:10.192502+0000","last_clean":"2024-01-20T08:10:10.192502+0000","last_became_active":"2024-01-20T08:10:08.787064+0000","last_became_peered":"2024-01-20T08:10:08.787064+0000","last_unstale":"2024-01-20T08:10:10.192502+0000","last_undegraded":"2024-01-20T08:10:10.192502+0000","last_fullsized":"2024-01-20T08:10:10.192502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756111+0000","last_change":"2024-01-20T08:10:07.759594+0000","last_active":"2024-01-20T08:10:09.756111+0000","last_peered":"2024-01-20T08:10:09.756111+0000","last_clean":"2024-01-20T08:10:09.756111+0000","last_became_active":"2024-01-20T08:10:07.759092+0000","last_became_peered":"2024-01-20T08:10:07.759092+0000","last_unstale":"2024-01-20T08:10:09.756111+0000","last_undegraded":"2024-01-20T08:10:09.756111+0000","last_fullsized":"2024-01-20T08:10:09.756111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192462+0000","last_change":"2024-01-20T08:10:08.787171+0000","last_active":"2024-01-20T08:10:10.192462+0000","last_peered":"2024-01-20T08:10:10.192462+0000","last_clean":"2024-01-20T08:10:10.192462+0000","last_became_active":"2024-01-20T08:10:08.786910+0000","last_became_peered":"2024-01-20T08:10:08.786910+0000","last_unstale":"2024-01-20T08:10:10.192462+0000","last_undegraded":"2024-01-20T08:10:10.192462+0000","last_fullsized":"2024-01-20T08:10:10.192462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758344+0000","last_change":"2024-01-20T08:10:07.768872+0000","last_active":"2024-01-20T08:10:09.758344+0000","last_peered":"2024-01-20T08:10:09.758344+0000","last_clean":"2024-01-20T08:10:09.758344+0000","last_became_active":"2024-01-20T08:10:07.768410+0000","last_became_peered":"2024-01-20T08:10:07.768410+0000","last_unstale":"2024-01-20T08:10:09.758344+0000","last_undegraded":"2024-01-20T08:10:09.758344+0000","last_fullsized":"2024-01-20T08:10:09.758344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:31:17.868223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193451+0000","last_change":"2024-01-20T08:10:08.788993+0000","last_active":"2024-01-20T08:10:10.193451+0000","last_peered":"2024-01-20T08:10:10.193451+0000","last_clean":"2024-01-20T08:10:10.193451+0000","last_became_active":"2024-01-20T08:10:08.788676+0000","last_became_peered":"2024-01-20T08:10:08.788676+0000","last_unstale":"2024-01-20T08:10:10.193451+0000","last_undegraded":"2024-01-20T08:10:10.193451+0000","last_fullsized":"2024-01-20T08:10:10.193451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188374+0000","last_change":"2024-01-20T08:10:07.770092+0000","last_active":"2024-01-20T08:10:10.188374+0000","last_peered":"2024-01-20T08:10:10.188374+0000","last_clean":"2024-01-20T08:10:10.188374+0000","last_became_active":"2024-01-20T08:10:07.769349+0000","last_became_peered":"2024-01-20T08:10:07.769349+0000","last_unstale":"2024-01-20T08:10:10.188374+0000","last_undegraded":"2024-01-20T08:10:10.188374+0000","last_fullsized":"2024-01-20T08:10:10.188374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188541+0000","last_change":"2024-01-20T08:10:08.780078+0000","last_active":"2024-01-20T08:10:10.188541+0000","last_peered":"2024-01-20T08:10:10.188541+0000","last_clean":"2024-01-20T08:10:10.188541+0000","last_became_active":"2024-01-20T08:10:08.778811+0000","last_became_peered":"2024-01-20T08:10:08.778811+0000","last_unstale":"2024-01-20T08:10:10.188541+0000","last_undegraded":"2024-01-20T08:10:10.188541+0000","last_fullsized":"2024-01-20T08:10:10.188541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757909+0000","last_change":"2024-01-20T08:10:07.782606+0000","last_active":"2024-01-20T08:10:09.757909+0000","last_peered":"2024-01-20T08:10:09.757909+0000","last_clean":"2024-01-20T08:10:09.757909+0000","last_became_active":"2024-01-20T08:10:07.782208+0000","last_became_peered":"2024-01-20T08:10:07.782208+0000","last_unstale":"2024-01-20T08:10:09.757909+0000","last_undegraded":"2024-01-20T08:10:09.757909+0000","last_fullsized":"2024-01-20T08:10:09.757909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190352+0000","last_change":"2024-01-20T08:10:08.793744+0000","last_active":"2024-01-20T08:10:10.190352+0000","last_peered":"2024-01-20T08:10:10.190352+0000","last_clean":"2024-01-20T08:10:10.190352+0000","last_became_active":"2024-01-20T08:10:08.793434+0000","last_became_peered":"2024-01-20T08:10:08.793434+0000","last_unstale":"2024-01-20T08:10:10.190352+0000","last_undegraded":"2024-01-20T08:10:10.190352+0000","last_fullsized":"2024-01-20T08:10:10.190352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T08:10:08.753995+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:10:08.753995+0000","last_peered":"2024-01-20T08:10:08.753995+0000","last_clean":"2024-01-20T08:10:08.753995+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:10:08.753995+0000","last_undegraded":"2024-01-20T08:10:08.753995+0000","last_fullsized":"2024-01-20T08:10:08.753995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187608+0000","last_change":"2024-01-20T08:10:07.781232+0000","last_active":"2024-01-20T08:10:10.187608+0000","last_peered":"2024-01-20T08:10:10.187608+0000","last_clean":"2024-01-20T08:10:10.187608+0000","last_became_active":"2024-01-20T08:10:07.780629+0000","last_became_peered":"2024-01-20T08:10:07.780629+0000","last_unstale":"2024-01-20T08:10:10.187608+0000","last_undegraded":"2024-01-20T08:10:10.187608+0000","last_fullsized":"2024-01-20T08:10:10.187608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755289+0000","last_change":"2024-01-20T08:10:08.780899+0000","last_active":"2024-01-20T08:10:09.755289+0000","last_peered":"2024-01-20T08:10:09.755289+0000","last_clean":"2024-01-20T08:10:09.755289+0000","last_became_active":"2024-01-20T08:10:08.780569+0000","last_became_peered":"2024-01-20T08:10:08.780569+0000","last_unstale":"2024-01-20T08:10:09.755289+0000","last_undegraded":"2024-01-20T08:10:09.755289+0000","last_fullsized":"2024-01-20T08:10:09.755289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188706+0000","last_change":"2024-01-20T08:10:07.772607+0000","last_active":"2024-01-20T08:10:10.188706+0000","last_peered":"2024-01-20T08:10:10.188706+0000","last_clean":"2024-01-20T08:10:10.188706+0000","last_became_active":"2024-01-20T08:10:07.772327+0000","last_became_peered":"2024-01-20T08:10:07.772327+0000","last_unstale":"2024-01-20T08:10:10.188706+0000","last_undegraded":"2024-01-20T08:10:10.188706+0000","last_fullsized":"2024-01-20T08:10:10.188706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186426+0000","last_change":"2024-01-20T08:10:08.789696+0000","last_active":"2024-01-20T08:10:10.186426+0000","last_peered":"2024-01-20T08:10:10.186426+0000","last_clean":"2024-01-20T08:10:10.186426+0000","last_became_active":"2024-01-20T08:10:08.789380+0000","last_became_peered":"2024-01-20T08:10:08.789380+0000","last_unstale":"2024-01-20T08:10:10.186426+0000","last_undegraded":"2024-01-20T08:10:10.186426+0000","last_fullsized":"2024-01-20T08:10:10.186426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757606+0000","last_change":"2024-01-20T08:10:07.770872+0000","last_active":"2024-01-20T08:10:09.757606+0000","last_peered":"2024-01-20T08:10:09.757606+0000","last_clean":"2024-01-20T08:10:09.757606+0000","last_became_active":"2024-01-20T08:10:07.770607+0000","last_became_peered":"2024-01-20T08:10:07.770607+0000","last_unstale":"2024-01-20T08:10:09.757606+0000","last_undegraded":"2024-01-20T08:10:09.757606+0000","last_fullsized":"2024-01-20T08:10:09.757606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.774148+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.773809+0000","last_became_peered":"2024-01-20T08:10:08.773809+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188851+0000","last_change":"2024-01-20T08:10:07.772528+0000","last_active":"2024-01-20T08:10:10.188851+0000","last_peered":"2024-01-20T08:10:10.188851+0000","last_clean":"2024-01-20T08:10:10.188851+0000","last_became_active":"2024-01-20T08:10:07.769568+0000","last_became_peered":"2024-01-20T08:10:07.769568+0000","last_unstale":"2024-01-20T08:10:10.188851+0000","last_undegraded":"2024-01-20T08:10:10.188851+0000","last_fullsized":"2024-01-20T08:10:10.188851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755908+0000","last_change":"2024-01-20T08:10:08.781307+0000","last_active":"2024-01-20T08:10:09.755908+0000","last_peered":"2024-01-20T08:10:09.755908+0000","last_clean":"2024-01-20T08:10:09.755908+0000","last_became_active":"2024-01-20T08:10:08.779605+0000","last_became_peered":"2024-01-20T08:10:08.779605+0000","last_unstale":"2024-01-20T08:10:09.755908+0000","last_undegraded":"2024-01-20T08:10:09.755908+0000","last_fullsized":"2024-01-20T08:10:09.755908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:02.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188853+0000","last_change":"2024-01-20T08:10:07.771605+0000","last_active":"2024-01-20T08:10:10.188853+0000","last_peered":"2024-01-20T08:10:10.188853+0000","last_clean":"2024-01-20T08:10:10.188853+0000","last_became_active":"2024-01-20T08:10:07.771371+0000","last_became_peered":"2024-01-20T08:10:07.771371+0000","last_unstale":"2024-01-20T08:10:10.188853+0000","last_undegraded":"2024-01-20T08:10:10.188853+0000","last_fullsized":"2024-01-20T08:10:10.188853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190748+0000","last_change":"2024-01-20T08:10:08.784437+0000","last_active":"2024-01-20T08:10:10.190748+0000","last_peered":"2024-01-20T08:10:10.190748+0000","last_clean":"2024-01-20T08:10:10.190748+0000","last_became_active":"2024-01-20T08:10:08.784168+0000","last_became_peered":"2024-01-20T08:10:08.784168+0000","last_unstale":"2024-01-20T08:10:10.190748+0000","last_undegraded":"2024-01-20T08:10:10.190748+0000","last_fullsized":"2024-01-20T08:10:10.190748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191198+0000","last_change":"2024-01-20T08:10:07.774618+0000","last_active":"2024-01-20T08:10:10.191198+0000","last_peered":"2024-01-20T08:10:10.191198+0000","last_clean":"2024-01-20T08:10:10.191198+0000","last_became_active":"2024-01-20T08:10:07.774350+0000","last_became_peered":"2024-01-20T08:10:07.774350+0000","last_unstale":"2024-01-20T08:10:10.191198+0000","last_undegraded":"2024-01-20T08:10:10.191198+0000","last_fullsized":"2024-01-20T08:10:10.191198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188744+0000","last_change":"2024-01-20T08:10:08.774147+0000","last_active":"2024-01-20T08:10:10.188744+0000","last_peered":"2024-01-20T08:10:10.188744+0000","last_clean":"2024-01-20T08:10:10.188744+0000","last_became_active":"2024-01-20T08:10:08.773823+0000","last_became_peered":"2024-01-20T08:10:08.773823+0000","last_unstale":"2024-01-20T08:10:10.188744+0000","last_undegraded":"2024-01-20T08:10:10.188744+0000","last_fullsized":"2024-01-20T08:10:10.188744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.967916+0000","last_change":"2024-01-20T08:10:07.774279+0000","last_active":"2024-01-20T08:10:10.967916+0000","last_peered":"2024-01-20T08:10:10.967916+0000","last_clean":"2024-01-20T08:10:10.967916+0000","last_became_active":"2024-01-20T08:10:07.774002+0000","last_became_peered":"2024-01-20T08:10:07.774002+0000","last_unstale":"2024-01-20T08:10:10.967916+0000","last_undegraded":"2024-01-20T08:10:10.967916+0000","last_fullsized":"2024-01-20T08:10:10.967916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755901+0000","last_change":"2024-01-20T08:10:08.775836+0000","last_active":"2024-01-20T08:10:09.755901+0000","last_peered":"2024-01-20T08:10:09.755901+0000","last_clean":"2024-01-20T08:10:09.755901+0000","last_became_active":"2024-01-20T08:10:08.770776+0000","last_became_peered":"2024-01-20T08:10:08.770776+0000","last_unstale":"2024-01-20T08:10:09.755901+0000","last_undegraded":"2024-01-20T08:10:09.755901+0000","last_fullsized":"2024-01-20T08:10:09.755901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192752+0000","last_change":"2024-01-20T08:10:07.777758+0000","last_active":"2024-01-20T08:10:10.192752+0000","last_peered":"2024-01-20T08:10:10.192752+0000","last_clean":"2024-01-20T08:10:10.192752+0000","last_became_active":"2024-01-20T08:10:07.773502+0000","last_became_peered":"2024-01-20T08:10:07.773502+0000","last_unstale":"2024-01-20T08:10:10.192752+0000","last_undegraded":"2024-01-20T08:10:10.192752+0000","last_fullsized":"2024-01-20T08:10:10.192752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186956+0000","last_change":"2024-01-20T08:10:08.782036+0000","last_active":"2024-01-20T08:10:10.186956+0000","last_peered":"2024-01-20T08:10:10.186956+0000","last_clean":"2024-01-20T08:10:10.186956+0000","last_became_active":"2024-01-20T08:10:08.781743+0000","last_became_peered":"2024-01-20T08:10:08.781743+0000","last_unstale":"2024-01-20T08:10:10.186956+0000","last_undegraded":"2024-01-20T08:10:10.186956+0000","last_fullsized":"2024-01-20T08:10:10.186956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188450+0000","last_change":"2024-01-20T08:10:07.775094+0000","last_active":"2024-01-20T08:10:10.188450+0000","last_peered":"2024-01-20T08:10:10.188450+0000","last_clean":"2024-01-20T08:10:10.188450+0000","last_became_active":"2024-01-20T08:10:07.774836+0000","last_became_peered":"2024-01-20T08:10:07.774836+0000","last_unstale":"2024-01-20T08:10:10.188450+0000","last_undegraded":"2024-01-20T08:10:10.188450+0000","last_fullsized":"2024-01-20T08:10:10.188450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755687+0000","last_change":"2024-01-20T08:10:08.785065+0000","last_active":"2024-01-20T08:10:09.755687+0000","last_peered":"2024-01-20T08:10:09.755687+0000","last_clean":"2024-01-20T08:10:09.755687+0000","last_became_active":"2024-01-20T08:10:08.782610+0000","last_became_peered":"2024-01-20T08:10:08.782610+0000","last_unstale":"2024-01-20T08:10:09.755687+0000","last_undegraded":"2024-01-20T08:10:09.755687+0000","last_fullsized":"2024-01-20T08:10:09.755687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188086+0000","last_change":"2024-01-20T08:10:07.770741+0000","last_active":"2024-01-20T08:10:10.188086+0000","last_peered":"2024-01-20T08:10:10.188086+0000","last_clean":"2024-01-20T08:10:10.188086+0000","last_became_active":"2024-01-20T08:10:07.770315+0000","last_became_peered":"2024-01-20T08:10:07.770315+0000","last_unstale":"2024-01-20T08:10:10.188086+0000","last_undegraded":"2024-01-20T08:10:10.188086+0000","last_fullsized":"2024-01-20T08:10:10.188086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754531+0000","last_change":"2024-01-20T08:10:08.775245+0000","last_active":"2024-01-20T08:10:09.754531+0000","last_peered":"2024-01-20T08:10:09.754531+0000","last_clean":"2024-01-20T08:10:09.754531+0000","last_became_active":"2024-01-20T08:10:08.774956+0000","last_became_peered":"2024-01-20T08:10:08.774956+0000","last_unstale":"2024-01-20T08:10:09.754531+0000","last_undegraded":"2024-01-20T08:10:09.754531+0000","last_fullsized":"2024-01-20T08:10:09.754531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188622+0000","last_change":"2024-01-20T08:10:07.772612+0000","last_active":"2024-01-20T08:10:10.188622+0000","last_peered":"2024-01-20T08:10:10.188622+0000","last_clean":"2024-01-20T08:10:10.188622+0000","last_became_active":"2024-01-20T08:10:07.772238+0000","last_became_peered":"2024-01-20T08:10:07.772238+0000","last_unstale":"2024-01-20T08:10:10.188622+0000","last_undegraded":"2024-01-20T08:10:10.188622+0000","last_fullsized":"2024-01-20T08:10:10.188622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755280+0000","last_change":"2024-01-20T08:10:08.780781+0000","last_active":"2024-01-20T08:10:09.755280+0000","last_peered":"2024-01-20T08:10:09.755280+0000","last_clean":"2024-01-20T08:10:09.755280+0000","last_became_active":"2024-01-20T08:10:08.780502+0000","last_became_peered":"2024-01-20T08:10:08.780502+0000","last_unstale":"2024-01-20T08:10:09.755280+0000","last_undegraded":"2024-01-20T08:10:09.755280+0000","last_fullsized":"2024-01-20T08:10:09.755280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192526+0000","last_change":"2024-01-20T08:10:07.769908+0000","last_active":"2024-01-20T08:10:10.192526+0000","last_peered":"2024-01-20T08:10:10.192526+0000","last_clean":"2024-01-20T08:10:10.192526+0000","last_became_active":"2024-01-20T08:10:07.769315+0000","last_became_peered":"2024-01-20T08:10:07.769315+0000","last_unstale":"2024-01-20T08:10:10.192526+0000","last_undegraded":"2024-01-20T08:10:10.192526+0000","last_fullsized":"2024-01-20T08:10:10.192526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189995+0000","last_change":"2024-01-20T08:10:08.789928+0000","last_active":"2024-01-20T08:10:10.189995+0000","last_peered":"2024-01-20T08:10:10.189995+0000","last_clean":"2024-01-20T08:10:10.189995+0000","last_became_active":"2024-01-20T08:10:08.789486+0000","last_became_peered":"2024-01-20T08:10:08.789486+0000","last_unstale":"2024-01-20T08:10:10.189995+0000","last_undegraded":"2024-01-20T08:10:10.189995+0000","last_fullsized":"2024-01-20T08:10:10.189995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190318+0000","last_change":"2024-01-20T08:10:08.788327+0000","last_active":"2024-01-20T08:10:10.190318+0000","last_peered":"2024-01-20T08:10:10.190318+0000","last_clean":"2024-01-20T08:10:10.190318+0000","last_became_active":"2024-01-20T08:10:08.788050+0000","last_became_peered":"2024-01-20T08:10:08.788050+0000","last_unstale":"2024-01-20T08:10:10.190318+0000","last_undegraded":"2024-01-20T08:10:10.190318+0000","last_fullsized":"2024-01-20T08:10:10.190318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192978+0000","last_change":"2024-01-20T08:10:07.783387+0000","last_active":"2024-01-20T08:10:10.192978+0000","last_peered":"2024-01-20T08:10:10.192978+0000","last_clean":"2024-01-20T08:10:10.192978+0000","last_became_active":"2024-01-20T08:10:07.783090+0000","last_became_peered":"2024-01-20T08:10:07.783090+0000","last_unstale":"2024-01-20T08:10:10.192978+0000","last_undegraded":"2024-01-20T08:10:10.192978+0000","last_fullsized":"2024-01-20T08:10:10.192978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188183+0000","last_change":"2024-01-20T08:10:08.788111+0000","last_active":"2024-01-20T08:10:10.188183+0000","last_peered":"2024-01-20T08:10:10.188183+0000","last_clean":"2024-01-20T08:10:10.188183+0000","last_became_active":"2024-01-20T08:10:08.787785+0000","last_became_peered":"2024-01-20T08:10:08.787785+0000","last_unstale":"2024-01-20T08:10:10.188183+0000","last_undegraded":"2024-01-20T08:10:10.188183+0000","last_fullsized":"2024-01-20T08:10:10.188183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190593+0000","last_change":"2024-01-20T08:10:07.773272+0000","last_active":"2024-01-20T08:10:10.190593+0000","last_peered":"2024-01-20T08:10:10.190593+0000","last_clean":"2024-01-20T08:10:10.190593+0000","last_became_active":"2024-01-20T08:10:07.772994+0000","last_became_peered":"2024-01-20T08:10:07.772994+0000","last_unstale":"2024-01-20T08:10:10.190593+0000","last_undegraded":"2024-01-20T08:10:10.190593+0000","last_fullsized":"2024-01-20T08:10:10.190593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187781+0000","last_change":"2024-01-20T08:10:08.792517+0000","last_active":"2024-01-20T08:10:10.187781+0000","last_peered":"2024-01-20T08:10:10.187781+0000","last_clean":"2024-01-20T08:10:10.187781+0000","last_became_active":"2024-01-20T08:10:08.792227+0000","last_became_peered":"2024-01-20T08:10:08.792227+0000","last_unstale":"2024-01-20T08:10:10.187781+0000","last_undegraded":"2024-01-20T08:10:10.187781+0000","last_fullsized":"2024-01-20T08:10:10.187781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755753+0000","last_change":"2024-01-20T08:10:07.753907+0000","last_active":"2024-01-20T08:10:09.755753+0000","last_peered":"2024-01-20T08:10:09.755753+0000","last_clean":"2024-01-20T08:10:09.755753+0000","last_became_active":"2024-01-20T08:10:07.753601+0000","last_became_peered":"2024-01-20T08:10:07.753601+0000","last_unstale":"2024-01-20T08:10:09.755753+0000","last_undegraded":"2024-01-20T08:10:09.755753+0000","last_fullsized":"2024-01-20T08:10:09.755753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:08:42.443428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755706+0000","last_change":"2024-01-20T08:10:08.789390+0000","last_active":"2024-01-20T08:10:09.755706+0000","last_peered":"2024-01-20T08:10:09.755706+0000","last_clean":"2024-01-20T08:10:09.755706+0000","last_became_active":"2024-01-20T08:10:08.789026+0000","last_became_peered":"2024-01-20T08:10:08.789026+0000","last_unstale":"2024-01-20T08:10:09.755706+0000","last_undegraded":"2024-01-20T08:10:09.755706+0000","last_fullsized":"2024-01-20T08:10:09.755706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187992+0000","last_change":"2024-01-20T08:10:07.768390+0000","last_active":"2024-01-20T08:10:10.187992+0000","last_peered":"2024-01-20T08:10:10.187992+0000","last_clean":"2024-01-20T08:10:10.187992+0000","last_became_active":"2024-01-20T08:10:07.768097+0000","last_became_peered":"2024-01-20T08:10:07.768097+0000","last_unstale":"2024-01-20T08:10:10.187992+0000","last_undegraded":"2024-01-20T08:10:10.187992+0000","last_fullsized":"2024-01-20T08:10:10.187992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":827392,"data_stored":671588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":80728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":80764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":80638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":835584,"data_stored":671644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:10:17.022 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:10:17.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.259+0000 7f1c94e00640 1 Processor -- start 2024-01-20T08:10:17.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.259+0000 7f1c94e00640 1 -- start start 2024-01-20T08:10:17.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c94e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c90147f20 0x7f1c900abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c94e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90151f60 0x7f1c90070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c94e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c900c1670 con 0x7f1c900c1b00 2024-01-20T08:10:17.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c94e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c901524b0 con 0x7f1c90147f20 2024-01-20T08:10:17.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c94e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c900c0d40 con 0x7f1c90151f60 2024-01-20T08:10:17.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.260+0000 7f1c8de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c90147f20 0x7f1c900abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1c90147f20 0x7f1c900abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58026/0 (socket says 172.21.15.100:58026) 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 -- 172.21.15.100:0/3611934334 learned_addr learned my addr 172.21.15.100:0/3611934334 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c85200640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90151f60 0x7f1c90070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 -- 172.21.15.100:0/3611934334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90151f60 msgr2=0x7f1c90070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90151f60 0x7f1c90070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 -- 172.21.15.100:0/3611934334 >> v1:172.21.15.110:6789/0 conn(0x7f1c900c1b00 legacy=0x7f1c900c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.261+0000 7f1c8de00640 1 -- 172.21.15.100:0/3611934334 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c900c1020 con 0x7f1c90147f20 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.262+0000 7f1c8de00640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c90147f20 0x7f1c900abfd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f321634a5d7ebf9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.262+0000 7f1c8d400640 1 -- 172.21.15.100:0/3611934334 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80031640 con 0x7f1c90147f20 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.262+0000 7f1c8d400640 1 -- 172.21.15.100:0/3611934334 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c800317a0 con 0x7f1c90147f20 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.262+0000 7f1c8d400640 1 -- 172.21.15.100:0/3611934334 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80031b30 con 0x7f1c90147f20 2024-01-20T08:10:17.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 -- 172.21.15.100:0/3611934334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c90147f20 msgr2=0x7f1c900abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c90147f20 0x7f1c900abfd0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c8002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 -- 172.21.15.100:0/3611934334 shutdown_connections 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90151f60 0x7f1c90070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3611934334 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c90147f20 0x7f1c900abfd0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 -- 172.21.15.100:0/3611934334 >> 172.21.15.100:0/3611934334 conn(0x7f1c9006a5e0 msgr2=0x7f1c9006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:17.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 -- 172.21.15.100:0/3611934334 shutdown_connections 2024-01-20T08:10:17.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.263+0000 7f1c94e00640 1 -- 172.21.15.100:0/3611934334 wait complete. 2024-01-20T08:10:17.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.265+0000 7f1c94e00640 1 Processor -- start 2024-01-20T08:10:17.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.265+0000 7f1c94e00640 1 -- start start 2024-01-20T08:10:17.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90147f20 0x7f1c901ed750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c90151f60 0x7f1c90143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901ea5a0 con 0x7f1c900c1b00 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c90150ee0 con 0x7f1c90151f60 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c94e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c901edc90 con 0x7f1c90147f20 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58032/0 (socket says 172.21.15.100:58032) 2024-01-20T08:10:17.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 -- 172.21.15.100:0/3527757068 learned_addr learned my addr 172.21.15.100:0/3527757068 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 -- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90147f20 msgr2=0x7f1c901ed750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90147f20 0x7f1c901ed750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 -- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c90151f60 msgr2=0x7f1c90143000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c90151f60 0x7f1c90143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.266+0000 7f1c8de00640 1 -- 172.21.15.100:0/3527757068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800094d0 con 0x7f1c900c1b00 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c8de00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8003ac60 con 0x7f1c900c1b00 2024-01-20T08:10:17.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8003ade0 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80044630 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c901ea1e0 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.267+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c901ee210 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.268+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c901ea6e0 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.269+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1c8002f050 con 0x7f1c900c1b00 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.270+0000 7f1c86a00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 0x7f1c6806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.270+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c800ab7c0 con 0x7f1c900c1b00 2024-01-20T08:10:17.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.270+0000 7f1c85200640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 0x7f1c6806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.271+0000 7f1c85200640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 0x7f1c6806d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c901471b0 tx=0x7f1c78008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.275+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1c901ea6e0 con 0x7f1c900c1b00 2024-01-20T08:10:17.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.447+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c90148300 con 0x7f1c6806af00 2024-01-20T08:10:17.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.467+0000 7f1c86a00640 1 -- 172.21.15.100:0/3527757068 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264407 (secure 0 0 0) 0x7f1c7800a420 con 0x7f1c6806af00 2024-01-20T08:10:17.473 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:17.475 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.471+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 msgr2=0x7f1c6806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.471+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 0x7f1c6806d3c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c901471b0 tx=0x7f1c78008040 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.471+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 msgr2=0x7f1c9014f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.471+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c80009870 tx=0x7f1c800046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.471+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 shutdown_connections 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1c90151f60 0x7f1c90143000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1c6806af00 0x7f1c6806d3c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1c90147f20 0x7f1c901ed750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 --2- 172.21.15.100:0/3527757068 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1c900c1b00 0x7f1c9014f350 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 >> 172.21.15.100:0/3527757068 conn(0x7f1c9006a5e0 msgr2=0x7f1c900bfd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:17.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 shutdown_connections 2024-01-20T08:10:17.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.472+0000 7f1c94e00640 1 -- 172.21.15.100:0/3527757068 wait complete. 2024-01-20T08:10:17.493 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-01-20T08:10:15.887907+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236244,"kb_used_data":3016,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738476,"statfs":{"total":773094113280,"available":772852199424,"internally_reserved":0,"allocated":3088384,"data_stored":1830660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":20,"num_read_kb":18,"num_write":81,"num_write_kb":798,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002357"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193298+0000","last_change":"2024-01-20T08:10:08.794516+0000","last_active":"2024-01-20T08:10:10.193298+0000","last_peered":"2024-01-20T08:10:10.193298+0000","last_clean":"2024-01-20T08:10:10.193298+0000","last_became_active":"2024-01-20T08:10:08.794118+0000","last_became_peered":"2024-01-20T08:10:08.794118+0000","last_unstale":"2024-01-20T08:10:10.193298+0000","last_undegraded":"2024-01-20T08:10:10.193298+0000","last_fullsized":"2024-01-20T08:10:10.193298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188560+0000","last_change":"2024-01-20T08:10:08.778488+0000","last_active":"2024-01-20T08:10:10.188560+0000","last_peered":"2024-01-20T08:10:10.188560+0000","last_clean":"2024-01-20T08:10:10.188560+0000","last_became_active":"2024-01-20T08:10:08.778115+0000","last_became_peered":"2024-01-20T08:10:08.778115+0000","last_unstale":"2024-01-20T08:10:10.188560+0000","last_undegraded":"2024-01-20T08:10:10.188560+0000","last_fullsized":"2024-01-20T08:10:10.188560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.783518+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.780866+0000","last_became_peered":"2024-01-20T08:10:08.780866+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188914+0000","last_change":"2024-01-20T08:10:08.783382+0000","last_active":"2024-01-20T08:10:10.188914+0000","last_peered":"2024-01-20T08:10:10.188914+0000","last_clean":"2024-01-20T08:10:10.188914+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.188914+0000","last_undegraded":"2024-01-20T08:10:10.188914+0000","last_fullsized":"2024-01-20T08:10:10.188914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191839+0000","last_change":"2024-01-20T08:10:08.776063+0000","last_active":"2024-01-20T08:10:10.191839+0000","last_peered":"2024-01-20T08:10:10.191839+0000","last_clean":"2024-01-20T08:10:10.191839+0000","last_became_active":"2024-01-20T08:10:08.775617+0000","last_became_peered":"2024-01-20T08:10:08.775617+0000","last_unstale":"2024-01-20T08:10:10.191839+0000","last_undegraded":"2024-01-20T08:10:10.191839+0000","last_fullsized":"2024-01-20T08:10:10.191839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187876+0000","last_change":"2024-01-20T08:10:08.782346+0000","last_active":"2024-01-20T08:10:10.187876+0000","last_peered":"2024-01-20T08:10:10.187876+0000","last_clean":"2024-01-20T08:10:10.187876+0000","last_became_active":"2024-01-20T08:10:08.782015+0000","last_became_peered":"2024-01-20T08:10:08.782015+0000","last_unstale":"2024-01-20T08:10:10.187876+0000","last_undegraded":"2024-01-20T08:10:10.187876+0000","last_fullsized":"2024-01-20T08:10:10.187876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192165+0000","last_change":"2024-01-20T08:10:08.780591+0000","last_active":"2024-01-20T08:10:10.192165+0000","last_peered":"2024-01-20T08:10:10.192165+0000","last_clean":"2024-01-20T08:10:10.192165+0000","last_became_active":"2024-01-20T08:10:08.780333+0000","last_became_peered":"2024-01-20T08:10:08.780333+0000","last_unstale":"2024-01-20T08:10:10.192165+0000","last_undegraded":"2024-01-20T08:10:10.192165+0000","last_fullsized":"2024-01-20T08:10:10.192165+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754474+0000","last_change":"2024-01-20T08:10:08.780476+0000","last_active":"2024-01-20T08:10:09.754474+0000","last_peered":"2024-01-20T08:10:09.754474+0000","last_clean":"2024-01-20T08:10:09.754474+0000","last_became_active":"2024-01-20T08:10:08.780055+0000","last_became_peered":"2024-01-20T08:10:08.780055+0000","last_unstale":"2024-01-20T08:10:09.754474+0000","last_undegraded":"2024-01-20T08:10:09.754474+0000","last_fullsized":"2024-01-20T08:10:09.754474+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193268+0000","last_change":"2024-01-20T08:10:08.780635+0000","last_active":"2024-01-20T08:10:10.193268+0000","last_peered":"2024-01-20T08:10:10.193268+0000","last_clean":"2024-01-20T08:10:10.193268+0000","last_became_active":"2024-01-20T08:10:08.780253+0000","last_became_peered":"2024-01-20T08:10:08.780253+0000","last_unstale":"2024-01-20T08:10:10.193268+0000","last_undegraded":"2024-01-20T08:10:10.193268+0000","last_fullsized":"2024-01-20T08:10:10.193268+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192006+0000","last_change":"2024-01-20T08:10:08.790551+0000","last_active":"2024-01-20T08:10:10.192006+0000","last_peered":"2024-01-20T08:10:10.192006+0000","last_clean":"2024-01-20T08:10:10.192006+0000","last_became_active":"2024-01-20T08:10:08.790180+0000","last_became_peered":"2024-01-20T08:10:08.790180+0000","last_unstale":"2024-01-20T08:10:10.192006+0000","last_undegraded":"2024-01-20T08:10:10.192006+0000","last_fullsized":"2024-01-20T08:10:10.192006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191485+0000","last_change":"2024-01-20T08:10:08.792788+0000","last_active":"2024-01-20T08:10:10.191485+0000","last_peered":"2024-01-20T08:10:10.191485+0000","last_clean":"2024-01-20T08:10:10.191485+0000","last_became_active":"2024-01-20T08:10:08.791594+0000","last_became_peered":"2024-01-20T08:10:08.791594+0000","last_unstale":"2024-01-20T08:10:10.191485+0000","last_undegraded":"2024-01-20T08:10:10.191485+0000","last_fullsized":"2024-01-20T08:10:10.191485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756031+0000","last_change":"2024-01-20T08:10:08.791553+0000","last_active":"2024-01-20T08:10:09.756031+0000","last_peered":"2024-01-20T08:10:09.756031+0000","last_clean":"2024-01-20T08:10:09.756031+0000","last_became_active":"2024-01-20T08:10:08.789326+0000","last_became_peered":"2024-01-20T08:10:08.789326+0000","last_unstale":"2024-01-20T08:10:09.756031+0000","last_undegraded":"2024-01-20T08:10:09.756031+0000","last_fullsized":"2024-01-20T08:10:09.756031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:59.728565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755024+0000","last_change":"2024-01-20T08:10:08.783923+0000","last_active":"2024-01-20T08:10:09.755024+0000","last_peered":"2024-01-20T08:10:09.755024+0000","last_clean":"2024-01-20T08:10:09.755024+0000","last_became_active":"2024-01-20T08:10:08.783605+0000","last_became_peered":"2024-01-20T08:10:08.783605+0000","last_unstale":"2024-01-20T08:10:09.755024+0000","last_undegraded":"2024-01-20T08:10:09.755024+0000","last_fullsized":"2024-01-20T08:10:09.755024+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186481+0000","last_change":"2024-01-20T08:10:08.786608+0000","last_active":"2024-01-20T08:10:10.186481+0000","last_peered":"2024-01-20T08:10:10.186481+0000","last_clean":"2024-01-20T08:10:10.186481+0000","last_became_active":"2024-01-20T08:10:08.783083+0000","last_became_peered":"2024-01-20T08:10:08.783083+0000","last_unstale":"2024-01-20T08:10:10.186481+0000","last_undegraded":"2024-01-20T08:10:10.186481+0000","last_fullsized":"2024-01-20T08:10:10.186481+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:29:39.402870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187982+0000","last_change":"2024-01-20T08:10:08.790598+0000","last_active":"2024-01-20T08:10:10.187982+0000","last_peered":"2024-01-20T08:10:10.187982+0000","last_clean":"2024-01-20T08:10:10.187982+0000","last_became_active":"2024-01-20T08:10:08.790298+0000","last_became_peered":"2024-01-20T08:10:08.790298+0000","last_unstale":"2024-01-20T08:10:10.187982+0000","last_undegraded":"2024-01-20T08:10:10.187982+0000","last_fullsized":"2024-01-20T08:10:10.187982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187500+0000","last_change":"2024-01-20T08:10:08.782029+0000","last_active":"2024-01-20T08:10:10.187500+0000","last_peered":"2024-01-20T08:10:10.187500+0000","last_clean":"2024-01-20T08:10:10.187500+0000","last_became_active":"2024-01-20T08:10:08.781132+0000","last_became_peered":"2024-01-20T08:10:08.781132+0000","last_unstale":"2024-01-20T08:10:10.187500+0000","last_undegraded":"2024-01-20T08:10:10.187500+0000","last_fullsized":"2024-01-20T08:10:10.187500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190735+0000","last_change":"2024-01-20T08:10:08.787165+0000","last_active":"2024-01-20T08:10:10.190735+0000","last_peered":"2024-01-20T08:10:10.190735+0000","last_clean":"2024-01-20T08:10:10.190735+0000","last_became_active":"2024-01-20T08:10:08.786862+0000","last_became_peered":"2024-01-20T08:10:08.786862+0000","last_unstale":"2024-01-20T08:10:10.190735+0000","last_undegraded":"2024-01-20T08:10:10.190735+0000","last_fullsized":"2024-01-20T08:10:10.190735+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:36:39.006155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758174+0000","last_change":"2024-01-20T08:10:08.795799+0000","last_active":"2024-01-20T08:10:09.758174+0000","last_peered":"2024-01-20T08:10:09.758174+0000","last_clean":"2024-01-20T08:10:09.758174+0000","last_became_active":"2024-01-20T08:10:08.795565+0000","last_became_peered":"2024-01-20T08:10:08.795565+0000","last_unstale":"2024-01-20T08:10:09.758174+0000","last_undegraded":"2024-01-20T08:10:09.758174+0000","last_fullsized":"2024-01-20T08:10:09.758174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190974+0000","last_change":"2024-01-20T08:10:08.772099+0000","last_active":"2024-01-20T08:10:10.190974+0000","last_peered":"2024-01-20T08:10:10.190974+0000","last_clean":"2024-01-20T08:10:10.190974+0000","last_became_active":"2024-01-20T08:10:08.771805+0000","last_became_peered":"2024-01-20T08:10:08.771805+0000","last_unstale":"2024-01-20T08:10:10.190974+0000","last_undegraded":"2024-01-20T08:10:10.190974+0000","last_fullsized":"2024-01-20T08:10:10.190974+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190191+0000","last_change":"2024-01-20T08:10:08.797402+0000","last_active":"2024-01-20T08:10:10.190191+0000","last_peered":"2024-01-20T08:10:10.190191+0000","last_clean":"2024-01-20T08:10:10.190191+0000","last_became_active":"2024-01-20T08:10:08.797026+0000","last_became_peered":"2024-01-20T08:10:08.797026+0000","last_unstale":"2024-01-20T08:10:10.190191+0000","last_undegraded":"2024-01-20T08:10:10.190191+0000","last_fullsized":"2024-01-20T08:10:10.190191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186861+0000","last_change":"2024-01-20T08:10:08.796525+0000","last_active":"2024-01-20T08:10:10.186861+0000","last_peered":"2024-01-20T08:10:10.186861+0000","last_clean":"2024-01-20T08:10:10.186861+0000","last_became_active":"2024-01-20T08:10:08.796194+0000","last_became_peered":"2024-01-20T08:10:08.796194+0000","last_unstale":"2024-01-20T08:10:10.186861+0000","last_undegraded":"2024-01-20T08:10:10.186861+0000","last_fullsized":"2024-01-20T08:10:10.186861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188827+0000","last_change":"2024-01-20T08:10:08.786863+0000","last_active":"2024-01-20T08:10:10.188827+0000","last_peered":"2024-01-20T08:10:10.188827+0000","last_clean":"2024-01-20T08:10:10.188827+0000","last_became_active":"2024-01-20T08:10:08.786412+0000","last_became_peered":"2024-01-20T08:10:08.786412+0000","last_unstale":"2024-01-20T08:10:10.188827+0000","last_undegraded":"2024-01-20T08:10:10.188827+0000","last_fullsized":"2024-01-20T08:10:10.188827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:03.264942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754903+0000","last_change":"2024-01-20T08:10:08.788906+0000","last_active":"2024-01-20T08:10:09.754903+0000","last_peered":"2024-01-20T08:10:09.754903+0000","last_clean":"2024-01-20T08:10:09.754903+0000","last_became_active":"2024-01-20T08:10:08.788531+0000","last_became_peered":"2024-01-20T08:10:08.788531+0000","last_unstale":"2024-01-20T08:10:09.754903+0000","last_undegraded":"2024-01-20T08:10:09.754903+0000","last_fullsized":"2024-01-20T08:10:09.754903+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188113+0000","last_change":"2024-01-20T08:10:08.782233+0000","last_active":"2024-01-20T08:10:10.188113+0000","last_peered":"2024-01-20T08:10:10.188113+0000","last_clean":"2024-01-20T08:10:10.188113+0000","last_became_active":"2024-01-20T08:10:08.781895+0000","last_became_peered":"2024-01-20T08:10:08.781895+0000","last_unstale":"2024-01-20T08:10:10.188113+0000","last_undegraded":"2024-01-20T08:10:10.188113+0000","last_fullsized":"2024-01-20T08:10:10.188113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755626+0000","last_change":"2024-01-20T08:10:08.789012+0000","last_active":"2024-01-20T08:10:09.755626+0000","last_peered":"2024-01-20T08:10:09.755626+0000","last_clean":"2024-01-20T08:10:09.755626+0000","last_became_active":"2024-01-20T08:10:08.788686+0000","last_became_peered":"2024-01-20T08:10:08.788686+0000","last_unstale":"2024-01-20T08:10:09.755626+0000","last_undegraded":"2024-01-20T08:10:09.755626+0000","last_fullsized":"2024-01-20T08:10:09.755626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:12:22.280635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192597+0000","last_change":"2024-01-20T08:10:08.796945+0000","last_active":"2024-01-20T08:10:10.192597+0000","last_peered":"2024-01-20T08:10:10.192597+0000","last_clean":"2024-01-20T08:10:10.192597+0000","last_became_active":"2024-01-20T08:10:08.796510+0000","last_became_peered":"2024-01-20T08:10:08.796510+0000","last_unstale":"2024-01-20T08:10:10.192597+0000","last_undegraded":"2024-01-20T08:10:10.192597+0000","last_fullsized":"2024-01-20T08:10:10.192597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187326+0000","last_change":"2024-01-20T08:10:08.781890+0000","last_active":"2024-01-20T08:10:10.187326+0000","last_peered":"2024-01-20T08:10:10.187326+0000","last_clean":"2024-01-20T08:10:10.187326+0000","last_became_active":"2024-01-20T08:10:08.781584+0000","last_became_peered":"2024-01-20T08:10:08.781584+0000","last_unstale":"2024-01-20T08:10:10.187326+0000","last_undegraded":"2024-01-20T08:10:10.187326+0000","last_fullsized":"2024-01-20T08:10:10.187326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755750+0000","last_change":"2024-01-20T08:10:08.789316+0000","last_active":"2024-01-20T08:10:09.755750+0000","last_peered":"2024-01-20T08:10:09.755750+0000","last_clean":"2024-01-20T08:10:09.755750+0000","last_became_active":"2024-01-20T08:10:08.788713+0000","last_became_peered":"2024-01-20T08:10:08.788713+0000","last_unstale":"2024-01-20T08:10:09.755750+0000","last_undegraded":"2024-01-20T08:10:09.755750+0000","last_fullsized":"2024-01-20T08:10:09.755750+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187162+0000","last_change":"2024-01-20T08:10:08.785197+0000","last_active":"2024-01-20T08:10:10.187162+0000","last_peered":"2024-01-20T08:10:10.187162+0000","last_clean":"2024-01-20T08:10:10.187162+0000","last_became_active":"2024-01-20T08:10:08.784924+0000","last_became_peered":"2024-01-20T08:10:08.784924+0000","last_unstale":"2024-01-20T08:10:10.187162+0000","last_undegraded":"2024-01-20T08:10:10.187162+0000","last_fullsized":"2024-01-20T08:10:10.187162+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188330+0000","last_change":"2024-01-20T08:10:08.783898+0000","last_active":"2024-01-20T08:10:10.188330+0000","last_peered":"2024-01-20T08:10:10.188330+0000","last_clean":"2024-01-20T08:10:10.188330+0000","last_became_active":"2024-01-20T08:10:08.783616+0000","last_became_peered":"2024-01-20T08:10:08.783616+0000","last_unstale":"2024-01-20T08:10:10.188330+0000","last_undegraded":"2024-01-20T08:10:10.188330+0000","last_fullsized":"2024-01-20T08:10:10.188330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:43:11.805723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757513+0000","last_change":"2024-01-20T08:10:08.777383+0000","last_active":"2024-01-20T08:10:09.757513+0000","last_peered":"2024-01-20T08:10:09.757513+0000","last_clean":"2024-01-20T08:10:09.757513+0000","last_became_active":"2024-01-20T08:10:08.777063+0000","last_became_peered":"2024-01-20T08:10:08.777063+0000","last_unstale":"2024-01-20T08:10:09.757513+0000","last_undegraded":"2024-01-20T08:10:09.757513+0000","last_fullsized":"2024-01-20T08:10:09.757513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188697+0000","last_change":"2024-01-20T08:10:08.786427+0000","last_active":"2024-01-20T08:10:10.188697+0000","last_peered":"2024-01-20T08:10:10.188697+0000","last_clean":"2024-01-20T08:10:10.188697+0000","last_became_active":"2024-01-20T08:10:08.786064+0000","last_became_peered":"2024-01-20T08:10:08.786064+0000","last_unstale":"2024-01-20T08:10:10.188697+0000","last_undegraded":"2024-01-20T08:10:10.188697+0000","last_fullsized":"2024-01-20T08:10:10.188697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:53:18.124098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755478+0000","last_change":"2024-01-20T08:10:08.779140+0000","last_active":"2024-01-20T08:10:09.755478+0000","last_peered":"2024-01-20T08:10:09.755478+0000","last_clean":"2024-01-20T08:10:09.755478+0000","last_became_active":"2024-01-20T08:10:08.778789+0000","last_became_peered":"2024-01-20T08:10:08.778789+0000","last_unstale":"2024-01-20T08:10:09.755478+0000","last_undegraded":"2024-01-20T08:10:09.755478+0000","last_fullsized":"2024-01-20T08:10:09.755478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:25.692182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755123+0000","last_change":"2024-01-20T08:10:07.773775+0000","last_active":"2024-01-20T08:10:09.755123+0000","last_peered":"2024-01-20T08:10:09.755123+0000","last_clean":"2024-01-20T08:10:09.755123+0000","last_became_active":"2024-01-20T08:10:07.773480+0000","last_became_peered":"2024-01-20T08:10:07.773480+0000","last_unstale":"2024-01-20T08:10:09.755123+0000","last_undegraded":"2024-01-20T08:10:09.755123+0000","last_fullsized":"2024-01-20T08:10:09.755123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187214+0000","last_change":"2024-01-20T08:10:08.789715+0000","last_active":"2024-01-20T08:10:10.187214+0000","last_peered":"2024-01-20T08:10:10.187214+0000","last_clean":"2024-01-20T08:10:10.187214+0000","last_became_active":"2024-01-20T08:10:08.789077+0000","last_became_peered":"2024-01-20T08:10:08.789077+0000","last_unstale":"2024-01-20T08:10:10.187214+0000","last_undegraded":"2024-01-20T08:10:10.187214+0000","last_fullsized":"2024-01-20T08:10:10.187214+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189547+0000","last_change":"2024-01-20T08:10:07.779298+0000","last_active":"2024-01-20T08:10:10.189547+0000","last_peered":"2024-01-20T08:10:10.189547+0000","last_clean":"2024-01-20T08:10:10.189547+0000","last_became_active":"2024-01-20T08:10:07.776952+0000","last_became_peered":"2024-01-20T08:10:07.776952+0000","last_unstale":"2024-01-20T08:10:10.189547+0000","last_undegraded":"2024-01-20T08:10:10.189547+0000","last_fullsized":"2024-01-20T08:10:10.189547+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754848+0000","last_change":"2024-01-20T08:10:07.771726+0000","last_active":"2024-01-20T08:10:09.754848+0000","last_peered":"2024-01-20T08:10:09.754848+0000","last_clean":"2024-01-20T08:10:09.754848+0000","last_became_active":"2024-01-20T08:10:07.771478+0000","last_became_peered":"2024-01-20T08:10:07.771478+0000","last_unstale":"2024-01-20T08:10:09.754848+0000","last_undegraded":"2024-01-20T08:10:09.754848+0000","last_fullsized":"2024-01-20T08:10:09.754848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754395+0000","last_change":"2024-01-20T08:10:08.778862+0000","last_active":"2024-01-20T08:10:09.754395+0000","last_peered":"2024-01-20T08:10:09.754395+0000","last_clean":"2024-01-20T08:10:09.754395+0000","last_became_active":"2024-01-20T08:10:08.778602+0000","last_became_peered":"2024-01-20T08:10:08.778602+0000","last_unstale":"2024-01-20T08:10:09.754395+0000","last_undegraded":"2024-01-20T08:10:09.754395+0000","last_fullsized":"2024-01-20T08:10:09.754395+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187787+0000","last_change":"2024-01-20T08:10:07.782188+0000","last_active":"2024-01-20T08:10:10.187787+0000","last_peered":"2024-01-20T08:10:10.187787+0000","last_clean":"2024-01-20T08:10:10.187787+0000","last_became_active":"2024-01-20T08:10:07.781848+0000","last_became_peered":"2024-01-20T08:10:07.781848+0000","last_unstale":"2024-01-20T08:10:10.187787+0000","last_undegraded":"2024-01-20T08:10:10.187787+0000","last_fullsized":"2024-01-20T08:10:10.187787+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187824+0000","last_change":"2024-01-20T08:10:08.771016+0000","last_active":"2024-01-20T08:10:10.187824+0000","last_peered":"2024-01-20T08:10:10.187824+0000","last_clean":"2024-01-20T08:10:10.187824+0000","last_became_active":"2024-01-20T08:10:08.770684+0000","last_became_peered":"2024-01-20T08:10:08.770684+0000","last_unstale":"2024-01-20T08:10:10.187824+0000","last_undegraded":"2024-01-20T08:10:10.187824+0000","last_fullsized":"2024-01-20T08:10:10.187824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192570+0000","last_change":"2024-01-20T08:10:07.783230+0000","last_active":"2024-01-20T08:10:10.192570+0000","last_peered":"2024-01-20T08:10:10.192570+0000","last_clean":"2024-01-20T08:10:10.192570+0000","last_became_active":"2024-01-20T08:10:07.782491+0000","last_became_peered":"2024-01-20T08:10:07.782491+0000","last_unstale":"2024-01-20T08:10:10.192570+0000","last_undegraded":"2024-01-20T08:10:10.192570+0000","last_fullsized":"2024-01-20T08:10:10.192570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190746+0000","last_change":"2024-01-20T08:10:08.790309+0000","last_active":"2024-01-20T08:10:10.190746+0000","last_peered":"2024-01-20T08:10:10.190746+0000","last_clean":"2024-01-20T08:10:10.190746+0000","last_became_active":"2024-01-20T08:10:08.790047+0000","last_became_peered":"2024-01-20T08:10:08.790047+0000","last_unstale":"2024-01-20T08:10:10.190746+0000","last_undegraded":"2024-01-20T08:10:10.190746+0000","last_fullsized":"2024-01-20T08:10:10.190746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190087+0000","last_change":"2024-01-20T08:10:07.786339+0000","last_active":"2024-01-20T08:10:10.190087+0000","last_peered":"2024-01-20T08:10:10.190087+0000","last_clean":"2024-01-20T08:10:10.190087+0000","last_became_active":"2024-01-20T08:10:07.786034+0000","last_became_peered":"2024-01-20T08:10:07.786034+0000","last_unstale":"2024-01-20T08:10:10.190087+0000","last_undegraded":"2024-01-20T08:10:10.190087+0000","last_fullsized":"2024-01-20T08:10:10.190087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188010+0000","last_change":"2024-01-20T08:10:08.792377+0000","last_active":"2024-01-20T08:10:10.188010+0000","last_peered":"2024-01-20T08:10:10.188010+0000","last_clean":"2024-01-20T08:10:10.188010+0000","last_became_active":"2024-01-20T08:10:08.792096+0000","last_became_peered":"2024-01-20T08:10:08.792096+0000","last_unstale":"2024-01-20T08:10:10.188010+0000","last_undegraded":"2024-01-20T08:10:10.188010+0000","last_fullsized":"2024-01-20T08:10:10.188010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187591+0000","last_change":"2024-01-20T08:10:07.782717+0000","last_active":"2024-01-20T08:10:10.187591+0000","last_peered":"2024-01-20T08:10:10.187591+0000","last_clean":"2024-01-20T08:10:10.187591+0000","last_became_active":"2024-01-20T08:10:07.782484+0000","last_became_peered":"2024-01-20T08:10:07.782484+0000","last_unstale":"2024-01-20T08:10:10.187591+0000","last_undegraded":"2024-01-20T08:10:10.187591+0000","last_fullsized":"2024-01-20T08:10:10.187591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756143+0000","last_change":"2024-01-20T08:10:08.781928+0000","last_active":"2024-01-20T08:10:09.756143+0000","last_peered":"2024-01-20T08:10:09.756143+0000","last_clean":"2024-01-20T08:10:09.756143+0000","last_became_active":"2024-01-20T08:10:08.781472+0000","last_became_peered":"2024-01-20T08:10:08.781472+0000","last_unstale":"2024-01-20T08:10:09.756143+0000","last_undegraded":"2024-01-20T08:10:09.756143+0000","last_fullsized":"2024-01-20T08:10:09.756143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:26.656512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190465+0000","last_change":"2024-01-20T08:10:07.782772+0000","last_active":"2024-01-20T08:10:10.190465+0000","last_peered":"2024-01-20T08:10:10.190465+0000","last_clean":"2024-01-20T08:10:10.190465+0000","last_became_active":"2024-01-20T08:10:07.780824+0000","last_became_peered":"2024-01-20T08:10:07.780824+0000","last_unstale":"2024-01-20T08:10:10.190465+0000","last_undegraded":"2024-01-20T08:10:10.190465+0000","last_fullsized":"2024-01-20T08:10:10.190465+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190013+0000","last_change":"2024-01-20T08:10:08.786404+0000","last_active":"2024-01-20T08:10:10.190013+0000","last_peered":"2024-01-20T08:10:10.190013+0000","last_clean":"2024-01-20T08:10:10.190013+0000","last_became_active":"2024-01-20T08:10:08.786120+0000","last_became_peered":"2024-01-20T08:10:08.786120+0000","last_unstale":"2024-01-20T08:10:10.190013+0000","last_undegraded":"2024-01-20T08:10:10.190013+0000","last_fullsized":"2024-01-20T08:10:10.190013+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187474+0000","last_change":"2024-01-20T08:10:07.763023+0000","last_active":"2024-01-20T08:10:10.187474+0000","last_peered":"2024-01-20T08:10:10.187474+0000","last_clean":"2024-01-20T08:10:10.187474+0000","last_became_active":"2024-01-20T08:10:07.762445+0000","last_became_peered":"2024-01-20T08:10:07.762445+0000","last_unstale":"2024-01-20T08:10:10.187474+0000","last_undegraded":"2024-01-20T08:10:10.187474+0000","last_fullsized":"2024-01-20T08:10:10.187474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186810+0000","last_change":"2024-01-20T08:10:08.788158+0000","last_active":"2024-01-20T08:10:10.186810+0000","last_peered":"2024-01-20T08:10:10.186810+0000","last_clean":"2024-01-20T08:10:10.186810+0000","last_became_active":"2024-01-20T08:10:08.787042+0000","last_became_peered":"2024-01-20T08:10:08.787042+0000","last_unstale":"2024-01-20T08:10:10.186810+0000","last_undegraded":"2024-01-20T08:10:10.186810+0000","last_fullsized":"2024-01-20T08:10:10.186810+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188550+0000","last_change":"2024-01-20T08:10:07.780955+0000","last_active":"2024-01-20T08:10:10.188550+0000","last_peered":"2024-01-20T08:10:10.188550+0000","last_clean":"2024-01-20T08:10:10.188550+0000","last_became_active":"2024-01-20T08:10:07.780635+0000","last_became_peered":"2024-01-20T08:10:07.780635+0000","last_unstale":"2024-01-20T08:10:10.188550+0000","last_undegraded":"2024-01-20T08:10:10.188550+0000","last_fullsized":"2024-01-20T08:10:10.188550+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:48:54.165646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192151+0000","last_change":"2024-01-20T08:10:08.783000+0000","last_active":"2024-01-20T08:10:10.192151+0000","last_peered":"2024-01-20T08:10:10.192151+0000","last_clean":"2024-01-20T08:10:10.192151+0000","last_became_active":"2024-01-20T08:10:08.782683+0000","last_became_peered":"2024-01-20T08:10:08.782683+0000","last_unstale":"2024-01-20T08:10:10.192151+0000","last_undegraded":"2024-01-20T08:10:10.192151+0000","last_fullsized":"2024-01-20T08:10:10.192151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189278+0000","last_change":"2024-01-20T08:10:07.775311+0000","last_active":"2024-01-20T08:10:10.189278+0000","last_peered":"2024-01-20T08:10:10.189278+0000","last_clean":"2024-01-20T08:10:10.189278+0000","last_became_active":"2024-01-20T08:10:07.771006+0000","last_became_peered":"2024-01-20T08:10:07.771006+0000","last_unstale":"2024-01-20T08:10:10.189278+0000","last_undegraded":"2024-01-20T08:10:10.189278+0000","last_fullsized":"2024-01-20T08:10:10.189278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189142+0000","last_change":"2024-01-20T08:10:08.779813+0000","last_active":"2024-01-20T08:10:10.189142+0000","last_peered":"2024-01-20T08:10:10.189142+0000","last_clean":"2024-01-20T08:10:10.189142+0000","last_became_active":"2024-01-20T08:10:08.778962+0000","last_became_peered":"2024-01-20T08:10:08.778962+0000","last_unstale":"2024-01-20T08:10:10.189142+0000","last_undegraded":"2024-01-20T08:10:10.189142+0000","last_fullsized":"2024-01-20T08:10:10.189142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757296+0000","last_change":"2024-01-20T08:10:07.773757+0000","last_active":"2024-01-20T08:10:09.757296+0000","last_peered":"2024-01-20T08:10:09.757296+0000","last_clean":"2024-01-20T08:10:09.757296+0000","last_became_active":"2024-01-20T08:10:07.773422+0000","last_became_peered":"2024-01-20T08:10:07.773422+0000","last_unstale":"2024-01-20T08:10:09.757296+0000","last_undegraded":"2024-01-20T08:10:09.757296+0000","last_fullsized":"2024-01-20T08:10:09.757296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192502+0000","last_change":"2024-01-20T08:10:08.787377+0000","last_active":"2024-01-20T08:10:10.192502+0000","last_peered":"2024-01-20T08:10:10.192502+0000","last_clean":"2024-01-20T08:10:10.192502+0000","last_became_active":"2024-01-20T08:10:08.787064+0000","last_became_peered":"2024-01-20T08:10:08.787064+0000","last_unstale":"2024-01-20T08:10:10.192502+0000","last_undegraded":"2024-01-20T08:10:10.192502+0000","last_fullsized":"2024-01-20T08:10:10.192502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.756111+0000","last_change":"2024-01-20T08:10:07.759594+0000","last_active":"2024-01-20T08:10:09.756111+0000","last_peered":"2024-01-20T08:10:09.756111+0000","last_clean":"2024-01-20T08:10:09.756111+0000","last_became_active":"2024-01-20T08:10:07.759092+0000","last_became_peered":"2024-01-20T08:10:07.759092+0000","last_unstale":"2024-01-20T08:10:09.756111+0000","last_undegraded":"2024-01-20T08:10:09.756111+0000","last_fullsized":"2024-01-20T08:10:09.756111+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192462+0000","last_change":"2024-01-20T08:10:08.787171+0000","last_active":"2024-01-20T08:10:10.192462+0000","last_peered":"2024-01-20T08:10:10.192462+0000","last_clean":"2024-01-20T08:10:10.192462+0000","last_became_active":"2024-01-20T08:10:08.786910+0000","last_became_peered":"2024-01-20T08:10:08.786910+0000","last_unstale":"2024-01-20T08:10:10.192462+0000","last_undegraded":"2024-01-20T08:10:10.192462+0000","last_fullsized":"2024-01-20T08:10:10.192462+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:34.448068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.758344+0000","last_change":"2024-01-20T08:10:07.768872+0000","last_active":"2024-01-20T08:10:09.758344+0000","last_peered":"2024-01-20T08:10:09.758344+0000","last_clean":"2024-01-20T08:10:09.758344+0000","last_became_active":"2024-01-20T08:10:07.768410+0000","last_became_peered":"2024-01-20T08:10:07.768410+0000","last_unstale":"2024-01-20T08:10:09.758344+0000","last_undegraded":"2024-01-20T08:10:09.758344+0000","last_fullsized":"2024-01-20T08:10:09.758344+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:31:17.868223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.193451+0000","last_change":"2024-01-20T08:10:08.788993+0000","last_active":"2024-01-20T08:10:10.193451+0000","last_peered":"2024-01-20T08:10:10.193451+0000","last_clean":"2024-01-20T08:10:10.193451+0000","last_became_active":"2024-01-20T08:10:08.788676+0000","last_became_peered":"2024-01-20T08:10:08.788676+0000","last_unstale":"2024-01-20T08:10:10.193451+0000","last_undegraded":"2024-01-20T08:10:10.193451+0000","last_fullsized":"2024-01-20T08:10:10.193451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:26.946080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188374+0000","last_change":"2024-01-20T08:10:07.770092+0000","last_active":"2024-01-20T08:10:10.188374+0000","last_peered":"2024-01-20T08:10:10.188374+0000","last_clean":"2024-01-20T08:10:10.188374+0000","last_became_active":"2024-01-20T08:10:07.769349+0000","last_became_peered":"2024-01-20T08:10:07.769349+0000","last_unstale":"2024-01-20T08:10:10.188374+0000","last_undegraded":"2024-01-20T08:10:10.188374+0000","last_fullsized":"2024-01-20T08:10:10.188374+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188541+0000","last_change":"2024-01-20T08:10:08.780078+0000","last_active":"2024-01-20T08:10:10.188541+0000","last_peered":"2024-01-20T08:10:10.188541+0000","last_clean":"2024-01-20T08:10:10.188541+0000","last_became_active":"2024-01-20T08:10:08.778811+0000","last_became_peered":"2024-01-20T08:10:08.778811+0000","last_unstale":"2024-01-20T08:10:10.188541+0000","last_undegraded":"2024-01-20T08:10:10.188541+0000","last_fullsized":"2024-01-20T08:10:10.188541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:10:55.426137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757909+0000","last_change":"2024-01-20T08:10:07.782606+0000","last_active":"2024-01-20T08:10:09.757909+0000","last_peered":"2024-01-20T08:10:09.757909+0000","last_clean":"2024-01-20T08:10:09.757909+0000","last_became_active":"2024-01-20T08:10:07.782208+0000","last_became_peered":"2024-01-20T08:10:07.782208+0000","last_unstale":"2024-01-20T08:10:09.757909+0000","last_undegraded":"2024-01-20T08:10:09.757909+0000","last_fullsized":"2024-01-20T08:10:09.757909+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:29:30.507186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190352+0000","last_change":"2024-01-20T08:10:08.793744+0000","last_active":"2024-01-20T08:10:10.190352+0000","last_peered":"2024-01-20T08:10:10.190352+0000","last_clean":"2024-01-20T08:10:10.190352+0000","last_became_active":"2024-01-20T08:10:08.793434+0000","last_became_peered":"2024-01-20T08:10:08.793434+0000","last_unstale":"2024-01-20T08:10:10.190352+0000","last_undegraded":"2024-01-20T08:10:10.190352+0000","last_fullsized":"2024-01-20T08:10:10.190352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":166,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-01-20T08:10:08.753995+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:10:08.753995+0000","last_peered":"2024-01-20T08:10:08.753995+0000","last_clean":"2024-01-20T08:10:08.753995+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:10:08.753995+0000","last_undegraded":"2024-01-20T08:10:08.753995+0000","last_fullsized":"2024-01-20T08:10:08.753995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187608+0000","last_change":"2024-01-20T08:10:07.781232+0000","last_active":"2024-01-20T08:10:10.187608+0000","last_peered":"2024-01-20T08:10:10.187608+0000","last_clean":"2024-01-20T08:10:10.187608+0000","last_became_active":"2024-01-20T08:10:07.780629+0000","last_became_peered":"2024-01-20T08:10:07.780629+0000","last_unstale":"2024-01-20T08:10:10.187608+0000","last_undegraded":"2024-01-20T08:10:10.187608+0000","last_fullsized":"2024-01-20T08:10:10.187608+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755289+0000","last_change":"2024-01-20T08:10:08.780899+0000","last_active":"2024-01-20T08:10:09.755289+0000","last_peered":"2024-01-20T08:10:09.755289+0000","last_clean":"2024-01-20T08:10:09.755289+0000","last_became_active":"2024-01-20T08:10:08.780569+0000","last_became_peered":"2024-01-20T08:10:08.780569+0000","last_unstale":"2024-01-20T08:10:09.755289+0000","last_undegraded":"2024-01-20T08:10:09.755289+0000","last_fullsized":"2024-01-20T08:10:09.755289+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:46:40.515113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188706+0000","last_change":"2024-01-20T08:10:07.772607+0000","last_active":"2024-01-20T08:10:10.188706+0000","last_peered":"2024-01-20T08:10:10.188706+0000","last_clean":"2024-01-20T08:10:10.188706+0000","last_became_active":"2024-01-20T08:10:07.772327+0000","last_became_peered":"2024-01-20T08:10:07.772327+0000","last_unstale":"2024-01-20T08:10:10.188706+0000","last_undegraded":"2024-01-20T08:10:10.188706+0000","last_fullsized":"2024-01-20T08:10:10.188706+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186426+0000","last_change":"2024-01-20T08:10:08.789696+0000","last_active":"2024-01-20T08:10:10.186426+0000","last_peered":"2024-01-20T08:10:10.186426+0000","last_clean":"2024-01-20T08:10:10.186426+0000","last_became_active":"2024-01-20T08:10:08.789380+0000","last_became_peered":"2024-01-20T08:10:08.789380+0000","last_unstale":"2024-01-20T08:10:10.186426+0000","last_undegraded":"2024-01-20T08:10:10.186426+0000","last_fullsized":"2024-01-20T08:10:10.186426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:37.093953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.757606+0000","last_change":"2024-01-20T08:10:07.770872+0000","last_active":"2024-01-20T08:10:09.757606+0000","last_peered":"2024-01-20T08:10:09.757606+0000","last_clean":"2024-01-20T08:10:09.757606+0000","last_became_active":"2024-01-20T08:10:07.770607+0000","last_became_peered":"2024-01-20T08:10:07.770607+0000","last_unstale":"2024-01-20T08:10:09.757606+0000","last_undegraded":"2024-01-20T08:10:09.757606+0000","last_fullsized":"2024-01-20T08:10:09.757606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:31:14.716695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187472+0000","last_change":"2024-01-20T08:10:08.774148+0000","last_active":"2024-01-20T08:10:10.187472+0000","last_peered":"2024-01-20T08:10:10.187472+0000","last_clean":"2024-01-20T08:10:10.187472+0000","last_became_active":"2024-01-20T08:10:08.773809+0000","last_became_peered":"2024-01-20T08:10:08.773809+0000","last_unstale":"2024-01-20T08:10:10.187472+0000","last_undegraded":"2024-01-20T08:10:10.187472+0000","last_fullsized":"2024-01-20T08:10:10.187472+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188851+0000","last_change":"2024-01-20T08:10:07.772528+0000","last_active":"2024-01-20T08:10:10.188851+0000","last_peered":"2024-01-20T08:10:10.188851+0000","last_clean":"2024-01-20T08:10:10.188851+0000","last_became_active":"2024-01-20T08:10:07.769568+0000","last_became_peered":"2024-01-20T08:10:07.769568+0000","last_unstale":"2024-01-20T08:10:10.188851+0000","last_undegraded":"2024-01-20T08:10:10.188851+0000","last_fullsized":"2024-01-20T08:10:10.188851+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755908+0000","last_change":"2024-01-20T08:10:08.781307+0000","last_active":"2024-01-20T08:10:09.755908+0000","last_peered":"2024-01-20T08:10:09.755908+0000","last_clean":"2024-01-20T08:10:09.755908+0000","last_became_active":"2024-01-20T08:10:08.779605+0000","last_became_peered":"2024-01-20T08:10:08.779605+0000","last_unstale":"2024-01-20T08:10:09.755908+0000","last_undegraded":"2024-01-20T08:10:09.755908+0000","last_fullsized":"2024-01-20T08:10:09.755908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:02.671917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188853+0000","last_change":"2024-01-20T08:10:07.771605+0000","last_active":"2024-01-20T08:10:10.188853+0000","last_peered":"2024-01-20T08:10:10.188853+0000","last_clean":"2024-01-20T08:10:10.188853+0000","last_became_active":"2024-01-20T08:10:07.771371+0000","last_became_peered":"2024-01-20T08:10:07.771371+0000","last_unstale":"2024-01-20T08:10:10.188853+0000","last_undegraded":"2024-01-20T08:10:10.188853+0000","last_fullsized":"2024-01-20T08:10:10.188853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190748+0000","last_change":"2024-01-20T08:10:08.784437+0000","last_active":"2024-01-20T08:10:10.190748+0000","last_peered":"2024-01-20T08:10:10.190748+0000","last_clean":"2024-01-20T08:10:10.190748+0000","last_became_active":"2024-01-20T08:10:08.784168+0000","last_became_peered":"2024-01-20T08:10:08.784168+0000","last_unstale":"2024-01-20T08:10:10.190748+0000","last_undegraded":"2024-01-20T08:10:10.190748+0000","last_fullsized":"2024-01-20T08:10:10.190748+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:46:42.462548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.191198+0000","last_change":"2024-01-20T08:10:07.774618+0000","last_active":"2024-01-20T08:10:10.191198+0000","last_peered":"2024-01-20T08:10:10.191198+0000","last_clean":"2024-01-20T08:10:10.191198+0000","last_became_active":"2024-01-20T08:10:07.774350+0000","last_became_peered":"2024-01-20T08:10:07.774350+0000","last_unstale":"2024-01-20T08:10:10.191198+0000","last_undegraded":"2024-01-20T08:10:10.191198+0000","last_fullsized":"2024-01-20T08:10:10.191198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188744+0000","last_change":"2024-01-20T08:10:08.774147+0000","last_active":"2024-01-20T08:10:10.188744+0000","last_peered":"2024-01-20T08:10:10.188744+0000","last_clean":"2024-01-20T08:10:10.188744+0000","last_became_active":"2024-01-20T08:10:08.773823+0000","last_became_peered":"2024-01-20T08:10:08.773823+0000","last_unstale":"2024-01-20T08:10:10.188744+0000","last_undegraded":"2024-01-20T08:10:10.188744+0000","last_fullsized":"2024-01-20T08:10:10.188744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:59:20.988022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.967916+0000","last_change":"2024-01-20T08:10:07.774279+0000","last_active":"2024-01-20T08:10:10.967916+0000","last_peered":"2024-01-20T08:10:10.967916+0000","last_clean":"2024-01-20T08:10:10.967916+0000","last_became_active":"2024-01-20T08:10:07.774002+0000","last_became_peered":"2024-01-20T08:10:07.774002+0000","last_unstale":"2024-01-20T08:10:10.967916+0000","last_undegraded":"2024-01-20T08:10:10.967916+0000","last_fullsized":"2024-01-20T08:10:10.967916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:01.659043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755901+0000","last_change":"2024-01-20T08:10:08.775836+0000","last_active":"2024-01-20T08:10:09.755901+0000","last_peered":"2024-01-20T08:10:09.755901+0000","last_clean":"2024-01-20T08:10:09.755901+0000","last_became_active":"2024-01-20T08:10:08.770776+0000","last_became_peered":"2024-01-20T08:10:08.770776+0000","last_unstale":"2024-01-20T08:10:09.755901+0000","last_undegraded":"2024-01-20T08:10:09.755901+0000","last_fullsized":"2024-01-20T08:10:09.755901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:03:44.877426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192752+0000","last_change":"2024-01-20T08:10:07.777758+0000","last_active":"2024-01-20T08:10:10.192752+0000","last_peered":"2024-01-20T08:10:10.192752+0000","last_clean":"2024-01-20T08:10:10.192752+0000","last_became_active":"2024-01-20T08:10:07.773502+0000","last_became_peered":"2024-01-20T08:10:07.773502+0000","last_unstale":"2024-01-20T08:10:10.192752+0000","last_undegraded":"2024-01-20T08:10:10.192752+0000","last_fullsized":"2024-01-20T08:10:10.192752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.186956+0000","last_change":"2024-01-20T08:10:08.782036+0000","last_active":"2024-01-20T08:10:10.186956+0000","last_peered":"2024-01-20T08:10:10.186956+0000","last_clean":"2024-01-20T08:10:10.186956+0000","last_became_active":"2024-01-20T08:10:08.781743+0000","last_became_peered":"2024-01-20T08:10:08.781743+0000","last_unstale":"2024-01-20T08:10:10.186956+0000","last_undegraded":"2024-01-20T08:10:10.186956+0000","last_fullsized":"2024-01-20T08:10:10.186956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:59:04.353691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188450+0000","last_change":"2024-01-20T08:10:07.775094+0000","last_active":"2024-01-20T08:10:10.188450+0000","last_peered":"2024-01-20T08:10:10.188450+0000","last_clean":"2024-01-20T08:10:10.188450+0000","last_became_active":"2024-01-20T08:10:07.774836+0000","last_became_peered":"2024-01-20T08:10:07.774836+0000","last_unstale":"2024-01-20T08:10:10.188450+0000","last_undegraded":"2024-01-20T08:10:10.188450+0000","last_fullsized":"2024-01-20T08:10:10.188450+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755687+0000","last_change":"2024-01-20T08:10:08.785065+0000","last_active":"2024-01-20T08:10:09.755687+0000","last_peered":"2024-01-20T08:10:09.755687+0000","last_clean":"2024-01-20T08:10:09.755687+0000","last_became_active":"2024-01-20T08:10:08.782610+0000","last_became_peered":"2024-01-20T08:10:08.782610+0000","last_unstale":"2024-01-20T08:10:09.755687+0000","last_undegraded":"2024-01-20T08:10:09.755687+0000","last_fullsized":"2024-01-20T08:10:09.755687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:48.003669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188086+0000","last_change":"2024-01-20T08:10:07.770741+0000","last_active":"2024-01-20T08:10:10.188086+0000","last_peered":"2024-01-20T08:10:10.188086+0000","last_clean":"2024-01-20T08:10:10.188086+0000","last_became_active":"2024-01-20T08:10:07.770315+0000","last_became_peered":"2024-01-20T08:10:07.770315+0000","last_unstale":"2024-01-20T08:10:10.188086+0000","last_undegraded":"2024-01-20T08:10:10.188086+0000","last_fullsized":"2024-01-20T08:10:10.188086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:14.946980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.754531+0000","last_change":"2024-01-20T08:10:08.775245+0000","last_active":"2024-01-20T08:10:09.754531+0000","last_peered":"2024-01-20T08:10:09.754531+0000","last_clean":"2024-01-20T08:10:09.754531+0000","last_became_active":"2024-01-20T08:10:08.774956+0000","last_became_peered":"2024-01-20T08:10:08.774956+0000","last_unstale":"2024-01-20T08:10:09.754531+0000","last_undegraded":"2024-01-20T08:10:09.754531+0000","last_fullsized":"2024-01-20T08:10:09.754531+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:31.335605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188622+0000","last_change":"2024-01-20T08:10:07.772612+0000","last_active":"2024-01-20T08:10:10.188622+0000","last_peered":"2024-01-20T08:10:10.188622+0000","last_clean":"2024-01-20T08:10:10.188622+0000","last_became_active":"2024-01-20T08:10:07.772238+0000","last_became_peered":"2024-01-20T08:10:07.772238+0000","last_unstale":"2024-01-20T08:10:10.188622+0000","last_undegraded":"2024-01-20T08:10:10.188622+0000","last_fullsized":"2024-01-20T08:10:10.188622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:52.542861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755280+0000","last_change":"2024-01-20T08:10:08.780781+0000","last_active":"2024-01-20T08:10:09.755280+0000","last_peered":"2024-01-20T08:10:09.755280+0000","last_clean":"2024-01-20T08:10:09.755280+0000","last_became_active":"2024-01-20T08:10:08.780502+0000","last_became_peered":"2024-01-20T08:10:08.780502+0000","last_unstale":"2024-01-20T08:10:09.755280+0000","last_undegraded":"2024-01-20T08:10:09.755280+0000","last_fullsized":"2024-01-20T08:10:09.755280+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192526+0000","last_change":"2024-01-20T08:10:07.769908+0000","last_active":"2024-01-20T08:10:10.192526+0000","last_peered":"2024-01-20T08:10:10.192526+0000","last_clean":"2024-01-20T08:10:10.192526+0000","last_became_active":"2024-01-20T08:10:07.769315+0000","last_became_peered":"2024-01-20T08:10:07.769315+0000","last_unstale":"2024-01-20T08:10:10.192526+0000","last_undegraded":"2024-01-20T08:10:10.192526+0000","last_fullsized":"2024-01-20T08:10:10.192526+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:26:58.715691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.189995+0000","last_change":"2024-01-20T08:10:08.789928+0000","last_active":"2024-01-20T08:10:10.189995+0000","last_peered":"2024-01-20T08:10:10.189995+0000","last_clean":"2024-01-20T08:10:10.189995+0000","last_became_active":"2024-01-20T08:10:08.789486+0000","last_became_peered":"2024-01-20T08:10:08.789486+0000","last_unstale":"2024-01-20T08:10:10.189995+0000","last_undegraded":"2024-01-20T08:10:10.189995+0000","last_fullsized":"2024-01-20T08:10:10.189995+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:53.012036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190318+0000","last_change":"2024-01-20T08:10:08.788327+0000","last_active":"2024-01-20T08:10:10.190318+0000","last_peered":"2024-01-20T08:10:10.190318+0000","last_clean":"2024-01-20T08:10:10.190318+0000","last_became_active":"2024-01-20T08:10:08.788050+0000","last_became_peered":"2024-01-20T08:10:08.788050+0000","last_unstale":"2024-01-20T08:10:10.190318+0000","last_undegraded":"2024-01-20T08:10:10.190318+0000","last_fullsized":"2024-01-20T08:10:10.190318+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:03.141129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.192978+0000","last_change":"2024-01-20T08:10:07.783387+0000","last_active":"2024-01-20T08:10:10.192978+0000","last_peered":"2024-01-20T08:10:10.192978+0000","last_clean":"2024-01-20T08:10:10.192978+0000","last_became_active":"2024-01-20T08:10:07.783090+0000","last_became_peered":"2024-01-20T08:10:07.783090+0000","last_unstale":"2024-01-20T08:10:10.192978+0000","last_undegraded":"2024-01-20T08:10:10.192978+0000","last_fullsized":"2024-01-20T08:10:10.192978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:36:24.679308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.188183+0000","last_change":"2024-01-20T08:10:08.788111+0000","last_active":"2024-01-20T08:10:10.188183+0000","last_peered":"2024-01-20T08:10:10.188183+0000","last_clean":"2024-01-20T08:10:10.188183+0000","last_became_active":"2024-01-20T08:10:08.787785+0000","last_became_peered":"2024-01-20T08:10:08.787785+0000","last_unstale":"2024-01-20T08:10:10.188183+0000","last_undegraded":"2024-01-20T08:10:10.188183+0000","last_fullsized":"2024-01-20T08:10:10.188183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:40:06.790484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.190593+0000","last_change":"2024-01-20T08:10:07.773272+0000","last_active":"2024-01-20T08:10:10.190593+0000","last_peered":"2024-01-20T08:10:10.190593+0000","last_clean":"2024-01-20T08:10:10.190593+0000","last_became_active":"2024-01-20T08:10:07.772994+0000","last_became_peered":"2024-01-20T08:10:07.772994+0000","last_unstale":"2024-01-20T08:10:10.190593+0000","last_undegraded":"2024-01-20T08:10:10.190593+0000","last_fullsized":"2024-01-20T08:10:10.190593+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:44:46.990794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187781+0000","last_change":"2024-01-20T08:10:08.792517+0000","last_active":"2024-01-20T08:10:10.187781+0000","last_peered":"2024-01-20T08:10:10.187781+0000","last_clean":"2024-01-20T08:10:10.187781+0000","last_became_active":"2024-01-20T08:10:08.792227+0000","last_became_peered":"2024-01-20T08:10:08.792227+0000","last_unstale":"2024-01-20T08:10:10.187781+0000","last_undegraded":"2024-01-20T08:10:10.187781+0000","last_fullsized":"2024-01-20T08:10:10.187781+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":13,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755753+0000","last_change":"2024-01-20T08:10:07.753907+0000","last_active":"2024-01-20T08:10:09.755753+0000","last_peered":"2024-01-20T08:10:09.755753+0000","last_clean":"2024-01-20T08:10:09.755753+0000","last_became_active":"2024-01-20T08:10:07.753601+0000","last_became_peered":"2024-01-20T08:10:07.753601+0000","last_unstale":"2024-01-20T08:10:09.755753+0000","last_undegraded":"2024-01-20T08:10:09.755753+0000","last_fullsized":"2024-01-20T08:10:09.755753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:08:42.443428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:09.755706+0000","last_change":"2024-01-20T08:10:08.789390+0000","last_active":"2024-01-20T08:10:09.755706+0000","last_peered":"2024-01-20T08:10:09.755706+0000","last_clean":"2024-01-20T08:10:09.755706+0000","last_became_active":"2024-01-20T08:10:08.789026+0000","last_became_peered":"2024-01-20T08:10:08.789026+0000","last_unstale":"2024-01-20T08:10:09.755706+0000","last_undegraded":"2024-01-20T08:10:09.755706+0000","last_fullsized":"2024-01-20T08:10:09.755706+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:07.715089+0000","last_clean_scrub_stamp":"2024-01-20T08:10:07.715089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:11:32.220659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-01-20T08:10:10.187992+0000","last_change":"2024-01-20T08:10:07.768390+0000","last_active":"2024-01-20T08:10:10.187992+0000","last_peered":"2024-01-20T08:10:10.187992+0000","last_clean":"2024-01-20T08:10:10.187992+0000","last_became_active":"2024-01-20T08:10:07.768097+0000","last_became_peered":"2024-01-20T08:10:07.768097+0000","last_unstale":"2024-01-20T08:10:10.187992+0000","last_undegraded":"2024-01-20T08:10:10.187992+0000","last_fullsized":"2024-01-20T08:10:10.187992+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:06.702215+0000","last_clean_scrub_stamp":"2024-01-20T08:10:06.702215+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:19:02.285186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":827392,"data_stored":671588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2130000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6279999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5740000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6930000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.012}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9610000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8580000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31416,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340424,"statfs":{"total":96636764160,"available":96604594176,"internally_reserved":0,"allocated":233472,"data_stored":80728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.629}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.391}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.831}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31424,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340416,"statfs":{"total":96636764160,"available":96604585984,"internally_reserved":0,"allocated":241664,"data_stored":80764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0229999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4610000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.571}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27264,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344576,"statfs":{"total":96636764160,"available":96608845824,"internally_reserved":0,"allocated":241664,"data_stored":82250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.133}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":229376,"data_stored":80638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.359}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.889}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":237568,"data_stored":80798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.04}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.129}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.54}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":835584,"data_stored":671644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1850000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3420000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:10:17.497 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-20T08:10:17.497 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-01-20T08:10:17.497 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-01-20T08:10:17.497 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-01-20T08:10:17.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.735+0000 7fd38b400640 1 Processor -- start 2024-01-20T08:10:17.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.735+0000 7fd38b400640 1 -- start start 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.736+0000 7fd38b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd38414b720 0x7fd3841515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.736+0000 7fd38b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd3840c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.736+0000 7fd38b400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd384154ba0 con 0x7fd38406c8d0 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.736+0000 7fd38b400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd38414bb00 con 0x7fd38414b720 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.736+0000 7fd38b400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd384155a00 con 0x7fd3840c1850 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd389400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd38406c8d0 0x7fd38406cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55640/0 (socket says 172.21.15.100:55640) 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd389400640 1 -- 172.21.15.100:0/3669928331 learned_addr learned my addr 172.21.15.100:0/3669928331 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:17.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd388a00640 1 --2- 172.21.15.100:0/3669928331 >> v2:172.21.15.110:3300/0 conn(0x7fd38414b720 0x7fd3841515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd37bc00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd3840c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459210928 0 0) 0x7fd384154ba0 con 0x7fd38406c8d0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd364003520 con 0x7fd38406c8d0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 860232751 0 0) 0x7fd364003520 con 0x7fd38406c8d0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 msgr2=0x7fd3840c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd3840c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 >> v2:172.21.15.110:3300/0 conn(0x7fd38414b720 msgr2=0x7fd3841515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 --2- 172.21.15.100:0/3669928331 >> v2:172.21.15.110:3300/0 conn(0x7fd38414b720 0x7fd3841515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd384154df0 con 0x7fd38406c8d0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fd37c0019f0 con 0x7fd38406c8d0 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 >> v1:172.21.15.100:6789/0 conn(0x7fd38406c8d0 legacy=0x7fd38406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd364003970 0x7fd364003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.737+0000 7fd383e00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3640047c0 0x7fd364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd383e00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd364005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414bb00 con 0x7fd3640047c0 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd384155a00 con 0x7fd364003970 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd36400ba30 con 0x7fd3840c1850 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3640047c0 0x7fd364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd388a00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd364003970 0x7fd364003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd389400640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd364005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 -- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 msgr2=0x7fd364005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3840c1850 0x7fd364005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 -- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd364003970 msgr2=0x7fd364003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd364003970 0x7fd364003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.738+0000 7fd37bc00640 1 -- 172.21.15.100:0/3669928331 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364003520 con 0x7fd3640047c0 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.739+0000 7fd37bc00640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3640047c0 0x7fd364004c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00ba00 tx=0x7fd3640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97071b2dcaf8cbc2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.739+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0335f0 con 0x7fd3640047c0 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.739+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c033750 con 0x7fd3640047c0 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.739+0000 7fd383e00640 1 -- 172.21.15.100:0/3669928331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c033ae0 con 0x7fd3640047c0 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 -- 172.21.15.100:0/3669928331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3640047c0 msgr2=0x7fd364004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 --2- 172.21.15.100:0/3669928331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd3640047c0 0x7fd364004c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd36c00ba00 tx=0x7fd3640057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd389400640 1 -- 172.21.15.100:0/3669928331 reap_dead start 2024-01-20T08:10:17.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 -- 172.21.15.100:0/3669928331 shutdown_connections 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 -- 172.21.15.100:0/3669928331 >> 172.21.15.100:0/3669928331 conn(0x7fd3840c2940 msgr2=0x7fd3840c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 -- 172.21.15.100:0/3669928331 shutdown_connections 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.740+0000 7fd38b400640 1 -- 172.21.15.100:0/3669928331 wait complete. 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.742+0000 7fd38b400640 1 Processor -- start 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.742+0000 7fd38b400640 1 -- start start 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3640047c0 0x7fd3841ebdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd38414a6b0 0x7fd3841542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841482c0 con 0x7fd384154800 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3841ec2f0 con 0x7fd38414a6b0 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd38b400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38414cad0 con 0x7fd3640047c0 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58056/0 (socket says 172.21.15.100:58056) 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 -- 172.21.15.100:0/4054986848 learned_addr learned my addr 172.21.15.100:0/4054986848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd37bc00640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd38414a6b0 0x7fd3841542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd388a00640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3640047c0 0x7fd3841ebdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 -- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3640047c0 msgr2=0x7fd3841ebdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3640047c0 0x7fd3841ebdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 -- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd38414a6b0 msgr2=0x7fd3841542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd38414a6b0 0x7fd3841542c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.743+0000 7fd389400640 1 -- 172.21.15.100:0/4054986848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd38414c4c0 con 0x7fd384154800 2024-01-20T08:10:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd389400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd38406fe10 tx=0x7fd37c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c00bb20 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37c00bca0 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37c007110 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384147450 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.744+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd384147a10 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.745+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd384146670 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.746+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd37c007270 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.747+0000 7fd381600640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 0x7fd35c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.747+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd37c089a80 con 0x7fd384154800 2024-01-20T08:10:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.747+0000 7fd388a00640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 0x7fd35c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.748+0000 7fd388a00640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 0x7fd35c06d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd374009a90 tx=0x7fd374008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.751+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd37c054940 con 0x7fd384154800 2024-01-20T08:10:17.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.962+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd384147c00 con 0x7fd384154800 2024-01-20T08:10:17.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.963+0000 7fd381600640 1 -- 172.21.15.100:0/4054986848 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fd37c057f60 con 0x7fd384154800 2024-01-20T08:10:17.966 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:17.966 INFO:teuthology.orchestra.run.smithi100.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 msgr2=0x7fd35c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 0x7fd35c06d390 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd374009a90 tx=0x7fd374008040 comp rx=0 tx=0).stop 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 msgr2=0x7fd384145970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd38406fe10 tx=0x7fd37c00b4a0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 shutdown_connections 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd384154800 0x7fd384145970 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd38414a6b0 0x7fd3841542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35c06aed0 0x7fd35c06d390 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 --2- 172.21.15.100:0/4054986848 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd3640047c0 0x7fd3841ebdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 >> 172.21.15.100:0/4054986848 conn(0x7fd3840c2940 msgr2=0x7fd38406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 shutdown_connections 2024-01-20T08:10:17.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:17.966+0000 7fd38b400640 1 -- 172.21.15.100:0/4054986848 wait complete. 2024-01-20T08:10:17.985 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-01-20T08:10:17.985 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.182+0000 7f22e9800640 1 Processor -- start 2024-01-20T08:10:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.182+0000 7f22e9800640 1 -- start start 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e9800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22e40c4d10 0x7f22e4155c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e9800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e40aa110 con 0x7f22e40aa9e0 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e9800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22e4155340 con 0x7f22e40aa5a0 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e9800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22e4155620 con 0x7f22e40c4d10 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e3400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f22e40aa9e0 0x7f22e4151bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55642/0 (socket says 172.21.15.100:55642) 2024-01-20T08:10:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e3400640 1 -- 172.21.15.100:0/4096839720 learned_addr learned my addr 172.21.15.100:0/4096839720 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.184+0000 7f22e2a00640 1 --2- 172.21.15.100:0/4096839720 >> v2:172.21.15.110:3300/0 conn(0x7f22e40c4d10 0x7f22e4155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913016791 0 0) 0x7f22e40aa110 con 0x7f22e40aa9e0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c4003520 con 0x7f22e40aa9e0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3151350919 0 0) 0x7f22c4003520 con 0x7f22e40aa9e0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 >> v2:172.21.15.110:3300/0 conn(0x7f22e40c4d10 msgr2=0x7f22e4155c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 --2- 172.21.15.100:0/4096839720 >> v2:172.21.15.110:3300/0 conn(0x7f22e40c4d10 0x7f22e4155c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 >> v1:172.21.15.110:6789/0 conn(0x7f22e40aa5a0 legacy=0x7f22e41548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e40a9ac0 con 0x7f22e40aa9e0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f22dc001670 con 0x7f22e40aa9e0 2024-01-20T08:10:18.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 >> v1:172.21.15.100:6789/0 conn(0x7f22e40aa9e0 legacy=0x7f22e4151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4003970 0x7f22c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 0x7f22c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4005180 0x7f22c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e4155620 con 0x7f22c40047c0 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c400c120 con 0x7f22c4003970 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c400c2e0 con 0x7f22c4005180 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.185+0000 7f22e2000640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 0x7f22c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2a00640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4003970 0x7f22c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2000640 1 -- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4005180 msgr2=0x7f22c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2000640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c4005180 0x7f22c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2000640 1 -- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4003970 msgr2=0x7f22c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2000640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22c4003970 0x7f22c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e2000640 1 -- 172.21.15.100:0/4096839720 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c4003520 con 0x7f22c40047c0 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.186+0000 7f22e3400640 1 -- 172.21.15.100:0/4096839720 reap_dead start 2024-01-20T08:10:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e2000640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 0x7f22c4004c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001e50 tx=0x7f22c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33056597828c9bed server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc003b70 con 0x7f22c40047c0 2024-01-20T08:10:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc003cd0 con 0x7f22c40047c0 2024-01-20T08:10:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e1600640 1 -- 172.21.15.100:0/4096839720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc005310 con 0x7f22c40047c0 2024-01-20T08:10:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e9800640 1 -- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 msgr2=0x7f22c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.187+0000 7f22e9800640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 0x7f22c4004c40 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001e50 tx=0x7f22c40057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.188+0000 7f22e9800640 1 -- 172.21.15.100:0/4096839720 shutdown_connections 2024-01-20T08:10:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.188+0000 7f22e9800640 1 --2- 172.21.15.100:0/4096839720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22c40047c0 0x7f22c4004c40 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.188+0000 7f22e9800640 1 -- 172.21.15.100:0/4096839720 >> 172.21.15.100:0/4096839720 conn(0x7f22e40abe30 msgr2=0x7f22e40ac210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.188+0000 7f22e9800640 1 -- 172.21.15.100:0/4096839720 shutdown_connections 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.188+0000 7f22e9800640 1 -- 172.21.15.100:0/4096839720 wait complete. 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.189+0000 7f22e9800640 1 Processor -- start 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.189+0000 7f22e9800640 1 -- start start 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c40047c0 0x7f22e41ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e414fac0 0x7f22e406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e41ee3d0 con 0x7f22e40c8020 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22e414f660 con 0x7f22e414fac0 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e9800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22e41edb30 con 0x7f22c40047c0 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58078/0 (socket says 172.21.15.100:58078) 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.190+0000 7f22e3400640 1 -- 172.21.15.100:0/2744333532 learned_addr learned my addr 172.21.15.100:0/2744333532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e2000640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e414fac0 0x7f22e406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e2a00640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c40047c0 0x7f22e41ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 -- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c40047c0 msgr2=0x7f22e41ed4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c40047c0 0x7f22e41ed4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 -- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e414fac0 msgr2=0x7f22e406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e414fac0 0x7f22e406c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 -- 172.21.15.100:0/2744333532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22e41ede10 con 0x7f22e40c8020 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e3400640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22e408bce0 tx=0x7f22dc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc0074e0 con 0x7f22e40c8020 2024-01-20T08:10:18.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22dc007640 con 0x7f22e40c8020 2024-01-20T08:10:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22e41ee0f0 con 0x7f22e40c8020 2024-01-20T08:10:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.191+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22dc004a20 con 0x7f22e40c8020 2024-01-20T08:10:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.192+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22e406ca30 con 0x7f22e40c8020 2024-01-20T08:10:18.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.193+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22e4067b60 con 0x7f22e40c8020 2024-01-20T08:10:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.193+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f22dc004b80 con 0x7f22e40c8020 2024-01-20T08:10:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.194+0000 7f22daa00640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 0x7f22bc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.194+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22dc088e90 con 0x7f22e40c8020 2024-01-20T08:10:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.195+0000 7f22e2a00640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 0x7f22bc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.195+0000 7f22e2a00640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 0x7f22bc06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009a90 tx=0x7f22d4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.199+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f22dc053df0 con 0x7f22e40c8020 2024-01-20T08:10:18.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.377+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22e41e9f50 con 0x7f22e40c8020 2024-01-20T08:10:18.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.379+0000 7f22daa00640 1 -- 172.21.15.100:0/2744333532 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f22e41e9f50 con 0x7f22e40c8020 2024-01-20T08:10:18.383 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:18.383 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.382+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 msgr2=0x7f22bc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 0x7f22bc06d3c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f22d4009a90 tx=0x7f22d4008040 comp rx=0 tx=0).stop 2024-01-20T08:10:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 msgr2=0x7f22e41ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f22e408bce0 tx=0x7f22dc00c890 comp rx=0 tx=0).stop 2024-01-20T08:10:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 shutdown_connections 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22e40c8020 0x7f22e41ea610 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22e414fac0 0x7f22e406c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22bc06af00 0x7f22bc06d3c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 --2- 172.21.15.100:0/2744333532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22c40047c0 0x7f22e41ed4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 >> 172.21.15.100:0/2744333532 conn(0x7f22e40abe30 msgr2=0x7f22e4155b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 shutdown_connections 2024-01-20T08:10:18.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.383+0000 7f22e9800640 1 -- 172.21.15.100:0/2744333532 wait complete. 2024-01-20T08:10:18.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:18.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:18.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.605+0000 7fc399000640 1 Processor -- start 2024-01-20T08:10:18.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.605+0000 7fc399000640 1 -- start start 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.606+0000 7fc399000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39414b720 0x7fc3941515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.606+0000 7fc399000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3940c1cd0 0x7fc39406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.606+0000 7fc399000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc394154ba0 con 0x7fc3940c1850 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.606+0000 7fc399000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc39414bb00 con 0x7fc3940c1cd0 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.606+0000 7fc399000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc394155a00 con 0x7fc39414b720 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.607+0000 7fc391e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39414b720 0x7fc3941515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.607+0000 7fc392800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3940c1cd0 0x7fc39406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.607+0000 7fc38be00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fc3940c1850 0x7fc39406c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:42508/0 (socket says 172.21.15.100:42508) 2024-01-20T08:10:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.607+0000 7fc392800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3940c1cd0 0x7fc39406cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:53408/0 (socket says 172.21.15.100:53408) 2024-01-20T08:10:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.607+0000 7fc38be00640 1 -- 172.21.15.100:0/870783543 learned_addr learned my addr 172.21.15.100:0/870783543 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.608+0000 7fc392800640 1 -- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39414b720 msgr2=0x7fc3941515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:18.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.608+0000 7fc392800640 1 --2- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39414b720 0x7fc3941515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.608+0000 7fc392800640 1 -- 172.21.15.100:0/870783543 >> v1:172.21.15.110:6789/0 conn(0x7fc3940c1850 legacy=0x7fc39406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.608+0000 7fc392800640 1 -- 172.21.15.100:0/870783543 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc394154df0 con 0x7fc3940c1cd0 2024-01-20T08:10:18.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.609+0000 7fc392800640 1 --2- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1cd0 0x7fc39406cfe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c02be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b25d9d9076b3416b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.609+0000 7fc391400640 1 -- 172.21.15.100:0/870783543 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c02cbc0 con 0x7fc3940c1cd0 2024-01-20T08:10:18.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.609+0000 7fc391400640 1 -- 172.21.15.100:0/870783543 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02cd20 con 0x7fc3940c1cd0 2024-01-20T08:10:18.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.609+0000 7fc391400640 1 -- 172.21.15.100:0/870783543 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c034660 con 0x7fc3940c1cd0 2024-01-20T08:10:18.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 -- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1cd0 msgr2=0x7fc39406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 --2- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1cd0 0x7fc39406cfe0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c02be10 comp rx=0 tx=0).stop 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 -- 172.21.15.100:0/870783543 shutdown_connections 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 --2- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1cd0 0x7fc39406cfe0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 --2- 172.21.15.100:0/870783543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39414b720 0x7fc3941515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 -- 172.21.15.100:0/870783543 >> 172.21.15.100:0/870783543 conn(0x7fc3940c2940 msgr2=0x7fc3940c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 -- 172.21.15.100:0/870783543 shutdown_connections 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.610+0000 7fc399000640 1 -- 172.21.15.100:0/870783543 wait complete. 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.612+0000 7fc399000640 1 Processor -- start 2024-01-20T08:10:18.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.612+0000 7fc399000640 1 -- start start 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1850 0x7fc39414ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 0x7fc39414d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414f420 con 0x7fc39414b720 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39414f950 con 0x7fc3940c1850 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc399000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3940ab330 con 0x7fc3940c1cd0 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58082/0 (socket says 172.21.15.100:58082) 2024-01-20T08:10:18.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 -- 172.21.15.100:0/508025362 learned_addr learned my addr 172.21.15.100:0/508025362 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:18.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc391e00640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1850 0x7fc39414ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc38be00640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 0x7fc39414d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 -- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 msgr2=0x7fc39414d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 0x7fc39414d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 -- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1850 msgr2=0x7fc39414ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1850 0x7fc39414ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc392800640 1 -- 172.21.15.100:0/508025362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc38c009a70 con 0x7fc39414b720 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.613+0000 7fc38be00640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 0x7fc39414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc392800640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c040650 con 0x7fc39414b720 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02ce90 con 0x7fc39414b720 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c040a10 con 0x7fc39414b720 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3940ab610 con 0x7fc39414b720 2024-01-20T08:10:18.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.614+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39414d140 con 0x7fc39414b720 2024-01-20T08:10:18.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.615+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc394066f60 con 0x7fc39414b720 2024-01-20T08:10:18.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.616+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc38c040b70 con 0x7fc39414b720 2024-01-20T08:10:18.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.617+0000 7fc38a000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 0x7fc36c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:18.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.617+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc38c0ac2e0 con 0x7fc39414b720 2024-01-20T08:10:18.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.617+0000 7fc391e00640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 0x7fc36c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:18.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.618+0000 7fc391e00640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 0x7fc36c06d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc384009ad0 tx=0x7fc384008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:18.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.622+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc38c0771a0 con 0x7fc39414b720 2024-01-20T08:10:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.799+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc3940a91c0 con 0x7fc39414b720 2024-01-20T08:10:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.800+0000 7fc38a000640 1 -- 172.21.15.100:0/508025362 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc38c07a7c0 con 0x7fc39414b720 2024-01-20T08:10:18.802 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 msgr2=0x7fc36c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 0x7fc36c06d390 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc384009ad0 tx=0x7fc384008040 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 msgr2=0x7fc39414df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fc38c009d90 tx=0x7fc38c004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 shutdown_connections 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39414b720 0x7fc39414df10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc36c06aed0 0x7fc36c06d390 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3940c1cd0 0x7fc39414d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 --2- 172.21.15.100:0/508025362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3940c1850 0x7fc39414ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 >> 172.21.15.100:0/508025362 conn(0x7fc3940c2940 msgr2=0x7fc3941e0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.802+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 shutdown_connections 2024-01-20T08:10:18.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:18.803+0000 7fc399000640 1 -- 172.21.15.100:0/508025362 wait complete. 2024-01-20T08:10:18.824 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.027+0000 7f9afa600640 1 Processor -- start 2024-01-20T08:10:19.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.027+0000 7f9afa600640 1 -- start start 2024-01-20T08:10:19.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.028+0000 7f9afa600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9af40c7f70 0x7f9af4151c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.028+0000 7f9afa600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af40c6030 0x7f9af4152140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.028+0000 7f9afa600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9af4154b80 con 0x7f9af40c5070 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.028+0000 7f9afa600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af406ad40 con 0x7f9af40c6030 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.028+0000 7f9afa600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9af406c0e0 con 0x7f9af40c7f70 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af40c6030 0x7f9af4152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9af40c6030 0x7f9af4152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53416/0 (socket says 172.21.15.100:53416) 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 -- 172.21.15.100:0/2499107145 learned_addr learned my addr 172.21.15.100:0/2499107145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af3e00640 1 --2- 172.21.15.100:0/2499107145 >> v2:172.21.15.110:3300/0 conn(0x7f9af40c7f70 0x7f9af4151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 -- 172.21.15.100:0/2499107145 >> v2:172.21.15.110:3300/0 conn(0x7f9af40c7f70 msgr2=0x7f9af4151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 --2- 172.21.15.100:0/2499107145 >> v2:172.21.15.110:3300/0 conn(0x7f9af40c7f70 0x7f9af4151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 -- 172.21.15.100:0/2499107145 >> v1:172.21.15.110:6789/0 conn(0x7f9af40c5070 legacy=0x7f9af406b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.029+0000 7f9af9c00640 1 -- 172.21.15.100:0/2499107145 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af40c59c0 con 0x7f9af40c6030 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.030+0000 7f9af9c00640 1 --2- 172.21.15.100:0/2499107145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c6030 0x7f9af4152140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9af40a9b40 tx=0x7f9aec02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b317c9b2f11f4ff server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.030+0000 7f9af3400640 1 -- 172.21.15.100:0/2499107145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec02c9f0 con 0x7f9af40c6030 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.030+0000 7f9af3400640 1 -- 172.21.15.100:0/2499107145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9aec02cb50 con 0x7f9af40c6030 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.030+0000 7f9af3400640 1 -- 172.21.15.100:0/2499107145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aec0343f0 con 0x7f9af40c6030 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 -- 172.21.15.100:0/2499107145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c6030 msgr2=0x7f9af4152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 --2- 172.21.15.100:0/2499107145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c6030 0x7f9af4152140 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9af40a9b40 tx=0x7f9aec02be50 comp rx=0 tx=0).stop 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 -- 172.21.15.100:0/2499107145 shutdown_connections 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 --2- 172.21.15.100:0/2499107145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c6030 0x7f9af4152140 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 --2- 172.21.15.100:0/2499107145 >> v2:172.21.15.110:3300/0 conn(0x7f9af40c7f70 0x7f9af4151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 -- 172.21.15.100:0/2499107145 >> 172.21.15.100:0/2499107145 conn(0x7f9af40ca070 msgr2=0x7f9af40ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 -- 172.21.15.100:0/2499107145 shutdown_connections 2024-01-20T08:10:19.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.031+0000 7f9afa600640 1 -- 172.21.15.100:0/2499107145 wait complete. 2024-01-20T08:10:19.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.033+0000 7f9afa600640 1 Processor -- start 2024-01-20T08:10:19.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.033+0000 7f9afa600640 1 -- start start 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af40c6030 0x7f9af41e9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af40c7f70 0x7f9af41ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af4148440 con 0x7f9af40c5070 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9af40c6d90 con 0x7f9af40c6030 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9afa600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9af41eabc0 con 0x7f9af40c7f70 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53424/0 (socket says 172.21.15.100:53424) 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 -- 172.21.15.100:0/2643162946 learned_addr learned my addr 172.21.15.100:0/2643162946 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 -- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af40c7f70 msgr2=0x7f9af41ea3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af40c7f70 0x7f9af41ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 -- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af40c6030 msgr2=0x7f9af41e9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af40c6030 0x7f9af41e9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.034+0000 7f9af9200640 1 -- 172.21.15.100:0/2643162946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aec009b30 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9af9200640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400c460 tx=0x7f9ae400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4012830 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ae40129d0 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9af40af090 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ae4012d80 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.035+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9af41ea8e0 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.036+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9af404e9e0 con 0x7f9af40c5070 2024-01-20T08:10:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.037+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9ae401a3b0 con 0x7f9af40c5070 2024-01-20T08:10:19.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.038+0000 7f9af0c00640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 0x7f9acc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.038+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ae4089540 con 0x7f9af40c5070 2024-01-20T08:10:19.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.038+0000 7f9af3e00640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 0x7f9acc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.039+0000 7f9af3e00640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 0x7f9acc06d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9adc006fd0 tx=0x7f9adc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.043+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9ae4054400 con 0x7f9af40c5070 2024-01-20T08:10:19.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.236+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9af40c4430 con 0x7f9af40c5070 2024-01-20T08:10:19.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.237+0000 7f9af0c00640 1 -- 172.21.15.100:0/2643162946 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ae4057a20 con 0x7f9af40c5070 2024-01-20T08:10:19.240 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 msgr2=0x7f9acc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 0x7f9acc06d390 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9adc006fd0 tx=0x7f9adc008040 comp rx=0 tx=0).stop 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 msgr2=0x7f9af414dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9ae400c460 tx=0x7f9ae400c920 comp rx=0 tx=0).stop 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 shutdown_connections 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9acc06aed0 0x7f9acc06d390 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9af40c7f70 0x7f9af41ea3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9af40c6030 0x7f9af41e9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 --2- 172.21.15.100:0/2643162946 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9af40c5070 0x7f9af414dc30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 >> 172.21.15.100:0/2643162946 conn(0x7f9af40ca070 msgr2=0x7f9af40ca450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:19.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 shutdown_connections 2024-01-20T08:10:19.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.240+0000 7f9afa600640 1 -- 172.21.15.100:0/2643162946 wait complete. 2024-01-20T08:10:19.260 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:19.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.458+0000 7f812fc00640 1 Processor -- start 2024-01-20T08:10:19.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.458+0000 7f812fc00640 1 -- start start 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812fc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81280c4a50 0x7f81280c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812fc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8128155290 0x7f812806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812fc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81280c9f30 con 0x7f8128151e40 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812fc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f812806c5a0 con 0x7f8128155290 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812fc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81280c87a0 con 0x7f81280c4a50 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8128155290 0x7f812806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8128155290 0x7f812806b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53440/0 (socket says 172.21.15.100:53440) 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f812dc00640 1 -- 172.21.15.100:0/281238294 learned_addr learned my addr 172.21.15.100:0/281238294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.460+0000 7f8127e00640 1 --2- 172.21.15.100:0/281238294 >> v2:172.21.15.110:3300/0 conn(0x7f81280c4a50 0x7f81280c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.461+0000 7f812dc00640 1 -- 172.21.15.100:0/281238294 >> v2:172.21.15.110:3300/0 conn(0x7f81280c4a50 msgr2=0x7f81280c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:19.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.461+0000 7f812dc00640 1 --2- 172.21.15.100:0/281238294 >> v2:172.21.15.110:3300/0 conn(0x7f81280c4a50 0x7f81280c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.461+0000 7f812dc00640 1 -- 172.21.15.100:0/281238294 >> v1:172.21.15.110:6789/0 conn(0x7f8128151e40 legacy=0x7f8128155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.461+0000 7f812dc00640 1 -- 172.21.15.100:0/281238294 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8128156410 con 0x7f8128155290 2024-01-20T08:10:19.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.462+0000 7f812dc00640 1 --2- 172.21.15.100:0/281238294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8128155290 0x7f812806b140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f812808ba90 tx=0x7f812002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77e072e681e9e88 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.462+0000 7f8127400640 1 -- 172.21.15.100:0/281238294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120031870 con 0x7f8128155290 2024-01-20T08:10:19.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.462+0000 7f8127400640 1 -- 172.21.15.100:0/281238294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81200319d0 con 0x7f8128155290 2024-01-20T08:10:19.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.462+0000 7f8127400640 1 -- 172.21.15.100:0/281238294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8120031d60 con 0x7f8128155290 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 -- 172.21.15.100:0/281238294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8128155290 msgr2=0x7f812806b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 --2- 172.21.15.100:0/281238294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8128155290 0x7f812806b140 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f812808ba90 tx=0x7f812002b910 comp rx=0 tx=0).stop 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 -- 172.21.15.100:0/281238294 shutdown_connections 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 --2- 172.21.15.100:0/281238294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8128155290 0x7f812806b140 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 --2- 172.21.15.100:0/281238294 >> v2:172.21.15.110:3300/0 conn(0x7f81280c4a50 0x7f81280c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 -- 172.21.15.100:0/281238294 >> 172.21.15.100:0/281238294 conn(0x7f81280abde0 msgr2=0x7f81280ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 -- 172.21.15.100:0/281238294 shutdown_connections 2024-01-20T08:10:19.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.463+0000 7f812fc00640 1 -- 172.21.15.100:0/281238294 wait complete. 2024-01-20T08:10:19.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.465+0000 7f812fc00640 1 Processor -- start 2024-01-20T08:10:19.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.465+0000 7f812fc00640 1 -- start start 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128151e40 0x7f812814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 0x7f81281485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8128152f90 con 0x7f81280c4a50 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81280a9ea0 con 0x7f8128155290 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812fc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81281531a0 con 0x7f8128151e40 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53446/0 (socket says 172.21.15.100:53446) 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 -- 172.21.15.100:0/3763009887 learned_addr learned my addr 172.21.15.100:0/3763009887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f8127e00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128151e40 0x7f812814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812dc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 0x7f81281485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 -- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128151e40 msgr2=0x7f812814a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128151e40 0x7f812814a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 -- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 msgr2=0x7f81281485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 0x7f81281485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812d200640 1 -- 172.21.15.100:0/3763009887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81200094d0 con 0x7f81280c4a50 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.466+0000 7f812dc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 0x7f81281485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f812d200640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f811000c400 tx=0x7f811000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81100052d0 con 0x7f81280c4a50 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8110005450 con 0x7f81280c4a50 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81280a9b30 con 0x7f81280c4a50 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110007260 con 0x7f81280c4a50 2024-01-20T08:10:19.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.467+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8128153480 con 0x7f81280c4a50 2024-01-20T08:10:19.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.468+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f812804e970 con 0x7f81280c4a50 2024-01-20T08:10:19.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.469+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f81100073c0 con 0x7f81280c4a50 2024-01-20T08:10:19.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.470+0000 7f8124c00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 0x7f810006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.471+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8110088890 con 0x7f81280c4a50 2024-01-20T08:10:19.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.471+0000 7f8127e00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 0x7f810006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.471+0000 7f8127e00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 0x7f810006d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f812814b2f0 tx=0x7f811800b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.475+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8110053760 con 0x7f81280c4a50 2024-01-20T08:10:19.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.665+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81280c9f30 con 0x7f81280c4a50 2024-01-20T08:10:19.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.666+0000 7f8124c00640 1 -- 172.21.15.100:0/3763009887 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81280c9f30 con 0x7f81280c4a50 2024-01-20T08:10:19.669 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 msgr2=0x7f810006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 0x7f810006d390 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f812814b2f0 tx=0x7f811800b040 comp rx=0 tx=0).stop 2024-01-20T08:10:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 msgr2=0x7f81281ea970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f811000c400 tx=0x7f811000c8c0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 shutdown_connections 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8128155290 0x7f81281485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f810006aed0 0x7f810006d390 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8128151e40 0x7f812814a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 --2- 172.21.15.100:0/3763009887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81280c4a50 0x7f81281ea970 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 >> 172.21.15.100:0/3763009887 conn(0x7f81280abde0 msgr2=0x7f81280ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.669+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 shutdown_connections 2024-01-20T08:10:19.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.670+0000 7f812fc00640 1 -- 172.21.15.100:0/3763009887 wait complete. 2024-01-20T08:10:19.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:19.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.893+0000 7f703f200640 1 Processor -- start 2024-01-20T08:10:19.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.893+0000 7f703f200640 1 -- start start 2024-01-20T08:10:19.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.894+0000 7f703f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.894+0000 7f703f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 0x7f70380ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.894+0000 7f703f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70380a9940 con 0x7f70380a93c0 2024-01-20T08:10:19.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.894+0000 7f703f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70381500c0 con 0x7f70380aae00 2024-01-20T08:10:19.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.894+0000 7f703f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7038156810 con 0x7f703814fce0 2024-01-20T08:10:19.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.895+0000 7f7037e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.895+0000 7f7037e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:34958/0 (socket says 172.21.15.100:34958) 2024-01-20T08:10:19.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.895+0000 7f7037e00640 1 -- 172.21.15.100:0/530881993 learned_addr learned my addr 172.21.15.100:0/530881993 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.895+0000 7f7037400640 1 --1- 172.21.15.100:0/530881993 >> v1:172.21.15.110:6789/0 conn(0x7f70380a93c0 0x7f7038152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:53604/0 (socket says 172.21.15.100:53604) 2024-01-20T08:10:19.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.895+0000 7f703d200640 1 --2- 172.21.15.100:0/530881993 >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 0x7f70380ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7036a00640 1 -- 172.21.15.100:0/530881993 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887392092 0 0) 0x7f70380a9940 con 0x7f70380a93c0 2024-01-20T08:10:19.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7036a00640 1 -- 172.21.15.100:0/530881993 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7018003520 con 0x7f70380a93c0 2024-01-20T08:10:19.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7037e00640 1 -- 172.21.15.100:0/530881993 >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 msgr2=0x7f70380ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:19.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7037e00640 1 --2- 172.21.15.100:0/530881993 >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 0x7f70380ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7037e00640 1 -- 172.21.15.100:0/530881993 >> v1:172.21.15.110:6789/0 conn(0x7f70380a93c0 legacy=0x7f7038152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f7037e00640 1 -- 172.21.15.100:0/530881993 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7038156af0 con 0x7f703814fce0 2024-01-20T08:10:19.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.896+0000 7f703d200640 1 --2- 172.21.15.100:0/530881993 >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 0x7f70380ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:19.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.898+0000 7f7037e00640 1 --2- 172.21.15.100:0/530881993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7028009870 tx=0x7f702802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a51808b5057ee11 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.898+0000 7f7036a00640 1 -- 172.21.15.100:0/530881993 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028030840 con 0x7f703814fce0 2024-01-20T08:10:19.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.898+0000 7f7036a00640 1 -- 172.21.15.100:0/530881993 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70280309a0 con 0x7f703814fce0 2024-01-20T08:10:19.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.898+0000 7f7036a00640 1 -- 172.21.15.100:0/530881993 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028030d30 con 0x7f703814fce0 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 -- 172.21.15.100:0/530881993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 msgr2=0x7f7038153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 --2- 172.21.15.100:0/530881993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f7028009870 tx=0x7f702802b980 comp rx=0 tx=0).stop 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 -- 172.21.15.100:0/530881993 shutdown_connections 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 --2- 172.21.15.100:0/530881993 >> v2:172.21.15.110:3300/0 conn(0x7f70380aae00 0x7f70380ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 --2- 172.21.15.100:0/530881993 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f703814fce0 0x7f7038153b80 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 -- 172.21.15.100:0/530881993 >> 172.21.15.100:0/530881993 conn(0x7f703806a5e0 msgr2=0x7f703806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:19.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 -- 172.21.15.100:0/530881993 shutdown_connections 2024-01-20T08:10:19.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.899+0000 7f703f200640 1 -- 172.21.15.100:0/530881993 wait complete. 2024-01-20T08:10:19.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.902+0000 7f703f200640 1 Processor -- start 2024-01-20T08:10:19.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.902+0000 7f703f200640 1 -- start start 2024-01-20T08:10:19.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 0x7f7038150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70380aae00 0x7f70381dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70381dc6d0 con 0x7f703814fce0 2024-01-20T08:10:19.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7038070370 con 0x7f70380aae00 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7038070650 con 0x7f70380a93c0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53454/0 (socket says 172.21.15.100:53454) 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.903+0000 7f703d200640 1 -- 172.21.15.100:0/3988082726 learned_addr learned my addr 172.21.15.100:0/3988082726 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f7037e00640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 0x7f7038150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f7037400640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70380aae00 0x7f70381dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 -- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 msgr2=0x7f7038150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 0x7f7038150c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 -- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70380aae00 msgr2=0x7f70381dbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70380aae00 0x7f70381dbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 -- 172.21.15.100:0/3988082726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7030009a70 con 0x7f703814fce0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f7037e00640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 0x7f7038150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f703d200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f703000efc0 tx=0x7f7030009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.904+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030009d70 con 0x7f703814fce0 2024-01-20T08:10:19.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.905+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f703000f040 con 0x7f703814fce0 2024-01-20T08:10:19.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.905+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280094d0 con 0x7f703814fce0 2024-01-20T08:10:19.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.905+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7030003990 con 0x7f703814fce0 2024-01-20T08:10:19.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.905+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7038151150 con 0x7f703814fce0 2024-01-20T08:10:19.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.906+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f703804e970 con 0x7f703814fce0 2024-01-20T08:10:19.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.907+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7030014480 con 0x7f703814fce0 2024-01-20T08:10:19.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.908+0000 7f702fe00640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 0x7f701006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:19.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.908+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f703008a130 con 0x7f703814fce0 2024-01-20T08:10:19.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.908+0000 7f7037e00640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 0x7f701006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:19.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.909+0000 7f7037e00640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 0x7f701006d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7028036000 tx=0x7f702803b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:19.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:19.912+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7030055090 con 0x7f703814fce0 2024-01-20T08:10:20.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.146+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7038070790 con 0x7f703814fce0 2024-01-20T08:10:20.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.147+0000 7f702fe00640 1 -- 172.21.15.100:0/3988082726 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f70300586b0 con 0x7f703814fce0 2024-01-20T08:10:20.150 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:20.150 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:20.150 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.149+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 msgr2=0x7f701006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.149+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 0x7f701006d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7028036000 tx=0x7f702803b040 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.149+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 msgr2=0x7f70381eda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.149+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f703000efc0 tx=0x7f7030009f90 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.149+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 shutdown_connections 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f703814fce0 0x7f70381eda10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f70380aae00 0x7f70381dbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f701006aed0 0x7f701006d390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 --2- 172.21.15.100:0/3988082726 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f70380a93c0 0x7f7038150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 >> 172.21.15.100:0/3988082726 conn(0x7f703806a5e0 msgr2=0x7f703814db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:20.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 shutdown_connections 2024-01-20T08:10:20.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.150+0000 7f703f200640 1 -- 172.21.15.100:0/3988082726 wait complete. 2024-01-20T08:10:20.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.379+0000 7f4ea0800640 1 Processor -- start 2024-01-20T08:10:20.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.379+0000 7f4ea0800640 1 -- start start 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.380+0000 7f4ea0800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e98147f20 0x7f4e980abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4ea0800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e980c1670 con 0x7f4e98151f60 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4ea0800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e98070800 con 0x7f4e98070370 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4ea0800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e980c2210 con 0x7f4e98147f20 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4e98147f20 0x7f4e980abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9d400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4e98151f60 0x7f4e980c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37454/0 (socket says 172.21.15.100:37454) 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9d400640 1 -- 172.21.15.100:0/570154112 learned_addr learned my addr 172.21.15.100:0/570154112 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:20.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9de00640 1 -- 172.21.15.100:0/570154112 >> v1:172.21.15.110:6789/0 conn(0x7f4e98070370 legacy=0x7f4e980c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9de00640 1 -- 172.21.15.100:0/570154112 >> v1:172.21.15.100:6789/0 conn(0x7f4e98151f60 legacy=0x7f4e980c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9de00640 1 -- 172.21.15.100:0/570154112 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e980c0d40 con 0x7f4e98147f20 2024-01-20T08:10:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.381+0000 7f4e9ca00640 1 -- 172.21.15.100:0/570154112 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016090570 0 0) 0x7f4e980c1670 con 0x7f4e98151f60 2024-01-20T08:10:20.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.383+0000 7f4e9de00640 1 --2- 172.21.15.100:0/570154112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98147f20 0x7f4e980abfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e880097a0 tx=0x7f4e8802dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6679299ba0445f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.383+0000 7f4e9ca00640 1 -- 172.21.15.100:0/570154112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8802f8a0 con 0x7f4e98147f20 2024-01-20T08:10:20.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.383+0000 7f4e9ca00640 1 -- 172.21.15.100:0/570154112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e8802fa00 con 0x7f4e98147f20 2024-01-20T08:10:20.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.383+0000 7f4e9ca00640 1 -- 172.21.15.100:0/570154112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8802fd90 con 0x7f4e98147f20 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 -- 172.21.15.100:0/570154112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98147f20 msgr2=0x7f4e980abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 --2- 172.21.15.100:0/570154112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98147f20 0x7f4e980abfd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4e880097a0 tx=0x7f4e8802dae0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 -- 172.21.15.100:0/570154112 shutdown_connections 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 --2- 172.21.15.100:0/570154112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98147f20 0x7f4e980abfd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 -- 172.21.15.100:0/570154112 >> 172.21.15.100:0/570154112 conn(0x7f4e9806a5e0 msgr2=0x7f4e9806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 -- 172.21.15.100:0/570154112 shutdown_connections 2024-01-20T08:10:20.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.384+0000 7f4ea0800640 1 -- 172.21.15.100:0/570154112 wait complete. 2024-01-20T08:10:20.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.386+0000 7f4ea0800640 1 Processor -- start 2024-01-20T08:10:20.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.386+0000 7f4ea0800640 1 -- start start 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e98147f20 0x7f4e98150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98151f60 0x7f4e9814ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e98149310 con 0x7f4e98070370 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814a360 con 0x7f4e98151f60 2024-01-20T08:10:20.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4ea0800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e9814c4f0 con 0x7f4e98147f20 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53476/0 (socket says 172.21.15.100:53476) 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 -- 172.21.15.100:0/1975918078 learned_addr learned my addr 172.21.15.100:0/1975918078 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 -- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e98147f20 msgr2=0x7f4e98150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e98147f20 0x7f4e98150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 -- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98151f60 msgr2=0x7f4e9814ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98151f60 0x7f4e9814ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.387+0000 7f4e9de00640 1 -- 172.21.15.100:0/1975918078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e88009400 con 0x7f4e98070370 2024-01-20T08:10:20.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4e9de00640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000c00 tx=0x7f4e880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e8803e070 con 0x7f4e98070370 2024-01-20T08:10:20.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e88004030 con 0x7f4e98070370 2024-01-20T08:10:20.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e880041a0 con 0x7f4e98070370 2024-01-20T08:10:20.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e98149030 con 0x7f4e98070370 2024-01-20T08:10:20.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.388+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e9814ca50 con 0x7f4e98070370 2024-01-20T08:10:20.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.389+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9804e970 con 0x7f4e98070370 2024-01-20T08:10:20.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.390+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4e88042070 con 0x7f4e98070370 2024-01-20T08:10:20.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.391+0000 7f4e96000640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 0x7f4e7006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.391+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e880ab730 con 0x7f4e98070370 2024-01-20T08:10:20.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.391+0000 7f4e9d400640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 0x7f4e7006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.392+0000 7f4e9d400640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 0x7f4e7006d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80007960 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.395+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4e88076680 con 0x7f4e98070370 2024-01-20T08:10:20.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.589+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e980c38d0 con 0x7f4e98070370 2024-01-20T08:10:20.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.592+0000 7f4e96000640 1 -- 172.21.15.100:0/1975918078 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f4e88079ca0 con 0x7f4e98070370 2024-01-20T08:10:20.595 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:20.595 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.594+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 msgr2=0x7f4e7006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.594+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 0x7f4e7006d3c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4e80007fd0 tx=0x7f4e80007960 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.594+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 msgr2=0x7f4e981449a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.594+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e88000c00 tx=0x7f4e880046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 shutdown_connections 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4e98151f60 0x7f4e9814ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4e7006af00 0x7f4e7006d3c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4e98147f20 0x7f4e98150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 --2- 172.21.15.100:0/1975918078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e98070370 0x7f4e981449a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 >> 172.21.15.100:0/1975918078 conn(0x7f4e9806a5e0 msgr2=0x7f4e98146e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:20.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 shutdown_connections 2024-01-20T08:10:20.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.595+0000 7f4ea0800640 1 -- 172.21.15.100:0/1975918078 wait complete. 2024-01-20T08:10:20.617 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:20.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:20.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.827+0000 7f02e8000640 1 Processor -- start 2024-01-20T08:10:20.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.827+0000 7f02e8000640 1 -- start start 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.829+0000 7f02e8000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 0x7f02e00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.829+0000 7f02e8000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02e01532f0 0x7f02e015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.829+0000 7f02e8000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e0150190 con 0x7f02e00c1d90 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.829+0000 7f02e8000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e00a9ce0 con 0x7f02e01532f0 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.829+0000 7f02e8000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e00a93b0 con 0x7f02e014fdb0 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02e01532f0 0x7f02e015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f02e01532f0 0x7f02e015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53482/0 (socket says 172.21.15.100:53482) 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 -- 172.21.15.100:0/1095515073 learned_addr learned my addr 172.21.15.100:0/1095515073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:20.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e5600640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 0x7f02e00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 -- 172.21.15.100:0/1095515073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 msgr2=0x7f02e00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 0x7f02e00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 -- 172.21.15.100:0/1095515073 >> v1:172.21.15.110:6789/0 conn(0x7f02e00c1d90 legacy=0x7f02e0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e6000640 1 -- 172.21.15.100:0/1095515073 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e00a8810 con 0x7f02e01532f0 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.830+0000 7f02e5600640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 0x7f02e00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:20.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.831+0000 7f02e6000640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e015cfc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009e50 tx=0x7f02d802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950b6f0a6f22dcf6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02dfe00640 1 -- 172.21.15.100:0/1095515073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d802ca80 con 0x7f02e01532f0 2024-01-20T08:10:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02dfe00640 1 -- 172.21.15.100:0/1095515073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d802cbe0 con 0x7f02e01532f0 2024-01-20T08:10:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02dfe00640 1 -- 172.21.15.100:0/1095515073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80343f0 con 0x7f02e01532f0 2024-01-20T08:10:20.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 -- 172.21.15.100:0/1095515073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 msgr2=0x7f02e015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e015cfc0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009e50 tx=0x7f02d802bee0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 -- 172.21.15.100:0/1095515073 shutdown_connections 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e015cfc0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 --2- 172.21.15.100:0/1095515073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e014fdb0 0x7f02e00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.832+0000 7f02e8000640 1 -- 172.21.15.100:0/1095515073 >> 172.21.15.100:0/1095515073 conn(0x7f02e00c2940 msgr2=0x7f02e00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.833+0000 7f02e8000640 1 -- 172.21.15.100:0/1095515073 shutdown_connections 2024-01-20T08:10:20.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.833+0000 7f02e8000640 1 -- 172.21.15.100:0/1095515073 wait complete. 2024-01-20T08:10:20.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.834+0000 7f02e8000640 1 Processor -- start 2024-01-20T08:10:20.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.834+0000 7f02e8000640 1 -- start start 2024-01-20T08:10:20.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 0x7f02e006d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02e014fdb0 0x7f02e01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01ea250 con 0x7f02e01532f0 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01416a0 con 0x7f02e014fdb0 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e8000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e01418f0 con 0x7f02e00c1d90 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.835+0000 7f02e6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53498/0 (socket says 172.21.15.100:53498) 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 -- 172.21.15.100:0/3841842820 learned_addr learned my addr 172.21.15.100:0/3841842820 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e5600640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 0x7f02e006d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e4c00640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02e014fdb0 0x7f02e01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 -- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 msgr2=0x7f02e006d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 0x7f02e006d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 -- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02e014fdb0 msgr2=0x7f02e01551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02e014fdb0 0x7f02e01551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:20.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 -- 172.21.15.100:0/3841842820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d8009b30 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e5600640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 0x7f02e006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.836+0000 7f02e6000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02d8036040 tx=0x7f02d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.837+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8040670 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.837+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d80407f0 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.837+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8040ba0 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.837+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e014a050 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.837+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e0152050 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.838+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e0152570 con 0x7f02e01532f0 2024-01-20T08:10:20.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.839+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f02d802cd50 con 0x7f02e01532f0 2024-01-20T08:10:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.840+0000 7f02dd600640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 0x7f02b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.840+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02d80ac7b0 con 0x7f02e01532f0 2024-01-20T08:10:20.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.840+0000 7f02e5600640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 0x7f02b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:20.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.841+0000 7f02e5600640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 0x7f02b806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02d000aa30 tx=0x7f02d0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:20.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:20.844+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f02d80775e0 con 0x7f02e01532f0 2024-01-20T08:10:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.040+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02e004e970 con 0x7f02e01532f0 2024-01-20T08:10:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.040+0000 7f02dd600640 1 -- 172.21.15.100:0/3841842820 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02d8009510 con 0x7f02e01532f0 2024-01-20T08:10:21.044 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:21.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 msgr2=0x7f02b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 0x7f02b806d390 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f02d000aa30 tx=0x7f02d0008040 comp rx=0 tx=0).stop 2024-01-20T08:10:21.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 msgr2=0x7f02e0155710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f02d8036040 tx=0x7f02d8004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 shutdown_connections 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f02e01532f0 0x7f02e0155710 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f02e014fdb0 0x7f02e01551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f02b806aed0 0x7f02b806d390 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 --2- 172.21.15.100:0/3841842820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f02e00c1d90 0x7f02e006d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 >> 172.21.15.100:0/3841842820 conn(0x7f02e00c2940 msgr2=0x7f02e00bf400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:21.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 shutdown_connections 2024-01-20T08:10:21.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.043+0000 7f02e8000640 1 -- 172.21.15.100:0/3841842820 wait complete. 2024-01-20T08:10:21.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:21.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.260+0000 7f5bed400640 1 Processor -- start 2024-01-20T08:10:21.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.260+0000 7f5bed400640 1 -- start start 2024-01-20T08:10:21.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5bed400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5be814c750 0x7f5be8153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5bed400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be80ab620 con 0x7f5be80715a0 2024-01-20T08:10:21.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5bed400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be80ab900 con 0x7f5be80ab0b0 2024-01-20T08:10:21.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5bed400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be814cb30 con 0x7f5be814c750 2024-01-20T08:10:21.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5be6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5be814c750 0x7f5be8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5be7200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5be80715a0 0x7f5be8071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37456/0 (socket says 172.21.15.100:37456) 2024-01-20T08:10:21.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.262+0000 7f5be7200640 1 -- 172.21.15.100:0/2952213385 learned_addr learned my addr 172.21.15.100:0/2952213385 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.263+0000 7f5be5400640 1 -- 172.21.15.100:0/2952213385 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573074724 0 0) 0x7f5be80ab620 con 0x7f5be80715a0 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.263+0000 7f5be5400640 1 -- 172.21.15.100:0/2952213385 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc8003520 con 0x7f5be80715a0 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.263+0000 7f5be6800640 1 -- 172.21.15.100:0/2952213385 >> v1:172.21.15.110:6789/0 conn(0x7f5be80ab0b0 legacy=0x7f5be80a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.263+0000 7f5be6800640 1 -- 172.21.15.100:0/2952213385 >> v1:172.21.15.100:6789/0 conn(0x7f5be80715a0 legacy=0x7f5be8071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.263+0000 7f5be6800640 1 -- 172.21.15.100:0/2952213385 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be80abbe0 con 0x7f5be814c750 2024-01-20T08:10:21.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.264+0000 7f5be6800640 1 --2- 172.21.15.100:0/2952213385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be814c750 0x7f5be8153190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80097a0 tx=0x7f5bd802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62578a90b937ac63 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5be5400640 1 -- 172.21.15.100:0/2952213385 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8030610 con 0x7f5be814c750 2024-01-20T08:10:21.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5be5400640 1 -- 172.21.15.100:0/2952213385 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8030770 con 0x7f5be814c750 2024-01-20T08:10:21.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5be5400640 1 -- 172.21.15.100:0/2952213385 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8030b00 con 0x7f5be814c750 2024-01-20T08:10:21.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5bed400640 1 -- 172.21.15.100:0/2952213385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be814c750 msgr2=0x7f5be8153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5bed400640 1 --2- 172.21.15.100:0/2952213385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be814c750 0x7f5be8153190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80097a0 tx=0x7f5bd802b960 comp rx=0 tx=0).stop 2024-01-20T08:10:21.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5bed400640 1 -- 172.21.15.100:0/2952213385 shutdown_connections 2024-01-20T08:10:21.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5bed400640 1 --2- 172.21.15.100:0/2952213385 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be814c750 0x7f5be8153190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.265+0000 7f5bed400640 1 -- 172.21.15.100:0/2952213385 >> 172.21.15.100:0/2952213385 conn(0x7f5be80c6090 msgr2=0x7f5be80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:21.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.266+0000 7f5bed400640 1 -- 172.21.15.100:0/2952213385 shutdown_connections 2024-01-20T08:10:21.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.266+0000 7f5bed400640 1 -- 172.21.15.100:0/2952213385 wait complete. 2024-01-20T08:10:21.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.267+0000 7f5bed400640 1 Processor -- start 2024-01-20T08:10:21.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.268+0000 7f5bed400640 1 -- start start 2024-01-20T08:10:21.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.268+0000 7f5bed400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.268+0000 7f5bed400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 0x7f5be81ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.268+0000 7f5bed400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5be814c750 0x7f5be81ec130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5bed400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be81ec730 con 0x7f5be80715a0 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5bed400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be8154970 con 0x7f5be80ab0b0 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5bed400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be814d3d0 con 0x7f5be814c750 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53514/0 (socket says 172.21.15.100:53514) 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 -- 172.21.15.100:0/3494674966 learned_addr learned my addr 172.21.15.100:0/3494674966 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be5e00640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 0x7f5be81ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 -- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5be814c750 msgr2=0x7f5be81ec130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5be814c750 0x7f5be81ec130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 -- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 msgr2=0x7f5be81ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 0x7f5be81ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 -- 172.21.15.100:0/3494674966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8009400 con 0x7f5be80715a0 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be5e00640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 0x7f5be81ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.269+0000 7f5be6800640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5bd802bf70 tx=0x7f5bd8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.270+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd803e040 con 0x7f5be80715a0 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.270+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd8039cb0 con 0x7f5be80715a0 2024-01-20T08:10:21.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.270+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8044630 con 0x7f5be80715a0 2024-01-20T08:10:21.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.270+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be814ce10 con 0x7f5be80715a0 2024-01-20T08:10:21.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.270+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be8154b60 con 0x7f5be80715a0 2024-01-20T08:10:21.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.271+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be804ea50 con 0x7f5be80715a0 2024-01-20T08:10:21.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.272+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5bd804d3b0 con 0x7f5be80715a0 2024-01-20T08:10:21.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.273+0000 7f5bdea00640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 0x7f5bc006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.273+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bd80abb30 con 0x7f5be80715a0 2024-01-20T08:10:21.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.273+0000 7f5be5e00640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 0x7f5bc006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.274+0000 7f5be5e00640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 0x7f5bc006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5be8155cc0 tx=0x7f5bd0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.277+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5bd8076960 con 0x7f5be80715a0 2024-01-20T08:10:21.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.463+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5be80702b0 con 0x7f5be80715a0 2024-01-20T08:10:21.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.464+0000 7f5bdea00640 1 -- 172.21.15.100:0/3494674966 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5bd8079f80 con 0x7f5be80715a0 2024-01-20T08:10:21.467 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 msgr2=0x7f5bc006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 0x7f5bc006d390 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5be8155cc0 tx=0x7f5bd0009040 comp rx=0 tx=0).stop 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 msgr2=0x7f5be8155080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5bd802bf70 tx=0x7f5bd8004730 comp rx=0 tx=0).stop 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 shutdown_connections 2024-01-20T08:10:21.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5bc006aed0 0x7f5bc006d390 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5be814c750 0x7f5be81ec130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5be80ab0b0 0x7f5be81ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 --2- 172.21.15.100:0/3494674966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5be80715a0 0x7f5be8155080 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 >> 172.21.15.100:0/3494674966 conn(0x7f5be80c6090 msgr2=0x7f5be8071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 shutdown_connections 2024-01-20T08:10:21.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.467+0000 7f5bed400640 1 -- 172.21.15.100:0/3494674966 wait complete. 2024-01-20T08:10:21.488 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.683+0000 7feb9fa00640 1 Processor -- start 2024-01-20T08:10:21.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.683+0000 7feb9fa00640 1 -- start start 2024-01-20T08:10:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb980c24f0 0x7feb98157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9fa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb98071d00 con 0x7feb98158af0 2024-01-20T08:10:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9fa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb98071fa0 con 0x7feb981550c0 2024-01-20T08:10:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb98154ca0 con 0x7feb980c24f0 2024-01-20T08:10:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9d000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7feb98158af0 0x7feb9806e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37464/0 (socket says 172.21.15.100:37464) 2024-01-20T08:10:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb9d000640 1 -- 172.21.15.100:0/2998316375 learned_addr learned my addr 172.21.15.100:0/2998316375 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:21.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.685+0000 7feb97e00640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb980c24f0 0x7feb98157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 521821758 0 0) 0x7feb98071d00 con 0x7feb98158af0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb78003520 con 0x7feb98158af0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3806676945 0 0) 0x7feb98071fa0 con 0x7feb981550c0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb98071d00 con 0x7feb981550c0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2668362300 0 0) 0x7feb78003520 con 0x7feb98158af0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb980c24f0 msgr2=0x7feb98157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb980c24f0 0x7feb98157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 >> v1:172.21.15.110:6789/0 conn(0x7feb981550c0 legacy=0x7feb980c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb98072280 con 0x7feb98158af0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7feb88001670 con 0x7feb98158af0 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 >> v1:172.21.15.100:6789/0 conn(0x7feb98158af0 legacy=0x7feb9806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.686+0000 7feb97400640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb78004f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97400640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb78003760 0x7feb78003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97400640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb78004120 0x7feb7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98154ca0 con 0x7feb78004b90 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800c0b0 con 0x7feb78004120 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb7800c270 con 0x7feb78003760 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb97e00640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb980c24f0 0x7feb98157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb78004f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9da00640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb78004120 0x7feb7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 -- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb78003760 msgr2=0x7feb78003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb78003760 0x7feb78003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 -- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb78004120 msgr2=0x7feb7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb78004120 0x7feb7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9d000640 1 -- 172.21.15.100:0/2998316375 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb78003520 con 0x7feb78004b90 2024-01-20T08:10:21.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.687+0000 7feb9da00640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb78004120 0x7feb7800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:21.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.688+0000 7feb9d000640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb78004f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c190 tx=0x7feb780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e258f968f5ca0e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88005ad0 con 0x7feb78004b90 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb88005c30 con 0x7feb78004b90 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb97400640 1 -- 172.21.15.100:0/2998316375 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8802c850 con 0x7feb78004b90 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb9fa00640 1 -- 172.21.15.100:0/2998316375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 msgr2=0x7feb78004f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb9fa00640 1 --2- 172.21.15.100:0/2998316375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb78004f90 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c190 tx=0x7feb780057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb9da00640 1 -- 172.21.15.100:0/2998316375 reap_dead start 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb9fa00640 1 -- 172.21.15.100:0/2998316375 shutdown_connections 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.689+0000 7feb9fa00640 1 -- 172.21.15.100:0/2998316375 >> 172.21.15.100:0/2998316375 conn(0x7feb980c2940 msgr2=0x7feb980c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.690+0000 7feb9fa00640 1 -- 172.21.15.100:0/2998316375 shutdown_connections 2024-01-20T08:10:21.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.690+0000 7feb9fa00640 1 -- 172.21.15.100:0/2998316375 wait complete. 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.691+0000 7feb9fa00640 1 Processor -- start 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.691+0000 7feb9fa00640 1 -- start start 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb98151960 0x7feb98156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb981edb40 0x7feb981edfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb980a8de0 con 0x7feb78004b90 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981576e0 con 0x7feb98151960 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb980a8640 con 0x7feb981edb40 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.692+0000 7feb9d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53530/0 (socket says 172.21.15.100:53530) 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 -- 172.21.15.100:0/660787393 learned_addr learned my addr 172.21.15.100:0/660787393 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:21.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb97e00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb98151960 0x7feb98156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 -- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb981edb40 msgr2=0x7feb981edfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb981edb40 0x7feb981edfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 -- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb98151960 msgr2=0x7feb98156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb98151960 0x7feb98156e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 -- 172.21.15.100:0/660787393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb980a9050 con 0x7feb78004b90 2024-01-20T08:10:21.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb9d000640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c190 tx=0x7feb98071e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.693+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88039030 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.694+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8802cc60 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.694+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8803c040 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.694+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb98157380 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.694+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb980a9330 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.695+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb9804e970 con 0x7feb78004b90 2024-01-20T08:10:21.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.696+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feb88032070 con 0x7feb78004b90 2024-01-20T08:10:21.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.697+0000 7feb94c00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 0x7feb7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:21.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.697+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb880aa830 con 0x7feb78004b90 2024-01-20T08:10:21.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.697+0000 7feb97e00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 0x7feb7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:21.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.697+0000 7feb97e00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 0x7feb7006d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb9806be40 tx=0x7feb80008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:21.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.701+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feb88075790 con 0x7feb78004b90 2024-01-20T08:10:21.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.879+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb98074480 con 0x7feb78004b90 2024-01-20T08:10:21.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.879+0000 7feb94c00640 1 -- 172.21.15.100:0/660787393 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb88078db0 con 0x7feb78004b90 2024-01-20T08:10:21.882 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 msgr2=0x7feb7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 0x7feb7006d390 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feb9806be40 tx=0x7feb80008040 comp rx=0 tx=0).stop 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 msgr2=0x7feb9814b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7feb8800c190 tx=0x7feb98071e90 comp rx=0 tx=0).stop 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 shutdown_connections 2024-01-20T08:10:21.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb7006aed0 0x7feb7006d390 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb981edb40 0x7feb981edfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb98151960 0x7feb98156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 --2- 172.21.15.100:0/660787393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb78004b90 0x7feb9814b030 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 >> 172.21.15.100:0/660787393 conn(0x7feb980c2940 msgr2=0x7feb98153240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 shutdown_connections 2024-01-20T08:10:21.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:21.882+0000 7feb9fa00640 1 -- 172.21.15.100:0/660787393 wait complete. 2024-01-20T08:10:21.903 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:22.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.102+0000 7f8423200640 1 Processor -- start 2024-01-20T08:10:22.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.102+0000 7f8423200640 1 -- start start 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8423200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8423200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f841c0c7e30 0x7f841c154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8423200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f841c158560 con 0x7f841c071d10 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8423200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f841c0c5640 con 0x7f841c0c7e30 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8423200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c0c50a0 con 0x7f841c0bd5c0 2024-01-20T08:10:22.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f841c0c7e30 0x7f841c154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f841c0c7e30 0x7f841c154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53538/0 (socket says 172.21.15.100:53538) 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 -- 172.21.15.100:0/1942309813 learned_addr learned my addr 172.21.15.100:0/1942309813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8421400640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 -- 172.21.15.100:0/1942309813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 msgr2=0x7f841c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c0720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 -- 172.21.15.100:0/1942309813 >> v1:172.21.15.110:6789/0 conn(0x7f841c071d10 legacy=0x7f841c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:22.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.104+0000 7f8422800640 1 -- 172.21.15.100:0/1942309813 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f841c06cb90 con 0x7f841c0c7e30 2024-01-20T08:10:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8422800640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c154e30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8414009e50 tx=0x7f841402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216641bf7b34a56a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8420a00640 1 -- 172.21.15.100:0/1942309813 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841402c950 con 0x7f841c0c7e30 2024-01-20T08:10:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8420a00640 1 -- 172.21.15.100:0/1942309813 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841402cab0 con 0x7f841c0c7e30 2024-01-20T08:10:22.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8420a00640 1 -- 172.21.15.100:0/1942309813 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841402ce40 con 0x7f841c0c7e30 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8423200640 1 -- 172.21.15.100:0/1942309813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 msgr2=0x7f841c154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.106+0000 7f8423200640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c154e30 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8414009e50 tx=0x7f841402bdb0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 -- 172.21.15.100:0/1942309813 shutdown_connections 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c154e30 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 --2- 172.21.15.100:0/1942309813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c0720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 -- 172.21.15.100:0/1942309813 >> 172.21.15.100:0/1942309813 conn(0x7f841c0c9f30 msgr2=0x7f841c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 -- 172.21.15.100:0/1942309813 shutdown_connections 2024-01-20T08:10:22.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.107+0000 7f8423200640 1 -- 172.21.15.100:0/1942309813 wait complete. 2024-01-20T08:10:22.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.108+0000 7f8423200640 1 Processor -- start 2024-01-20T08:10:22.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.108+0000 7f8423200640 1 -- start start 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 0x7f841c1eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c1eaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c149210 con 0x7f841c0c7e30 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1ee0b0 con 0x7f841c071d10 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.109+0000 7f8423200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f841c1ee5e0 con 0x7f841c0bd5c0 2024-01-20T08:10:22.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53544/0 (socket says 172.21.15.100:53544) 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 -- 172.21.15.100:0/1118426243 learned_addr learned my addr 172.21.15.100:0/1118426243 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8421e00640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 0x7f841c1eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8421400640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c1eaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 -- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 msgr2=0x7f841c1eaad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c1eaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 -- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 msgr2=0x7f841c1eb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 0x7f841c1eb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 -- 172.21.15.100:0/1118426243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8414009b30 con 0x7f841c0c7e30 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8421e00640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 0x7f841c1eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:22.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.110+0000 7f8422800640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8414009f70 tx=0x7f8414004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.111+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8414009510 con 0x7f841c0c7e30 2024-01-20T08:10:22.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.111+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841403e450 con 0x7f841c0c7e30 2024-01-20T08:10:22.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.111+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f841c1ea640 con 0x7f841c0c7e30 2024-01-20T08:10:22.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.111+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841403e800 con 0x7f841c0c7e30 2024-01-20T08:10:22.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.111+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f841c1ebae0 con 0x7f841c0c7e30 2024-01-20T08:10:22.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.112+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f841c1ea130 con 0x7f841c0c7e30 2024-01-20T08:10:22.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.113+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f841403e960 con 0x7f841c0c7e30 2024-01-20T08:10:22.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.114+0000 7f841a000640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.114+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84140ac460 con 0x7f841c0c7e30 2024-01-20T08:10:22.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.114+0000 7f8421e00640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.114+0000 7f8421e00640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 0x7f83f406d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f841c145e10 tx=0x7f840c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.118+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f841c1ea130 con 0x7f841c0c7e30 2024-01-20T08:10:22.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.346+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f841c1ea130 con 0x7f841c0c7e30 2024-01-20T08:10:22.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.347+0000 7f841a000640 1 -- 172.21.15.100:0/1118426243 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f841c1ea130 con 0x7f841c0c7e30 2024-01-20T08:10:22.350 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:22.351 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:22.351 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 msgr2=0x7f83f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 0x7f83f406d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f841c145e10 tx=0x7f840c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 msgr2=0x7f841c156f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8414009f70 tx=0x7f8414004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 shutdown_connections 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f841c0c7e30 0x7f841c156f90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f83f406aed0 0x7f83f406d390 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f841c0bd5c0 0x7f841c1eaad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 --2- 172.21.15.100:0/1118426243 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f841c071d10 0x7f841c1eb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 >> 172.21.15.100:0/1118426243 conn(0x7f841c0c9f30 msgr2=0x7f841c0720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 shutdown_connections 2024-01-20T08:10:22.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.350+0000 7f8423200640 1 -- 172.21.15.100:0/1118426243 wait complete. 2024-01-20T08:10:22.371 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.575+0000 7f1a53e00640 1 Processor -- start 2024-01-20T08:10:22.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.575+0000 7f1a53e00640 1 -- start start 2024-01-20T08:10:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.576+0000 7f1a53e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a54155230 0x7f1a54072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.576+0000 7f1a53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a540a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.576+0000 7f1a53e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a540c0490 con 0x7f1a540bfc30 2024-01-20T08:10:22.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.576+0000 7f1a53e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a540c2100 con 0x7f1a54155230 2024-01-20T08:10:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.576+0000 7f1a53e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a540c1260 con 0x7f1a540c0920 2024-01-20T08:10:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1a54155230 0x7f1a54072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a49e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1a540bfc30 0x7f1a540c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37466/0 (socket says 172.21.15.100:37466) 2024-01-20T08:10:22.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a49e00640 1 -- 172.21.15.100:0/916432319 learned_addr learned my addr 172.21.15.100:0/916432319 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a53400640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a540a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52a00640 1 -- 172.21.15.100:0/916432319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 msgr2=0x7f1a540a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52a00640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a540a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52a00640 1 -- 172.21.15.100:0/916432319 >> v1:172.21.15.100:6789/0 conn(0x7f1a540bfc30 legacy=0x7f1a540c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52a00640 1 -- 172.21.15.100:0/916432319 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a540c1540 con 0x7f1a54155230 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a53400640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a540a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.577+0000 7f1a52000640 1 -- 172.21.15.100:0/916432319 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759030373 0 0) 0x7f1a540c0490 con 0x7f1a540bfc30 2024-01-20T08:10:22.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.578+0000 7f1a52a00640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a54072250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4843f6beaaea1f4a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a52000640 1 -- 172.21.15.100:0/916432319 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44031780 con 0x7f1a54155230 2024-01-20T08:10:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a52000640 1 -- 172.21.15.100:0/916432319 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a440318e0 con 0x7f1a54155230 2024-01-20T08:10:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a52000640 1 -- 172.21.15.100:0/916432319 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a44031c70 con 0x7f1a54155230 2024-01-20T08:10:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 -- 172.21.15.100:0/916432319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 msgr2=0x7f1a54072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a54072250 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a440097a0 tx=0x7f1a4402b820 comp rx=0 tx=0).stop 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 -- 172.21.15.100:0/916432319 shutdown_connections 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a540a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 --2- 172.21.15.100:0/916432319 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a54072250 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 -- 172.21.15.100:0/916432319 >> 172.21.15.100:0/916432319 conn(0x7f1a540c2590 msgr2=0x7f1a540c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 -- 172.21.15.100:0/916432319 shutdown_connections 2024-01-20T08:10:22.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.579+0000 7f1a53e00640 1 -- 172.21.15.100:0/916432319 wait complete. 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.581+0000 7f1a53e00640 1 Processor -- start 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.581+0000 7f1a53e00640 1 -- start start 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a540bfc30 0x7f1a541edb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a541ee090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a541ee690 con 0x7f1a54155230 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54155e20 con 0x7f1a540bfc30 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a54156100 con 0x7f1a540c0920 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53568/0 (socket says 172.21.15.100:53568) 2024-01-20T08:10:22.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 -- 172.21.15.100:0/3962251824 learned_addr learned my addr 172.21.15.100:0/3962251824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 -- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 msgr2=0x7f1a541ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a541ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 -- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a540bfc30 msgr2=0x7f1a541edb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a540bfc30 0x7f1a541edb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.582+0000 7f1a53400640 1 -- 172.21.15.100:0/3962251824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a44009400 con 0x7f1a54155230 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a53400640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00cef0 tx=0x7f1a4c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00d840 con 0x7f1a54155230 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c00d9c0 con 0x7f1a54155230 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c00dd70 con 0x7f1a54155230 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a541563e0 con 0x7f1a54155230 2024-01-20T08:10:22.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.583+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a540a8930 con 0x7f1a54155230 2024-01-20T08:10:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.584+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a541565d0 con 0x7f1a54155230 2024-01-20T08:10:22.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.585+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1a4c01e3b0 con 0x7f1a54155230 2024-01-20T08:10:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.586+0000 7f1a4b400640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.586+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1a4c08a0e0 con 0x7f1a54155230 2024-01-20T08:10:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.586+0000 7f1a52a00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:22.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.587+0000 7f1a52a00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 0x7f1a2c06d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a44036000 tx=0x7f1a44030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:22.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.590+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1a4c055070 con 0x7f1a54155230 2024-01-20T08:10:22.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.780+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a540679a0 con 0x7f1a54155230 2024-01-20T08:10:22.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.782+0000 7f1a4b400640 1 -- 172.21.15.100:0/3962251824 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f1a4c058690 con 0x7f1a54155230 2024-01-20T08:10:22.785 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 msgr2=0x7f1a2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 0x7f1a2c06d390 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a44036000 tx=0x7f1a44030000 comp rx=0 tx=0).stop 2024-01-20T08:10:22.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 msgr2=0x7f1a540aa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00cef0 tx=0x7f1a4c00a710 comp rx=0 tx=0).stop 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 shutdown_connections 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a54155230 0x7f1a540aa440 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1a2c06aed0 0x7f1a2c06d390 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1a540c0920 0x7f1a541ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 --2- 172.21.15.100:0/3962251824 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1a540bfc30 0x7f1a541edb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 >> 172.21.15.100:0/3962251824 conn(0x7f1a540c2590 msgr2=0x7f1a540c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 shutdown_connections 2024-01-20T08:10:22.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:22.785+0000 7f1a53e00640 1 -- 172.21.15.100:0/3962251824 wait complete. 2024-01-20T08:10:22.806 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:23.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.004+0000 7fd666c00640 1 Processor -- start 2024-01-20T08:10:23.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.004+0000 7fd666c00640 1 -- start start 2024-01-20T08:10:23.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.005+0000 7fd666c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 0x7fd660151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.005+0000 7fd666c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6601521e0 0x7fd660157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.005+0000 7fd666c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6600c0fb0 con 0x7fd660071220 2024-01-20T08:10:23.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.005+0000 7fd666c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6600c04a0 con 0x7fd6601521e0 2024-01-20T08:10:23.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.005+0000 7fd666c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd660071d10 con 0x7fd6600bfae0 2024-01-20T08:10:23.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd660071220 0x7fd660071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37472/0 (socket says 172.21.15.100:37472) 2024-01-20T08:10:23.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65fe00640 1 -- 172.21.15.100:0/555659463 learned_addr learned my addr 172.21.15.100:0/555659463 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3472259758 0 0) 0x7fd6600c0fb0 con 0x7fd660071220 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd640003520 con 0x7fd660071220 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65f400640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 0x7fd660151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd664c00640 1 --2- 172.21.15.100:0/555659463 >> v2:172.21.15.110:3300/0 conn(0x7fd6601521e0 0x7fd660157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3387257654 0 0) 0x7fd640003520 con 0x7fd660071220 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 msgr2=0x7fd660151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 0x7fd660151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 >> v2:172.21.15.110:3300/0 conn(0x7fd6601521e0 msgr2=0x7fd660157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 --2- 172.21.15.100:0/555659463 >> v2:172.21.15.110:3300/0 conn(0x7fd6601521e0 0x7fd660157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd66006def0 con 0x7fd660071220 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd664c00640 1 --2- 172.21.15.100:0/555659463 >> v2:172.21.15.110:3300/0 conn(0x7fd6601521e0 0x7fd660157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.006+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fd650001670 con 0x7fd660071220 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 >> v1:172.21.15.100:6789/0 conn(0x7fd660071220 legacy=0x7fd660071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640003970 0x7fd640003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 0x7fd6400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd640004d00 0x7fd640005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6600c04a0 con 0x7fd640003970 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64000bb40 con 0x7fd640004d00 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd64000bd00 con 0x7fd6600bfae0 2024-01-20T08:10:23.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640003970 0x7fd640003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd664c00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd640004d00 0x7fd640005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 -- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 msgr2=0x7fd6400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6600bfae0 0x7fd6400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 -- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd640004d00 msgr2=0x7fd640005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd640004d00 0x7fd640005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.007+0000 7fd65fe00640 1 -- 172.21.15.100:0/555659463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd640003520 con 0x7fd640003970 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.008+0000 7fd65fe00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640003970 0x7fd640003d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c0e0 tx=0x7fd6400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4a4617b9595a4b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.008+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd650005ad0 con 0x7fd640003970 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.008+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd650005c50 con 0x7fd640003970 2024-01-20T08:10:23.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.008+0000 7fd65ea00640 1 -- 172.21.15.100:0/555659463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65002c810 con 0x7fd640003970 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 -- 172.21.15.100:0/555659463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640003970 msgr2=0x7fd640003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 --2- 172.21.15.100:0/555659463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd640003970 0x7fd640003d90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd65000c0e0 tx=0x7fd6400057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd664c00640 1 -- 172.21.15.100:0/555659463 reap_dead start 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 -- 172.21.15.100:0/555659463 shutdown_connections 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 -- 172.21.15.100:0/555659463 >> 172.21.15.100:0/555659463 conn(0x7fd66006a5e0 msgr2=0x7fd66006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 -- 172.21.15.100:0/555659463 shutdown_connections 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.009+0000 7fd666c00640 1 -- 172.21.15.100:0/555659463 wait complete. 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.011+0000 7fd666c00640 1 Processor -- start 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.011+0000 7fd666c00640 1 -- start start 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd640003970 0x7fd66014de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd660142f30 0x7fd6601ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601ea9f0 con 0x7fd6601514c0 2024-01-20T08:10:23.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd660153050 con 0x7fd660142f30 2024-01-20T08:10:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd666c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6601e9d70 con 0x7fd640003970 2024-01-20T08:10:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53572/0 (socket says 172.21.15.100:53572) 2024-01-20T08:10:23.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 -- 172.21.15.100:0/3753726168 learned_addr learned my addr 172.21.15.100:0/3753726168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 -- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd640003970 msgr2=0x7fd66014de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd664c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd660142f30 0x7fd6601ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65fe00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd640003970 0x7fd66014de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd640003970 0x7fd66014de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 -- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd660142f30 msgr2=0x7fd6601ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd660142f30 0x7fd6601ed230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.012+0000 7fd65f400640 1 -- 172.21.15.100:0/3753726168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6601ea050 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd65f400640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd64800d620 tx=0x7fd64800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800b620 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd64800b780 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6601ea330 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd64800bb10 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.013+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd660152730 con 0x7fd6601514c0 2024-01-20T08:10:23.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.014+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6601eab30 con 0x7fd6601514c0 2024-01-20T08:10:23.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.015+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd64800bc70 con 0x7fd6601514c0 2024-01-20T08:10:23.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.016+0000 7fd657e00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 0x7fd63806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.016+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd648089a80 con 0x7fd6601514c0 2024-01-20T08:10:23.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.016+0000 7fd65fe00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 0x7fd63806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.017+0000 7fd65fe00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 0x7fd63806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd650034000 tx=0x7fd650007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.021+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd6601eab30 con 0x7fd6601514c0 2024-01-20T08:10:23.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.250+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6601eab30 con 0x7fd6601514c0 2024-01-20T08:10:23.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.250+0000 7fd657e00640 1 -- 172.21.15.100:0/3753726168 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fd6601eab30 con 0x7fd6601514c0 2024-01-20T08:10:23.253 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:23.254 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:23.254 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 msgr2=0x7fd63806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 0x7fd63806d3c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd650034000 tx=0x7fd650007000 comp rx=0 tx=0).stop 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 msgr2=0x7fd6601429f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd64800d620 tx=0x7fd64800dae0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 shutdown_connections 2024-01-20T08:10:23.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd660142f30 0x7fd6601ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6601514c0 0x7fd6601429f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd63806af00 0x7fd63806d3c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 --2- 172.21.15.100:0/3753726168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd640003970 0x7fd66014de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 >> 172.21.15.100:0/3753726168 conn(0x7fd66006a5e0 msgr2=0x7fd66014e460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 shutdown_connections 2024-01-20T08:10:23.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.253+0000 7fd666c00640 1 -- 172.21.15.100:0/3753726168 wait complete. 2024-01-20T08:10:23.678 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T08:10:08.212342+0000', 'modified': '2024-01-20T08:10:11.485762+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6837/3076466356', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 3076466356}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 3076466356}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T08:10:23.678 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T08:10:23.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-20T08:10:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.893+0000 7fc9c5e00640 1 Processor -- start 2024-01-20T08:10:23.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.893+0000 7fc9c5e00640 1 -- start start 2024-01-20T08:10:23.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc9c014e690 0x7fc9c01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc9c01581e0 0x7fc9c0158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c0158bb0 con 0x7fc9c00c7e10 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c0157d00 con 0x7fc9c014e690 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00c4890 con 0x7fc9c01581e0 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9bfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc9c00c7e10 0x7fc9c00ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37484/0 (socket says 172.21.15.100:37484) 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9bfe00640 1 -- 172.21.15.100:0/909783517 learned_addr learned my addr 172.21.15.100:0/909783517 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/909783517 >> v2:172.21.15.100:3300/0 conn(0x7fc9c014e690 0x7fc9c01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.895+0000 7fc9c5400640 1 --2- 172.21.15.100:0/909783517 >> v2:172.21.15.110:3300/0 conn(0x7fc9c01581e0 0x7fc9c0158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.896+0000 7fc9bf400640 1 -- 172.21.15.100:0/909783517 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238291201 0 0) 0x7fc9c0158bb0 con 0x7fc9c00c7e10 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.896+0000 7fc9c4a00640 1 -- 172.21.15.100:0/909783517 >> v2:172.21.15.110:3300/0 conn(0x7fc9c01581e0 msgr2=0x7fc9c0158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.896+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/909783517 >> v2:172.21.15.110:3300/0 conn(0x7fc9c01581e0 0x7fc9c0158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.896+0000 7fc9c4a00640 1 -- 172.21.15.100:0/909783517 >> v1:172.21.15.100:6789/0 conn(0x7fc9c00c7e10 legacy=0x7fc9c00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.896+0000 7fc9c4a00640 1 -- 172.21.15.100:0/909783517 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c006cd00 con 0x7fc9c014e690 2024-01-20T08:10:23.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.897+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/909783517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c014e690 0x7fc9c01550f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00c6480 tx=0x7fc9b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896dfcd7822fb54e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.897+0000 7fc9bf400640 1 -- 172.21.15.100:0/909783517 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b002e070 con 0x7fc9c014e690 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.897+0000 7fc9bf400640 1 -- 172.21.15.100:0/909783517 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b00315a0 con 0x7fc9c014e690 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.897+0000 7fc9bf400640 1 -- 172.21.15.100:0/909783517 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0031930 con 0x7fc9c014e690 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 -- 172.21.15.100:0/909783517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c014e690 msgr2=0x7fc9c01550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/909783517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c014e690 0x7fc9c01550f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00c6480 tx=0x7fc9b002b840 comp rx=0 tx=0).stop 2024-01-20T08:10:23.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 -- 172.21.15.100:0/909783517 shutdown_connections 2024-01-20T08:10:23.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/909783517 >> v2:172.21.15.110:3300/0 conn(0x7fc9c01581e0 0x7fc9c0158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/909783517 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c014e690 0x7fc9c01550f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 -- 172.21.15.100:0/909783517 >> 172.21.15.100:0/909783517 conn(0x7fc9c0072130 msgr2=0x7fc9c0072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 -- 172.21.15.100:0/909783517 shutdown_connections 2024-01-20T08:10:23.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.898+0000 7fc9c5e00640 1 -- 172.21.15.100:0/909783517 wait complete. 2024-01-20T08:10:23.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.899+0000 7fc9c5e00640 1 Processor -- start 2024-01-20T08:10:23.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 -- start start 2024-01-20T08:10:23.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c00c7e10 0x7fc9c01eaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c014e690 0x7fc9c00ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c01eb3e0 con 0x7fc9c01581e0 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00acf60 con 0x7fc9c00c7e10 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.900+0000 7fc9c5e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c00ad240 con 0x7fc9c014e690 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53586/0 (socket says 172.21.15.100:53586) 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 -- 172.21.15.100:0/4202375451 learned_addr learned my addr 172.21.15.100:0/4202375451 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c00c7e10 0x7fc9c01eaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 -- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c014e690 msgr2=0x7fc9c00ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c014e690 0x7fc9c00ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 -- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c00c7e10 msgr2=0x7fc9c01eaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c00c7e10 0x7fc9c01eaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 -- 172.21.15.100:0/4202375451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009400 con 0x7fc9c01581e0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.901+0000 7fc9c5400640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d800 tx=0x7fc9b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.902+0000 7fc9bcc00640 1 -- 172.21.15.100:0/4202375451 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800b6c0 con 0x7fc9c01581e0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.902+0000 7fc9bcc00640 1 -- 172.21.15.100:0/4202375451 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800b840 con 0x7fc9c01581e0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.902+0000 7fc9bcc00640 1 -- 172.21.15.100:0/4202375451 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800bbf0 con 0x7fc9c01581e0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.902+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c00ad520 con 0x7fc9c01581e0 2024-01-20T08:10:23.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.902+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c00adae0 con 0x7fc9c01581e0 2024-01-20T08:10:23.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.904+0000 7fc9bcc00640 1 -- 172.21.15.100:0/4202375451 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc9b800bd50 con 0x7fc9c01581e0 2024-01-20T08:10:23.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.905+0000 7fc9bcc00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 0x7fc99806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.905+0000 7fc9bcc00640 1 -- 172.21.15.100:0/4202375451 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9b8089b10 con 0x7fc9c01581e0 2024-01-20T08:10:23.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.905+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 0x7fc99806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.906+0000 7fc9ca171740 1 Processor -- start 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.906+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 0x7fc99806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0036000 tx=0x7fc9b003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.906+0000 7fc9ca171740 1 -- start start 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c436546f40 0x55c436547320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436548250 0x55c436583090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4364b3d80 con 0x55c4365835d0 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4364b1470 con 0x55c436548250 2024-01-20T08:10:23.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c4364acd60 con 0x55c436546f40 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53588/0 (socket says 172.21.15.100:53588) 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 -- 172.21.15.100:0/1290321967 learned_addr learned my addr 172.21.15.100:0/1290321967 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 -- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c436546f40 msgr2=0x55c436547320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c436546f40 0x55c436547320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 -- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436548250 msgr2=0x55c436583090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436548250 0x55c436583090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.907+0000 7fc9c5400640 1 -- 172.21.15.100:0/1290321967 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c436462280 con 0x55c4365835d0 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9c5400640 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8060500 tx=0x7fc9b8058e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79f44bdcc371ca39 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9b5200640 1 -- 172.21.15.100:0/1290321967 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8060a30 con 0x55c4365835d0 2024-01-20T08:10:23.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9b5200640 1 -- 172.21.15.100:0/1290321967 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8056ad0 con 0x55c4365835d0 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9b5200640 1 -- 172.21.15.100:0/1290321967 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8057c20 con 0x55c4365835d0 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9ca171740 1 -- 172.21.15.100:0/1290321967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 msgr2=0x55c436581640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.908+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8060500 tx=0x7fc9b8058e30 comp rx=0 tx=0).stop 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 -- 172.21.15.100:0/1290321967 shutdown_connections 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c4365835d0 0x55c436581640 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436548250 0x55c436583090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1290321967 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c436546f40 0x55c436547320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 -- 172.21.15.100:0/1290321967 >> 172.21.15.100:0/1290321967 conn(0x55c436543b20 msgr2=0x55c4365682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 -- 172.21.15.100:0/1290321967 shutdown_connections 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 -- 172.21.15.100:0/1290321967 wait complete. 2024-01-20T08:10:23.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.909+0000 7fc9ca171740 1 -- start start 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.910+0000 7fc9ca171740 1 Processor -- start 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c4365933f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436593930 0x55c436580040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c436448740 con 0x55c436548250 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4364660c0 con 0x55c436593930 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c43620ef20 con 0x55c4365835d0 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ca171740 10 client.0 _ll_register_callbacks cb 0x55c4364a3200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53604/0 (socket says 172.21.15.100:53604) 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1691132300 learned_addr learned my addr 172.21.15.100:0/1691132300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 msgr2=0x55c4365933f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c4365933f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436593930 msgr2=0x55c436580040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436593930 0x55c436580040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1691132300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c00adae0 con 0x55c436548250 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9b002be50 tx=0x7fc9b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=679747585b412c2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.911+0000 7fc9ad600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b004b070 con 0x55c436548250 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9b0040070 con 0x55c436548250 2024-01-20T08:10:23.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c4364a5bf0 con 0x55c436548250 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9b0045610 con 0x55c436548250 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 10 client.4587 fetch_fsmap learned FSMap version 8 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c4364ab3e0 con 0x55c436548250 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c4364a5bf0 con 0x55c436548250 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc9b0045770 con 0x55c436548250 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 10 client.4587 fetch_fsmap finished waiting for FSMap version 8 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 10 client.4587 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 20 client.4587 populate_metadata read hostname 'smithi100' 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c436544ac0 0x55c436544ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 4 client.4587 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.912+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 --> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c4364a5910 con 0x55c436544ac0 2024-01-20T08:10:23.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.913+0000 7fc9bfe00640 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c436544ac0 0x55c436544ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.913+0000 7fc9ad600640 10 client.4587 ms_handle_connect on v2:172.21.15.100:6836/3076466356 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.913+0000 7fc9bfe00640 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c436544ac0 0x55c436544ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e955db3c620930e server_cookie=3f2cfc84c839d18c in_seq=0 out_seq=0 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ad600640 1 -- 172.21.15.100:0/1691132300 <== mds.0 v2:172.21.15.100:6836/3076466356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55c4364a5910 con 0x55c436544ac0 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ad600640 10 client.4587 handle_command_reply: tid=0 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 client.4587 shutdown 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 msgr2=0x55c436542180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc9b002be50 tx=0x7fc9b00046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 shutdown_connections 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c436544ac0 0x55c436544ea0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c436593930 0x55c436580040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c4365933f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1691132300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436542180 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ad600640 0 client.4587 ms_handle_reset on v2:172.21.15.100:6836/3076466356 2024-01-20T08:10:23.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 >> 172.21.15.100:0/1691132300 conn(0x55c436546f40 msgr2=0x55c436581d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 shutdown_connections 2024-01-20T08:10:23.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.914+0000 7fc9ca171740 1 -- 172.21.15.100:0/1691132300 wait complete. 2024-01-20T08:10:23.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.915+0000 7fc9ca171740 20 client.4587 trim_cache size 0 max 16384 2024-01-20T08:10:23.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.934+0000 7fc9ca171740 1 Processor -- start 2024-01-20T08:10:23.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.934+0000 7fc9ca171740 1 -- start start 2024-01-20T08:10:23.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c43657fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c436567970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c436563b80 con 0x55c436548250 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4364a5910 con 0x55c43657ff70 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c436461140 con 0x55c4365835d0 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53610/0 (socket says 172.21.15.100:53610) 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 -- 172.21.15.100:0/2467698427 learned_addr learned my addr 172.21.15.100:0/2467698427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 -- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 msgr2=0x55c43657fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c43657fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 -- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 msgr2=0x55c436567970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c436567970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.935+0000 7fc9c4a00640 1 -- 172.21.15.100:0/2467698427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c436447fd0 con 0x55c436548250 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0045c60 tx=0x7fc9b004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203e626b3e65d84d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9afe00640 1 -- 172.21.15.100:0/2467698427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0045d00 con 0x55c436548250 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9afe00640 1 -- 172.21.15.100:0/2467698427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b0045610 con 0x55c436548250 2024-01-20T08:10:23.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9afe00640 1 -- 172.21.15.100:0/2467698427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0050470 con 0x55c436548250 2024-01-20T08:10:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 -- 172.21.15.100:0/2467698427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 msgr2=0x55c436596a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0045c60 tx=0x7fc9b004b000 comp rx=0 tx=0).stop 2024-01-20T08:10:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 -- 172.21.15.100:0/2467698427 shutdown_connections 2024-01-20T08:10:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c436567970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c43657fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 --2- 172.21.15.100:0/2467698427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436596a60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.936+0000 7fc9ca171740 1 -- 172.21.15.100:0/2467698427 >> 172.21.15.100:0/2467698427 conn(0x55c436546f40 msgr2=0x55c4365a5fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.937+0000 7fc9ca171740 1 -- 172.21.15.100:0/2467698427 shutdown_connections 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.937+0000 7fc9ca171740 1 -- 172.21.15.100:0/2467698427 wait complete. 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.937+0000 7fc9ca171740 1 -- start start 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.937+0000 7fc9ca171740 1 Processor -- start 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c4365fab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c436567bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4365a6340 con 0x55c436548250 2024-01-20T08:10:23.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4365fb5e0 con 0x55c43657ff70 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c436566e70 con 0x55c4365835d0 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9ca171740 10 client.0 _ll_register_callbacks cb 0x7fc9b8054a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9c4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53616/0 (socket says 172.21.15.100:53616) 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.938+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1555367496 learned_addr learned my addr 172.21.15.100:0/1555367496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 msgr2=0x55c436567bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c436567bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 msgr2=0x55c4365fab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c4365fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 -- 172.21.15.100:0/1555367496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4364ab3e0 con 0x55c436548250 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9c4a00640 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00091d0 tx=0x7fc9b0008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76243bed31259c95 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:23.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9ad600640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b004b070 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9b0040040 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9b8056ad0 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.939+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9b0032430 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 10 client.4593 fetch_fsmap learned FSMap version 8 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55c43646d5c0 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b8056ad0 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 8) v1 ==== 3294+0+0 (secure 0 0 0) 0x7fc9b0058070 con 0x55c436548250 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 10 client.4593 fetch_fsmap finished waiting for FSMap version 8 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 10 client.4593 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 20 client.4593 populate_metadata read hostname 'smithi100' 2024-01-20T08:10:23.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c4365f49d0 0x55c4365f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 4 client.4593 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 --> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55c4361ac6c0 con 0x55c4365f49d0 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.940+0000 7fc9bfe00640 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c4365f49d0 0x55c4365f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ad600640 10 client.4593 ms_handle_connect on v2:172.21.15.100:6836/3076466356 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9bfe00640 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c4365f49d0 0x55c4365f4db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab51d20464217e2 server_cookie=fa527a941094fdaf in_seq=0 out_seq=0 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ad600640 1 -- 172.21.15.100:0/1555367496 <== mds.0 v2:172.21.15.100:6836/3076466356 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55c4361ac6c0 con 0x55c4365f49d0 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ad600640 10 client.4593 handle_command_reply: tid=0 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 client.4593 shutdown 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 msgr2=0x55c436540ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00091d0 tx=0x7fc9b0008030 comp rx=0 tx=0).stop 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 shutdown_connections 2024-01-20T08:10:23.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:6836/3076466356,v1:172.21.15.100:6837/3076466356] conn(0x55c4365f49d0 0x55c4365f4db0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x55c4365835d0 0x55c436567bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x55c43657ff70 0x55c4365fab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ad600640 0 client.4593 ms_handle_reset on v2:172.21.15.100:6836/3076466356 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 --2- 172.21.15.100:0/1555367496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55c436548250 0x55c436540ec0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 >> 172.21.15.100:0/1555367496 conn(0x55c436546f40 msgr2=0x55c436596a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 shutdown_connections 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 1 -- 172.21.15.100:0/1555367496 wait complete. 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.941+0000 7fc9ca171740 20 client.4593 trim_cache size 0 max 16384 2024-01-20T08:10:23.949 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "10ce7bd0-b73e-4b66-b126-32ffded4722e", 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4245, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 14.959619959999999, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 8, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 22, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 22, 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 22.790717470000001 2024-01-20T08:10:23.950 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:10:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 msgr2=0x7fc99806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 0x7fc99806d390 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0036000 tx=0x7fc9b003d040 comp rx=0 tx=0).stop 2024-01-20T08:10:23.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 msgr2=0x7fc9c00af1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800d800 tx=0x7fc9b800dcc0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 shutdown_connections 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9c01581e0 0x7fc9c00af1a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc99806aed0 0x7fc99806d390 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9c014e690 0x7fc9c00ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 --2- 172.21.15.100:0/4202375451 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9c00c7e10 0x7fc9c01eaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 >> 172.21.15.100:0/4202375451 conn(0x7fc9c0072130 msgr2=0x7fc9c0072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 shutdown_connections 2024-01-20T08:10:23.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:23.942+0000 7fc9c5e00640 1 -- 172.21.15.100:0/4202375451 wait complete. 2024-01-20T08:10:23.959 INFO:teuthology.run_tasks:Running task kclient... 2024-01-20T08:10:23.984 INFO:tasks.kclient:Mounting kernel clients... 2024-01-20T08:10:23.985 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-01-20T08:10:23.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:23.985 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:10:24.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:24.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-01-20T08:10:24.130 INFO:teuthology.orchestra.run.smithi100.stderr:Cannot find device "ceph-brx" 2024-01-20T08:10:24.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:10:24.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:24.134 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:10:24.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:24.376 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-20T08:10:24.473 INFO:teuthology.orchestra.run.smithi110.stderr:Cannot find device "ceph-brx" 2024-01-20T08:10:24.476 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:10:24.477 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-01-20T08:10:24.477 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T08:10:24.477 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:10:24.477 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:10:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.692+0000 7f3842800640 1 Processor -- start 2024-01-20T08:10:24.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.692+0000 7f3842800640 1 -- start start 2024-01-20T08:10:24.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.693+0000 7f3842800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f383c14b720 0x7f383c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3842800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f383c0c1850 0x7f383c0c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3842800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c154ba0 con 0x7f383c06c8d0 2024-01-20T08:10:24.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3842800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c14bb00 con 0x7f383c0c1850 2024-01-20T08:10:24.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3842800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c155a00 con 0x7f383c14b720 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3833e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f383c0c1850 0x7f383c0c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3833e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f383c0c1850 0x7f383c0c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53626/0 (socket says 172.21.15.100:53626) 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f3833e00640 1 -- 172.21.15.100:0/2640595754 learned_addr learned my addr 172.21.15.100:0/2640595754 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.694+0000 7f383b400640 1 --2- 172.21.15.100:0/2640595754 >> v2:172.21.15.110:3300/0 conn(0x7f383c14b720 0x7f383c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.695+0000 7f3833e00640 1 -- 172.21.15.100:0/2640595754 >> v2:172.21.15.110:3300/0 conn(0x7f383c14b720 msgr2=0x7f383c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.695+0000 7f3833e00640 1 --2- 172.21.15.100:0/2640595754 >> v2:172.21.15.110:3300/0 conn(0x7f383c14b720 0x7f383c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.695+0000 7f3833e00640 1 -- 172.21.15.100:0/2640595754 >> v1:172.21.15.110:6789/0 conn(0x7f383c06c8d0 legacy=0x7f383c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.695+0000 7f3833e00640 1 -- 172.21.15.100:0/2640595754 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c154df0 con 0x7f383c0c1850 2024-01-20T08:10:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.696+0000 7f3833e00640 1 --2- 172.21.15.100:0/2640595754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c0c1d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f383c06be40 tx=0x7f382402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b945e306d1630042 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.696+0000 7f383aa00640 1 -- 172.21.15.100:0/2640595754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38240317e0 con 0x7f383c0c1850 2024-01-20T08:10:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.696+0000 7f383aa00640 1 -- 172.21.15.100:0/2640595754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3824031940 con 0x7f383c0c1850 2024-01-20T08:10:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.696+0000 7f383aa00640 1 -- 172.21.15.100:0/2640595754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824031cd0 con 0x7f383c0c1850 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 -- 172.21.15.100:0/2640595754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 msgr2=0x7f383c0c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 --2- 172.21.15.100:0/2640595754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c0c1d00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f383c06be40 tx=0x7f382402b880 comp rx=0 tx=0).stop 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 -- 172.21.15.100:0/2640595754 shutdown_connections 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 --2- 172.21.15.100:0/2640595754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c0c1d00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 --2- 172.21.15.100:0/2640595754 >> v2:172.21.15.110:3300/0 conn(0x7f383c14b720 0x7f383c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 -- 172.21.15.100:0/2640595754 >> 172.21.15.100:0/2640595754 conn(0x7f383c0c2940 msgr2=0x7f383c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 -- 172.21.15.100:0/2640595754 shutdown_connections 2024-01-20T08:10:24.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.697+0000 7f3842800640 1 -- 172.21.15.100:0/2640595754 wait complete. 2024-01-20T08:10:24.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.699+0000 7f3842800640 1 Processor -- start 2024-01-20T08:10:24.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.699+0000 7f3842800640 1 -- start start 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383c06c8d0 0x7f383c142380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 0x7f383c13f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c151f60 con 0x7f383c0c1850 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0aa2e0 con 0x7f383c14b720 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3842800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c144640 con 0x7f383c06c8d0 2024-01-20T08:10:24.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53636/0 (socket says 172.21.15.100:53636) 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 -- 172.21.15.100:0/475003496 learned_addr learned my addr 172.21.15.100:0/475003496 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f383b400640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383c06c8d0 0x7f383c142380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 -- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383c06c8d0 msgr2=0x7f383c142380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383c06c8d0 0x7f383c142380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 -- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 msgr2=0x7f383c13f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f383be00640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 0x7f383c13f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 0x7f383c13f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f3833e00640 1 -- 172.21.15.100:0/475003496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38240094d0 con 0x7f383c0c1850 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.700+0000 7f383be00640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 0x7f383c13f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3833e00640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3824000c00 tx=0x7f38240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:24.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824032880 con 0x7f383c0c1850 2024-01-20T08:10:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38240329e0 con 0x7f383c0c1850 2024-01-20T08:10:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3824032d90 con 0x7f383c0c1850 2024-01-20T08:10:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c1527f0 con 0x7f383c0c1850 2024-01-20T08:10:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.701+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c14aee0 con 0x7f383c0c1850 2024-01-20T08:10:24.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.702+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c04e970 con 0x7f383c0c1850 2024-01-20T08:10:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.703+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f38240453f0 con 0x7f383c0c1850 2024-01-20T08:10:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.704+0000 7f3833400640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 0x7f381406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.704+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f38240aba50 con 0x7f383c0c1850 2024-01-20T08:10:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.704+0000 7f383b400640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 0x7f381406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:24.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.705+0000 7f383b400640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 0x7f381406d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:24.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.709+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3824076930 con 0x7f383c0c1850 2024-01-20T08:10:24.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.948+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f383c0c37e0 con 0x7f383c0c1850 2024-01-20T08:10:24.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.949+0000 7f3833400640 1 -- 172.21.15.100:0/475003496 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3824079f50 con 0x7f383c0c1850 2024-01-20T08:10:24.951 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:10:24.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 msgr2=0x7f381406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:24.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 0x7f381406d390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f382c006fd0 tx=0x7f382c008040 comp rx=0 tx=0).stop 2024-01-20T08:10:24.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 msgr2=0x7f383c14a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:24.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3824000c00 tx=0x7f38240046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 shutdown_connections 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f383c14b720 0x7f383c13f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f383c0c1850 0x7f383c14a9a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f381406aed0 0x7f381406d390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 --2- 172.21.15.100:0/475003496 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f383c06c8d0 0x7f383c142380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 >> 172.21.15.100:0/475003496 conn(0x7f383c0c2940 msgr2=0x7f383c0c5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 shutdown_connections 2024-01-20T08:10:24.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:24.952+0000 7f3842800640 1 -- 172.21.15.100:0/475003496 wait complete. 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T08:10:24.974 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T08:10:24.975 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:10:24.975 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:10:24.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:24.975 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:10:25.027 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:25.028 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42648sec preferred_lft 42648sec 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:10:25.029 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:25.029 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-20T08:10:25.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add name ceph-brx type bridge 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr flush dev ceph-brx 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set ceph-brx up 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-20T08:10:25.030 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:10:25.459 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:25.459 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:10:25.535 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:10:25.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:25.539 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:10:25.594 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:10:25.594 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:10:25.594 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:10:25.594 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:10:25.594 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:10:25.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:10:25.595 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:10:26.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:26.287 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:10:26.343 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:26.343 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list-id 2024-01-20T08:10:26.394 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:26.394 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:10:26.394 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:10:26.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:10:26.394 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-01-20T08:10:26.395 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:10:26.526 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-01-20T08:10:26.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-01-20T08:10:26.527 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:10:26.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:26.795 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:10:26.795 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:10:26.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:10:26.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set dev brx.0 master ceph-brx 2024-01-20T08:10:26.795 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:10:26.954 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:10:26.955 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:10:27.002 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:10:27.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:10:27.002 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:10:27.099 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-20T08:10:27.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:27.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:27.269 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:27.269 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:10:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:10:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:10:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:10:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:10:27.881 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T08:10:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:10:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:10:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:10:27.881 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:10:27.887 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:10:27.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:27.888 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:10:27.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:27.979 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:28.049 INFO:teuthology.orchestra.run.smithi100.stdout:client4379 2024-01-20T08:10:28.049 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:10:28.049 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:28.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:28.102 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:28.212 INFO:teuthology.orchestra.run.smithi100.stdout:client4379 2024-01-20T08:10:28.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:28.213 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:28.279 INFO:teuthology.orchestra.run.smithi100.stdout:client4379 2024-01-20T08:10:28.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:28.279 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10ce7bd0-b73e-4b66-b126-32ffded4722e.client4379/status') 2024-01-20T08:10:28.373 INFO:teuthology.orchestra.run.smithi100.stdout:instance: client.4379 (3)172.21.15.100:0/534873707 2024-01-20T08:10:28.373 INFO:teuthology.orchestra.run.smithi100.stdout:blocklisted: false 2024-01-20T08:10:28.374 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records in 2024-01-20T08:10:28.374 INFO:teuthology.orchestra.run.smithi100.stderr:0+1 records out 2024-01-20T08:10:28.374 INFO:teuthology.orchestra.run.smithi100.stderr:70 bytes copied, 6.7401e-05 s, 1.0 MB/s 2024-01-20T08:10:28.377 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-01-20T08:10:28.377 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-01-20T08:10:28.378 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:10:28.378 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:10:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.579+0000 7fc934c00640 1 Processor -- start 2024-01-20T08:10:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.579+0000 7fc934c00640 1 -- start start 2024-01-20T08:10:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.580+0000 7fc934c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 0x7fc930152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc934c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc930153120 0x7fc93015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc934c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc930150190 con 0x7fc93014fdb0 2024-01-20T08:10:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc934c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300a9ce0 con 0x7fc930153120 2024-01-20T08:10:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc934c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9300a93b0 con 0x7fc9300c3460 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc930153120 0x7fc93015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc930153120 0x7fc93015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53638/0 (socket says 172.21.15.100:53638) 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 -- 172.21.15.100:0/2857882978 learned_addr learned my addr 172.21.15.100:0/2857882978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc925200640 1 --2- 172.21.15.100:0/2857882978 >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 0x7fc930152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 -- 172.21.15.100:0/2857882978 >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 msgr2=0x7fc930152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 --2- 172.21.15.100:0/2857882978 >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 0x7fc930152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 -- 172.21.15.100:0/2857882978 >> v1:172.21.15.110:6789/0 conn(0x7fc93014fdb0 legacy=0x7fc9300c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc92e800640 1 -- 172.21.15.100:0/2857882978 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9301535b0 con 0x7fc930153120 2024-01-20T08:10:28.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.581+0000 7fc925200640 1 --2- 172.21.15.100:0/2857882978 >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 0x7fc930152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.583+0000 7fc92e800640 1 --2- 172.21.15.100:0/2857882978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc930153120 0x7fc93015cfc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc93006be40 tx=0x7fc92802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570b7599867eeac1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.583+0000 7fc92d400640 1 -- 172.21.15.100:0/2857882978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92802ca80 con 0x7fc930153120 2024-01-20T08:10:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.583+0000 7fc92d400640 1 -- 172.21.15.100:0/2857882978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92802cbe0 con 0x7fc930153120 2024-01-20T08:10:28.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.583+0000 7fc92d400640 1 -- 172.21.15.100:0/2857882978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9280343f0 con 0x7fc930153120 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 -- 172.21.15.100:0/2857882978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc930153120 msgr2=0x7fc93015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 --2- 172.21.15.100:0/2857882978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc930153120 0x7fc93015cfc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc93006be40 tx=0x7fc92802bee0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 -- 172.21.15.100:0/2857882978 shutdown_connections 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 --2- 172.21.15.100:0/2857882978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc930153120 0x7fc93015cfc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 --2- 172.21.15.100:0/2857882978 >> v2:172.21.15.110:3300/0 conn(0x7fc9300c3460 0x7fc930152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 -- 172.21.15.100:0/2857882978 >> 172.21.15.100:0/2857882978 conn(0x7fc9300c2940 msgr2=0x7fc9300c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 -- 172.21.15.100:0/2857882978 shutdown_connections 2024-01-20T08:10:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.584+0000 7fc934c00640 1 -- 172.21.15.100:0/2857882978 wait complete. 2024-01-20T08:10:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.585+0000 7fc934c00640 1 Processor -- start 2024-01-20T08:10:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 -- start start 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc93014fdb0 0x7fc93006c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc930153120 0x7fc9301edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930150d80 con 0x7fc9300c3460 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc930151590 con 0x7fc93014fdb0 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.586+0000 7fc934c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc930150fd0 con 0x7fc930153120 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53644/0 (socket says 172.21.15.100:53644) 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 -- 172.21.15.100:0/210783695 learned_addr learned my addr 172.21.15.100:0/210783695 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc925200640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc93014fdb0 0x7fc93006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92e800640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc930153120 0x7fc9301edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 -- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc930153120 msgr2=0x7fc9301edb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc930153120 0x7fc9301edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 -- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc93014fdb0 msgr2=0x7fc93006c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc93014fdb0 0x7fc93006c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.587+0000 7fc92de00640 1 -- 172.21.15.100:0/210783695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc928009b30 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc92de00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c460 tx=0x7fc92000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920012830 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9200129d0 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920012d80 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9301512b0 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.588+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9301ed620 con 0x7fc9300c3460 2024-01-20T08:10:28.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.589+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9301ed840 con 0x7fc9300c3460 2024-01-20T08:10:28.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.590+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc92001a3b0 con 0x7fc9300c3460 2024-01-20T08:10:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.591+0000 7fc926a00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.591+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9200892b0 con 0x7fc9300c3460 2024-01-20T08:10:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.591+0000 7fc925200640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:28.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.592+0000 7fc925200640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 0x7fc90806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc93006e060 tx=0x7fc918008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:28.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.595+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc920054170 con 0x7fc9300c3460 2024-01-20T08:10:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.825+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc93004e970 con 0x7fc9300c3460 2024-01-20T08:10:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.826+0000 7fc926a00640 1 -- 172.21.15.100:0/210783695 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc920057790 con 0x7fc9300c3460 2024-01-20T08:10:28.829 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 msgr2=0x7fc90806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 0x7fc90806d390 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fc93006e060 tx=0x7fc918008040 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 msgr2=0x7fc93006d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc92000c460 tx=0x7fc92000c920 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 shutdown_connections 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc90806aed0 0x7fc90806d390 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc930153120 0x7fc9301edb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc93014fdb0 0x7fc93006c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 --2- 172.21.15.100:0/210783695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9300c3460 0x7fc93006d8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:28.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.828+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 >> 172.21.15.100:0/210783695 conn(0x7fc9300c2940 msgr2=0x7fc930072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.829+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 shutdown_connections 2024-01-20T08:10:28.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:28.829+0000 7fc934c00640 1 -- 172.21.15.100:0/210783695 wait complete. 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:10:28.850 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:10:28.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:28.850 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:28.910 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42618sec preferred_lft 42618sec 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:10:28.911 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-01-20T08:10:28.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:28.911 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add name ceph-brx type bridge 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr flush dev ceph-brx 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set ceph-brx up 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-01-20T08:10:28.912 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:10:29.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:29.347 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:10:29.423 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:10:29.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:29.427 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:10:29.481 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:10:29.481 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:10:29.482 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:10:29.482 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:10:29.482 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:10:29.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:10:29.483 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:10:30.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:30.197 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:10:30.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:30.253 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list-id 2024-01-20T08:10:30.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:30.302 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:10:30.302 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:10:30.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:10:30.302 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-01-20T08:10:30.302 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:10:30.443 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-01-20T08:10:30.443 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-01-20T08:10:30.443 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-01-20T08:10:30.444 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:10:30.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:30.710 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:10:30.710 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:10:30.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:10:30.710 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set dev brx.0 master ceph-brx 2024-01-20T08:10:30.710 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:10:30.867 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:10:30.867 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:10:30.918 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:10:30.918 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:10:30.918 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:10:31.011 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-20T08:10:31.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:31.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:31.158 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:31.159 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:10:31.823 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:10:31.823 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:10:31.823 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:10:31.823 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:10:31.823 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:10:31.826 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:10:31.827 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:10:31.827 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:10:31.827 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:10:31.827 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:10:31.833 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:10:31.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:31.833 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:10:31.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:31.922 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:31.980 INFO:teuthology.orchestra.run.smithi110.stdout:client4382 2024-01-20T08:10:31.980 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:10:31.980 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:32.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:32.033 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:32.086 INFO:teuthology.orchestra.run.smithi110.stdout:client4382 2024-01-20T08:10:32.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:32.087 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:10:32.141 INFO:teuthology.orchestra.run.smithi110.stdout:client4382 2024-01-20T08:10:32.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:32.142 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/10ce7bd0-b73e-4b66-b126-32ffded4722e.client4382/status') 2024-01-20T08:10:32.228 INFO:teuthology.orchestra.run.smithi110.stdout:instance: client.4382 (3)192.168.0.1:0/2465663442 2024-01-20T08:10:32.229 INFO:teuthology.orchestra.run.smithi110.stdout:blocklisted: false 2024-01-20T08:10:32.229 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records in 2024-01-20T08:10:32.229 INFO:teuthology.orchestra.run.smithi110.stderr:0+1 records out 2024-01-20T08:10:32.229 INFO:teuthology.orchestra.run.smithi110.stderr:69 bytes copied, 6.3941e-05 s, 1.1 MB/s 2024-01-20T08:10:32.233 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-01-20T08:10:32.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.459+0000 7f4193400640 1 Processor -- start 2024-01-20T08:10:32.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.459+0000 7f4193400640 1 -- start start 2024-01-20T08:10:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.460+0000 7f4193400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f418c072320 0x7f418c14f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.460+0000 7f4193400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0c1720 con 0x7f418c0c3240 2024-01-20T08:10:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.460+0000 7f4193400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f418c0a4f30 con 0x7f418c06dd90 2024-01-20T08:10:32.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.460+0000 7f4193400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f418c0c20a0 con 0x7f418c072320 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f418c072320 0x7f418c14f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f418c0c3240 0x7f418c156210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60898/0 (socket says 172.21.15.100:60898) 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192a00640 1 -- 172.21.15.100:0/4239399851 learned_addr learned my addr 172.21.15.100:0/4239399851 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4190c00640 1 -- 172.21.15.100:0/4239399851 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3000959362 0 0) 0x7f418c0c1720 con 0x7f418c0c3240 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4190c00640 1 -- 172.21.15.100:0/4239399851 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f416c003520 con 0x7f418c0c3240 2024-01-20T08:10:32.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192000640 1 -- 172.21.15.100:0/4239399851 >> v1:172.21.15.110:6789/0 conn(0x7f418c06dd90 legacy=0x7f418c155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192000640 1 -- 172.21.15.100:0/4239399851 >> v1:172.21.15.100:6789/0 conn(0x7f418c0c3240 legacy=0x7f418c156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.461+0000 7f4192000640 1 -- 172.21.15.100:0/4239399851 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c0c19e0 con 0x7f418c072320 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.462+0000 7f4192000640 1 --2- 172.21.15.100:0/4239399851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c14f5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097a0 tx=0x7f417c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f95acf508c59f0ae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4190c00640 1 -- 172.21.15.100:0/4239399851 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c02e070 con 0x7f418c072320 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4190c00640 1 -- 172.21.15.100:0/4239399851 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f417c0315a0 con 0x7f418c072320 2024-01-20T08:10:32.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4190c00640 1 -- 172.21.15.100:0/4239399851 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417c031930 con 0x7f418c072320 2024-01-20T08:10:32.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 -- 172.21.15.100:0/4239399851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 msgr2=0x7f418c14f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 --2- 172.21.15.100:0/4239399851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c14f5d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f417c0097a0 tx=0x7f417c02b840 comp rx=0 tx=0).stop 2024-01-20T08:10:32.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 -- 172.21.15.100:0/4239399851 shutdown_connections 2024-01-20T08:10:32.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 --2- 172.21.15.100:0/4239399851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c14f5d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 -- 172.21.15.100:0/4239399851 >> 172.21.15.100:0/4239399851 conn(0x7f418c0c2590 msgr2=0x7f418c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:32.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 -- 172.21.15.100:0/4239399851 shutdown_connections 2024-01-20T08:10:32.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.463+0000 7f4193400640 1 -- 172.21.15.100:0/4239399851 wait complete. 2024-01-20T08:10:32.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.465+0000 7f4193400640 1 Processor -- start 2024-01-20T08:10:32.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.465+0000 7f4193400640 1 -- start start 2024-01-20T08:10:32.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418c06dd90 0x7f418c14d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418c0c3240 0x7f418c155030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1ed000 con 0x7f418c072320 2024-01-20T08:10:32.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f418c1eddf0 con 0x7f418c0c3240 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4193400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f418c153c20 con 0x7f418c06dd90 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4191600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4191600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53396/0 (socket says 172.21.15.100:53396) 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.466+0000 7f4191600640 1 -- 172.21.15.100:0/3804831792 learned_addr learned my addr 172.21.15.100:0/3804831792 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4192000640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418c06dd90 0x7f418c14d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 -- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418c06dd90 msgr2=0x7f418c14d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418c06dd90 0x7f418c14d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4192a00640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418c0c3240 0x7f418c155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 -- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418c0c3240 msgr2=0x7f418c155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418c0c3240 0x7f418c155030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 -- 172.21.15.100:0/3804831792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c009400 con 0x7f418c072320 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4191600640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f417400b420 tx=0x7f417400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011830 con 0x7f418c072320 2024-01-20T08:10:32.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4174011990 con 0x7f418c072320 2024-01-20T08:10:32.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f418c1ecad0 con 0x7f418c072320 2024-01-20T08:10:32.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4174011d40 con 0x7f418c072320 2024-01-20T08:10:32.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.467+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f418c153940 con 0x7f418c072320 2024-01-20T08:10:32.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.468+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f418c1edfa0 con 0x7f418c072320 2024-01-20T08:10:32.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.469+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f417401b460 con 0x7f418c072320 2024-01-20T08:10:32.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.471+0000 7f418a000640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 0x7f416406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.471+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4174089170 con 0x7f418c072320 2024-01-20T08:10:32.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.471+0000 7f4192000640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 0x7f416406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.472+0000 7f4192000640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 0x7f416406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f417c036000 tx=0x7f417c03d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.475+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f418c1edfa0 con 0x7f418c072320 2024-01-20T08:10:32.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.668+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f418c1edfa0 con 0x7f418c072320 2024-01-20T08:10:32.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.671+0000 7f418a000640 1 -- 172.21.15.100:0/3804831792 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f418c1edfa0 con 0x7f418c072320 2024-01-20T08:10:32.674 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:32.674 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:32.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 msgr2=0x7f416406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 0x7f416406d3c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f417c036000 tx=0x7f417c03d040 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 msgr2=0x7f418c1ed420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f417400b420 tx=0x7f417400b8e0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 shutdown_connections 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f418c0c3240 0x7f418c155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f418c072320 0x7f418c1ed420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f416406af00 0x7f416406d3c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 --2- 172.21.15.100:0/3804831792 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f418c06dd90 0x7f418c14d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.673+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 >> 172.21.15.100:0/3804831792 conn(0x7f418c0c2590 msgr2=0x7f418c155c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.674+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 shutdown_connections 2024-01-20T08:10:32.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.674+0000 7f4193400640 1 -- 172.21.15.100:0/3804831792 wait complete. 2024-01-20T08:10:32.696 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:32.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:32.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.904+0000 7fd70ea00640 1 Processor -- start 2024-01-20T08:10:32.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.904+0000 7fd70ea00640 1 -- start start 2024-01-20T08:10:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd70ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd708151e80 0x7fd7081588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd70ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7080c7ff0 0x7fd7080c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd70ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd708158df0 con 0x7fd7080c4fb0 2024-01-20T08:10:32.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd70ea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7080c6c10 con 0x7fd7080c7ff0 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd70ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7080c6ef0 con 0x7fd708151e80 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd707400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7080c7ff0 0x7fd7080c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd707400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7080c7ff0 0x7fd7080c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53412/0 (socket says 172.21.15.100:53412) 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.906+0000 7fd707400640 1 -- 172.21.15.100:0/1346706216 learned_addr learned my addr 172.21.15.100:0/1346706216 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.907+0000 7fd707e00640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd708151e80 0x7fd7081588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.907+0000 7fd707400640 1 -- 172.21.15.100:0/1346706216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd708151e80 msgr2=0x7fd7081588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.907+0000 7fd707400640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd708151e80 0x7fd7081588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.907+0000 7fd707400640 1 -- 172.21.15.100:0/1346706216 >> v1:172.21.15.110:6789/0 conn(0x7fd7080c4fb0 legacy=0x7fd70806c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.907+0000 7fd707400640 1 -- 172.21.15.100:0/1346706216 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080c71d0 con 0x7fd7080c7ff0 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.908+0000 7fd707400640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7080c7ff0 0x7fd7080c4a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009870 tx=0x7fd6f002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf02a2e790361d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.908+0000 7fd706a00640 1 -- 172.21.15.100:0/1346706216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f00317c0 con 0x7fd7080c7ff0 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.908+0000 7fd706a00640 1 -- 172.21.15.100:0/1346706216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f0031920 con 0x7fd7080c7ff0 2024-01-20T08:10:32.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.908+0000 7fd706a00640 1 -- 172.21.15.100:0/1346706216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f0031cb0 con 0x7fd7080c7ff0 2024-01-20T08:10:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 -- 172.21.15.100:0/1346706216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7080c7ff0 msgr2=0x7fd7080c4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7080c7ff0 0x7fd7080c4a70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0009870 tx=0x7fd6f002b860 comp rx=0 tx=0).stop 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 -- 172.21.15.100:0/1346706216 shutdown_connections 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7080c7ff0 0x7fd7080c4a70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 --2- 172.21.15.100:0/1346706216 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd708151e80 0x7fd7081588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 -- 172.21.15.100:0/1346706216 >> 172.21.15.100:0/1346706216 conn(0x7fd7080abd20 msgr2=0x7fd7080ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 -- 172.21.15.100:0/1346706216 shutdown_connections 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.909+0000 7fd70ea00640 1 -- 172.21.15.100:0/1346706216 wait complete. 2024-01-20T08:10:32.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.911+0000 7fd70ea00640 1 Processor -- start 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.911+0000 7fd70ea00640 1 -- start start 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7080c4fb0 0x7fd70814cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 0x7fd7081ede50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd708141870 con 0x7fd708151e80 2024-01-20T08:10:32.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081ed9c0 con 0x7fd7080c7ff0 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7081eaa00 con 0x7fd7080c4fb0 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53428/0 (socket says 172.21.15.100:53428) 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd70ca00640 1 -- 172.21.15.100:0/3097285850 learned_addr learned my addr 172.21.15.100:0/3097285850 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd707e00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7080c4fb0 0x7fd70814cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.912+0000 7fd707400640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 0x7fd7081ede50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 -- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7080c4fb0 msgr2=0x7fd70814cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7080c4fb0 0x7fd70814cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 -- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 msgr2=0x7fd7081ede50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 0x7fd7081ede50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 -- 172.21.15.100:0/3097285850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f00094d0 con 0x7fd708151e80 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd707400640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 0x7fd7081ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ca00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b410 tx=0x7fd70000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700004020 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700004180 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700011630 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7081eace0 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.913+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7081ee390 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.915+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7081ed480 con 0x7fd708151e80 2024-01-20T08:10:32.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.916+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd700011790 con 0x7fd708151e80 2024-01-20T08:10:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.916+0000 7fd6ffe00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 0x7fd6e006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:32.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.917+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd700089350 con 0x7fd708151e80 2024-01-20T08:10:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.917+0000 7fd707e00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 0x7fd6e006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.917+0000 7fd707e00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 0x7fd6e006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80099c0 tx=0x7fd6f8003990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:32.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:32.921+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd700054210 con 0x7fd708151e80 2024-01-20T08:10:33.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.114+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd70804e970 con 0x7fd708151e80 2024-01-20T08:10:33.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.115+0000 7fd6ffe00640 1 -- 172.21.15.100:0/3097285850 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd700057830 con 0x7fd708151e80 2024-01-20T08:10:33.119 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 msgr2=0x7fd6e006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 0x7fd6e006d390 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6f80099c0 tx=0x7fd6f8003990 comp rx=0 tx=0).stop 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 msgr2=0x7fd70814d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b410 tx=0x7fd70000b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 shutdown_connections 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd708151e80 0x7fd70814d3d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7080c7ff0 0x7fd7081ede50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd6e006aed0 0x7fd6e006d390 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 --2- 172.21.15.100:0/3097285850 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7080c4fb0 0x7fd70814cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 >> 172.21.15.100:0/3097285850 conn(0x7fd7080abd20 msgr2=0x7fd7080c97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 shutdown_connections 2024-01-20T08:10:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.118+0000 7fd70ea00640 1 -- 172.21.15.100:0/3097285850 wait complete. 2024-01-20T08:10:33.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.339+0000 7f7981000640 1 Processor -- start 2024-01-20T08:10:33.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.339+0000 7f7981000640 1 -- start start 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7981000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f797c0c5720 0x7f797c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7981000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c154b00 con 0x7f797c0c4d70 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7981000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f797c154de0 con 0x7f797c13df00 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7981000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f797c1550c0 con 0x7f797c0c5720 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7979e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f797c0c4d70 0x7f797c0aef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60906/0 (socket says 172.21.15.100:60906) 2024-01-20T08:10:33.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.341+0000 7f7979e00640 1 -- 172.21.15.100:0/969897361 learned_addr learned my addr 172.21.15.100:0/969897361 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870927285 0 0) 0x7f797c154b00 con 0x7f797c0c4d70 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f795c003520 con 0x7f797c0c4d70 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f797a800640 1 --2- 172.21.15.100:0/969897361 >> v2:172.21.15.110:3300/0 conn(0x7f797c0c5720 0x7f797c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4237936424 0 0) 0x7f795c003520 con 0x7f797c0c4d70 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 >> v2:172.21.15.110:3300/0 conn(0x7f797c0c5720 msgr2=0x7f797c0c5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 --2- 172.21.15.100:0/969897361 >> v2:172.21.15.110:3300/0 conn(0x7f797c0c5720 0x7f797c0c5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 >> v1:172.21.15.110:6789/0 conn(0x7f797c13df00 legacy=0x7f797c13d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c1553a0 con 0x7f797c0c4d70 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7974001670 con 0x7f797c0c4d70 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 >> v1:172.21.15.100:6789/0 conn(0x7f797c0c4d70 legacy=0x7f797c0aef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c003970 0x7f795c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 0x7f795c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c005380 0x7f795c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1550c0 con 0x7f795c0047c0 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c00c210 con 0x7f795c005380 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c00c3d0 con 0x7f795c003970 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.342+0000 7f7979400640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 0x7f795c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979e00640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c003970 0x7f795c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f797a800640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c005380 0x7f795c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979400640 1 -- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c003970 msgr2=0x7f795c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:33.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979400640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c003970 0x7f795c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979400640 1 -- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c005380 msgr2=0x7f795c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979400640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f795c005380 0x7f795c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f7979400640 1 -- 172.21.15.100:0/969897361 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c003520 con 0x7f795c0047c0 2024-01-20T08:10:33.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.343+0000 7f797a800640 1 -- 172.21.15.100:0/969897361 reap_dead start 2024-01-20T08:10:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.344+0000 7f7979400640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 0x7f795c004c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7964001720 tx=0x7f795c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=898feeea6adf67ef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.344+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640052d0 con 0x7f795c0047c0 2024-01-20T08:10:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.344+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796402e050 con 0x7f795c0047c0 2024-01-20T08:10:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.344+0000 7f7978a00640 1 -- 172.21.15.100:0/969897361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964003830 con 0x7f795c0047c0 2024-01-20T08:10:33.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 -- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 msgr2=0x7f795c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 0x7f795c004c40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7964001720 tx=0x7f795c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 -- 172.21.15.100:0/969897361 shutdown_connections 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 --2- 172.21.15.100:0/969897361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f795c0047c0 0x7f795c004c40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 -- 172.21.15.100:0/969897361 >> 172.21.15.100:0/969897361 conn(0x7f797c0ca180 msgr2=0x7f797c0ca590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 -- 172.21.15.100:0/969897361 shutdown_connections 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.345+0000 7f7981000640 1 -- 172.21.15.100:0/969897361 wait complete. 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.347+0000 7f7981000640 1 Processor -- start 2024-01-20T08:10:33.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.347+0000 7f7981000640 1 -- start start 2024-01-20T08:10:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.347+0000 7f7981000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0047c0 0x7f797c1ee230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7981000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7981000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f797c06c440 0x7f797c1ea030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7981000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c06cc70 con 0x7f797c06d060 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7981000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797c06c990 con 0x7f797c06c440 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7981000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f797c1ed750 con 0x7f795c0047c0 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53444/0 (socket says 172.21.15.100:53444) 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 -- 172.21.15.100:0/2526494861 learned_addr learned my addr 172.21.15.100:0/2526494861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979e00640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0047c0 0x7f797c1ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 -- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0047c0 msgr2=0x7f797c1ee230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0047c0 0x7f797c1ee230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 -- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f797c06c440 msgr2=0x7f797c1ea030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f797a800640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f797c06c440 0x7f797c1ea030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f797c06c440 0x7f797c1ea030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.348+0000 7f7979400640 1 -- 172.21.15.100:0/2526494861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f797c1eda30 con 0x7f797c06d060 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7979400640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7964000c00 tx=0x7f7964001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79640076c0 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7964007a30 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7964006be0 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797c1edd10 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.349+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797c158c00 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.350+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f797c1ed890 con 0x7f797c06d060 2024-01-20T08:10:33.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.351+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7964006d40 con 0x7f797c06d060 2024-01-20T08:10:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.352+0000 7f7972000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 0x7f795406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.352+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79640ab290 con 0x7f797c06d060 2024-01-20T08:10:33.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.352+0000 7f7979e00640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 0x7f795406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.353+0000 7f7979e00640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 0x7f795406d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7974001eb0 tx=0x7f7974009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.357+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f797c1ed890 con 0x7f797c06d060 2024-01-20T08:10:33.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.547+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f797c1ed890 con 0x7f797c06d060 2024-01-20T08:10:33.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.548+0000 7f7972000640 1 -- 172.21.15.100:0/2526494861 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f797c1ed890 con 0x7f797c06d060 2024-01-20T08:10:33.551 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 msgr2=0x7f795406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 0x7f795406d390 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7974001eb0 tx=0x7f7974009040 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 msgr2=0x7f797c0ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7964000c00 tx=0x7f7964001120 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 shutdown_connections 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f797c06c440 0x7f797c1ea030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f797c06d060 0x7f797c0ab000 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f795406aed0 0x7f795406d390 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 --2- 172.21.15.100:0/2526494861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f795c0047c0 0x7f797c1ee230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 >> 172.21.15.100:0/2526494861 conn(0x7f797c0ca180 msgr2=0x7f797c13d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 shutdown_connections 2024-01-20T08:10:33.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.551+0000 7f7981000640 1 -- 172.21.15.100:0/2526494861 wait complete. 2024-01-20T08:10:33.573 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:33.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.782+0000 7f327ea00640 1 Processor -- start 2024-01-20T08:10:33.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.782+0000 7f327ea00640 1 -- start start 2024-01-20T08:10:33.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.783+0000 7f327ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f32780c24f0 0x7f3278157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.783+0000 7f327ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f32780c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.783+0000 7f327ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3278071d00 con 0x7f3278158af0 2024-01-20T08:10:33.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.783+0000 7f327ea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3278154ca0 con 0x7f32780c24f0 2024-01-20T08:10:33.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.783+0000 7f327ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278071fa0 con 0x7f32781550c0 2024-01-20T08:10:33.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f32780c24f0 0x7f3278157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f32780c24f0 0x7f3278157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53456/0 (socket says 172.21.15.100:53456) 2024-01-20T08:10:33.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 -- 172.21.15.100:0/82078398 learned_addr learned my addr 172.21.15.100:0/82078398 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:33.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f327ca00640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f32780c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 -- 172.21.15.100:0/82078398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 msgr2=0x7f32780c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f32780c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 -- 172.21.15.100:0/82078398 >> v1:172.21.15.110:6789/0 conn(0x7f3278158af0 legacy=0x7f327806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:33.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.784+0000 7f3277400640 1 -- 172.21.15.100:0/82078398 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3278072280 con 0x7f32780c24f0 2024-01-20T08:10:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.785+0000 7f3277400640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32780c24f0 0x7f3278157da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3260009870 tx=0x7f326002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f60ec4ea2f0cb9d1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.785+0000 7f3276a00640 1 -- 172.21.15.100:0/82078398 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260031740 con 0x7f32780c24f0 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.785+0000 7f3276a00640 1 -- 172.21.15.100:0/82078398 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32600318a0 con 0x7f32780c24f0 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.785+0000 7f3276a00640 1 -- 172.21.15.100:0/82078398 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260031c30 con 0x7f32780c24f0 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 -- 172.21.15.100:0/82078398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32780c24f0 msgr2=0x7f3278157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32780c24f0 0x7f3278157da0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3260009870 tx=0x7f326002b7e0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 -- 172.21.15.100:0/82078398 shutdown_connections 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f32780c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 --2- 172.21.15.100:0/82078398 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32780c24f0 0x7f3278157da0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 -- 172.21.15.100:0/82078398 >> 172.21.15.100:0/82078398 conn(0x7f32780c2940 msgr2=0x7f32780c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 -- 172.21.15.100:0/82078398 shutdown_connections 2024-01-20T08:10:33.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.786+0000 7f327ea00640 1 -- 172.21.15.100:0/82078398 wait complete. 2024-01-20T08:10:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.788+0000 7f327ea00640 1 Processor -- start 2024-01-20T08:10:33.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.788+0000 7f327ea00640 1 -- start start 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 0x7f32781567d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f3278156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278156360 con 0x7f3278158af0 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3278157250 con 0x7f32780c24f0 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3278156080 con 0x7f32781550c0 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53464/0 (socket says 172.21.15.100:53464) 2024-01-20T08:10:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.789+0000 7f327ca00640 1 -- 172.21.15.100:0/3362088109 learned_addr learned my addr 172.21.15.100:0/3362088109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f3277400640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f3278156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f3277e00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 0x7f32781567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 -- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 msgr2=0x7f3278156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f3278156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 -- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 msgr2=0x7f32781567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 0x7f32781567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 -- 172.21.15.100:0/3362088109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32600094d0 con 0x7f3278158af0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f3277e00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 0x7f32781567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ca00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f327000c7f0 tx=0x7f327000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270004220 con 0x7f3278158af0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3270004380 con 0x7f3278158af0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3270007860 con 0x7f3278158af0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780c5020 con 0x7f3278158af0 2024-01-20T08:10:33.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.790+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780c55e0 con 0x7f3278158af0 2024-01-20T08:10:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.791+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32780c5800 con 0x7f3278158af0 2024-01-20T08:10:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.792+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3270007bd0 con 0x7f3278158af0 2024-01-20T08:10:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.794+0000 7f326fe00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 0x7f325006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.794+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3270089560 con 0x7f3278158af0 2024-01-20T08:10:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.794+0000 7f3277e00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 0x7f325006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.795+0000 7f3277e00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 0x7f325006d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3268004520 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:33.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.798+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f32700544c0 con 0x7f3278158af0 2024-01-20T08:10:33.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.993+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f327804e970 con 0x7f3278158af0 2024-01-20T08:10:33.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.994+0000 7f326fe00640 1 -- 172.21.15.100:0/3362088109 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3270057ae0 con 0x7f3278158af0 2024-01-20T08:10:33.997 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 msgr2=0x7f325006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 0x7f325006d390 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3268004520 tx=0x7f3268009040 comp rx=0 tx=0).stop 2024-01-20T08:10:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 msgr2=0x7f3278148940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f327000c7f0 tx=0x7f327000ccb0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 shutdown_connections 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3278158af0 0x7f3278148940 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f325006aed0 0x7f325006d390 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f32781550c0 0x7f3278156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 --2- 172.21.15.100:0/3362088109 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32780c24f0 0x7f32781567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 >> 172.21.15.100:0/3362088109 conn(0x7f32780c2940 msgr2=0x7f3278152410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 shutdown_connections 2024-01-20T08:10:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:33.998+0000 7f327ea00640 1 -- 172.21.15.100:0/3362088109 wait complete. 2024-01-20T08:10:34.020 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.221+0000 7faa4c200640 1 Processor -- start 2024-01-20T08:10:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.221+0000 7faa4c200640 1 -- start start 2024-01-20T08:10:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4c200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa440a93c0 0x7faa44153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440aae00 0x7faa440ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4c200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa440a9940 con 0x7faa4414fce0 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4c200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa441500c0 con 0x7faa440a93c0 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa44156810 con 0x7faa440aae00 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa4a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440aae00 0x7faa440ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa49800640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7faa4414fce0 0x7faa44152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:44940/0 (socket says 172.21.15.100:44940) 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.223+0000 7faa48e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7faa440a93c0 0x7faa44153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.224+0000 7faa49800640 1 -- 172.21.15.100:0/2201437687 learned_addr learned my addr 172.21.15.100:0/2201437687 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.224+0000 7faa48e00640 1 -- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440aae00 msgr2=0x7faa440ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.224+0000 7faa48e00640 1 --2- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440aae00 0x7faa440ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.224+0000 7faa48e00640 1 -- 172.21.15.100:0/2201437687 >> v1:172.21.15.110:6789/0 conn(0x7faa4414fce0 legacy=0x7faa44152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.224+0000 7faa48e00640 1 -- 172.21.15.100:0/2201437687 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa44156af0 con 0x7faa440a93c0 2024-01-20T08:10:34.228 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.226+0000 7faa48e00640 1 --2- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440a93c0 0x7faa44153b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0097a0 tx=0x7faa2c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbd16ac0f42d733a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.226+0000 7faa43e00640 1 -- 172.21.15.100:0/2201437687 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c031830 con 0x7faa440a93c0 2024-01-20T08:10:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.226+0000 7faa43e00640 1 -- 172.21.15.100:0/2201437687 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2c031990 con 0x7faa440a93c0 2024-01-20T08:10:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.226+0000 7faa43e00640 1 -- 172.21.15.100:0/2201437687 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2c031d20 con 0x7faa440a93c0 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 -- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440a93c0 msgr2=0x7faa44153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 --2- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440a93c0 0x7faa44153b80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7faa2c0097a0 tx=0x7faa2c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 -- 172.21.15.100:0/2201437687 shutdown_connections 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 --2- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440aae00 0x7faa440ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 --2- 172.21.15.100:0/2201437687 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440a93c0 0x7faa44153b80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 -- 172.21.15.100:0/2201437687 >> 172.21.15.100:0/2201437687 conn(0x7faa4406a5e0 msgr2=0x7faa4406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 -- 172.21.15.100:0/2201437687 shutdown_connections 2024-01-20T08:10:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.227+0000 7faa4c200640 1 -- 172.21.15.100:0/2201437687 wait complete. 2024-01-20T08:10:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.228+0000 7faa4c200640 1 Processor -- start 2024-01-20T08:10:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.229+0000 7faa4c200640 1 -- start start 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.229+0000 7faa4c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 0x7faa441517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.229+0000 7faa4c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440aae00 0x7faa44149d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.229+0000 7faa4c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.229+0000 7faa4c200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa441ec4a0 con 0x7faa4414fce0 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4414a8e0 con 0x7faa440aae00 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa441ec140 con 0x7faa440a93c0 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53466/0 (socket says 172.21.15.100:53466) 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 -- 172.21.15.100:0/3148780481 learned_addr learned my addr 172.21.15.100:0/3148780481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:34.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa49800640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 0x7faa441517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa48e00640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440aae00 0x7faa44149d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 -- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 msgr2=0x7faa441517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 0x7faa441517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 -- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440aae00 msgr2=0x7faa44149d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440aae00 0x7faa44149d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa4a200640 1 -- 172.21.15.100:0/3148780481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2c009400 con 0x7faa4414fce0 2024-01-20T08:10:34.234 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.230+0000 7faa49800640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 0x7faa441517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa4a200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e930 tx=0x7faa3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c009690 con 0x7faa4414fce0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3c00c980 con 0x7faa4414fce0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4414df60 con 0x7faa4414fce0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3c00cd30 con 0x7faa4414fce0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.231+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa441dbcf0 con 0x7faa4414fce0 2024-01-20T08:10:34.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.232+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa441ec5e0 con 0x7faa4414fce0 2024-01-20T08:10:34.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.233+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7faa3c013470 con 0x7faa4414fce0 2024-01-20T08:10:34.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.234+0000 7faa41600640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.234+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3c089830 con 0x7faa4414fce0 2024-01-20T08:10:34.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.234+0000 7faa49800640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.235+0000 7faa49800640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 0x7faa1c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa34005c00 tx=0x7faa34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.239+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7faa441ec5e0 con 0x7faa4414fce0 2024-01-20T08:10:34.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.432+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa441ec5e0 con 0x7faa4414fce0 2024-01-20T08:10:34.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.435+0000 7faa41600640 1 -- 172.21.15.100:0/3148780481 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7faa441ec5e0 con 0x7faa4414fce0 2024-01-20T08:10:34.439 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:34.439 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 msgr2=0x7faa1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 0x7faa1c06d390 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa34005c00 tx=0x7faa34009040 comp rx=0 tx=0).stop 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 msgr2=0x7faa4414a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7faa3c00e930 tx=0x7faa3c00edf0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 shutdown_connections 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faa4414fce0 0x7faa4414a280 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faa440aae00 0x7faa44149d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa1c06aed0 0x7faa1c06d390 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 --2- 172.21.15.100:0/3148780481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faa440a93c0 0x7faa441517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 >> 172.21.15.100:0/3148780481 conn(0x7faa4406a5e0 msgr2=0x7faa440c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 shutdown_connections 2024-01-20T08:10:34.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.438+0000 7faa4c200640 1 -- 172.21.15.100:0/3148780481 wait complete. 2024-01-20T08:10:34.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:34.460 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:34.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.664+0000 7f3bf7200640 1 Processor -- start 2024-01-20T08:10:34.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.665+0000 7f3bf7200640 1 -- start start 2024-01-20T08:10:34.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3bf7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3bf0157da0 0x7f3bf00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3bf7200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0158230 con 0x7f3bf0158af0 2024-01-20T08:10:34.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3bf7200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf0071d00 con 0x7f3bf00c24f0 2024-01-20T08:10:34.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3bf7200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf0154ca0 con 0x7f3bf0157da0 2024-01-20T08:10:34.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3befe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3bf0158af0 0x7f3bf006e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60908/0 (socket says 172.21.15.100:60908) 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3befe00640 1 -- 172.21.15.100:0/2730173150 learned_addr learned my addr 172.21.15.100:0/2730173150 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.666+0000 7f3bf5200640 1 --2- 172.21.15.100:0/2730173150 >> v2:172.21.15.100:3300/0 conn(0x7f3bf0157da0 0x7f3bf00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.667+0000 7f3bf5200640 1 -- 172.21.15.100:0/2730173150 >> v1:172.21.15.110:6789/0 conn(0x7f3bf00c24f0 legacy=0x7f3bf01550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.667+0000 7f3bef400640 1 -- 172.21.15.100:0/2730173150 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1890303991 0 0) 0x7f3bf0158230 con 0x7f3bf0158af0 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.667+0000 7f3bf5200640 1 -- 172.21.15.100:0/2730173150 >> v1:172.21.15.100:6789/0 conn(0x7f3bf0158af0 legacy=0x7f3bf006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.667+0000 7f3bf5200640 1 -- 172.21.15.100:0/2730173150 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf0071fa0 con 0x7f3bf0157da0 2024-01-20T08:10:34.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.668+0000 7f3bf5200640 1 --2- 172.21.15.100:0/2730173150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0157da0 0x7f3bf00c1850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c216d533c9bb325 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.668+0000 7f3bef400640 1 -- 172.21.15.100:0/2730173150 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be802cbd0 con 0x7f3bf0157da0 2024-01-20T08:10:34.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.668+0000 7f3bef400640 1 -- 172.21.15.100:0/2730173150 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be802cd30 con 0x7f3bf0157da0 2024-01-20T08:10:34.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.668+0000 7f3bef400640 1 -- 172.21.15.100:0/2730173150 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be802cea0 con 0x7f3bf0157da0 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 -- 172.21.15.100:0/2730173150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0157da0 msgr2=0x7f3bf00c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 --2- 172.21.15.100:0/2730173150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0157da0 0x7f3bf00c1850 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be802be20 comp rx=0 tx=0).stop 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 -- 172.21.15.100:0/2730173150 shutdown_connections 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 --2- 172.21.15.100:0/2730173150 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0157da0 0x7f3bf00c1850 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 -- 172.21.15.100:0/2730173150 >> 172.21.15.100:0/2730173150 conn(0x7f3bf00c2940 msgr2=0x7f3bf00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 -- 172.21.15.100:0/2730173150 shutdown_connections 2024-01-20T08:10:34.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.669+0000 7f3bf7200640 1 -- 172.21.15.100:0/2730173150 wait complete. 2024-01-20T08:10:34.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.671+0000 7f3bf7200640 1 Processor -- start 2024-01-20T08:10:34.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.671+0000 7f3bf7200640 1 -- start start 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf00c24f0 0x7f3bf01edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 0x7f3bf0149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014f010 con 0x7f3bf0158af0 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014f2b0 con 0x7f3bf0157da0 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf014f590 con 0x7f3bf00c24f0 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53474/0 (socket says 172.21.15.100:53474) 2024-01-20T08:10:34.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf5200640 1 -- 172.21.15.100:0/1259960696 learned_addr learned my addr 172.21.15.100:0/1259960696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3be7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 0x7f3bf0149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3befe00640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf00c24f0 0x7f3bf01edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf5200640 1 -- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf00c24f0 msgr2=0x7f3bf01edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.672+0000 7f3bf5200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf00c24f0 0x7f3bf01edc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf5200640 1 -- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 msgr2=0x7f3bf0149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf5200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 0x7f3bf0149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf5200640 1 -- 172.21.15.100:0/1259960696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009a70 con 0x7f3bf0158af0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3be7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 0x7f3bf0149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf5200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be802cea0 con 0x7f3bf0158af0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be8003bb0 con 0x7f3bf0158af0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8004030 con 0x7f3bf0158af0 2024-01-20T08:10:34.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf0155c40 con 0x7f3bf0158af0 2024-01-20T08:10:34.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.673+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf014f870 con 0x7f3bf0158af0 2024-01-20T08:10:34.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.675+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf0155e30 con 0x7f3bf0158af0 2024-01-20T08:10:34.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.675+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3be80043a0 con 0x7f3bf0158af0 2024-01-20T08:10:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.677+0000 7f3becc00640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 0x7f3bc806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.677+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3be80ac1c0 con 0x7f3bf0158af0 2024-01-20T08:10:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.677+0000 7f3befe00640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 0x7f3bc806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:34.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.678+0000 7f3befe00640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 0x7f3bc806d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000f60 tx=0x7f3be0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:34.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.681+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3be8077080 con 0x7f3bf0158af0 2024-01-20T08:10:34.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.869+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bf004e970 con 0x7f3bf0158af0 2024-01-20T08:10:34.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.870+0000 7f3becc00640 1 -- 172.21.15.100:0/1259960696 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3be807a6a0 con 0x7f3bf0158af0 2024-01-20T08:10:34.873 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.872+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 msgr2=0x7f3bc806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.872+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 0x7f3bc806d3c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3be0000f60 tx=0x7f3be0009040 comp rx=0 tx=0).stop 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 msgr2=0x7f3bf0156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3be8009d90 tx=0x7f3be8004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 shutdown_connections 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3bf0158af0 0x7f3bf0156160 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3bf0157da0 0x7f3bf0149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bc806af00 0x7f3bc806d3c0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 --2- 172.21.15.100:0/1259960696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3bf00c24f0 0x7f3bf01edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 >> 172.21.15.100:0/1259960696 conn(0x7f3bf00c2940 msgr2=0x7f3bf01538d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 shutdown_connections 2024-01-20T08:10:34.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:34.873+0000 7f3bf7200640 1 -- 172.21.15.100:0/1259960696 wait complete. 2024-01-20T08:10:34.894 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.098+0000 7fc4f2200640 1 Processor -- start 2024-01-20T08:10:35.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.098+0000 7fc4f2200640 1 -- start start 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.099+0000 7fc4f2200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 0x7fc4ec153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4f2200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4f2200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4ec0ab620 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4f2200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4ec14cb30 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4f2200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec0ab900 con 0x7fc4ec14c750 2024-01-20T08:10:35.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53486/0 (socket says 172.21.15.100:53486) 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 -- 172.21.15.100:0/3180579483 learned_addr learned my addr 172.21.15.100:0/3180579483 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eb400640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 0x7fc4ec153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 -- 172.21.15.100:0/3180579483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 msgr2=0x7fc4ec153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 0x7fc4ec153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 -- 172.21.15.100:0/3180579483 >> v1:172.21.15.110:6789/0 conn(0x7fc4ec0a96f0 legacy=0x7fc4ec0715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eaa00640 1 -- 172.21.15.100:0/3180579483 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4ec0abbe0 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.100+0000 7fc4eb400640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 0x7fc4ec153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.101+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009870 tx=0x7fc4d402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88fea402e78b49ef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4ea000640 1 -- 172.21.15.100:0/3180579483 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4031640 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4ea000640 1 -- 172.21.15.100:0/3180579483 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4d40317a0 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4ea000640 1 -- 172.21.15.100:0/3180579483 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d4031b30 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 -- 172.21.15.100:0/3180579483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0ab0b0 msgr2=0x7fc4ec0a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4009870 tx=0x7fc4d402b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 -- 172.21.15.100:0/3180579483 shutdown_connections 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0ab0b0 0x7fc4ec0a91b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 --2- 172.21.15.100:0/3180579483 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec14c750 0x7fc4ec153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.102+0000 7fc4f2200640 1 -- 172.21.15.100:0/3180579483 >> 172.21.15.100:0/3180579483 conn(0x7fc4ec0c6090 msgr2=0x7fc4ec0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.103+0000 7fc4f2200640 1 -- 172.21.15.100:0/3180579483 shutdown_connections 2024-01-20T08:10:35.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.103+0000 7fc4f2200640 1 -- 172.21.15.100:0/3180579483 wait complete. 2024-01-20T08:10:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.104+0000 7fc4f2200640 1 Processor -- start 2024-01-20T08:10:35.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.104+0000 7fc4f2200640 1 -- start start 2024-01-20T08:10:35.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 0x7fc4ec1418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 0x7fc4ec141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec06dfb0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec142350 con 0x7fc4ec14c750 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4f2200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4ec1ea2e0 con 0x7fc4ec0ab0b0 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4eb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4eb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53494/0 (socket says 172.21.15.100:53494) 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.105+0000 7fc4eb400640 1 -- 172.21.15.100:0/519005819 learned_addr learned my addr 172.21.15.100:0/519005819 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 0x7fc4ec1418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 -- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 msgr2=0x7fc4ec1418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 0x7fc4ec1418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 -- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 msgr2=0x7fc4ec141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4ebe00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 0x7fc4ec141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 0x7fc4ec141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 -- 172.21.15.100:0/519005819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d40094d0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 0x7fc4ec1418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4ebe00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 0x7fc4ec141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4eb400640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c7f0 tx=0x7fc4dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc007820 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4dc007980 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.106+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4dc007cf0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.107+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4ec1edce0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.107+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4ec1ee2a0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.108+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4ec0c5cf0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.109+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc4dc0113f0 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.109+0000 7fc4e3400640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 0x7fc4c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.109+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4dc089940 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.110+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 0x7fc4c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.110+0000 7fc4eaa00640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 0x7fc4c406d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4036000 tx=0x7fc4d403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.114+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc4dc054800 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.292+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4ec04ea50 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.293+0000 7fc4e3400640 1 -- 172.21.15.100:0/519005819 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4dc01f020 con 0x7fc4ec0a96f0 2024-01-20T08:10:35.296 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 msgr2=0x7fc4c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 0x7fc4c406d390 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4036000 tx=0x7fc4d403c040 comp rx=0 tx=0).stop 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 msgr2=0x7fc4ec0bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc4dc00c7f0 tx=0x7fc4dc00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 shutdown_connections 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4ec14c750 0x7fc4ec141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4c406aed0 0x7fc4c406d390 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4ec0ab0b0 0x7fc4ec1418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 --2- 172.21.15.100:0/519005819 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4ec0a96f0 0x7fc4ec0bf4c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 >> 172.21.15.100:0/519005819 conn(0x7fc4ec0c6090 msgr2=0x7fc4ec1523e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 shutdown_connections 2024-01-20T08:10:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.296+0000 7fc4f2200640 1 -- 172.21.15.100:0/519005819 wait complete. 2024-01-20T08:10:35.316 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:35.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.524+0000 7fd619e00640 1 Processor -- start 2024-01-20T08:10:35.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.524+0000 7fd619e00640 1 -- start start 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.525+0000 7fd619e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 0x7fd6141515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.525+0000 7fd619e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6140c1850 0x7fd6140c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.525+0000 7fd619e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61406cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd619e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd61414bb00 con 0x7fd6140c1850 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd619e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd614154ba0 con 0x7fd61414b720 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd619e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd614155a00 con 0x7fd61406c8d0 2024-01-20T08:10:35.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6140c1850 0x7fd6140c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6140c1850 0x7fd6140c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53502/0 (socket says 172.21.15.100:53502) 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 -- 172.21.15.100:0/4096643543 learned_addr learned my addr 172.21.15.100:0/4096643543 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 -- 172.21.15.100:0/4096643543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 msgr2=0x7fd61406cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612a00640 1 --2- 172.21.15.100:0/4096643543 >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 0x7fd6141515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 --2- 172.21.15.100:0/4096643543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61406cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 -- 172.21.15.100:0/4096643543 >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 msgr2=0x7fd6141515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 --2- 172.21.15.100:0/4096643543 >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 0x7fd6141515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612000640 1 -- 172.21.15.100:0/4096643543 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd614154df0 con 0x7fd6140c1850 2024-01-20T08:10:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.526+0000 7fd612a00640 1 --2- 172.21.15.100:0/4096643543 >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 0x7fd6141515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.527+0000 7fd612000640 1 --2- 172.21.15.100:0/4096643543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6140c1850 0x7fd6140c1d00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd61406be40 tx=0x7fd5fc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3e33f4dc91c585 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.528+0000 7fd611600640 1 -- 172.21.15.100:0/4096643543 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc0317d0 con 0x7fd6140c1850 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.528+0000 7fd611600640 1 -- 172.21.15.100:0/4096643543 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc031930 con 0x7fd6140c1850 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.528+0000 7fd611600640 1 -- 172.21.15.100:0/4096643543 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031cc0 con 0x7fd6140c1850 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.528+0000 7fd619e00640 1 -- 172.21.15.100:0/4096643543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6140c1850 msgr2=0x7fd6140c1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.528+0000 7fd619e00640 1 --2- 172.21.15.100:0/4096643543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6140c1850 0x7fd6140c1d00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd61406be40 tx=0x7fd5fc02b870 comp rx=0 tx=0).stop 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 -- 172.21.15.100:0/4096643543 shutdown_connections 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 --2- 172.21.15.100:0/4096643543 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 --2- 172.21.15.100:0/4096643543 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6140c1850 0x7fd6140c1d00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 --2- 172.21.15.100:0/4096643543 >> v2:172.21.15.110:3300/0 conn(0x7fd61414b720 0x7fd6141515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 -- 172.21.15.100:0/4096643543 >> 172.21.15.100:0/4096643543 conn(0x7fd6140c2940 msgr2=0x7fd6140c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 -- 172.21.15.100:0/4096643543 shutdown_connections 2024-01-20T08:10:35.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.529+0000 7fd619e00640 1 -- 172.21.15.100:0/4096643543 wait complete. 2024-01-20T08:10:35.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.531+0000 7fd619e00640 1 Processor -- start 2024-01-20T08:10:35.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.531+0000 7fd619e00640 1 -- start start 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61414c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c1850 0x7fd61414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141eacf0 con 0x7fd61414b720 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6141eb220 con 0x7fd6140c1850 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd619e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd61414e470 con 0x7fd61406c8d0 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd613400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd613400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53516/0 (socket says 172.21.15.100:53516) 2024-01-20T08:10:35.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.532+0000 7fd613400640 1 -- 172.21.15.100:0/4064408354 learned_addr learned my addr 172.21.15.100:0/4064408354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd612000640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c1850 0x7fd61414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd612a00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61414c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 -- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 msgr2=0x7fd61414c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61414c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 -- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c1850 msgr2=0x7fd61414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c1850 0x7fd61414e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 -- 172.21.15.100:0/4064408354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0094d0 con 0x7fd61414b720 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd613400640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00b9d0 tx=0x7fd60c00be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c00cbd0 con 0x7fd61414b720 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00cd50 con 0x7fd61414b720 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c014680 con 0x7fd61414b720 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.533+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd614148490 con 0x7fd61414b720 2024-01-20T08:10:35.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.534+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd61414e100 con 0x7fd61414b720 2024-01-20T08:10:35.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.535+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd61414df40 con 0x7fd61414b720 2024-01-20T08:10:35.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.536+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd60c01d3b0 con 0x7fd61414b720 2024-01-20T08:10:35.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.537+0000 7fd60b400640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 0x7fd5ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.537+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd60c089650 con 0x7fd61414b720 2024-01-20T08:10:35.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.537+0000 7fd612a00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 0x7fd5ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.537+0000 7fd612a00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 0x7fd5ec06d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6140bfa20 tx=0x7fd604008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.543 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.541+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd60c054480 con 0x7fd61414b720 2024-01-20T08:10:35.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.733+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd61406da10 con 0x7fd61414b720 2024-01-20T08:10:35.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.734+0000 7fd60b400640 1 -- 172.21.15.100:0/4064408354 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd60c057aa0 con 0x7fd61414b720 2024-01-20T08:10:35.737 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 msgr2=0x7fd5ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 0x7fd5ec06d390 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fd6140bfa20 tx=0x7fd604008040 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 msgr2=0x7fd61414ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00b9d0 tx=0x7fd60c00be90 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 shutdown_connections 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd61414b720 0x7fd61414ee40 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6140c1850 0x7fd61414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5ec06aed0 0x7fd5ec06d390 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 --2- 172.21.15.100:0/4064408354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd61406c8d0 0x7fd61414c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.736+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 >> 172.21.15.100:0/4064408354 conn(0x7fd6140c2940 msgr2=0x7fd6140c3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.737+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 shutdown_connections 2024-01-20T08:10:35.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.737+0000 7fd619e00640 1 -- 172.21.15.100:0/4064408354 wait complete. 2024-01-20T08:10:35.759 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:35.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:10:35.857 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:10:35.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.966+0000 7f81bce00640 1 Processor -- start 2024-01-20T08:10:35.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.966+0000 7f81bce00640 1 -- start start 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81bce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f81b8155250 0x7f81b8155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81bce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f81b8151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81bce00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b80c8650 con 0x7f81b806b3b0 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81bce00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81b80c8070 con 0x7f81b8155250 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81bce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c4dd0 con 0x7f81b81519a0 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81b5e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f81b806b3b0 0x7f81b80c8ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60912/0 (socket says 172.21.15.100:60912) 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.967+0000 7f81b5e00640 1 -- 172.21.15.100:0/340451220 learned_addr learned my addr 172.21.15.100:0/340451220 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81afe00640 1 --2- 172.21.15.100:0/340451220 >> v2:172.21.15.110:3300/0 conn(0x7f81b8155250 0x7f81b8155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399154064 0 0) 0x7f81b80c8650 con 0x7f81b806b3b0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b6800640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f81b8151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8198003520 con 0x7f81b806b3b0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4205165298 0 0) 0x7f8198003520 con 0x7f81b806b3b0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 msgr2=0x7f81b8151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f81b8151da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 >> v2:172.21.15.110:3300/0 conn(0x7f81b8155250 msgr2=0x7f81b8155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 --2- 172.21.15.100:0/340451220 >> v2:172.21.15.110:3300/0 conn(0x7f81b8155250 0x7f81b8155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80c82e0 con 0x7f81b806b3b0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f81a8001670 con 0x7f81b806b3b0 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 >> v1:172.21.15.100:6789/0 conn(0x7f81b806b3b0 legacy=0x7f81b80c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f8198003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8198003f40 0x7f81980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.968+0000 7f81b5400640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198004d00 0x7f8198005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c8070 con 0x7f8198003f40 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b80c4dd0 con 0x7f8198004d00 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819800ba30 con 0x7f81b81519a0 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8198003f40 0x7f81980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81b5e00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f8198003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 -- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 msgr2=0x7f8198003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b81519a0 0x7f8198003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 -- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198004d00 msgr2=0x7f8198005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198004d00 0x7f8198005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.969+0000 7f81afe00640 1 -- 172.21.15.100:0/340451220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8198003520 con 0x7f8198003f40 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.970+0000 7f81afe00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8198003f40 0x7f81980047c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009ac0 tx=0x7f81980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47bd407414b14db7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a002c710 con 0x7f8198003f40 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a002c870 con 0x7f8198003f40 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81b5400640 1 -- 172.21.15.100:0/340451220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a002cc00 con 0x7f8198003f40 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 -- 172.21.15.100:0/340451220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8198003f40 msgr2=0x7f81980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 --2- 172.21.15.100:0/340451220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8198003f40 0x7f81980047c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f81a0009ac0 tx=0x7f81980057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81b6800640 1 -- 172.21.15.100:0/340451220 reap_dead start 2024-01-20T08:10:35.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 -- 172.21.15.100:0/340451220 shutdown_connections 2024-01-20T08:10:35.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 -- 172.21.15.100:0/340451220 >> 172.21.15.100:0/340451220 conn(0x7f81b80abc00 msgr2=0x7f81b80ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:35.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 -- 172.21.15.100:0/340451220 shutdown_connections 2024-01-20T08:10:35.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.971+0000 7f81bce00640 1 -- 172.21.15.100:0/340451220 wait complete. 2024-01-20T08:10:35.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.973+0000 7f81bce00640 1 Processor -- start 2024-01-20T08:10:35.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.973+0000 7f81bce00640 1 -- start start 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198003f40 0x7f81b80c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b80c0960 0x7f81b81485f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81eab80 con 0x7f81b80c0410 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b81eb0b0 con 0x7f8198003f40 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81bce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b8149070 con 0x7f81b80c0960 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53532/0 (socket says 172.21.15.100:53532) 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.974+0000 7f81b6800640 1 -- 172.21.15.100:0/576774379 learned_addr learned my addr 172.21.15.100:0/576774379 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b5e00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198003f40 0x7f81b80c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81afe00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b80c0960 0x7f81b81485f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 -- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b80c0960 msgr2=0x7f81b81485f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b80c0960 0x7f81b81485f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 -- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198003f40 msgr2=0x7f81b80c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:35.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198003f40 0x7f81b80c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:35.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 -- 172.21.15.100:0/576774379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b80c6b50 con 0x7f81b80c0410 2024-01-20T08:10:35.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81b6800640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f81b000ee50 tx=0x7f81b000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.975+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0010040 con 0x7f81b80c0410 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.976+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b000bbf0 con 0x7f81b80c0410 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.976+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b0014400 con 0x7f81b80c0410 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.976+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b80c6e30 con 0x7f81b80c0410 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.976+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b814be10 con 0x7f81b80c0410 2024-01-20T08:10:35.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.977+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b804e970 con 0x7f81b80c0410 2024-01-20T08:10:35.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.978+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f81b0014560 con 0x7f81b80c0410 2024-01-20T08:10:35.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.979+0000 7f81ae000640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 0x7f819006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:35.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.979+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81b0089f70 con 0x7f81b80c0410 2024-01-20T08:10:35.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.979+0000 7f81b5e00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 0x7f819006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:35.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.980+0000 7f81b5e00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 0x7f819006d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000c00 tx=0x7f81a8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:35.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:35.982+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f81b0054fb0 con 0x7f81b80c0410 2024-01-20T08:10:36.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.177+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f81b80c9b80 con 0x7f81b80c0410 2024-01-20T08:10:36.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.180+0000 7f81ae000640 1 -- 172.21.15.100:0/576774379 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f81b00585d0 con 0x7f81b80c0410 2024-01-20T08:10:36.183 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:36.183 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:36.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.182+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 msgr2=0x7f819006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.182+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 0x7f819006d3c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f81a8000c00 tx=0x7f81a8009040 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.182+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 msgr2=0x7f81b8148b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.182+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f81b000ee50 tx=0x7f81b000b480 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 shutdown_connections 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f81b80c0410 0x7f81b8148b30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f819006af00 0x7f819006d3c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f81b80c0960 0x7f81b81485f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 --2- 172.21.15.100:0/576774379 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8198003f40 0x7f81b80c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 >> 172.21.15.100:0/576774379 conn(0x7f81b80abc00 msgr2=0x7f81b8154840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 shutdown_connections 2024-01-20T08:10:36.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.183+0000 7f81bce00640 1 -- 172.21.15.100:0/576774379 wait complete. 2024-01-20T08:10:36.205 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:36.206 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.462+0000 7f5959a00640 1 Processor -- start 2024-01-20T08:10:36.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.462+0000 7f5959a00640 1 -- start start 2024-01-20T08:10:36.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.463+0000 7f5959a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f595414b720 0x7f59541515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.463+0000 7f5959a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f59540c1850 0x7f59540c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.463+0000 7f5959a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5954154ba0 con 0x7f595406c8d0 2024-01-20T08:10:36.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.463+0000 7f5959a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f595414bb00 con 0x7f595414b720 2024-01-20T08:10:36.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.463+0000 7f5959a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5954155a00 con 0x7f59540c1850 2024-01-20T08:10:36.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5953400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f595406c8d0 0x7f595406cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60920/0 (socket says 172.21.15.100:60920) 2024-01-20T08:10:36.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f595414b720 0x7f59541515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5953400640 1 -- 172.21.15.100:0/1634304030 learned_addr learned my addr 172.21.15.100:0/1634304030 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5949e00640 1 --2- 172.21.15.100:0/1634304030 >> v2:172.21.15.110:3300/0 conn(0x7f59540c1850 0x7f59540c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952a00640 1 -- 172.21.15.100:0/1634304030 >> v2:172.21.15.110:3300/0 conn(0x7f59540c1850 msgr2=0x7f59540c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952a00640 1 --2- 172.21.15.100:0/1634304030 >> v2:172.21.15.110:3300/0 conn(0x7f59540c1850 0x7f59540c1d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952a00640 1 -- 172.21.15.100:0/1634304030 >> v1:172.21.15.100:6789/0 conn(0x7f595406c8d0 legacy=0x7f595406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952a00640 1 -- 172.21.15.100:0/1634304030 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5954154df0 con 0x7f595414b720 2024-01-20T08:10:36.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.464+0000 7f5952000640 1 -- 172.21.15.100:0/1634304030 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232302371 0 0) 0x7f5954154ba0 con 0x7f595406c8d0 2024-01-20T08:10:36.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.465+0000 7f5952a00640 1 --2- 172.21.15.100:0/1634304030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595414b720 0x7f59541515b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59540ac030 tx=0x7f594402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adb914d1ed5134b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5952000640 1 -- 172.21.15.100:0/1634304030 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594402e070 con 0x7f595414b720 2024-01-20T08:10:36.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5952000640 1 -- 172.21.15.100:0/1634304030 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59440315a0 con 0x7f595414b720 2024-01-20T08:10:36.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5952000640 1 -- 172.21.15.100:0/1634304030 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944031930 con 0x7f595414b720 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 -- 172.21.15.100:0/1634304030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595414b720 msgr2=0x7f59541515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 --2- 172.21.15.100:0/1634304030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595414b720 0x7f59541515b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f59540ac030 tx=0x7f594402b840 comp rx=0 tx=0).stop 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 -- 172.21.15.100:0/1634304030 shutdown_connections 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 --2- 172.21.15.100:0/1634304030 >> v2:172.21.15.110:3300/0 conn(0x7f59540c1850 0x7f59540c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 --2- 172.21.15.100:0/1634304030 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595414b720 0x7f59541515b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 -- 172.21.15.100:0/1634304030 >> 172.21.15.100:0/1634304030 conn(0x7f59540c2940 msgr2=0x7f59540c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.466+0000 7f5959a00640 1 -- 172.21.15.100:0/1634304030 shutdown_connections 2024-01-20T08:10:36.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.467+0000 7f5959a00640 1 -- 172.21.15.100:0/1634304030 wait complete. 2024-01-20T08:10:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.468+0000 7f5959a00640 1 Processor -- start 2024-01-20T08:10:36.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.468+0000 7f5959a00640 1 -- start start 2024-01-20T08:10:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 0x7f59541db4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f595414b720 0x7f59541db9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541dc9b0 con 0x7f595406c8d0 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541dcc90 con 0x7f59540c1850 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5959a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59541dacb0 con 0x7f595414b720 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5952a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5952a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53558/0 (socket says 172.21.15.100:53558) 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.469+0000 7f5952a00640 1 -- 172.21.15.100:0/3953802383 learned_addr learned my addr 172.21.15.100:0/3953802383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5949e00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 0x7f59541db4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 -- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f595414b720 msgr2=0x7f59541db9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f595414b720 0x7f59541db9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 -- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 msgr2=0x7f59541db4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 0x7f59541db4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 -- 172.21.15.100:0/3953802383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009400 con 0x7f595406c8d0 2024-01-20T08:10:36.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5949e00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 0x7f59541db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:36.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5952a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5944000c00 tx=0x7f59440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944032900 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5944032a60 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944032dd0 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.470+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59541daf90 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.471+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59541dc640 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.472+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595404e970 con 0x7f595406c8d0 2024-01-20T08:10:36.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.473+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f594404d3f0 con 0x7f595406c8d0 2024-01-20T08:10:36.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.474+0000 7f594b400640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 0x7f592c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.474+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59440ab320 con 0x7f595406c8d0 2024-01-20T08:10:36.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.474+0000 7f5949e00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 0x7f592c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.475+0000 7f5949e00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 0x7f592c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59540bbac0 tx=0x7f593c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.478+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5944076300 con 0x7f595406c8d0 2024-01-20T08:10:36.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.672+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5954070310 con 0x7f595406c8d0 2024-01-20T08:10:36.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.674+0000 7f594b400640 1 -- 172.21.15.100:0/3953802383 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5944079920 con 0x7f595406c8d0 2024-01-20T08:10:36.677 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 msgr2=0x7f592c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 0x7f592c06d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f59540bbac0 tx=0x7f593c008040 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 msgr2=0x7f59540aaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5944000c00 tx=0x7f59440046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 shutdown_connections 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f592c06aed0 0x7f592c06d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f595414b720 0x7f59541db9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59540c1850 0x7f59541db4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 --2- 172.21.15.100:0/3953802383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f595406c8d0 0x7f59540aaad0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 >> 172.21.15.100:0/3953802383 conn(0x7f59540c2940 msgr2=0x7f595406cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 shutdown_connections 2024-01-20T08:10:36.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.677+0000 7f5959a00640 1 -- 172.21.15.100:0/3953802383 wait complete. 2024-01-20T08:10:36.699 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.913+0000 7ff5dbc00640 1 Processor -- start 2024-01-20T08:10:36.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.913+0000 7ff5dbc00640 1 -- start start 2024-01-20T08:10:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d414c750 0x7ff5d4153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 0x7ff5d40a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5d40a96f0 0x7ff5d40715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d414cb30 con 0x7ff5d40a96f0 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5d40ab620 con 0x7ff5d40ab0b0 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5dbc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d40ab900 con 0x7ff5d414c750 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5d9c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5d40a96f0 0x7ff5d40715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5d9c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff5d40a96f0 0x7ff5d40715a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53574/0 (socket says 172.21.15.100:53574) 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.915+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2842711936 learned_addr learned my addr 172.21.15.100:0/2842711936 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9200640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d414c750 0x7ff5d4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d3e00640 1 --2- 172.21.15.100:0/2842711936 >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 0x7ff5d40a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2842711936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d414c750 msgr2=0x7ff5d4153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d414c750 0x7ff5d4153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2842711936 >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 msgr2=0x7ff5d40a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2842711936 >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 0x7ff5d40a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2842711936 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d40abbe0 con 0x7ff5d40a96f0 2024-01-20T08:10:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.916+0000 7ff5d3e00640 1 --2- 172.21.15.100:0/2842711936 >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 0x7ff5d40a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.917+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d40a96f0 0x7ff5d40715a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c2af0 tx=0x7ff5cc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bca972253e707b1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5d3400640 1 -- 172.21.15.100:0/2842711936 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc02ca70 con 0x7ff5d40a96f0 2024-01-20T08:10:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5d3400640 1 -- 172.21.15.100:0/2842711936 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc02cbd0 con 0x7ff5d40a96f0 2024-01-20T08:10:36.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5d3400640 1 -- 172.21.15.100:0/2842711936 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0343f0 con 0x7ff5d40a96f0 2024-01-20T08:10:36.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2842711936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d40a96f0 msgr2=0x7ff5d40715a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d40a96f0 0x7ff5d40715a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff5d40c2af0 tx=0x7ff5cc02bed0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2842711936 shutdown_connections 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d40a96f0 0x7ff5d40715a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2842711936 >> v2:172.21.15.110:3300/0 conn(0x7ff5d40ab0b0 0x7ff5d40a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2842711936 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d414c750 0x7ff5d4153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2842711936 >> 172.21.15.100:0/2842711936 conn(0x7ff5d40c6090 msgr2=0x7ff5d40c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.918+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2842711936 shutdown_connections 2024-01-20T08:10:36.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.919+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2842711936 wait complete. 2024-01-20T08:10:36.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.920+0000 7ff5dbc00640 1 Processor -- start 2024-01-20T08:10:36.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.921+0000 7ff5dbc00640 1 -- start start 2024-01-20T08:10:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d40a96f0 0x7ff5d4145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 0x7ff5d4144900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d414b6c0 con 0x7ff5d414c750 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4154550 con 0x7ff5d40ab0b0 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5dbc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4144e40 con 0x7ff5d40a96f0 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5d9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5d9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53582/0 (socket says 172.21.15.100:53582) 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2237958661 learned_addr learned my addr 172.21.15.100:0/2237958661 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5d9200640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d40a96f0 0x7ff5d4145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.922+0000 7ff5d3e00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 0x7ff5d4144900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d40a96f0 msgr2=0x7ff5d4145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d40a96f0 0x7ff5d4145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 msgr2=0x7ff5d4144900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 0x7ff5d4144900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:36.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 -- 172.21.15.100:0/2237958661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5cc009b30 con 0x7ff5d414c750 2024-01-20T08:10:36.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d3e00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 0x7ff5d4144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:36.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d9c00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc036040 tx=0x7ff5cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc009510 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5cc03e450 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc03e800 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d41ed870 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.923+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d41ede30 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.925+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d414b800 con 0x7ff5d414c750 2024-01-20T08:10:36.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.926+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff5cc03e960 con 0x7ff5d414c750 2024-01-20T08:10:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.927+0000 7ff5d0c00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 0x7ff5ac06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:36.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.927+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5cc0ac2b0 con 0x7ff5d414c750 2024-01-20T08:10:36.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.927+0000 7ff5d9200640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 0x7ff5ac06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:36.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.928+0000 7ff5d9200640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 0x7ff5ac06d3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4006fd0 tx=0x7ff5c4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:36.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:36.932+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff5cc0772f0 con 0x7ff5d414c750 2024-01-20T08:10:37.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.118+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff5d404ea50 con 0x7ff5d414c750 2024-01-20T08:10:37.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.119+0000 7ff5d0c00640 1 -- 172.21.15.100:0/2237958661 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff5cc07a910 con 0x7ff5d414c750 2024-01-20T08:10:37.122 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:37.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 msgr2=0x7ff5ac06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 0x7ff5ac06d3e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4006fd0 tx=0x7ff5c4008040 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 msgr2=0x7ff5d40bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc036040 tx=0x7ff5cc004a40 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 shutdown_connections 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff5d414c750 0x7ff5d40bf4c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.121+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff5d40ab0b0 0x7ff5d4144900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.122+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5ac06af20 0x7ff5ac06d3e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.122+0000 7ff5dbc00640 1 --2- 172.21.15.100:0/2237958661 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff5d40a96f0 0x7ff5d4145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.122+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 >> 172.21.15.100:0/2237958661 conn(0x7ff5d40c6090 msgr2=0x7ff5d4071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.122+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 shutdown_connections 2024-01-20T08:10:37.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.122+0000 7ff5dbc00640 1 -- 172.21.15.100:0/2237958661 wait complete. 2024-01-20T08:10:37.143 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:37.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.342+0000 7f0edae00640 1 Processor -- start 2024-01-20T08:10:37.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.342+0000 7f0edae00640 1 -- start start 2024-01-20T08:10:37.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.343+0000 7f0edae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0ed41515b0 0x7f0ed406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0edae00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4154ba0 con 0x7f0ed406ce10 2024-01-20T08:10:37.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0edae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ed4155a00 con 0x7f0ed414b720 2024-01-20T08:10:37.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0edae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ed414bb00 con 0x7f0ed41515b0 2024-01-20T08:10:37.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0ed8e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0ed406ce10 0x7f0ed415bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60924/0 (socket says 172.21.15.100:60924) 2024-01-20T08:10:37.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0ed8e00640 1 -- 172.21.15.100:0/2110344942 learned_addr learned my addr 172.21.15.100:0/2110344942 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:37.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357902718 0 0) 0x7f0ed4154ba0 con 0x7f0ed406ce10 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0eb4003520 con 0x7f0ed406ce10 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.344+0000 7f0ecb200640 1 --2- 172.21.15.100:0/2110344942 >> v2:172.21.15.110:3300/0 conn(0x7f0ed41515b0 0x7f0ed406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 949932196 0 0) 0x7f0eb4003520 con 0x7f0ed406ce10 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 >> v2:172.21.15.110:3300/0 conn(0x7f0ed41515b0 msgr2=0x7f0ed406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 --2- 172.21.15.100:0/2110344942 >> v2:172.21.15.110:3300/0 conn(0x7f0ed41515b0 0x7f0ed406c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 >> v1:172.21.15.110:6789/0 conn(0x7f0ed414b720 legacy=0x7f0ed40c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4154df0 con 0x7f0ed406ce10 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f0ecc0019f0 con 0x7f0ed406ce10 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 >> v1:172.21.15.100:6789/0 conn(0x7f0ed406ce10 legacy=0x7f0ed415bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb40039c0 0x7f0eb4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40047c0 0x7f0eb4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0eb400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed414bb00 con 0x7f0eb40052a0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400e3d0 con 0x7f0eb40039c0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb400e590 con 0x7f0eb40047c0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.345+0000 7f0ed8e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0eb400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 -- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40047c0 msgr2=0x7f0eb4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0eb40047c0 0x7f0eb4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 -- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb40039c0 msgr2=0x7f0eb4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed3e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb40039c0 0x7f0eb4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb40039c0 0x7f0eb4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 -- 172.21.15.100:0/2110344942 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb4003520 con 0x7f0eb40052a0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed3e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0eb40039c0 0x7f0eb4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.346+0000 7f0ed8e00640 1 -- 172.21.15.100:0/2110344942 reap_dead start 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0ed8e00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0eb400db90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00a760 tx=0x7f0eb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe84de79907b33a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc034630 con 0x7f0eb40052a0 2024-01-20T08:10:37.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ecc02f070 con 0x7f0eb40052a0 2024-01-20T08:10:37.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0ed3400640 1 -- 172.21.15.100:0/2110344942 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc034a10 con 0x7f0eb40052a0 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0edae00640 1 -- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 msgr2=0x7f0eb400db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0edae00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0eb400db90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc00a760 tx=0x7f0eb40057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0edae00640 1 -- 172.21.15.100:0/2110344942 shutdown_connections 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0edae00640 1 --2- 172.21.15.100:0/2110344942 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0eb400db90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.347+0000 7f0edae00640 1 -- 172.21.15.100:0/2110344942 >> 172.21.15.100:0/2110344942 conn(0x7f0ed40c2940 msgr2=0x7f0ed40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.348+0000 7f0edae00640 1 -- 172.21.15.100:0/2110344942 shutdown_connections 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.348+0000 7f0edae00640 1 -- 172.21.15.100:0/2110344942 wait complete. 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.349+0000 7f0edae00640 1 Processor -- start 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.349+0000 7f0edae00640 1 -- start start 2024-01-20T08:10:37.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ed4154560 0x7f0ed41e5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed41e6480 0x7f0ed4071260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40ab970 con 0x7f0eb40052a0 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed41e5a40 con 0x7f0ed41e6480 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.350+0000 7f0edae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed4154210 con 0x7f0ed4154560 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53606/0 (socket says 172.21.15.100:53606) 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 -- 172.21.15.100:0/3306010406 learned_addr learned my addr 172.21.15.100:0/3306010406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ecb200640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ed4154560 0x7f0ed41e5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 -- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ed4154560 msgr2=0x7f0ed41e5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ed4154560 0x7f0ed41e5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 -- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed41e6480 msgr2=0x7f0ed4071260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed41e6480 0x7f0ed4071260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 -- 172.21.15.100:0/3306010406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4153f30 con 0x7f0eb40052a0 2024-01-20T08:10:37.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed3e00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d7a0 tx=0x7f0ec400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.351+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4017070 con 0x7f0eb40052a0 2024-01-20T08:10:37.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.352+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec4005070 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.352+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4005420 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.352+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed41e9ae0 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.352+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed4143390 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.353+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed41e5bb0 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.354+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0ec4007030 con 0x7f0eb40052a0 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.354+0000 7f0ed0c00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 0x7f0eac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.355+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ec4088f50 con 0x7f0eb40052a0 2024-01-20T08:10:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.355+0000 7f0ecb200640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 0x7f0eac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.355+0000 7f0ecb200640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 0x7f0eac06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ed414a940 tx=0x7f0ebc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.359+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0ec4053e10 con 0x7f0eb40052a0 2024-01-20T08:10:37.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.551+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0ed404e970 con 0x7f0eb40052a0 2024-01-20T08:10:37.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.552+0000 7f0ed0c00640 1 -- 172.21.15.100:0/3306010406 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ec4057430 con 0x7f0eb40052a0 2024-01-20T08:10:37.555 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:37.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.554+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 msgr2=0x7f0eac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.554+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 0x7f0eac06d390 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0ed414a940 tx=0x7f0ebc008040 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.554+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 msgr2=0x7f0ed40ab430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.554+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0ec400d7a0 tx=0x7f0ec400dc60 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.554+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 shutdown_connections 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0ed41e6480 0x7f0ed4071260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0eac06aed0 0x7f0eac06d390 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0ed4154560 0x7f0ed41e5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 --2- 172.21.15.100:0/3306010406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0eb40052a0 0x7f0ed40ab430 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 >> 172.21.15.100:0/3306010406 conn(0x7f0ed40c2940 msgr2=0x7f0ed40c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 shutdown_connections 2024-01-20T08:10:37.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.555+0000 7f0edae00640 1 -- 172.21.15.100:0/3306010406 wait complete. 2024-01-20T08:10:37.576 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.761+0000 7efc78e00640 1 Processor -- start 2024-01-20T08:10:37.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.761+0000 7efc78e00640 1 -- start start 2024-01-20T08:10:37.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc78e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc78e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740a9940 con 0x7efc740a93c0 2024-01-20T08:10:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc78e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc741500c0 con 0x7efc740aae00 2024-01-20T08:10:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc78e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74156810 con 0x7efc7414fce0 2024-01-20T08:10:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc6be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efc740a93c0 0x7efc74152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60940/0 (socket says 172.21.15.100:60940) 2024-01-20T08:10:37.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc6be00640 1 -- 172.21.15.100:0/2064290460 learned_addr learned my addr 172.21.15.100:0/2064290460 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc71e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.763+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277845212 0 0) 0x7efc740a9940 con 0x7efc740a93c0 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc54003520 con 0x7efc740a93c0 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1301630534 0 0) 0x7efc54003520 con 0x7efc740a93c0 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 msgr2=0x7efc74153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 >> v1:172.21.15.110:6789/0 conn(0x7efc740aae00 legacy=0x7efc740ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74156af0 con 0x7efc740a93c0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7efc5c001670 con 0x7efc740a93c0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 >> v1:172.21.15.100:6789/0 conn(0x7efc740a93c0 legacy=0x7efc74152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc54003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc540047c0 0x7efc54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc54005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74156810 con 0x7efc540039a0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400ba30 con 0x7efc540047c0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc5400bbf0 con 0x7efc7414fce0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.764+0000 7efc71e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc54003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc72800640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc54005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc71e00640 1 -- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 msgr2=0x7efc54005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc71e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc54005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc71e00640 1 -- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc540047c0 msgr2=0x7efc54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc71e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc540047c0 0x7efc54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc71e00640 1 -- 172.21.15.100:0/2064290460 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc54003520 con 0x7efc540039a0 2024-01-20T08:10:37.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.765+0000 7efc72800640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc54005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.766+0000 7efc71e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc54003dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc64009a90 tx=0x7efc540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54453c5f49e9af25 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.766+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6402c660 con 0x7efc540039a0 2024-01-20T08:10:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.766+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6402c7c0 con 0x7efc540039a0 2024-01-20T08:10:37.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.766+0000 7efc71400640 1 -- 172.21.15.100:0/2064290460 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6402cb50 con 0x7efc540039a0 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 -- 172.21.15.100:0/2064290460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 msgr2=0x7efc54003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 --2- 172.21.15.100:0/2064290460 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc54003dc0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc64009a90 tx=0x7efc540057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc72800640 1 -- 172.21.15.100:0/2064290460 reap_dead start 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 -- 172.21.15.100:0/2064290460 shutdown_connections 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 -- 172.21.15.100:0/2064290460 >> 172.21.15.100:0/2064290460 conn(0x7efc7406a5e0 msgr2=0x7efc7406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 -- 172.21.15.100:0/2064290460 shutdown_connections 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.767+0000 7efc78e00640 1 -- 172.21.15.100:0/2064290460 wait complete. 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.768+0000 7efc78e00640 1 Processor -- start 2024-01-20T08:10:37.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 -- start start 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc74153f40 0x7efc740c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc740c6330 0x7efc741ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740c5960 con 0x7efc540039a0 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc74145da0 con 0x7efc740c6330 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.769+0000 7efc78e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740c5630 con 0x7efc74153f40 2024-01-20T08:10:37.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53618/0 (socket says 172.21.15.100:53618) 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 -- 172.21.15.100:0/1127346313 learned_addr learned my addr 172.21.15.100:0/1127346313 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 -- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc74153f40 msgr2=0x7efc740c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc74153f40 0x7efc740c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 -- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc740c6330 msgr2=0x7efc741ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc740c6330 0x7efc741ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 -- 172.21.15.100:0/1127346313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74144dc0 con 0x7efc540039a0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.770+0000 7efc71e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc64037040 tx=0x7efc64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.771+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64003810 con 0x7efc540039a0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.771+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64003990 con 0x7efc540039a0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.771+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64003d40 con 0x7efc540039a0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.771+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740c5960 con 0x7efc540039a0 2024-01-20T08:10:37.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.771+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc74145ac0 con 0x7efc540039a0 2024-01-20T08:10:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.772+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7404e970 con 0x7efc540039a0 2024-01-20T08:10:37.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.773+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efc64034440 con 0x7efc540039a0 2024-01-20T08:10:37.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.774+0000 7efc6a000640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 0x7efc4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:37.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.774+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc640ab540 con 0x7efc540039a0 2024-01-20T08:10:37.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.774+0000 7efc6be00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 0x7efc4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:37.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.775+0000 7efc6be00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 0x7efc4c06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0011e0 tx=0x7efc5c001570 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:37.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.779+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efc64076540 con 0x7efc540039a0 2024-01-20T08:10:37.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.972+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efc74072870 con 0x7efc540039a0 2024-01-20T08:10:37.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.975+0000 7efc6a000640 1 -- 172.21.15.100:0/1127346313 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7efc64079b60 con 0x7efc540039a0 2024-01-20T08:10:37.978 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:37.978 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.977+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 msgr2=0x7efc4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.977+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 0x7efc4c06d390 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc5c0011e0 tx=0x7efc5c001570 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 msgr2=0x7efc74144880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc64037040 tx=0x7efc64004730 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 shutdown_connections 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc740c6330 0x7efc741ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06aed0 0x7efc4c06d390 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc74153f40 0x7efc740c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 --2- 172.21.15.100:0/1127346313 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc540039a0 0x7efc74144880 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 >> 172.21.15.100:0/1127346313 conn(0x7efc7406a5e0 msgr2=0x7efc74150590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 shutdown_connections 2024-01-20T08:10:37.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:37.978+0000 7efc78e00640 1 -- 172.21.15.100:0/1127346313 wait complete. 2024-01-20T08:10:37.999 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:37.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:38.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.202+0000 7fcfb4000640 1 Processor -- start 2024-01-20T08:10:38.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.202+0000 7fcfb4000640 1 -- start start 2024-01-20T08:10:38.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.203+0000 7fcfb4000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcfac14b720 0x7fcfac1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb4000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac154ba0 con 0x7fcfac0c1d00 2024-01-20T08:10:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb4000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfac155a00 con 0x7fcfac0c1850 2024-01-20T08:10:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb4000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfac14bb00 con 0x7fcfac14b720 2024-01-20T08:10:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcfac0c1d00 0x7fcfac06cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:60944/0 (socket says 172.21.15.100:60944) 2024-01-20T08:10:38.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb2000640 1 -- 172.21.15.100:0/2007083503 learned_addr learned my addr 172.21.15.100:0/2007083503 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.204+0000 7fcfb1600640 1 --2- 172.21.15.100:0/2007083503 >> v2:172.21.15.110:3300/0 conn(0x7fcfac14b720 0x7fcfac1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247653569 0 0) 0x7fcfac154ba0 con 0x7fcfac0c1d00 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf8c003520 con 0x7fcfac0c1d00 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3482050155 0 0) 0x7fcf8c003520 con 0x7fcfac0c1d00 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 >> v2:172.21.15.110:3300/0 conn(0x7fcfac14b720 msgr2=0x7fcfac1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 --2- 172.21.15.100:0/2007083503 >> v2:172.21.15.110:3300/0 conn(0x7fcfac14b720 0x7fcfac1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 >> v1:172.21.15.110:6789/0 conn(0x7fcfac0c1850 legacy=0x7fcfac06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac154df0 con 0x7fcfac0c1d00 2024-01-20T08:10:38.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fcfa40019f0 con 0x7fcfac0c1d00 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 >> v1:172.21.15.100:6789/0 conn(0x7fcfac0c1d00 legacy=0x7fcfac06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf8c003970 0x7fcf8c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 0x7fcf8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0052a0 0x7fcf8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac14bb00 con 0x7fcf8c0047c0 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c00c170 con 0x7fcf8c0052a0 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8c00c330 con 0x7fcf8c003970 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.205+0000 7fcfb0c00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 0x7fcf8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb1600640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf8c003970 0x7fcf8c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb0c00640 1 -- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf8c003970 msgr2=0x7fcf8c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb0c00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf8c003970 0x7fcf8c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb2000640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0052a0 0x7fcf8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb0c00640 1 -- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0052a0 msgr2=0x7fcf8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:38.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb0c00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0052a0 0x7fcf8c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb0c00640 1 -- 172.21.15.100:0/2007083503 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8c003520 con 0x7fcf8c0047c0 2024-01-20T08:10:38.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.206+0000 7fcfb2000640 1 -- 172.21.15.100:0/2007083503 reap_dead start 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.207+0000 7fcfb0c00640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 0x7fcf8c004c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf94001720 tx=0x7fcf8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5ab91cf4f71cef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.207+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf940052d0 con 0x7fcf8c0047c0 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.207+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9402e050 con 0x7fcf8c0047c0 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.207+0000 7fcfabe00640 1 -- 172.21.15.100:0/2007083503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94003830 con 0x7fcf8c0047c0 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 -- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 msgr2=0x7fcf8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 0x7fcf8c004c40 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcf94001720 tx=0x7fcf8c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 -- 172.21.15.100:0/2007083503 shutdown_connections 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 --2- 172.21.15.100:0/2007083503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf8c0047c0 0x7fcf8c004c40 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 -- 172.21.15.100:0/2007083503 >> 172.21.15.100:0/2007083503 conn(0x7fcfac0c2940 msgr2=0x7fcfac0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 -- 172.21.15.100:0/2007083503 shutdown_connections 2024-01-20T08:10:38.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.208+0000 7fcfb4000640 1 -- 172.21.15.100:0/2007083503 wait complete. 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.210+0000 7fcfb4000640 1 Processor -- start 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.210+0000 7fcfb4000640 1 -- start start 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0047c0 0x7fcfac0aa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfac14a370 0x7fcfac149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac1ee4c0 con 0x7fcfac14a8a0 2024-01-20T08:10:38.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac14e290 con 0x7fcf8c0047c0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb4000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfac1edf00 con 0x7fcfac14a370 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53628/0 (socket says 172.21.15.100:53628) 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 -- 172.21.15.100:0/860277061 learned_addr learned my addr 172.21.15.100:0/860277061 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 -- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfac14a370 msgr2=0x7fcfac149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfac14a370 0x7fcfac149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 -- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0047c0 msgr2=0x7fcfac0aa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0047c0 0x7fcfac0aa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.211+0000 7fcfb2000640 1 -- 172.21.15.100:0/860277061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfac1ee1e0 con 0x7fcfac14a8a0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfb2000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000f80 tx=0x7fcfa400df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400b860 con 0x7fcfac14a8a0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa400b9c0 con 0x7fcfac14a8a0 2024-01-20T08:10:38.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfac14df20 con 0x7fcfac14a8a0 2024-01-20T08:10:38.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa400bd70 con 0x7fcfac14a8a0 2024-01-20T08:10:38.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.212+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfac14d160 con 0x7fcfac14a8a0 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.213+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfac14dd80 con 0x7fcfac14a8a0 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.214+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcfa4007070 con 0x7fcfac14a8a0 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.215+0000 7fcfa9600640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 0x7fcf8406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.215+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfa40899f0 con 0x7fcfac14a8a0 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.215+0000 7fcfb1600640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 0x7fcf8406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.216+0000 7fcfb1600640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 0x7fcf8406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009990 tx=0x7fcf9c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.219+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcfac14dd80 con 0x7fcfac14a8a0 2024-01-20T08:10:38.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.409+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcfac14dd80 con 0x7fcfac14a8a0 2024-01-20T08:10:38.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.409+0000 7fcfa9600640 1 -- 172.21.15.100:0/860277061 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcfac14dd80 con 0x7fcfac14a8a0 2024-01-20T08:10:38.413 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:38.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 msgr2=0x7fcf8406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 0x7fcf8406d390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009990 tx=0x7fcf9c008040 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 msgr2=0x7fcfac149b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fcfa4000f80 tx=0x7fcfa400df70 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 shutdown_connections 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfac14a8a0 0x7fcfac149b60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf8406aed0 0x7fcf8406d390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfac14a370 0x7fcfac149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 --2- 172.21.15.100:0/860277061 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf8c0047c0 0x7fcfac0aa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.412+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 >> 172.21.15.100:0/860277061 conn(0x7fcfac0c2940 msgr2=0x7fcfac0bf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:38.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.413+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 shutdown_connections 2024-01-20T08:10:38.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.413+0000 7fcfb4000640 1 -- 172.21.15.100:0/860277061 wait complete. 2024-01-20T08:10:38.433 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:38.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.644+0000 7f2777200640 1 Processor -- start 2024-01-20T08:10:38.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.644+0000 7f2777200640 1 -- start start 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.645+0000 7f2777200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780c1850 0x7f27780abba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2777200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27780c1c30 0x7f277815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2777200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27780c20c0 con 0x7f27780715e0 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2777200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2778149410 con 0x7f27780c1c30 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2777200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780707d0 con 0x7f27780c1850 2024-01-20T08:10:38.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27780c1c30 0x7f277815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27780c1c30 0x7f277815ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53646/0 (socket says 172.21.15.100:53646) 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 -- 172.21.15.100:0/4139094919 learned_addr learned my addr 172.21.15.100:0/4139094919 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2775e00640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780c1850 0x7f27780abba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 -- 172.21.15.100:0/4139094919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780c1850 msgr2=0x7f27780abba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780c1850 0x7f27780abba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 -- 172.21.15.100:0/4139094919 >> v1:172.21.15.110:6789/0 conn(0x7f27780715e0 legacy=0x7f27780700c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:38.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.646+0000 7f2776800640 1 -- 172.21.15.100:0/4139094919 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27780aae00 con 0x7f27780c1c30 2024-01-20T08:10:38.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.648+0000 7f2776800640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1c30 0x7f277815ce20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2770009e50 tx=0x7f277002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa4d1e3ed0c8ce18 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.648+0000 7f2775400640 1 -- 172.21.15.100:0/4139094919 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277002ca70 con 0x7f27780c1c30 2024-01-20T08:10:38.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.648+0000 7f2775400640 1 -- 172.21.15.100:0/4139094919 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277002cbd0 con 0x7f27780c1c30 2024-01-20T08:10:38.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.648+0000 7f2775400640 1 -- 172.21.15.100:0/4139094919 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27700343f0 con 0x7f27780c1c30 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 -- 172.21.15.100:0/4139094919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1c30 msgr2=0x7f277815ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1c30 0x7f277815ce20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2770009e50 tx=0x7f277002bed0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 -- 172.21.15.100:0/4139094919 shutdown_connections 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1c30 0x7f277815ce20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 --2- 172.21.15.100:0/4139094919 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780c1850 0x7f27780abba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 -- 172.21.15.100:0/4139094919 >> 172.21.15.100:0/4139094919 conn(0x7f27780c2940 msgr2=0x7f27780c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 -- 172.21.15.100:0/4139094919 shutdown_connections 2024-01-20T08:10:38.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.649+0000 7f2777200640 1 -- 172.21.15.100:0/4139094919 wait complete. 2024-01-20T08:10:38.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.650+0000 7f2777200640 1 Processor -- start 2024-01-20T08:10:38.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 -- start start 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780715e0 0x7f27780c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27780c1c30 0x7f27781ed700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27781edf40 con 0x7f27780c1850 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27781ee220 con 0x7f27780c1c30 2024-01-20T08:10:38.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.651+0000 7f2777200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27780c5580 con 0x7f27780715e0 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:53652/0 (socket says 172.21.15.100:53652) 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 -- 172.21.15.100:0/2405693717 learned_addr learned my addr 172.21.15.100:0/2405693717 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f2775e00640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780715e0 0x7f27780c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 -- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780715e0 msgr2=0x7f27780c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780715e0 0x7f27780c3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f2776800640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27780c1c30 0x7f27781ed700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 -- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27780c1c30 msgr2=0x7f27781ed700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27780c1c30 0x7f27781ed700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.652+0000 7f276d200640 1 -- 172.21.15.100:0/2405693717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009b30 con 0x7f27780c1850 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f276d200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f276000b3f0 tx=0x7f276000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760011830 con 0x7f27780c1850 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2760011990 con 0x7f27780c1850 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760011d40 con 0x7f27780c1850 2024-01-20T08:10:38.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27780c5860 con 0x7f27780c1850 2024-01-20T08:10:38.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.653+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27780c5b40 con 0x7f27780c1850 2024-01-20T08:10:38.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.654+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277804e9e0 con 0x7f27780c1850 2024-01-20T08:10:38.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.655+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f276001a400 con 0x7f27780c1850 2024-01-20T08:10:38.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.656+0000 7f276ea00640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 0x7f275006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:38.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.656+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2760089440 con 0x7f27780c1850 2024-01-20T08:10:38.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.656+0000 7f2775e00640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 0x7f275006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:38.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.657+0000 7f2775e00640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 0x7f275006d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2768006fd0 tx=0x7f2768008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:38.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.661+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2760054300 con 0x7f27780c1850 2024-01-20T08:10:38.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.853+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2778072260 con 0x7f27780c1850 2024-01-20T08:10:38.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.854+0000 7f276ea00640 1 -- 172.21.15.100:0/2405693717 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2760057920 con 0x7f27780c1850 2024-01-20T08:10:38.857 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 msgr2=0x7f275006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 0x7f275006d390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2768006fd0 tx=0x7f2768008040 comp rx=0 tx=0).stop 2024-01-20T08:10:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 msgr2=0x7f2778141050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f276000b3f0 tx=0x7f276000b8b0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 shutdown_connections 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27780c1c30 0x7f27781ed700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27780c1850 0x7f2778141050 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f275006aed0 0x7f275006d390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 --2- 172.21.15.100:0/2405693717 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27780715e0 0x7f27780c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 >> 172.21.15.100:0/2405693717 conn(0x7f27780c2940 msgr2=0x7f2778151650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.857+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 shutdown_connections 2024-01-20T08:10:38.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:38.858+0000 7f2777200640 1 -- 172.21.15.100:0/2405693717 wait complete. 2024-01-20T08:10:38.879 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:39.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.090+0000 7f4364000640 1 Processor -- start 2024-01-20T08:10:39.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.091+0000 7f4364000640 1 -- start start 2024-01-20T08:10:39.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.092+0000 7f4364000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14b720 0x7f435c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.092+0000 7f4364000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f435c0c1850 0x7f435c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.092+0000 7f4364000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c154ba0 con 0x7f435c06c8d0 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.092+0000 7f4364000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c14bb00 con 0x7f435c0c1850 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.092+0000 7f4364000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c155a00 con 0x7f435c14b720 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4360c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f435c0c1850 0x7f435c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4362000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f435c06c8d0 0x7f435c06cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58266/0 (socket says 172.21.15.100:58266) 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4362000640 1 -- 172.21.15.100:0/267480541 learned_addr learned my addr 172.21.15.100:0/267480541 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4361600640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14b720 0x7f435c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4360c00640 1 -- 172.21.15.100:0/267480541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14b720 msgr2=0x7f435c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4360c00640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14b720 0x7f435c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4360c00640 1 -- 172.21.15.100:0/267480541 >> v1:172.21.15.100:6789/0 conn(0x7f435c06c8d0 legacy=0x7f435c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f4360c00640 1 -- 172.21.15.100:0/267480541 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c154df0 con 0x7f435c0c1850 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.093+0000 7f435be00640 1 -- 172.21.15.100:0/267480541 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2007512654 0 0) 0x7f435c154ba0 con 0x7f435c06c8d0 2024-01-20T08:10:39.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.094+0000 7f4360c00640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c0c1cd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f43440097a0 tx=0x7f434402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c11497cb5c338e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.094+0000 7f435be00640 1 -- 172.21.15.100:0/267480541 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434402e070 con 0x7f435c0c1850 2024-01-20T08:10:39.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.094+0000 7f435be00640 1 -- 172.21.15.100:0/267480541 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43440315a0 con 0x7f435c0c1850 2024-01-20T08:10:39.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.094+0000 7f435be00640 1 -- 172.21.15.100:0/267480541 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344031930 con 0x7f435c0c1850 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 -- 172.21.15.100:0/267480541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 msgr2=0x7f435c0c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c0c1cd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f43440097a0 tx=0x7f434402b840 comp rx=0 tx=0).stop 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 -- 172.21.15.100:0/267480541 shutdown_connections 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c0c1cd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 --2- 172.21.15.100:0/267480541 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14b720 0x7f435c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 -- 172.21.15.100:0/267480541 >> 172.21.15.100:0/267480541 conn(0x7f435c0c2940 msgr2=0x7f435c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 -- 172.21.15.100:0/267480541 shutdown_connections 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.095+0000 7f4364000640 1 -- 172.21.15.100:0/267480541 wait complete. 2024-01-20T08:10:39.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.097+0000 7f4364000640 1 Processor -- start 2024-01-20T08:10:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.097+0000 7f4364000640 1 -- start start 2024-01-20T08:10:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c06c8d0 0x7f435c1ed680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c14b720 0x7f435c14f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0c5580 con 0x7f435c0c1850 2024-01-20T08:10:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c149ba0 con 0x7f435c14b720 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4364000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0bfde0 con 0x7f435c06c8d0 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46768/0 (socket says 172.21.15.100:46768) 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 -- 172.21.15.100:0/2914812261 learned_addr learned my addr 172.21.15.100:0/2914812261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4361600640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c06c8d0 0x7f435c1ed680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 -- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c06c8d0 msgr2=0x7f435c1ed680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c06c8d0 0x7f435c1ed680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 -- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c14b720 msgr2=0x7f435c14f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.098+0000 7f4360c00640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c14b720 0x7f435c14f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4360c00640 1 -- 172.21.15.100:0/2914812261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344009400 con 0x7f435c0c1850 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4360c00640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4344034040 tx=0x7f43440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344032900 con 0x7f435c0c1850 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4344032a80 con 0x7f435c0c1850 2024-01-20T08:10:39.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4344032e30 con 0x7f435c0c1850 2024-01-20T08:10:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c1498c0 con 0x7f435c0c1850 2024-01-20T08:10:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.099+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c1ee1a0 con 0x7f435c0c1850 2024-01-20T08:10:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.100+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c04e970 con 0x7f435c0c1850 2024-01-20T08:10:39.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.101+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f434404e430 con 0x7f435c0c1850 2024-01-20T08:10:39.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.102+0000 7f4359600640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.102+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43440ab700 con 0x7f435c0c1850 2024-01-20T08:10:39.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.102+0000 7f4361600640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.103+0000 7f4361600640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f434c006fd0 tx=0x7f434c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.107+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f43440765c0 con 0x7f435c0c1850 2024-01-20T08:10:39.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.299+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f435c0c37e0 con 0x7f435c0c1850 2024-01-20T08:10:39.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.300+0000 7f4359600640 1 -- 172.21.15.100:0/2914812261 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4344079be0 con 0x7f435c0c1850 2024-01-20T08:10:39.303 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.302+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 msgr2=0x7f433406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f434c006fd0 tx=0x7f434c008040 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 msgr2=0x7f435c14f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4344034040 tx=0x7f43440046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 shutdown_connections 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c14b720 0x7f435c14f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c1850 0x7f435c14f100 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 --2- 172.21.15.100:0/2914812261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c06c8d0 0x7f435c1ed680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 >> 172.21.15.100:0/2914812261 conn(0x7f435c0c2940 msgr2=0x7f435c0bf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 shutdown_connections 2024-01-20T08:10:39.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.303+0000 7f4364000640 1 -- 172.21.15.100:0/2914812261 wait complete. 2024-01-20T08:10:39.371 INFO:tasks.cephfs_test_runner:Starting test: test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-20T08:10:39.372 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.585+0000 7f1d3ec00640 1 Processor -- start 2024-01-20T08:10:39.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.585+0000 7f1d3ec00640 1 -- start start 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.586+0000 7f1d3ec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d380a93c0 0x7f1d38153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d3ec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380a9940 con 0x7f1d3814fce0 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d3ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d381500c0 con 0x7f1d380aae00 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d3ec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d38156810 con 0x7f1d380a93c0 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d37e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1d3814fce0 0x7f1d38152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58280/0 (socket says 172.21.15.100:58280) 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d37e00640 1 -- 172.21.15.100:0/3645151050 learned_addr learned my addr 172.21.15.100:0/3645151050 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:39.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d37400640 1 --2- 172.21.15.100:0/3645151050 >> v2:172.21.15.100:3300/0 conn(0x7f1d380a93c0 0x7f1d38153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d36a00640 1 -- 172.21.15.100:0/3645151050 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436175632 0 0) 0x7f1d380a9940 con 0x7f1d3814fce0 2024-01-20T08:10:39.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d36a00640 1 -- 172.21.15.100:0/3645151050 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d18003520 con 0x7f1d3814fce0 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d37400640 1 -- 172.21.15.100:0/3645151050 >> v1:172.21.15.110:6789/0 conn(0x7f1d380aae00 legacy=0x7f1d380ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.587+0000 7f1d37400640 1 -- 172.21.15.100:0/3645151050 >> v1:172.21.15.100:6789/0 conn(0x7f1d3814fce0 legacy=0x7f1d38152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.588+0000 7f1d37400640 1 -- 172.21.15.100:0/3645151050 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38156af0 con 0x7f1d380a93c0 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d37400640 1 --2- 172.21.15.100:0/3645151050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d38153b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097a0 tx=0x7f1d2002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fec55b0ea2c23a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d36a00640 1 -- 172.21.15.100:0/3645151050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20030610 con 0x7f1d380a93c0 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d36a00640 1 -- 172.21.15.100:0/3645151050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d20030770 con 0x7f1d380a93c0 2024-01-20T08:10:39.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d36a00640 1 -- 172.21.15.100:0/3645151050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d20030ae0 con 0x7f1d380a93c0 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d3ec00640 1 -- 172.21.15.100:0/3645151050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 msgr2=0x7f1d38153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.589+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/3645151050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d38153b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097a0 tx=0x7f1d2002b960 comp rx=0 tx=0).stop 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.590+0000 7f1d3ec00640 1 -- 172.21.15.100:0/3645151050 shutdown_connections 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.590+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/3645151050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d38153b80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.590+0000 7f1d3ec00640 1 -- 172.21.15.100:0/3645151050 >> 172.21.15.100:0/3645151050 conn(0x7f1d3806a5e0 msgr2=0x7f1d3806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:39.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.590+0000 7f1d3ec00640 1 -- 172.21.15.100:0/3645151050 shutdown_connections 2024-01-20T08:10:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.590+0000 7f1d3ec00640 1 -- 172.21.15.100:0/3645151050 wait complete. 2024-01-20T08:10:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.591+0000 7f1d3ec00640 1 Processor -- start 2024-01-20T08:10:39.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.591+0000 7f1d3ec00640 1 -- start start 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 0x7f1d381edc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3814fce0 0x7f1d3814df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3814ec60 con 0x7f1d380a93c0 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3814f190 con 0x7f1d380aae00 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.592+0000 7f1d3ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381ee160 con 0x7f1d3814fce0 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46792/0 (socket says 172.21.15.100:46792) 2024-01-20T08:10:39.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 -- 172.21.15.100:0/682894875 learned_addr learned my addr 172.21.15.100:0/682894875 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 -- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3814fce0 msgr2=0x7f1d3814df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3814fce0 0x7f1d3814df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 -- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 msgr2=0x7f1d381edc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37400640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 0x7f1d381edc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 0x7f1d381edc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 -- 172.21.15.100:0/682894875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20009400 con 0x7f1d380a93c0 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37400640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 0x7f1d381edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d37e00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c410 tx=0x7f1d2800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.593+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28005ce0 con 0x7f1d380a93c0 2024-01-20T08:10:39.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.594+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d28005e40 con 0x7f1d380a93c0 2024-01-20T08:10:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.594+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d280072f0 con 0x7f1d380a93c0 2024-01-20T08:10:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.594+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d3814eeb0 con 0x7f1d380a93c0 2024-01-20T08:10:39.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.594+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381dc310 con 0x7f1d380a93c0 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.595+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3804e970 con 0x7f1d380a93c0 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.596+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1d28007510 con 0x7f1d380a93c0 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.596+0000 7f1d2fe00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 0x7f1d1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.597+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d28088cd0 con 0x7f1d380a93c0 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.597+0000 7f1d37400640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 0x7f1d1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:39.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.597+0000 7f1d37400640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 0x7f1d1006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d20036000 tx=0x7f1d2003b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:39.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.601+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1d28053c60 con 0x7f1d380a93c0 2024-01-20T08:10:39.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.797+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d38072870 con 0x7f1d380a93c0 2024-01-20T08:10:39.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.799+0000 7f1d2fe00640 1 -- 172.21.15.100:0/682894875 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f1d28017090 con 0x7f1d380a93c0 2024-01-20T08:10:39.802 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:39.802 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:39.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 msgr2=0x7f1d1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 0x7f1d1006d390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1d20036000 tx=0x7f1d2003b040 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 msgr2=0x7f1d381ed6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1d2800c410 tx=0x7f1d2800c8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 shutdown_connections 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1d1006aed0 0x7f1d1006d390 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d3814fce0 0x7f1d3814df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d380aae00 0x7f1d381edc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 --2- 172.21.15.100:0/682894875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d380a93c0 0x7f1d381ed6e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.801+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 >> 172.21.15.100:0/682894875 conn(0x7f1d3806a5e0 msgr2=0x7f1d380bfe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.802+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 shutdown_connections 2024-01-20T08:10:39.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:39.802+0000 7f1d3ec00640 1 -- 172.21.15.100:0/682894875 wait complete. 2024-01-20T08:10:39.823 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:39.823 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.033+0000 7f3985a00640 1 Processor -- start 2024-01-20T08:10:40.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.033+0000 7f3985a00640 1 -- start start 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f3985a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3980151e40 0x7f39800c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f3985a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 0x7f398006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f3985a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39800c9f30 con 0x7f39800c4a50 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f3985a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398006c5a0 con 0x7f3980151e40 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f3985a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39800c87a0 con 0x7f3980155290 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f397ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3980151e40 0x7f39800c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f397ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3980151e40 0x7f39800c8c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46808/0 (socket says 172.21.15.100:46808) 2024-01-20T08:10:40.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f397ea00640 1 -- 172.21.15.100:0/3845146045 learned_addr learned my addr 172.21.15.100:0/3845146045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f397f400640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 0x7f398006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.035+0000 7f397ea00640 1 -- 172.21.15.100:0/3845146045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 msgr2=0x7f398006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.036+0000 7f397ea00640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 0x7f398006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.036+0000 7f397ea00640 1 -- 172.21.15.100:0/3845146045 >> v1:172.21.15.110:6789/0 conn(0x7f39800c4a50 legacy=0x7f3980155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.036+0000 7f397ea00640 1 -- 172.21.15.100:0/3845146045 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3980156410 con 0x7f3980151e40 2024-01-20T08:10:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.036+0000 7f397f400640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 0x7f398006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:40.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.037+0000 7f397ea00640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980151e40 0x7f39800c8c30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3970009870 tx=0x7f397002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77093cca22c8b2bc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.037+0000 7f397d600640 1 -- 172.21.15.100:0/3845146045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39700317c0 con 0x7f3980151e40 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.037+0000 7f397d600640 1 -- 172.21.15.100:0/3845146045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3970031920 con 0x7f3980151e40 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.037+0000 7f397d600640 1 -- 172.21.15.100:0/3845146045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3970031cb0 con 0x7f3980151e40 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 -- 172.21.15.100:0/3845146045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980151e40 msgr2=0x7f39800c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980151e40 0x7f39800c8c30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3970009870 tx=0x7f397002b860 comp rx=0 tx=0).stop 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 -- 172.21.15.100:0/3845146045 shutdown_connections 2024-01-20T08:10:40.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980155290 0x7f398006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 --2- 172.21.15.100:0/3845146045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980151e40 0x7f39800c8c30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 -- 172.21.15.100:0/3845146045 >> 172.21.15.100:0/3845146045 conn(0x7f39800abde0 msgr2=0x7f39800ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 -- 172.21.15.100:0/3845146045 shutdown_connections 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.038+0000 7f3985a00640 1 -- 172.21.15.100:0/3845146045 wait complete. 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.040+0000 7f3985a00640 1 Processor -- start 2024-01-20T08:10:40.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.040+0000 7f3985a00640 1 -- start start 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39800c4a50 0x7f3980158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980151e40 0x7f3980153940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801ee940 con 0x7f3980155290 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39801ea610 con 0x7f39800c4a50 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f3985a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3980157bb0 con 0x7f3980151e40 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f397f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f397f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46820/0 (socket says 172.21.15.100:46820) 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f397f400640 1 -- 172.21.15.100:0/1472209136 learned_addr learned my addr 172.21.15.100:0/1472209136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f397ea00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39800c4a50 0x7f3980158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.041+0000 7f397e000640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980151e40 0x7f3980153940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 -- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980151e40 msgr2=0x7f3980153940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980151e40 0x7f3980153940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 -- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39800c4a50 msgr2=0x7f3980158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39800c4a50 0x7f3980158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 -- 172.21.15.100:0/1472209136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700094d0 con 0x7f3980155290 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f397f400640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f397800cd50 tx=0x7f397800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800f680 con 0x7f3980155290 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397800f800 con 0x7f3980155290 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3980157e90 con 0x7f3980155290 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397800fbb0 con 0x7f3980155290 2024-01-20T08:10:40.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.042+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3980158170 con 0x7f3980155290 2024-01-20T08:10:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.043+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39801ea780 con 0x7f3980155290 2024-01-20T08:10:40.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.044+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f397800b040 con 0x7f3980155290 2024-01-20T08:10:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.045+0000 7f3976a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 0x7f395806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.045+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f397808a080 con 0x7f3980155290 2024-01-20T08:10:40.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.046+0000 7f397ea00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 0x7f395806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.046+0000 7f397ea00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 0x7f395806d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3970036000 tx=0x7f397003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.050+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f39780bd0d0 con 0x7f3980155290 2024-01-20T08:10:40.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.244+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f398004e970 con 0x7f3980155290 2024-01-20T08:10:40.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.245+0000 7f3976a00640 1 -- 172.21.15.100:0/1472209136 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39801ea780 con 0x7f3980155290 2024-01-20T08:10:40.248 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 msgr2=0x7f395806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 0x7f395806d390 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3970036000 tx=0x7f397003d040 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 msgr2=0x7f39801eaa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f397800cd50 tx=0x7f397800a650 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 shutdown_connections 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3980155290 0x7f39801eaa60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f395806aed0 0x7f395806d390 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3980151e40 0x7f3980153940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 --2- 172.21.15.100:0/1472209136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39800c4a50 0x7f3980158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 >> 172.21.15.100:0/1472209136 conn(0x7f39800abde0 msgr2=0x7f398014e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 shutdown_connections 2024-01-20T08:10:40.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.248+0000 7f3985a00640 1 -- 172.21.15.100:0/1472209136 wait complete. 2024-01-20T08:10:40.270 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.481+0000 7ff242a00640 1 Processor -- start 2024-01-20T08:10:40.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.481+0000 7ff242a00640 1 -- start start 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.482+0000 7ff242a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff23c0abfa0 0x7ff23c14e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.482+0000 7ff242a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff23c0701e0 0x7ff23c0c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.482+0000 7ff242a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff23c06be40 con 0x7ff23c06ddf0 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.482+0000 7ff242a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c06cfa0 con 0x7ff23c0abfa0 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.482+0000 7ff242a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23c070690 con 0x7ff23c0701e0 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff23c0abfa0 0x7ff23c14e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff23c0abfa0 0x7ff23c14e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46824/0 (socket says 172.21.15.100:46824) 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 -- 172.21.15.100:0/922830109 learned_addr learned my addr 172.21.15.100:0/922830109 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 -- 172.21.15.100:0/922830109 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0701e0 msgr2=0x7ff23c0c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 --2- 172.21.15.100:0/922830109 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0701e0 0x7ff23c0c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 -- 172.21.15.100:0/922830109 >> v1:172.21.15.110:6789/0 conn(0x7ff23c06ddf0 legacy=0x7ff23c06c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.483+0000 7ff23be00640 1 -- 172.21.15.100:0/922830109 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23c151970 con 0x7ff23c0abfa0 2024-01-20T08:10:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.484+0000 7ff23be00640 1 --2- 172.21.15.100:0/922830109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0abfa0 0x7ff23c14e4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06e600 tx=0x7ff22c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60a3174f6448673 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff23aa00640 1 -- 172.21.15.100:0/922830109 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c031750 con 0x7ff23c0abfa0 2024-01-20T08:10:40.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff23aa00640 1 -- 172.21.15.100:0/922830109 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff22c0318b0 con 0x7ff23c0abfa0 2024-01-20T08:10:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff23aa00640 1 -- 172.21.15.100:0/922830109 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff22c031c40 con 0x7ff23c0abfa0 2024-01-20T08:10:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 -- 172.21.15.100:0/922830109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0abfa0 msgr2=0x7ff23c14e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 --2- 172.21.15.100:0/922830109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0abfa0 0x7ff23c14e4c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff23c06e600 tx=0x7ff22c02b7f0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 -- 172.21.15.100:0/922830109 shutdown_connections 2024-01-20T08:10:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 --2- 172.21.15.100:0/922830109 >> v2:172.21.15.110:3300/0 conn(0x7ff23c0701e0 0x7ff23c0c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 --2- 172.21.15.100:0/922830109 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0abfa0 0x7ff23c14e4c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 -- 172.21.15.100:0/922830109 >> 172.21.15.100:0/922830109 conn(0x7ff23c0c6090 msgr2=0x7ff23c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 -- 172.21.15.100:0/922830109 shutdown_connections 2024-01-20T08:10:40.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.485+0000 7ff242a00640 1 -- 172.21.15.100:0/922830109 wait complete. 2024-01-20T08:10:40.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.487+0000 7ff242a00640 1 Processor -- start 2024-01-20T08:10:40.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.488+0000 7ff242a00640 1 -- start start 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 0x7ff23c154760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0abfa0 0x7ff23c0a9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c1539c0 con 0x7ff23c0701e0 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c152360 con 0x7ff23c0abfa0 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff242a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23c153c60 con 0x7ff23c06ddf0 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46828/0 (socket says 172.21.15.100:46828) 2024-01-20T08:10:40.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 -- 172.21.15.100:0/2237194217 learned_addr learned my addr 172.21.15.100:0/2237194217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23be00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 0x7ff23c154760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 -- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 msgr2=0x7ff23c154760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 0x7ff23c154760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 -- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0abfa0 msgr2=0x7ff23c0a9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0abfa0 0x7ff23c0a9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23b400640 1 -- 172.21.15.100:0/2237194217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c0094d0 con 0x7ff23c0701e0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.489+0000 7ff23be00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 0x7ff23c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff23b400640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c400 tx=0x7ff22400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2240035f0 con 0x7ff23c0701e0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff224003750 con 0x7ff23c0701e0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff23c153f40 con 0x7ff23c0701e0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff224003b40 con 0x7ff23c0701e0 2024-01-20T08:10:40.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.490+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff23c141860 con 0x7ff23c0701e0 2024-01-20T08:10:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.491+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23c0a9740 con 0x7ff23c0701e0 2024-01-20T08:10:40.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.493+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff224003ca0 con 0x7ff23c0701e0 2024-01-20T08:10:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.494+0000 7ff233e00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 0x7ff21406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.494+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff224088b60 con 0x7ff23c0701e0 2024-01-20T08:10:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.494+0000 7ff23be00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 0x7ff21406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.495+0000 7ff23be00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 0x7ff21406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff22c035000 tx=0x7ff22c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.498+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff224053ad0 con 0x7ff23c0701e0 2024-01-20T08:10:40.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.689+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff23c04ea50 con 0x7ff23c0701e0 2024-01-20T08:10:40.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.690+0000 7ff233e00640 1 -- 172.21.15.100:0/2237194217 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff224017020 con 0x7ff23c0701e0 2024-01-20T08:10:40.693 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 msgr2=0x7ff21406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 0x7ff21406d390 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff22c035000 tx=0x7ff22c008030 comp rx=0 tx=0).stop 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 msgr2=0x7ff23c0a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff22400c400 tx=0x7ff22400c8c0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 shutdown_connections 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff23c0abfa0 0x7ff23c0a9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff23c0701e0 0x7ff23c0a99e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff21406aed0 0x7ff21406d390 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 --2- 172.21.15.100:0/2237194217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff23c06ddf0 0x7ff23c154760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 >> 172.21.15.100:0/2237194217 conn(0x7ff23c0c6090 msgr2=0x7ff23c06c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 shutdown_connections 2024-01-20T08:10:40.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.693+0000 7ff242a00640 1 -- 172.21.15.100:0/2237194217 wait complete. 2024-01-20T08:10:40.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:40.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.920+0000 7f41dee00640 1 Processor -- start 2024-01-20T08:10:40.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.920+0000 7f41dee00640 1 -- start start 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.921+0000 7f41dee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f41d814fdb0 0x7f41d80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.921+0000 7f41dee00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41d80c1d90 0x7f41d8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.921+0000 7f41dee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c3460 0x7f41d8153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.921+0000 7f41dee00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d80a9ce0 con 0x7f41d80c1d90 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41dee00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d80a93b0 con 0x7f41d814fdb0 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41dee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d8152790 con 0x7f41d80c3460 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41d80c1d90 0x7f41d8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f41d80c1d90 0x7f41d8152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46838/0 (socket says 172.21.15.100:46838) 2024-01-20T08:10:40.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 -- 172.21.15.100:0/3390339027 learned_addr learned my addr 172.21.15.100:0/3390339027 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 -- 172.21.15.100:0/3390339027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c3460 msgr2=0x7f41d8153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 --2- 172.21.15.100:0/3390339027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c3460 0x7f41d8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 -- 172.21.15.100:0/3390339027 >> v2:172.21.15.110:3300/0 conn(0x7f41d814fdb0 msgr2=0x7f41d80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:40.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 --2- 172.21.15.100:0/3390339027 >> v2:172.21.15.110:3300/0 conn(0x7f41d814fdb0 0x7f41d80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.922+0000 7f41cfe00640 1 -- 172.21.15.100:0/3390339027 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d8150190 con 0x7f41d80c1d90 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.923+0000 7f41cfe00640 1 --2- 172.21.15.100:0/3390339027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c1d90 0x7f41d8152be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d806e580 tx=0x7f41c002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce033ef3363016a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41d7400640 1 -- 172.21.15.100:0/3390339027 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0031870 con 0x7f41d80c1d90 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41d7400640 1 -- 172.21.15.100:0/3390339027 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c00319d0 con 0x7f41d80c1d90 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41d7400640 1 -- 172.21.15.100:0/3390339027 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0031d60 con 0x7f41d80c1d90 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 -- 172.21.15.100:0/3390339027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c1d90 msgr2=0x7f41d8152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 --2- 172.21.15.100:0/3390339027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c1d90 0x7f41d8152be0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d806e580 tx=0x7f41c002b910 comp rx=0 tx=0).stop 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 -- 172.21.15.100:0/3390339027 shutdown_connections 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 --2- 172.21.15.100:0/3390339027 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c3460 0x7f41d8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 --2- 172.21.15.100:0/3390339027 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c1d90 0x7f41d8152be0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 --2- 172.21.15.100:0/3390339027 >> v2:172.21.15.110:3300/0 conn(0x7f41d814fdb0 0x7f41d80c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 -- 172.21.15.100:0/3390339027 >> 172.21.15.100:0/3390339027 conn(0x7f41d80c2940 msgr2=0x7f41d80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 -- 172.21.15.100:0/3390339027 shutdown_connections 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.924+0000 7f41dee00640 1 -- 172.21.15.100:0/3390339027 wait complete. 2024-01-20T08:10:40.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.926+0000 7f41dee00640 1 Processor -- start 2024-01-20T08:10:40.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.926+0000 7f41dee00640 1 -- start start 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c1d90 0x7f41d81eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 0x7f41d8142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d80c5c50 con 0x7f41d80c3460 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d806da50 con 0x7f41d814fdb0 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41dee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d806dd10 con 0x7f41d80c1d90 2024-01-20T08:10:40.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41cfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41cfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46852/0 (socket says 172.21.15.100:46852) 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.927+0000 7f41cfe00640 1 -- 172.21.15.100:0/1677562689 learned_addr learned my addr 172.21.15.100:0/1677562689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41d7e00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c1d90 0x7f41d81eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41dce00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 0x7f41d8142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 -- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c1d90 msgr2=0x7f41d81eae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c1d90 0x7f41d81eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 -- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 msgr2=0x7f41d8142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 0x7f41d8142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 -- 172.21.15.100:0/1677562689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c00094d0 con 0x7f41d80c3460 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41dce00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 0x7f41d8142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41cfe00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000c00 tx=0x7f41c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c003ad30 con 0x7f41d80c3460 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41c003ae90 con 0x7f41d80c3460 2024-01-20T08:10:40.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d806dff0 con 0x7f41d80c3460 2024-01-20T08:10:40.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0044610 con 0x7f41d80c3460 2024-01-20T08:10:40.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.928+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d8156430 con 0x7f41d80c3460 2024-01-20T08:10:40.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.929+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d81569e0 con 0x7f41d80c3460 2024-01-20T08:10:40.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.930+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f41c004d450 con 0x7f41d80c3460 2024-01-20T08:10:40.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.931+0000 7f41d4c00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 0x7f41b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:40.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.931+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f41c002d040 con 0x7f41d80c3460 2024-01-20T08:10:40.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.932+0000 7f41d7e00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 0x7f41b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:40.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.932+0000 7f41d7e00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 0x7f41b006d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41c800a770 tx=0x7f41c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:40.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:40.936+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f41d81569e0 con 0x7f41d80c3460 2024-01-20T08:10:41.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.128+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f41d81569e0 con 0x7f41d80c3460 2024-01-20T08:10:41.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.129+0000 7f41d4c00640 1 -- 172.21.15.100:0/1677562689 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41d81569e0 con 0x7f41d80c3460 2024-01-20T08:10:41.132 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 msgr2=0x7f41b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 0x7f41b006d3c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f41c800a770 tx=0x7f41c8008040 comp rx=0 tx=0).stop 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 msgr2=0x7f41d806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f41c0000c00 tx=0x7f41c00046c0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 shutdown_connections 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f41d814fdb0 0x7f41d8142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f41d80c3460 0x7f41d806cb00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41b006af00 0x7f41b006d3c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 --2- 172.21.15.100:0/1677562689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f41d80c1d90 0x7f41d81eae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 >> 172.21.15.100:0/1677562689 conn(0x7f41d80c2940 msgr2=0x7f41d80c1040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 shutdown_connections 2024-01-20T08:10:41.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.132+0000 7f41dee00640 1 -- 172.21.15.100:0/1677562689 wait complete. 2024-01-20T08:10:41.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-20T08:10:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.356+0000 7fe875000640 1 Processor -- start 2024-01-20T08:10:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.356+0000 7fe875000640 1 -- start start 2024-01-20T08:10:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe875000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe8701515b0 0x7fe87006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe875000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe875000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe870154ba0 con 0x7fe87014b720 2024-01-20T08:10:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe875000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe87014bb00 con 0x7fe8701515b0 2024-01-20T08:10:41.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe875000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe870155a00 con 0x7fe87006ce10 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe86e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe86e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:34870/0 (socket says 172.21.15.100:34870) 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.358+0000 7fe86e800640 1 -- 172.21.15.100:0/3464924444 learned_addr learned my addr 172.21.15.100:0/3464924444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.359+0000 7fe865200640 1 --2- 172.21.15.100:0/3464924444 >> v2:172.21.15.110:3300/0 conn(0x7fe8701515b0 0x7fe87006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.359+0000 7fe86e800640 1 -- 172.21.15.100:0/3464924444 >> v2:172.21.15.110:3300/0 conn(0x7fe8701515b0 msgr2=0x7fe87006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.359+0000 7fe86e800640 1 --2- 172.21.15.100:0/3464924444 >> v2:172.21.15.110:3300/0 conn(0x7fe8701515b0 0x7fe87006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.359+0000 7fe86e800640 1 -- 172.21.15.100:0/3464924444 >> v1:172.21.15.110:6789/0 conn(0x7fe87014b720 legacy=0x7fe8700c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.359+0000 7fe86e800640 1 -- 172.21.15.100:0/3464924444 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe870154df0 con 0x7fe87006ce10 2024-01-20T08:10:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.360+0000 7fe86e800640 1 --2- 172.21.15.100:0/3464924444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe87014bc40 tx=0x7fe86802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c196c4221fa291 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.361+0000 7fe86d400640 1 -- 172.21.15.100:0/3464924444 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868031640 con 0x7fe87006ce10 2024-01-20T08:10:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.361+0000 7fe86d400640 1 -- 172.21.15.100:0/3464924444 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8680317a0 con 0x7fe87006ce10 2024-01-20T08:10:41.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.361+0000 7fe86d400640 1 -- 172.21.15.100:0/3464924444 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe868031b30 con 0x7fe87006ce10 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 -- 172.21.15.100:0/3464924444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 msgr2=0x7fe87015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 --2- 172.21.15.100:0/3464924444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe87014bc40 tx=0x7fe86802b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 -- 172.21.15.100:0/3464924444 shutdown_connections 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 --2- 172.21.15.100:0/3464924444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe87006ce10 0x7fe87015bf30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 --2- 172.21.15.100:0/3464924444 >> v2:172.21.15.110:3300/0 conn(0x7fe8701515b0 0x7fe87006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 -- 172.21.15.100:0/3464924444 >> 172.21.15.100:0/3464924444 conn(0x7fe8700c2940 msgr2=0x7fe8700c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 -- 172.21.15.100:0/3464924444 shutdown_connections 2024-01-20T08:10:41.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.362+0000 7fe875000640 1 -- 172.21.15.100:0/3464924444 wait complete. 2024-01-20T08:10:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.363+0000 7fe875000640 1 Processor -- start 2024-01-20T08:10:41.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 -- start start 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe87014b720 0x7fe87014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8701515b0 0x7fe87014ec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87014a620 con 0x7fe87006ce10 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe87014e2e0 con 0x7fe87014b720 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.364+0000 7fe875000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8701e9180 con 0x7fe8701515b0 2024-01-20T08:10:41.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46854/0 (socket says 172.21.15.100:46854) 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 -- 172.21.15.100:0/1193971986 learned_addr learned my addr 172.21.15.100:0/1193971986 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86e800640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8701515b0 0x7fe87014ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 -- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8701515b0 msgr2=0x7fe87014ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8701515b0 0x7fe87014ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 -- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe87014b720 msgr2=0x7fe87014e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe87014b720 0x7fe87014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 -- 172.21.15.100:0/1193971986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8680094d0 con 0x7fe87006ce10 2024-01-20T08:10:41.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.365+0000 7fe86de00640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c790 tx=0x7fe86000cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.366+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe86000cea0 con 0x7fe87006ce10 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.366+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe860006d50 con 0x7fe87006ce10 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.366+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe860003bb0 con 0x7fe87006ce10 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.366+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8701db300 con 0x7fe87006ce10 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.366+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8701db020 con 0x7fe87006ce10 2024-01-20T08:10:41.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.367+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8700a91c0 con 0x7fe87006ce10 2024-01-20T08:10:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.368+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe860003d10 con 0x7fe87006ce10 2024-01-20T08:10:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.369+0000 7fe866a00640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 0x7fe84806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:41.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.369+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe860089240 con 0x7fe87006ce10 2024-01-20T08:10:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.369+0000 7fe865200640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 0x7fe84806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:41.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.370+0000 7fe865200640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 0x7fe84806d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe858006a90 tx=0x7fe858006a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:41.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.373+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe860057c30 con 0x7fe87006ce10 2024-01-20T08:10:41.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:41.634+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7fe87014fb50 con 0x7fe87006ce10 2024-01-20T08:10:42.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.045+0000 7fe866a00640 1 -- 172.21.15.100:0/1193971986 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v48) v1 ==== 162+0+0 (secure 0 0 0) 0x7fe8600577c0 con 0x7fe87006ce10 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.049+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 msgr2=0x7fe84806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.049+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 0x7fe84806d390 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe858006a90 tx=0x7fe858006a20 comp rx=0 tx=0).stop 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.049+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 msgr2=0x7fe870149ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.049+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe86000c790 tx=0x7fe86000cc50 comp rx=0 tx=0).stop 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 shutdown_connections 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe84806aed0 0x7fe84806d390 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8701515b0 0x7fe87014ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe87014b720 0x7fe87014e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 --2- 172.21.15.100:0/1193971986 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe87006ce10 0x7fe870149ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 >> 172.21.15.100:0/1193971986 conn(0x7fe8700c2940 msgr2=0x7fe870151af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 shutdown_connections 2024-01-20T08:10:42.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.050+0000 7fe875000640 1 -- 172.21.15.100:0/1193971986 wait complete. 2024-01-20T08:10:42.074 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-20T08:10:42.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.275+0000 7fe843400640 1 Processor -- start 2024-01-20T08:10:42.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.276+0000 7fe843400640 1 -- start start 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe843400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe83c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe843400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c152130 con 0x7fe83c151d50 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe843400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83c0c8080 con 0x7fe83c0c9830 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe843400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c8360 con 0x7fe83c1547c0 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe840a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe83c151d50 0x7fe83c0c9120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58292/0 (socket says 172.21.15.100:58292) 2024-01-20T08:10:42.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.277+0000 7fe840a00640 1 -- 172.21.15.100:0/2999547560 learned_addr learned my addr 172.21.15.100:0/2999547560 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83be00640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe83c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 243705877 0 0) 0x7fe83c152130 con 0x7fe83c151d50 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe81c003520 con 0x7fe83c151d50 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2378386334 0 0) 0x7fe81c003520 con 0x7fe83c151d50 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 msgr2=0x7fe83c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:42.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe83c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 >> v1:172.21.15.110:6789/0 conn(0x7fe83c0c9830 legacy=0x7fe83c06b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c0c8640 con 0x7fe83c151d50 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe82c001670 con 0x7fe83c151d50 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 >> v1:172.21.15.100:6789/0 conn(0x7fe83c151d50 legacy=0x7fe83c0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe81c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe81c003f70 0x7fe81c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe81c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c8360 con 0x7fe81c004d00 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c00bb70 con 0x7fe81c003f70 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.278+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c00bd30 con 0x7fe83c1547c0 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe81c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe83be00640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe81c003f70 0x7fe81c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe840a00640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe81c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 -- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 msgr2=0x7fe81c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c1547c0 0x7fe81c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 -- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe81c003f70 msgr2=0x7fe81c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe81c003f70 0x7fe81c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe841400640 1 -- 172.21.15.100:0/2999547560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c003520 con 0x7fe81c004d00 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.279+0000 7fe83be00640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe81c003f70 0x7fe81c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.280+0000 7fe841400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe81c005180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe834001e50 tx=0x7fe81c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f3d55186a489177 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:42.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.280+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834003b70 con 0x7fe81c004d00 2024-01-20T08:10:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe834003cd0 con 0x7fe81c004d00 2024-01-20T08:10:42.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe83b400640 1 -- 172.21.15.100:0/2999547560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe834005310 con 0x7fe81c004d00 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 -- 172.21.15.100:0/2999547560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 msgr2=0x7fe81c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 --2- 172.21.15.100:0/2999547560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe81c005180 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe834001e50 tx=0x7fe81c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe841400640 1 -- 172.21.15.100:0/2999547560 reap_dead start 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 -- 172.21.15.100:0/2999547560 shutdown_connections 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 -- 172.21.15.100:0/2999547560 >> 172.21.15.100:0/2999547560 conn(0x7fe83c0ca0e0 msgr2=0x7fe83c0ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 -- 172.21.15.100:0/2999547560 shutdown_connections 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.281+0000 7fe843400640 1 -- 172.21.15.100:0/2999547560 wait complete. 2024-01-20T08:10:42.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.283+0000 7fe843400640 1 Processor -- start 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.283+0000 7fe843400640 1 -- start start 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c157270 0x7fe83c1493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe83c1576f0 0x7fe83c149920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c14b3a0 con 0x7fe81c004d00 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c1a10 con 0x7fe83c1576f0 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe843400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83c0c1cf0 con 0x7fe83c157270 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe840a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe840a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46872/0 (socket says 172.21.15.100:46872) 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.284+0000 7fe840a00640 1 -- 172.21.15.100:0/2531981857 learned_addr learned my addr 172.21.15.100:0/2531981857 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe83be00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c157270 0x7fe83c1493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe841400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe83c1576f0 0x7fe83c149920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 -- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c157270 msgr2=0x7fe83c1493e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c157270 0x7fe83c1493e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 -- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe83c1576f0 msgr2=0x7fe83c149920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe83c1576f0 0x7fe83c149920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 -- 172.21.15.100:0/2531981857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83c14ace0 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe840a00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e7b0 tx=0x7fe82c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00eec0 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe82c00c870 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe82c00cc00 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.285+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83c14afc0 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.286+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83c0c1580 con 0x7fe81c004d00 2024-01-20T08:10:42.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.287+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe83c14b4e0 con 0x7fe81c004d00 2024-01-20T08:10:42.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.288+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe82c013420 con 0x7fe81c004d00 2024-01-20T08:10:42.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.289+0000 7fe838c00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 0x7fe81406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:42.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.289+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe82c089260 con 0x7fe81c004d00 2024-01-20T08:10:42.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.289+0000 7fe83be00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 0x7fe81406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:42.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.290+0000 7fe83be00640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 0x7fe81406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe83c1ee9e0 tx=0x7fe824008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:42.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.293+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe83c14b4e0 con 0x7fe81c004d00 2024-01-20T08:10:42.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.488+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe83c14b4e0 con 0x7fe81c004d00 2024-01-20T08:10:42.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.493+0000 7fe838c00640 1 -- 172.21.15.100:0/2531981857 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe83c14b4e0 con 0x7fe81c004d00 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 msgr2=0x7fe81406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 0x7fe81406d3c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe83c1ee9e0 tx=0x7fe824008040 comp rx=0 tx=0).stop 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 msgr2=0x7fe83c14b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe82c00e7b0 tx=0x7fe82c00ec70 comp rx=0 tx=0).stop 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 shutdown_connections 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe83c1576f0 0x7fe83c149920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe81406af00 0x7fe81406d3c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe83c157270 0x7fe83c1493e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 --2- 172.21.15.100:0/2531981857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe81c004d00 0x7fe83c14b7c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:42.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 >> 172.21.15.100:0/2531981857 conn(0x7fe83c0ca0e0 msgr2=0x7fe83c14c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:42.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 shutdown_connections 2024-01-20T08:10:42.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:42.497+0000 7fe843400640 1 -- 172.21.15.100:0/2531981857 wait complete. 2024-01-20T08:10:42.519 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:10:42.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:10:42.629 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:10:42.747 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:10:42.748 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:10:42.748 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:42.804 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:10:42.805 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:42.854 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:10:42.854 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:42.950 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:43.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.165+0000 7fc511200640 1 Processor -- start 2024-01-20T08:10:43.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.165+0000 7fc511200640 1 -- start start 2024-01-20T08:10:43.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.166+0000 7fc511200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc50c0709e0 0x7fc50c0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.166+0000 7fc511200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc50c0c2e00 0x7fc50c0c3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc511200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc50c0c2970 con 0x7fc50c0c37d0 2024-01-20T08:10:43.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc511200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0c1fc0 con 0x7fc50c0709e0 2024-01-20T08:10:43.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc511200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc50c0c5f70 con 0x7fc50c0c2e00 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc50c0709e0 0x7fc50c0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc50c0709e0 0x7fc50c0c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46878/0 (socket says 172.21.15.100:46878) 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 -- 172.21.15.100:0/477519279 learned_addr learned my addr 172.21.15.100:0/477519279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 -- 172.21.15.100:0/477519279 >> v2:172.21.15.110:3300/0 conn(0x7fc50c0c2e00 msgr2=0x7fc50c0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 --2- 172.21.15.100:0/477519279 >> v2:172.21.15.110:3300/0 conn(0x7fc50c0c2e00 0x7fc50c0c3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 -- 172.21.15.100:0/477519279 >> v1:172.21.15.110:6789/0 conn(0x7fc50c0c37d0 legacy=0x7fc50c157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:43.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.167+0000 7fc509e00640 1 -- 172.21.15.100:0/477519279 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc50c0c1d20 con 0x7fc50c0709e0 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.168+0000 7fc509e00640 1 --2- 172.21.15.100:0/477519279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0709e0 0x7fc50c0c17e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0c8a90 tx=0x7fc4fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ff0a950624f2b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc509400640 1 -- 172.21.15.100:0/477519279 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc031870 con 0x7fc50c0709e0 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc509400640 1 -- 172.21.15.100:0/477519279 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc0319d0 con 0x7fc50c0709e0 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc509400640 1 -- 172.21.15.100:0/477519279 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc031d60 con 0x7fc50c0709e0 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 -- 172.21.15.100:0/477519279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0709e0 msgr2=0x7fc50c0c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 --2- 172.21.15.100:0/477519279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0709e0 0x7fc50c0c17e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc50c0c8a90 tx=0x7fc4fc02b910 comp rx=0 tx=0).stop 2024-01-20T08:10:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 -- 172.21.15.100:0/477519279 shutdown_connections 2024-01-20T08:10:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 --2- 172.21.15.100:0/477519279 >> v2:172.21.15.110:3300/0 conn(0x7fc50c0c2e00 0x7fc50c0c3290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 --2- 172.21.15.100:0/477519279 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0709e0 0x7fc50c0c17e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 -- 172.21.15.100:0/477519279 >> 172.21.15.100:0/477519279 conn(0x7fc50c06e770 msgr2=0x7fc50c066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 -- 172.21.15.100:0/477519279 shutdown_connections 2024-01-20T08:10:43.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.169+0000 7fc511200640 1 -- 172.21.15.100:0/477519279 wait complete. 2024-01-20T08:10:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.171+0000 7fc511200640 1 Processor -- start 2024-01-20T08:10:43.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.171+0000 7fc511200640 1 -- start start 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc50c0709e0 0x7fc50c14d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc50c0c37d0 0x7fc50c144720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c1562c0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c14dd50 con 0x7fc50c0709e0 2024-01-20T08:10:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc511200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50c155c70 con 0x7fc50c0c37d0 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc503e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc503e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46886/0 (socket says 172.21.15.100:46886) 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.172+0000 7fc503e00640 1 -- 172.21.15.100:0/229956297 learned_addr learned my addr 172.21.15.100:0/229956297 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc509e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc50c0709e0 0x7fc50c14d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 -- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc50c0c37d0 msgr2=0x7fc50c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc50a800640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc50c0c37d0 0x7fc50c144720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc50c0c37d0 0x7fc50c144720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 -- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc50c0709e0 msgr2=0x7fc50c14d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc50c0709e0 0x7fc50c14d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 -- 172.21.15.100:0/229956297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0094d0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc503e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b4d0 tx=0x7fc4f400b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4010870 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f40109d0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc50c155f50 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.173+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f4010d80 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.174+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc50c158b60 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.175+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc50c04e970 con 0x7fc50c0c2e00 2024-01-20T08:10:43.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.175+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc4f400f3c0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.176+0000 7fc502000640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 0x7fc4e406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.176+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f4089560 con 0x7fc50c0c2e00 2024-01-20T08:10:43.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.177+0000 7fc509e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 0x7fc4e406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.177+0000 7fc509e00640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 0x7fc4e406d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc036000 tx=0x7fc4fc03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.181+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc4f40544c0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.376+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc50c14e140 con 0x7fc50c0c2e00 2024-01-20T08:10:43.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.379+0000 7fc502000640 1 -- 172.21.15.100:0/229956297 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fc4f4057ae0 con 0x7fc50c0c2e00 2024-01-20T08:10:43.382 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:43.383 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 msgr2=0x7fc4e406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 0x7fc4e406d390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc036000 tx=0x7fc4fc03c040 comp rx=0 tx=0).stop 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 msgr2=0x7fc50c1441e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc4f400b4d0 tx=0x7fc4f400b990 comp rx=0 tx=0).stop 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 shutdown_connections 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc4e406aed0 0x7fc4e406d390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc50c0c37d0 0x7fc50c144720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc50c0c2e00 0x7fc50c1441e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 --2- 172.21.15.100:0/229956297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc50c0709e0 0x7fc50c14d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 >> 172.21.15.100:0/229956297 conn(0x7fc50c06e770 msgr2=0x7fc50c06b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:43.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 shutdown_connections 2024-01-20T08:10:43.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.382+0000 7fc511200640 1 -- 172.21.15.100:0/229956297 wait complete. 2024-01-20T08:10:43.403 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:43.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:43.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.616+0000 7fc907c00640 1 Processor -- start 2024-01-20T08:10:43.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.616+0000 7fc907c00640 1 -- start start 2024-01-20T08:10:43.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc90014b720 0x7fc9001515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9000c1850 0x7fc9000c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc90006c8d0 0x7fc90006cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc90014bb00 con 0x7fc90014b720 2024-01-20T08:10:43.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc900154ba0 con 0x7fc90006c8d0 2024-01-20T08:10:43.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.617+0000 7fc907c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc900155a00 con 0x7fc9000c1850 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc90014b720 0x7fc9001515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc90014b720 0x7fc9001515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46894/0 (socket says 172.21.15.100:46894) 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 -- 172.21.15.100:0/712034781 learned_addr learned my addr 172.21.15.100:0/712034781 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc8f7c00640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9000c1850 0x7fc9000c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905c00640 1 --2- 172.21.15.100:0/712034781 >> v2:172.21.15.110:3300/0 conn(0x7fc90006c8d0 0x7fc90006cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 -- 172.21.15.100:0/712034781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9000c1850 msgr2=0x7fc9000c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9000c1850 0x7fc9000c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 -- 172.21.15.100:0/712034781 >> v2:172.21.15.110:3300/0 conn(0x7fc90006c8d0 msgr2=0x7fc90006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 --2- 172.21.15.100:0/712034781 >> v2:172.21.15.110:3300/0 conn(0x7fc90006c8d0 0x7fc90006cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.618+0000 7fc905200640 1 -- 172.21.15.100:0/712034781 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900154df0 con 0x7fc90014b720 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc905200640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90014b720 0x7fc9001515b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc900072480 tx=0x7fc8f002da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65d7c360d995874 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc8ffe00640 1 -- 172.21.15.100:0/712034781 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002f850 con 0x7fc90014b720 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc8ffe00640 1 -- 172.21.15.100:0/712034781 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f002f9b0 con 0x7fc90014b720 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc8ffe00640 1 -- 172.21.15.100:0/712034781 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f002fd40 con 0x7fc90014b720 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc907c00640 1 -- 172.21.15.100:0/712034781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90014b720 msgr2=0x7fc9001515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.620+0000 7fc907c00640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90014b720 0x7fc9001515b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc900072480 tx=0x7fc8f002da90 comp rx=0 tx=0).stop 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 -- 172.21.15.100:0/712034781 shutdown_connections 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 --2- 172.21.15.100:0/712034781 >> v2:172.21.15.110:3300/0 conn(0x7fc90006c8d0 0x7fc90006cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9000c1850 0x7fc9000c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 --2- 172.21.15.100:0/712034781 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc90014b720 0x7fc9001515b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 -- 172.21.15.100:0/712034781 >> 172.21.15.100:0/712034781 conn(0x7fc9000c2940 msgr2=0x7fc9000c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:43.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 -- 172.21.15.100:0/712034781 shutdown_connections 2024-01-20T08:10:43.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.621+0000 7fc907c00640 1 -- 172.21.15.100:0/712034781 wait complete. 2024-01-20T08:10:43.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.622+0000 7fc907c00640 1 Processor -- start 2024-01-20T08:10:43.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.622+0000 7fc907c00640 1 -- start start 2024-01-20T08:10:43.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc90006c8d0 0x7fc9000bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc90014b720 0x7fc900150f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000aa950 con 0x7fc9000c1850 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001ea950 con 0x7fc90006c8d0 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.623+0000 7fc907c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000aabf0 con 0x7fc90014b720 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46908/0 (socket says 172.21.15.100:46908) 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 -- 172.21.15.100:0/1717807357 learned_addr learned my addr 172.21.15.100:0/1717807357 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc905c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc90014b720 0x7fc900150f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 -- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc90014b720 msgr2=0x7fc900150f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc90014b720 0x7fc900150f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 -- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc90006c8d0 msgr2=0x7fc9000bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc90006c8d0 0x7fc9000bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 -- 172.21.15.100:0/1717807357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f00094d0 con 0x7fc9000c1850 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.624+0000 7fc8f7c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800d800 tx=0x7fc8e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.625+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800b6c0 con 0x7fc9000c1850 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.625+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e800b820 con 0x7fc9000c1850 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.625+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e800bbb0 con 0x7fc9000c1850 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.625+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9000aaed0 con 0x7fc9000c1850 2024-01-20T08:10:43.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.625+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9000bfa20 con 0x7fc9000c1850 2024-01-20T08:10:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.626+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90004e970 con 0x7fc9000c1850 2024-01-20T08:10:43.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.627+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc8e800bd10 con 0x7fc9000c1850 2024-01-20T08:10:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.628+0000 7fc8fd600640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 0x7fc8d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.628+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc8e8089bf0 con 0x7fc9000c1850 2024-01-20T08:10:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.628+0000 7fc905200640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 0x7fc8d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:43.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.629+0000 7fc905200640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 0x7fc8d806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0038000 tx=0x7fc8f0032000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:43.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.632+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc8e8054ab0 con 0x7fc9000c1850 2024-01-20T08:10:43.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.823+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc9000c37e0 con 0x7fc9000c1850 2024-01-20T08:10:43.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.824+0000 7fc8fd600640 1 -- 172.21.15.100:0/1717807357 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc8e80580d0 con 0x7fc9000c1850 2024-01-20T08:10:43.827 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 msgr2=0x7fc8d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 0x7fc8d806d390 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0038000 tx=0x7fc8f0032000 comp rx=0 tx=0).stop 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 msgr2=0x7fc900150a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc8e800d800 tx=0x7fc8e800dcc0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 shutdown_connections 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8d806aed0 0x7fc8d806d390 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc90014b720 0x7fc900150f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9000c1850 0x7fc900150a00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 --2- 172.21.15.100:0/1717807357 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc90006c8d0 0x7fc9000bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 >> 172.21.15.100:0/1717807357 conn(0x7fc9000c2940 msgr2=0x7fc9000c4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 shutdown_connections 2024-01-20T08:10:43.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:43.827+0000 7fc907c00640 1 -- 172.21.15.100:0/1717807357 wait complete. 2024-01-20T08:10:43.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.055+0000 7f3540600640 1 Processor -- start 2024-01-20T08:10:44.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.055+0000 7f3540600640 1 -- start start 2024-01-20T08:10:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f3540600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f353814c750 0x7f3538153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f3540600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35380715a0 0x7f3538071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f3540600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35380ab620 con 0x7f35380ab0b0 2024-01-20T08:10:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f3540600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353814cb30 con 0x7f353814c750 2024-01-20T08:10:44.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f3540600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35380ab900 con 0x7f35380715a0 2024-01-20T08:10:44.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f353dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f353814c750 0x7f3538153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f353dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f353814c750 0x7f3538153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46916/0 (socket says 172.21.15.100:46916) 2024-01-20T08:10:44.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.057+0000 7f353dc00640 1 -- 172.21.15.100:0/2175846055 learned_addr learned my addr 172.21.15.100:0/2175846055 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:44.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.058+0000 7f353e600640 1 --2- 172.21.15.100:0/2175846055 >> v2:172.21.15.110:3300/0 conn(0x7f35380715a0 0x7f3538071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.058+0000 7f353dc00640 1 -- 172.21.15.100:0/2175846055 >> v2:172.21.15.110:3300/0 conn(0x7f35380715a0 msgr2=0x7f3538071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:44.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.058+0000 7f353dc00640 1 --2- 172.21.15.100:0/2175846055 >> v2:172.21.15.110:3300/0 conn(0x7f35380715a0 0x7f3538071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.058+0000 7f353dc00640 1 -- 172.21.15.100:0/2175846055 >> v1:172.21.15.100:6789/0 conn(0x7f35380ab0b0 legacy=0x7f35380a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.058+0000 7f353dc00640 1 -- 172.21.15.100:0/2175846055 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35380abbe0 con 0x7f353814c750 2024-01-20T08:10:44.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.059+0000 7f353dc00640 1 --2- 172.21.15.100:0/2175846055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f3538153190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35381501c0 tx=0x7f352802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381a33a19fff8fad server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.060+0000 7f3537e00640 1 -- 172.21.15.100:0/2175846055 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352802cb20 con 0x7f353814c750 2024-01-20T08:10:44.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.060+0000 7f3537e00640 1 -- 172.21.15.100:0/2175846055 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352802cc80 con 0x7f353814c750 2024-01-20T08:10:44.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.060+0000 7f3537e00640 1 -- 172.21.15.100:0/2175846055 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35280343f0 con 0x7f353814c750 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 -- 172.21.15.100:0/2175846055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 msgr2=0x7f3538153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 --2- 172.21.15.100:0/2175846055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f3538153190 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f35381501c0 tx=0x7f352802bf80 comp rx=0 tx=0).stop 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 -- 172.21.15.100:0/2175846055 shutdown_connections 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 --2- 172.21.15.100:0/2175846055 >> v2:172.21.15.110:3300/0 conn(0x7f35380715a0 0x7f3538071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 --2- 172.21.15.100:0/2175846055 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f3538153190 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 -- 172.21.15.100:0/2175846055 >> 172.21.15.100:0/2175846055 conn(0x7f35380c6090 msgr2=0x7f35380c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 -- 172.21.15.100:0/2175846055 shutdown_connections 2024-01-20T08:10:44.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.061+0000 7f3540600640 1 -- 172.21.15.100:0/2175846055 wait complete. 2024-01-20T08:10:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.063+0000 7f3540600640 1 Processor -- start 2024-01-20T08:10:44.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.063+0000 7f3540600640 1 -- start start 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35380715a0 0x7f3538151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35380ab0b0 0x7f35381dbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3538149f00 con 0x7f353814c750 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35381526d0 con 0x7f35380715a0 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f3540600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35381513b0 con 0x7f35380ab0b0 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f353e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f353e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46920/0 (socket says 172.21.15.100:46920) 2024-01-20T08:10:44.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.064+0000 7f353e600640 1 -- 172.21.15.100:0/4083300701 learned_addr learned my addr 172.21.15.100:0/4083300701 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353d200640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35380ab0b0 0x7f35381dbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353dc00640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35380715a0 0x7f3538151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 -- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35380ab0b0 msgr2=0x7f35381dbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35380ab0b0 0x7f35381dbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 -- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35380715a0 msgr2=0x7f3538151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35380715a0 0x7f3538151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 -- 172.21.15.100:0/4083300701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3528009b30 con 0x7f353814c750 2024-01-20T08:10:44.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f353e600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f353000d5d0 tx=0x7f353000da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35300125f0 con 0x7f353814c750 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3530012770 con 0x7f353814c750 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.065+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3530012b20 con 0x7f353814c750 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.066+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3538151650 con 0x7f353814c750 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.066+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35381eaf60 con 0x7f353814c750 2024-01-20T08:10:44.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.067+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35381eb120 con 0x7f353814c750 2024-01-20T08:10:44.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.068+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3530012c80 con 0x7f353814c750 2024-01-20T08:10:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.069+0000 7f3535600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 0x7f351006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.069+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3530089bc0 con 0x7f353814c750 2024-01-20T08:10:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.069+0000 7f353dc00640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 0x7f351006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.070+0000 7f353dc00640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 0x7f351006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3528035000 tx=0x7f3528030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.074+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3530054a00 con 0x7f353814c750 2024-01-20T08:10:44.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.268+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f353804ea50 con 0x7f353814c750 2024-01-20T08:10:44.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.269+0000 7f3535600640 1 -- 172.21.15.100:0/4083300701 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3530058020 con 0x7f353814c750 2024-01-20T08:10:44.272 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:44.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.272+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 msgr2=0x7f351006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.272+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 0x7f351006d390 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3528035000 tx=0x7f3528030000 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.272+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 msgr2=0x7f35381dc220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.272+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f353000d5d0 tx=0x7f353000da90 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 shutdown_connections 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f353814c750 0x7f35381dc220 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f351006aed0 0x7f351006d390 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35380ab0b0 0x7f35381dbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 --2- 172.21.15.100:0/4083300701 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35380715a0 0x7f3538151da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 >> 172.21.15.100:0/4083300701 conn(0x7f35380c6090 msgr2=0x7f35380c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 shutdown_connections 2024-01-20T08:10:44.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.273+0000 7f3540600640 1 -- 172.21.15.100:0/4083300701 wait complete. 2024-01-20T08:10:44.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:44.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.484+0000 7fc622800640 1 Processor -- start 2024-01-20T08:10:44.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.485+0000 7fc622800640 1 -- start start 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc622800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc61c0c4a50 0x7fc61c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc622800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc61c155290 0x7fc61c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc622800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc61c0c9f30 con 0x7fc61c151e40 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc622800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c06c5a0 con 0x7fc61c0c4a50 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc622800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc61c0c87a0 con 0x7fc61c155290 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc61b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc61c151e40 0x7fc61c155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58310/0 (socket says 172.21.15.100:58310) 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc61b400640 1 -- 172.21.15.100:0/3754380837 learned_addr learned my addr 172.21.15.100:0/3754380837 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:44.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.486+0000 7fc613e00640 1 --2- 172.21.15.100:0/3754380837 >> v2:172.21.15.100:3300/0 conn(0x7fc61c0c4a50 0x7fc61c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc61be00640 1 --2- 172.21.15.100:0/3754380837 >> v2:172.21.15.110:3300/0 conn(0x7fc61c155290 0x7fc61c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc61aa00640 1 -- 172.21.15.100:0/3754380837 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873855032 0 0) 0x7fc60c001110 con 0x7fc61c151e40 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc61aa00640 1 -- 172.21.15.100:0/3754380837 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5fc003520 con 0x7fc61c151e40 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc613e00640 1 -- 172.21.15.100:0/3754380837 >> v2:172.21.15.110:3300/0 conn(0x7fc61c155290 msgr2=0x7fc61c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc613e00640 1 --2- 172.21.15.100:0/3754380837 >> v2:172.21.15.110:3300/0 conn(0x7fc61c155290 0x7fc61c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc613e00640 1 -- 172.21.15.100:0/3754380837 >> v1:172.21.15.100:6789/0 conn(0x7fc61c151e40 legacy=0x7fc61c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.487+0000 7fc613e00640 1 -- 172.21.15.100:0/3754380837 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc61c156410 con 0x7fc61c0c4a50 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.488+0000 7fc613e00640 1 --2- 172.21.15.100:0/3754380837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c8c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0bdb30 tx=0x7fc60402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da91aa8538610bc7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.488+0000 7fc61aa00640 1 -- 172.21.15.100:0/3754380837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60402e070 con 0x7fc61c0c4a50 2024-01-20T08:10:44.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.488+0000 7fc61aa00640 1 -- 172.21.15.100:0/3754380837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6040315a0 con 0x7fc61c0c4a50 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.488+0000 7fc61aa00640 1 -- 172.21.15.100:0/3754380837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc604031930 con 0x7fc61c0c4a50 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 -- 172.21.15.100:0/3754380837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 msgr2=0x7fc61c0c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 --2- 172.21.15.100:0/3754380837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c8c30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc61c0bdb30 tx=0x7fc60402b840 comp rx=0 tx=0).stop 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 -- 172.21.15.100:0/3754380837 shutdown_connections 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 --2- 172.21.15.100:0/3754380837 >> v2:172.21.15.110:3300/0 conn(0x7fc61c155290 0x7fc61c06b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 --2- 172.21.15.100:0/3754380837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c8c30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 -- 172.21.15.100:0/3754380837 >> 172.21.15.100:0/3754380837 conn(0x7fc61c0abde0 msgr2=0x7fc61c0ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 -- 172.21.15.100:0/3754380837 shutdown_connections 2024-01-20T08:10:44.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.489+0000 7fc622800640 1 -- 172.21.15.100:0/3754380837 wait complete. 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.491+0000 7fc622800640 1 Processor -- start 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.491+0000 7fc622800640 1 -- start start 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc61c151e40 0x7fc61c1ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61c155290 0x7fc61c1eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1ea550 con 0x7fc61c0c4a50 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1eb3f0 con 0x7fc61c155290 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc622800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc61c1527b0 con 0x7fc61c151e40 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc61b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc61b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46938/0 (socket says 172.21.15.100:46938) 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc61b400640 1 -- 172.21.15.100:0/2017348179 learned_addr learned my addr 172.21.15.100:0/2017348179 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:44.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc613e00640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc61c151e40 0x7fc61c1ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.492+0000 7fc61be00640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61c155290 0x7fc61c1eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 -- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc61c151e40 msgr2=0x7fc61c1ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc61c151e40 0x7fc61c1ea970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 -- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61c155290 msgr2=0x7fc61c1eaeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61c155290 0x7fc61c1eaeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 -- 172.21.15.100:0/2017348179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc604009400 con 0x7fc61c0c4a50 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc61b400640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c700 tx=0x7fc60c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c005ab0 con 0x7fc61c0c4a50 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60c005c10 con 0x7fc61c0c4a50 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc61c152a90 con 0x7fc61c0c4a50 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60c001d50 con 0x7fc61c0c4a50 2024-01-20T08:10:44.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.493+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc61c153050 con 0x7fc61c0c4a50 2024-01-20T08:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.495+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc61c04e970 con 0x7fc61c0c4a50 2024-01-20T08:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.496+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc60c007070 con 0x7fc61c0c4a50 2024-01-20T08:10:44.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.497+0000 7fc613400640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 0x7fc5f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.497+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc60c0889c0 con 0x7fc61c0c4a50 2024-01-20T08:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.497+0000 7fc613e00640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 0x7fc5f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.498+0000 7fc613e00640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 0x7fc5f406d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc604036000 tx=0x7fc60403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.501+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc60c053920 con 0x7fc61c0c4a50 2024-01-20T08:10:44.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.695+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc61c0c9f30 con 0x7fc61c0c4a50 2024-01-20T08:10:44.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.696+0000 7fc613400640 1 -- 172.21.15.100:0/2017348179 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc61c0c9f30 con 0x7fc61c0c4a50 2024-01-20T08:10:44.707 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 msgr2=0x7fc5f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 0x7fc5f406d390 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc604036000 tx=0x7fc60403d040 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 msgr2=0x7fc61c0c6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc60c00c700 tx=0x7fc60c00cbc0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 shutdown_connections 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc61c155290 0x7fc61c1eaeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f406aed0 0x7fc5f406d390 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc61c151e40 0x7fc61c1ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 --2- 172.21.15.100:0/2017348179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc61c0c4a50 0x7fc61c0c6420 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 >> 172.21.15.100:0/2017348179 conn(0x7fc61c0abde0 msgr2=0x7fc61c0ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:44.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 shutdown_connections 2024-01-20T08:10:44.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.699+0000 7fc622800640 1 -- 172.21.15.100:0/2017348179 wait complete. 2024-01-20T08:10:44.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:10:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.896+0000 7fcda0c00640 1 Processor -- start 2024-01-20T08:10:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.896+0000 7fcda0c00640 1 -- start start 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcda0c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd9c14fdb0 0x7fcd9c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcda0c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcda0c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd9c150190 con 0x7fcd9c0c3460 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcda0c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd9c0a9ce0 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcda0c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c0a93b0 con 0x7fcd9c0c1d90 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcd99e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd9c14fdb0 0x7fcd9c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcd9a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcd9c0c3460 0x7fcd9c155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58322/0 (socket says 172.21.15.100:58322) 2024-01-20T08:10:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcd9a800640 1 -- 172.21.15.100:0/582752584 learned_addr learned my addr 172.21.15.100:0/582752584 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.898+0000 7fcd93e00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99400640 1 -- 172.21.15.100:0/582752584 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1281922515 0 0) 0x7fcd9c150190 con 0x7fcd9c0c3460 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99400640 1 -- 172.21.15.100:0/582752584 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd7c003520 con 0x7fcd9c0c3460 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99e00640 1 -- 172.21.15.100:0/582752584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 msgr2=0x7fcd9c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99e00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99e00640 1 -- 172.21.15.100:0/582752584 >> v1:172.21.15.100:6789/0 conn(0x7fcd9c0c3460 legacy=0x7fcd9c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.899+0000 7fcd99e00640 1 -- 172.21.15.100:0/582752584 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd9c0a8810 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.900+0000 7fcd99e00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c0c1850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097a0 tx=0x7fcd8c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3509b5eacce690a2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.900+0000 7fcd99400640 1 -- 172.21.15.100:0/582752584 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c02d040 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.900+0000 7fcd99400640 1 -- 172.21.15.100:0/582752584 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd8c031810 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.900+0000 7fcd99400640 1 -- 172.21.15.100:0/582752584 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd8c031ba0 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 -- 172.21.15.100:0/582752584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 msgr2=0x7fcd9c0c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c0c1850 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c0097a0 tx=0x7fcd8c02b8b0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 -- 172.21.15.100:0/582752584 shutdown_connections 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 --2- 172.21.15.100:0/582752584 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c0c1850 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 -- 172.21.15.100:0/582752584 >> 172.21.15.100:0/582752584 conn(0x7fcd9c0c2940 msgr2=0x7fcd9c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 -- 172.21.15.100:0/582752584 shutdown_connections 2024-01-20T08:10:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.901+0000 7fcda0c00640 1 -- 172.21.15.100:0/582752584 wait complete. 2024-01-20T08:10:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.902+0000 7fcda0c00640 1 Processor -- start 2024-01-20T08:10:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 -- start start 2024-01-20T08:10:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd9c0c3460 0x7fcd9c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1e9f90 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1ead70 con 0x7fcd9c0c3460 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.903+0000 7fcda0c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd9c1ea1a0 con 0x7fcd9c0c1d90 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46960/0 (socket says 172.21.15.100:46960) 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 -- 172.21.15.100:0/462313626 learned_addr learned my addr 172.21.15.100:0/462313626 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd93e00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd9c0c3460 0x7fcd9c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd99e00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 -- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 msgr2=0x7fcd9c151850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c151850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 -- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd9c0c3460 msgr2=0x7fcd9c14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd9c0c3460 0x7fcd9c14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.904+0000 7fcd9a800640 1 -- 172.21.15.100:0/462313626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd8c009400 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcd9a800640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400cb40 tx=0x7fcd9400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9400aca0 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd9400ae00 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd94012620 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd9c1ea440 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.905+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c1eaa00 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.906+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd9c04e970 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.907+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcd94007070 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.908+0000 7fcd92000640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 0x7fcd7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:44.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.908+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcd94089680 con 0x7fcd9c14fdb0 2024-01-20T08:10:44.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.908+0000 7fcd99e00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 0x7fcd7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:44.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.909+0000 7fcd99e00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 0x7fcd7406d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c036000 tx=0x7fcd8c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:44.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:44.917+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcd94054540 con 0x7fcd9c14fdb0 2024-01-20T08:10:45.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.116+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd9c1eaeb0 con 0x7fcd9c14fdb0 2024-01-20T08:10:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.116+0000 7fcd92000640 1 -- 172.21.15.100:0/462313626 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcd94057b60 con 0x7fcd9c14fdb0 2024-01-20T08:10:45.119 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:10:45.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.118+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 msgr2=0x7fcd7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.118+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 0x7fcd7406d390 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcd8c036000 tx=0x7fcd8c03c040 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.118+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 msgr2=0x7fcd9c14cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.118+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcd9400cb40 tx=0x7fcd9400a060 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 shutdown_connections 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd9c14fdb0 0x7fcd9c14cc90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd9c0c3460 0x7fcd9c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd7406aed0 0x7fcd7406d390 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 --2- 172.21.15.100:0/462313626 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd9c0c1d90 0x7fcd9c151850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 >> 172.21.15.100:0/462313626 conn(0x7fcd9c0c2940 msgr2=0x7fcd9c070da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 shutdown_connections 2024-01-20T08:10:45.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.119+0000 7fcda0c00640 1 -- 172.21.15.100:0/462313626 wait complete. 2024-01-20T08:10:45.138 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T08:10:45.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:45.138 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-01-20T08:10:45.222 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:10:45.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:45.223 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T08:10:45.278 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:10:45.278 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:45.335 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:10:45.335 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:45.386 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:10:45.386 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:10:45.439 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:45.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.640+0000 7f07ed000640 1 Processor -- start 2024-01-20T08:10:45.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.640+0000 7f07ed000640 1 -- start start 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07ed000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e8155120 0x7f07e8158630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07ed000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e81581a0 con 0x7f07e80ca280 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07ed000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e80c5290 con 0x7f07e814e6f0 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07ed000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e80c4cd0 con 0x7f07e8155120 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07de800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e8155120 0x7f07e8158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07e7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f07e80ca280 0x7f07e815f020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58334/0 (socket says 172.21.15.100:58334) 2024-01-20T08:10:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.642+0000 7f07e7e00640 1 -- 172.21.15.100:0/3826123188 learned_addr learned my addr 172.21.15.100:0/3826123188 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.643+0000 7f07de800640 1 -- 172.21.15.100:0/3826123188 >> v1:172.21.15.110:6789/0 conn(0x7f07e814e6f0 legacy=0x7f07e80c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.643+0000 7f07de800640 1 -- 172.21.15.100:0/3826123188 >> v1:172.21.15.100:6789/0 conn(0x7f07e80ca280 legacy=0x7f07e815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.643+0000 7f07de800640 1 -- 172.21.15.100:0/3826123188 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e80c4fb0 con 0x7f07e8155120 2024-01-20T08:10:45.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.644+0000 7f07de800640 1 --2- 172.21.15.100:0/3826123188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e8155120 0x7f07e8158630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f07d00097d0 tx=0x7f07d002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ccf44c3641cdac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.644+0000 7f07e6a00640 1 -- 172.21.15.100:0/3826123188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0031780 con 0x7f07e8155120 2024-01-20T08:10:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.644+0000 7f07e6a00640 1 -- 172.21.15.100:0/3826123188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d00318e0 con 0x7f07e8155120 2024-01-20T08:10:45.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.644+0000 7f07e6a00640 1 -- 172.21.15.100:0/3826123188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0031c70 con 0x7f07e8155120 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 -- 172.21.15.100:0/3826123188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e8155120 msgr2=0x7f07e8158630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 --2- 172.21.15.100:0/3826123188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e8155120 0x7f07e8158630 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f07d00097d0 tx=0x7f07d002b820 comp rx=0 tx=0).stop 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 -- 172.21.15.100:0/3826123188 shutdown_connections 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 --2- 172.21.15.100:0/3826123188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e8155120 0x7f07e8158630 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 -- 172.21.15.100:0/3826123188 >> 172.21.15.100:0/3826123188 conn(0x7f07e8071ef0 msgr2=0x7f07e8072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 -- 172.21.15.100:0/3826123188 shutdown_connections 2024-01-20T08:10:45.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.645+0000 7f07ed000640 1 -- 172.21.15.100:0/3826123188 wait complete. 2024-01-20T08:10:45.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.646+0000 7f07ed000640 1 Processor -- start 2024-01-20T08:10:45.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 -- start start 2024-01-20T08:10:45.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e814e6f0 0x7f07e8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e8155120 0x7f07e8151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e8151ba0 con 0x7f07e80ca280 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e80c41b0 con 0x7f07e8155120 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.647+0000 7f07ed000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e81eb830 con 0x7f07e814e6f0 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46972/0 (socket says 172.21.15.100:46972) 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 -- 172.21.15.100:0/2013030637 learned_addr learned my addr 172.21.15.100:0/2013030637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07de800640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e814e6f0 0x7f07e8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 -- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e814e6f0 msgr2=0x7f07e8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e814e6f0 0x7f07e8151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 -- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e8155120 msgr2=0x7f07e8151660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e8155120 0x7f07e8151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.648+0000 7f07e7400640 1 -- 172.21.15.100:0/2013030637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d0009400 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07e7400640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c460 tx=0x7f07d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8012830 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d80129d0 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8012d80 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e81eb220 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.649+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e80bf0e0 con 0x7f07e80ca280 2024-01-20T08:10:45.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.650+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e80749e0 con 0x7f07e80ca280 2024-01-20T08:10:45.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.652+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f07d801a3b0 con 0x7f07e80ca280 2024-01-20T08:10:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.653+0000 7f07dfe00640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 0x7f07c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.653+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07d8089310 con 0x7f07e80ca280 2024-01-20T08:10:45.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.653+0000 7f07de800640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 0x7f07c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:45.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.654+0000 7f07de800640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 0x7f07c006d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07d0036000 tx=0x7f07d0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:45.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.657+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f07d8054150 con 0x7f07e80ca280 2024-01-20T08:10:45.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.838+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e81555d0 con 0x7f07e80ca280 2024-01-20T08:10:45.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.840+0000 7f07dfe00640 1 -- 172.21.15.100:0/2013030637 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f07d8057770 con 0x7f07e80ca280 2024-01-20T08:10:45.844 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:45.844 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 msgr2=0x7f07c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 0x7f07c006d390 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f07d0036000 tx=0x7f07d0008030 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 msgr2=0x7f07e80bffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c460 tx=0x7f07d800c920 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 shutdown_connections 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e8155120 0x7f07e8151660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07c006aed0 0x7f07c006d390 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e814e6f0 0x7f07e8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 --2- 172.21.15.100:0/2013030637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e80ca280 0x7f07e80bffb0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 >> 172.21.15.100:0/2013030637 conn(0x7f07e8071ef0 msgr2=0x7f07e814bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:45.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 shutdown_connections 2024-01-20T08:10:45.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:45.843+0000 7f07ed000640 1 -- 172.21.15.100:0/2013030637 wait complete. 2024-01-20T08:10:45.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:45.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:46.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.069+0000 7fd5d0600640 1 Processor -- start 2024-01-20T08:10:46.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.070+0000 7fd5d0600640 1 -- start start 2024-01-20T08:10:46.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.071+0000 7fd5d0600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5c813b1e0 0x7fd5c806a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.071+0000 7fd5d0600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd5c813b7f0 0x7fd5c8152f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.071+0000 7fd5d0600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5c813b5c0 con 0x7fd5c806ab20 2024-01-20T08:10:46.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.071+0000 7fd5d0600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c81567e0 con 0x7fd5c813b1e0 2024-01-20T08:10:46.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.071+0000 7fd5d0600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5c8156c00 con 0x7fd5c813b7f0 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5c813b1e0 0x7fd5c806a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd5c813b1e0 0x7fd5c806a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46982/0 (socket says 172.21.15.100:46982) 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 -- 172.21.15.100:0/1785196184 learned_addr learned my addr 172.21.15.100:0/1785196184 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 -- 172.21.15.100:0/1785196184 >> v2:172.21.15.110:3300/0 conn(0x7fd5c813b7f0 msgr2=0x7fd5c8152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 --2- 172.21.15.100:0/1785196184 >> v2:172.21.15.110:3300/0 conn(0x7fd5c813b7f0 0x7fd5c8152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 -- 172.21.15.100:0/1785196184 >> v1:172.21.15.110:6789/0 conn(0x7fd5c806ab20 legacy=0x7fd5c8152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:46.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.072+0000 7fd5cdc00640 1 -- 172.21.15.100:0/1785196184 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5c80c1d80 con 0x7fd5c813b1e0 2024-01-20T08:10:46.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.073+0000 7fd5cdc00640 1 --2- 172.21.15.100:0/1785196184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b1e0 0x7fd5c806a5e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80729d0 tx=0x7fd5b802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8401393cc8dd317 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5c7e00640 1 -- 172.21.15.100:0/1785196184 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b802c960 con 0x7fd5c813b1e0 2024-01-20T08:10:46.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5c7e00640 1 -- 172.21.15.100:0/1785196184 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5b802cac0 con 0x7fd5c813b1e0 2024-01-20T08:10:46.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5c7e00640 1 -- 172.21.15.100:0/1785196184 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b802ce50 con 0x7fd5c813b1e0 2024-01-20T08:10:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 -- 172.21.15.100:0/1785196184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b1e0 msgr2=0x7fd5c806a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 --2- 172.21.15.100:0/1785196184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b1e0 0x7fd5c806a5e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd5c80729d0 tx=0x7fd5b802bdc0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 -- 172.21.15.100:0/1785196184 shutdown_connections 2024-01-20T08:10:46.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 --2- 172.21.15.100:0/1785196184 >> v2:172.21.15.110:3300/0 conn(0x7fd5c813b7f0 0x7fd5c8152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 --2- 172.21.15.100:0/1785196184 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b1e0 0x7fd5c806a5e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 -- 172.21.15.100:0/1785196184 >> 172.21.15.100:0/1785196184 conn(0x7fd5c806bd20 msgr2=0x7fd5c80c7010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.074+0000 7fd5d0600640 1 -- 172.21.15.100:0/1785196184 shutdown_connections 2024-01-20T08:10:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.075+0000 7fd5d0600640 1 -- 172.21.15.100:0/1785196184 wait complete. 2024-01-20T08:10:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.076+0000 7fd5d0600640 1 Processor -- start 2024-01-20T08:10:46.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.076+0000 7fd5d0600640 1 -- start start 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c806ab20 0x7fd5c814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c813b1e0 0x7fd5c81e8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c81e92f0 con 0x7fd5c813b7f0 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c814fe80 con 0x7fd5c813b1e0 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5d0600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5c80c5a00 con 0x7fd5c806ab20 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5ce600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5ce600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:46990/0 (socket says 172.21.15.100:46990) 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.077+0000 7fd5ce600640 1 -- 172.21.15.100:0/984801630 learned_addr learned my addr 172.21.15.100:0/984801630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5cd200640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c813b1e0 0x7fd5c81e8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5cdc00640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c806ab20 0x7fd5c814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 -- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c806ab20 msgr2=0x7fd5c814f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c806ab20 0x7fd5c814f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 -- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c813b1e0 msgr2=0x7fd5c81e8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c813b1e0 0x7fd5c81e8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 -- 172.21.15.100:0/984801630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b8009b30 con 0x7fd5c813b7f0 2024-01-20T08:10:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5ce600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b410 tx=0x7fd5c000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0011830 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5c00119b0 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5c0011d60 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.078+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5c80c4a70 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.079+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5c80c5030 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.080+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5c804e970 con 0x7fd5c813b7f0 2024-01-20T08:10:46.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.080+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd5c001a400 con 0x7fd5c813b7f0 2024-01-20T08:10:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.081+0000 7fd5c5600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 0x7fd5a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.081+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd5c0089730 con 0x7fd5c813b7f0 2024-01-20T08:10:46.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.082+0000 7fd5cdc00640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 0x7fd5a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.082+0000 7fd5cdc00640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 0x7fd5a006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8035000 tx=0x7fd5b8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.086+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd5c00545f0 con 0x7fd5c813b7f0 2024-01-20T08:10:46.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.264+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5c80c7c70 con 0x7fd5c813b7f0 2024-01-20T08:10:46.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.265+0000 7fd5c5600640 1 -- 172.21.15.100:0/984801630 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5c0057c10 con 0x7fd5c813b7f0 2024-01-20T08:10:46.268 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:46.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 msgr2=0x7fd5a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 0x7fd5a006d390 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd5b8035000 tx=0x7fd5b8030000 comp rx=0 tx=0).stop 2024-01-20T08:10:46.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 msgr2=0x7fd5c814f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd5c000b410 tx=0x7fd5c000b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 shutdown_connections 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd5c813b7f0 0x7fd5c814f0a0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd5c813b1e0 0x7fd5c81e8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5a006aed0 0x7fd5a006d390 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 --2- 172.21.15.100:0/984801630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd5c806ab20 0x7fd5c814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.267+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 >> 172.21.15.100:0/984801630 conn(0x7fd5c806bd20 msgr2=0x7fd5c8154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.268+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 shutdown_connections 2024-01-20T08:10:46.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.268+0000 7fd5d0600640 1 -- 172.21.15.100:0/984801630 wait complete. 2024-01-20T08:10:46.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.486+0000 7f224e000640 1 Processor -- start 2024-01-20T08:10:46.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.486+0000 7f224e000640 1 -- start start 2024-01-20T08:10:46.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.487+0000 7f224e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.487+0000 7f224e000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f22480c1d90 0x7f224815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.487+0000 7f224e000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2248151e50 con 0x7f224814ea50 2024-01-20T08:10:46.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.487+0000 7f224e000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22480a9180 con 0x7f22480c1d90 2024-01-20T08:10:46.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.487+0000 7f224e000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224814ee30 con 0x7f22480c2310 2024-01-20T08:10:46.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.488+0000 7f223fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.488+0000 7f223fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:34992/0 (socket says 172.21.15.100:34992) 2024-01-20T08:10:46.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.488+0000 7f223fc00640 1 -- 172.21.15.100:0/1789109412 learned_addr learned my addr 172.21.15.100:0/1789109412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.488+0000 7f224cc00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f224814ea50 0x7f2248071b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:54230/0 (socket says 172.21.15.100:54230) 2024-01-20T08:10:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.488+0000 7f224d600640 1 --2- 172.21.15.100:0/1789109412 >> v2:172.21.15.110:3300/0 conn(0x7f22480c1d90 0x7f224815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.489+0000 7f223fc00640 1 -- 172.21.15.100:0/1789109412 >> v2:172.21.15.110:3300/0 conn(0x7f22480c1d90 msgr2=0x7f224815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.489+0000 7f223fc00640 1 --2- 172.21.15.100:0/1789109412 >> v2:172.21.15.110:3300/0 conn(0x7f22480c1d90 0x7f224815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.489+0000 7f223fc00640 1 -- 172.21.15.100:0/1789109412 >> v1:172.21.15.110:6789/0 conn(0x7f224814ea50 legacy=0x7f2248071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.489+0000 7f223fc00640 1 -- 172.21.15.100:0/1789109412 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2248152380 con 0x7f22480c2310 2024-01-20T08:10:46.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.490+0000 7f223fc00640 1 --2- 172.21.15.100:0/1789109412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223002be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b61ea3c8d2adfb1a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f2247e00640 1 -- 172.21.15.100:0/1789109412 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f223002c9f0 con 0x7f22480c2310 2024-01-20T08:10:46.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f2247e00640 1 -- 172.21.15.100:0/1789109412 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223002cb50 con 0x7f22480c2310 2024-01-20T08:10:46.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f2247e00640 1 -- 172.21.15.100:0/1789109412 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22300343f0 con 0x7f22480c2310 2024-01-20T08:10:46.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 -- 172.21.15.100:0/1789109412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 msgr2=0x7f22480c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 --2- 172.21.15.100:0/1789109412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2230009e50 tx=0x7f223002be50 comp rx=0 tx=0).stop 2024-01-20T08:10:46.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 -- 172.21.15.100:0/1789109412 shutdown_connections 2024-01-20T08:10:46.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 --2- 172.21.15.100:0/1789109412 >> v2:172.21.15.110:3300/0 conn(0x7f22480c1d90 0x7f224815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 --2- 172.21.15.100:0/1789109412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f22480c2310 0x7f22480c1850 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 -- 172.21.15.100:0/1789109412 >> 172.21.15.100:0/1789109412 conn(0x7f22480c2940 msgr2=0x7f22480c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:46.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 -- 172.21.15.100:0/1789109412 shutdown_connections 2024-01-20T08:10:46.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.491+0000 7f224e000640 1 -- 172.21.15.100:0/1789109412 wait complete. 2024-01-20T08:10:46.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.493+0000 7f224e000640 1 Processor -- start 2024-01-20T08:10:46.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.493+0000 7f224e000640 1 -- start start 2024-01-20T08:10:46.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22480c2310 0x7f22481e6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f224814ea50 0x7f22481dd190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481e6db0 con 0x7f22480c1d90 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22481daa30 con 0x7f22480c2310 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224e000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22481dac80 con 0x7f224814ea50 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47004/0 (socket says 172.21.15.100:47004) 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.494+0000 7f224cc00640 1 -- 172.21.15.100:0/2641111531 learned_addr learned my addr 172.21.15.100:0/2641111531 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f223fc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22480c2310 0x7f22481e6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224d600640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f224814ea50 0x7f22481dd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 -- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f224814ea50 msgr2=0x7f22481dd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f224814ea50 0x7f22481dd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 -- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22480c2310 msgr2=0x7f22481e6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22480c2310 0x7f22481e6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 -- 172.21.15.100:0/2641111531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2230009b30 con 0x7f22480c1d90 2024-01-20T08:10:46.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224cc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f223800c3e0 tx=0x7f223800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380074e0 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2238007640 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22380049e0 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22481daf60 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.495+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22481db520 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.497+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224804e9e0 con 0x7f22480c1d90 2024-01-20T08:10:46.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.497+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2238004b40 con 0x7f22480c1d90 2024-01-20T08:10:46.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.498+0000 7f2245600640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.499+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2238089090 con 0x7f22480c1d90 2024-01-20T08:10:46.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.499+0000 7f223fc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.499+0000 7f223fc00640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 0x7f222006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2230035000 tx=0x7f2230030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.503+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2238053ec0 con 0x7f22480c1d90 2024-01-20T08:10:46.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.697+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22480a89e0 con 0x7f22480c1d90 2024-01-20T08:10:46.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.698+0000 7f2245600640 1 -- 172.21.15.100:0/2641111531 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22380574e0 con 0x7f22480c1d90 2024-01-20T08:10:46.701 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.700+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 msgr2=0x7f222006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.700+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 0x7f222006d3c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f2230035000 tx=0x7f2230030000 comp rx=0 tx=0).stop 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.700+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 msgr2=0x7f22481e3dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.700+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f223800c3e0 tx=0x7f223800c8a0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 shutdown_connections 2024-01-20T08:10:46.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f222006af00 0x7f222006d3c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f224814ea50 0x7f22481dd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22480c2310 0x7f22481e6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 --2- 172.21.15.100:0/2641111531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22480c1d90 0x7f22481e3dd0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 >> 172.21.15.100:0/2641111531 conn(0x7f22480c2940 msgr2=0x7f224814d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 shutdown_connections 2024-01-20T08:10:46.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.701+0000 7f224e000640 1 -- 172.21.15.100:0/2641111531 wait complete. 2024-01-20T08:10:46.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:46.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.931+0000 7f8e85e00640 1 Processor -- start 2024-01-20T08:10:46.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.931+0000 7f8e85e00640 1 -- start start 2024-01-20T08:10:46.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.932+0000 7f8e85e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e8014fdb0 0x7f8e800c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.932+0000 7f8e85e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e801532f0 0x7f8e8015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.932+0000 7f8e85e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e80150190 con 0x7f8e800c1d90 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e85e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e800a9ce0 con 0x7f8e8014fdb0 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e85e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e800a93b0 con 0x7f8e801532f0 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e7ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e8014fdb0 0x7f8e800c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e7ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8e8014fdb0 0x7f8e800c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47006/0 (socket says 172.21.15.100:47006) 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e7ea00640 1 -- 172.21.15.100:0/171933444 learned_addr learned my addr 172.21.15.100:0/171933444 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.933+0000 7f8e7f400640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e801532f0 0x7f8e8015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.934+0000 7f8e7ea00640 1 -- 172.21.15.100:0/171933444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e801532f0 msgr2=0x7f8e8015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.934+0000 7f8e7ea00640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e801532f0 0x7f8e8015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.934+0000 7f8e7ea00640 1 -- 172.21.15.100:0/171933444 >> v1:172.21.15.110:6789/0 conn(0x7f8e800c1d90 legacy=0x7f8e80152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.934+0000 7f8e7ea00640 1 -- 172.21.15.100:0/171933444 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800a8810 con 0x7f8e8014fdb0 2024-01-20T08:10:46.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.935+0000 7f8e7ea00640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e8014fdb0 0x7f8e800c1850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009870 tx=0x7f8e7002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6c746eb4f1fb2a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e7d600640 1 -- 172.21.15.100:0/171933444 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70030840 con 0x7f8e8014fdb0 2024-01-20T08:10:46.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e7d600640 1 -- 172.21.15.100:0/171933444 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e700309a0 con 0x7f8e8014fdb0 2024-01-20T08:10:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e7d600640 1 -- 172.21.15.100:0/171933444 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70030d30 con 0x7f8e8014fdb0 2024-01-20T08:10:46.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 -- 172.21.15.100:0/171933444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e8014fdb0 msgr2=0x7f8e800c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e8014fdb0 0x7f8e800c1850 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8e70009870 tx=0x7f8e7002b980 comp rx=0 tx=0).stop 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 -- 172.21.15.100:0/171933444 shutdown_connections 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e801532f0 0x7f8e8015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 --2- 172.21.15.100:0/171933444 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e8014fdb0 0x7f8e800c1850 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 -- 172.21.15.100:0/171933444 >> 172.21.15.100:0/171933444 conn(0x7f8e800c2940 msgr2=0x7f8e800c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 -- 172.21.15.100:0/171933444 shutdown_connections 2024-01-20T08:10:46.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.936+0000 7f8e85e00640 1 -- 172.21.15.100:0/171933444 wait complete. 2024-01-20T08:10:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.938+0000 7f8e85e00640 1 Processor -- start 2024-01-20T08:10:46.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.938+0000 7f8e85e00640 1 -- start start 2024-01-20T08:10:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e8014fdb0 0x7f8e80146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e801532f0 0x7f8e80144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8014a1f0 con 0x7f8e800c1d90 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8014c5e0 con 0x7f8e801532f0 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e85e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e801eae30 con 0x7f8e8014fdb0 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.939+0000 7f8e7ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47008/0 (socket says 172.21.15.100:47008) 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 -- 172.21.15.100:0/1704390093 learned_addr learned my addr 172.21.15.100:0/1704390093 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7e000640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e8014fdb0 0x7f8e80146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7f400640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e801532f0 0x7f8e80144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 -- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e8014fdb0 msgr2=0x7f8e80146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e8014fdb0 0x7f8e80146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 -- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e801532f0 msgr2=0x7f8e80144390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e801532f0 0x7f8e80144390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 -- 172.21.15.100:0/1704390093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700094d0 con 0x7f8e800c1d90 2024-01-20T08:10:46.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.940+0000 7f8e7ea00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.941+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70047070 con 0x7f8e800c1d90 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.941+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70039a90 con 0x7f8e800c1d90 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.941+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e8014a4d0 con 0x7f8e800c1d90 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.941+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70039e20 con 0x7f8e800c1d90 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.941+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8014c8c0 con 0x7f8e800c1d90 2024-01-20T08:10:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.942+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8004e970 con 0x7f8e800c1d90 2024-01-20T08:10:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.943+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8e7004c410 con 0x7f8e800c1d90 2024-01-20T08:10:46.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.944+0000 7f8e77400640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 0x7f8e5806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:46.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.944+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e7003e070 con 0x7f8e800c1d90 2024-01-20T08:10:46.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.944+0000 7f8e7e000640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 0x7f8e5806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:46.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.945+0000 7f8e7e000640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 0x7f8e5806d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e80152660 tx=0x7f8e68009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:46.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:46.948+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8e700769c0 con 0x7f8e800c1d90 2024-01-20T08:10:47.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.140+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e800bfa30 con 0x7f8e800c1d90 2024-01-20T08:10:47.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.141+0000 7f8e77400640 1 -- 172.21.15.100:0/1704390093 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e70079fe0 con 0x7f8e800c1d90 2024-01-20T08:10:47.144 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.143+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 msgr2=0x7f8e5806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.143+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 0x7f8e5806d3c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8e80152660 tx=0x7f8e68009040 comp rx=0 tx=0).stop 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.143+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 msgr2=0x7f8e8014bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.143+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8e70000c00 tx=0x7f8e70004730 comp rx=0 tx=0).stop 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 shutdown_connections 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8e801532f0 0x7f8e80144390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8e5806af00 0x7f8e5806d3c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8e8014fdb0 0x7f8e80146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 --2- 172.21.15.100:0/1704390093 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8e800c1d90 0x7f8e8014bd10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 >> 172.21.15.100:0/1704390093 conn(0x7f8e800c2940 msgr2=0x7f8e800c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:47.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 shutdown_connections 2024-01-20T08:10:47.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.144+0000 7f8e85e00640 1 -- 172.21.15.100:0/1704390093 wait complete. 2024-01-20T08:10:47.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:10:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.355+0000 7f20a6800640 1 Processor -- start 2024-01-20T08:10:47.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.355+0000 7f20a6800640 1 -- start start 2024-01-20T08:10:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.357+0000 7f20a6800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f20a00c24f0 0x7f20a0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.357+0000 7f20a6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.357+0000 7f20a6800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20a0071d00 con 0x7f20a0158af0 2024-01-20T08:10:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.357+0000 7f20a6800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20a0154ca0 con 0x7f20a00c24f0 2024-01-20T08:10:47.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.357+0000 7f20a6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0071fa0 con 0x7f20a01550c0 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:35046/0 (socket says 172.21.15.100:35046) 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 -- 172.21.15.100:0/3373418333 learned_addr learned my addr 172.21.15.100:0/3373418333 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209ea00640 1 --2- 172.21.15.100:0/3373418333 >> v2:172.21.15.110:3300/0 conn(0x7f20a00c24f0 0x7f20a0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 -- 172.21.15.100:0/3373418333 >> v2:172.21.15.110:3300/0 conn(0x7f20a00c24f0 msgr2=0x7f20a0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:47.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 --2- 172.21.15.100:0/3373418333 >> v2:172.21.15.110:3300/0 conn(0x7f20a00c24f0 0x7f20a0157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 -- 172.21.15.100:0/3373418333 >> v1:172.21.15.110:6789/0 conn(0x7f20a0158af0 legacy=0x7f20a006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.358+0000 7f209fe00640 1 -- 172.21.15.100:0/3373418333 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0072280 con 0x7f20a01550c0 2024-01-20T08:10:47.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.360+0000 7f209fe00640 1 --2- 172.21.15.100:0/3373418333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2098009e50 tx=0x7f209802be50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94cb9d13343ec64f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.360+0000 7f209e000640 1 -- 172.21.15.100:0/3373418333 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f209802c9f0 con 0x7f20a01550c0 2024-01-20T08:10:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.360+0000 7f209e000640 1 -- 172.21.15.100:0/3373418333 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f209802cb50 con 0x7f20a01550c0 2024-01-20T08:10:47.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.360+0000 7f209e000640 1 -- 172.21.15.100:0/3373418333 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20980343f0 con 0x7f20a01550c0 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 -- 172.21.15.100:0/3373418333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 msgr2=0x7f20a00c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 --2- 172.21.15.100:0/3373418333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2098009e50 tx=0x7f209802be50 comp rx=0 tx=0).stop 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 -- 172.21.15.100:0/3373418333 shutdown_connections 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 --2- 172.21.15.100:0/3373418333 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a01550c0 0x7f20a00c1850 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 --2- 172.21.15.100:0/3373418333 >> v2:172.21.15.110:3300/0 conn(0x7f20a00c24f0 0x7f20a0157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 -- 172.21.15.100:0/3373418333 >> 172.21.15.100:0/3373418333 conn(0x7f20a00c2940 msgr2=0x7f20a00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 -- 172.21.15.100:0/3373418333 shutdown_connections 2024-01-20T08:10:47.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.361+0000 7f20a6800640 1 -- 172.21.15.100:0/3373418333 wait complete. 2024-01-20T08:10:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.363+0000 7f20a6800640 1 Processor -- start 2024-01-20T08:10:47.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.363+0000 7f20a6800640 1 -- start start 2024-01-20T08:10:47.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a01550c0 0x7f20a00c1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 0x7f20a01425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a0152910 con 0x7f20a00c24f0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a014bdb0 con 0x7f20a01550c0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f20a6800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20a014c8f0 con 0x7f20a0158af0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f209f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f209f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47010/0 (socket says 172.21.15.100:47010) 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f209f400640 1 -- 172.21.15.100:0/1823307399 learned_addr learned my addr 172.21.15.100:0/1823307399 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f209ea00640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a01550c0 0x7f20a00c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.364+0000 7f209fe00640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 0x7f20a01425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 -- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 msgr2=0x7f20a01425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 0x7f20a01425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 -- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a01550c0 msgr2=0x7f20a00c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a01550c0 0x7f20a00c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 -- 172.21.15.100:0/1823307399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2098009b30 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209fe00640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 0x7f20a01425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f209f400640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f209000c400 tx=0x7f209000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20900052d0 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2090005450 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2090007260 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.365+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a014c050 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.366+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a014c610 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.367+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20a004e970 con 0x7f20a00c24f0 2024-01-20T08:10:47.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.368+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f20900073c0 con 0x7f20a00c24f0 2024-01-20T08:10:47.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.368+0000 7f2097400640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 0x7f207806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.369+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2090088990 con 0x7f20a00c24f0 2024-01-20T08:10:47.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.369+0000 7f209ea00640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 0x7f207806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.369+0000 7f209ea00640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 0x7f207806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a01546d0 tx=0x7f2088009190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:47.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.373+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2090053900 con 0x7f20a00c24f0 2024-01-20T08:10:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.578+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20a0074480 con 0x7f20a00c24f0 2024-01-20T08:10:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.579+0000 7f2097400640 1 -- 172.21.15.100:0/1823307399 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2090056f20 con 0x7f20a00c24f0 2024-01-20T08:10:47.581 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:10:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 msgr2=0x7f207806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 0x7f207806d3c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20a01546d0 tx=0x7f2088009190 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 msgr2=0x7f20a01eab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f209000c400 tx=0x7f209000c8c0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 shutdown_connections 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f207806af00 0x7f207806d3c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f20a0158af0 0x7f20a01425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f20a01550c0 0x7f20a00c1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 --2- 172.21.15.100:0/1823307399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f20a00c24f0 0x7f20a01eab00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 >> 172.21.15.100:0/1823307399 conn(0x7f20a00c2940 msgr2=0x7f20a00c0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.581+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 shutdown_connections 2024-01-20T08:10:47.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.582+0000 7f20a6800640 1 -- 172.21.15.100:0/1823307399 wait complete. 2024-01-20T08:10:47.602 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:10:47.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:47.602 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-01-20T08:10:47.710 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:10:47.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:10:47.711 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:10:47.780 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-20T08:10:47.780 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:47.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.991+0000 7fdd8be00640 1 Processor -- start 2024-01-20T08:10:47.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.992+0000 7fdd8be00640 1 -- start start 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd8be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd8414e440 0x7fdd840c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8406ddc0 0x7fdd841517a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd8be00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd8414e820 con 0x7fdd840c20f0 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd8be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd84150db0 con 0x7fdd8414e440 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd8be00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd840c10e0 con 0x7fdd8406ddc0 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd89400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd8414e440 0x7fdd840c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd89400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdd8414e440 0x7fdd840c0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47012/0 (socket says 172.21.15.100:47012) 2024-01-20T08:10:47.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.993+0000 7fdd89400640 1 -- 172.21.15.100:0/135335187 learned_addr learned my addr 172.21.15.100:0/135335187 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.994+0000 7fdd88a00640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8406ddc0 0x7fdd841517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.994+0000 7fdd89400640 1 -- 172.21.15.100:0/135335187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8406ddc0 msgr2=0x7fdd841517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.994+0000 7fdd89400640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8406ddc0 0x7fdd841517a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.994+0000 7fdd89400640 1 -- 172.21.15.100:0/135335187 >> v1:172.21.15.110:6789/0 conn(0x7fdd840c20f0 legacy=0x7fdd841543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:47.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.994+0000 7fdd89400640 1 -- 172.21.15.100:0/135335187 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd84071570 con 0x7fdd8414e440 2024-01-20T08:10:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.995+0000 7fdd89400640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd840c0ba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400bb00 tx=0x7fdd7402df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161c379d549e045c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.995+0000 7fdd83e00640 1 -- 172.21.15.100:0/135335187 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7402ece0 con 0x7fdd8414e440 2024-01-20T08:10:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.995+0000 7fdd83e00640 1 -- 172.21.15.100:0/135335187 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd74032070 con 0x7fdd8414e440 2024-01-20T08:10:47.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.995+0000 7fdd83e00640 1 -- 172.21.15.100:0/135335187 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd74038620 con 0x7fdd8414e440 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 -- 172.21.15.100:0/135335187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 msgr2=0x7fdd840c0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd840c0ba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fdd7400bb00 tx=0x7fdd7402df30 comp rx=0 tx=0).stop 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 -- 172.21.15.100:0/135335187 shutdown_connections 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd8406ddc0 0x7fdd841517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 --2- 172.21.15.100:0/135335187 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd840c0ba0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 -- 172.21.15.100:0/135335187 >> 172.21.15.100:0/135335187 conn(0x7fdd8406a5e0 msgr2=0x7fdd8406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 -- 172.21.15.100:0/135335187 shutdown_connections 2024-01-20T08:10:47.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.996+0000 7fdd8be00640 1 -- 172.21.15.100:0/135335187 wait complete. 2024-01-20T08:10:48.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.998+0000 7fdd8be00640 1 Processor -- start 2024-01-20T08:10:48.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.998+0000 7fdd8be00640 1 -- start start 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8406ddc0 0x7fdd841eaf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd840c20f0 0x7fdd84145560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd841eab70 con 0x7fdd8414e440 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8414a460 con 0x7fdd8406ddc0 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd8be00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd84144fa0 con 0x7fdd840c20f0 2024-01-20T08:10:48.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47018/0 (socket says 172.21.15.100:47018) 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 -- 172.21.15.100:0/2289753222 learned_addr learned my addr 172.21.15.100:0/2289753222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 -- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd840c20f0 msgr2=0x7fdd84145560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89400640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8406ddc0 0x7fdd841eaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd88a00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd840c20f0 0x7fdd84145560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd840c20f0 0x7fdd84145560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 -- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8406ddc0 msgr2=0x7fdd841eaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8406ddc0 0x7fdd841eaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:47.999+0000 7fdd89e00640 1 -- 172.21.15.100:0/2289753222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7400b760 con 0x7fdd8414e440 2024-01-20T08:10:48.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd89e00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c780 tx=0x7fdd7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c004b60 con 0x7fdd8414e440 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd7c00ce90 con 0x7fdd8414e440 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd84145280 con 0x7fdd8414e440 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c00a850 con 0x7fdd8414e440 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.000+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd841ea790 con 0x7fdd8414e440 2024-01-20T08:10:48.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.001+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd841eacb0 con 0x7fdd8414e440 2024-01-20T08:10:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.002+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdd7c00a9b0 con 0x7fdd8414e440 2024-01-20T08:10:48.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.003+0000 7fdd81600640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 0x7fdd5c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.003+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd7c089820 con 0x7fdd8414e440 2024-01-20T08:10:48.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.003+0000 7fdd89400640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 0x7fdd5c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.004+0000 7fdd89400640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 0x7fdd5c06d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd74039000 tx=0x7fdd74034000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.007+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdd841eacb0 con 0x7fdd8414e440 2024-01-20T08:10:48.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.239+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd841eacb0 con 0x7fdd8414e440 2024-01-20T08:10:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.240+0000 7fdd81600640 1 -- 172.21.15.100:0/2289753222 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fdd841eacb0 con 0x7fdd8414e440 2024-01-20T08:10:48.243 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:48.243 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:48.243 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 msgr2=0x7fdd5c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 0x7fdd5c06d390 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdd74039000 tx=0x7fdd74034000 comp rx=0 tx=0).stop 2024-01-20T08:10:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 msgr2=0x7fdd841df9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c00c780 tx=0x7fdd7c00cc40 comp rx=0 tx=0).stop 2024-01-20T08:10:48.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 shutdown_connections 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdd8414e440 0x7fdd841df9d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdd5c06aed0 0x7fdd5c06d390 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdd840c20f0 0x7fdd84145560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 --2- 172.21.15.100:0/2289753222 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdd8406ddc0 0x7fdd841eaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 >> 172.21.15.100:0/2289753222 conn(0x7fdd8406a5e0 msgr2=0x7fdd840c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 shutdown_connections 2024-01-20T08:10:48.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.243+0000 7fdd8be00640 1 -- 172.21.15.100:0/2289753222 wait complete. 2024-01-20T08:10:48.264 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.472+0000 7fcc81c00640 1 Processor -- start 2024-01-20T08:10:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.472+0000 7fcc81c00640 1 -- start start 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc81c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc7c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc81c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc7c0aae00 0x7fcc7c0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc81c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc7c0a9940 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc81c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc7c1500c0 con 0x7fcc7c0aae00 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc81c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c156810 con 0x7fcc7c14fce0 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc7a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcc7c0a93c0 0x7fcc7c152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58348/0 (socket says 172.21.15.100:58348) 2024-01-20T08:10:48.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.474+0000 7fcc7a000640 1 -- 172.21.15.100:0/4017848229 learned_addr learned my addr 172.21.15.100:0/4017848229 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc7c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc7b400640 1 --2- 172.21.15.100:0/4017848229 >> v2:172.21.15.110:3300/0 conn(0x7fcc7c0aae00 0x7fcc7c0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1932628111 0 0) 0x7fcc7c0a9940 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc5c003520 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 133507440 0 0) 0x7fcc5c003520 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 msgr2=0x7fcc7c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc7c153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 >> v2:172.21.15.110:3300/0 conn(0x7fcc7c0aae00 msgr2=0x7fcc7c0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 --2- 172.21.15.100:0/4017848229 >> v2:172.21.15.110:3300/0 conn(0x7fcc7c0aae00 0x7fcc7c0ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c156af0 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fcc64001670 con 0x7fcc7c0a93c0 2024-01-20T08:10:48.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 >> v1:172.21.15.100:6789/0 conn(0x7fcc7c0a93c0 legacy=0x7fcc7c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc5c003970 0x7fcc5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc5c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c004d00 0x7fcc5c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c1500c0 con 0x7fcc5c003970 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c156810 con 0x7fcc5c004d00 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.475+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c00b980 con 0x7fcc7c14fce0 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc5c003970 0x7fcc5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7a000640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc5c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7b400640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c004d00 0x7fcc5c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 -- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 msgr2=0x7fcc5c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc7c14fce0 0x7fcc5c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 -- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c004d00 msgr2=0x7fcc5c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc5c004d00 0x7fcc5c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.476+0000 7fcc7aa00640 1 -- 172.21.15.100:0/4017848229 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc5c003520 con 0x7fcc5c003970 2024-01-20T08:10:48.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.477+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc5c003970 0x7fcc5c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009fc0 tx=0x7fcc5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f6583e325dd6c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.477+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c02cc20 con 0x7fcc5c003970 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.477+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6c00f040 con 0x7fcc5c003970 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.477+0000 7fcc79600640 1 -- 172.21.15.100:0/4017848229 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c034440 con 0x7fcc5c003970 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 -- 172.21.15.100:0/4017848229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc5c003970 msgr2=0x7fcc5c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 --2- 172.21.15.100:0/4017848229 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc5c003970 0x7fcc5c003d90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009fc0 tx=0x7fcc5c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc7b400640 1 -- 172.21.15.100:0/4017848229 reap_dead start 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 -- 172.21.15.100:0/4017848229 shutdown_connections 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 -- 172.21.15.100:0/4017848229 >> 172.21.15.100:0/4017848229 conn(0x7fcc7c06a5e0 msgr2=0x7fcc7c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 -- 172.21.15.100:0/4017848229 shutdown_connections 2024-01-20T08:10:48.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.478+0000 7fcc81c00640 1 -- 172.21.15.100:0/4017848229 wait complete. 2024-01-20T08:10:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.480+0000 7fcc81c00640 1 Processor -- start 2024-01-20T08:10:48.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.480+0000 7fcc81c00640 1 -- start start 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c003970 0x7fcc7c071470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc7c14c0d0 0x7fcc7c148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c070830 con 0x7fcc7c1edc80 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c070b10 con 0x7fcc7c14c0d0 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc81c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7c14b5f0 con 0x7fcc5c003970 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc7a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc7a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47048/0 (socket says 172.21.15.100:47048) 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.481+0000 7fcc7a000640 1 -- 172.21.15.100:0/1314357609 learned_addr learned my addr 172.21.15.100:0/1314357609 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c003970 0x7fcc7c071470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7b400640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc7c14c0d0 0x7fcc7c148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 -- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c003970 msgr2=0x7fcc7c071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.486 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c003970 0x7fcc7c071470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 -- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc7c14c0d0 msgr2=0x7fcc7c148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc7c14c0d0 0x7fcc7c148a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 -- 172.21.15.100:0/1314357609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c14b8d0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc7a000640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc64001eb0 tx=0x7fcc6400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400c870 con 0x7fcc7c1edc80 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc6400c9f0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6400cda0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.482+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7c14bbb0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.483+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7c1ee0c0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.484+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7c0a9df0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.485+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcc6401d460 con 0x7fcc7c1edc80 2024-01-20T08:10:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.485+0000 7fcc72a00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 0x7fcc5406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.486+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcc640896b0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.486+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 0x7fcc5406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.486+0000 7fcc7aa00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 0x7fcc5406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c036000 tx=0x7fcc6c02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.490+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcc64054580 con 0x7fcc7c1edc80 2024-01-20T08:10:48.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.684+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcc7c14bda0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.687+0000 7fcc72a00640 1 -- 172.21.15.100:0/1314357609 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7fcc64057ba0 con 0x7fcc7c1edc80 2024-01-20T08:10:48.690 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:48.691 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.689+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 msgr2=0x7fcc5406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 0x7fcc5406d3c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c036000 tx=0x7fcc6c02e000 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 msgr2=0x7fcc7c149950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcc64001eb0 tx=0x7fcc6400ed50 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 shutdown_connections 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc7c14c0d0 0x7fcc7c148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc7c1edc80 0x7fcc7c149950 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcc5406af00 0x7fcc5406d3c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 --2- 172.21.15.100:0/1314357609 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc5c003970 0x7fcc7c071470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 >> 172.21.15.100:0/1314357609 conn(0x7fcc7c06a5e0 msgr2=0x7fcc7c0ab210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:48.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 shutdown_connections 2024-01-20T08:10:48.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.690+0000 7fcc81c00640 1 -- 172.21.15.100:0/1314357609 wait complete. 2024-01-20T08:10:48.711 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:10:06.100723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:10:07.215394+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:10:48.712 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:10:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.927+0000 7f1263000640 1 Processor -- start 2024-01-20T08:10:48.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.927+0000 7f1263000640 1 -- start start 2024-01-20T08:10:48.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1263000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c15c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1263000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f125c15cb60 0x7f125c1635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1263000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f125c06d420 con 0x7f125c15c240 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1263000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f125c0705b0 con 0x7f125c15cb60 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1263000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0c2260 con 0x7f125c070190 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1261000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f125c15cb60 0x7f125c1635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f125be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f125c15c240 0x7f125c06cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58352/0 (socket says 172.21.15.100:58352) 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f125be00640 1 -- 172.21.15.100:0/1055611371 learned_addr learned my addr 172.21.15.100:0/1055611371 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.929+0000 7f1253e00640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f1261000640 1 -- 172.21.15.100:0/1055611371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 msgr2=0x7f125c15c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f1261000640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c15c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f1261000640 1 -- 172.21.15.100:0/1055611371 >> v1:172.21.15.100:6789/0 conn(0x7f125c15c240 legacy=0x7f125c06cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f1261000640 1 -- 172.21.15.100:0/1055611371 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f125c0c2540 con 0x7f125c15cb60 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f125b400640 1 -- 172.21.15.100:0/1055611371 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017924160 0 0) 0x7f125c06d420 con 0x7f125c15c240 2024-01-20T08:10:48.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.930+0000 7f1253e00640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.931+0000 7f1261000640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15cb60 0x7f125c1635d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1254009d90 tx=0x7f125402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60988216f6a8c954 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.931+0000 7f125b400640 1 -- 172.21.15.100:0/1055611371 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125402cbd0 con 0x7f125c15cb60 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.931+0000 7f125b400640 1 -- 172.21.15.100:0/1055611371 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f125402cd30 con 0x7f125c15cb60 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.931+0000 7f125b400640 1 -- 172.21.15.100:0/1055611371 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125402cea0 con 0x7f125c15cb60 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 -- 172.21.15.100:0/1055611371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15cb60 msgr2=0x7f125c1635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15cb60 0x7f125c1635d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1254009d90 tx=0x7f125402be20 comp rx=0 tx=0).stop 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 -- 172.21.15.100:0/1055611371 shutdown_connections 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15cb60 0x7f125c1635d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 --2- 172.21.15.100:0/1055611371 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c15c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 -- 172.21.15.100:0/1055611371 >> 172.21.15.100:0/1055611371 conn(0x7f125c0c2940 msgr2=0x7f125c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 -- 172.21.15.100:0/1055611371 shutdown_connections 2024-01-20T08:10:48.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.932+0000 7f1263000640 1 -- 172.21.15.100:0/1055611371 wait complete. 2024-01-20T08:10:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.933+0000 7f1263000640 1 Processor -- start 2024-01-20T08:10:48.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 -- start start 2024-01-20T08:10:48.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 0x7f125c0a9170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c1f2c60 con 0x7f125c15c240 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c0c4f10 con 0x7f125c15cb60 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.934+0000 7f1263000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f125c1585c0 con 0x7f125c070190 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47064/0 (socket says 172.21.15.100:47064) 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 -- 172.21.15.100:0/3405877100 learned_addr learned my addr 172.21.15.100:0/3405877100 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f125be00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1261000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 0x7f125c0a9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 -- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 msgr2=0x7f125c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 -- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 msgr2=0x7f125c0a9170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 0x7f125c0a9170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 -- 172.21.15.100:0/3405877100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254009a70 con 0x7f125c15c240 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1261000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 0x7f125c0a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.935+0000 7f1253e00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f124400d7d0 tx=0x7f124400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.936+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244004030 con 0x7f125c15c240 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.936+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1244004190 con 0x7f125c15c240 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.936+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1244004520 con 0x7f125c15c240 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.936+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c1588a0 con 0x7f125c15c240 2024-01-20T08:10:48.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.936+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c158e60 con 0x7f125c15c240 2024-01-20T08:10:48.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.937+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c04e970 con 0x7f125c15c240 2024-01-20T08:10:48.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.938+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f12440096a0 con 0x7f125c15c240 2024-01-20T08:10:48.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.939+0000 7f1258c00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 0x7f123406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:48.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.939+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12440898c0 con 0x7f125c15c240 2024-01-20T08:10:48.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.939+0000 7f125be00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 0x7f123406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:48.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.940+0000 7f125be00640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 0x7f123406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f60 tx=0x7f124c007b70 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:48.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:48.943+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f12440546f0 con 0x7f125c15c240 2024-01-20T08:10:49.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.135+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f125c0c0ad0 con 0x7f125c15c240 2024-01-20T08:10:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.136+0000 7f1258c00640 1 -- 172.21.15.100:0/3405877100 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1244089070 con 0x7f125c15c240 2024-01-20T08:10:49.139 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 msgr2=0x7f123406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 0x7f123406d390 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f124c000f60 tx=0x7f124c007b70 comp rx=0 tx=0).stop 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 msgr2=0x7f125c1f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f124400d7d0 tx=0x7f124400dc90 comp rx=0 tx=0).stop 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 shutdown_connections 2024-01-20T08:10:49.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f125c15cb60 0x7f125c0a9170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f125c15c240 0x7f125c1f2150 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f123406aed0 0x7f123406d390 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 --2- 172.21.15.100:0/3405877100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f125c070190 0x7f125c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 >> 172.21.15.100:0/3405877100 conn(0x7f125c0c2940 msgr2=0x7f125c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 shutdown_connections 2024-01-20T08:10:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.139+0000 7f1263000640 1 -- 172.21.15.100:0/3405877100 wait complete. 2024-01-20T08:10:49.161 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:10:49.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.365+0000 7feab6a00640 1 Processor -- start 2024-01-20T08:10:49.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.366+0000 7feab6a00640 1 -- start start 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feab6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feab014c750 0x7feab0153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feab6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feab6a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feab00ab620 con 0x7feab00ab0b0 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feab6a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feab014cb30 con 0x7feab014c750 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feab6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab00ab900 con 0x7feab00715a0 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feaafe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feab014c750 0x7feab0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.367+0000 7feaafe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feab014c750 0x7feab0153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:57980/0 (socket says 172.21.15.100:57980) 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feaafe00640 1 -- 172.21.15.100:0/298221605 learned_addr learned my addr 172.21.15.100:0/298221605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feab4a00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feaafe00640 1 -- 172.21.15.100:0/298221605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 msgr2=0x7feab0071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:49.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feaafe00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feaafe00640 1 -- 172.21.15.100:0/298221605 >> v1:172.21.15.110:6789/0 conn(0x7feab00ab0b0 legacy=0x7feab00a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:49.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.368+0000 7feaafe00640 1 -- 172.21.15.100:0/298221605 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab00abbe0 con 0x7feab014c750 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.369+0000 7feaafe00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0153190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009870 tx=0x7feaa002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32f9bcdc07d5e32e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.369+0000 7feaaea00640 1 -- 172.21.15.100:0/298221605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0031640 con 0x7feab014c750 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.369+0000 7feaaea00640 1 -- 172.21.15.100:0/298221605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa00317a0 con 0x7feab014c750 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.369+0000 7feaaea00640 1 -- 172.21.15.100:0/298221605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0031b30 con 0x7feab014c750 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 -- 172.21.15.100:0/298221605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 msgr2=0x7feab0153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0153190 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009870 tx=0x7feaa002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 -- 172.21.15.100:0/298221605 shutdown_connections 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0071a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 --2- 172.21.15.100:0/298221605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0153190 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 -- 172.21.15.100:0/298221605 >> 172.21.15.100:0/298221605 conn(0x7feab00c6090 msgr2=0x7feab00c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 -- 172.21.15.100:0/298221605 shutdown_connections 2024-01-20T08:10:49.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.370+0000 7feab6a00640 1 -- 172.21.15.100:0/298221605 wait complete. 2024-01-20T08:10:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.372+0000 7feab6a00640 1 Processor -- start 2024-01-20T08:10:49.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.372+0000 7feab6a00640 1 -- start start 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feab00ab0b0 0x7feab01408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0141360 con 0x7feab014c750 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01431f0 con 0x7feab00ab0b0 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feab0142930 con 0x7feab00715a0 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58000/0 (socket says 172.21.15.100:58000) 2024-01-20T08:10:49.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feab4a00640 1 -- 172.21.15.100:0/854511660 learned_addr learned my addr 172.21.15.100:0/854511660 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.373+0000 7feaaf400640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feab00ab0b0 0x7feab01408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feaafe00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 -- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 msgr2=0x7feab0151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 -- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feab00ab0b0 msgr2=0x7feab01408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feab00ab0b0 0x7feab01408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 -- 172.21.15.100:0/854511660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00094d0 con 0x7feab014c750 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feaafe00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab4a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feaa8007e90 tx=0x7feaa800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8014420 con 0x7feab014c750 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa8014580 con 0x7feab014c750 2024-01-20T08:10:49.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa8014930 con 0x7feab014c750 2024-01-20T08:10:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab0142ba0 con 0x7feab014c750 2024-01-20T08:10:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.374+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab01521b0 con 0x7feab014c750 2024-01-20T08:10:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.376+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab01433a0 con 0x7feab014c750 2024-01-20T08:10:49.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.376+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feaa8014a90 con 0x7feab014c750 2024-01-20T08:10:49.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.377+0000 7feaa7e00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 0x7fea8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.377+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feaa8089f80 con 0x7feab014c750 2024-01-20T08:10:49.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.377+0000 7feaafe00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 0x7fea8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.378+0000 7feaafe00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 0x7fea8806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feaa0036000 tx=0x7feaa003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.382+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feab01433a0 con 0x7feab014c750 2024-01-20T08:10:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.574+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feab0143360 con 0x7feab014c750 2024-01-20T08:10:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.575+0000 7feaa7e00640 1 -- 172.21.15.100:0/854511660 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7feaa8054db0 con 0x7feab014c750 2024-01-20T08:10:49.578 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:10:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 msgr2=0x7fea8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 0x7fea8806d3c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7feaa0036000 tx=0x7feaa003c040 comp rx=0 tx=0).stop 2024-01-20T08:10:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 msgr2=0x7feab0140e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feaa8007e90 tx=0x7feaa800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 shutdown_connections 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab014c750 0x7feab0140e20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feab00ab0b0 0x7feab01408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fea8806af00 0x7fea8806d3c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 --2- 172.21.15.100:0/854511660 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feab00715a0 0x7feab0151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.578+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 >> 172.21.15.100:0/854511660 conn(0x7feab00c6090 msgr2=0x7feab0152ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.579+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 shutdown_connections 2024-01-20T08:10:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.579+0000 7feab6a00640 1 -- 172.21.15.100:0/854511660 wait complete. 2024-01-20T08:10:49.598 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:10:49.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.804+0000 7f9d62c00640 1 Processor -- start 2024-01-20T08:10:49.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.804+0000 7f9d62c00640 1 -- start start 2024-01-20T08:10:49.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d62c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9d5c0c3460 0x7f9d5c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d62c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c153120 0x7f9d5c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d62c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c150190 con 0x7f9d5c14fdb0 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d62c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0a9ce0 con 0x7f9d5c0c3460 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d62c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0a93b0 con 0x7f9d5c153120 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d5be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9d5c14fdb0 0x7f9d5c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36310/0 (socket says 172.21.15.100:36310) 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d5be00640 1 -- 172.21.15.100:0/3148648703 learned_addr learned my addr 172.21.15.100:0/3148648703 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:49.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d53e00640 1 --2- 172.21.15.100:0/3148648703 >> v2:172.21.15.100:3300/0 conn(0x7f9d5c0c3460 0x7f9d5c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d60c00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c153120 0x7f9d5c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d5b400640 1 -- 172.21.15.100:0/3148648703 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575743599 0 0) 0x7f9d5c150190 con 0x7f9d5c14fdb0 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d5b400640 1 -- 172.21.15.100:0/3148648703 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d3c003520 con 0x7f9d5c14fdb0 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.806+0000 7f9d53e00640 1 -- 172.21.15.100:0/3148648703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c153120 msgr2=0x7f9d5c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.807+0000 7f9d53e00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c153120 0x7f9d5c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.807+0000 7f9d53e00640 1 -- 172.21.15.100:0/3148648703 >> v1:172.21.15.100:6789/0 conn(0x7f9d5c14fdb0 legacy=0x7f9d5c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.807+0000 7f9d53e00640 1 -- 172.21.15.100:0/3148648703 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c1535b0 con 0x7f9d5c0c3460 2024-01-20T08:10:49.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d53e00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c0c3460 0x7f9d5c152be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d440097a0 tx=0x7f9d4402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26eb8d3a495c2bfc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d5b400640 1 -- 172.21.15.100:0/3148648703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4402d040 con 0x7f9d5c0c3460 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d5b400640 1 -- 172.21.15.100:0/3148648703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d44031810 con 0x7f9d5c0c3460 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d5b400640 1 -- 172.21.15.100:0/3148648703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d44031ba0 con 0x7f9d5c0c3460 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d62c00640 1 -- 172.21.15.100:0/3148648703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c0c3460 msgr2=0x7f9d5c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.808+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c0c3460 0x7f9d5c152be0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d440097a0 tx=0x7f9d4402b8b0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 -- 172.21.15.100:0/3148648703 shutdown_connections 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c153120 0x7f9d5c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3148648703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c0c3460 0x7f9d5c152be0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 -- 172.21.15.100:0/3148648703 >> 172.21.15.100:0/3148648703 conn(0x7f9d5c0c2940 msgr2=0x7f9d5c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 -- 172.21.15.100:0/3148648703 shutdown_connections 2024-01-20T08:10:49.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.809+0000 7f9d62c00640 1 -- 172.21.15.100:0/3148648703 wait complete. 2024-01-20T08:10:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.810+0000 7f9d62c00640 1 Processor -- start 2024-01-20T08:10:49.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.810+0000 7f9d62c00640 1 -- start start 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c0c3460 0x7f9d5c0bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d5c14fdb0 0x7f9d5c13b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1ed810 con 0x7f9d5c153120 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1edaf0 con 0x7f9d5c14fdb0 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.811+0000 7f9d62c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c1eddd0 con 0x7f9d5c0c3460 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58018/0 (socket says 172.21.15.100:58018) 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 -- 172.21.15.100:0/3620100520 learned_addr learned my addr 172.21.15.100:0/3620100520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:49.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d5be00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c0c3460 0x7f9d5c0bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d53e00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d5c14fdb0 0x7f9d5c13b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 -- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c0c3460 msgr2=0x7f9d5c0bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c0c3460 0x7f9d5c0bf4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 -- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d5c14fdb0 msgr2=0x7f9d5c13b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d5c14fdb0 0x7f9d5c13b160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:49.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.812+0000 7f9d60c00640 1 -- 172.21.15.100:0/3620100520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d44009400 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d60c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9d54007e40 tx=0x7f9d5400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d54014620 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5400ee90 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c1ee0b0 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540149e0 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.813+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c13bbe0 con 0x7f9d5c153120 2024-01-20T08:10:49.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.814+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c1ee570 con 0x7f9d5c153120 2024-01-20T08:10:49.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.815+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9d54014b40 con 0x7f9d5c153120 2024-01-20T08:10:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.816+0000 7f9d58c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 0x7f9d3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.816+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d5408a0f0 con 0x7f9d5c153120 2024-01-20T08:10:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.816+0000 7f9d5be00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 0x7f9d3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:49.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.817+0000 7f9d5be00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 0x7f9d3406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005880 tx=0x7f9d4c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:49.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:49.820+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9d54054f20 con 0x7f9d5c153120 2024-01-20T08:10:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.014+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9d5c04e970 con 0x7f9d5c153120 2024-01-20T08:10:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.015+0000 7f9d58c00640 1 -- 172.21.15.100:0/3620100520 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9d54058540 con 0x7f9d5c153120 2024-01-20T08:10:50.018 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 msgr2=0x7f9d3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 0x7f9d3406d390 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c005880 tx=0x7f9d4c009040 comp rx=0 tx=0).stop 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 msgr2=0x7f9d5c13b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9d54007e40 tx=0x7f9d5400e4b0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 shutdown_connections 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d5c153120 0x7f9d5c13b6a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d5c14fdb0 0x7f9d5c13b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9d3406aed0 0x7f9d3406d390 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 --2- 172.21.15.100:0/3620100520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d5c0c3460 0x7f9d5c0bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 >> 172.21.15.100:0/3620100520 conn(0x7f9d5c0c2940 msgr2=0x7f9d5c0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 shutdown_connections 2024-01-20T08:10:50.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.018+0000 7f9d62c00640 1 -- 172.21.15.100:0/3620100520 wait complete. 2024-01-20T08:10:50.040 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:50.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.240+0000 7fa201400640 1 Processor -- start 2024-01-20T08:10:50.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.240+0000 7fa201400640 1 -- start start 2024-01-20T08:10:50.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.241+0000 7fa201400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1fc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa201400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc0a9940 con 0x7fa1fc14fce0 2024-01-20T08:10:50.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa201400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1fc1500c0 con 0x7fa1fc0aae00 2024-01-20T08:10:50.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa201400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc156810 con 0x7fa1fc0a93c0 2024-01-20T08:10:50.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa1fa800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa1fc14fce0 0x7fa1fc152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36320/0 (socket says 172.21.15.100:36320) 2024-01-20T08:10:50.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa1fa800640 1 -- 172.21.15.100:0/3198848474 learned_addr learned my addr 172.21.15.100:0/3198848474 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:50.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa1f3e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1fc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758531681 0 0) 0x7fa1fc0a9940 con 0x7fa1fc14fce0 2024-01-20T08:10:50.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.242+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa1dc003520 con 0x7fa1fc14fce0 2024-01-20T08:10:50.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 849294821 0 0) 0x7fa1dc003520 con 0x7fa1fc14fce0 2024-01-20T08:10:50.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 msgr2=0x7fa1fc153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:50.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1fc153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 >> v1:172.21.15.110:6789/0 conn(0x7fa1fc0aae00 legacy=0x7fa1fc0ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc156af0 con 0x7fa1fc14fce0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fa1ec001670 con 0x7fa1fc14fce0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 >> v1:172.21.15.100:6789/0 conn(0x7fa1fc14fce0 legacy=0x7fa1fc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc156810 con 0x7fa1dc0039a0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00ba30 con 0x7fa1dc0047c0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1dc00bbf0 con 0x7fa1fc0a93c0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1f3e00640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.243+0000 7fa1fb200640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fa800640 1 -- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 msgr2=0x7fa1dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1dc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fa800640 1 -- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0047c0 msgr2=0x7fa1dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0047c0 0x7fa1dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fa800640 1 -- 172.21.15.100:0/3198848474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1dc003520 con 0x7fa1dc0039a0 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.244+0000 7fa1fb200640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc0a93c0 0x7fa1dc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c210 tx=0x7fa1dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2e434867cee02c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec005ad0 con 0x7fa1dc0039a0 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec005c30 con 0x7fa1dc0039a0 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa1f9e00640 1 -- 172.21.15.100:0/3198848474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec02c870 con 0x7fa1dc0039a0 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa201400640 1 -- 172.21.15.100:0/3198848474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1dc0039a0 msgr2=0x7fa1dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.245+0000 7fa201400640 1 --2- 172.21.15.100:0/3198848474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1dc0039a0 0x7fa1dc003dc0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00c210 tx=0x7fa1dc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.246+0000 7fa1fb200640 1 -- 172.21.15.100:0/3198848474 reap_dead start 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.246+0000 7fa201400640 1 -- 172.21.15.100:0/3198848474 shutdown_connections 2024-01-20T08:10:50.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.246+0000 7fa201400640 1 -- 172.21.15.100:0/3198848474 >> 172.21.15.100:0/3198848474 conn(0x7fa1fc06a5e0 msgr2=0x7fa1fc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.246+0000 7fa201400640 1 -- 172.21.15.100:0/3198848474 shutdown_connections 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.246+0000 7fa201400640 1 -- 172.21.15.100:0/3198848474 wait complete. 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.247+0000 7fa201400640 1 Processor -- start 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.247+0000 7fa201400640 1 -- start start 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 0x7fa1fc14e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc148420 0x7fa1fc1e5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1e8fe0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1e9840 con 0x7fa1dc0039a0 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.248+0000 7fa201400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1fc1e63f0 con 0x7fa1fc148420 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58034/0 (socket says 172.21.15.100:58034) 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 -- 172.21.15.100:0/3572859940 learned_addr learned my addr 172.21.15.100:0/3572859940 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1f3e00640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc148420 0x7fa1fc1e5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 0x7fa1fc14e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 -- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc148420 msgr2=0x7fa1fc1e5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc148420 0x7fa1fc1e5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 -- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 msgr2=0x7fa1fc14e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 0x7fa1fc14e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 -- 172.21.15.100:0/3572859940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1fc1489c0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 0x7fa1fc14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1fb200640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0c0860 tx=0x7fa1f4002000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.249+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003970 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.250+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1f4003af0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.250+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4003ea0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.250+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1fc1e91f0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.250+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1fc14e860 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.251+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1fc1e99f0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.252+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa1f4005030 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.252+0000 7fa1f2a00640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 0x7fa1d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.253+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1f408d0e0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.253+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 0x7fa1d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.253+0000 7fa1fa800640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 0x7fa1d406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.257+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa1fc1e99f0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.486+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1fc1e99f0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.487+0000 7fa1f2a00640 1 -- 172.21.15.100:0/3572859940 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fa1fc1e99f0 con 0x7fa1fc1e5f70 2024-01-20T08:10:50.490 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:50.490 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:50.490 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.489+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 msgr2=0x7fa1d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.489+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 0x7fa1d406d390 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec034000 tx=0x7fa1ec009030 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.489+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 msgr2=0x7fa1fc14b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.489+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa1fc0c0860 tx=0x7fa1f4002000 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 shutdown_connections 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1fc1e5f70 0x7fa1fc14b880 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1d406aed0 0x7fa1d406d390 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1fc148420 0x7fa1fc1e5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 --2- 172.21.15.100:0/3572859940 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1dc0039a0 0x7fa1fc14e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 >> 172.21.15.100:0/3572859940 conn(0x7fa1fc06a5e0 msgr2=0x7fa1fc150ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 shutdown_connections 2024-01-20T08:10:50.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.490+0000 7fa201400640 1 -- 172.21.15.100:0/3572859940 wait complete. 2024-01-20T08:10:50.511 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:50.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.712+0000 7f5e37400640 1 Processor -- start 2024-01-20T08:10:50.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.712+0000 7f5e37400640 1 -- start start 2024-01-20T08:10:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.713+0000 7f5e37400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e3014fce0 0x7f5e30153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.713+0000 7f5e37400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.713+0000 7f5e37400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e300a9940 con 0x7f5e30153440 2024-01-20T08:10:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.713+0000 7f5e37400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e301500c0 con 0x7f5e3014fce0 2024-01-20T08:10:50.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.713+0000 7f5e37400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e30156810 con 0x7f5e300a93c0 2024-01-20T08:10:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.714+0000 7f5e27c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.714+0000 7f5e27c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:50582/0 (socket says 172.21.15.100:50582) 2024-01-20T08:10:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.714+0000 7f5e27c00640 1 -- 172.21.15.100:0/2246140395 learned_addr learned my addr 172.21.15.100:0/2246140395 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:50.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.714+0000 7f5e34a00640 1 --2- 172.21.15.100:0/2246140395 >> v2:172.21.15.110:3300/0 conn(0x7f5e3014fce0 0x7f5e30153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.715+0000 7f5e27c00640 1 -- 172.21.15.100:0/2246140395 >> v2:172.21.15.110:3300/0 conn(0x7f5e3014fce0 msgr2=0x7f5e30153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.715+0000 7f5e27c00640 1 --2- 172.21.15.100:0/2246140395 >> v2:172.21.15.110:3300/0 conn(0x7f5e3014fce0 0x7f5e30153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.715+0000 7f5e27c00640 1 -- 172.21.15.100:0/2246140395 >> v1:172.21.15.110:6789/0 conn(0x7f5e30153440 legacy=0x7f5e300aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.715+0000 7f5e27c00640 1 -- 172.21.15.100:0/2246140395 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30156af0 con 0x7f5e300a93c0 2024-01-20T08:10:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.716+0000 7f5e27c00640 1 --2- 172.21.15.100:0/2246140395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009870 tx=0x7f5e1802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8fa03a58822e85f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.717+0000 7f5e2fe00640 1 -- 172.21.15.100:0/2246140395 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18030840 con 0x7f5e300a93c0 2024-01-20T08:10:50.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.717+0000 7f5e2fe00640 1 -- 172.21.15.100:0/2246140395 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e180309a0 con 0x7f5e300a93c0 2024-01-20T08:10:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.717+0000 7f5e2fe00640 1 -- 172.21.15.100:0/2246140395 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e18030d30 con 0x7f5e300a93c0 2024-01-20T08:10:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.717+0000 7f5e37400640 1 -- 172.21.15.100:0/2246140395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 msgr2=0x7f5e30152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.717+0000 7f5e37400640 1 --2- 172.21.15.100:0/2246140395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5e18009870 tx=0x7f5e1802b980 comp rx=0 tx=0).stop 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 -- 172.21.15.100:0/2246140395 shutdown_connections 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 --2- 172.21.15.100:0/2246140395 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e300a93c0 0x7f5e30152f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 --2- 172.21.15.100:0/2246140395 >> v2:172.21.15.110:3300/0 conn(0x7f5e3014fce0 0x7f5e30153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 -- 172.21.15.100:0/2246140395 >> 172.21.15.100:0/2246140395 conn(0x7f5e3006a5e0 msgr2=0x7f5e3006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 -- 172.21.15.100:0/2246140395 shutdown_connections 2024-01-20T08:10:50.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.718+0000 7f5e37400640 1 -- 172.21.15.100:0/2246140395 wait complete. 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.719+0000 7f5e37400640 1 Processor -- start 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.719+0000 7f5e37400640 1 -- start start 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e3014fce0 0x7f5e300c5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e30153440 0x7f5e300c1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301486b0 con 0x7f5e300a93c0 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301ec2d0 con 0x7f5e3014fce0 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e37400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e301dbf40 con 0x7f5e30153440 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.720+0000 7f5e34a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58036/0 (socket says 172.21.15.100:58036) 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 -- 172.21.15.100:0/602969796 learned_addr learned my addr 172.21.15.100:0/602969796 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:50.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e27c00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e3014fce0 0x7f5e300c5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e35400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e30153440 0x7f5e300c1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 -- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e30153440 msgr2=0x7f5e300c1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e30153440 0x7f5e300c1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 -- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e3014fce0 msgr2=0x7f5e300c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e3014fce0 0x7f5e300c5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 -- 172.21.15.100:0/602969796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e180094d0 con 0x7f5e300a93c0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.721+0000 7f5e34a00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e9e0 tx=0x7f5e2000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.722+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20009670 con 0x7f5e300a93c0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.722+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2000c970 con 0x7f5e300a93c0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.722+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2000cd20 con 0x7f5e300a93c0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.722+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e301ebe40 con 0x7f5e300a93c0 2024-01-20T08:10:50.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.722+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e301eb7f0 con 0x7f5e300a93c0 2024-01-20T08:10:50.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.723+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e3004e970 con 0x7f5e300a93c0 2024-01-20T08:10:50.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.724+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5e20013470 con 0x7f5e300a93c0 2024-01-20T08:10:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.725+0000 7f5e2d600640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 0x7f5e0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.725+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e20089b40 con 0x7f5e300a93c0 2024-01-20T08:10:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.725+0000 7f5e27c00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 0x7f5e0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:50.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.726+0000 7f5e27c00640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 0x7f5e0806d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e18036000 tx=0x7f5e18008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:50.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.729+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5e20054ab0 con 0x7f5e300a93c0 2024-01-20T08:10:50.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.907+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e3006b320 con 0x7f5e300a93c0 2024-01-20T08:10:50.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.909+0000 7f5e2d600640 1 -- 172.21.15.100:0/602969796 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f5e20017090 con 0x7f5e300a93c0 2024-01-20T08:10:50.913 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:50.913 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 msgr2=0x7f5e0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 0x7f5e0806d390 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5e18036000 tx=0x7f5e18008030 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 msgr2=0x7f5e300c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000e9e0 tx=0x7f5e2000eea0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 shutdown_connections 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e0806aed0 0x7f5e0806d390 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e30153440 0x7f5e300c1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e3014fce0 0x7f5e300c5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 --2- 172.21.15.100:0/602969796 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e300a93c0 0x7f5e300c5510 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:50.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 >> 172.21.15.100:0/602969796 conn(0x7f5e3006a5e0 msgr2=0x7f5e30153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 shutdown_connections 2024-01-20T08:10:50.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:50.912+0000 7f5e37400640 1 -- 172.21.15.100:0/602969796 wait complete. 2024-01-20T08:10:50.932 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T08:10:50.932 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:51.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.134+0000 7fae91c00640 1 Processor -- start 2024-01-20T08:10:51.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.134+0000 7fae91c00640 1 -- start start 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fae8c151f40 0x7fae8c1551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae8c0c7fb0 0x7fae8c06b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c0c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c06bf90 con 0x7fae8c151f40 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae8c155710 con 0x7fae8c0c7fb0 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae91c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c5310 con 0x7fae8c06b660 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fae8c151f40 0x7fae8c1551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fae8c151f40 0x7fae8c1551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58044/0 (socket says 172.21.15.100:58044) 2024-01-20T08:10:51.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.136+0000 7fae8aa00640 1 -- 172.21.15.100:0/567643466 learned_addr learned my addr 172.21.15.100:0/567643466 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:51.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8a000640 1 --2- 172.21.15.100:0/567643466 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0c7fb0 0x7fae8c06b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8b400640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c0c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8aa00640 1 -- 172.21.15.100:0/567643466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 msgr2=0x7fae8c0c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:51.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8aa00640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c0c60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8aa00640 1 -- 172.21.15.100:0/567643466 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0c7fb0 msgr2=0x7fae8c06b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:51.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8aa00640 1 --2- 172.21.15.100:0/567643466 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0c7fb0 0x7fae8c06b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.137+0000 7fae8aa00640 1 -- 172.21.15.100:0/567643466 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae8c0c4ff0 con 0x7fae8c151f40 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.138+0000 7fae8aa00640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1551d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0acc00 tx=0x7fae7c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac6ee20895fee7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.138+0000 7fae89600640 1 -- 172.21.15.100:0/567643466 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c030860 con 0x7fae8c151f40 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.138+0000 7fae89600640 1 -- 172.21.15.100:0/567643466 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7c0309c0 con 0x7fae8c151f40 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.138+0000 7fae89600640 1 -- 172.21.15.100:0/567643466 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7c030d50 con 0x7fae8c151f40 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 -- 172.21.15.100:0/567643466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 msgr2=0x7fae8c1551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1551d0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fae8c0acc00 tx=0x7fae7c02b9a0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 -- 172.21.15.100:0/567643466 shutdown_connections 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c0c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 --2- 172.21.15.100:0/567643466 >> v2:172.21.15.110:3300/0 conn(0x7fae8c0c7fb0 0x7fae8c06b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 --2- 172.21.15.100:0/567643466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1551d0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 -- 172.21.15.100:0/567643466 >> 172.21.15.100:0/567643466 conn(0x7fae8c0ca0b0 msgr2=0x7fae8c0ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 -- 172.21.15.100:0/567643466 shutdown_connections 2024-01-20T08:10:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.139+0000 7fae91c00640 1 -- 172.21.15.100:0/567643466 wait complete. 2024-01-20T08:10:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.141+0000 7fae91c00640 1 Processor -- start 2024-01-20T08:10:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.141+0000 7fae91c00640 1 -- start start 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c0c7fb0 0x7fae8c1e9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1ed310 con 0x7fae8c151f40 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c0c45c0 con 0x7fae8c0c7fb0 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae91c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae8c1edbb0 con 0x7fae8c06b660 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58050/0 (socket says 172.21.15.100:58050) 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 -- 172.21.15.100:0/3093151434 learned_addr learned my addr 172.21.15.100:0/3093151434 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8aa00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8a000640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c0c7fb0 0x7fae8c1e9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 -- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 msgr2=0x7fae8c153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c153180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 -- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c0c7fb0 msgr2=0x7fae8c1e9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c0c7fb0 0x7fae8c1e9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.142+0000 7fae8b400640 1 -- 172.21.15.100:0/3093151434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0094d0 con 0x7fae8c151f40 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae8b400640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae8400d5d0 tx=0x7fae8400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840125f0 con 0x7fae8c151f40 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84012770 con 0x7fae8c151f40 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84012b20 con 0x7fae8c151f40 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae8c0c42e0 con 0x7fae8c151f40 2024-01-20T08:10:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.143+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae8c1ed7d0 con 0x7fae8c151f40 2024-01-20T08:10:51.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.144+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae8c067b60 con 0x7fae8c151f40 2024-01-20T08:10:51.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.145+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fae84012c80 con 0x7fae8c151f40 2024-01-20T08:10:51.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.146+0000 7fae82a00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 0x7fae6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.146+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae84089ba0 con 0x7fae8c151f40 2024-01-20T08:10:51.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.146+0000 7fae8aa00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 0x7fae6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.147+0000 7fae8aa00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 0x7fae6406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036000 tx=0x7fae7c03b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.150+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fae840549e0 con 0x7fae8c151f40 2024-01-20T08:10:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.376+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae8c04e970 con 0x7fae8c151f40 2024-01-20T08:10:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.377+0000 7fae82a00640 1 -- 172.21.15.100:0/3093151434 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7fae84058000 con 0x7fae8c151f40 2024-01-20T08:10:51.380 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:51.380 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 msgr2=0x7fae6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 0x7fae6406d390 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fae7c036000 tx=0x7fae7c03b040 comp rx=0 tx=0).stop 2024-01-20T08:10:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 msgr2=0x7fae8c1ea2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fae8400d5d0 tx=0x7fae8400da90 comp rx=0 tx=0).stop 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 shutdown_connections 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae8c151f40 0x7fae8c1ea2e0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae8c0c7fb0 0x7fae8c1e9da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae6406aed0 0x7fae6406d390 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 --2- 172.21.15.100:0/3093151434 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae8c06b660 0x7fae8c153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 >> 172.21.15.100:0/3093151434 conn(0x7fae8c0ca0b0 msgr2=0x7fae8c150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 shutdown_connections 2024-01-20T08:10:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.380+0000 7fae91c00640 1 -- 172.21.15.100:0/3093151434 wait complete. 2024-01-20T08:10:51.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.589+0000 7f7422200640 1 Processor -- start 2024-01-20T08:10:51.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.589+0000 7f7422200640 1 -- start start 2024-01-20T08:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.590+0000 7f7422200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f741c0ac000 0x7f741c0721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.590+0000 7f7422200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f741c159760 0x7f741c156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.590+0000 7f7422200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f741c1592d0 con 0x7f741c0705e0 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.590+0000 7f7422200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c158ca0 con 0x7f741c159760 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.590+0000 7f7422200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f741c15cd40 con 0x7f741c0ac000 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f741c159760 0x7f741c156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f741c0705e0 0x7f741c15a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36328/0 (socket says 172.21.15.100:36328) 2024-01-20T08:10:51.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741b400640 1 -- 172.21.15.100:0/2910716754 learned_addr learned my addr 172.21.15.100:0/2910716754 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f7412800640 1 --2- 172.21.15.100:0/2910716754 >> v2:172.21.15.110:3300/0 conn(0x7f741c0ac000 0x7f741c0721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741be00640 1 -- 172.21.15.100:0/2910716754 >> v2:172.21.15.110:3300/0 conn(0x7f741c0ac000 msgr2=0x7f741c0721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741be00640 1 --2- 172.21.15.100:0/2910716754 >> v2:172.21.15.110:3300/0 conn(0x7f741c0ac000 0x7f741c0721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741be00640 1 -- 172.21.15.100:0/2910716754 >> v1:172.21.15.100:6789/0 conn(0x7f741c0705e0 legacy=0x7f741c15a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741aa00640 1 -- 172.21.15.100:0/2910716754 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4056844511 0 0) 0x7f741c1592d0 con 0x7f741c0705e0 2024-01-20T08:10:51.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.591+0000 7f741be00640 1 -- 172.21.15.100:0/2910716754 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f741c15d020 con 0x7f741c159760 2024-01-20T08:10:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.593+0000 7f741be00640 1 --2- 172.21.15.100:0/2910716754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c159760 0x7f741c156040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f741c071620 tx=0x7f741402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caee0a38f80d801f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.593+0000 7f741aa00640 1 -- 172.21.15.100:0/2910716754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741402cbf0 con 0x7f741c159760 2024-01-20T08:10:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.593+0000 7f741aa00640 1 -- 172.21.15.100:0/2910716754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741402cd50 con 0x7f741c159760 2024-01-20T08:10:51.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.593+0000 7f741aa00640 1 -- 172.21.15.100:0/2910716754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7414034660 con 0x7f741c159760 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 -- 172.21.15.100:0/2910716754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c159760 msgr2=0x7f741c156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 --2- 172.21.15.100:0/2910716754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c159760 0x7f741c156040 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f741c071620 tx=0x7f741402be40 comp rx=0 tx=0).stop 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 -- 172.21.15.100:0/2910716754 shutdown_connections 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 --2- 172.21.15.100:0/2910716754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c159760 0x7f741c156040 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 --2- 172.21.15.100:0/2910716754 >> v2:172.21.15.110:3300/0 conn(0x7f741c0ac000 0x7f741c0721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 -- 172.21.15.100:0/2910716754 >> 172.21.15.100:0/2910716754 conn(0x7f741c06a5e0 msgr2=0x7f741c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 -- 172.21.15.100:0/2910716754 shutdown_connections 2024-01-20T08:10:51.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.594+0000 7f7422200640 1 -- 172.21.15.100:0/2910716754 wait complete. 2024-01-20T08:10:51.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.595+0000 7f7422200640 1 Processor -- start 2024-01-20T08:10:51.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.596+0000 7f7422200640 1 -- start start 2024-01-20T08:10:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.596+0000 7f7422200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.596+0000 7f7422200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f741c0ac000 0x7f741c0bf040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f7422200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f741c159760 0x7f741c0bf580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f7422200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0aa8b0 con 0x7f741c0705e0 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f7422200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741c0bd870 con 0x7f741c0ac000 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f7422200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f741c158220 con 0x7f741c159760 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58064/0 (socket says 172.21.15.100:58064) 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 -- 172.21.15.100:0/935044482 learned_addr learned my addr 172.21.15.100:0/935044482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 -- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f741c159760 msgr2=0x7f741c0bf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f741c159760 0x7f741c0bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 -- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f741c0ac000 msgr2=0x7f741c0bf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f741c0ac000 0x7f741c0bf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 -- 172.21.15.100:0/935044482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009a70 con 0x7f741c0705e0 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.597+0000 7f741b400640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c4d0 tx=0x7f740c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.598+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c0074e0 con 0x7f741c0705e0 2024-01-20T08:10:51.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.598+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f740c007640 con 0x7f741c0705e0 2024-01-20T08:10:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.598+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f740c004a20 con 0x7f741c0705e0 2024-01-20T08:10:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.598+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f741c158500 con 0x7f741c0705e0 2024-01-20T08:10:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.598+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f741c0aa4d0 con 0x7f741c0705e0 2024-01-20T08:10:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.599+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741c0aa660 con 0x7f741c0705e0 2024-01-20T08:10:51.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.600+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f740c004b80 con 0x7f741c0705e0 2024-01-20T08:10:51.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.601+0000 7f7413e00640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 0x7f73f406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:51.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.601+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f740c088720 con 0x7f741c0705e0 2024-01-20T08:10:51.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.601+0000 7f7412800640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 0x7f73f406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:51.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.602+0000 7f7412800640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 0x7f73f406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f741c0c0ae0 tx=0x7f7404008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:51.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.605+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f740c053680 con 0x7f741c0705e0 2024-01-20T08:10:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.817+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f741c1586f0 con 0x7f741c0705e0 2024-01-20T08:10:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.818+0000 7f7413e00640 1 -- 172.21.15.100:0/935044482 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4941 (secure 0 0 0) 0x7f740c018090 con 0x7f741c0705e0 2024-01-20T08:10:51.822 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:51.822 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6833/981499741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":981499741},{"type":"v1","addr":"172.21.15.110:6833","nonce":981499741}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4235,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3609131637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6834","nonce":3609131637},{"type":"v1","addr":"172.21.15.110:6835","nonce":3609131637}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/3758497544","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":3758497544},{"type":"v1","addr":"172.21.15.100:6835","nonce":3758497544}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:10:08.212342+0000","modified":"2024-01-20T08:10:11.485762+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/3076466356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3076466356},{"type":"v1","addr":"172.21.15.100:6837","nonce":3076466356}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-01-20T08:10:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 8 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 msgr2=0x7f73f406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 0x7f73f406d390 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f741c0c0ae0 tx=0x7f7404008040 comp rx=0 tx=0).stop 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 msgr2=0x7f741c0c0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f740c00c4d0 tx=0x7f740c00c990 comp rx=0 tx=0).stop 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 shutdown_connections 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f73f406aed0 0x7f73f406d390 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f741c159760 0x7f741c0bf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f741c0ac000 0x7f741c0bf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 --2- 172.21.15.100:0/935044482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f741c0705e0 0x7f741c0c0040 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 >> 172.21.15.100:0/935044482 conn(0x7f741c06a5e0 msgr2=0x7f741c0c4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 shutdown_connections 2024-01-20T08:10:51.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:51.821+0000 7f7422200640 1 -- 172.21.15.100:0/935044482 wait complete. 2024-01-20T08:10:51.841 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:10:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.045+0000 7f430c000640 1 Processor -- start 2024-01-20T08:10:52.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.045+0000 7f430c000640 1 -- start start 2024-01-20T08:10:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.046+0000 7f430c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.046+0000 7f430c000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43040aae00 0x7f43040ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f430c000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43040a9940 con 0x7f43040a93c0 2024-01-20T08:10:52.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f430c000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43041500c0 con 0x7f43040aae00 2024-01-20T08:10:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f430c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4304156810 con 0x7f430414fce0 2024-01-20T08:10:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f4309600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f4309600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:50612/0 (socket says 172.21.15.100:50612) 2024-01-20T08:10:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f4309600640 1 -- 172.21.15.100:0/1168356043 learned_addr learned my addr 172.21.15.100:0/1168356043 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:52.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.047+0000 7f430a000640 1 --2- 172.21.15.100:0/1168356043 >> v2:172.21.15.110:3300/0 conn(0x7f43040aae00 0x7f43040ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.048+0000 7f4309600640 1 -- 172.21.15.100:0/1168356043 >> v2:172.21.15.110:3300/0 conn(0x7f43040aae00 msgr2=0x7f43040ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.048+0000 7f4309600640 1 --2- 172.21.15.100:0/1168356043 >> v2:172.21.15.110:3300/0 conn(0x7f43040aae00 0x7f43040ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.048+0000 7f4309600640 1 -- 172.21.15.100:0/1168356043 >> v1:172.21.15.110:6789/0 conn(0x7f43040a93c0 legacy=0x7f4304152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.048+0000 7f4303e00640 1 -- 172.21.15.100:0/1168356043 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2516339405 0 0) 0x7f43040a9940 con 0x7f43040a93c0 2024-01-20T08:10:52.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.048+0000 7f4309600640 1 -- 172.21.15.100:0/1168356043 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4304156af0 con 0x7f430414fce0 2024-01-20T08:10:52.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.049+0000 7f4309600640 1 --2- 172.21.15.100:0/1168356043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009870 tx=0x7f42f402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f90251562a4e9810 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.050+0000 7f4303e00640 1 -- 172.21.15.100:0/1168356043 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4030840 con 0x7f430414fce0 2024-01-20T08:10:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.050+0000 7f4303e00640 1 -- 172.21.15.100:0/1168356043 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f40309a0 con 0x7f430414fce0 2024-01-20T08:10:52.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.050+0000 7f4303e00640 1 -- 172.21.15.100:0/1168356043 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f4030d30 con 0x7f430414fce0 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 -- 172.21.15.100:0/1168356043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 msgr2=0x7f4304153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 --2- 172.21.15.100:0/1168356043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009870 tx=0x7f42f402b980 comp rx=0 tx=0).stop 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 -- 172.21.15.100:0/1168356043 shutdown_connections 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 --2- 172.21.15.100:0/1168356043 >> v2:172.21.15.110:3300/0 conn(0x7f43040aae00 0x7f43040ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 --2- 172.21.15.100:0/1168356043 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f430414fce0 0x7f4304153b80 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 -- 172.21.15.100:0/1168356043 >> 172.21.15.100:0/1168356043 conn(0x7f430406a5e0 msgr2=0x7f430406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:52.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 -- 172.21.15.100:0/1168356043 shutdown_connections 2024-01-20T08:10:52.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.051+0000 7f430c000640 1 -- 172.21.15.100:0/1168356043 wait complete. 2024-01-20T08:10:52.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.053+0000 7f430c000640 1 Processor -- start 2024-01-20T08:10:52.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.053+0000 7f430c000640 1 -- start start 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.054+0000 7f430c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43040a93c0 0x7f430414aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.054+0000 7f430c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f430c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430414fce0 0x7f43040c5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f430c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43040c05b0 con 0x7f43040aae00 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f430c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43041e89f0 con 0x7f430414fce0 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f430c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430414b000 con 0x7f43040a93c0 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58072/0 (socket says 172.21.15.100:58072) 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 -- 172.21.15.100:0/3288876551 learned_addr learned my addr 172.21.15.100:0/3288876551 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f430a000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430414fce0 0x7f43040c5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4309600640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43040a93c0 0x7f430414aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 -- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43040a93c0 msgr2=0x7f430414aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43040a93c0 0x7f430414aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 -- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430414fce0 msgr2=0x7f43040c5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430414fce0 0x7f43040c5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.055+0000 7f4308c00640 1 -- 172.21.15.100:0/3288876551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f40094d0 con 0x7f43040aae00 2024-01-20T08:10:52.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f4308c00640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c4b0 tx=0x7f42ec00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec005480 con 0x7f43040aae00 2024-01-20T08:10:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ec0035f0 con 0x7f43040aae00 2024-01-20T08:10:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ec0039a0 con 0x7f43040aae00 2024-01-20T08:10:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43041e8c70 con 0x7f43040aae00 2024-01-20T08:10:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.056+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43041dc230 con 0x7f43040aae00 2024-01-20T08:10:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.057+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43041e8e00 con 0x7f43040aae00 2024-01-20T08:10:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.058+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f42ec003b00 con 0x7f43040aae00 2024-01-20T08:10:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.059+0000 7f4301600640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 0x7f42dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.059+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42ec088b20 con 0x7f43040aae00 2024-01-20T08:10:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.059+0000 7f4309600640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 0x7f42dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.060+0000 7f4309600640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 0x7f42dc06d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42f4036000 tx=0x7f42f4008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.064+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f42ec053a80 con 0x7f43040aae00 2024-01-20T08:10:52.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.257+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f43041df4b0 con 0x7f43040aae00 2024-01-20T08:10:52.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.260+0000 7f4301600640 1 -- 172.21.15.100:0/3288876551 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16482 (secure 0 0 0) 0x7f42ec017070 con 0x7f43040aae00 2024-01-20T08:10:52.264 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:52.264 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":22,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:09.744968+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:10:06.100723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-01-20T08:10:07.215394+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:10:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 msgr2=0x7f42dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 0x7f42dc06d390 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f42f4036000 tx=0x7f42f4008030 comp rx=0 tx=0).stop 2024-01-20T08:10:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 msgr2=0x7f43041dbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42ec00c4b0 tx=0x7f42ec00c970 comp rx=0 tx=0).stop 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 shutdown_connections 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f430414fce0 0x7f43040c5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43040aae00 0x7f43041dbcf0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f42dc06aed0 0x7f42dc06d390 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 --2- 172.21.15.100:0/3288876551 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43040a93c0 0x7f430414aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.263+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 >> 172.21.15.100:0/3288876551 conn(0x7f430406a5e0 msgr2=0x7f4304073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.264+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 shutdown_connections 2024-01-20T08:10:52.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.264+0000 7f430c000640 1 -- 172.21.15.100:0/3288876551 wait complete. 2024-01-20T08:10:52.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T08:10:52.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.492+0000 7f34ad200640 1 Processor -- start 2024-01-20T08:10:52.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.493+0000 7f34ad200640 1 -- start start 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f34ad200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34a8155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f34ad200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a80c9f30 con 0x7f34a80c4a50 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f34ad200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34a81557d0 con 0x7f34a8151e40 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f34ad200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a806c5a0 con 0x7f34a80c8c30 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f349d200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f34a80c4a50 0x7f34a806b140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36338/0 (socket says 172.21.15.100:36338) 2024-01-20T08:10:52.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f349d200640 1 -- 172.21.15.100:0/3616913776 learned_addr learned my addr 172.21.15.100:0/3616913776 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.494+0000 7f34a6800640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34a8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985088377 0 0) 0x7f3490001110 con 0x7f34a80c4a50 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3488003520 con 0x7f34a80c4a50 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1153958282 0 0) 0x7f3488003520 con 0x7f34a80c4a50 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 msgr2=0x7f34a8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:52.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34a8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 >> v1:172.21.15.110:6789/0 conn(0x7f34a8151e40 legacy=0x7f34a8155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80c87a0 con 0x7f34a80c4a50 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3490001800 con 0x7f34a80c4a50 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 >> v1:172.21.15.100:6789/0 conn(0x7f34a80c4a50 legacy=0x7f34a806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3488004d00 0x7f3488005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a806c5a0 con 0x7f3488003f70 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348800bb70 con 0x7f3488004d00 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348800bd30 con 0x7f34a80c8c30 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.495+0000 7f349d200640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f34a5e00640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f34a6800640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3488004d00 0x7f3488005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f349d200640 1 -- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 msgr2=0x7f34880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:52.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f349d200640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80c8c30 0x7f34880039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f349d200640 1 -- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3488004d00 msgr2=0x7f3488005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:52.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f349d200640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3488004d00 0x7f3488005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f349d200640 1 -- 172.21.15.100:0/3616913776 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3488003520 con 0x7f3488003f70 2024-01-20T08:10:52.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.496+0000 7f34a6800640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3488004d00 0x7f3488005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.497+0000 7f349d200640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34880047c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3490007f80 tx=0x7f34880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af985469b53d244d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.497+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490005ad0 con 0x7f3488003f70 2024-01-20T08:10:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.497+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3490005c50 con 0x7f3488003f70 2024-01-20T08:10:52.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.497+0000 7f34a5400640 1 -- 172.21.15.100:0/3616913776 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3490007070 con 0x7f3488003f70 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 -- 172.21.15.100:0/3616913776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 msgr2=0x7f34880047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 --2- 172.21.15.100:0/3616913776 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34880047c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f3490007f80 tx=0x7f34880057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34a6800640 1 -- 172.21.15.100:0/3616913776 reap_dead start 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 -- 172.21.15.100:0/3616913776 shutdown_connections 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 -- 172.21.15.100:0/3616913776 >> 172.21.15.100:0/3616913776 conn(0x7f34a80abde0 msgr2=0x7f34a80ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 -- 172.21.15.100:0/3616913776 shutdown_connections 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.498+0000 7f34ad200640 1 -- 172.21.15.100:0/3616913776 wait complete. 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.500+0000 7f34ad200640 1 Processor -- start 2024-01-20T08:10:52.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.500+0000 7f34ad200640 1 -- start start 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 0x7f34a8141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34a80c6310 0x7f34a80c6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c3f30 con 0x7f3488003f70 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80be820 con 0x7f34a80c6310 2024-01-20T08:10:52.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34ad200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34a80c1b30 con 0x7f34a80bf6d0 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58090/0 (socket says 172.21.15.100:58090) 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 -- 172.21.15.100:0/1191689356 learned_addr learned my addr 172.21.15.100:0/1191689356 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f349d200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 0x7f34a8141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 -- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 msgr2=0x7f34a8141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a6800640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34a80c6310 0x7f34a80c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 0x7f34a8141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 -- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34a80c6310 msgr2=0x7f34a80c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34a80c6310 0x7f34a80c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f34a5e00640 1 -- 172.21.15.100:0/1191689356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a80c1240 con 0x7f3488003f70 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.501+0000 7f349d200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 0x7f34a8141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f34a5e00640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f349800e4c0 tx=0x7f349800e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34980052e0 con 0x7f3488003f70 2024-01-20T08:10:52.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3498005440 con 0x7f3488003f70 2024-01-20T08:10:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3498003830 con 0x7f3488003f70 2024-01-20T08:10:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a80c14e0 con 0x7f3488003f70 2024-01-20T08:10:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.502+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a80ab680 con 0x7f3488003f70 2024-01-20T08:10:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.503+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a804e970 con 0x7f3488003f70 2024-01-20T08:10:52.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.505+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3498003990 con 0x7f3488003f70 2024-01-20T08:10:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.506+0000 7f349ea00640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 0x7f348006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.506+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f34980891e0 con 0x7f3488003f70 2024-01-20T08:10:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.506+0000 7f349d200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 0x7f348006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.507+0000 7f349d200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 0x7f348006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3490034000 tx=0x7f3490007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.510+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3498054160 con 0x7f3488003f70 2024-01-20T08:10:52.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.741+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f34a81557d0 con 0x7f3488003f70 2024-01-20T08:10:52.744 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:10:52.742+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:10:52.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.745+0000 7f349ea00640 1 -- 172.21.15.100:0/1191689356 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f34a81557d0 con 0x7f3488003f70 2024-01-20T08:10:52.748 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.748+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 msgr2=0x7f348006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.748+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 0x7f348006d390 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3490034000 tx=0x7f3490007000 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 msgr2=0x7f34a80be2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f349800e4c0 tx=0x7f349800e980 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 shutdown_connections 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34a80c6310 0x7f34a80c6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f348006aed0 0x7f348006d390 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34a80bf6d0 0x7f34a8141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 --2- 172.21.15.100:0/1191689356 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3488003f70 0x7f34a80be2e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 >> 172.21.15.100:0/1191689356 conn(0x7f34a80abde0 msgr2=0x7f34a80ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:52.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 shutdown_connections 2024-01-20T08:10:52.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.749+0000 7f34ad200640 1 -- 172.21.15.100:0/1191689356 wait complete. 2024-01-20T08:10:52.770 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T08:10:52.785 INFO:tasks.ceph.mds.c.smithi100.stderr: -5760> 2024-01-20T08:10:12.166+0000 7f33e8c00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:10:52.859 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:10:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.967+0000 7f4363e00640 1 Processor -- start 2024-01-20T08:10:52.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.968+0000 7f4363e00640 1 -- start start 2024-01-20T08:10:52.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4363e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f435c14fdb0 0x7f435c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4363e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f435c0c1d90 0x7f435c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4363e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c150190 con 0x7f435c0c3460 2024-01-20T08:10:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4363e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0a9ce0 con 0x7f435c14fdb0 2024-01-20T08:10:52.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4363e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f435c0a93b0 con 0x7f435c0c1d90 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4361400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f435c14fdb0 0x7f435c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4361e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f435c0c3460 0x7f435c155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36342/0 (socket says 172.21.15.100:36342) 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4361e00640 1 -- 172.21.15.100:0/2828416681 learned_addr learned my addr 172.21.15.100:0/2828416681 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.969+0000 7f4360a00640 1 --2- 172.21.15.100:0/2828416681 >> v2:172.21.15.110:3300/0 conn(0x7f435c0c1d90 0x7f435c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.970+0000 7f4361400640 1 -- 172.21.15.100:0/2828416681 >> v2:172.21.15.110:3300/0 conn(0x7f435c0c1d90 msgr2=0x7f435c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.970+0000 7f4361400640 1 --2- 172.21.15.100:0/2828416681 >> v2:172.21.15.110:3300/0 conn(0x7f435c0c1d90 0x7f435c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.970+0000 7f4361400640 1 -- 172.21.15.100:0/2828416681 >> v1:172.21.15.100:6789/0 conn(0x7f435c0c3460 legacy=0x7f435c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.970+0000 7f435be00640 1 -- 172.21.15.100:0/2828416681 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 221493264 0 0) 0x7f435c150190 con 0x7f435c0c3460 2024-01-20T08:10:52.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.970+0000 7f4361400640 1 -- 172.21.15.100:0/2828416681 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0a8810 con 0x7f435c14fdb0 2024-01-20T08:10:52.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.971+0000 7f4361400640 1 --2- 172.21.15.100:0/2828416681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c14fdb0 0x7f435c0c1850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f435c06be40 tx=0x7f434c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe3e2236497b9e2e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.971+0000 7f435be00640 1 -- 172.21.15.100:0/2828416681 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c031830 con 0x7f435c14fdb0 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.971+0000 7f435be00640 1 -- 172.21.15.100:0/2828416681 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434c031990 con 0x7f435c14fdb0 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.971+0000 7f435be00640 1 -- 172.21.15.100:0/2828416681 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434c031d20 con 0x7f435c14fdb0 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 -- 172.21.15.100:0/2828416681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c14fdb0 msgr2=0x7f435c0c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 --2- 172.21.15.100:0/2828416681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c14fdb0 0x7f435c0c1850 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f435c06be40 tx=0x7f434c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 -- 172.21.15.100:0/2828416681 shutdown_connections 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 --2- 172.21.15.100:0/2828416681 >> v2:172.21.15.110:3300/0 conn(0x7f435c0c1d90 0x7f435c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 --2- 172.21.15.100:0/2828416681 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c14fdb0 0x7f435c0c1850 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 -- 172.21.15.100:0/2828416681 >> 172.21.15.100:0/2828416681 conn(0x7f435c0c2940 msgr2=0x7f435c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 -- 172.21.15.100:0/2828416681 shutdown_connections 2024-01-20T08:10:52.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.972+0000 7f4363e00640 1 -- 172.21.15.100:0/2828416681 wait complete. 2024-01-20T08:10:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.973+0000 7f4363e00640 1 Processor -- start 2024-01-20T08:10:52.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.974+0000 7f4363e00640 1 -- start start 2024-01-20T08:10:52.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.974+0000 7f4363e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c0c1d90 0x7f435c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.974+0000 7f4363e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.974+0000 7f4363e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14fdb0 0x7f435c13f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.974+0000 7f4363e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0bf2e0 con 0x7f435c0c3460 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4363e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c13f640 con 0x7f435c0c1d90 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4363e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c1eaba0 con 0x7f435c14fdb0 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58120/0 (socket says 172.21.15.100:58120) 2024-01-20T08:10:52.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 -- 172.21.15.100:0/3277977209 learned_addr learned my addr 172.21.15.100:0/3277977209 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4361400640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c0c1d90 0x7f435c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 -- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14fdb0 msgr2=0x7f435c13f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14fdb0 0x7f435c13f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 -- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c0c1d90 msgr2=0x7f435c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c0c1d90 0x7f435c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 -- 172.21.15.100:0/3277977209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f434c009400 con 0x7f435c0c3460 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.975+0000 7f4360a00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f434400d800 tx=0x7f434400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.976+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400b6c0 con 0x7f435c0c3460 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.976+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f434400b820 con 0x7f435c0c3460 2024-01-20T08:10:52.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.976+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f434400bbb0 con 0x7f435c0c3460 2024-01-20T08:10:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.976+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c151970 con 0x7f435c0c3460 2024-01-20T08:10:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.976+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c151f30 con 0x7f435c0c3460 2024-01-20T08:10:52.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.977+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c04e970 con 0x7f435c0c3460 2024-01-20T08:10:52.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.978+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f434400bd10 con 0x7f435c0c3460 2024-01-20T08:10:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.979+0000 7f4359600640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.979+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4344089c40 con 0x7f435c0c3460 2024-01-20T08:10:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.979+0000 7f4361400640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:52.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.980+0000 7f4361400640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f434c036000 tx=0x7f434c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:52.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:52.983+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4344054ab0 con 0x7f435c0c3460 2024-01-20T08:10:53.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.212+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f435c0c1a80 con 0x7f435c0c3460 2024-01-20T08:10:53.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.748+0000 7f4359600640 1 -- 172.21.15.100:0/3277977209 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f43440580d0 con 0x7f435c0c3460 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.752+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 msgr2=0x7f433406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.752+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f434c036000 tx=0x7f434c008030 comp rx=0 tx=0).stop 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.752+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 msgr2=0x7f435c13ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.752+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f434400d800 tx=0x7f434400dcc0 comp rx=0 tx=0).stop 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 shutdown_connections 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f433406aed0 0x7f433406d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f435c14fdb0 0x7f435c13f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f435c0c3460 0x7f435c13ebc0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:53.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 --2- 172.21.15.100:0/3277977209 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f435c0c1d90 0x7f435c0c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:53.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 >> 172.21.15.100:0/3277977209 conn(0x7f435c0c2940 msgr2=0x7f435c1451f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:53.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 shutdown_connections 2024-01-20T08:10:53.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:53.753+0000 7f4363e00640 1 -- 172.21.15.100:0/3277977209 wait complete. 2024-01-20T08:10:53.776 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T08:10:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.024+0000 7fc781600640 1 Processor -- start 2024-01-20T08:10:54.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.024+0000 7fc781600640 1 -- start start 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc781600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc77c151fe0 0x7fc77c155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc781600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc77c0c70b0 0x7fc77c0c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc781600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc77c155840 con 0x7fc77c155d70 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc781600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c0c9e90 con 0x7fc77c0c70b0 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc781600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc77c06b6a0 con 0x7fc77c151fe0 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc77a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc77c155d70 0x7fc77c0c8880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36346/0 (socket says 172.21.15.100:36346) 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc77a000640 1 -- 172.21.15.100:0/674554640 learned_addr learned my addr 172.21.15.100:0/674554640 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:54.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc77b400640 1 --2- 172.21.15.100:0/674554640 >> v2:172.21.15.100:3300/0 conn(0x7fc77c0c70b0 0x7fc77c0c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc77aa00640 1 --2- 172.21.15.100:0/674554640 >> v2:172.21.15.110:3300/0 conn(0x7fc77c151fe0 0x7fc77c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.026+0000 7fc779600640 1 -- 172.21.15.100:0/674554640 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549568261 0 0) 0x7fc77c155840 con 0x7fc77c155d70 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.027+0000 7fc779600640 1 -- 172.21.15.100:0/674554640 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc75c003520 con 0x7fc77c155d70 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.027+0000 7fc77b400640 1 -- 172.21.15.100:0/674554640 >> v2:172.21.15.110:3300/0 conn(0x7fc77c151fe0 msgr2=0x7fc77c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.027+0000 7fc77b400640 1 --2- 172.21.15.100:0/674554640 >> v2:172.21.15.110:3300/0 conn(0x7fc77c151fe0 0x7fc77c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.027+0000 7fc77b400640 1 -- 172.21.15.100:0/674554640 >> v1:172.21.15.100:6789/0 conn(0x7fc77c155d70 legacy=0x7fc77c0c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.027+0000 7fc77b400640 1 -- 172.21.15.100:0/674554640 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc77c06b980 con 0x7fc77c0c70b0 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.028+0000 7fc77b400640 1 --2- 172.21.15.100:0/674554640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c70b0 0x7fc77c0c7520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cb180 tx=0x7fc77402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c672c8561b3987 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.028+0000 7fc779600640 1 -- 172.21.15.100:0/674554640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc77402e070 con 0x7fc77c0c70b0 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.028+0000 7fc779600640 1 -- 172.21.15.100:0/674554640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7740315a0 con 0x7fc77c0c70b0 2024-01-20T08:10:54.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.028+0000 7fc779600640 1 -- 172.21.15.100:0/674554640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc774031930 con 0x7fc77c0c70b0 2024-01-20T08:10:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 -- 172.21.15.100:0/674554640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c70b0 msgr2=0x7fc77c0c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 --2- 172.21.15.100:0/674554640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c70b0 0x7fc77c0c7520 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc77c0cb180 tx=0x7fc77402b840 comp rx=0 tx=0).stop 2024-01-20T08:10:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 -- 172.21.15.100:0/674554640 shutdown_connections 2024-01-20T08:10:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 --2- 172.21.15.100:0/674554640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c0c70b0 0x7fc77c0c7520 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 --2- 172.21.15.100:0/674554640 >> v2:172.21.15.110:3300/0 conn(0x7fc77c151fe0 0x7fc77c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 -- 172.21.15.100:0/674554640 >> 172.21.15.100:0/674554640 conn(0x7fc77c0ac010 msgr2=0x7fc77c0ac420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 -- 172.21.15.100:0/674554640 shutdown_connections 2024-01-20T08:10:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.029+0000 7fc781600640 1 -- 172.21.15.100:0/674554640 wait complete. 2024-01-20T08:10:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.030+0000 7fc781600640 1 Processor -- start 2024-01-20T08:10:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 -- start start 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc77c0c70b0 0x7fc77c1ea6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc77c155d70 0x7fc77c0aad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c0c33c0 con 0x7fc77c151fe0 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1eac00 con 0x7fc77c0c70b0 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.031+0000 7fc781600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc77c1ee0f0 con 0x7fc77c155d70 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58142/0 (socket says 172.21.15.100:58142) 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 -- 172.21.15.100:0/1158141003 learned_addr learned my addr 172.21.15.100:0/1158141003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:54.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77aa00640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc77c0c70b0 0x7fc77c1ea6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 -- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc77c155d70 msgr2=0x7fc77c0aad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77b400640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc77c155d70 0x7fc77c0aad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc77c155d70 0x7fc77c0aad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 -- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc77c0c70b0 msgr2=0x7fc77c1ea6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc77c0c70b0 0x7fc77c1ea6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.032+0000 7fc77a000640 1 -- 172.21.15.100:0/1158141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc774009400 con 0x7fc77c151fe0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc77a000640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c490 tx=0x7fc76400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764005ce0 con 0x7fc77c151fe0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc764005e40 con 0x7fc77c151fe0 2024-01-20T08:10:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc77c1ed720 con 0x7fc77c151fe0 2024-01-20T08:10:54.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764007290 con 0x7fc77c151fe0 2024-01-20T08:10:54.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.033+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc77c0c60f0 con 0x7fc77c151fe0 2024-01-20T08:10:54.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.034+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc77c1ed8b0 con 0x7fc77c151fe0 2024-01-20T08:10:54.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.035+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc7640073f0 con 0x7fc77c151fe0 2024-01-20T08:10:54.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.036+0000 7fc772a00640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.036+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc764088cd0 con 0x7fc77c151fe0 2024-01-20T08:10:54.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.036+0000 7fc77aa00640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.037+0000 7fc77aa00640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 0x7fc75406d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0099c0 tx=0x7fc76c003990 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:54.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.041+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc764053aa0 con 0x7fc77c151fe0 2024-01-20T08:10:54.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.238+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc77c074300 con 0x7fc77c151fe0 2024-01-20T08:10:54.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.752+0000 7fc772a00640 1 -- 172.21.15.100:0/1158141003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc764017070 con 0x7fc77c151fe0 2024-01-20T08:10:54.756 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-20T08:10:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.758+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 msgr2=0x7fc75406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.758+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 0x7fc75406d390 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0099c0 tx=0x7fc76c003990 comp rx=0 tx=0).stop 2024-01-20T08:10:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.758+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 msgr2=0x7fc77c1edbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.758+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fc76400c490 tx=0x7fc76400c950 comp rx=0 tx=0).stop 2024-01-20T08:10:54.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 shutdown_connections 2024-01-20T08:10:54.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc75406aed0 0x7fc75406d390 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc77c155d70 0x7fc77c0aad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc77c151fe0 0x7fc77c1edbb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 --2- 172.21.15.100:0/1158141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc77c0c70b0 0x7fc77c1ea6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 >> 172.21.15.100:0/1158141003 conn(0x7fc77c0ac010 msgr2=0x7fc77c073790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 shutdown_connections 2024-01-20T08:10:54.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.759+0000 7fc781600640 1 -- 172.21.15.100:0/1158141003 wait complete. 2024-01-20T08:10:54.794 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T08:10:54.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.982+0000 7f35a2000640 1 Processor -- start 2024-01-20T08:10:54.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.982+0000 7f35a2000640 1 -- start start 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.983+0000 7f35a2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 0x7f359c0bf620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.983+0000 7f35a2000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f359c0c5460 0x7f359c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.983+0000 7f35a2000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359c072680 con 0x7f359c0bf240 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.983+0000 7f35a2000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f359c0c06c0 con 0x7f359c0c5460 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.983+0000 7f35a2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c0a5750 con 0x7f359c0bfe70 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a1600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f359c0c5460 0x7f359c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a0c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f359c0bf240 0x7f359c0a98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36356/0 (socket says 172.21.15.100:36356) 2024-01-20T08:10:54.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a0c00640 1 -- 172.21.15.100:0/3962861998 learned_addr learned my addr 172.21.15.100:0/3962861998 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f359be00640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 0x7f359c0bf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a1600640 1 -- 172.21.15.100:0/3962861998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 msgr2=0x7f359c0bf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a1600640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 0x7f359c0bf620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a1600640 1 -- 172.21.15.100:0/3962861998 >> v1:172.21.15.100:6789/0 conn(0x7f359c0bf240 legacy=0x7f359c0a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f35a1600640 1 -- 172.21.15.100:0/3962861998 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359c072c40 con 0x7f359c0c5460 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f359b400640 1 -- 172.21.15.100:0/3962861998 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188550281 0 0) 0x7f359c072680 con 0x7f359c0bf240 2024-01-20T08:10:54.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.984+0000 7f359be00640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 0x7f359c0bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:54.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.985+0000 7f35a1600640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0c5460 0x7f359c1583c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35940097a0 tx=0x7f359402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41758bfc129db496 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:54.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f359b400640 1 -- 172.21.15.100:0/3962861998 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031830 con 0x7f359c0c5460 2024-01-20T08:10:54.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f359b400640 1 -- 172.21.15.100:0/3962861998 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3594031990 con 0x7f359c0c5460 2024-01-20T08:10:54.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f359b400640 1 -- 172.21.15.100:0/3962861998 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3594031d20 con 0x7f359c0c5460 2024-01-20T08:10:54.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f35a2000640 1 -- 172.21.15.100:0/3962861998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0c5460 msgr2=0x7f359c1583c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f35a2000640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0c5460 0x7f359c1583c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f35940097a0 tx=0x7f359402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f35a2000640 1 -- 172.21.15.100:0/3962861998 shutdown_connections 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f35a2000640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0c5460 0x7f359c1583c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.986+0000 7f35a2000640 1 --2- 172.21.15.100:0/3962861998 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0bfe70 0x7f359c0bf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.987+0000 7f35a2000640 1 -- 172.21.15.100:0/3962861998 >> 172.21.15.100:0/3962861998 conn(0x7f359c0a7950 msgr2=0x7f359c0a7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.987+0000 7f35a2000640 1 -- 172.21.15.100:0/3962861998 shutdown_connections 2024-01-20T08:10:54.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.987+0000 7f35a2000640 1 -- 172.21.15.100:0/3962861998 wait complete. 2024-01-20T08:10:54.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.988+0000 7f35a2000640 1 Processor -- start 2024-01-20T08:10:54.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.989+0000 7f35a2000640 1 -- start start 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.989+0000 7f35a2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.989+0000 7f35a2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f359c0bfe70 0x7f359c14cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.989+0000 7f35a2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0c5460 0x7f359c070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.989+0000 7f35a2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c1ea8c0 con 0x7f359c0bf240 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359c06c8b0 con 0x7f359c0bfe70 2024-01-20T08:10:54.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359c072130 con 0x7f359c0c5460 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58160/0 (socket says 172.21.15.100:58160) 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 -- 172.21.15.100:0/1125294032 learned_addr learned my addr 172.21.15.100:0/1125294032 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a1600640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0c5460 0x7f359c070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 -- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0c5460 msgr2=0x7f359c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0c5460 0x7f359c070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 -- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f359c0bfe70 msgr2=0x7f359c14cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f359c0bfe70 0x7f359c14cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.990+0000 7f35a0c00640 1 -- 172.21.15.100:0/1125294032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3594009400 con 0x7f359c0bf240 2024-01-20T08:10:54.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f35a0c00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c890 tx=0x7f358c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00a640 con 0x7f359c0bf240 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00a7c0 con 0x7f359c0bf240 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359c14d120 con 0x7f359c0bf240 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00ab70 con 0x7f359c0bf240 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.991+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f359c070270 con 0x7f359c0bf240 2024-01-20T08:10:54.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.992+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f359c067b60 con 0x7f359c0bf240 2024-01-20T08:10:54.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.993+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f358c00acd0 con 0x7f359c0bf240 2024-01-20T08:10:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.994+0000 7f3598c00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 0x7f357406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.994+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5502+0+0 (secure 0 0 0) 0x7f358c088df0 con 0x7f359c0bf240 2024-01-20T08:10:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.994+0000 7f359be00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 0x7f357406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:54.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.995+0000 7f359be00640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 0x7f357406d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3584006fd0 tx=0x7f3584008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:55.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:54.998+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f358c053d80 con 0x7f359c0bf240 2024-01-20T08:10:55.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.191+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f359c04e970 con 0x7f359c0bf240 2024-01-20T08:10:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.755+0000 7f3598c00640 1 -- 172.21.15.100:0/1125294032 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f358c018020 con 0x7f359c0bf240 2024-01-20T08:10:55.759 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 msgr2=0x7f357406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 0x7f357406d390 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f3584006fd0 tx=0x7f3584008040 comp rx=0 tx=0).stop 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 msgr2=0x7f359c1ea380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f358c00c890 tx=0x7f358c00cd50 comp rx=0 tx=0).stop 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 shutdown_connections 2024-01-20T08:10:55.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f357406aed0 0x7f357406d390 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f359c0c5460 0x7f359c070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f359c0bfe70 0x7f359c14cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 --2- 172.21.15.100:0/1125294032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f359c0bf240 0x7f359c1ea380 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 >> 172.21.15.100:0/1125294032 conn(0x7f359c0a7950 msgr2=0x7f359c157300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 shutdown_connections 2024-01-20T08:10:55.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:55.759+0000 7f35a2000640 1 -- 172.21.15.100:0/1125294032 wait complete. 2024-01-20T08:10:55.788 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T08:10:55.788 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-20T08:10:55.789 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T08:10:55.789 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:10:55.789 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T08:10:55.789 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-20T08:10:55.789 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T08:10:55.789 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:10:55.789 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T08:10:55.790 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-20T08:10:55.790 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T08:10:55.790 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:10:55.790 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T08:10:55.790 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-20T08:10:55.790 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T08:10:55.790 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:10:55.807 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T08:10:55.807 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T08:10:55.809 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T08:10:55.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T08:10:55.811 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T08:10:55.812 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T08:10:55.813 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T08:10:55.813 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T08:10:55.854 INFO:tasks.ceph.mds.c:Started 2024-01-20T08:10:55.855 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:55.858 INFO:tasks.ceph.mds.a:Started 2024-01-20T08:10:55.858 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:55.859 INFO:tasks.ceph.mds.d:Started 2024-01-20T08:10:55.859 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:55.865 INFO:tasks.ceph.mds.b:Started 2024-01-20T08:10:55.865 DEBUG:teuthology.parallel:result is None 2024-01-20T08:10:55.865 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-20T08:10:56.006 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-20T08:10:56.007 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:10:56.015 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:10:56.016 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-20T08:10:56.017 INFO:tasks.ceph.mds.d.smithi110.stderr:2024-01-20T08:10:56.015+0000 7f4054400640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-01-20T08:10:56.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.044+0000 7fc71f200640 1 Processor -- start 2024-01-20T08:10:56.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.044+0000 7fc71f200640 1 -- start start 2024-01-20T08:10:56.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.045+0000 7fc71f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc71814b720 0x7fc7181515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.045+0000 7fc71f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 0x7fc7180c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.045+0000 7fc71f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc718154ba0 con 0x7fc71806c8d0 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.045+0000 7fc71f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc71814bb00 con 0x7fc71814b720 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.045+0000 7fc71f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc718155a00 con 0x7fc7180c1850 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc71814b720 0x7fc7181515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc71814b720 0x7fc7181515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58190/0 (socket says 172.21.15.100:58190) 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 -- 172.21.15.100:0/2389050610 learned_addr learned my addr 172.21.15.100:0/2389050610 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717400640 1 --2- 172.21.15.100:0/2389050610 >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 0x7fc7180c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 -- 172.21.15.100:0/2389050610 >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 msgr2=0x7fc7180c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 --2- 172.21.15.100:0/2389050610 >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 0x7fc7180c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 -- 172.21.15.100:0/2389050610 >> v1:172.21.15.100:6789/0 conn(0x7fc71806c8d0 legacy=0x7fc71806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717e00640 1 -- 172.21.15.100:0/2389050610 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc718154df0 con 0x7fc71814b720 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.046+0000 7fc717400640 1 --2- 172.21.15.100:0/2389050610 >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 0x7fc7180c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:56.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.047+0000 7fc717e00640 1 --2- 172.21.15.100:0/2389050610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc71814b720 0x7fc7181515b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ac030 tx=0x7fc70802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af8e4a280f16a8d4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:56.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.047+0000 7fc716a00640 1 -- 172.21.15.100:0/2389050610 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708031870 con 0x7fc71814b720 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.047+0000 7fc716a00640 1 -- 172.21.15.100:0/2389050610 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7080319d0 con 0x7fc71814b720 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.047+0000 7fc716a00640 1 -- 172.21.15.100:0/2389050610 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc708031d60 con 0x7fc71814b720 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 -- 172.21.15.100:0/2389050610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc71814b720 msgr2=0x7fc7181515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 --2- 172.21.15.100:0/2389050610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc71814b720 0x7fc7181515b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc7180ac030 tx=0x7fc70802b910 comp rx=0 tx=0).stop 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 -- 172.21.15.100:0/2389050610 shutdown_connections 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 --2- 172.21.15.100:0/2389050610 >> v2:172.21.15.110:3300/0 conn(0x7fc7180c1850 0x7fc7180c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 --2- 172.21.15.100:0/2389050610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc71814b720 0x7fc7181515b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 -- 172.21.15.100:0/2389050610 >> 172.21.15.100:0/2389050610 conn(0x7fc7180c2940 msgr2=0x7fc7180c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 -- 172.21.15.100:0/2389050610 shutdown_connections 2024-01-20T08:10:56.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.048+0000 7fc71f200640 1 -- 172.21.15.100:0/2389050610 wait complete. 2024-01-20T08:10:56.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.050+0000 7fc71f200640 1 Processor -- start 2024-01-20T08:10:56.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.050+0000 7fc71f200640 1 -- start start 2024-01-20T08:10:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.050+0000 7fc71f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc71806c8d0 0x7fc7180bbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71814b720 0x7fc7181e8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181e7c80 con 0x7fc7180c1850 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180bf190 con 0x7fc71814b720 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180bc3f0 con 0x7fc71806c8d0 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58192/0 (socket says 172.21.15.100:58192) 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 -- 172.21.15.100:0/3479038223 learned_addr learned my addr 172.21.15.100:0/3479038223 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717e00640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc71806c8d0 0x7fc7180bbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc71d200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71814b720 0x7fc7181e8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 -- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc71806c8d0 msgr2=0x7fc7180bbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc71806c8d0 0x7fc7180bbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 -- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71814b720 msgr2=0x7fc7181e8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71814b720 0x7fc7181e8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.051+0000 7fc717400640 1 -- 172.21.15.100:0/3479038223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080094d0 con 0x7fc7180c1850 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc717400640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c7f0 tx=0x7fc70000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:56.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700007a30 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700007b90 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7180beeb0 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70000ce40 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.052+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7181e7e90 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.054+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7181eb5e0 con 0x7fc7180c1850 2024-01-20T08:10:56.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.054+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc7000113f0 con 0x7fc7180c1850 2024-01-20T08:10:56.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.055+0000 7fc70fe00640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 0x7fc6f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:56.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.055+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc700089390 con 0x7fc7180c1850 2024-01-20T08:10:56.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.056+0000 7fc717e00640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 0x7fc6f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:56.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.056+0000 7fc717e00640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 0x7fc6f006d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc708036000 tx=0x7fc70803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:56.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.060+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc7181eb5e0 con 0x7fc7180c1850 2024-01-20T08:10:56.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:56.269+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc7181eb5e0 con 0x7fc7180c1850 2024-01-20T08:10:57.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.150+0000 7fc70fe00640 1 -- 172.21.15.100:0/3479038223 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc7181eb5e0 con 0x7fc7180c1850 2024-01-20T08:10:57.154 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-01-20T08:10:57.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 msgr2=0x7fc6f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 0x7fc6f006d390 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc708036000 tx=0x7fc70803c040 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 msgr2=0x7fc7180be4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc70000c7f0 tx=0x7fc70000cbf0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 shutdown_connections 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc71814b720 0x7fc7181e8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc7180c1850 0x7fc7180be4a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6f006aed0 0x7fc6f006d390 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 --2- 172.21.15.100:0/3479038223 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc71806c8d0 0x7fc7180bbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.154+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 >> 172.21.15.100:0/3479038223 conn(0x7fc7180c2940 msgr2=0x7fc718072030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.155+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 shutdown_connections 2024-01-20T08:10:57.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.155+0000 7fc71f200640 1 -- 172.21.15.100:0/3479038223 wait complete. 2024-01-20T08:10:57.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-20T08:10:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.381+0000 7f7daee00640 1 Processor -- start 2024-01-20T08:10:57.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.381+0000 7f7daee00640 1 -- start start 2024-01-20T08:10:57.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.382+0000 7f7daee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7da814fc10 0x7f7da80a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7daee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da8156710 con 0x7f7da80c4ed0 2024-01-20T08:10:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7daee00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7da8155b00 con 0x7f7da80a5240 2024-01-20T08:10:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7daee00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7da814fff0 con 0x7f7da814fc10 2024-01-20T08:10:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7dad000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7da80c4ed0 0x7f7da80c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36386/0 (socket says 172.21.15.100:36386) 2024-01-20T08:10:57.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7dad000640 1 -- 172.21.15.100:0/1817898051 learned_addr learned my addr 172.21.15.100:0/1817898051 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:57.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666361995 0 0) 0x7f7da8156710 con 0x7f7da80c4ed0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d88003520 con 0x7f7da80c4ed0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.383+0000 7f7dada00640 1 --2- 172.21.15.100:0/1817898051 >> v2:172.21.15.110:3300/0 conn(0x7f7da814fc10 0x7f7da80a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2089773949 0 0) 0x7f7d88003520 con 0x7f7da80c4ed0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 >> v2:172.21.15.110:3300/0 conn(0x7f7da814fc10 msgr2=0x7f7da80a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 --2- 172.21.15.100:0/1817898051 >> v2:172.21.15.110:3300/0 conn(0x7f7da814fc10 0x7f7da80a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 >> v1:172.21.15.110:6789/0 conn(0x7f7da80a5240 legacy=0x7f7da80c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da8155de0 con 0x7f7da80c4ed0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7d90001670 con 0x7f7da80c4ed0 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 >> v1:172.21.15.100:6789/0 conn(0x7f7da80c4ed0 legacy=0x7f7da80c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88003970 0x7f7d88003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880047c0 0x7f7d88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7d8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da814fff0 con 0x7f7d880052a0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8800c1f0 con 0x7f7d88003970 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8800c3b0 con 0x7f7d880047c0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7dae400640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7d8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7dada00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88003970 0x7f7d88003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7dad000640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880047c0 0x7f7d88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7dae400640 1 -- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880047c0 msgr2=0x7f7d88004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.384+0000 7f7dae400640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880047c0 0x7f7d88004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.385+0000 7f7dae400640 1 -- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88003970 msgr2=0x7f7d88003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.385+0000 7f7dae400640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d88003970 0x7f7d88003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.385+0000 7f7dae400640 1 -- 172.21.15.100:0/1817898051 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d88003520 con 0x7f7d880052a0 2024-01-20T08:10:57.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.385+0000 7f7dad000640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d880047c0 0x7f7d88004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.385+0000 7f7dae400640 1 -- 172.21.15.100:0/1817898051 reap_dead start 2024-01-20T08:10:57.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7dae400640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7d8800b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7da0004480 tx=0x7f7d880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb26a3105e9f616e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0006b50 con 0x7f7d880052a0 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7da0006cd0 con 0x7f7d880052a0 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7da7e00640 1 -- 172.21.15.100:0/1817898051 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7da0007260 con 0x7f7d880052a0 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7daee00640 1 -- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 msgr2=0x7f7d8800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7daee00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7d8800b980 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7da0004480 tx=0x7f7d880057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7daee00640 1 -- 172.21.15.100:0/1817898051 shutdown_connections 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7daee00640 1 --2- 172.21.15.100:0/1817898051 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7d8800b980 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.386+0000 7f7daee00640 1 -- 172.21.15.100:0/1817898051 >> 172.21.15.100:0/1817898051 conn(0x7f7da80c5ba0 msgr2=0x7f7da80c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.387+0000 7f7daee00640 1 -- 172.21.15.100:0/1817898051 shutdown_connections 2024-01-20T08:10:57.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.387+0000 7f7daee00640 1 -- 172.21.15.100:0/1817898051 wait complete. 2024-01-20T08:10:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.388+0000 7f7daee00640 1 Processor -- start 2024-01-20T08:10:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.388+0000 7f7daee00640 1 -- start start 2024-01-20T08:10:57.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da8071f20 0x7f7da814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 0x7f7da8070690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da8071070 con 0x7f7d880052a0 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7da81e6220 con 0x7f7da8070200 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.389+0000 7f7daee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7da8071310 con 0x7f7da8071f20 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58214/0 (socket says 172.21.15.100:58214) 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 -- 172.21.15.100:0/449893773 learned_addr learned my addr 172.21.15.100:0/449893773 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dae400640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 0x7f7da8070690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 -- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da8071f20 msgr2=0x7f7da814e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dad000640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da8071f20 0x7f7da814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da8071f20 0x7f7da814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 -- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 msgr2=0x7f7da8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 0x7f7da8070690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 -- 172.21.15.100:0/449893773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7da80715f0 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dae400640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 0x7f7da8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.390+0000 7f7dada00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800f580 tx=0x7f7d9800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.391+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98013810 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.391+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d98013970 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.391+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7da81e6500 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.391+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d98013ce0 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.391+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7da8155650 con 0x7f7d880052a0 2024-01-20T08:10:57.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.392+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7da8067b60 con 0x7f7d880052a0 2024-01-20T08:10:57.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.393+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7d9801f460 con 0x7f7d880052a0 2024-01-20T08:10:57.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.394+0000 7f7da5600640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 0x7f7d8006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.394+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7d980897b0 con 0x7f7d880052a0 2024-01-20T08:10:57.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.394+0000 7f7dad000640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 0x7f7d8006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.395+0000 7f7dad000640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 0x7f7d8006d360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000fd0 tx=0x7f7d90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.398+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7d98054940 con 0x7f7d880052a0 2024-01-20T08:10:57.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.660+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7da8071780 con 0x7f7d880052a0 2024-01-20T08:10:57.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.660+0000 7f7da5600640 1 -- 172.21.15.100:0/449893773 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v3) v1 ==== 80+0+6065 (secure 0 0 0) 0x7f7d98057f60 con 0x7f7d880052a0 2024-01-20T08:10:57.663 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl1DYBKhAAW3E/HAERBMsGrC4rMf53bQ==", 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.664 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl3YX/DxAAznFmYWhRluqcjxkZ5aIzOQ==", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl/QN8OhAAToAKaEXXyxtgsbnP4CK9lg==", 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.665 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tlJS3/IBAAyxDTy7tcAxzFhe/cO0LaAQ==", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.666 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCqf6tlONOfMxAAUv9z4O2m2+OR+OlKEVTAyQ==", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCuf6tlpdWGEBAA4XbJMFejMXMzlZtAcFI1rQ==", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.667 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCxf6tlH+NYKRAAp4T2SRL9Hb7JzDT7AbAzzA==", 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.668 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC1f6tlxVV0BhAAzktBoqojfG876bmIT8vaHg==", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC6f6tl+4ikCRAA1btg/3+O5ZPGTIUHPT8vgw==", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.669 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC9f6tlEsDvIRAAFJKBssqBywoRFRWZFtHraA==", 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-01-20T08:10:57.670 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDAf6tl8W63OhAA/8jrYsmX0b/Jyf/bdIcR2A==", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDEf6tldmY8FxAA5SaAQB68UYfSJ3zFBwesuQ==", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.671 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA==", 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.672 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw==", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow r", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rwx" 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCkf6tlP8ACHBAAfGPqDgVbicLXk4WIoRUypQ==", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:10:57.673 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mds", 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tlUmBFNRAAOs4IFDpTGXZhp5qdNN8UJg==", 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mds" 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-mgr", 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tl4GlFNRAAC4S3n5Z+oDEodymnj5CzMA==", 2024-01-20T08:10:57.674 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-mgr" 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-osd", 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tldXJFNRAAhghgljODuhQ3CCqMD/tU+A==", 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-osd" 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd", 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tl13pFNRAASiJhPPnQztlPIeJRKfLiow==", 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.675 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd" 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tl0oNFNRAAO2F4eOM4Y16gLKlOJFgotg==", 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.bootstrap-rgw", 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDMf6tll4xFNRAApFXYzoVoPd+SgCY5HgNIzg==", 2024-01-20T08:10:57.676 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile bootstrap-rgw" 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlWV55HhAAm9X0Xnf67LjDKy4V1A8DvQ==", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlFW6MERAAzJBCQ7yx6sLPN6cv75rbhg==", 2024-01-20T08:10:57.677 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-01-20T08:10:57.678 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 msgr2=0x7f7d8006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 0x7f7d8006d360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f7d90000fd0 tx=0x7f7d90009040 comp rx=0 tx=0).stop 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 msgr2=0x7f7da814dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7d9800f580 tx=0x7f7d9800fa40 comp rx=0 tx=0).stop 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 shutdown_connections 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7da8070200 0x7f7da8070690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d8006aea0 0x7f7d8006d360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7da8071f20 0x7f7da814e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 --2- 172.21.15.100:0/449893773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d880052a0 0x7f7da814dbb0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.663+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 >> 172.21.15.100:0/449893773 conn(0x7f7da80c5ba0 msgr2=0x7f7da80a57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.664+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 shutdown_connections 2024-01-20T08:10:57.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.664+0000 7f7daee00640 1 -- 172.21.15.100:0/449893773 wait complete. 2024-01-20T08:10:57.684 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-01-20T08:10:57.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.889+0000 7f35ed800640 1 Processor -- start 2024-01-20T08:10:57.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.890+0000 7f35ed800640 1 -- start start 2024-01-20T08:10:57.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.891+0000 7f35ed800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 0x7f35e806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.891+0000 7f35ed800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f35e806ce10 0x7f35e815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.891+0000 7f35ed800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35e8154ba0 con 0x7f35e814b720 2024-01-20T08:10:57.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.891+0000 7f35ed800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35e814bb00 con 0x7f35e806ce10 2024-01-20T08:10:57.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.891+0000 7f35ed800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8155a00 con 0x7f35e81515b0 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f35e814b720 0x7f35e80c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:33100/0 (socket says 172.21.15.100:33100) 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6a00640 1 -- 172.21.15.100:0/218626534 learned_addr learned my addr 172.21.15.100:0/218626534 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6000640 1 --2- 172.21.15.100:0/218626534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 0x7f35e806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e7400640 1 --2- 172.21.15.100:0/218626534 >> v2:172.21.15.110:3300/0 conn(0x7f35e806ce10 0x7f35e815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6000640 1 -- 172.21.15.100:0/218626534 >> v2:172.21.15.110:3300/0 conn(0x7f35e806ce10 msgr2=0x7f35e815bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6000640 1 --2- 172.21.15.100:0/218626534 >> v2:172.21.15.110:3300/0 conn(0x7f35e806ce10 0x7f35e815bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e5600640 1 -- 172.21.15.100:0/218626534 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2535800663 0 0) 0x7f35e8154ba0 con 0x7f35e814b720 2024-01-20T08:10:57.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.892+0000 7f35e6000640 1 -- 172.21.15.100:0/218626534 >> v1:172.21.15.110:6789/0 conn(0x7f35e814b720 legacy=0x7f35e80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.893+0000 7f35e6000640 1 -- 172.21.15.100:0/218626534 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e8154df0 con 0x7f35e81515b0 2024-01-20T08:10:57.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.894+0000 7f35e6000640 1 --2- 172.21.15.100:0/218626534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 0x7f35e806c8d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009d90 tx=0x7f35d802be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1869292cde79910 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35e5600640 1 -- 172.21.15.100:0/218626534 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d802cbc0 con 0x7f35e81515b0 2024-01-20T08:10:57.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35e5600640 1 -- 172.21.15.100:0/218626534 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35d802cd20 con 0x7f35e81515b0 2024-01-20T08:10:57.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35e5600640 1 -- 172.21.15.100:0/218626534 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35d8034660 con 0x7f35e81515b0 2024-01-20T08:10:57.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 -- 172.21.15.100:0/218626534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 msgr2=0x7f35e806c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 --2- 172.21.15.100:0/218626534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 0x7f35e806c8d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f35d8009d90 tx=0x7f35d802be10 comp rx=0 tx=0).stop 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 -- 172.21.15.100:0/218626534 shutdown_connections 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 --2- 172.21.15.100:0/218626534 >> v2:172.21.15.110:3300/0 conn(0x7f35e806ce10 0x7f35e815bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 --2- 172.21.15.100:0/218626534 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e81515b0 0x7f35e806c8d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 -- 172.21.15.100:0/218626534 >> 172.21.15.100:0/218626534 conn(0x7f35e80c2940 msgr2=0x7f35e80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 -- 172.21.15.100:0/218626534 shutdown_connections 2024-01-20T08:10:57.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.895+0000 7f35ed800640 1 -- 172.21.15.100:0/218626534 wait complete. 2024-01-20T08:10:57.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.897+0000 7f35ed800640 1 Processor -- start 2024-01-20T08:10:57.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.897+0000 7f35ed800640 1 -- start start 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806ce10 0x7f35e814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e814b720 0x7f35e813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8153fc0 con 0x7f35e81515b0 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8149e40 con 0x7f35e814b720 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35ed800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35e8149b60 con 0x7f35e806ce10 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35e7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35e7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58218/0 (socket says 172.21.15.100:58218) 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.898+0000 7f35e7400640 1 -- 172.21.15.100:0/183473197 learned_addr learned my addr 172.21.15.100:0/183473197 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:57.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e6a00640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806ce10 0x7f35e814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e6000640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e814b720 0x7f35e813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 -- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806ce10 msgr2=0x7f35e814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806ce10 0x7f35e814c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 -- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e814b720 msgr2=0x7f35e813b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e814b720 0x7f35e813b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 -- 172.21.15.100:0/183473197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d8009a70 con 0x7f35e81515b0 2024-01-20T08:10:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.899+0000 7f35e7400640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f35e000e930 tx=0x7f35e000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.900+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e0009690 con 0x7f35e81515b0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.900+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e000c980 con 0x7f35e81515b0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.900+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35e8153200 con 0x7f35e81515b0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.900+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000cd30 con 0x7f35e81515b0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.900+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35e81537c0 con 0x7f35e81515b0 2024-01-20T08:10:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.901+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35e8067d50 con 0x7f35e81515b0 2024-01-20T08:10:57.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.902+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f35e0013470 con 0x7f35e81515b0 2024-01-20T08:10:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.903+0000 7f35dea00640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 0x7f35c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.903+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f35e0089440 con 0x7f35e81515b0 2024-01-20T08:10:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.904+0000 7f35e6a00640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 0x7f35c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.904+0000 7f35e6a00640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 0x7f35c006d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000f60 tx=0x7f35d0007bb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:57.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:57.908+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f35e00547b0 con 0x7f35e81515b0 2024-01-20T08:10:58.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.172+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f35e804e970 con 0x7f35e81515b0 2024-01-20T08:10:58.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.177+0000 7f35dea00640 1 -- 172.21.15.100:0/183473197 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v4) v1 ==== 90+0+0 (secure 0 0 0) 0x7f35e0057dd0 con 0x7f35e81515b0 2024-01-20T08:10:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 msgr2=0x7f35c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 0x7f35c006d390 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f35d0000f60 tx=0x7f35d0007bb0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 msgr2=0x7f35e813b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f35e000e930 tx=0x7f35e000edf0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 shutdown_connections 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35e81515b0 0x7f35e813b9f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35e814b720 0x7f35e813b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35c006aed0 0x7f35c006d390 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 --2- 172.21.15.100:0/183473197 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f35e806ce10 0x7f35e814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 >> 172.21.15.100:0/183473197 conn(0x7f35e80c2940 msgr2=0x7f35e81519d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 shutdown_connections 2024-01-20T08:10:58.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.180+0000 7f35ed800640 1 -- 172.21.15.100:0/183473197 wait complete. 2024-01-20T08:10:58.203 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-01-20T08:10:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.401+0000 7fdcabc00640 1 Processor -- start 2024-01-20T08:10:58.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.401+0000 7fdcabc00640 1 -- start start 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.402+0000 7fdcabc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdca414fdb0 0x7fdca40c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.402+0000 7fdcabc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca4150190 con 0x7fdca41532f0 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdcabc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca40a8810 con 0x7fdca40c1d90 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdcabc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca40a9ce0 con 0x7fdca414fdb0 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdca9c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdca41532f0 0x7fdca415cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36398/0 (socket says 172.21.15.100:36398) 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdca9c00640 1 -- 172.21.15.100:0/3043993502 learned_addr learned my addr 172.21.15.100:0/3043993502 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdca9200640 1 --2- 172.21.15.100:0/3043993502 >> v2:172.21.15.110:3300/0 conn(0x7fdca414fdb0 0x7fdca40c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84068970 0 0) 0x7fdca4150190 con 0x7fdca41532f0 2024-01-20T08:10:58.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.403+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc84003520 con 0x7fdca41532f0 2024-01-20T08:10:58.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1446493814 0 0) 0x7fdc84003520 con 0x7fdca41532f0 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 >> v2:172.21.15.110:3300/0 conn(0x7fdca414fdb0 msgr2=0x7fdca40c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 --2- 172.21.15.100:0/3043993502 >> v2:172.21.15.110:3300/0 conn(0x7fdca414fdb0 0x7fdca40c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 >> v1:172.21.15.110:6789/0 conn(0x7fdca40c1d90 legacy=0x7fdca4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca40a8df0 con 0x7fdca41532f0 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fdc9c0019f0 con 0x7fdca41532f0 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 >> v1:172.21.15.100:6789/0 conn(0x7fdca41532f0 legacy=0x7fdca415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc84003970 0x7fdc84003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 0x7fdc84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc84005180 0x7fdc8400fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840103e0 con 0x7fdc840047c0 2024-01-20T08:10:58.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84010550 con 0x7fdc84003970 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc84010710 con 0x7fdc84005180 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca3e00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 0x7fdc84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.404+0000 7fdca9200640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc84003970 0x7fdc84003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca9c00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc84005180 0x7fdc8400fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca3e00640 1 -- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc84005180 msgr2=0x7fdc8400fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca3e00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc84005180 0x7fdc8400fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca3e00640 1 -- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc84003970 msgr2=0x7fdc84003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca3e00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc84003970 0x7fdc84003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca3e00640 1 -- 172.21.15.100:0/3043993502 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc84003520 con 0x7fdc840047c0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.405+0000 7fdca9c00640 1 -- 172.21.15.100:0/3043993502 reap_dead start 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.406+0000 7fdca3e00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 0x7fdc84004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c003dd0 tx=0x7fdc840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74c9e74b93ba3e5d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.406+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c032600 con 0x7fdc840047c0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.406+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc8c02e050 con 0x7fdc840047c0 2024-01-20T08:10:58.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.406+0000 7fdca3400640 1 -- 172.21.15.100:0/3043993502 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c032980 con 0x7fdc840047c0 2024-01-20T08:10:58.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 -- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 msgr2=0x7fdc84004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 0x7fdc84004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fdc8c003dd0 tx=0x7fdc840057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 -- 172.21.15.100:0/3043993502 shutdown_connections 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 --2- 172.21.15.100:0/3043993502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc840047c0 0x7fdc84004c40 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 -- 172.21.15.100:0/3043993502 >> 172.21.15.100:0/3043993502 conn(0x7fdca40c2940 msgr2=0x7fdca40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 -- 172.21.15.100:0/3043993502 shutdown_connections 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.407+0000 7fdcabc00640 1 -- 172.21.15.100:0/3043993502 wait complete. 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.408+0000 7fdcabc00640 1 Processor -- start 2024-01-20T08:10:58.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.409+0000 7fdcabc00640 1 -- start start 2024-01-20T08:10:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.409+0000 7fdcabc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc840047c0 0x7fdca41e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.409+0000 7fdcabc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca406df20 0x7fdca40c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.409+0000 7fdcabc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdcabc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41449f0 con 0x7fdca40708e0 2024-01-20T08:10:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdcabc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40c5b10 con 0x7fdc840047c0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdcabc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca41e5ec0 con 0x7fdca406df20 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58236/0 (socket says 172.21.15.100:58236) 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 -- 172.21.15.100:0/1752080871 learned_addr learned my addr 172.21.15.100:0/1752080871 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9200640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc840047c0 0x7fdca41e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 -- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca406df20 msgr2=0x7fdca40c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca406df20 0x7fdca40c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 -- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc840047c0 msgr2=0x7fdca41e69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc840047c0 0x7fdca41e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.410+0000 7fdca9c00640 1 -- 172.21.15.100:0/1752080871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca41e61a0 con 0x7fdca40708e0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdca9c00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdca406fe10 tx=0x7fdc9c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c00ec10 con 0x7fdca40708e0 2024-01-20T08:10:58.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c00ed90 con 0x7fdca40708e0 2024-01-20T08:10:58.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca41e6480 con 0x7fdca40708e0 2024-01-20T08:10:58.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c013660 con 0x7fdca40708e0 2024-01-20T08:10:58.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.411+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca4144c40 con 0x7fdca40708e0 2024-01-20T08:10:58.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.412+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca41e6670 con 0x7fdca40708e0 2024-01-20T08:10:58.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.413+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdc9c0137c0 con 0x7fdca40708e0 2024-01-20T08:10:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.414+0000 7fdca0c00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 0x7fdc7c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.415+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdc9c0896d0 con 0x7fdca40708e0 2024-01-20T08:10:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.415+0000 7fdca9200640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 0x7fdc7c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.415+0000 7fdca9200640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 0x7fdc7c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdca4073300 tx=0x7fdc94008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.419+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdc9c054980 con 0x7fdca40708e0 2024-01-20T08:10:58.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.677+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fdca404e970 con 0x7fdca40708e0 2024-01-20T08:10:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.681+0000 7fdca0c00640 1 -- 172.21.15.100:0/1752080871 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdc9c057fa0 con 0x7fdca40708e0 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.684+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 msgr2=0x7fdc7c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.684+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 0x7fdc7c06d3c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdca4073300 tx=0x7fdc94008040 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.684+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 msgr2=0x7fdca41508c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.684+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fdca406fe10 tx=0x7fdc9c00e530 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 shutdown_connections 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca40708e0 0x7fdca41508c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06af00 0x7fdc7c06d3c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca406df20 0x7fdca40c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 --2- 172.21.15.100:0/1752080871 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc840047c0 0x7fdca41e69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 >> 172.21.15.100:0/1752080871 conn(0x7fdca40c2940 msgr2=0x7fdca4146a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:58.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 shutdown_connections 2024-01-20T08:10:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.685+0000 7fdcabc00640 1 -- 172.21.15.100:0/1752080871 wait complete. 2024-01-20T08:10:58.704 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-01-20T08:10:58.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.897+0000 7f5024600640 1 Processor -- start 2024-01-20T08:10:58.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.897+0000 7f5024600640 1 -- start start 2024-01-20T08:10:58.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5024600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f501c14fdb0 0x7f501c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5024600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c150190 con 0x7f501c0c1d90 2024-01-20T08:10:58.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5024600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f501c0a8810 con 0x7f501c1532f0 2024-01-20T08:10:58.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5024600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f501c0a9ce0 con 0x7f501c14fdb0 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5021200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f501c0c1d90 0x7f501c152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:36402/0 (socket says 172.21.15.100:36402) 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.898+0000 7f5021200640 1 -- 172.21.15.100:0/3126861098 learned_addr learned my addr 172.21.15.100:0/3126861098 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f5021c00640 1 --2- 172.21.15.100:0/3126861098 >> v2:172.21.15.110:3300/0 conn(0x7f501c14fdb0 0x7f501c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3731424867 0 0) 0x7f501c150190 con 0x7f501c0c1d90 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ffc003520 con 0x7f501c0c1d90 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1511442479 0 0) 0x7f4ffc003520 con 0x7f501c0c1d90 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 >> v2:172.21.15.110:3300/0 conn(0x7f501c14fdb0 msgr2=0x7f501c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 --2- 172.21.15.100:0/3126861098 >> v2:172.21.15.110:3300/0 conn(0x7f501c14fdb0 0x7f501c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 >> v1:172.21.15.110:6789/0 conn(0x7f501c1532f0 legacy=0x7f501c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c0a8df0 con 0x7f501c0c1d90 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f5004001670 con 0x7f501c0c1d90 2024-01-20T08:10:58.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 >> v1:172.21.15.100:6789/0 conn(0x7f501c0c1d90 legacy=0x7f501c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ffc003970 0x7f4ffc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f4ffc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ffc005180 0x7f4ffc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00bff0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00c160 con 0x7f4ffc005180 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.899+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ffc00c320 con 0x7f4ffc003970 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f4ffc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5022600640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ffc005180 0x7f4ffc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 -- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ffc003970 msgr2=0x7f4ffc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ffc003970 0x7f4ffc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 -- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ffc005180 msgr2=0x7f4ffc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:58.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ffc005180 0x7f4ffc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5021200640 1 -- 172.21.15.100:0/3126861098 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc003520 con 0x7f4ffc0047c0 2024-01-20T08:10:58.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5022600640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ffc005180 0x7f4ffc00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:58.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.900+0000 7f5022600640 1 -- 172.21.15.100:0/3126861098 reap_dead start 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.901+0000 7f5021200640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f4ffc004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f500400c240 tx=0x7f4ffc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b71d055ec82fb22 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.901+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5004005ad0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.901+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5004005c50 con 0x7f4ffc0047c0 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.901+0000 7f501be00640 1 -- 172.21.15.100:0/3126861098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500402c8b0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 -- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 msgr2=0x7f4ffc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f4ffc004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f500400c240 tx=0x7f4ffc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 -- 172.21.15.100:0/3126861098 shutdown_connections 2024-01-20T08:10:58.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 --2- 172.21.15.100:0/3126861098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f4ffc004c40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 -- 172.21.15.100:0/3126861098 >> 172.21.15.100:0/3126861098 conn(0x7f501c0c2940 msgr2=0x7f501c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:58.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 -- 172.21.15.100:0/3126861098 shutdown_connections 2024-01-20T08:10:58.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.902+0000 7f5024600640 1 -- 172.21.15.100:0/3126861098 wait complete. 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.903+0000 7f5024600640 1 Processor -- start 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.904+0000 7f5024600640 1 -- start start 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.904+0000 7f5024600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.904+0000 7f5024600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c152250 0x7f501c1e6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.904+0000 7f5024600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c151cd0 0x7f501c1e66d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5024600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c148c80 con 0x7f4ffc0047c0 2024-01-20T08:10:58.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5024600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501c0c5bb0 con 0x7f501c151cd0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5024600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501c148600 con 0x7f501c152250 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58242/0 (socket says 172.21.15.100:58242) 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 -- 172.21.15.100:0/266648994 learned_addr learned my addr 172.21.15.100:0/266648994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 -- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c152250 msgr2=0x7f501c1e6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c152250 0x7f501c1e6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5022600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c151cd0 0x7f501c1e66d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 -- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c151cd0 msgr2=0x7f501c1e66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c151cd0 0x7f501c1e66d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.905+0000 7f5021c00640 1 -- 172.21.15.100:0/266648994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f501c1e9fd0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5021c00640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f500c00e890 tx=0x7f500c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00c8e0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f500c00ca60 con 0x7f4ffc0047c0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f500c00ce10 con 0x7f4ffc0047c0 2024-01-20T08:10:58.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f501c1488a0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.906+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f501c1480a0 con 0x7f4ffc0047c0 2024-01-20T08:10:58.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.907+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f501c148a30 con 0x7f4ffc0047c0 2024-01-20T08:10:58.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.908+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f500c013470 con 0x7f4ffc0047c0 2024-01-20T08:10:58.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.908+0000 7f5019600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 0x7f4ff406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:58.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.909+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f500c089480 con 0x7f4ffc0047c0 2024-01-20T08:10:58.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.909+0000 7f5021200640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 0x7f4ff406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:58.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.909+0000 7f5021200640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 0x7f4ff406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5004034000 tx=0x7f5004039040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:58.913+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f500c054600 con 0x7f4ffc0047c0 2024-01-20T08:10:59.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.155+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f501c04e970 con 0x7f4ffc0047c0 2024-01-20T08:10:59.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.159+0000 7f5019600640 1 -- 172.21.15.100:0/266648994 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f500c057c20 con 0x7f4ffc0047c0 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 msgr2=0x7f4ff406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 0x7f4ff406d3c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5004034000 tx=0x7f5004039040 comp rx=0 tx=0).stop 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 msgr2=0x7f501c147b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f500c00e890 tx=0x7f500c00ed50 comp rx=0 tx=0).stop 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 shutdown_connections 2024-01-20T08:10:59.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f501c151cd0 0x7f501c1e66d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4ff406af00 0x7f4ff406d3c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f501c152250 0x7f501c1e6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 --2- 172.21.15.100:0/266648994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ffc0047c0 0x7f501c147b60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 >> 172.21.15.100:0/266648994 conn(0x7f501c0c2940 msgr2=0x7f501c0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 shutdown_connections 2024-01-20T08:10:59.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.162+0000 7f5024600640 1 -- 172.21.15.100:0/266648994 wait complete. 2024-01-20T08:10:59.184 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-01-20T08:10:59.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.382+0000 7f7fa7600640 1 Processor -- start 2024-01-20T08:10:59.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.383+0000 7f7fa7600640 1 -- start start 2024-01-20T08:10:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa7600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7fa006b140 0x7f7fa006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00c5880 con 0x7f7fa0151d50 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa7600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fa00c9a40 con 0x7f7fa00c5d10 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa7600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fa00c4a60 con 0x7f7fa006b140 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa4c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7fa0151d50 0x7f7fa01551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56726/0 (socket says 172.21.15.100:56726) 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.384+0000 7f7fa4c00640 1 -- 172.21.15.100:0/3436844086 learned_addr learned my addr 172.21.15.100:0/3436844086 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499009733 0 0) 0x7f7fa00c5880 con 0x7f7fa0151d50 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3436844086 >> v2:172.21.15.110:3300/0 conn(0x7f7fa006b140 0x7f7fa006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f80003520 con 0x7f7fa0151d50 2024-01-20T08:10:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103938023 0 0) 0x7f7f80003520 con 0x7f7fa0151d50 2024-01-20T08:10:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 >> v2:172.21.15.110:3300/0 conn(0x7f7fa006b140 msgr2=0x7f7fa006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 --2- 172.21.15.100:0/3436844086 >> v2:172.21.15.110:3300/0 conn(0x7f7fa006b140 0x7f7fa006b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 >> v1:172.21.15.110:6789/0 conn(0x7f7fa00c5d10 legacy=0x7f7fa00c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa00c9f10 con 0x7f7fa0151d50 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7f90001670 con 0x7f7fa0151d50 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 >> v1:172.21.15.100:6789/0 conn(0x7f7fa0151d50 legacy=0x7f7fa01551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f80003970 0x7f7f80003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f800047c0 0x7f7f80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 0x7f7f8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00c4a60 con 0x7f7f800052a0 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8000c150 con 0x7f7f80003970 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.385+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8000c310 con 0x7f7f800047c0 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 0x7f7f8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa4c00640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f80003970 0x7f7f80003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f800047c0 0x7f7f80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 -- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f800047c0 msgr2=0x7f7f80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f800047c0 0x7f7f80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 -- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f80003970 msgr2=0x7f7f80003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f80003970 0x7f7f80003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7fa5600640 1 -- 172.21.15.100:0/3436844086 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f80003520 con 0x7f7f800052a0 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.386+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f800047c0 0x7f7f80004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.387+0000 7f7fa5600640 1 -- 172.21.15.100:0/3436844086 reap_dead start 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.387+0000 7f7fa5600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 0x7f7f8000b980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004480 tx=0x7f7f800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6ae14d7c3236f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.387+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98006b50 con 0x7f7f800052a0 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.387+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f98006cd0 con 0x7f7f800052a0 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.387+0000 7f7f9f400640 1 -- 172.21.15.100:0/3436844086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f98007260 con 0x7f7f800052a0 2024-01-20T08:10:59.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 -- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 msgr2=0x7f7f8000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 0x7f7f8000b980 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7f98004480 tx=0x7f7f800057f0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 -- 172.21.15.100:0/3436844086 shutdown_connections 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3436844086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f800052a0 0x7f7f8000b980 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 -- 172.21.15.100:0/3436844086 >> 172.21.15.100:0/3436844086 conn(0x7f7fa00ca0e0 msgr2=0x7f7fa00ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 -- 172.21.15.100:0/3436844086 shutdown_connections 2024-01-20T08:10:59.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.388+0000 7f7fa7600640 1 -- 172.21.15.100:0/3436844086 wait complete. 2024-01-20T08:10:59.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.390+0000 7f7fa7600640 1 Processor -- start 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.390+0000 7f7fa7600640 1 -- start start 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f800052a0 0x7f7fa01edf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fa0156db0 0x7f7fa01494a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa00bd5b0 con 0x7f7fa01ea980 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01ed520 con 0x7f7f800052a0 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fa01edae0 con 0x7f7fa0156db0 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7f9fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56052/0 (socket says 172.21.15.100:56052) 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7f9fe00640 1 -- 172.21.15.100:0/3488514058 learned_addr learned my addr 172.21.15.100:0/3488514058 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa4c00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f800052a0 0x7f7fa01edf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7fa5600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fa0156db0 0x7f7fa01494a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.391+0000 7f7f9fe00640 1 -- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fa0156db0 msgr2=0x7f7fa01494a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fa0156db0 0x7f7fa01494a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9fe00640 1 -- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f800052a0 msgr2=0x7f7fa01edf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f800052a0 0x7f7fa01edf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9fe00640 1 -- 172.21.15.100:0/3488514058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa014b630 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9fe00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e810 tx=0x7f7f8800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800c670 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8800c7d0 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800cb40 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fa00bd800 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.392+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fa01ed770 con 0x7f7fa01ea980 2024-01-20T08:10:59.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.393+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fa004e970 con 0x7f7fa01ea980 2024-01-20T08:10:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.394+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7f8800cca0 con 0x7f7fa01ea980 2024-01-20T08:10:59.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.395+0000 7f7f9cc00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 0x7f7f7806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.395+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7f88088fe0 con 0x7f7fa01ea980 2024-01-20T08:10:59.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.395+0000 7f7fa4c00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 0x7f7f7806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.396+0000 7f7fa4c00640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 0x7f7f7806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f900059f0 tx=0x7f7f90009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.400+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7f88054230 con 0x7f7fa01ea980 2024-01-20T08:10:59.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.639+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7fa01edc20 con 0x7f7fa01ea980 2024-01-20T08:10:59.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.645+0000 7f7f9cc00640 1 -- 172.21.15.100:0/3488514058 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7f88057850 con 0x7f7fa01ea980 2024-01-20T08:10:59.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 msgr2=0x7f7f7806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 0x7f7f7806d3c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7f900059f0 tx=0x7f7f90009040 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 msgr2=0x7f7fa00c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e810 tx=0x7f7f8800ecd0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 shutdown_connections 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f7806af00 0x7f7f7806d3c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fa0156db0 0x7f7fa01494a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fa01ea980 0x7f7fa00c8560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 --2- 172.21.15.100:0/3488514058 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f800052a0 0x7f7fa01edf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 >> 172.21.15.100:0/3488514058 conn(0x7f7fa00ca0e0 msgr2=0x7f7fa0153100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 shutdown_connections 2024-01-20T08:10:59.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.647+0000 7f7fa7600640 1 -- 172.21.15.100:0/3488514058 wait complete. 2024-01-20T08:10:59.667 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-01-20T08:10:59.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.855+0000 7f3732000640 1 Processor -- start 2024-01-20T08:10:59.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.855+0000 7f3732000640 1 -- start start 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 0x7f372c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 0x7f372c0701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f372c154af0 0x7f372c154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c06dbf0 con 0x7f372c154af0 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f372c06d220 con 0x7f372c0c05a0 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f3732000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1557a0 con 0x7f372c1481a0 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f372be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f372c154af0 0x7f372c154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f372be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f372c154af0 0x7f372c154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56066/0 (socket says 172.21.15.100:56066) 2024-01-20T08:10:59.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.857+0000 7f372be00640 1 -- 172.21.15.100:0/1454660645 learned_addr learned my addr 172.21.15.100:0/1454660645 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f3723e00640 1 --2- 172.21.15.100:0/1454660645 >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 0x7f372c0701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372b400640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 0x7f372c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372be00640 1 -- 172.21.15.100:0/1454660645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 msgr2=0x7f372c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372be00640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 0x7f372c06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372be00640 1 -- 172.21.15.100:0/1454660645 >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 msgr2=0x7f372c0701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372be00640 1 --2- 172.21.15.100:0/1454660645 >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 0x7f372c0701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372be00640 1 -- 172.21.15.100:0/1454660645 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c06c8f0 con 0x7f372c154af0 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f372b400640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 0x7f372c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.858+0000 7f3723e00640 1 --2- 172.21.15.100:0/1454660645 >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 0x7f372c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:59.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.859+0000 7f372be00640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c154f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f372c06e680 tx=0x7f372402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848373ff125d582e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.859+0000 7f372aa00640 1 -- 172.21.15.100:0/1454660645 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372402ca80 con 0x7f372c154af0 2024-01-20T08:10:59.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.859+0000 7f372aa00640 1 -- 172.21.15.100:0/1454660645 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372402cbe0 con 0x7f372c154af0 2024-01-20T08:10:59.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.859+0000 7f372aa00640 1 -- 172.21.15.100:0/1454660645 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37240343f0 con 0x7f372c154af0 2024-01-20T08:10:59.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 -- 172.21.15.100:0/1454660645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 msgr2=0x7f372c154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c154f60 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f372c06e680 tx=0x7f372402bee0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 -- 172.21.15.100:0/1454660645 shutdown_connections 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c154f60 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 --2- 172.21.15.100:0/1454660645 >> v2:172.21.15.110:3300/0 conn(0x7f372c0c05a0 0x7f372c0701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 --2- 172.21.15.100:0/1454660645 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1481a0 0x7f372c06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 -- 172.21.15.100:0/1454660645 >> 172.21.15.100:0/1454660645 conn(0x7f372c0c6090 msgr2=0x7f372c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 -- 172.21.15.100:0/1454660645 shutdown_connections 2024-01-20T08:10:59.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.860+0000 7f3732000640 1 -- 172.21.15.100:0/1454660645 wait complete. 2024-01-20T08:10:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.862+0000 7f3732000640 1 Processor -- start 2024-01-20T08:10:59.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.862+0000 7f3732000640 1 -- start start 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1ea1e0 0x7f372c0c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 0x7f372c14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1425d0 con 0x7f372c154af0 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372c0ac2f0 con 0x7f372c0c5210 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f3732000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372c1eb160 con 0x7f372c1ea1e0 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f372b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f372b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56082/0 (socket says 172.21.15.100:56082) 2024-01-20T08:10:59.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.863+0000 7f372b400640 1 -- 172.21.15.100:0/1131274337 learned_addr learned my addr 172.21.15.100:0/1131274337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:10:59.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372be00640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 0x7f372c14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3723e00640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1ea1e0 0x7f372c0c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 -- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1ea1e0 msgr2=0x7f372c0c4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1ea1e0 0x7f372c0c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 -- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 msgr2=0x7f372c14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 0x7f372c14f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 -- 172.21.15.100:0/1131274337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3724009b30 con 0x7f372c154af0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372be00640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 0x7f372c14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f372b400640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c7f0 tx=0x7f371c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c007a30 con 0x7f372c154af0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f371c007b90 con 0x7f372c154af0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f372c1523d0 con 0x7f372c154af0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f371c00ce40 con 0x7f372c154af0 2024-01-20T08:10:59.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.864+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f372c0abca0 con 0x7f372c154af0 2024-01-20T08:10:59.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.865+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f372c0a9540 con 0x7f372c154af0 2024-01-20T08:10:59.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.867+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f371c0113f0 con 0x7f372c154af0 2024-01-20T08:10:59.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.868+0000 7f3723400640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 0x7f370406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:10:59.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.868+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f371c089400 con 0x7f372c154af0 2024-01-20T08:10:59.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.868+0000 7f3723e00640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 0x7f370406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:10:59.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.868+0000 7f3723e00640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 0x7f370406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f372c14e910 tx=0x7f3714008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:10:59.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:10:59.872+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f371c054610 con 0x7f372c154af0 2024-01-20T08:11:00.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.130+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f372c04ea50 con 0x7f372c154af0 2024-01-20T08:11:00.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.134+0000 7f3723400640 1 -- 172.21.15.100:0/1131274337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v8) v1 ==== 97+0+0 (secure 0 0 0) 0x7f371c057c30 con 0x7f372c154af0 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 msgr2=0x7f370406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 0x7f370406d3c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f372c14e910 tx=0x7f3714008040 comp rx=0 tx=0).stop 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 msgr2=0x7f372c1eac20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f371c00c7f0 tx=0x7f371c00cbf0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 shutdown_connections 2024-01-20T08:11:00.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f372c0c5210 0x7f372c14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f370406af00 0x7f370406d3c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f372c1ea1e0 0x7f372c0c4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 --2- 172.21.15.100:0/1131274337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f372c154af0 0x7f372c1eac20 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 >> 172.21.15.100:0/1131274337 conn(0x7f372c0c6090 msgr2=0x7f372c0709b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 shutdown_connections 2024-01-20T08:11:00.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.137+0000 7f3732000640 1 -- 172.21.15.100:0/1131274337 wait complete. 2024-01-20T08:11:00.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-01-20T08:11:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.344+0000 7fda16000640 1 Processor -- start 2024-01-20T08:11:00.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.344+0000 7fda16000640 1 -- start start 2024-01-20T08:11:00.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda16000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda1014b720 0x7fda101515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda16000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fda100c1850 0x7fda100c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda16000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda10154ba0 con 0x7fda1006c8d0 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda16000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1014bb00 con 0x7fda1014b720 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda16000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda10155a00 con 0x7fda100c1850 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.345+0000 7fda0f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda1014b720 0x7fda101515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fda1014b720 0x7fda101515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56090/0 (socket says 172.21.15.100:56090) 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 -- 172.21.15.100:0/2958027108 learned_addr learned my addr 172.21.15.100:0/2958027108 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda06800640 1 --2- 172.21.15.100:0/2958027108 >> v2:172.21.15.110:3300/0 conn(0x7fda100c1850 0x7fda100c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 -- 172.21.15.100:0/2958027108 >> v2:172.21.15.110:3300/0 conn(0x7fda100c1850 msgr2=0x7fda100c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 --2- 172.21.15.100:0/2958027108 >> v2:172.21.15.110:3300/0 conn(0x7fda100c1850 0x7fda100c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 -- 172.21.15.100:0/2958027108 >> v1:172.21.15.100:6789/0 conn(0x7fda1006c8d0 legacy=0x7fda1006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.346+0000 7fda0f400640 1 -- 172.21.15.100:0/2958027108 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10154df0 con 0x7fda1014b720 2024-01-20T08:11:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.347+0000 7fda0f400640 1 --2- 172.21.15.100:0/2958027108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101515b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fda100ac030 tx=0x7fda0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173b31dd01a0da5d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.347+0000 7fda0ea00640 1 -- 172.21.15.100:0/2958027108 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00031870 con 0x7fda1014b720 2024-01-20T08:11:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.347+0000 7fda0ea00640 1 -- 172.21.15.100:0/2958027108 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda000319d0 con 0x7fda1014b720 2024-01-20T08:11:00.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.347+0000 7fda0ea00640 1 -- 172.21.15.100:0/2958027108 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00031d60 con 0x7fda1014b720 2024-01-20T08:11:00.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 -- 172.21.15.100:0/2958027108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 msgr2=0x7fda101515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 --2- 172.21.15.100:0/2958027108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101515b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fda100ac030 tx=0x7fda0002b910 comp rx=0 tx=0).stop 2024-01-20T08:11:00.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 -- 172.21.15.100:0/2958027108 shutdown_connections 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 --2- 172.21.15.100:0/2958027108 >> v2:172.21.15.110:3300/0 conn(0x7fda100c1850 0x7fda100c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 --2- 172.21.15.100:0/2958027108 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101515b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 -- 172.21.15.100:0/2958027108 >> 172.21.15.100:0/2958027108 conn(0x7fda100c2940 msgr2=0x7fda100c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 -- 172.21.15.100:0/2958027108 shutdown_connections 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.348+0000 7fda16000640 1 -- 172.21.15.100:0/2958027108 wait complete. 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.350+0000 7fda16000640 1 Processor -- start 2024-01-20T08:11:00.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.350+0000 7fda16000640 1 -- start start 2024-01-20T08:11:00.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda1006c8d0 0x7fda101477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda100c1850 0x7fda10147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda101de7d0 con 0x7fda1014b720 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda100bcd00 con 0x7fda100c1850 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda16000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda101de150 con 0x7fda1006c8d0 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56096/0 (socket says 172.21.15.100:56096) 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 -- 172.21.15.100:0/1578757787 learned_addr learned my addr 172.21.15.100:0/1578757787 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0f400640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda1006c8d0 0x7fda101477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 -- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda1006c8d0 msgr2=0x7fda101477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda06800640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda100c1850 0x7fda10147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda1006c8d0 0x7fda101477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.351+0000 7fda0fe00640 1 -- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda100c1850 msgr2=0x7fda10147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda0fe00640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda100c1850 0x7fda10147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda0fe00640 1 -- 172.21.15.100:0/1578757787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000094d0 con 0x7fda1014b720 2024-01-20T08:11:00.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda0fe00640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c7a0 tx=0x7fda0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08003b70 con 0x7fda1014b720 2024-01-20T08:11:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda08003cf0 con 0x7fda1014b720 2024-01-20T08:11:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0800aa90 con 0x7fda1014b720 2024-01-20T08:11:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda101e8c80 con 0x7fda1014b720 2024-01-20T08:11:00.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.352+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda101e8f60 con 0x7fda1014b720 2024-01-20T08:11:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.353+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1004e970 con 0x7fda1014b720 2024-01-20T08:11:00.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.354+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fda0800abf0 con 0x7fda1014b720 2024-01-20T08:11:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.355+0000 7fda07e00640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 0x7fd9e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.355+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fda08089170 con 0x7fda1014b720 2024-01-20T08:11:00.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.355+0000 7fda0f400640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 0x7fd9e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.356+0000 7fda0f400640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 0x7fd9e806d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fda00036000 tx=0x7fda0003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.360+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fda08054380 con 0x7fda1014b720 2024-01-20T08:11:00.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.620+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fda100c37e0 con 0x7fda1014b720 2024-01-20T08:11:00.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.625+0000 7fda07e00640 1 -- 172.21.15.100:0/1578757787 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fda080579a0 con 0x7fda1014b720 2024-01-20T08:11:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 msgr2=0x7fd9e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 0x7fd9e806d390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fda00036000 tx=0x7fda0003c040 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 msgr2=0x7fda101deeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fda0800c7a0 tx=0x7fda0800cc60 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 shutdown_connections 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1014b720 0x7fda101deeb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fda100c1850 0x7fda10147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd9e806aed0 0x7fd9e806d390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 --2- 172.21.15.100:0/1578757787 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fda1006c8d0 0x7fda101477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.628+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 >> 172.21.15.100:0/1578757787 conn(0x7fda100c2940 msgr2=0x7fda10071f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.629+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 shutdown_connections 2024-01-20T08:11:00.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.629+0000 7fda16000640 1 -- 172.21.15.100:0/1578757787 wait complete. 2024-01-20T08:11:00.648 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:00.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.850+0000 7f7ffc200640 1 Processor -- start 2024-01-20T08:11:00.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.850+0000 7f7ffc200640 1 -- start start 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ffc200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ff4147f20 0x7f7ff40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ffc200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ff4151f60 0x7f7ff4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ffc200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ff40c1670 con 0x7f7ff40c1b00 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ffc200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff41524b0 con 0x7f7ff4151f60 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ffc200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ff40c0d40 con 0x7f7ff4147f20 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.851+0000 7f7ff8e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ff4151f60 0x7f7ff4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ff4151f60 0x7f7ff4070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56104/0 (socket says 172.21.15.100:56104) 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2909030172 learned_addr learned my addr 172.21.15.100:0/2909030172 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff9800640 1 --2- 172.21.15.100:0/2909030172 >> v2:172.21.15.110:3300/0 conn(0x7f7ff4147f20 0x7f7ff40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2909030172 >> v2:172.21.15.110:3300/0 conn(0x7f7ff4147f20 msgr2=0x7f7ff40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:00.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 --2- 172.21.15.100:0/2909030172 >> v2:172.21.15.110:3300/0 conn(0x7f7ff4147f20 0x7f7ff40abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2909030172 >> v1:172.21.15.100:6789/0 conn(0x7f7ff40c1b00 legacy=0x7f7ff40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.852+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2909030172 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff40c1020 con 0x7f7ff4151f60 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.853+0000 7f7ff8e00640 1 --2- 172.21.15.100:0/2909030172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4151f60 0x7f7ff4070370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ff406e5d0 tx=0x7f7fdc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2cdf51a54045c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.853+0000 7f7ff3e00640 1 -- 172.21.15.100:0/2909030172 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc030860 con 0x7f7ff4151f60 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.853+0000 7f7ff3e00640 1 -- 172.21.15.100:0/2909030172 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc0309c0 con 0x7f7ff4151f60 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.853+0000 7f7ff3e00640 1 -- 172.21.15.100:0/2909030172 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc030d50 con 0x7f7ff4151f60 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 -- 172.21.15.100:0/2909030172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4151f60 msgr2=0x7f7ff4070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2909030172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4151f60 0x7f7ff4070370 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f7ff406e5d0 tx=0x7f7fdc02b9a0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 -- 172.21.15.100:0/2909030172 shutdown_connections 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2909030172 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4151f60 0x7f7ff4070370 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2909030172 >> v2:172.21.15.110:3300/0 conn(0x7f7ff4147f20 0x7f7ff40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 -- 172.21.15.100:0/2909030172 >> 172.21.15.100:0/2909030172 conn(0x7f7ff406a5e0 msgr2=0x7f7ff406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 -- 172.21.15.100:0/2909030172 shutdown_connections 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.854+0000 7f7ffc200640 1 -- 172.21.15.100:0/2909030172 wait complete. 2024-01-20T08:11:00.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.856+0000 7f7ffc200640 1 Processor -- start 2024-01-20T08:11:00.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.856+0000 7f7ffc200640 1 -- start start 2024-01-20T08:11:00.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40c1b00 0x7f7ff4149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff4151f60 0x7f7ff4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4148cd0 con 0x7f7ff4147f20 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41542e0 con 0x7f7ff4151f60 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ffc200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff41436f0 con 0x7f7ff40c1b00 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ff8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ff8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56120/0 (socket says 172.21.15.100:56120) 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.857+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2790542854 learned_addr learned my addr 172.21.15.100:0/2790542854 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40c1b00 msgr2=0x7f7ff4149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40c1b00 0x7f7ff4149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff4151f60 msgr2=0x7f7ff4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff4151f60 0x7f7ff4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 -- 172.21.15.100:0/2790542854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc0094d0 con 0x7f7ff4147f20 2024-01-20T08:11:00.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff8e00640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc03e070 con 0x7f7ff4147f20 2024-01-20T08:11:00.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fdc039a60 con 0x7f7ff4147f20 2024-01-20T08:11:00.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fdc039df0 con 0x7f7ff4147f20 2024-01-20T08:11:00.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff414f460 con 0x7f7ff4147f20 2024-01-20T08:11:00.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.858+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff41489f0 con 0x7f7ff4147f20 2024-01-20T08:11:00.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.859+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff404e970 con 0x7f7ff4147f20 2024-01-20T08:11:00.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.860+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7fdc04b400 con 0x7f7ff4147f20 2024-01-20T08:11:00.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.861+0000 7f7ff1600640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 0x7f7fcc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:00.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.861+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7fdc0aba60 con 0x7f7ff4147f20 2024-01-20T08:11:00.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.861+0000 7f7ff9800640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 0x7f7fcc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:00.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.862+0000 7f7ff9800640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 0x7f7fcc06d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ff41e5c90 tx=0x7f7fe4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:00.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:00.866+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fdc076d20 con 0x7f7ff4147f20 2024-01-20T08:11:01.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.059+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ff40c38d0 con 0x7f7ff4147f20 2024-01-20T08:11:01.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.061+0000 7f7ff1600640 1 -- 172.21.15.100:0/2790542854 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12834 (secure 0 0 0) 0x7f7fdc034090 con 0x7f7ff4147f20 2024-01-20T08:11:01.064 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:01.064 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":30,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:10:57.147941+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 msgr2=0x7f7fcc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 0x7f7fcc06d390 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7ff41e5c90 tx=0x7f7fe4008040 comp rx=0 tx=0).stop 2024-01-20T08:11:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 msgr2=0x7f7ff41e53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc000c00 tx=0x7f7fdc0046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 shutdown_connections 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ff4151f60 0x7f7ff4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ff4147f20 0x7f7ff41e53b0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fcc06aed0 0x7f7fcc06d390 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 --2- 172.21.15.100:0/2790542854 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ff40c1b00 0x7f7ff4149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.064+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 >> 172.21.15.100:0/2790542854 conn(0x7f7ff406a5e0 msgr2=0x7f7ff40c61b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.065+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 shutdown_connections 2024-01-20T08:11:01.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.065+0000 7f7ffc200640 1 -- 172.21.15.100:0/2790542854 wait complete. 2024-01-20T08:11:01.085 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:01.086 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:01.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.290+0000 7f23cd800640 1 Processor -- start 2024-01-20T08:11:01.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.290+0000 7f23cd800640 1 -- start start 2024-01-20T08:11:01.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 0x7f23c8157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c24f0 0x7f23c806e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23c81550c0 0x7f23c80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c8154ca0 con 0x7f23c81550c0 2024-01-20T08:11:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23c806e760 con 0x7f23c8158af0 2024-01-20T08:11:01.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23cd800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8071d00 con 0x7f23c80c24f0 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23c7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23c81550c0 0x7f23c80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23c7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23c81550c0 0x7f23c80c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56134/0 (socket says 172.21.15.100:56134) 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23c7400640 1 -- 172.21.15.100:0/2322946813 learned_addr learned my addr 172.21.15.100:0/2322946813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23bfe00640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c24f0 0x7f23c806e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.292+0000 7f23c6a00640 1 --2- 172.21.15.100:0/2322946813 >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 0x7f23c8157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c7400640 1 -- 172.21.15.100:0/2322946813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c24f0 msgr2=0x7f23c806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c7400640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c24f0 0x7f23c806e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c7400640 1 -- 172.21.15.100:0/2322946813 >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 msgr2=0x7f23c8157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c7400640 1 --2- 172.21.15.100:0/2322946813 >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 0x7f23c8157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c7400640 1 -- 172.21.15.100:0/2322946813 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8071fa0 con 0x7f23c81550c0 2024-01-20T08:11:01.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.293+0000 7f23c6a00640 1 --2- 172.21.15.100:0/2322946813 >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 0x7f23c8157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.294+0000 7f23c7400640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c81550c0 0x7f23c80c1850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f23c806fd60 tx=0x7f23c002bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad21e5f464b170d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.294+0000 7f23c6000640 1 -- 172.21.15.100:0/2322946813 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c002c950 con 0x7f23c81550c0 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.294+0000 7f23c6000640 1 -- 172.21.15.100:0/2322946813 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c002cab0 con 0x7f23c81550c0 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.294+0000 7f23c6000640 1 -- 172.21.15.100:0/2322946813 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c002ce40 con 0x7f23c81550c0 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 -- 172.21.15.100:0/2322946813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c81550c0 msgr2=0x7f23c80c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c81550c0 0x7f23c80c1850 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f23c806fd60 tx=0x7f23c002bdb0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 -- 172.21.15.100:0/2322946813 shutdown_connections 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c81550c0 0x7f23c80c1850 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 --2- 172.21.15.100:0/2322946813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c80c24f0 0x7f23c806e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 --2- 172.21.15.100:0/2322946813 >> v2:172.21.15.110:3300/0 conn(0x7f23c8158af0 0x7f23c8157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 -- 172.21.15.100:0/2322946813 >> 172.21.15.100:0/2322946813 conn(0x7f23c80c2940 msgr2=0x7f23c80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 -- 172.21.15.100:0/2322946813 shutdown_connections 2024-01-20T08:11:01.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.295+0000 7f23cd800640 1 -- 172.21.15.100:0/2322946813 wait complete. 2024-01-20T08:11:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.297+0000 7f23cd800640 1 Processor -- start 2024-01-20T08:11:01.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.297+0000 7f23cd800640 1 -- start start 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c81550c0 0x7f23c81519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c8158af0 0x7f23c8151f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80aadf0 con 0x7f23c80c24f0 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23c8151550 con 0x7f23c81550c0 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.298+0000 7f23cd800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23c80ab320 con 0x7f23c8158af0 2024-01-20T08:11:01.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56150/0 (socket says 172.21.15.100:56150) 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 -- 172.21.15.100:0/2473639995 learned_addr learned my addr 172.21.15.100:0/2473639995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 -- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c8158af0 msgr2=0x7f23c8151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c8158af0 0x7f23c8151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 -- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c81550c0 msgr2=0x7f23c81519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c81550c0 0x7f23c81519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.299+0000 7f23c6a00640 1 -- 172.21.15.100:0/2473639995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c0009b30 con 0x7f23c80c24f0 2024-01-20T08:11:01.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23c6a00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f23b800d7d0 tx=0x7f23b800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004030 con 0x7f23c80c24f0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23b8004190 con 0x7f23c80c24f0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23b8004520 con 0x7f23c80c24f0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23c80ab040 con 0x7f23c80c24f0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.300+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23c81573a0 con 0x7f23c80c24f0 2024-01-20T08:11:01.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.301+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23c804e970 con 0x7f23c80c24f0 2024-01-20T08:11:01.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.302+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f23b80096a0 con 0x7f23c80c24f0 2024-01-20T08:11:01.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.303+0000 7f23bea00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 0x7f23a006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.303+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f23b80893a0 con 0x7f23c80c24f0 2024-01-20T08:11:01.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.303+0000 7f23bfe00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 0x7f23a006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.304+0000 7f23bfe00640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 0x7f23a006d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23c814db60 tx=0x7f23b0009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.308+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f23b8054650 con 0x7f23c80c24f0 2024-01-20T08:11:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.500+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23c8074480 con 0x7f23c80c24f0 2024-01-20T08:11:01.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.500+0000 7f23bea00640 1 -- 172.21.15.100:0/2473639995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7f23b8057c70 con 0x7f23c80c24f0 2024-01-20T08:11:01.502 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 msgr2=0x7f23a006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 0x7f23a006d3c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f23c814db60 tx=0x7f23b0009500 comp rx=0 tx=0).stop 2024-01-20T08:11:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 msgr2=0x7f23c8156e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f23b800d7d0 tx=0x7f23b800dc90 comp rx=0 tx=0).stop 2024-01-20T08:11:01.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 shutdown_connections 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23a006af00 0x7f23a006d3c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23c8158af0 0x7f23c8151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23c81550c0 0x7f23c81519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 --2- 172.21.15.100:0/2473639995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23c80c24f0 0x7f23c8156e60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 >> 172.21.15.100:0/2473639995 conn(0x7f23c80c2940 msgr2=0x7f23c81534b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 shutdown_connections 2024-01-20T08:11:01.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.503+0000 7f23cd800640 1 -- 172.21.15.100:0/2473639995 wait complete. 2024-01-20T08:11:01.525 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:11:01.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.732+0000 7f28bbc00640 1 Processor -- start 2024-01-20T08:11:01.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.732+0000 7f28bbc00640 1 -- start start 2024-01-20T08:11:01.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.733+0000 7f28bbc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f28b414b720 0x7f28b41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.733+0000 7f28bbc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f28b40c1d00 0x7f28b406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.733+0000 7f28bbc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b4154ba0 con 0x7f28b40c1850 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.733+0000 7f28bbc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b414bb00 con 0x7f28b40c1d00 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.733+0000 7f28bbc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b4155a00 con 0x7f28b414b720 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f28b40c1850 0x7f28b406c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56762/0 (socket says 172.21.15.100:56762) 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b3e00640 1 -- 172.21.15.100:0/634153669 learned_addr learned my addr 172.21.15.100:0/634153669 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9c00640 1 --2- 172.21.15.100:0/634153669 >> v2:172.21.15.100:3300/0 conn(0x7f28b40c1d00 0x7f28b406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9200640 1 --2- 172.21.15.100:0/634153669 >> v2:172.21.15.110:3300/0 conn(0x7f28b414b720 0x7f28b41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9c00640 1 -- 172.21.15.100:0/634153669 >> v2:172.21.15.110:3300/0 conn(0x7f28b414b720 msgr2=0x7f28b41515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:01.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9c00640 1 --2- 172.21.15.100:0/634153669 >> v2:172.21.15.110:3300/0 conn(0x7f28b414b720 0x7f28b41515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9c00640 1 -- 172.21.15.100:0/634153669 >> v1:172.21.15.100:6789/0 conn(0x7f28b40c1850 legacy=0x7f28b406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.734+0000 7f28b9c00640 1 -- 172.21.15.100:0/634153669 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b4154df0 con 0x7f28b40c1d00 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.735+0000 7f28b9c00640 1 --2- 172.21.15.100:0/634153669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b40c1d00 0x7f28b406cfe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28b406be40 tx=0x7f28ac02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=658b1ce70a02402d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.735+0000 7f28b3400640 1 -- 172.21.15.100:0/634153669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac02cbf0 con 0x7f28b40c1d00 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28b3400640 1 -- 172.21.15.100:0/634153669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac02cd50 con 0x7f28b40c1d00 2024-01-20T08:11:01.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28b3400640 1 -- 172.21.15.100:0/634153669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac034660 con 0x7f28b40c1d00 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 -- 172.21.15.100:0/634153669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b40c1d00 msgr2=0x7f28b406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 --2- 172.21.15.100:0/634153669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b40c1d00 0x7f28b406cfe0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f28b406be40 tx=0x7f28ac02be40 comp rx=0 tx=0).stop 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 -- 172.21.15.100:0/634153669 shutdown_connections 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 --2- 172.21.15.100:0/634153669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b40c1d00 0x7f28b406cfe0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 --2- 172.21.15.100:0/634153669 >> v2:172.21.15.110:3300/0 conn(0x7f28b414b720 0x7f28b41515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 -- 172.21.15.100:0/634153669 >> 172.21.15.100:0/634153669 conn(0x7f28b40c2940 msgr2=0x7f28b40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:01.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 -- 172.21.15.100:0/634153669 shutdown_connections 2024-01-20T08:11:01.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.736+0000 7f28bbc00640 1 -- 172.21.15.100:0/634153669 wait complete. 2024-01-20T08:11:01.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.738+0000 7f28bbc00640 1 Processor -- start 2024-01-20T08:11:01.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.738+0000 7f28bbc00640 1 -- start start 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28b40c1850 0x7f28b414a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28b40c1d00 0x7f28b414dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b40bfdb0 con 0x7f28b414b720 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b414d3e0 con 0x7f28b40c1d00 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28bbc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b414c7d0 con 0x7f28b40c1850 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56166/0 (socket says 172.21.15.100:56166) 2024-01-20T08:11:01.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 -- 172.21.15.100:0/1830247752 learned_addr learned my addr 172.21.15.100:0/1830247752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:01.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 -- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28b40c1850 msgr2=0x7f28b414a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28b40c1850 0x7f28b414a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 -- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28b40c1d00 msgr2=0x7f28b414dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28b40c1d00 0x7f28b414dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.739+0000 7f28b9c00640 1 -- 172.21.15.100:0/1830247752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ac009a70 con 0x7f28b414b720 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28b9c00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009e80 tx=0x7f28ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac040650 con 0x7f28b414b720 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28ac0407d0 con 0x7f28b414b720 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28ac040b80 con 0x7f28b414b720 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b414cab0 con 0x7f28b414b720 2024-01-20T08:11:01.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.740+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b414d070 con 0x7f28b414b720 2024-01-20T08:11:01.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.741+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28b414d200 con 0x7f28b414b720 2024-01-20T08:11:01.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.742+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f28ac040ce0 con 0x7f28b414b720 2024-01-20T08:11:01.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.744+0000 7f28b0c00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 0x7f288c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:01.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.744+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f28ac0ac0c0 con 0x7f28b414b720 2024-01-20T08:11:01.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.744+0000 7f28b9200640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 0x7f288c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:01.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.745+0000 7f28b9200640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 0x7f288c06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006fd0 tx=0x7f28a4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:01.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.748+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f28ac077350 con 0x7f28b414b720 2024-01-20T08:11:01.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.946+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f28b404e970 con 0x7f28b414b720 2024-01-20T08:11:01.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.946+0000 7f28b0c00640 1 -- 172.21.15.100:0/1830247752 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f28ac07a970 con 0x7f28b414b720 2024-01-20T08:11:01.948 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:01.948 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:11:01.948 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:11:01.949 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:11:01.949 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:11:01.949 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:11:01.949 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.949+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 msgr2=0x7f288c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.949+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 0x7f288c06d390 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f28a4006fd0 tx=0x7f28a4008040 comp rx=0 tx=0).stop 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.949+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 msgr2=0x7f28b414e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.949+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f28ac009e80 tx=0x7f28ac004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 shutdown_connections 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f28b414b720 0x7f28b414e170 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f28b40c1d00 0x7f28b414dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f288c06aed0 0x7f288c06d390 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 --2- 172.21.15.100:0/1830247752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f28b40c1850 0x7f28b414a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 >> 172.21.15.100:0/1830247752 conn(0x7f28b40c2940 msgr2=0x7f28b40c49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 shutdown_connections 2024-01-20T08:11:01.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:01.950+0000 7f28bbc00640 1 -- 172.21.15.100:0/1830247752 wait complete. 2024-01-20T08:11:01.969 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T08:11:01.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T08:11:02.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.181+0000 7fd382c00640 1 Processor -- start 2024-01-20T08:11:02.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.182+0000 7fd382c00640 1 -- start start 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd382c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c0c4ae0 0x7fd37c154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd382c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd37c0c4ec0 0x7fd37c06b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd382c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd37c0c8f50 con 0x7fd37c0c93e0 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd382c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0c5320 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd382c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0c8060 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.183+0000 7fd37be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c0c4ae0 0x7fd37c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd37c0c4ae0 0x7fd37c154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56174/0 (socket says 172.21.15.100:56174) 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 -- 172.21.15.100:0/165871501 learned_addr learned my addr 172.21.15.100:0/165871501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd373200640 1 --2- 172.21.15.100:0/165871501 >> v2:172.21.15.110:3300/0 conn(0x7fd37c0c4ec0 0x7fd37c06b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 -- 172.21.15.100:0/165871501 >> v2:172.21.15.110:3300/0 conn(0x7fd37c0c4ec0 msgr2=0x7fd37c06b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:02.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 --2- 172.21.15.100:0/165871501 >> v2:172.21.15.110:3300/0 conn(0x7fd37c0c4ec0 0x7fd37c06b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 -- 172.21.15.100:0/165871501 >> v1:172.21.15.110:6789/0 conn(0x7fd37c0c93e0 legacy=0x7fd37c157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.184+0000 7fd37be00640 1 -- 172.21.15.100:0/165871501 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0c8340 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.185+0000 7fd37be00640 1 --2- 172.21.15.100:0/165871501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ae0 0x7fd37c154850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd37c074670 tx=0x7fd36c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e057d7e1cd51dd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.185+0000 7fd37b400640 1 -- 172.21.15.100:0/165871501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c02c9f0 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd37b400640 1 -- 172.21.15.100:0/165871501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd36c02cb50 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd37b400640 1 -- 172.21.15.100:0/165871501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd36c0343f0 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 -- 172.21.15.100:0/165871501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ae0 msgr2=0x7fd37c154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:02.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 --2- 172.21.15.100:0/165871501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ae0 0x7fd37c154850 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fd37c074670 tx=0x7fd36c02be50 comp rx=0 tx=0).stop 2024-01-20T08:11:02.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 -- 172.21.15.100:0/165871501 shutdown_connections 2024-01-20T08:11:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 --2- 172.21.15.100:0/165871501 >> v2:172.21.15.110:3300/0 conn(0x7fd37c0c4ec0 0x7fd37c06b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 --2- 172.21.15.100:0/165871501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ae0 0x7fd37c154850 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 -- 172.21.15.100:0/165871501 >> 172.21.15.100:0/165871501 conn(0x7fd37c0ca160 msgr2=0x7fd37c0ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 -- 172.21.15.100:0/165871501 shutdown_connections 2024-01-20T08:11:02.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.186+0000 7fd382c00640 1 -- 172.21.15.100:0/165871501 wait complete. 2024-01-20T08:11:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.188+0000 7fd382c00640 1 Processor -- start 2024-01-20T08:11:02.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.188+0000 7fd382c00640 1 -- start start 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 0x7fd37c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 0x7fd37c1ebda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c1533b0 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c153690 con 0x7fd37c0c93e0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd382c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c153970 con 0x7fd37c0c4ae0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd373200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd373200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56186/0 (socket says 172.21.15.100:56186) 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.189+0000 7fd373200640 1 -- 172.21.15.100:0/286065413 learned_addr learned my addr 172.21.15.100:0/286065413 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd37be00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 0x7fd37c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd380c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 0x7fd37c1ebda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 -- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 msgr2=0x7fd37c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:02.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 0x7fd37c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 -- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 msgr2=0x7fd37c1ebda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 0x7fd37c1ebda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 -- 172.21.15.100:0/286065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd36c009b30 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd380c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 0x7fd37c1ebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd37be00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 0x7fd37c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:02.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd373200640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c7f0 tx=0x7fd36400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364004220 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.190+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd364004380 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.191+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c153c50 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.191+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd364007840 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.191+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c153080 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.192+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c154170 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.193+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd364007bb0 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.193+0000 7fd378c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 0x7fd35406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.194+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd364089200 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.194+0000 7fd37be00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 0x7fd35406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:02.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.194+0000 7fd37be00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 0x7fd35406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd36c035000 tx=0x7fd36c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:02.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.198+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd37c154170 con 0x7fd37c0c4ec0 2024-01-20T08:11:02.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:02.389+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fd37c154170 con 0x7fd37c0c4ec0 2024-01-20T08:11:03.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.198+0000 7fd378c00640 1 -- 172.21.15.100:0/286065413 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fd37c154170 con 0x7fd37c0c4ec0 2024-01-20T08:11:03.200 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-20T08:11:03.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.202+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 msgr2=0x7fd35406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:03.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.202+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 0x7fd35406d3c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd36c035000 tx=0x7fd36c030000 comp rx=0 tx=0).stop 2024-01-20T08:11:03.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.202+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 msgr2=0x7fd37c1eb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:03.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.202+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd36400c7f0 tx=0x7fd36400ccb0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 shutdown_connections 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd37c0c93e0 0x7fd37c1ebda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd37c0c4ec0 0x7fd37c1eb860 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd35406af00 0x7fd35406d3c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 --2- 172.21.15.100:0/286065413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd37c0c4ae0 0x7fd37c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.203+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 >> 172.21.15.100:0/286065413 conn(0x7fd37c0ca160 msgr2=0x7fd37c150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:03.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.204+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 shutdown_connections 2024-01-20T08:11:03.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.204+0000 7fd382c00640 1 -- 172.21.15.100:0/286065413 wait complete. 2024-01-20T08:11:03.231 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:11:03.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.442+0000 7f251f800640 1 Processor -- start 2024-01-20T08:11:03.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.442+0000 7f251f800640 1 -- start start 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f251806ed40 0x7f2518150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2518070a80 0x7f2518152190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f251814dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2518070fd0 con 0x7f251806ed40 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25180712b0 con 0x7f2518070a80 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.443+0000 7f251f800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518071590 con 0x7f2518072070 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f251806ed40 0x7f2518150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f251806ed40 0x7f2518150ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56188/0 (socket says 172.21.15.100:56188) 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 -- 172.21.15.100:0/1226030799 learned_addr learned my addr 172.21.15.100:0/1226030799 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f2517e00640 1 --2- 172.21.15.100:0/1226030799 >> v2:172.21.15.110:3300/0 conn(0x7f2518070a80 0x7f2518152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251d800640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f251814dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 -- 172.21.15.100:0/1226030799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 msgr2=0x7f251814dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f251814dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 -- 172.21.15.100:0/1226030799 >> v2:172.21.15.110:3300/0 conn(0x7f2518070a80 msgr2=0x7f2518152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 --2- 172.21.15.100:0/1226030799 >> v2:172.21.15.110:3300/0 conn(0x7f2518070a80 0x7f2518152190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.444+0000 7f251ce00640 1 -- 172.21.15.100:0/1226030799 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2518071870 con 0x7f251806ed40 2024-01-20T08:11:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.446+0000 7f251ce00640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251806ed40 0x7f2518150ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f25180c6640 tx=0x7f250802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca297b04a9f43ca8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.446+0000 7f2517400640 1 -- 172.21.15.100:0/1226030799 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508031870 con 0x7f251806ed40 2024-01-20T08:11:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.446+0000 7f2517400640 1 -- 172.21.15.100:0/1226030799 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25080319d0 con 0x7f251806ed40 2024-01-20T08:11:03.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.446+0000 7f2517400640 1 -- 172.21.15.100:0/1226030799 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2508031d60 con 0x7f251806ed40 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 -- 172.21.15.100:0/1226030799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251806ed40 msgr2=0x7f2518150ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251806ed40 0x7f2518150ca0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f25180c6640 tx=0x7f250802b910 comp rx=0 tx=0).stop 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 -- 172.21.15.100:0/1226030799 shutdown_connections 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f251814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 --2- 172.21.15.100:0/1226030799 >> v2:172.21.15.110:3300/0 conn(0x7f2518070a80 0x7f2518152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 --2- 172.21.15.100:0/1226030799 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f251806ed40 0x7f2518150ca0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 -- 172.21.15.100:0/1226030799 >> 172.21.15.100:0/1226030799 conn(0x7f251806a5e0 msgr2=0x7f251806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 -- 172.21.15.100:0/1226030799 shutdown_connections 2024-01-20T08:11:03.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.447+0000 7f251f800640 1 -- 172.21.15.100:0/1226030799 wait complete. 2024-01-20T08:11:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.449+0000 7f251f800640 1 Processor -- start 2024-01-20T08:11:03.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.449+0000 7f251f800640 1 -- start start 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251806ed40 0x7f25180bfd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f25180c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518147ec0 con 0x7f2518070a80 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2518148a40 con 0x7f251806ed40 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f251f800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2518148760 con 0x7f2518072070 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f2517e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f2517e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56196/0 (socket says 172.21.15.100:56196) 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.450+0000 7f2517e00640 1 -- 172.21.15.100:0/785543278 learned_addr learned my addr 172.21.15.100:0/785543278 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f251ce00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251806ed40 0x7f25180bfd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f251d800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f25180c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 -- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 msgr2=0x7f25180c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:03.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f25180c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 -- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251806ed40 msgr2=0x7f25180bfd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251806ed40 0x7f25180bfd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 -- 172.21.15.100:0/785543278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25080094d0 con 0x7f2518070a80 2024-01-20T08:11:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f251d800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f25180c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:03.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2517e00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f250000d800 tx=0x7f250000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000096a0 con 0x7f2518070a80 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500009800 con 0x7f2518070a80 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25181ee080 con 0x7f2518070a80 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.451+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2500009b90 con 0x7f2518070a80 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.452+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2518148110 con 0x7f2518070a80 2024-01-20T08:11:03.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.453+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2518067d50 con 0x7f2518070a80 2024-01-20T08:11:03.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.454+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2500009cf0 con 0x7f2518070a80 2024-01-20T08:11:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.456+0000 7f2514c00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.456+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f2500089fb0 con 0x7f2518070a80 2024-01-20T08:11:03.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.456+0000 7f251ce00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:03.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.457+0000 7f251ce00640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 0x7f24f006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2508036000 tx=0x7f250803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:03.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.460+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f25000550d0 con 0x7f2518070a80 2024-01-20T08:11:03.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:03.654+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f251814d3d0 con 0x7f2518070a80 2024-01-20T08:11:04.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.203+0000 7f2514c00640 1 -- 172.21.15.100:0/785543278 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f250000b440 con 0x7f2518070a80 2024-01-20T08:11:04.205 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-20T08:11:04.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.207+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 msgr2=0x7f24f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:04.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.207+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 0x7f24f006d3c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2508036000 tx=0x7f250803c040 comp rx=0 tx=0).stop 2024-01-20T08:11:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.207+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 msgr2=0x7f25180c21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:04.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.207+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f250000d800 tx=0x7f250000dcc0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 shutdown_connections 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f24f006af00 0x7f24f006d3c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2518072070 0x7f25180c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2518070a80 0x7f25180c21d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 --2- 172.21.15.100:0/785543278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f251806ed40 0x7f25180bfd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 >> 172.21.15.100:0/785543278 conn(0x7f251806a5e0 msgr2=0x7f251814abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 shutdown_connections 2024-01-20T08:11:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.209+0000 7f251f800640 1 -- 172.21.15.100:0/785543278 wait complete. 2024-01-20T08:11:04.250 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T08:11:04.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.424+0000 7f4ee7000640 1 Processor -- start 2024-01-20T08:11:04.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.425+0000 7f4ee7000640 1 -- start start 2024-01-20T08:11:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4ee014fdb0 0x7f4ee00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c1d90 0x7f4ee0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ee00c3460 0x7f4ee0153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00a9ce0 con 0x7f4ee00c3460 2024-01-20T08:11:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00a93b0 con 0x7f4ee014fdb0 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee0152790 con 0x7f4ee00c1d90 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ee00c3460 0x7f4ee0153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4ee00c3460 0x7f4ee0153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56202/0 (socket says 172.21.15.100:56202) 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.426+0000 7f4ee5000640 1 -- 172.21.15.100:0/2992931503 learned_addr learned my addr 172.21.15.100:0/2992931503 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ed7e00640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c1d90 0x7f4ee0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4edfe00640 1 --2- 172.21.15.100:0/2992931503 >> v2:172.21.15.110:3300/0 conn(0x7f4ee014fdb0 0x7f4ee00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ee5000640 1 -- 172.21.15.100:0/2992931503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c1d90 msgr2=0x7f4ee0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ee5000640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c1d90 0x7f4ee0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ee5000640 1 -- 172.21.15.100:0/2992931503 >> v2:172.21.15.110:3300/0 conn(0x7f4ee014fdb0 msgr2=0x7f4ee00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ee5000640 1 --2- 172.21.15.100:0/2992931503 >> v2:172.21.15.110:3300/0 conn(0x7f4ee014fdb0 0x7f4ee00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.427+0000 7f4ee5000640 1 -- 172.21.15.100:0/2992931503 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0150190 con 0x7f4ee00c3460 2024-01-20T08:11:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.428+0000 7f4ee5000640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c3460 0x7f4ee0153120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ee006e580 tx=0x7f4ed802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659d3147cfa985a4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.428+0000 7f4edf400640 1 -- 172.21.15.100:0/2992931503 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed802ca70 con 0x7f4ee00c3460 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.428+0000 7f4edf400640 1 -- 172.21.15.100:0/2992931503 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed802cbd0 con 0x7f4ee00c3460 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.428+0000 7f4edf400640 1 -- 172.21.15.100:0/2992931503 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80343f0 con 0x7f4ee00c3460 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 -- 172.21.15.100:0/2992931503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c3460 msgr2=0x7f4ee0153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c3460 0x7f4ee0153120 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4ee006e580 tx=0x7f4ed802bed0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 -- 172.21.15.100:0/2992931503 shutdown_connections 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c3460 0x7f4ee0153120 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 --2- 172.21.15.100:0/2992931503 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c1d90 0x7f4ee0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 --2- 172.21.15.100:0/2992931503 >> v2:172.21.15.110:3300/0 conn(0x7f4ee014fdb0 0x7f4ee00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 -- 172.21.15.100:0/2992931503 >> 172.21.15.100:0/2992931503 conn(0x7f4ee00c2940 msgr2=0x7f4ee00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 -- 172.21.15.100:0/2992931503 shutdown_connections 2024-01-20T08:11:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.429+0000 7f4ee7000640 1 -- 172.21.15.100:0/2992931503 wait complete. 2024-01-20T08:11:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.431+0000 7f4ee7000640 1 Processor -- start 2024-01-20T08:11:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.431+0000 7f4ee7000640 1 -- start start 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c3460 0x7f4ee014d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ee014fdb0 0x7f4ee014d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee014df20 con 0x7f4ee00c1d90 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee006dbe0 con 0x7f4ee014fdb0 2024-01-20T08:11:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee006cfd0 con 0x7f4ee00c3460 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56208/0 (socket says 172.21.15.100:56208) 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 -- 172.21.15.100:0/639735863 learned_addr learned my addr 172.21.15.100:0/639735863 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ed7e00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c3460 0x7f4ee014d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 -- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c3460 msgr2=0x7f4ee014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c3460 0x7f4ee014d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4edfe00640 1 -- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ee014fdb0 msgr2=0x7f4ee014d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.432+0000 7f4ee5000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ee014fdb0 0x7f4ee014d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edfe00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ee014fdb0 0x7f4ee014d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edfe00640 1 -- 172.21.15.100:0/639735863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed8009b30 con 0x7f4ee00c1d90 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edfe00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000d5f0 tx=0x7f4ed000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed00125f0 con 0x7f4ee00c1d90 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed0012750 con 0x7f4ee00c1d90 2024-01-20T08:11:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed0012b00 con 0x7f4ee00c1d90 2024-01-20T08:11:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee006d2b0 con 0x7f4ee00c1d90 2024-01-20T08:11:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.433+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee006d870 con 0x7f4ee00c1d90 2024-01-20T08:11:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.434+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee004e970 con 0x7f4ee00c1d90 2024-01-20T08:11:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.435+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4ed0012c60 con 0x7f4ee00c1d90 2024-01-20T08:11:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.436+0000 7f4edcc00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 0x7f4eb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.436+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4ed0089b80 con 0x7f4ee00c1d90 2024-01-20T08:11:04.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.437+0000 7f4ed7e00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 0x7f4eb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.437+0000 7f4ed7e00640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 0x7f4eb806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ee01e7a20 tx=0x7f4ec8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.441+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4ed0054a10 con 0x7f4ee00c1d90 2024-01-20T08:11:04.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:04.671+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4ee00c2260 con 0x7f4ee00c1d90 2024-01-20T08:11:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.245+0000 7f4edcc00640 1 -- 172.21.15.100:0/639735863 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4ed0058030 con 0x7f4ee00c1d90 2024-01-20T08:11:05.248 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 4 and data pool 5 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 msgr2=0x7f4eb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 0x7f4eb806d390 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ee01e7a20 tx=0x7f4ec8008040 comp rx=0 tx=0).stop 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 msgr2=0x7f4ee00bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000d5f0 tx=0x7f4ed000dab0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 shutdown_connections 2024-01-20T08:11:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4ee014fdb0 0x7f4ee014d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4eb806aed0 0x7f4eb806d390 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4ee01e7a20 tx=0x7f4ec8008040 comp rx=0 tx=0).stop 2024-01-20T08:11:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4ee00c3460 0x7f4ee014d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 --2- 172.21.15.100:0/639735863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4ee00c1d90 0x7f4ee00bf4e0 secure :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4ed000d5f0 tx=0x7f4ed000dab0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.253+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 >> 172.21.15.100:0/639735863 conn(0x7f4ee00c2940 msgr2=0x7f4ee0070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.255+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 shutdown_connections 2024-01-20T08:11:05.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.255+0000 7f4ee7000640 1 -- 172.21.15.100:0/639735863 wait complete. 2024-01-20T08:11:05.293 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:05.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.465+0000 7f598d200640 1 Processor -- start 2024-01-20T08:11:05.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.465+0000 7f598d200640 1 -- start start 2024-01-20T08:11:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.466+0000 7f598d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880bd5c0 0x7f59880720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.466+0000 7f598d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59880c7e30 0x7f5988154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.466+0000 7f598d200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5988158560 con 0x7f5988071d10 2024-01-20T08:11:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.466+0000 7f598d200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59880c5640 con 0x7f59880c7e30 2024-01-20T08:11:05.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.466+0000 7f598d200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59880c50a0 con 0x7f59880bd5c0 2024-01-20T08:11:05.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59880c7e30 0x7f5988154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f59880c7e30 0x7f5988154e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56214/0 (socket says 172.21.15.100:56214) 2024-01-20T08:11:05.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 -- 172.21.15.100:0/3703799669 learned_addr learned my addr 172.21.15.100:0/3703799669 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:05.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5986a00640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880bd5c0 0x7f59880720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 -- 172.21.15.100:0/3703799669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880bd5c0 msgr2=0x7f59880720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880bd5c0 0x7f59880720f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 -- 172.21.15.100:0/3703799669 >> v1:172.21.15.100:6789/0 conn(0x7f5988071d10 legacy=0x7f5988154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.467+0000 7f5987e00640 1 -- 172.21.15.100:0/3703799669 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f598806cb90 con 0x7f59880c7e30 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.468+0000 7f5987e00640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59880c7e30 0x7f5988154e30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5980009870 tx=0x7f598002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7d5bebec4925c7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f5986000640 1 -- 172.21.15.100:0/3703799669 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59800317c0 con 0x7f59880c7e30 2024-01-20T08:11:05.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f5986000640 1 -- 172.21.15.100:0/3703799669 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5980031920 con 0x7f59880c7e30 2024-01-20T08:11:05.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f5986000640 1 -- 172.21.15.100:0/3703799669 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5980031cb0 con 0x7f59880c7e30 2024-01-20T08:11:05.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 -- 172.21.15.100:0/3703799669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59880c7e30 msgr2=0x7f5988154e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59880c7e30 0x7f5988154e30 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f5980009870 tx=0x7f598002b860 comp rx=0 tx=0).stop 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 -- 172.21.15.100:0/3703799669 shutdown_connections 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59880c7e30 0x7f5988154e30 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 --2- 172.21.15.100:0/3703799669 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880bd5c0 0x7f59880720f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 -- 172.21.15.100:0/3703799669 >> 172.21.15.100:0/3703799669 conn(0x7f59880c9f30 msgr2=0x7f59880ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 -- 172.21.15.100:0/3703799669 shutdown_connections 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.469+0000 7f598d200640 1 -- 172.21.15.100:0/3703799669 wait complete. 2024-01-20T08:11:05.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.471+0000 7f598d200640 1 Processor -- start 2024-01-20T08:11:05.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.471+0000 7f598d200640 1 -- start start 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59880bd5c0 0x7f59881e02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 0x7f59881ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f598814dba0 con 0x7f5988071d10 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59881ea580 con 0x7f59880bd5c0 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f598d200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59881de400 con 0x7f59880c7e30 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f5987400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f5987400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56216/0 (socket says 172.21.15.100:56216) 2024-01-20T08:11:05.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.472+0000 7f5987400640 1 -- 172.21.15.100:0/4238674144 learned_addr learned my addr 172.21.15.100:0/4238674144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987e00640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 0x7f59881ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 -- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 msgr2=0x7f59881ea9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 0x7f59881ea9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5986a00640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59880bd5c0 0x7f59881e02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 -- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59880bd5c0 msgr2=0x7f59881e02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59880bd5c0 0x7f59881e02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 -- 172.21.15.100:0/4238674144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59800094d0 con 0x7f5988071d10 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987e00640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 0x7f59881ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f5987400640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f597800c7c0 tx=0x7f597800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978006d50 con 0x7f5988071d10 2024-01-20T08:11:05.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5978003970 con 0x7f5988071d10 2024-01-20T08:11:05.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5978003d20 con 0x7f5988071d10 2024-01-20T08:11:05.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.473+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f598814e030 con 0x7f5988071d10 2024-01-20T08:11:05.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.474+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59881de930 con 0x7f5988071d10 2024-01-20T08:11:05.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.475+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59880749e0 con 0x7f5988071d10 2024-01-20T08:11:05.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.476+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f597800a850 con 0x7f5988071d10 2024-01-20T08:11:05.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.476+0000 7f597f400640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 0x7f596006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.477+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5978089260 con 0x7f5988071d10 2024-01-20T08:11:05.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.477+0000 7f5986a00640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 0x7f596006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.477+0000 7f5986a00640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 0x7f596006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5970006fd0 tx=0x7f5970008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.481+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f59780541c0 con 0x7f5988071d10 2024-01-20T08:11:05.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.672+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f59881ea7f0 con 0x7f5988071d10 2024-01-20T08:11:05.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.674+0000 7f597f400640 1 -- 172.21.15.100:0/4238674144 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f59780577e0 con 0x7f5988071d10 2024-01-20T08:11:05.677 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:05.677 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":33,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:04.673243+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.676+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 msgr2=0x7f596006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.676+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 0x7f596006d390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5970006fd0 tx=0x7f5970008040 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.676+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 msgr2=0x7f5988155e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.676+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f597800c7c0 tx=0x7f597800cc80 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 shutdown_connections 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f596006aed0 0x7f596006d390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59880c7e30 0x7f59881ea9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59880bd5c0 0x7f59881e02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 --2- 172.21.15.100:0/4238674144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5988071d10 0x7f5988155e00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 >> 172.21.15.100:0/4238674144 conn(0x7f59880c9f30 msgr2=0x7f59880ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 shutdown_connections 2024-01-20T08:11:05.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.677+0000 7f598d200640 1 -- 172.21.15.100:0/4238674144 wait complete. 2024-01-20T08:11:05.696 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:05.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.890+0000 7f5833600640 1 Processor -- start 2024-01-20T08:11:05.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.891+0000 7f5833600640 1 -- start start 2024-01-20T08:11:05.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5833600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f582c0709e0 0x7f582c0c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5833600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f582c157df0 0x7f582c158200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5833600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f582c0c2970 con 0x7f582c0c2e00 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5833600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0c1fc0 con 0x7f582c0709e0 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5833600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f582c0c5f70 con 0x7f582c157df0 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5830c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f582c0709e0 0x7f582c0c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5830c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f582c0709e0 0x7f582c0c17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56232/0 (socket says 172.21.15.100:56232) 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.892+0000 7f5830c00640 1 -- 172.21.15.100:0/2163292958 learned_addr learned my addr 172.21.15.100:0/2163292958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.893+0000 7f5831600640 1 --2- 172.21.15.100:0/2163292958 >> v2:172.21.15.110:3300/0 conn(0x7f582c157df0 0x7f582c158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.893+0000 7f5830c00640 1 -- 172.21.15.100:0/2163292958 >> v2:172.21.15.110:3300/0 conn(0x7f582c157df0 msgr2=0x7f582c158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.893+0000 7f5830c00640 1 --2- 172.21.15.100:0/2163292958 >> v2:172.21.15.110:3300/0 conn(0x7f582c157df0 0x7f582c158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.893+0000 7f5830c00640 1 -- 172.21.15.100:0/2163292958 >> v1:172.21.15.110:6789/0 conn(0x7f582c0c2e00 legacy=0x7f582c0c3290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:05.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.893+0000 7f5830c00640 1 -- 172.21.15.100:0/2163292958 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c0c1d20 con 0x7f582c0709e0 2024-01-20T08:11:05.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.894+0000 7f5830c00640 1 --2- 172.21.15.100:0/2163292958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0709e0 0x7f582c0c17e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c5a30 tx=0x7f581c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afa127043b94358 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.894+0000 7f582be00640 1 -- 172.21.15.100:0/2163292958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c031870 con 0x7f582c0709e0 2024-01-20T08:11:05.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.894+0000 7f582be00640 1 -- 172.21.15.100:0/2163292958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f581c0319d0 con 0x7f582c0709e0 2024-01-20T08:11:05.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.894+0000 7f582be00640 1 -- 172.21.15.100:0/2163292958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581c031d60 con 0x7f582c0709e0 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 -- 172.21.15.100:0/2163292958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0709e0 msgr2=0x7f582c0c17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 --2- 172.21.15.100:0/2163292958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0709e0 0x7f582c0c17e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f582c0c5a30 tx=0x7f581c02b910 comp rx=0 tx=0).stop 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 -- 172.21.15.100:0/2163292958 shutdown_connections 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 --2- 172.21.15.100:0/2163292958 >> v2:172.21.15.110:3300/0 conn(0x7f582c157df0 0x7f582c158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 --2- 172.21.15.100:0/2163292958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0709e0 0x7f582c0c17e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 -- 172.21.15.100:0/2163292958 >> 172.21.15.100:0/2163292958 conn(0x7f582c06e770 msgr2=0x7f582c066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 -- 172.21.15.100:0/2163292958 shutdown_connections 2024-01-20T08:11:05.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.895+0000 7f5833600640 1 -- 172.21.15.100:0/2163292958 wait complete. 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.897+0000 7f5833600640 1 Processor -- start 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.897+0000 7f5833600640 1 -- start start 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f582c0709e0 0x7f582c1ee060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f582c157df0 0x7f582c1dedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1ee8a0 con 0x7f582c0c2e00 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1eeb40 con 0x7f582c0709e0 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5833600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c1e07a0 con 0x7f582c157df0 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56244/0 (socket says 172.21.15.100:56244) 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 -- 172.21.15.100:0/424679178 learned_addr learned my addr 172.21.15.100:0/424679178 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 -- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f582c157df0 msgr2=0x7f582c1dedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5831600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f582c157df0 0x7f582c1dedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5830c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f582c0709e0 0x7f582c1ee060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f582c157df0 0x7f582c1dedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 -- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f582c0709e0 msgr2=0x7f582c1ee060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f582c0709e0 0x7f582c1ee060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.898+0000 7f5823c00640 1 -- 172.21.15.100:0/424679178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f581c0094d0 con 0x7f582c0c2e00 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5823c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f581400c7a0 tx=0x7f581400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814003d80 con 0x7f582c0c2e00 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5814005070 con 0x7f582c0c2e00 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5814005460 con 0x7f582c0c2e00 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c0ad2b0 con 0x7f582c0c2e00 2024-01-20T08:11:05.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.899+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c0acef0 con 0x7f582c0c2e00 2024-01-20T08:11:05.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.900+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0c67e0 con 0x7f582c0c2e00 2024-01-20T08:11:05.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.901+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f58140055c0 con 0x7f582c0c2e00 2024-01-20T08:11:05.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.902+0000 7f5829600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 0x7f580406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:05.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.902+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5814088ee0 con 0x7f582c0c2e00 2024-01-20T08:11:05.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.902+0000 7f5830c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 0x7f580406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:05.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.903+0000 7f5830c00640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 0x7f580406d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f581c036000 tx=0x7f581c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:05.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:05.907+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5814053e40 con 0x7f582c0c2e00 2024-01-20T08:11:05.982 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:11:05.990 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:11:06.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.093+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f582c04e970 con 0x7f582c0c2e00 2024-01-20T08:11:06.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.095+0000 7f5829600640 1 -- 172.21.15.100:0/424679178 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16559 (secure 0 0 0) 0x7f5814017070 con 0x7f582c0c2e00 2024-01-20T08:11:06.098 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:06.098 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":33,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:04.673243+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 msgr2=0x7f580406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 0x7f580406d390 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f581c036000 tx=0x7f581c03c040 comp rx=0 tx=0).stop 2024-01-20T08:11:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 msgr2=0x7f582c1de870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:06.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f581400c7a0 tx=0x7f581400cc60 comp rx=0 tx=0).stop 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 shutdown_connections 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f580406aed0 0x7f580406d390 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f582c157df0 0x7f582c1dedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f582c0c2e00 0x7f582c1de870 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 --2- 172.21.15.100:0/424679178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f582c0709e0 0x7f582c1ee060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 >> 172.21.15.100:0/424679178 conn(0x7f582c06e770 msgr2=0x7f582c14cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 shutdown_connections 2024-01-20T08:11:06.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.097+0000 7f5833600640 1 -- 172.21.15.100:0/424679178 wait complete. 2024-01-20T08:11:06.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T08:11:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.360+0000 7f47a6400640 1 Processor -- start 2024-01-20T08:11:06.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.360+0000 7f47a6400640 1 -- start start 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f47a6400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47a00c3460 0x7f47a0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f47a6400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f47a0153120 0x7f47a015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f47a6400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a0150190 con 0x7f47a014fdb0 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f47a6400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00a9ce0 con 0x7f47a00c3460 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f47a6400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a00a93b0 con 0x7f47a0153120 2024-01-20T08:11:06.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47a00c3460 0x7f47a0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47a00c3460 0x7f47a0152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56260/0 (socket says 172.21.15.100:56260) 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 -- 172.21.15.100:0/4154811397 learned_addr learned my addr 172.21.15.100:0/4154811397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479fe00640 1 --2- 172.21.15.100:0/4154811397 >> v2:172.21.15.110:3300/0 conn(0x7f47a0153120 0x7f47a015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 -- 172.21.15.100:0/4154811397 >> v2:172.21.15.110:3300/0 conn(0x7f47a0153120 msgr2=0x7f47a015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 --2- 172.21.15.100:0/4154811397 >> v2:172.21.15.110:3300/0 conn(0x7f47a0153120 0x7f47a015cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 -- 172.21.15.100:0/4154811397 >> v1:172.21.15.110:6789/0 conn(0x7f47a014fdb0 legacy=0x7f47a00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:06.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.362+0000 7f479ea00640 1 -- 172.21.15.100:0/4154811397 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a01535b0 con 0x7f47a00c3460 2024-01-20T08:11:06.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.363+0000 7f479ea00640 1 --2- 172.21.15.100:0/4154811397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a00c3460 0x7f47a0152be0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f47a006bdd0 tx=0x7f478802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45e7e757e0a7b43 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:06.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f479e000640 1 -- 172.21.15.100:0/4154811397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788030860 con 0x7f47a00c3460 2024-01-20T08:11:06.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f479e000640 1 -- 172.21.15.100:0/4154811397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47880309c0 con 0x7f47a00c3460 2024-01-20T08:11:06.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f479e000640 1 -- 172.21.15.100:0/4154811397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788030d50 con 0x7f47a00c3460 2024-01-20T08:11:06.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 -- 172.21.15.100:0/4154811397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a00c3460 msgr2=0x7f47a0152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 --2- 172.21.15.100:0/4154811397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a00c3460 0x7f47a0152be0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f47a006bdd0 tx=0x7f478802b9a0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 -- 172.21.15.100:0/4154811397 shutdown_connections 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 --2- 172.21.15.100:0/4154811397 >> v2:172.21.15.110:3300/0 conn(0x7f47a0153120 0x7f47a015cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 --2- 172.21.15.100:0/4154811397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a00c3460 0x7f47a0152be0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 -- 172.21.15.100:0/4154811397 >> 172.21.15.100:0/4154811397 conn(0x7f47a00c2940 msgr2=0x7f47a00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.364+0000 7f47a6400640 1 -- 172.21.15.100:0/4154811397 shutdown_connections 2024-01-20T08:11:06.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.365+0000 7f47a6400640 1 -- 172.21.15.100:0/4154811397 wait complete. 2024-01-20T08:11:06.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.366+0000 7f47a6400640 1 Processor -- start 2024-01-20T08:11:06.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.366+0000 7f47a6400640 1 -- start start 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a00c3460 0x7f47a00c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a0153120 0x7f47a0141410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a014c630 con 0x7f47a014fdb0 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a0156bc0 con 0x7f47a0153120 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f47a6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a01516e0 con 0x7f47a00c3460 2024-01-20T08:11:06.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f479ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f479ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56266/0 (socket says 172.21.15.100:56266) 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.367+0000 7f479ea00640 1 -- 172.21.15.100:0/2052352872 learned_addr learned my addr 172.21.15.100:0/2052352872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479fe00640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a0153120 0x7f47a0141410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479f400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a00c3460 0x7f47a00c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 -- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a00c3460 msgr2=0x7f47a00c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a00c3460 0x7f47a00c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 -- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a0153120 msgr2=0x7f47a0141410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a0153120 0x7f47a0141410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 -- 172.21.15.100:0/2052352872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47880094d0 con 0x7f47a014fdb0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f479ea00640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4788000c00 tx=0x7f4788004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788039d60 con 0x7f47a014fdb0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788043400 con 0x7f47a014fdb0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880437b0 con 0x7f47a014fdb0 2024-01-20T08:11:06.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.368+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a0151120 con 0x7f47a014fdb0 2024-01-20T08:11:06.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.369+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a01eb510 con 0x7f47a014fdb0 2024-01-20T08:11:06.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.370+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a004e970 con 0x7f47a014fdb0 2024-01-20T08:11:06.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.371+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4788043910 con 0x7f47a014fdb0 2024-01-20T08:11:06.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.371+0000 7f4797400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 0x7f477806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:06.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.371+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f478803e070 con 0x7f47a014fdb0 2024-01-20T08:11:06.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.372+0000 7f479f400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 0x7f477806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:06.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.372+0000 7f479f400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 0x7f477806d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4790000f60 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:06.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.376+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4788077770 con 0x7f47a014fdb0 2024-01-20T08:11:06.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:06.589+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f47a00c2260 con 0x7f47a014fdb0 2024-01-20T08:11:06.781 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-01-20T08:11:06.778+0000 7f760f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:11:07.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.264+0000 7f4797400640 1 -- 172.21.15.100:0/2052352872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f478807ad90 con 0x7f47a014fdb0 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 msgr2=0x7f477806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 0x7f477806d390 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4790000f60 tx=0x7f4790009040 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 msgr2=0x7f47a0152140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4788000c00 tx=0x7f4788004730 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 shutdown_connections 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a0153120 0x7f47a0141410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47a014fdb0 0x7f47a0152140 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f477806aed0 0x7f477806d390 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 --2- 172.21.15.100:0/2052352872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a00c3460 0x7f47a00c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 >> 172.21.15.100:0/2052352872 conn(0x7f47a00c2940 msgr2=0x7f47a00c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:07.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 shutdown_connections 2024-01-20T08:11:07.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.268+0000 7f47a6400640 1 -- 172.21.15.100:0/2052352872 wait complete. 2024-01-20T08:11:07.292 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:11:07.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T08:11:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.499+0000 7f2af1400640 1 Processor -- start 2024-01-20T08:11:07.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.500+0000 7f2af1400640 1 -- start start 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.501+0000 7f2af1400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2aec0c3460 0x7f2aec152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.501+0000 7f2af1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2aec153120 0x7f2aec15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.501+0000 7f2af1400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec150190 con 0x7f2aec14fdb0 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.501+0000 7f2af1400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0a9ce0 con 0x7f2aec153120 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.501+0000 7f2af1400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec0a93b0 con 0x7f2aec0c3460 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2aec153120 0x7f2aec15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2aec153120 0x7f2aec15cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56276/0 (socket says 172.21.15.100:56276) 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 -- 172.21.15.100:0/482141654 learned_addr learned my addr 172.21.15.100:0/482141654 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2ae1c00640 1 --2- 172.21.15.100:0/482141654 >> v2:172.21.15.110:3300/0 conn(0x7f2aec0c3460 0x7f2aec152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 -- 172.21.15.100:0/482141654 >> v2:172.21.15.110:3300/0 conn(0x7f2aec0c3460 msgr2=0x7f2aec152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 --2- 172.21.15.100:0/482141654 >> v2:172.21.15.110:3300/0 conn(0x7f2aec0c3460 0x7f2aec152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 -- 172.21.15.100:0/482141654 >> v1:172.21.15.110:6789/0 conn(0x7f2aec14fdb0 legacy=0x7f2aec0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.502+0000 7f2aeb200640 1 -- 172.21.15.100:0/482141654 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec1535b0 con 0x7f2aec153120 2024-01-20T08:11:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.503+0000 7f2aeb200640 1 --2- 172.21.15.100:0/482141654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec153120 0x7f2aec15cfc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06be40 tx=0x7f2ae402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc7116caf762fae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.503+0000 7f2ae9e00640 1 -- 172.21.15.100:0/482141654 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae402ca80 con 0x7f2aec153120 2024-01-20T08:11:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.503+0000 7f2ae9e00640 1 -- 172.21.15.100:0/482141654 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae402cbe0 con 0x7f2aec153120 2024-01-20T08:11:07.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.503+0000 7f2ae9e00640 1 -- 172.21.15.100:0/482141654 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae40343f0 con 0x7f2aec153120 2024-01-20T08:11:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 -- 172.21.15.100:0/482141654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec153120 msgr2=0x7f2aec15cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 --2- 172.21.15.100:0/482141654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec153120 0x7f2aec15cfc0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2aec06be40 tx=0x7f2ae402bee0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 -- 172.21.15.100:0/482141654 shutdown_connections 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 --2- 172.21.15.100:0/482141654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec153120 0x7f2aec15cfc0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 --2- 172.21.15.100:0/482141654 >> v2:172.21.15.110:3300/0 conn(0x7f2aec0c3460 0x7f2aec152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 -- 172.21.15.100:0/482141654 >> 172.21.15.100:0/482141654 conn(0x7f2aec0c2940 msgr2=0x7f2aec0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 -- 172.21.15.100:0/482141654 shutdown_connections 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.504+0000 7f2af1400640 1 -- 172.21.15.100:0/482141654 wait complete. 2024-01-20T08:11:07.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.506+0000 7f2af1400640 1 Processor -- start 2024-01-20T08:11:07.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.506+0000 7f2af1400640 1 -- start start 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 0x7f2aec140960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aec153120 0x7f2aec13e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec152010 con 0x7f2aec0c3460 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0c4b90 con 0x7f2aec14fdb0 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2af1400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec153b20 con 0x7f2aec153120 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2aea800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2aea800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56290/0 (socket says 172.21.15.100:56290) 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2aea800640 1 -- 172.21.15.100:0/2702099241 learned_addr learned my addr 172.21.15.100:0/2702099241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.507+0000 7f2ae1c00640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 0x7f2aec140960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 -- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aec153120 msgr2=0x7f2aec13e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aeb200640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aec153120 0x7f2aec13e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aec153120 0x7f2aec13e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 -- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 msgr2=0x7f2aec140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 0x7f2aec140960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 -- 172.21.15.100:0/2702099241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009b30 con 0x7f2aec0c3460 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2ae1c00640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 0x7f2aec140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2aea800640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c430 tx=0x7f2adc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc011790 con 0x7f2aec0c3460 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc0118f0 con 0x7f2aec0c3460 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec0c57b0 con 0x7f2aec0c3460 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc011ce0 con 0x7f2aec0c3460 2024-01-20T08:11:07.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.508+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec152220 con 0x7f2aec0c3460 2024-01-20T08:11:07.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.509+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0c1740 con 0x7f2aec0c3460 2024-01-20T08:11:07.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.510+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2adc01c460 con 0x7f2aec0c3460 2024-01-20T08:11:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.511+0000 7f2ae3400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 0x7f2ac406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.511+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2adc089670 con 0x7f2aec0c3460 2024-01-20T08:11:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.511+0000 7f2ae1c00640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 0x7f2ac406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.512+0000 7f2ae1c00640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 0x7f2ac406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2aec072220 tx=0x7f2ad4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:07.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.515+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2adc054410 con 0x7f2aec0c3460 2024-01-20T08:11:07.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:07.746+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f2aec04e970 con 0x7f2aec0c3460 2024-01-20T08:11:08.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.278+0000 7f2ae3400640 1 -- 172.21.15.100:0/2702099241 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2adc057a30 con 0x7f2aec0c3460 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.281+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 msgr2=0x7f2ac406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.281+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 0x7f2ac406d3c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2aec072220 tx=0x7f2ad4008040 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.281+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 msgr2=0x7f2aec0c4650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.281+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f2adc00c430 tx=0x7f2adc00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 shutdown_connections 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ac406af00 0x7f2ac406d3c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2aec153120 0x7f2aec13e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2aec14fdb0 0x7f2aec140960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 --2- 172.21.15.100:0/2702099241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2aec0c3460 0x7f2aec0c4650 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 >> 172.21.15.100:0/2702099241 conn(0x7f2aec0c2940 msgr2=0x7f2aec0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 shutdown_connections 2024-01-20T08:11:08.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.282+0000 7f2af1400640 1 -- 172.21.15.100:0/2702099241 wait complete. 2024-01-20T08:11:08.307 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T08:11:08.308 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.519+0000 7fb1af600640 1 Processor -- start 2024-01-20T08:11:08.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.519+0000 7fb1af600640 1 -- start start 2024-01-20T08:11:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.520+0000 7fb1af600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb1a8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.520+0000 7fb1af600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb1a80aae00 0x7fb1a80ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.520+0000 7fb1af600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a80a9940 con 0x7fb1a814fce0 2024-01-20T08:11:08.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.520+0000 7fb1af600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1a81500c0 con 0x7fb1a80aae00 2024-01-20T08:11:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.520+0000 7fb1af600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8156810 con 0x7fb1a80a93c0 2024-01-20T08:11:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1acc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb1a814fce0 0x7fb1a8152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:56784/0 (socket says 172.21.15.100:56784) 2024-01-20T08:11:08.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1acc00640 1 -- 172.21.15.100:0/2612315365 learned_addr learned my addr 172.21.15.100:0/2612315365 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781120069 0 0) 0x7fb1a80a9940 con 0x7fb1a814fce0 2024-01-20T08:11:08.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1ad600640 1 --2- 172.21.15.100:0/2612315365 >> v2:172.21.15.110:3300/0 conn(0x7fb1a80aae00 0x7fb1a80ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb19fc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb1a8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb188003520 con 0x7fb1a814fce0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1804956740 0 0) 0x7fb188003520 con 0x7fb1a814fce0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 msgr2=0x7fb1a8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb1a8153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 >> v2:172.21.15.110:3300/0 conn(0x7fb1a80aae00 msgr2=0x7fb1a80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.521+0000 7fb1a7e00640 1 --2- 172.21.15.100:0/2612315365 >> v2:172.21.15.110:3300/0 conn(0x7fb1a80aae00 0x7fb1a80ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a8156af0 con 0x7fb1a814fce0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fb198001670 con 0x7fb1a814fce0 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 >> v1:172.21.15.100:6789/0 conn(0x7fb1a814fce0 legacy=0x7fb1a8152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb188003970 0x7fb188003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1880047c0 0x7fb188004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb188005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81500c0 con 0x7fb1880047c0 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a8156810 con 0x7fb188003970 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18800ba80 con 0x7fb1a80a93c0 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1ad600640 1 --2- 172.21.15.100:0/2612315365 >> v2:172.21.15.110:3300/0 conn(0x7fb1a80aae00 0x7fb1a80ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb19fc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1880047c0 0x7fb188004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1acc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb188003970 0x7fb188003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb1ad600640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb188005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb19fc00640 1 -- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 msgr2=0x7fb188005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb19fc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1a80a93c0 0x7fb188005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb19fc00640 1 -- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb188003970 msgr2=0x7fb188003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.522+0000 7fb19fc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb188003970 0x7fb188003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.523+0000 7fb19fc00640 1 -- 172.21.15.100:0/2612315365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb188003520 con 0x7fb1880047c0 2024-01-20T08:11:08.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.524+0000 7fb19fc00640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1880047c0 0x7fb188004c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb19000ba00 tx=0x7fb1880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba233b65d59a3d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:08.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.524+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190032620 con 0x7fb1880047c0 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.524+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb190032780 con 0x7fb1880047c0 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.524+0000 7fb1a7e00640 1 -- 172.21.15.100:0/2612315365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb190032b10 con 0x7fb1880047c0 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 -- 172.21.15.100:0/2612315365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1880047c0 msgr2=0x7fb188004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 --2- 172.21.15.100:0/2612315365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1880047c0 0x7fb188004c40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb19000ba00 tx=0x7fb1880057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1ad600640 1 -- 172.21.15.100:0/2612315365 reap_dead start 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 -- 172.21.15.100:0/2612315365 shutdown_connections 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 -- 172.21.15.100:0/2612315365 >> 172.21.15.100:0/2612315365 conn(0x7fb1a806a5e0 msgr2=0x7fb1a806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 -- 172.21.15.100:0/2612315365 shutdown_connections 2024-01-20T08:11:08.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.525+0000 7fb1af600640 1 -- 172.21.15.100:0/2612315365 wait complete. 2024-01-20T08:11:08.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.526+0000 7fb1af600640 1 Processor -- start 2024-01-20T08:11:08.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 -- start start 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 0x7fb1a81475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 0x7fb1a8149f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81ee5f0 con 0x7fb1a814a460 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a80c2d80 con 0x7fb1a8147ae0 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.527+0000 7fb1af600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a81ed970 con 0x7fb1880047c0 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56308/0 (socket says 172.21.15.100:56308) 2024-01-20T08:11:08.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 -- 172.21.15.100:0/1421872084 learned_addr learned my addr 172.21.15.100:0/1421872084 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:08.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb19fc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 0x7fb1a8149f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1acc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 0x7fb1a81475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 -- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 msgr2=0x7fb1a81475a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 0x7fb1a81475a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 -- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 msgr2=0x7fb1a8149f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 0x7fb1a8149f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1ad600640 1 -- 172.21.15.100:0/1421872084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a81edc50 con 0x7fb1a814a460 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb19fc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 0x7fb1a8149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.528+0000 7fb1acc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 0x7fb1a81475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1ad600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8072d80 tx=0x7fb1a0004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0007ce0 con 0x7fb1a814a460 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a0007e80 con 0x7fb1a814a460 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a0014640 con 0x7fb1a814a460 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a81edf30 con 0x7fb1a814a460 2024-01-20T08:11:08.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.529+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a814ac00 con 0x7fb1a814a460 2024-01-20T08:11:08.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.530+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a81ee730 con 0x7fb1a814a460 2024-01-20T08:11:08.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.531+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb1a00147a0 con 0x7fb1a814a460 2024-01-20T08:11:08.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.532+0000 7fb1a5600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 0x7fb18006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.532+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb1a0089310 con 0x7fb1a814a460 2024-01-20T08:11:08.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.532+0000 7fb1acc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 0x7fb18006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.533+0000 7fb1acc00640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 0x7fb18006d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb198000c00 tx=0x7fb198001430 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:08.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.536+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb1a81ee730 con 0x7fb1a814a460 2024-01-20T08:11:08.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.764+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1a81ee730 con 0x7fb1a814a460 2024-01-20T08:11:08.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.765+0000 7fb1a5600640 1 -- 172.21.15.100:0/1421872084 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb1a81ee730 con 0x7fb1a814a460 2024-01-20T08:11:08.771 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:08.771 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4669,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 msgr2=0x7fb18006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 0x7fb18006d3c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb198000c00 tx=0x7fb198001430 comp rx=0 tx=0).stop 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 msgr2=0x7fb1a8147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fb1a8072d80 tx=0x7fb1a0004840 comp rx=0 tx=0).stop 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 shutdown_connections 2024-01-20T08:11:08.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1a814a460 0x7fb1a8147fb0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1a8147ae0 0x7fb1a8149f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb18006af00 0x7fb18006d3c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 --2- 172.21.15.100:0/1421872084 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1880047c0 0x7fb1a81475a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 >> 172.21.15.100:0/1421872084 conn(0x7fb1a806a5e0 msgr2=0x7fb1a80c69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 shutdown_connections 2024-01-20T08:11:08.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.768+0000 7fb1af600640 1 -- 172.21.15.100:0/1421872084 wait complete. 2024-01-20T08:11:08.788 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.991+0000 7fd840e00640 1 Processor -- start 2024-01-20T08:11:08.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.991+0000 7fd840e00640 1 -- start start 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.993+0000 7fd840e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.993+0000 7fd840e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd83c1519a0 0x7fd83c151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.993+0000 7fd840e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd83c0c8650 con 0x7fd83c06b3b0 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.993+0000 7fd840e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd83c0c8070 con 0x7fd83c1519a0 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.993+0000 7fd840e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c0c4dd0 con 0x7fd83c155250 2024-01-20T08:11:08.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.994+0000 7fd839e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd83c06b3b0 0x7fd83c0c8ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57496/0 (socket says 172.21.15.100:57496) 2024-01-20T08:11:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.994+0000 7fd839e00640 1 -- 172.21.15.100:0/3049630866 learned_addr learned my addr 172.21.15.100:0/3049630866 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.994+0000 7fd839400640 1 --2- 172.21.15.100:0/3049630866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.994+0000 7fd83a800640 1 --2- 172.21.15.100:0/3049630866 >> v2:172.21.15.110:3300/0 conn(0x7fd83c1519a0 0x7fd83c151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:08.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.994+0000 7fd838a00640 1 -- 172.21.15.100:0/3049630866 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492164496 0 0) 0x7fd83c0c8650 con 0x7fd83c06b3b0 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.995+0000 7fd838a00640 1 -- 172.21.15.100:0/3049630866 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd81c003520 con 0x7fd83c06b3b0 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.995+0000 7fd839400640 1 -- 172.21.15.100:0/3049630866 >> v2:172.21.15.110:3300/0 conn(0x7fd83c1519a0 msgr2=0x7fd83c151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.995+0000 7fd839400640 1 --2- 172.21.15.100:0/3049630866 >> v2:172.21.15.110:3300/0 conn(0x7fd83c1519a0 0x7fd83c151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.995+0000 7fd839400640 1 -- 172.21.15.100:0/3049630866 >> v1:172.21.15.100:6789/0 conn(0x7fd83c06b3b0 legacy=0x7fd83c0c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.995+0000 7fd839400640 1 -- 172.21.15.100:0/3049630866 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c0c82e0 con 0x7fd83c155250 2024-01-20T08:11:08.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.996+0000 7fd839400640 1 --2- 172.21.15.100:0/3049630866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c155cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=efe337f59d5495aa server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.996+0000 7fd838a00640 1 -- 172.21.15.100:0/3049630866 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031780 con 0x7fd83c155250 2024-01-20T08:11:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd838a00640 1 -- 172.21.15.100:0/3049630866 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240318e0 con 0x7fd83c155250 2024-01-20T08:11:08.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd838a00640 1 -- 172.21.15.100:0/3049630866 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824031c70 con 0x7fd83c155250 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 -- 172.21.15.100:0/3049630866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 msgr2=0x7fd83c155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 --2- 172.21.15.100:0/3049630866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c155cc0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd8240097a0 tx=0x7fd82402b820 comp rx=0 tx=0).stop 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 -- 172.21.15.100:0/3049630866 shutdown_connections 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 --2- 172.21.15.100:0/3049630866 >> v2:172.21.15.110:3300/0 conn(0x7fd83c1519a0 0x7fd83c151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 --2- 172.21.15.100:0/3049630866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c155cc0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 -- 172.21.15.100:0/3049630866 >> 172.21.15.100:0/3049630866 conn(0x7fd83c0abc00 msgr2=0x7fd83c0ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:09.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 -- 172.21.15.100:0/3049630866 shutdown_connections 2024-01-20T08:11:09.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.997+0000 7fd840e00640 1 -- 172.21.15.100:0/3049630866 wait complete. 2024-01-20T08:11:09.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.999+0000 7fd840e00640 1 Processor -- start 2024-01-20T08:11:09.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:08.999+0000 7fd840e00640 1 -- start start 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c06b3b0 0x7fd83c157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c14beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c14daa0 con 0x7fd83c1519a0 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c158680 con 0x7fd83c06b3b0 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.000+0000 7fd840e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c156e50 con 0x7fd83c155250 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60926/0 (socket says 172.21.15.100:60926) 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 -- 172.21.15.100:0/3797158389 learned_addr learned my addr 172.21.15.100:0/3797158389 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c06b3b0 0x7fd83c157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd83a800640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c14beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 -- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 msgr2=0x7fd83c14beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c14beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 -- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c06b3b0 msgr2=0x7fd83c157910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c06b3b0 0x7fd83c157910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd839400640 1 -- 172.21.15.100:0/3797158389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd824009400 con 0x7fd83c1519a0 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.001+0000 7fd83a800640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c14beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:09.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd839400640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd8240098c0 tx=0x7fd8240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824032820 con 0x7fd83c1519a0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8240329a0 con 0x7fd83c1519a0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd83c157380 con 0x7fd83c1519a0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd824032d50 con 0x7fd83c1519a0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.002+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd83c1570a0 con 0x7fd83c1519a0 2024-01-20T08:11:09.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.003+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd83c04e970 con 0x7fd83c1519a0 2024-01-20T08:11:09.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.004+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd82404e450 con 0x7fd83c1519a0 2024-01-20T08:11:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.005+0000 7fd832000640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 0x7fd81406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.005+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8240ab620 con 0x7fd83c1519a0 2024-01-20T08:11:09.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.006+0000 7fd839e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 0x7fd81406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.006+0000 7fd839e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 0x7fd81406d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005880 tx=0x7fd82c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.010+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd824076590 con 0x7fd83c1519a0 2024-01-20T08:11:09.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.201+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd83c157670 con 0x7fd83c1519a0 2024-01-20T08:11:09.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.204+0000 7fd832000640 1 -- 172.21.15.100:0/3797158389 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16546 (secure 0 0 0) 0x7fd824079bb0 con 0x7fd83c1519a0 2024-01-20T08:11:09.208 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:09.208 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:06.246580+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 msgr2=0x7fd81406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 0x7fd81406d390 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd82c005880 tx=0x7fd82c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 msgr2=0x7fd83c0c6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd8240098c0 tx=0x7fd8240046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 shutdown_connections 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd81406aed0 0x7fd81406d390 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd83c155250 0x7fd83c14beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd83c1519a0 0x7fd83c0c6a90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 --2- 172.21.15.100:0/3797158389 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd83c06b3b0 0x7fd83c157910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.207+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 >> 172.21.15.100:0/3797158389 conn(0x7fd83c0abc00 msgr2=0x7fd83c152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.208+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 shutdown_connections 2024-01-20T08:11:09.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.208+0000 7fd840e00640 1 -- 172.21.15.100:0/3797158389 wait complete. 2024-01-20T08:11:09.230 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:11:09.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:11:09.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.438+0000 7fa1de400640 1 Processor -- start 2024-01-20T08:11:09.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.439+0000 7fa1de400640 1 -- start start 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1de400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa1d814fce0 0x7fa1d8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1de400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 0x7fa1d80ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1de400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1d80a9940 con 0x7fa1d80a93c0 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1de400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1d81500c0 con 0x7fa1d814fce0 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1de400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d8156810 con 0x7fa1d80aae00 2024-01-20T08:11:09.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1d7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa1d814fce0 0x7fa1d8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1d7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa1d814fce0 0x7fa1d8153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60930/0 (socket says 172.21.15.100:60930) 2024-01-20T08:11:09.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.440+0000 7fa1d7400640 1 -- 172.21.15.100:0/3943875357 learned_addr learned my addr 172.21.15.100:0/3943875357 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7400640 1 -- 172.21.15.100:0/3943875357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 msgr2=0x7fa1d80ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7e00640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 0x7fa1d80ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7400640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 0x7fa1d80ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7400640 1 -- 172.21.15.100:0/3943875357 >> v1:172.21.15.110:6789/0 conn(0x7fa1d80a93c0 legacy=0x7fa1d8152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7400640 1 -- 172.21.15.100:0/3943875357 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1d8156af0 con 0x7fa1d814fce0 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.441+0000 7fa1d7e00640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 0x7fa1d80ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:09.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.442+0000 7fa1d7400640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d814fce0 0x7fa1d8153b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e50 tx=0x7fa1c802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e553d92f326391f4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.442+0000 7fa1d6a00640 1 -- 172.21.15.100:0/3943875357 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c802ca70 con 0x7fa1d814fce0 2024-01-20T08:11:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.442+0000 7fa1d6a00640 1 -- 172.21.15.100:0/3943875357 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c802cbd0 con 0x7fa1d814fce0 2024-01-20T08:11:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.442+0000 7fa1d6a00640 1 -- 172.21.15.100:0/3943875357 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c80343f0 con 0x7fa1d814fce0 2024-01-20T08:11:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 -- 172.21.15.100:0/3943875357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d814fce0 msgr2=0x7fa1d8153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d814fce0 0x7fa1d8153b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e50 tx=0x7fa1c802bed0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 -- 172.21.15.100:0/3943875357 shutdown_connections 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d80aae00 0x7fa1d80ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 --2- 172.21.15.100:0/3943875357 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d814fce0 0x7fa1d8153b80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 -- 172.21.15.100:0/3943875357 >> 172.21.15.100:0/3943875357 conn(0x7fa1d806a5e0 msgr2=0x7fa1d806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 -- 172.21.15.100:0/3943875357 shutdown_connections 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.443+0000 7fa1de400640 1 -- 172.21.15.100:0/3943875357 wait complete. 2024-01-20T08:11:09.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.445+0000 7fa1de400640 1 Processor -- start 2024-01-20T08:11:09.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.445+0000 7fa1de400640 1 -- start start 2024-01-20T08:11:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 0x7fa1d81ec120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d814fce0 0x7fa1d8140860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80be4b0 con 0x7fa1d80a93c0 2024-01-20T08:11:09.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80c2cd0 con 0x7fa1d80aae00 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1de400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d80c5a40 con 0x7fa1d814fce0 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60940/0 (socket says 172.21.15.100:60940) 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.446+0000 7fa1d7400640 1 -- 172.21.15.100:0/1146325571 learned_addr learned my addr 172.21.15.100:0/1146325571 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7e00640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d814fce0 0x7fa1d8140860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 -- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d814fce0 msgr2=0x7fa1d8140860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1ce800640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 0x7fa1d81ec120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d814fce0 0x7fa1d8140860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 -- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 msgr2=0x7fa1d81ec120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 0x7fa1d81ec120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 -- 172.21.15.100:0/1146325571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c8009b30 con 0x7fa1d80a93c0 2024-01-20T08:11:09.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1ce800640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 0x7fa1d81ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1d7400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e50 tx=0x7fa1c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c803e450 con 0x7fa1d80a93c0 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c803e5f0 con 0x7fa1d80a93c0 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c803e9a0 con 0x7fa1d80a93c0 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d81ebc90 con 0x7fa1d80a93c0 2024-01-20T08:11:09.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.447+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d81eb920 con 0x7fa1d80a93c0 2024-01-20T08:11:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.448+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d81ebab0 con 0x7fa1d80a93c0 2024-01-20T08:11:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.449+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa1c803eb00 con 0x7fa1d80a93c0 2024-01-20T08:11:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.450+0000 7fa1cfe00640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 0x7fa1b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.450+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1c80ac690 con 0x7fa1d80a93c0 2024-01-20T08:11:09.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.451+0000 7fa1ce800640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 0x7fa1b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.451+0000 7fa1ce800640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 0x7fa1b006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ac720 tx=0x7fa1c0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.455+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa1d81ebab0 con 0x7fa1d80a93c0 2024-01-20T08:11:09.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.647+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1d8152470 con 0x7fa1b006aed0 2024-01-20T08:11:09.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.671+0000 7fa1cfe00640 1 -- 172.21.15.100:0/1146325571 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286518 (secure 0 0 0) 0x7fa1d8152470 con 0x7fa1b006aed0 2024-01-20T08:11:09.678 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:09.680 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 msgr2=0x7fa1b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 0x7fa1b006d390 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1d80ac720 tx=0x7fa1c0008040 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 msgr2=0x7fa1d80bb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009e50 tx=0x7fa1c8004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 shutdown_connections 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.677+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa1b006aed0 0x7fa1b006d390 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.678+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa1d814fce0 0x7fa1d8140860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.678+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa1d80aae00 0x7fa1d81ec120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.678+0000 7fa1de400640 1 --2- 172.21.15.100:0/1146325571 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1d80a93c0 0x7fa1d80bb1c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.678+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 >> 172.21.15.100:0/1146325571 conn(0x7fa1d806a5e0 msgr2=0x7fa1d814e330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:09.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.679+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 shutdown_connections 2024-01-20T08:11:09.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.679+0000 7fa1de400640 1 -- 172.21.15.100:0/1146325571 wait complete. 2024-01-20T08:11:09.703 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-01-20T08:11:07.902675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236928,"kb_used_data":4108,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737792,"statfs":{"total":773094113280,"available":772851499008,"internally_reserved":0,"allocated":4206592,"data_stored":2323099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.703172"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278142+0000","last_change":"2024-01-20T08:11:05.275929+0000","last_active":"2024-01-20T08:11:05.278142+0000","last_peered":"2024-01-20T08:11:05.278142+0000","last_clean":"2024-01-20T08:11:05.278142+0000","last_became_active":"2024-01-20T08:11:05.275558+0000","last_became_peered":"2024-01-20T08:11:05.275558+0000","last_unstale":"2024-01-20T08:11:05.278142+0000","last_undegraded":"2024-01-20T08:11:05.278142+0000","last_fullsized":"2024-01-20T08:11:05.278142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275023+0000","last_change":"2024-01-20T08:11:05.268340+0000","last_active":"2024-01-20T08:11:05.275023+0000","last_peered":"2024-01-20T08:11:05.275023+0000","last_clean":"2024-01-20T08:11:05.275023+0000","last_became_active":"2024-01-20T08:11:05.268008+0000","last_became_peered":"2024-01-20T08:11:05.268008+0000","last_unstale":"2024-01-20T08:11:05.275023+0000","last_undegraded":"2024-01-20T08:11:05.275023+0000","last_fullsized":"2024-01-20T08:11:05.275023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274753+0000","last_change":"2024-01-20T08:11:05.263675+0000","last_active":"2024-01-20T08:11:05.274753+0000","last_peered":"2024-01-20T08:11:05.274753+0000","last_clean":"2024-01-20T08:11:05.274753+0000","last_became_active":"2024-01-20T08:11:05.262876+0000","last_became_peered":"2024-01-20T08:11:05.262876+0000","last_unstale":"2024-01-20T08:11:05.274753+0000","last_undegraded":"2024-01-20T08:11:05.274753+0000","last_fullsized":"2024-01-20T08:11:05.274753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283627+0000","last_change":"2024-01-20T08:11:05.276439+0000","last_active":"2024-01-20T08:11:05.283627+0000","last_peered":"2024-01-20T08:11:05.283627+0000","last_clean":"2024-01-20T08:11:05.283627+0000","last_became_active":"2024-01-20T08:11:05.273677+0000","last_became_peered":"2024-01-20T08:11:05.273677+0000","last_unstale":"2024-01-20T08:11:05.283627+0000","last_undegraded":"2024-01-20T08:11:05.283627+0000","last_fullsized":"2024-01-20T08:11:05.283627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271402+0000","last_change":"2024-01-20T08:11:05.263742+0000","last_active":"2024-01-20T08:11:05.271402+0000","last_peered":"2024-01-20T08:11:05.271402+0000","last_clean":"2024-01-20T08:11:05.271402+0000","last_became_active":"2024-01-20T08:11:05.263437+0000","last_became_peered":"2024-01-20T08:11:05.263437+0000","last_unstale":"2024-01-20T08:11:05.271402+0000","last_undegraded":"2024-01-20T08:11:05.271402+0000","last_fullsized":"2024-01-20T08:11:05.271402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:30.930826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271798+0000","last_change":"2024-01-20T08:11:05.258827+0000","last_active":"2024-01-20T08:11:05.271798+0000","last_peered":"2024-01-20T08:11:05.271798+0000","last_clean":"2024-01-20T08:11:05.271798+0000","last_became_active":"2024-01-20T08:11:05.257441+0000","last_became_peered":"2024-01-20T08:11:05.257441+0000","last_unstale":"2024-01-20T08:11:05.271798+0000","last_undegraded":"2024-01-20T08:11:05.271798+0000","last_fullsized":"2024-01-20T08:11:05.271798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273405+0000","last_change":"2024-01-20T08:11:05.269037+0000","last_active":"2024-01-20T08:11:05.273405+0000","last_peered":"2024-01-20T08:11:05.273405+0000","last_clean":"2024-01-20T08:11:05.273405+0000","last_became_active":"2024-01-20T08:11:05.268712+0000","last_became_peered":"2024-01-20T08:11:05.268712+0000","last_unstale":"2024-01-20T08:11:05.273405+0000","last_undegraded":"2024-01-20T08:11:05.273405+0000","last_fullsized":"2024-01-20T08:11:05.273405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275410+0000","last_change":"2024-01-20T08:11:05.266849+0000","last_active":"2024-01-20T08:11:05.275410+0000","last_peered":"2024-01-20T08:11:05.275410+0000","last_clean":"2024-01-20T08:11:05.275410+0000","last_became_active":"2024-01-20T08:11:05.265215+0000","last_became_peered":"2024-01-20T08:11:05.265215+0000","last_unstale":"2024-01-20T08:11:05.275410+0000","last_undegraded":"2024-01-20T08:11:05.275410+0000","last_fullsized":"2024-01-20T08:11:05.275410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269786+0000","last_change":"2024-01-20T08:11:05.263501+0000","last_active":"2024-01-20T08:11:05.269786+0000","last_peered":"2024-01-20T08:11:05.269786+0000","last_clean":"2024-01-20T08:11:05.269786+0000","last_became_active":"2024-01-20T08:11:05.263158+0000","last_became_peered":"2024-01-20T08:11:05.263158+0000","last_unstale":"2024-01-20T08:11:05.269786+0000","last_undegraded":"2024-01-20T08:11:05.269786+0000","last_fullsized":"2024-01-20T08:11:05.269786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:00.670692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277541+0000","last_change":"2024-01-20T08:11:05.269484+0000","last_active":"2024-01-20T08:11:05.277541+0000","last_peered":"2024-01-20T08:11:05.277541+0000","last_clean":"2024-01-20T08:11:05.277541+0000","last_became_active":"2024-01-20T08:11:05.269195+0000","last_became_peered":"2024-01-20T08:11:05.269195+0000","last_unstale":"2024-01-20T08:11:05.277541+0000","last_undegraded":"2024-01-20T08:11:05.277541+0000","last_fullsized":"2024-01-20T08:11:05.277541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278568+0000","last_change":"2024-01-20T08:11:05.272142+0000","last_active":"2024-01-20T08:11:05.278568+0000","last_peered":"2024-01-20T08:11:05.278568+0000","last_clean":"2024-01-20T08:11:05.278568+0000","last_became_active":"2024-01-20T08:11:05.271469+0000","last_became_peered":"2024-01-20T08:11:05.271469+0000","last_unstale":"2024-01-20T08:11:05.278568+0000","last_undegraded":"2024-01-20T08:11:05.278568+0000","last_fullsized":"2024-01-20T08:11:05.278568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274748+0000","last_change":"2024-01-20T08:11:05.267733+0000","last_active":"2024-01-20T08:11:05.274748+0000","last_peered":"2024-01-20T08:11:05.274748+0000","last_clean":"2024-01-20T08:11:05.274748+0000","last_became_active":"2024-01-20T08:11:05.267455+0000","last_became_peered":"2024-01-20T08:11:05.267455+0000","last_unstale":"2024-01-20T08:11:05.274748+0000","last_undegraded":"2024-01-20T08:11:05.274748+0000","last_fullsized":"2024-01-20T08:11:05.274748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269296+0000","last_change":"2024-01-20T08:11:05.259975+0000","last_active":"2024-01-20T08:11:05.269296+0000","last_peered":"2024-01-20T08:11:05.269296+0000","last_clean":"2024-01-20T08:11:05.269296+0000","last_became_active":"2024-01-20T08:11:05.259444+0000","last_became_peered":"2024-01-20T08:11:05.259444+0000","last_unstale":"2024-01-20T08:11:05.269296+0000","last_undegraded":"2024-01-20T08:11:05.269296+0000","last_fullsized":"2024-01-20T08:11:05.269296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:11:51.908895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270353+0000","last_change":"2024-01-20T08:11:05.258558+0000","last_active":"2024-01-20T08:11:05.270353+0000","last_peered":"2024-01-20T08:11:05.270353+0000","last_clean":"2024-01-20T08:11:05.270353+0000","last_became_active":"2024-01-20T08:11:05.253870+0000","last_became_peered":"2024-01-20T08:11:05.253870+0000","last_unstale":"2024-01-20T08:11:05.270353+0000","last_undegraded":"2024-01-20T08:11:05.270353+0000","last_fullsized":"2024-01-20T08:11:05.270353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275099+0000","last_change":"2024-01-20T08:11:05.262066+0000","last_active":"2024-01-20T08:11:05.275099+0000","last_peered":"2024-01-20T08:11:05.275099+0000","last_clean":"2024-01-20T08:11:05.275099+0000","last_became_active":"2024-01-20T08:11:05.261204+0000","last_became_peered":"2024-01-20T08:11:05.261204+0000","last_unstale":"2024-01-20T08:11:05.275099+0000","last_undegraded":"2024-01-20T08:11:05.275099+0000","last_fullsized":"2024-01-20T08:11:05.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280032+0000","last_change":"2024-01-20T08:11:05.276118+0000","last_active":"2024-01-20T08:11:05.280032+0000","last_peered":"2024-01-20T08:11:05.280032+0000","last_clean":"2024-01-20T08:11:05.280032+0000","last_became_active":"2024-01-20T08:11:05.273797+0000","last_became_peered":"2024-01-20T08:11:05.273797+0000","last_unstale":"2024-01-20T08:11:05.280032+0000","last_undegraded":"2024-01-20T08:11:05.280032+0000","last_fullsized":"2024-01-20T08:11:05.280032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273371+0000","last_change":"2024-01-20T08:11:05.271502+0000","last_active":"2024-01-20T08:11:05.273371+0000","last_peered":"2024-01-20T08:11:05.273371+0000","last_clean":"2024-01-20T08:11:05.273371+0000","last_became_active":"2024-01-20T08:11:05.271187+0000","last_became_peered":"2024-01-20T08:11:05.271187+0000","last_unstale":"2024-01-20T08:11:05.273371+0000","last_undegraded":"2024-01-20T08:11:05.273371+0000","last_fullsized":"2024-01-20T08:11:05.273371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269406+0000","last_change":"2024-01-20T08:11:05.258329+0000","last_active":"2024-01-20T08:11:05.269406+0000","last_peered":"2024-01-20T08:11:05.269406+0000","last_clean":"2024-01-20T08:11:05.269406+0000","last_became_active":"2024-01-20T08:11:05.258043+0000","last_became_peered":"2024-01-20T08:11:05.258043+0000","last_unstale":"2024-01-20T08:11:05.269406+0000","last_undegraded":"2024-01-20T08:11:05.269406+0000","last_fullsized":"2024-01-20T08:11:05.269406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273257+0000","last_change":"2024-01-20T08:11:05.261388+0000","last_active":"2024-01-20T08:11:05.273257+0000","last_peered":"2024-01-20T08:11:05.273257+0000","last_clean":"2024-01-20T08:11:05.273257+0000","last_became_active":"2024-01-20T08:11:05.260589+0000","last_became_peered":"2024-01-20T08:11:05.260589+0000","last_unstale":"2024-01-20T08:11:05.273257+0000","last_undegraded":"2024-01-20T08:11:05.273257+0000","last_fullsized":"2024-01-20T08:11:05.273257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272042+0000","last_change":"2024-01-20T08:11:05.269680+0000","last_active":"2024-01-20T08:11:05.272042+0000","last_peered":"2024-01-20T08:11:05.272042+0000","last_clean":"2024-01-20T08:11:05.272042+0000","last_became_active":"2024-01-20T08:11:05.269407+0000","last_became_peered":"2024-01-20T08:11:05.269407+0000","last_unstale":"2024-01-20T08:11:05.272042+0000","last_undegraded":"2024-01-20T08:11:05.272042+0000","last_fullsized":"2024-01-20T08:11:05.272042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:38.945306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271604+0000","last_change":"2024-01-20T08:11:05.264644+0000","last_active":"2024-01-20T08:11:05.271604+0000","last_peered":"2024-01-20T08:11:05.271604+0000","last_clean":"2024-01-20T08:11:05.271604+0000","last_became_active":"2024-01-20T08:11:05.264067+0000","last_became_peered":"2024-01-20T08:11:05.264067+0000","last_unstale":"2024-01-20T08:11:05.271604+0000","last_undegraded":"2024-01-20T08:11:05.271604+0000","last_fullsized":"2024-01-20T08:11:05.271604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.263125+0000","last_change":"2024-01-20T08:11:05.258143+0000","last_active":"2024-01-20T08:11:05.263125+0000","last_peered":"2024-01-20T08:11:05.263125+0000","last_clean":"2024-01-20T08:11:05.263125+0000","last_became_active":"2024-01-20T08:11:05.257144+0000","last_became_peered":"2024-01-20T08:11:05.257144+0000","last_unstale":"2024-01-20T08:11:05.263125+0000","last_undegraded":"2024-01-20T08:11:05.263125+0000","last_fullsized":"2024-01-20T08:11:05.263125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:50.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270383+0000","last_change":"2024-01-20T08:11:05.264328+0000","last_active":"2024-01-20T08:11:05.270383+0000","last_peered":"2024-01-20T08:11:05.270383+0000","last_clean":"2024-01-20T08:11:05.270383+0000","last_became_active":"2024-01-20T08:11:05.263991+0000","last_became_peered":"2024-01-20T08:11:05.263991+0000","last_unstale":"2024-01-20T08:11:05.270383+0000","last_undegraded":"2024-01-20T08:11:05.270383+0000","last_fullsized":"2024-01-20T08:11:05.270383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274828+0000","last_change":"2024-01-20T08:11:05.256694+0000","last_active":"2024-01-20T08:11:05.274828+0000","last_peered":"2024-01-20T08:11:05.274828+0000","last_clean":"2024-01-20T08:11:05.274828+0000","last_became_active":"2024-01-20T08:11:05.256285+0000","last_became_peered":"2024-01-20T08:11:05.256285+0000","last_unstale":"2024-01-20T08:11:05.274828+0000","last_undegraded":"2024-01-20T08:11:05.274828+0000","last_fullsized":"2024-01-20T08:11:05.274828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278098+0000","last_change":"2024-01-20T08:11:05.266720+0000","last_active":"2024-01-20T08:11:05.278098+0000","last_peered":"2024-01-20T08:11:05.278098+0000","last_clean":"2024-01-20T08:11:05.278098+0000","last_became_active":"2024-01-20T08:11:05.266340+0000","last_became_peered":"2024-01-20T08:11:05.266340+0000","last_unstale":"2024-01-20T08:11:05.278098+0000","last_undegraded":"2024-01-20T08:11:05.278098+0000","last_fullsized":"2024-01-20T08:11:05.278098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269386+0000","last_change":"2024-01-20T08:11:05.257696+0000","last_active":"2024-01-20T08:11:05.269386+0000","last_peered":"2024-01-20T08:11:05.269386+0000","last_clean":"2024-01-20T08:11:05.269386+0000","last_became_active":"2024-01-20T08:11:05.257432+0000","last_became_peered":"2024-01-20T08:11:05.257432+0000","last_unstale":"2024-01-20T08:11:05.269386+0000","last_undegraded":"2024-01-20T08:11:05.269386+0000","last_fullsized":"2024-01-20T08:11:05.269386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.282399+0000","last_change":"2024-01-20T08:11:05.274284+0000","last_active":"2024-01-20T08:11:05.282399+0000","last_peered":"2024-01-20T08:11:05.282399+0000","last_clean":"2024-01-20T08:11:05.282399+0000","last_became_active":"2024-01-20T08:11:05.274004+0000","last_became_peered":"2024-01-20T08:11:05.274004+0000","last_unstale":"2024-01-20T08:11:05.282399+0000","last_undegraded":"2024-01-20T08:11:05.282399+0000","last_fullsized":"2024-01-20T08:11:05.282399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277254+0000","last_change":"2024-01-20T08:11:05.273526+0000","last_active":"2024-01-20T08:11:05.277254+0000","last_peered":"2024-01-20T08:11:05.277254+0000","last_clean":"2024-01-20T08:11:05.277254+0000","last_became_active":"2024-01-20T08:11:05.273257+0000","last_became_peered":"2024-01-20T08:11:05.273257+0000","last_unstale":"2024-01-20T08:11:05.277254+0000","last_undegraded":"2024-01-20T08:11:05.277254+0000","last_fullsized":"2024-01-20T08:11:05.277254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.261161+0000","last_change":"2024-01-20T08:11:05.253163+0000","last_active":"2024-01-20T08:11:05.261161+0000","last_peered":"2024-01-20T08:11:05.261161+0000","last_clean":"2024-01-20T08:11:05.261161+0000","last_became_active":"2024-01-20T08:11:05.252357+0000","last_became_peered":"2024-01-20T08:11:05.252357+0000","last_unstale":"2024-01-20T08:11:05.261161+0000","last_undegraded":"2024-01-20T08:11:05.261161+0000","last_fullsized":"2024-01-20T08:11:05.261161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:46.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273345+0000","last_change":"2024-01-20T08:11:05.267754+0000","last_active":"2024-01-20T08:11:05.273345+0000","last_peered":"2024-01-20T08:11:05.273345+0000","last_clean":"2024-01-20T08:11:05.273345+0000","last_became_active":"2024-01-20T08:11:05.267459+0000","last_became_peered":"2024-01-20T08:11:05.267459+0000","last_unstale":"2024-01-20T08:11:05.273345+0000","last_undegraded":"2024-01-20T08:11:05.273345+0000","last_fullsized":"2024-01-20T08:11:05.273345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278222+0000","last_change":"2024-01-20T08:11:05.274553+0000","last_active":"2024-01-20T08:11:05.278222+0000","last_peered":"2024-01-20T08:11:05.278222+0000","last_clean":"2024-01-20T08:11:05.278222+0000","last_became_active":"2024-01-20T08:11:05.272535+0000","last_became_peered":"2024-01-20T08:11:05.272535+0000","last_unstale":"2024-01-20T08:11:05.278222+0000","last_undegraded":"2024-01-20T08:11:05.278222+0000","last_fullsized":"2024-01-20T08:11:05.278222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271593+0000","last_change":"2024-01-20T08:11:05.264877+0000","last_active":"2024-01-20T08:11:05.271593+0000","last_peered":"2024-01-20T08:11:05.271593+0000","last_clean":"2024-01-20T08:11:05.271593+0000","last_became_active":"2024-01-20T08:11:05.260771+0000","last_became_peered":"2024-01-20T08:11:05.260771+0000","last_unstale":"2024-01-20T08:11:05.271593+0000","last_undegraded":"2024-01-20T08:11:05.271593+0000","last_fullsized":"2024-01-20T08:11:05.271593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270478+0000","last_change":"2024-01-20T08:11:05.264962+0000","last_active":"2024-01-20T08:11:05.270478+0000","last_peered":"2024-01-20T08:11:05.270478+0000","last_clean":"2024-01-20T08:11:05.270478+0000","last_became_active":"2024-01-20T08:11:05.264693+0000","last_became_peered":"2024-01-20T08:11:05.264693+0000","last_unstale":"2024-01-20T08:11:05.270478+0000","last_undegraded":"2024-01-20T08:11:05.270478+0000","last_fullsized":"2024-01-20T08:11:05.270478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277905+0000","last_change":"2024-01-20T08:11:04.244349+0000","last_active":"2024-01-20T08:11:05.277905+0000","last_peered":"2024-01-20T08:11:05.277905+0000","last_clean":"2024-01-20T08:11:05.277905+0000","last_became_active":"2024-01-20T08:11:04.244029+0000","last_became_peered":"2024-01-20T08:11:04.244029+0000","last_unstale":"2024-01-20T08:11:05.277905+0000","last_undegraded":"2024-01-20T08:11:05.277905+0000","last_fullsized":"2024-01-20T08:11:05.277905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274025+0000","last_change":"2024-01-20T08:11:05.267631+0000","last_active":"2024-01-20T08:11:05.274025+0000","last_peered":"2024-01-20T08:11:05.274025+0000","last_clean":"2024-01-20T08:11:05.274025+0000","last_became_active":"2024-01-20T08:11:05.267310+0000","last_became_peered":"2024-01-20T08:11:05.267310+0000","last_unstale":"2024-01-20T08:11:05.274025+0000","last_undegraded":"2024-01-20T08:11:05.274025+0000","last_fullsized":"2024-01-20T08:11:05.274025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:00.670692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280190+0000","last_change":"2024-01-20T08:11:04.238741+0000","last_active":"2024-01-20T08:11:05.280190+0000","last_peered":"2024-01-20T08:11:05.280190+0000","last_clean":"2024-01-20T08:11:05.280190+0000","last_became_active":"2024-01-20T08:11:04.238272+0000","last_became_peered":"2024-01-20T08:11:04.238272+0000","last_unstale":"2024-01-20T08:11:05.280190+0000","last_undegraded":"2024-01-20T08:11:05.280190+0000","last_fullsized":"2024-01-20T08:11:05.280190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269315+0000","last_change":"2024-01-20T08:11:05.261271+0000","last_active":"2024-01-20T08:11:05.269315+0000","last_peered":"2024-01-20T08:11:05.269315+0000","last_clean":"2024-01-20T08:11:05.269315+0000","last_became_active":"2024-01-20T08:11:05.258484+0000","last_became_peered":"2024-01-20T08:11:05.258484+0000","last_unstale":"2024-01-20T08:11:05.269315+0000","last_undegraded":"2024-01-20T08:11:05.269315+0000","last_fullsized":"2024-01-20T08:11:05.269315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:10.236082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.285301+0000","last_change":"2024-01-20T08:11:04.227503+0000","last_active":"2024-01-20T08:11:05.285301+0000","last_peered":"2024-01-20T08:11:05.285301+0000","last_clean":"2024-01-20T08:11:05.285301+0000","last_became_active":"2024-01-20T08:11:04.227241+0000","last_became_peered":"2024-01-20T08:11:04.227241+0000","last_unstale":"2024-01-20T08:11:05.285301+0000","last_undegraded":"2024-01-20T08:11:05.285301+0000","last_fullsized":"2024-01-20T08:11:05.285301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:45.729946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.282380+0000","last_change":"2024-01-20T08:11:05.273419+0000","last_active":"2024-01-20T08:11:05.282380+0000","last_peered":"2024-01-20T08:11:05.282380+0000","last_clean":"2024-01-20T08:11:05.282380+0000","last_became_active":"2024-01-20T08:11:05.273110+0000","last_became_peered":"2024-01-20T08:11:05.273110+0000","last_unstale":"2024-01-20T08:11:05.282380+0000","last_undegraded":"2024-01-20T08:11:05.282380+0000","last_fullsized":"2024-01-20T08:11:05.282380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.284290+0000","last_change":"2024-01-20T08:11:04.227383+0000","last_active":"2024-01-20T08:11:05.284290+0000","last_peered":"2024-01-20T08:11:05.284290+0000","last_clean":"2024-01-20T08:11:05.284290+0000","last_became_active":"2024-01-20T08:11:04.227109+0000","last_became_peered":"2024-01-20T08:11:04.227109+0000","last_unstale":"2024-01-20T08:11:05.284290+0000","last_undegraded":"2024-01-20T08:11:05.284290+0000","last_fullsized":"2024-01-20T08:11:05.284290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:04:40.346500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273326+0000","last_change":"2024-01-20T08:11:05.267543+0000","last_active":"2024-01-20T08:11:05.273326+0000","last_peered":"2024-01-20T08:11:05.273326+0000","last_clean":"2024-01-20T08:11:05.273326+0000","last_became_active":"2024-01-20T08:11:05.267013+0000","last_became_peered":"2024-01-20T08:11:05.267013+0000","last_unstale":"2024-01-20T08:11:05.273326+0000","last_undegraded":"2024-01-20T08:11:05.273326+0000","last_fullsized":"2024-01-20T08:11:05.273326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281754+0000","last_change":"2024-01-20T08:11:04.234921+0000","last_active":"2024-01-20T08:11:05.281754+0000","last_peered":"2024-01-20T08:11:05.281754+0000","last_clean":"2024-01-20T08:11:05.281754+0000","last_became_active":"2024-01-20T08:11:04.232868+0000","last_became_peered":"2024-01-20T08:11:04.232868+0000","last_unstale":"2024-01-20T08:11:05.281754+0000","last_undegraded":"2024-01-20T08:11:05.281754+0000","last_fullsized":"2024-01-20T08:11:05.281754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:57.342375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274667+0000","last_change":"2024-01-20T08:11:05.261155+0000","last_active":"2024-01-20T08:11:05.274667+0000","last_peered":"2024-01-20T08:11:05.274667+0000","last_clean":"2024-01-20T08:11:05.274667+0000","last_became_active":"2024-01-20T08:11:05.260746+0000","last_became_peered":"2024-01-20T08:11:05.260746+0000","last_unstale":"2024-01-20T08:11:05.274667+0000","last_undegraded":"2024-01-20T08:11:05.274667+0000","last_fullsized":"2024-01-20T08:11:05.274667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281734+0000","last_change":"2024-01-20T08:11:04.233438+0000","last_active":"2024-01-20T08:11:05.281734+0000","last_peered":"2024-01-20T08:11:05.281734+0000","last_clean":"2024-01-20T08:11:05.281734+0000","last_became_active":"2024-01-20T08:11:04.232954+0000","last_became_peered":"2024-01-20T08:11:04.232954+0000","last_unstale":"2024-01-20T08:11:05.281734+0000","last_undegraded":"2024-01-20T08:11:05.281734+0000","last_fullsized":"2024-01-20T08:11:05.281734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:49.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271541+0000","last_change":"2024-01-20T08:11:05.265947+0000","last_active":"2024-01-20T08:11:05.271541+0000","last_peered":"2024-01-20T08:11:05.271541+0000","last_clean":"2024-01-20T08:11:05.271541+0000","last_became_active":"2024-01-20T08:11:05.265674+0000","last_became_peered":"2024-01-20T08:11:05.265674+0000","last_unstale":"2024-01-20T08:11:05.271541+0000","last_undegraded":"2024-01-20T08:11:05.271541+0000","last_fullsized":"2024-01-20T08:11:05.271541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.244779+0000","last_change":"2024-01-20T08:11:04.228883+0000","last_active":"2024-01-20T08:11:05.244779+0000","last_peered":"2024-01-20T08:11:05.244779+0000","last_clean":"2024-01-20T08:11:05.244779+0000","last_became_active":"2024-01-20T08:11:04.228077+0000","last_became_peered":"2024-01-20T08:11:04.228077+0000","last_unstale":"2024-01-20T08:11:05.244779+0000","last_undegraded":"2024-01-20T08:11:05.244779+0000","last_fullsized":"2024-01-20T08:11:05.244779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280616+0000","last_change":"2024-01-20T08:11:05.270984+0000","last_active":"2024-01-20T08:11:05.280616+0000","last_peered":"2024-01-20T08:11:05.280616+0000","last_clean":"2024-01-20T08:11:05.280616+0000","last_became_active":"2024-01-20T08:11:05.270740+0000","last_became_peered":"2024-01-20T08:11:05.270740+0000","last_unstale":"2024-01-20T08:11:05.280616+0000","last_undegraded":"2024-01-20T08:11:05.280616+0000","last_fullsized":"2024-01-20T08:11:05.280616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.236376+0000","last_change":"2024-01-20T08:11:04.238159+0000","last_active":"2024-01-20T08:11:05.236376+0000","last_peered":"2024-01-20T08:11:05.236376+0000","last_clean":"2024-01-20T08:11:05.236376+0000","last_became_active":"2024-01-20T08:11:04.237894+0000","last_became_peered":"2024-01-20T08:11:04.237894+0000","last_unstale":"2024-01-20T08:11:05.236376+0000","last_undegraded":"2024-01-20T08:11:05.236376+0000","last_fullsized":"2024-01-20T08:11:05.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:15.898827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275017+0000","last_change":"2024-01-20T08:11:05.270395+0000","last_active":"2024-01-20T08:11:05.275017+0000","last_peered":"2024-01-20T08:11:05.275017+0000","last_clean":"2024-01-20T08:11:05.275017+0000","last_became_active":"2024-01-20T08:11:05.269778+0000","last_became_peered":"2024-01-20T08:11:05.269778+0000","last_unstale":"2024-01-20T08:11:05.275017+0000","last_undegraded":"2024-01-20T08:11:05.275017+0000","last_fullsized":"2024-01-20T08:11:05.275017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.247355+0000","last_change":"2024-01-20T08:11:04.238975+0000","last_active":"2024-01-20T08:11:05.247355+0000","last_peered":"2024-01-20T08:11:05.247355+0000","last_clean":"2024-01-20T08:11:05.247355+0000","last_became_active":"2024-01-20T08:11:04.238626+0000","last_became_peered":"2024-01-20T08:11:04.238626+0000","last_unstale":"2024-01-20T08:11:05.247355+0000","last_undegraded":"2024-01-20T08:11:05.247355+0000","last_fullsized":"2024-01-20T08:11:05.247355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:35.183036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277339+0000","last_change":"2024-01-20T08:11:05.271640+0000","last_active":"2024-01-20T08:11:05.277339+0000","last_peered":"2024-01-20T08:11:05.277339+0000","last_clean":"2024-01-20T08:11:05.277339+0000","last_became_active":"2024-01-20T08:11:05.271380+0000","last_became_peered":"2024-01-20T08:11:05.271380+0000","last_unstale":"2024-01-20T08:11:05.277339+0000","last_undegraded":"2024-01-20T08:11:05.277339+0000","last_fullsized":"2024-01-20T08:11:05.277339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.254589+0000","last_change":"2024-01-20T08:11:04.231597+0000","last_active":"2024-01-20T08:11:05.254589+0000","last_peered":"2024-01-20T08:11:05.254589+0000","last_clean":"2024-01-20T08:11:05.254589+0000","last_became_active":"2024-01-20T08:11:04.231265+0000","last_became_peered":"2024-01-20T08:11:04.231265+0000","last_unstale":"2024-01-20T08:11:05.254589+0000","last_undegraded":"2024-01-20T08:11:05.254589+0000","last_fullsized":"2024-01-20T08:11:05.254589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.263525+0000","last_change":"2024-01-20T08:11:05.254926+0000","last_active":"2024-01-20T08:11:05.263525+0000","last_peered":"2024-01-20T08:11:05.263525+0000","last_clean":"2024-01-20T08:11:05.263525+0000","last_became_active":"2024-01-20T08:11:05.254655+0000","last_became_peered":"2024-01-20T08:11:05.254655+0000","last_unstale":"2024-01-20T08:11:05.263525+0000","last_undegraded":"2024-01-20T08:11:05.263525+0000","last_fullsized":"2024-01-20T08:11:05.263525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280169+0000","last_change":"2024-01-20T08:11:04.240118+0000","last_active":"2024-01-20T08:11:05.280169+0000","last_peered":"2024-01-20T08:11:05.280169+0000","last_clean":"2024-01-20T08:11:05.280169+0000","last_became_active":"2024-01-20T08:11:04.239850+0000","last_became_peered":"2024-01-20T08:11:04.239850+0000","last_unstale":"2024-01-20T08:11:05.280169+0000","last_undegraded":"2024-01-20T08:11:05.280169+0000","last_fullsized":"2024-01-20T08:11:05.280169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274768+0000","last_change":"2024-01-20T08:11:05.264063+0000","last_active":"2024-01-20T08:11:05.274768+0000","last_peered":"2024-01-20T08:11:05.274768+0000","last_clean":"2024-01-20T08:11:05.274768+0000","last_became_active":"2024-01-20T08:11:05.263343+0000","last_became_peered":"2024-01-20T08:11:05.263343+0000","last_unstale":"2024-01-20T08:11:05.274768+0000","last_undegraded":"2024-01-20T08:11:05.274768+0000","last_fullsized":"2024-01-20T08:11:05.274768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.289111+0000","last_change":"2024-01-20T08:11:04.229958+0000","last_active":"2024-01-20T08:11:05.289111+0000","last_peered":"2024-01-20T08:11:05.289111+0000","last_clean":"2024-01-20T08:11:05.289111+0000","last_became_active":"2024-01-20T08:11:04.229708+0000","last_became_peered":"2024-01-20T08:11:04.229708+0000","last_unstale":"2024-01-20T08:11:05.289111+0000","last_undegraded":"2024-01-20T08:11:05.289111+0000","last_fullsized":"2024-01-20T08:11:05.289111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:19.024894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283090+0000","last_change":"2024-01-20T08:11:05.277996+0000","last_active":"2024-01-20T08:11:05.283090+0000","last_peered":"2024-01-20T08:11:05.283090+0000","last_clean":"2024-01-20T08:11:05.283090+0000","last_became_active":"2024-01-20T08:11:05.277744+0000","last_became_peered":"2024-01-20T08:11:05.277744+0000","last_unstale":"2024-01-20T08:11:05.283090+0000","last_undegraded":"2024-01-20T08:11:05.283090+0000","last_fullsized":"2024-01-20T08:11:05.283090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281396+0000","last_change":"2024-01-20T08:11:04.239053+0000","last_active":"2024-01-20T08:11:05.281396+0000","last_peered":"2024-01-20T08:11:05.281396+0000","last_clean":"2024-01-20T08:11:05.281396+0000","last_became_active":"2024-01-20T08:11:04.238709+0000","last_became_peered":"2024-01-20T08:11:04.238709+0000","last_unstale":"2024-01-20T08:11:05.281396+0000","last_undegraded":"2024-01-20T08:11:05.281396+0000","last_fullsized":"2024-01-20T08:11:05.281396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:27.855678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273800+0000","last_change":"2024-01-20T08:11:05.262683+0000","last_active":"2024-01-20T08:11:05.273800+0000","last_peered":"2024-01-20T08:11:05.273800+0000","last_clean":"2024-01-20T08:11:05.273800+0000","last_became_active":"2024-01-20T08:11:05.259731+0000","last_became_peered":"2024-01-20T08:11:05.259731+0000","last_unstale":"2024-01-20T08:11:05.273800+0000","last_undegraded":"2024-01-20T08:11:05.273800+0000","last_fullsized":"2024-01-20T08:11:05.273800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.260685+0000","last_change":"2024-01-20T08:11:04.240412+0000","last_active":"2024-01-20T08:11:05.260685+0000","last_peered":"2024-01-20T08:11:05.260685+0000","last_clean":"2024-01-20T08:11:05.260685+0000","last_became_active":"2024-01-20T08:11:04.240045+0000","last_became_peered":"2024-01-20T08:11:04.240045+0000","last_unstale":"2024-01-20T08:11:05.260685+0000","last_undegraded":"2024-01-20T08:11:05.260685+0000","last_fullsized":"2024-01-20T08:11:05.260685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271507+0000","last_change":"2024-01-20T08:11:05.263329+0000","last_active":"2024-01-20T08:11:05.271507+0000","last_peered":"2024-01-20T08:11:05.271507+0000","last_clean":"2024-01-20T08:11:05.271507+0000","last_became_active":"2024-01-20T08:11:05.263049+0000","last_became_peered":"2024-01-20T08:11:05.263049+0000","last_unstale":"2024-01-20T08:11:05.271507+0000","last_undegraded":"2024-01-20T08:11:05.271507+0000","last_fullsized":"2024-01-20T08:11:05.271507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.243011+0000","last_change":"2024-01-20T08:11:04.238160+0000","last_active":"2024-01-20T08:11:05.243011+0000","last_peered":"2024-01-20T08:11:05.243011+0000","last_clean":"2024-01-20T08:11:05.243011+0000","last_became_active":"2024-01-20T08:11:04.237860+0000","last_became_peered":"2024-01-20T08:11:04.237860+0000","last_unstale":"2024-01-20T08:11:05.243011+0000","last_undegraded":"2024-01-20T08:11:05.243011+0000","last_fullsized":"2024-01-20T08:11:05.243011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274462+0000","last_change":"2024-01-20T08:11:05.266758+0000","last_active":"2024-01-20T08:11:05.274462+0000","last_peered":"2024-01-20T08:11:05.274462+0000","last_clean":"2024-01-20T08:11:05.274462+0000","last_became_active":"2024-01-20T08:11:05.265820+0000","last_became_peered":"2024-01-20T08:11:05.265820+0000","last_unstale":"2024-01-20T08:11:05.274462+0000","last_undegraded":"2024-01-20T08:11:05.274462+0000","last_fullsized":"2024-01-20T08:11:05.274462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:10.236082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.285858+0000","last_change":"2024-01-20T08:11:04.231466+0000","last_active":"2024-01-20T08:11:05.285858+0000","last_peered":"2024-01-20T08:11:05.285858+0000","last_clean":"2024-01-20T08:11:05.285858+0000","last_became_active":"2024-01-20T08:11:04.231224+0000","last_became_peered":"2024-01-20T08:11:04.231224+0000","last_unstale":"2024-01-20T08:11:05.285858+0000","last_undegraded":"2024-01-20T08:11:05.285858+0000","last_fullsized":"2024-01-20T08:11:05.285858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274274+0000","last_change":"2024-01-20T08:11:05.269731+0000","last_active":"2024-01-20T08:11:05.274274+0000","last_peered":"2024-01-20T08:11:05.274274+0000","last_clean":"2024-01-20T08:11:05.274274+0000","last_became_active":"2024-01-20T08:11:05.269500+0000","last_became_peered":"2024-01-20T08:11:05.269500+0000","last_unstale":"2024-01-20T08:11:05.274274+0000","last_undegraded":"2024-01-20T08:11:05.274274+0000","last_fullsized":"2024-01-20T08:11:05.274274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.286550+0000","last_change":"2024-01-20T08:11:04.241452+0000","last_active":"2024-01-20T08:11:05.286550+0000","last_peered":"2024-01-20T08:11:05.286550+0000","last_clean":"2024-01-20T08:11:05.286550+0000","last_became_active":"2024-01-20T08:11:04.240981+0000","last_became_peered":"2024-01-20T08:11:04.240981+0000","last_unstale":"2024-01-20T08:11:05.286550+0000","last_undegraded":"2024-01-20T08:11:05.286550+0000","last_fullsized":"2024-01-20T08:11:05.286550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269674+0000","last_change":"2024-01-20T08:11:05.254371+0000","last_active":"2024-01-20T08:11:05.269674+0000","last_peered":"2024-01-20T08:11:05.269674+0000","last_clean":"2024-01-20T08:11:05.269674+0000","last_became_active":"2024-01-20T08:11:05.253911+0000","last_became_peered":"2024-01-20T08:11:05.253911+0000","last_unstale":"2024-01-20T08:11:05.269674+0000","last_undegraded":"2024-01-20T08:11:05.269674+0000","last_fullsized":"2024-01-20T08:11:05.269674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280433+0000","last_change":"2024-01-20T08:11:04.240349+0000","last_active":"2024-01-20T08:11:05.280433+0000","last_peered":"2024-01-20T08:11:05.280433+0000","last_clean":"2024-01-20T08:11:05.280433+0000","last_became_active":"2024-01-20T08:11:04.240032+0000","last_became_peered":"2024-01-20T08:11:04.240032+0000","last_unstale":"2024-01-20T08:11:05.280433+0000","last_undegraded":"2024-01-20T08:11:05.280433+0000","last_fullsized":"2024-01-20T08:11:05.280433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:27:52.299223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283522+0000","last_change":"2024-01-20T08:11:05.273938+0000","last_active":"2024-01-20T08:11:05.283522+0000","last_peered":"2024-01-20T08:11:05.283522+0000","last_clean":"2024-01-20T08:11:05.283522+0000","last_became_active":"2024-01-20T08:11:05.273244+0000","last_became_peered":"2024-01-20T08:11:05.273244+0000","last_unstale":"2024-01-20T08:11:05.283522+0000","last_undegraded":"2024-01-20T08:11:05.283522+0000","last_fullsized":"2024-01-20T08:11:05.283522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283903+0000","last_change":"2024-01-20T08:11:04.228172+0000","last_active":"2024-01-20T08:11:05.283903+0000","last_peered":"2024-01-20T08:11:05.283903+0000","last_clean":"2024-01-20T08:11:05.283903+0000","last_became_active":"2024-01-20T08:11:04.227839+0000","last_became_peered":"2024-01-20T08:11:04.227839+0000","last_unstale":"2024-01-20T08:11:05.283903+0000","last_undegraded":"2024-01-20T08:11:05.283903+0000","last_fullsized":"2024-01-20T08:11:05.283903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:09.878605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.262924+0000","last_change":"2024-01-20T08:11:05.256215+0000","last_active":"2024-01-20T08:11:05.262924+0000","last_peered":"2024-01-20T08:11:05.262924+0000","last_clean":"2024-01-20T08:11:05.262924+0000","last_became_active":"2024-01-20T08:11:05.255935+0000","last_became_peered":"2024-01-20T08:11:05.255935+0000","last_unstale":"2024-01-20T08:11:05.262924+0000","last_undegraded":"2024-01-20T08:11:05.262924+0000","last_fullsized":"2024-01-20T08:11:05.262924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:44:08.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.237933+0000","last_change":"2024-01-20T08:11:04.231418+0000","last_active":"2024-01-20T08:11:05.237933+0000","last_peered":"2024-01-20T08:11:05.237933+0000","last_clean":"2024-01-20T08:11:05.237933+0000","last_became_active":"2024-01-20T08:11:04.231150+0000","last_became_peered":"2024-01-20T08:11:04.231150+0000","last_unstale":"2024-01-20T08:11:05.237933+0000","last_undegraded":"2024-01-20T08:11:05.237933+0000","last_fullsized":"2024-01-20T08:11:05.237933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:56.187386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.252208+0000","last_change":"2024-01-20T08:11:05.246307+0000","last_active":"2024-01-20T08:11:05.252208+0000","last_peered":"2024-01-20T08:11:05.252208+0000","last_clean":"2024-01-20T08:11:05.252208+0000","last_became_active":"2024-01-20T08:11:05.245686+0000","last_became_peered":"2024-01-20T08:11:05.245686+0000","last_unstale":"2024-01-20T08:11:05.252208+0000","last_undegraded":"2024-01-20T08:11:05.252208+0000","last_fullsized":"2024-01-20T08:11:05.252208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:41:03.273241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283408+0000","last_change":"2024-01-20T08:11:04.234512+0000","last_active":"2024-01-20T08:11:05.283408+0000","last_peered":"2024-01-20T08:11:05.283408+0000","last_clean":"2024-01-20T08:11:05.283408+0000","last_became_active":"2024-01-20T08:11:04.234175+0000","last_became_peered":"2024-01-20T08:11:04.234175+0000","last_unstale":"2024-01-20T08:11:05.283408+0000","last_undegraded":"2024-01-20T08:11:05.283408+0000","last_fullsized":"2024-01-20T08:11:05.283408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269318+0000","last_change":"2024-01-20T08:11:05.260221+0000","last_active":"2024-01-20T08:11:05.269318+0000","last_peered":"2024-01-20T08:11:05.269318+0000","last_clean":"2024-01-20T08:11:05.269318+0000","last_became_active":"2024-01-20T08:11:05.259763+0000","last_became_peered":"2024-01-20T08:11:05.259763+0000","last_unstale":"2024-01-20T08:11:05.269318+0000","last_undegraded":"2024-01-20T08:11:05.269318+0000","last_fullsized":"2024-01-20T08:11:05.269318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:59.747699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.253007+0000","last_change":"2024-01-20T08:11:04.241959+0000","last_active":"2024-01-20T08:11:05.253007+0000","last_peered":"2024-01-20T08:11:05.253007+0000","last_clean":"2024-01-20T08:11:05.253007+0000","last_became_active":"2024-01-20T08:11:04.241594+0000","last_became_peered":"2024-01-20T08:11:04.241594+0000","last_unstale":"2024-01-20T08:11:05.253007+0000","last_undegraded":"2024-01-20T08:11:05.253007+0000","last_fullsized":"2024-01-20T08:11:05.253007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:45.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272557+0000","last_change":"2024-01-20T08:11:05.264028+0000","last_active":"2024-01-20T08:11:05.272557+0000","last_peered":"2024-01-20T08:11:05.272557+0000","last_clean":"2024-01-20T08:11:05.272557+0000","last_became_active":"2024-01-20T08:11:05.263766+0000","last_became_peered":"2024-01-20T08:11:05.263766+0000","last_unstale":"2024-01-20T08:11:05.272557+0000","last_undegraded":"2024-01-20T08:11:05.272557+0000","last_fullsized":"2024-01-20T08:11:05.272557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:59.623887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.240405+0000","last_change":"2024-01-20T08:11:04.236898+0000","last_active":"2024-01-20T08:11:05.240405+0000","last_peered":"2024-01-20T08:11:05.240405+0000","last_clean":"2024-01-20T08:11:05.240405+0000","last_became_active":"2024-01-20T08:11:04.236608+0000","last_became_peered":"2024-01-20T08:11:04.236608+0000","last_unstale":"2024-01-20T08:11:05.240405+0000","last_undegraded":"2024-01-20T08:11:05.240405+0000","last_fullsized":"2024-01-20T08:11:05.240405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:47:19.869135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273395+0000","last_change":"2024-01-20T08:11:05.268170+0000","last_active":"2024-01-20T08:11:05.273395+0000","last_peered":"2024-01-20T08:11:05.273395+0000","last_clean":"2024-01-20T08:11:05.273395+0000","last_became_active":"2024-01-20T08:11:05.267444+0000","last_became_peered":"2024-01-20T08:11:05.267444+0000","last_unstale":"2024-01-20T08:11:05.273395+0000","last_undegraded":"2024-01-20T08:11:05.273395+0000","last_fullsized":"2024-01-20T08:11:05.273395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.244368+0000","last_change":"2024-01-20T08:11:04.243302+0000","last_active":"2024-01-20T08:11:05.244368+0000","last_peered":"2024-01-20T08:11:05.244368+0000","last_clean":"2024-01-20T08:11:05.244368+0000","last_became_active":"2024-01-20T08:11:04.243105+0000","last_became_peered":"2024-01-20T08:11:04.243105+0000","last_unstale":"2024-01-20T08:11:05.244368+0000","last_undegraded":"2024-01-20T08:11:05.244368+0000","last_fullsized":"2024-01-20T08:11:05.244368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272221+0000","last_change":"2024-01-20T08:11:05.269356+0000","last_active":"2024-01-20T08:11:05.272221+0000","last_peered":"2024-01-20T08:11:05.272221+0000","last_clean":"2024-01-20T08:11:05.272221+0000","last_became_active":"2024-01-20T08:11:05.269074+0000","last_became_peered":"2024-01-20T08:11:05.269074+0000","last_unstale":"2024-01-20T08:11:05.272221+0000","last_undegraded":"2024-01-20T08:11:05.272221+0000","last_fullsized":"2024-01-20T08:11:05.272221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:37:35.488913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.284864+0000","last_change":"2024-01-20T08:11:04.242771+0000","last_active":"2024-01-20T08:11:05.284864+0000","last_peered":"2024-01-20T08:11:05.284864+0000","last_clean":"2024-01-20T08:11:05.284864+0000","last_became_active":"2024-01-20T08:11:04.242500+0000","last_became_peered":"2024-01-20T08:11:04.242500+0000","last_unstale":"2024-01-20T08:11:05.284864+0000","last_undegraded":"2024-01-20T08:11:05.284864+0000","last_fullsized":"2024-01-20T08:11:05.284864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274952+0000","last_change":"2024-01-20T08:11:05.269524+0000","last_active":"2024-01-20T08:11:05.274952+0000","last_peered":"2024-01-20T08:11:05.274952+0000","last_clean":"2024-01-20T08:11:05.274952+0000","last_became_active":"2024-01-20T08:11:05.269284+0000","last_became_peered":"2024-01-20T08:11:05.269284+0000","last_unstale":"2024-01-20T08:11:05.274952+0000","last_undegraded":"2024-01-20T08:11:05.274952+0000","last_fullsized":"2024-01-20T08:11:05.274952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.254740+0000","last_change":"2024-01-20T08:11:04.229764+0000","last_active":"2024-01-20T08:11:05.254740+0000","last_peered":"2024-01-20T08:11:05.254740+0000","last_clean":"2024-01-20T08:11:05.254740+0000","last_became_active":"2024-01-20T08:11:04.229453+0000","last_became_peered":"2024-01-20T08:11:04.229453+0000","last_unstale":"2024-01-20T08:11:05.254740+0000","last_undegraded":"2024-01-20T08:11:05.254740+0000","last_fullsized":"2024-01-20T08:11:05.254740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272117+0000","last_change":"2024-01-20T08:11:05.265952+0000","last_active":"2024-01-20T08:11:05.272117+0000","last_peered":"2024-01-20T08:11:05.272117+0000","last_clean":"2024-01-20T08:11:05.272117+0000","last_became_active":"2024-01-20T08:11:05.265641+0000","last_became_peered":"2024-01-20T08:11:05.265641+0000","last_unstale":"2024-01-20T08:11:05.272117+0000","last_undegraded":"2024-01-20T08:11:05.272117+0000","last_fullsized":"2024-01-20T08:11:05.272117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.259074+0000","last_change":"2024-01-20T08:11:04.228714+0000","last_active":"2024-01-20T08:11:05.259074+0000","last_peered":"2024-01-20T08:11:05.259074+0000","last_clean":"2024-01-20T08:11:05.259074+0000","last_became_active":"2024-01-20T08:11:04.227227+0000","last_became_peered":"2024-01-20T08:11:04.227227+0000","last_unstale":"2024-01-20T08:11:05.259074+0000","last_undegraded":"2024-01-20T08:11:05.259074+0000","last_fullsized":"2024-01-20T08:11:05.259074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277833+0000","last_change":"2024-01-20T08:11:05.273342+0000","last_active":"2024-01-20T08:11:05.277833+0000","last_peered":"2024-01-20T08:11:05.277833+0000","last_clean":"2024-01-20T08:11:05.277833+0000","last_became_active":"2024-01-20T08:11:05.272929+0000","last_became_peered":"2024-01-20T08:11:05.272929+0000","last_unstale":"2024-01-20T08:11:05.277833+0000","last_undegraded":"2024-01-20T08:11:05.277833+0000","last_fullsized":"2024-01-20T08:11:05.277833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.256460+0000","last_change":"2024-01-20T08:11:04.236506+0000","last_active":"2024-01-20T08:11:05.256460+0000","last_peered":"2024-01-20T08:11:05.256460+0000","last_clean":"2024-01-20T08:11:05.256460+0000","last_became_active":"2024-01-20T08:11:04.235965+0000","last_became_peered":"2024-01-20T08:11:04.235965+0000","last_unstale":"2024-01-20T08:11:05.256460+0000","last_undegraded":"2024-01-20T08:11:05.256460+0000","last_fullsized":"2024-01-20T08:11:05.256460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274421+0000","last_change":"2024-01-20T08:11:05.267861+0000","last_active":"2024-01-20T08:11:05.274421+0000","last_peered":"2024-01-20T08:11:05.274421+0000","last_clean":"2024-01-20T08:11:05.274421+0000","last_became_active":"2024-01-20T08:11:05.267603+0000","last_became_peered":"2024-01-20T08:11:05.267603+0000","last_unstale":"2024-01-20T08:11:05.274421+0000","last_undegraded":"2024-01-20T08:11:05.274421+0000","last_fullsized":"2024-01-20T08:11:05.274421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.259927+0000","last_change":"2024-01-20T08:11:04.236173+0000","last_active":"2024-01-20T08:11:05.259927+0000","last_peered":"2024-01-20T08:11:05.259927+0000","last_clean":"2024-01-20T08:11:05.259927+0000","last_became_active":"2024-01-20T08:11:04.235839+0000","last_became_peered":"2024-01-20T08:11:04.235839+0000","last_unstale":"2024-01-20T08:11:05.259927+0000","last_undegraded":"2024-01-20T08:11:05.259927+0000","last_fullsized":"2024-01-20T08:11:05.259927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272985+0000","last_change":"2024-01-20T08:11:05.258770+0000","last_active":"2024-01-20T08:11:05.272985+0000","last_peered":"2024-01-20T08:11:05.272985+0000","last_clean":"2024-01-20T08:11:05.272985+0000","last_became_active":"2024-01-20T08:11:05.258482+0000","last_became_peered":"2024-01-20T08:11:05.258482+0000","last_unstale":"2024-01-20T08:11:05.272985+0000","last_undegraded":"2024-01-20T08:11:05.272985+0000","last_fullsized":"2024-01-20T08:11:05.272985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.240480+0000","last_change":"2024-01-20T08:11:04.242211+0000","last_active":"2024-01-20T08:11:05.240480+0000","last_peered":"2024-01-20T08:11:05.240480+0000","last_clean":"2024-01-20T08:11:05.240480+0000","last_became_active":"2024-01-20T08:11:04.241913+0000","last_became_peered":"2024-01-20T08:11:04.241913+0000","last_unstale":"2024-01-20T08:11:05.240480+0000","last_undegraded":"2024-01-20T08:11:05.240480+0000","last_fullsized":"2024-01-20T08:11:05.240480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:15.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.265030+0000","last_change":"2024-01-20T08:11:05.260184+0000","last_active":"2024-01-20T08:11:05.265030+0000","last_peered":"2024-01-20T08:11:05.265030+0000","last_clean":"2024-01-20T08:11:05.265030+0000","last_became_active":"2024-01-20T08:11:05.259912+0000","last_became_peered":"2024-01-20T08:11:05.259912+0000","last_unstale":"2024-01-20T08:11:05.265030+0000","last_undegraded":"2024-01-20T08:11:05.265030+0000","last_fullsized":"2024-01-20T08:11:05.265030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:47.830275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.243323+0000","last_change":"2024-01-20T08:11:04.238908+0000","last_active":"2024-01-20T08:11:05.243323+0000","last_peered":"2024-01-20T08:11:05.243323+0000","last_clean":"2024-01-20T08:11:05.243323+0000","last_became_active":"2024-01-20T08:11:04.238633+0000","last_became_peered":"2024-01-20T08:11:04.238633+0000","last_unstale":"2024-01-20T08:11:05.243323+0000","last_undegraded":"2024-01-20T08:11:05.243323+0000","last_fullsized":"2024-01-20T08:11:05.243323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271626+0000","last_change":"2024-01-20T08:11:05.264816+0000","last_active":"2024-01-20T08:11:05.271626+0000","last_peered":"2024-01-20T08:11:05.271626+0000","last_clean":"2024-01-20T08:11:05.271626+0000","last_became_active":"2024-01-20T08:11:05.264191+0000","last_became_peered":"2024-01-20T08:11:05.264191+0000","last_unstale":"2024-01-20T08:11:05.271626+0000","last_undegraded":"2024-01-20T08:11:05.271626+0000","last_fullsized":"2024-01-20T08:11:05.271626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.257016+0000","last_change":"2024-01-20T08:11:04.245453+0000","last_active":"2024-01-20T08:11:05.257016+0000","last_peered":"2024-01-20T08:11:05.257016+0000","last_clean":"2024-01-20T08:11:05.257016+0000","last_became_active":"2024-01-20T08:11:04.244780+0000","last_became_peered":"2024-01-20T08:11:04.244780+0000","last_unstale":"2024-01-20T08:11:05.257016+0000","last_undegraded":"2024-01-20T08:11:05.257016+0000","last_fullsized":"2024-01-20T08:11:05.257016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-20T08:11:04.239722+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:11:04.239722+0000","last_peered":"2024-01-20T08:11:04.239722+0000","last_clean":"2024-01-20T08:11:04.239722+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:11:04.239722+0000","last_undegraded":"2024-01-20T08:11:04.239722+0000","last_fullsized":"2024-01-20T08:11:04.239722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":733702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.3939999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.45}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.173},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.1200000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.95899999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.0509999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.5620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.671}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3240000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.494},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.266}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.8859999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.5900000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.395}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.93999999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.0720000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.147},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.24}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.369}]},{"osd":7,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.353},{"interface":"front","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4139999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":1.03},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.5029999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":7.3179999999999996,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.298}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.482},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.5840000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.7},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5309999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.276},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6539999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.778},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5660000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":144878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82799999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.0800000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.145},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.92600000000000005}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.103},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.97899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.389},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.3280000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.429},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":3.2530000000000001,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.468}]},{"osd":7,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.218},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.375},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.504}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.43099999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":733612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0760000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.278}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.745},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.85299999999999998}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.129}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.236},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.413}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.361},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.91300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:11:09.708 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:11:09.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.945+0000 7f0d8ca00640 1 Processor -- start 2024-01-20T08:11:09.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.945+0000 7f0d8ca00640 1 -- start start 2024-01-20T08:11:09.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 0x7f0d840abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d84070370 0x7f0d840c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8ca00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d840c1670 con 0x7f0d84147f20 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d840c2210 con 0x7f0d84070370 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8ca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d841524b0 con 0x7f0d84151f60 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d84070370 0x7f0d840c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d84070370 0x7f0d840c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60954/0 (socket says 172.21.15.100:60954) 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d8aa00640 1 -- 172.21.15.100:0/1356012720 learned_addr learned my addr 172.21.15.100:0/1356012720 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.947+0000 7f0d89600640 1 --2- 172.21.15.100:0/1356012720 >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 0x7f0d840abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.948+0000 7f0d8aa00640 1 -- 172.21.15.100:0/1356012720 >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 msgr2=0x7f0d840abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.948+0000 7f0d8aa00640 1 --2- 172.21.15.100:0/1356012720 >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 0x7f0d840abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.948+0000 7f0d8aa00640 1 -- 172.21.15.100:0/1356012720 >> v1:172.21.15.110:6789/0 conn(0x7f0d84147f20 legacy=0x7f0d840c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.948+0000 7f0d8aa00640 1 -- 172.21.15.100:0/1356012720 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d84070800 con 0x7f0d84070370 2024-01-20T08:11:09.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.948+0000 7f0d89600640 1 --2- 172.21.15.100:0/1356012720 >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 0x7f0d840abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:09.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.949+0000 7f0d8aa00640 1 --2- 172.21.15.100:0/1356012720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c2c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d8406e550 tx=0x7f0d7c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c4c555b3de1bde server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.949+0000 7f0d88c00640 1 -- 172.21.15.100:0/1356012720 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c02ca80 con 0x7f0d84070370 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.949+0000 7f0d88c00640 1 -- 172.21.15.100:0/1356012720 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c02cbe0 con 0x7f0d84070370 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.949+0000 7f0d88c00640 1 -- 172.21.15.100:0/1356012720 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c0343f0 con 0x7f0d84070370 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 -- 172.21.15.100:0/1356012720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 msgr2=0x7f0d840c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/1356012720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c2c30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f0d8406e550 tx=0x7f0d7c02bee0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 -- 172.21.15.100:0/1356012720 shutdown_connections 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/1356012720 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c2c30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/1356012720 >> v2:172.21.15.110:3300/0 conn(0x7f0d84151f60 0x7f0d840abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 -- 172.21.15.100:0/1356012720 >> 172.21.15.100:0/1356012720 conn(0x7f0d8406a5e0 msgr2=0x7f0d8406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 -- 172.21.15.100:0/1356012720 shutdown_connections 2024-01-20T08:11:09.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.950+0000 7f0d8ca00640 1 -- 172.21.15.100:0/1356012720 wait complete. 2024-01-20T08:11:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.951+0000 7f0d8ca00640 1 Processor -- start 2024-01-20T08:11:09.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 -- start start 2024-01-20T08:11:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d84147f20 0x7f0d8414c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84151f60 0x7f0d841ea830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d841552d0 con 0x7f0d84070370 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d841ea050 con 0x7f0d84151f60 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.952+0000 7f0d8ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d84155570 con 0x7f0d84147f20 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60956/0 (socket says 172.21.15.100:60956) 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 -- 172.21.15.100:0/3011822140 learned_addr learned my addr 172.21.15.100:0/3011822140 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d89600640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d84147f20 0x7f0d8414c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8aa00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84151f60 0x7f0d841ea830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 -- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d84147f20 msgr2=0x7f0d8414c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d84147f20 0x7f0d8414c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 -- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84151f60 msgr2=0x7f0d841ea830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84151f60 0x7f0d841ea830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 -- 172.21.15.100:0/3011822140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c009b30 con 0x7f0d84070370 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.953+0000 7f0d8a000640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c430 tx=0x7f0d7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.954+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011790 con 0x7f0d84070370 2024-01-20T08:11:09.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.954+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d740118f0 con 0x7f0d84070370 2024-01-20T08:11:09.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.954+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d74011ce0 con 0x7f0d84070370 2024-01-20T08:11:09.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.954+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d84155850 con 0x7f0d84070370 2024-01-20T08:11:09.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.954+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8414c720 con 0x7f0d84070370 2024-01-20T08:11:09.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.955+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d841ea550 con 0x7f0d84070370 2024-01-20T08:11:09.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.956+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0d7401c460 con 0x7f0d84070370 2024-01-20T08:11:09.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.957+0000 7f0d82000640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 0x7f0d5c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:09.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.957+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d74089550 con 0x7f0d84070370 2024-01-20T08:11:09.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.957+0000 7f0d89600640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 0x7f0d5c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:09.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.958+0000 7f0d89600640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 0x7f0d5c06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d84151700 tx=0x7f0d6c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:09.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:09.962+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0d74054410 con 0x7f0d84070370 2024-01-20T08:11:10.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.150+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d841556e0 con 0x7f0d5c06af00 2024-01-20T08:11:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.165+0000 7f0d82000640 1 -- 172.21.15.100:0/3011822140 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286518 (secure 0 0 0) 0x7f0d841556e0 con 0x7f0d5c06af00 2024-01-20T08:11:10.172 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:10.173 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:11:10.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 msgr2=0x7f0d5c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 0x7f0d5c06d3c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0d84151700 tx=0x7f0d6c008040 comp rx=0 tx=0).stop 2024-01-20T08:11:10.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 msgr2=0x7f0d840c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0d7400c430 tx=0x7f0d7400c8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 shutdown_connections 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d84151f60 0x7f0d841ea830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d5c06af00 0x7f0d5c06d3c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d84147f20 0x7f0d8414c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 --2- 172.21.15.100:0/3011822140 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d84070370 0x7f0d840c4ff0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 >> 172.21.15.100:0/3011822140 conn(0x7f0d8406a5e0 msgr2=0x7f0d84070990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 shutdown_connections 2024-01-20T08:11:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.171+0000 7f0d8ca00640 1 -- 172.21.15.100:0/3011822140 wait complete. 2024-01-20T08:11:10.192 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-01-20T08:11:09.903171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":93,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236928,"kb_used_data":4108,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737792,"statfs":{"total":773094113280,"available":772851499008,"internally_reserved":0,"allocated":4206592,"data_stored":2323099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001430"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278142+0000","last_change":"2024-01-20T08:11:05.275929+0000","last_active":"2024-01-20T08:11:05.278142+0000","last_peered":"2024-01-20T08:11:05.278142+0000","last_clean":"2024-01-20T08:11:05.278142+0000","last_became_active":"2024-01-20T08:11:05.275558+0000","last_became_peered":"2024-01-20T08:11:05.275558+0000","last_unstale":"2024-01-20T08:11:05.278142+0000","last_undegraded":"2024-01-20T08:11:05.278142+0000","last_fullsized":"2024-01-20T08:11:05.278142+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275023+0000","last_change":"2024-01-20T08:11:05.268340+0000","last_active":"2024-01-20T08:11:05.275023+0000","last_peered":"2024-01-20T08:11:05.275023+0000","last_clean":"2024-01-20T08:11:05.275023+0000","last_became_active":"2024-01-20T08:11:05.268008+0000","last_became_peered":"2024-01-20T08:11:05.268008+0000","last_unstale":"2024-01-20T08:11:05.275023+0000","last_undegraded":"2024-01-20T08:11:05.275023+0000","last_fullsized":"2024-01-20T08:11:05.275023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274753+0000","last_change":"2024-01-20T08:11:05.263675+0000","last_active":"2024-01-20T08:11:05.274753+0000","last_peered":"2024-01-20T08:11:05.274753+0000","last_clean":"2024-01-20T08:11:05.274753+0000","last_became_active":"2024-01-20T08:11:05.262876+0000","last_became_peered":"2024-01-20T08:11:05.262876+0000","last_unstale":"2024-01-20T08:11:05.274753+0000","last_undegraded":"2024-01-20T08:11:05.274753+0000","last_fullsized":"2024-01-20T08:11:05.274753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283627+0000","last_change":"2024-01-20T08:11:05.276439+0000","last_active":"2024-01-20T08:11:05.283627+0000","last_peered":"2024-01-20T08:11:05.283627+0000","last_clean":"2024-01-20T08:11:05.283627+0000","last_became_active":"2024-01-20T08:11:05.273677+0000","last_became_peered":"2024-01-20T08:11:05.273677+0000","last_unstale":"2024-01-20T08:11:05.283627+0000","last_undegraded":"2024-01-20T08:11:05.283627+0000","last_fullsized":"2024-01-20T08:11:05.283627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271402+0000","last_change":"2024-01-20T08:11:05.263742+0000","last_active":"2024-01-20T08:11:05.271402+0000","last_peered":"2024-01-20T08:11:05.271402+0000","last_clean":"2024-01-20T08:11:05.271402+0000","last_became_active":"2024-01-20T08:11:05.263437+0000","last_became_peered":"2024-01-20T08:11:05.263437+0000","last_unstale":"2024-01-20T08:11:05.271402+0000","last_undegraded":"2024-01-20T08:11:05.271402+0000","last_fullsized":"2024-01-20T08:11:05.271402+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:26:30.930826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271798+0000","last_change":"2024-01-20T08:11:05.258827+0000","last_active":"2024-01-20T08:11:05.271798+0000","last_peered":"2024-01-20T08:11:05.271798+0000","last_clean":"2024-01-20T08:11:05.271798+0000","last_became_active":"2024-01-20T08:11:05.257441+0000","last_became_peered":"2024-01-20T08:11:05.257441+0000","last_unstale":"2024-01-20T08:11:05.271798+0000","last_undegraded":"2024-01-20T08:11:05.271798+0000","last_fullsized":"2024-01-20T08:11:05.271798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273405+0000","last_change":"2024-01-20T08:11:05.269037+0000","last_active":"2024-01-20T08:11:05.273405+0000","last_peered":"2024-01-20T08:11:05.273405+0000","last_clean":"2024-01-20T08:11:05.273405+0000","last_became_active":"2024-01-20T08:11:05.268712+0000","last_became_peered":"2024-01-20T08:11:05.268712+0000","last_unstale":"2024-01-20T08:11:05.273405+0000","last_undegraded":"2024-01-20T08:11:05.273405+0000","last_fullsized":"2024-01-20T08:11:05.273405+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275410+0000","last_change":"2024-01-20T08:11:05.266849+0000","last_active":"2024-01-20T08:11:05.275410+0000","last_peered":"2024-01-20T08:11:05.275410+0000","last_clean":"2024-01-20T08:11:05.275410+0000","last_became_active":"2024-01-20T08:11:05.265215+0000","last_became_peered":"2024-01-20T08:11:05.265215+0000","last_unstale":"2024-01-20T08:11:05.275410+0000","last_undegraded":"2024-01-20T08:11:05.275410+0000","last_fullsized":"2024-01-20T08:11:05.275410+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269786+0000","last_change":"2024-01-20T08:11:05.263501+0000","last_active":"2024-01-20T08:11:05.269786+0000","last_peered":"2024-01-20T08:11:05.269786+0000","last_clean":"2024-01-20T08:11:05.269786+0000","last_became_active":"2024-01-20T08:11:05.263158+0000","last_became_peered":"2024-01-20T08:11:05.263158+0000","last_unstale":"2024-01-20T08:11:05.269786+0000","last_undegraded":"2024-01-20T08:11:05.269786+0000","last_fullsized":"2024-01-20T08:11:05.269786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:00.670692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277541+0000","last_change":"2024-01-20T08:11:05.269484+0000","last_active":"2024-01-20T08:11:05.277541+0000","last_peered":"2024-01-20T08:11:05.277541+0000","last_clean":"2024-01-20T08:11:05.277541+0000","last_became_active":"2024-01-20T08:11:05.269195+0000","last_became_peered":"2024-01-20T08:11:05.269195+0000","last_unstale":"2024-01-20T08:11:05.277541+0000","last_undegraded":"2024-01-20T08:11:05.277541+0000","last_fullsized":"2024-01-20T08:11:05.277541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278568+0000","last_change":"2024-01-20T08:11:05.272142+0000","last_active":"2024-01-20T08:11:05.278568+0000","last_peered":"2024-01-20T08:11:05.278568+0000","last_clean":"2024-01-20T08:11:05.278568+0000","last_became_active":"2024-01-20T08:11:05.271469+0000","last_became_peered":"2024-01-20T08:11:05.271469+0000","last_unstale":"2024-01-20T08:11:05.278568+0000","last_undegraded":"2024-01-20T08:11:05.278568+0000","last_fullsized":"2024-01-20T08:11:05.278568+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274748+0000","last_change":"2024-01-20T08:11:05.267733+0000","last_active":"2024-01-20T08:11:05.274748+0000","last_peered":"2024-01-20T08:11:05.274748+0000","last_clean":"2024-01-20T08:11:05.274748+0000","last_became_active":"2024-01-20T08:11:05.267455+0000","last_became_peered":"2024-01-20T08:11:05.267455+0000","last_unstale":"2024-01-20T08:11:05.274748+0000","last_undegraded":"2024-01-20T08:11:05.274748+0000","last_fullsized":"2024-01-20T08:11:05.274748+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269296+0000","last_change":"2024-01-20T08:11:05.259975+0000","last_active":"2024-01-20T08:11:05.269296+0000","last_peered":"2024-01-20T08:11:05.269296+0000","last_clean":"2024-01-20T08:11:05.269296+0000","last_became_active":"2024-01-20T08:11:05.259444+0000","last_became_peered":"2024-01-20T08:11:05.259444+0000","last_unstale":"2024-01-20T08:11:05.269296+0000","last_undegraded":"2024-01-20T08:11:05.269296+0000","last_fullsized":"2024-01-20T08:11:05.269296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:11:51.908895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270353+0000","last_change":"2024-01-20T08:11:05.258558+0000","last_active":"2024-01-20T08:11:05.270353+0000","last_peered":"2024-01-20T08:11:05.270353+0000","last_clean":"2024-01-20T08:11:05.270353+0000","last_became_active":"2024-01-20T08:11:05.253870+0000","last_became_peered":"2024-01-20T08:11:05.253870+0000","last_unstale":"2024-01-20T08:11:05.270353+0000","last_undegraded":"2024-01-20T08:11:05.270353+0000","last_fullsized":"2024-01-20T08:11:05.270353+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275099+0000","last_change":"2024-01-20T08:11:05.262066+0000","last_active":"2024-01-20T08:11:05.275099+0000","last_peered":"2024-01-20T08:11:05.275099+0000","last_clean":"2024-01-20T08:11:05.275099+0000","last_became_active":"2024-01-20T08:11:05.261204+0000","last_became_peered":"2024-01-20T08:11:05.261204+0000","last_unstale":"2024-01-20T08:11:05.275099+0000","last_undegraded":"2024-01-20T08:11:05.275099+0000","last_fullsized":"2024-01-20T08:11:05.275099+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280032+0000","last_change":"2024-01-20T08:11:05.276118+0000","last_active":"2024-01-20T08:11:05.280032+0000","last_peered":"2024-01-20T08:11:05.280032+0000","last_clean":"2024-01-20T08:11:05.280032+0000","last_became_active":"2024-01-20T08:11:05.273797+0000","last_became_peered":"2024-01-20T08:11:05.273797+0000","last_unstale":"2024-01-20T08:11:05.280032+0000","last_undegraded":"2024-01-20T08:11:05.280032+0000","last_fullsized":"2024-01-20T08:11:05.280032+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273371+0000","last_change":"2024-01-20T08:11:05.271502+0000","last_active":"2024-01-20T08:11:05.273371+0000","last_peered":"2024-01-20T08:11:05.273371+0000","last_clean":"2024-01-20T08:11:05.273371+0000","last_became_active":"2024-01-20T08:11:05.271187+0000","last_became_peered":"2024-01-20T08:11:05.271187+0000","last_unstale":"2024-01-20T08:11:05.273371+0000","last_undegraded":"2024-01-20T08:11:05.273371+0000","last_fullsized":"2024-01-20T08:11:05.273371+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269406+0000","last_change":"2024-01-20T08:11:05.258329+0000","last_active":"2024-01-20T08:11:05.269406+0000","last_peered":"2024-01-20T08:11:05.269406+0000","last_clean":"2024-01-20T08:11:05.269406+0000","last_became_active":"2024-01-20T08:11:05.258043+0000","last_became_peered":"2024-01-20T08:11:05.258043+0000","last_unstale":"2024-01-20T08:11:05.269406+0000","last_undegraded":"2024-01-20T08:11:05.269406+0000","last_fullsized":"2024-01-20T08:11:05.269406+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273257+0000","last_change":"2024-01-20T08:11:05.261388+0000","last_active":"2024-01-20T08:11:05.273257+0000","last_peered":"2024-01-20T08:11:05.273257+0000","last_clean":"2024-01-20T08:11:05.273257+0000","last_became_active":"2024-01-20T08:11:05.260589+0000","last_became_peered":"2024-01-20T08:11:05.260589+0000","last_unstale":"2024-01-20T08:11:05.273257+0000","last_undegraded":"2024-01-20T08:11:05.273257+0000","last_fullsized":"2024-01-20T08:11:05.273257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272042+0000","last_change":"2024-01-20T08:11:05.269680+0000","last_active":"2024-01-20T08:11:05.272042+0000","last_peered":"2024-01-20T08:11:05.272042+0000","last_clean":"2024-01-20T08:11:05.272042+0000","last_became_active":"2024-01-20T08:11:05.269407+0000","last_became_peered":"2024-01-20T08:11:05.269407+0000","last_unstale":"2024-01-20T08:11:05.272042+0000","last_undegraded":"2024-01-20T08:11:05.272042+0000","last_fullsized":"2024-01-20T08:11:05.272042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:38.945306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271604+0000","last_change":"2024-01-20T08:11:05.264644+0000","last_active":"2024-01-20T08:11:05.271604+0000","last_peered":"2024-01-20T08:11:05.271604+0000","last_clean":"2024-01-20T08:11:05.271604+0000","last_became_active":"2024-01-20T08:11:05.264067+0000","last_became_peered":"2024-01-20T08:11:05.264067+0000","last_unstale":"2024-01-20T08:11:05.271604+0000","last_undegraded":"2024-01-20T08:11:05.271604+0000","last_fullsized":"2024-01-20T08:11:05.271604+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.263125+0000","last_change":"2024-01-20T08:11:05.258143+0000","last_active":"2024-01-20T08:11:05.263125+0000","last_peered":"2024-01-20T08:11:05.263125+0000","last_clean":"2024-01-20T08:11:05.263125+0000","last_became_active":"2024-01-20T08:11:05.257144+0000","last_became_peered":"2024-01-20T08:11:05.257144+0000","last_unstale":"2024-01-20T08:11:05.263125+0000","last_undegraded":"2024-01-20T08:11:05.263125+0000","last_fullsized":"2024-01-20T08:11:05.263125+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:50.261683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270383+0000","last_change":"2024-01-20T08:11:05.264328+0000","last_active":"2024-01-20T08:11:05.270383+0000","last_peered":"2024-01-20T08:11:05.270383+0000","last_clean":"2024-01-20T08:11:05.270383+0000","last_became_active":"2024-01-20T08:11:05.263991+0000","last_became_peered":"2024-01-20T08:11:05.263991+0000","last_unstale":"2024-01-20T08:11:05.270383+0000","last_undegraded":"2024-01-20T08:11:05.270383+0000","last_fullsized":"2024-01-20T08:11:05.270383+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274828+0000","last_change":"2024-01-20T08:11:05.256694+0000","last_active":"2024-01-20T08:11:05.274828+0000","last_peered":"2024-01-20T08:11:05.274828+0000","last_clean":"2024-01-20T08:11:05.274828+0000","last_became_active":"2024-01-20T08:11:05.256285+0000","last_became_peered":"2024-01-20T08:11:05.256285+0000","last_unstale":"2024-01-20T08:11:05.274828+0000","last_undegraded":"2024-01-20T08:11:05.274828+0000","last_fullsized":"2024-01-20T08:11:05.274828+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278098+0000","last_change":"2024-01-20T08:11:05.266720+0000","last_active":"2024-01-20T08:11:05.278098+0000","last_peered":"2024-01-20T08:11:05.278098+0000","last_clean":"2024-01-20T08:11:05.278098+0000","last_became_active":"2024-01-20T08:11:05.266340+0000","last_became_peered":"2024-01-20T08:11:05.266340+0000","last_unstale":"2024-01-20T08:11:05.278098+0000","last_undegraded":"2024-01-20T08:11:05.278098+0000","last_fullsized":"2024-01-20T08:11:05.278098+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269386+0000","last_change":"2024-01-20T08:11:05.257696+0000","last_active":"2024-01-20T08:11:05.269386+0000","last_peered":"2024-01-20T08:11:05.269386+0000","last_clean":"2024-01-20T08:11:05.269386+0000","last_became_active":"2024-01-20T08:11:05.257432+0000","last_became_peered":"2024-01-20T08:11:05.257432+0000","last_unstale":"2024-01-20T08:11:05.269386+0000","last_undegraded":"2024-01-20T08:11:05.269386+0000","last_fullsized":"2024-01-20T08:11:05.269386+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.282399+0000","last_change":"2024-01-20T08:11:05.274284+0000","last_active":"2024-01-20T08:11:05.282399+0000","last_peered":"2024-01-20T08:11:05.282399+0000","last_clean":"2024-01-20T08:11:05.282399+0000","last_became_active":"2024-01-20T08:11:05.274004+0000","last_became_peered":"2024-01-20T08:11:05.274004+0000","last_unstale":"2024-01-20T08:11:05.282399+0000","last_undegraded":"2024-01-20T08:11:05.282399+0000","last_fullsized":"2024-01-20T08:11:05.282399+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277254+0000","last_change":"2024-01-20T08:11:05.273526+0000","last_active":"2024-01-20T08:11:05.277254+0000","last_peered":"2024-01-20T08:11:05.277254+0000","last_clean":"2024-01-20T08:11:05.277254+0000","last_became_active":"2024-01-20T08:11:05.273257+0000","last_became_peered":"2024-01-20T08:11:05.273257+0000","last_unstale":"2024-01-20T08:11:05.277254+0000","last_undegraded":"2024-01-20T08:11:05.277254+0000","last_fullsized":"2024-01-20T08:11:05.277254+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.261161+0000","last_change":"2024-01-20T08:11:05.253163+0000","last_active":"2024-01-20T08:11:05.261161+0000","last_peered":"2024-01-20T08:11:05.261161+0000","last_clean":"2024-01-20T08:11:05.261161+0000","last_became_active":"2024-01-20T08:11:05.252357+0000","last_became_peered":"2024-01-20T08:11:05.252357+0000","last_unstale":"2024-01-20T08:11:05.261161+0000","last_undegraded":"2024-01-20T08:11:05.261161+0000","last_fullsized":"2024-01-20T08:11:05.261161+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:46.615565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273345+0000","last_change":"2024-01-20T08:11:05.267754+0000","last_active":"2024-01-20T08:11:05.273345+0000","last_peered":"2024-01-20T08:11:05.273345+0000","last_clean":"2024-01-20T08:11:05.273345+0000","last_became_active":"2024-01-20T08:11:05.267459+0000","last_became_peered":"2024-01-20T08:11:05.267459+0000","last_unstale":"2024-01-20T08:11:05.273345+0000","last_undegraded":"2024-01-20T08:11:05.273345+0000","last_fullsized":"2024-01-20T08:11:05.273345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.278222+0000","last_change":"2024-01-20T08:11:05.274553+0000","last_active":"2024-01-20T08:11:05.278222+0000","last_peered":"2024-01-20T08:11:05.278222+0000","last_clean":"2024-01-20T08:11:05.278222+0000","last_became_active":"2024-01-20T08:11:05.272535+0000","last_became_peered":"2024-01-20T08:11:05.272535+0000","last_unstale":"2024-01-20T08:11:05.278222+0000","last_undegraded":"2024-01-20T08:11:05.278222+0000","last_fullsized":"2024-01-20T08:11:05.278222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271593+0000","last_change":"2024-01-20T08:11:05.264877+0000","last_active":"2024-01-20T08:11:05.271593+0000","last_peered":"2024-01-20T08:11:05.271593+0000","last_clean":"2024-01-20T08:11:05.271593+0000","last_became_active":"2024-01-20T08:11:05.260771+0000","last_became_peered":"2024-01-20T08:11:05.260771+0000","last_unstale":"2024-01-20T08:11:05.271593+0000","last_undegraded":"2024-01-20T08:11:05.271593+0000","last_fullsized":"2024-01-20T08:11:05.271593+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.270478+0000","last_change":"2024-01-20T08:11:05.264962+0000","last_active":"2024-01-20T08:11:05.270478+0000","last_peered":"2024-01-20T08:11:05.270478+0000","last_clean":"2024-01-20T08:11:05.270478+0000","last_became_active":"2024-01-20T08:11:05.264693+0000","last_became_peered":"2024-01-20T08:11:05.264693+0000","last_unstale":"2024-01-20T08:11:05.270478+0000","last_undegraded":"2024-01-20T08:11:05.270478+0000","last_fullsized":"2024-01-20T08:11:05.270478+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277905+0000","last_change":"2024-01-20T08:11:04.244349+0000","last_active":"2024-01-20T08:11:05.277905+0000","last_peered":"2024-01-20T08:11:05.277905+0000","last_clean":"2024-01-20T08:11:05.277905+0000","last_became_active":"2024-01-20T08:11:04.244029+0000","last_became_peered":"2024-01-20T08:11:04.244029+0000","last_unstale":"2024-01-20T08:11:05.277905+0000","last_undegraded":"2024-01-20T08:11:05.277905+0000","last_fullsized":"2024-01-20T08:11:05.277905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274025+0000","last_change":"2024-01-20T08:11:05.267631+0000","last_active":"2024-01-20T08:11:05.274025+0000","last_peered":"2024-01-20T08:11:05.274025+0000","last_clean":"2024-01-20T08:11:05.274025+0000","last_became_active":"2024-01-20T08:11:05.267310+0000","last_became_peered":"2024-01-20T08:11:05.267310+0000","last_unstale":"2024-01-20T08:11:05.274025+0000","last_undegraded":"2024-01-20T08:11:05.274025+0000","last_fullsized":"2024-01-20T08:11:05.274025+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:00.670692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280190+0000","last_change":"2024-01-20T08:11:04.238741+0000","last_active":"2024-01-20T08:11:05.280190+0000","last_peered":"2024-01-20T08:11:05.280190+0000","last_clean":"2024-01-20T08:11:05.280190+0000","last_became_active":"2024-01-20T08:11:04.238272+0000","last_became_peered":"2024-01-20T08:11:04.238272+0000","last_unstale":"2024-01-20T08:11:05.280190+0000","last_undegraded":"2024-01-20T08:11:05.280190+0000","last_fullsized":"2024-01-20T08:11:05.280190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269315+0000","last_change":"2024-01-20T08:11:05.261271+0000","last_active":"2024-01-20T08:11:05.269315+0000","last_peered":"2024-01-20T08:11:05.269315+0000","last_clean":"2024-01-20T08:11:05.269315+0000","last_became_active":"2024-01-20T08:11:05.258484+0000","last_became_peered":"2024-01-20T08:11:05.258484+0000","last_unstale":"2024-01-20T08:11:05.269315+0000","last_undegraded":"2024-01-20T08:11:05.269315+0000","last_fullsized":"2024-01-20T08:11:05.269315+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:10.236082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.285301+0000","last_change":"2024-01-20T08:11:04.227503+0000","last_active":"2024-01-20T08:11:05.285301+0000","last_peered":"2024-01-20T08:11:05.285301+0000","last_clean":"2024-01-20T08:11:05.285301+0000","last_became_active":"2024-01-20T08:11:04.227241+0000","last_became_peered":"2024-01-20T08:11:04.227241+0000","last_unstale":"2024-01-20T08:11:05.285301+0000","last_undegraded":"2024-01-20T08:11:05.285301+0000","last_fullsized":"2024-01-20T08:11:05.285301+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:45.729946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.282380+0000","last_change":"2024-01-20T08:11:05.273419+0000","last_active":"2024-01-20T08:11:05.282380+0000","last_peered":"2024-01-20T08:11:05.282380+0000","last_clean":"2024-01-20T08:11:05.282380+0000","last_became_active":"2024-01-20T08:11:05.273110+0000","last_became_peered":"2024-01-20T08:11:05.273110+0000","last_unstale":"2024-01-20T08:11:05.282380+0000","last_undegraded":"2024-01-20T08:11:05.282380+0000","last_fullsized":"2024-01-20T08:11:05.282380+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.284290+0000","last_change":"2024-01-20T08:11:04.227383+0000","last_active":"2024-01-20T08:11:05.284290+0000","last_peered":"2024-01-20T08:11:05.284290+0000","last_clean":"2024-01-20T08:11:05.284290+0000","last_became_active":"2024-01-20T08:11:04.227109+0000","last_became_peered":"2024-01-20T08:11:04.227109+0000","last_unstale":"2024-01-20T08:11:05.284290+0000","last_undegraded":"2024-01-20T08:11:05.284290+0000","last_fullsized":"2024-01-20T08:11:05.284290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:04:40.346500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273326+0000","last_change":"2024-01-20T08:11:05.267543+0000","last_active":"2024-01-20T08:11:05.273326+0000","last_peered":"2024-01-20T08:11:05.273326+0000","last_clean":"2024-01-20T08:11:05.273326+0000","last_became_active":"2024-01-20T08:11:05.267013+0000","last_became_peered":"2024-01-20T08:11:05.267013+0000","last_unstale":"2024-01-20T08:11:05.273326+0000","last_undegraded":"2024-01-20T08:11:05.273326+0000","last_fullsized":"2024-01-20T08:11:05.273326+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281754+0000","last_change":"2024-01-20T08:11:04.234921+0000","last_active":"2024-01-20T08:11:05.281754+0000","last_peered":"2024-01-20T08:11:05.281754+0000","last_clean":"2024-01-20T08:11:05.281754+0000","last_became_active":"2024-01-20T08:11:04.232868+0000","last_became_peered":"2024-01-20T08:11:04.232868+0000","last_unstale":"2024-01-20T08:11:05.281754+0000","last_undegraded":"2024-01-20T08:11:05.281754+0000","last_fullsized":"2024-01-20T08:11:05.281754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:57.342375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274667+0000","last_change":"2024-01-20T08:11:05.261155+0000","last_active":"2024-01-20T08:11:05.274667+0000","last_peered":"2024-01-20T08:11:05.274667+0000","last_clean":"2024-01-20T08:11:05.274667+0000","last_became_active":"2024-01-20T08:11:05.260746+0000","last_became_peered":"2024-01-20T08:11:05.260746+0000","last_unstale":"2024-01-20T08:11:05.274667+0000","last_undegraded":"2024-01-20T08:11:05.274667+0000","last_fullsized":"2024-01-20T08:11:05.274667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281734+0000","last_change":"2024-01-20T08:11:04.233438+0000","last_active":"2024-01-20T08:11:05.281734+0000","last_peered":"2024-01-20T08:11:05.281734+0000","last_clean":"2024-01-20T08:11:05.281734+0000","last_became_active":"2024-01-20T08:11:04.232954+0000","last_became_peered":"2024-01-20T08:11:04.232954+0000","last_unstale":"2024-01-20T08:11:05.281734+0000","last_undegraded":"2024-01-20T08:11:05.281734+0000","last_fullsized":"2024-01-20T08:11:05.281734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:49.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271541+0000","last_change":"2024-01-20T08:11:05.265947+0000","last_active":"2024-01-20T08:11:05.271541+0000","last_peered":"2024-01-20T08:11:05.271541+0000","last_clean":"2024-01-20T08:11:05.271541+0000","last_became_active":"2024-01-20T08:11:05.265674+0000","last_became_peered":"2024-01-20T08:11:05.265674+0000","last_unstale":"2024-01-20T08:11:05.271541+0000","last_undegraded":"2024-01-20T08:11:05.271541+0000","last_fullsized":"2024-01-20T08:11:05.271541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.244779+0000","last_change":"2024-01-20T08:11:04.228883+0000","last_active":"2024-01-20T08:11:05.244779+0000","last_peered":"2024-01-20T08:11:05.244779+0000","last_clean":"2024-01-20T08:11:05.244779+0000","last_became_active":"2024-01-20T08:11:04.228077+0000","last_became_peered":"2024-01-20T08:11:04.228077+0000","last_unstale":"2024-01-20T08:11:05.244779+0000","last_undegraded":"2024-01-20T08:11:05.244779+0000","last_fullsized":"2024-01-20T08:11:05.244779+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280616+0000","last_change":"2024-01-20T08:11:05.270984+0000","last_active":"2024-01-20T08:11:05.280616+0000","last_peered":"2024-01-20T08:11:05.280616+0000","last_clean":"2024-01-20T08:11:05.280616+0000","last_became_active":"2024-01-20T08:11:05.270740+0000","last_became_peered":"2024-01-20T08:11:05.270740+0000","last_unstale":"2024-01-20T08:11:05.280616+0000","last_undegraded":"2024-01-20T08:11:05.280616+0000","last_fullsized":"2024-01-20T08:11:05.280616+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.236376+0000","last_change":"2024-01-20T08:11:04.238159+0000","last_active":"2024-01-20T08:11:05.236376+0000","last_peered":"2024-01-20T08:11:05.236376+0000","last_clean":"2024-01-20T08:11:05.236376+0000","last_became_active":"2024-01-20T08:11:04.237894+0000","last_became_peered":"2024-01-20T08:11:04.237894+0000","last_unstale":"2024-01-20T08:11:05.236376+0000","last_undegraded":"2024-01-20T08:11:05.236376+0000","last_fullsized":"2024-01-20T08:11:05.236376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:15.898827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.275017+0000","last_change":"2024-01-20T08:11:05.270395+0000","last_active":"2024-01-20T08:11:05.275017+0000","last_peered":"2024-01-20T08:11:05.275017+0000","last_clean":"2024-01-20T08:11:05.275017+0000","last_became_active":"2024-01-20T08:11:05.269778+0000","last_became_peered":"2024-01-20T08:11:05.269778+0000","last_unstale":"2024-01-20T08:11:05.275017+0000","last_undegraded":"2024-01-20T08:11:05.275017+0000","last_fullsized":"2024-01-20T08:11:05.275017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.247355+0000","last_change":"2024-01-20T08:11:04.238975+0000","last_active":"2024-01-20T08:11:05.247355+0000","last_peered":"2024-01-20T08:11:05.247355+0000","last_clean":"2024-01-20T08:11:05.247355+0000","last_became_active":"2024-01-20T08:11:04.238626+0000","last_became_peered":"2024-01-20T08:11:04.238626+0000","last_unstale":"2024-01-20T08:11:05.247355+0000","last_undegraded":"2024-01-20T08:11:05.247355+0000","last_fullsized":"2024-01-20T08:11:05.247355+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:35.183036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277339+0000","last_change":"2024-01-20T08:11:05.271640+0000","last_active":"2024-01-20T08:11:05.277339+0000","last_peered":"2024-01-20T08:11:05.277339+0000","last_clean":"2024-01-20T08:11:05.277339+0000","last_became_active":"2024-01-20T08:11:05.271380+0000","last_became_peered":"2024-01-20T08:11:05.271380+0000","last_unstale":"2024-01-20T08:11:05.277339+0000","last_undegraded":"2024-01-20T08:11:05.277339+0000","last_fullsized":"2024-01-20T08:11:05.277339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.254589+0000","last_change":"2024-01-20T08:11:04.231597+0000","last_active":"2024-01-20T08:11:05.254589+0000","last_peered":"2024-01-20T08:11:05.254589+0000","last_clean":"2024-01-20T08:11:05.254589+0000","last_became_active":"2024-01-20T08:11:04.231265+0000","last_became_peered":"2024-01-20T08:11:04.231265+0000","last_unstale":"2024-01-20T08:11:05.254589+0000","last_undegraded":"2024-01-20T08:11:05.254589+0000","last_fullsized":"2024-01-20T08:11:05.254589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.263525+0000","last_change":"2024-01-20T08:11:05.254926+0000","last_active":"2024-01-20T08:11:05.263525+0000","last_peered":"2024-01-20T08:11:05.263525+0000","last_clean":"2024-01-20T08:11:05.263525+0000","last_became_active":"2024-01-20T08:11:05.254655+0000","last_became_peered":"2024-01-20T08:11:05.254655+0000","last_unstale":"2024-01-20T08:11:05.263525+0000","last_undegraded":"2024-01-20T08:11:05.263525+0000","last_fullsized":"2024-01-20T08:11:05.263525+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280169+0000","last_change":"2024-01-20T08:11:04.240118+0000","last_active":"2024-01-20T08:11:05.280169+0000","last_peered":"2024-01-20T08:11:05.280169+0000","last_clean":"2024-01-20T08:11:05.280169+0000","last_became_active":"2024-01-20T08:11:04.239850+0000","last_became_peered":"2024-01-20T08:11:04.239850+0000","last_unstale":"2024-01-20T08:11:05.280169+0000","last_undegraded":"2024-01-20T08:11:05.280169+0000","last_fullsized":"2024-01-20T08:11:05.280169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274768+0000","last_change":"2024-01-20T08:11:05.264063+0000","last_active":"2024-01-20T08:11:05.274768+0000","last_peered":"2024-01-20T08:11:05.274768+0000","last_clean":"2024-01-20T08:11:05.274768+0000","last_became_active":"2024-01-20T08:11:05.263343+0000","last_became_peered":"2024-01-20T08:11:05.263343+0000","last_unstale":"2024-01-20T08:11:05.274768+0000","last_undegraded":"2024-01-20T08:11:05.274768+0000","last_fullsized":"2024-01-20T08:11:05.274768+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.289111+0000","last_change":"2024-01-20T08:11:04.229958+0000","last_active":"2024-01-20T08:11:05.289111+0000","last_peered":"2024-01-20T08:11:05.289111+0000","last_clean":"2024-01-20T08:11:05.289111+0000","last_became_active":"2024-01-20T08:11:04.229708+0000","last_became_peered":"2024-01-20T08:11:04.229708+0000","last_unstale":"2024-01-20T08:11:05.289111+0000","last_undegraded":"2024-01-20T08:11:05.289111+0000","last_fullsized":"2024-01-20T08:11:05.289111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:19.024894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283090+0000","last_change":"2024-01-20T08:11:05.277996+0000","last_active":"2024-01-20T08:11:05.283090+0000","last_peered":"2024-01-20T08:11:05.283090+0000","last_clean":"2024-01-20T08:11:05.283090+0000","last_became_active":"2024-01-20T08:11:05.277744+0000","last_became_peered":"2024-01-20T08:11:05.277744+0000","last_unstale":"2024-01-20T08:11:05.283090+0000","last_undegraded":"2024-01-20T08:11:05.283090+0000","last_fullsized":"2024-01-20T08:11:05.283090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.281396+0000","last_change":"2024-01-20T08:11:04.239053+0000","last_active":"2024-01-20T08:11:05.281396+0000","last_peered":"2024-01-20T08:11:05.281396+0000","last_clean":"2024-01-20T08:11:05.281396+0000","last_became_active":"2024-01-20T08:11:04.238709+0000","last_became_peered":"2024-01-20T08:11:04.238709+0000","last_unstale":"2024-01-20T08:11:05.281396+0000","last_undegraded":"2024-01-20T08:11:05.281396+0000","last_fullsized":"2024-01-20T08:11:05.281396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:27.855678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273800+0000","last_change":"2024-01-20T08:11:05.262683+0000","last_active":"2024-01-20T08:11:05.273800+0000","last_peered":"2024-01-20T08:11:05.273800+0000","last_clean":"2024-01-20T08:11:05.273800+0000","last_became_active":"2024-01-20T08:11:05.259731+0000","last_became_peered":"2024-01-20T08:11:05.259731+0000","last_unstale":"2024-01-20T08:11:05.273800+0000","last_undegraded":"2024-01-20T08:11:05.273800+0000","last_fullsized":"2024-01-20T08:11:05.273800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.260685+0000","last_change":"2024-01-20T08:11:04.240412+0000","last_active":"2024-01-20T08:11:05.260685+0000","last_peered":"2024-01-20T08:11:05.260685+0000","last_clean":"2024-01-20T08:11:05.260685+0000","last_became_active":"2024-01-20T08:11:04.240045+0000","last_became_peered":"2024-01-20T08:11:04.240045+0000","last_unstale":"2024-01-20T08:11:05.260685+0000","last_undegraded":"2024-01-20T08:11:05.260685+0000","last_fullsized":"2024-01-20T08:11:05.260685+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271507+0000","last_change":"2024-01-20T08:11:05.263329+0000","last_active":"2024-01-20T08:11:05.271507+0000","last_peered":"2024-01-20T08:11:05.271507+0000","last_clean":"2024-01-20T08:11:05.271507+0000","last_became_active":"2024-01-20T08:11:05.263049+0000","last_became_peered":"2024-01-20T08:11:05.263049+0000","last_unstale":"2024-01-20T08:11:05.271507+0000","last_undegraded":"2024-01-20T08:11:05.271507+0000","last_fullsized":"2024-01-20T08:11:05.271507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.243011+0000","last_change":"2024-01-20T08:11:04.238160+0000","last_active":"2024-01-20T08:11:05.243011+0000","last_peered":"2024-01-20T08:11:05.243011+0000","last_clean":"2024-01-20T08:11:05.243011+0000","last_became_active":"2024-01-20T08:11:04.237860+0000","last_became_peered":"2024-01-20T08:11:04.237860+0000","last_unstale":"2024-01-20T08:11:05.243011+0000","last_undegraded":"2024-01-20T08:11:05.243011+0000","last_fullsized":"2024-01-20T08:11:05.243011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274462+0000","last_change":"2024-01-20T08:11:05.266758+0000","last_active":"2024-01-20T08:11:05.274462+0000","last_peered":"2024-01-20T08:11:05.274462+0000","last_clean":"2024-01-20T08:11:05.274462+0000","last_became_active":"2024-01-20T08:11:05.265820+0000","last_became_peered":"2024-01-20T08:11:05.265820+0000","last_unstale":"2024-01-20T08:11:05.274462+0000","last_undegraded":"2024-01-20T08:11:05.274462+0000","last_fullsized":"2024-01-20T08:11:05.274462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:10.236082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.285858+0000","last_change":"2024-01-20T08:11:04.231466+0000","last_active":"2024-01-20T08:11:05.285858+0000","last_peered":"2024-01-20T08:11:05.285858+0000","last_clean":"2024-01-20T08:11:05.285858+0000","last_became_active":"2024-01-20T08:11:04.231224+0000","last_became_peered":"2024-01-20T08:11:04.231224+0000","last_unstale":"2024-01-20T08:11:05.285858+0000","last_undegraded":"2024-01-20T08:11:05.285858+0000","last_fullsized":"2024-01-20T08:11:05.285858+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274274+0000","last_change":"2024-01-20T08:11:05.269731+0000","last_active":"2024-01-20T08:11:05.274274+0000","last_peered":"2024-01-20T08:11:05.274274+0000","last_clean":"2024-01-20T08:11:05.274274+0000","last_became_active":"2024-01-20T08:11:05.269500+0000","last_became_peered":"2024-01-20T08:11:05.269500+0000","last_unstale":"2024-01-20T08:11:05.274274+0000","last_undegraded":"2024-01-20T08:11:05.274274+0000","last_fullsized":"2024-01-20T08:11:05.274274+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:33.470717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.286550+0000","last_change":"2024-01-20T08:11:04.241452+0000","last_active":"2024-01-20T08:11:05.286550+0000","last_peered":"2024-01-20T08:11:05.286550+0000","last_clean":"2024-01-20T08:11:05.286550+0000","last_became_active":"2024-01-20T08:11:04.240981+0000","last_became_peered":"2024-01-20T08:11:04.240981+0000","last_unstale":"2024-01-20T08:11:05.286550+0000","last_undegraded":"2024-01-20T08:11:05.286550+0000","last_fullsized":"2024-01-20T08:11:05.286550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269674+0000","last_change":"2024-01-20T08:11:05.254371+0000","last_active":"2024-01-20T08:11:05.269674+0000","last_peered":"2024-01-20T08:11:05.269674+0000","last_clean":"2024-01-20T08:11:05.269674+0000","last_became_active":"2024-01-20T08:11:05.253911+0000","last_became_peered":"2024-01-20T08:11:05.253911+0000","last_unstale":"2024-01-20T08:11:05.269674+0000","last_undegraded":"2024-01-20T08:11:05.269674+0000","last_fullsized":"2024-01-20T08:11:05.269674+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.280433+0000","last_change":"2024-01-20T08:11:04.240349+0000","last_active":"2024-01-20T08:11:05.280433+0000","last_peered":"2024-01-20T08:11:05.280433+0000","last_clean":"2024-01-20T08:11:05.280433+0000","last_became_active":"2024-01-20T08:11:04.240032+0000","last_became_peered":"2024-01-20T08:11:04.240032+0000","last_unstale":"2024-01-20T08:11:05.280433+0000","last_undegraded":"2024-01-20T08:11:05.280433+0000","last_fullsized":"2024-01-20T08:11:05.280433+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:27:52.299223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283522+0000","last_change":"2024-01-20T08:11:05.273938+0000","last_active":"2024-01-20T08:11:05.283522+0000","last_peered":"2024-01-20T08:11:05.283522+0000","last_clean":"2024-01-20T08:11:05.283522+0000","last_became_active":"2024-01-20T08:11:05.273244+0000","last_became_peered":"2024-01-20T08:11:05.273244+0000","last_unstale":"2024-01-20T08:11:05.283522+0000","last_undegraded":"2024-01-20T08:11:05.283522+0000","last_fullsized":"2024-01-20T08:11:05.283522+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283903+0000","last_change":"2024-01-20T08:11:04.228172+0000","last_active":"2024-01-20T08:11:05.283903+0000","last_peered":"2024-01-20T08:11:05.283903+0000","last_clean":"2024-01-20T08:11:05.283903+0000","last_became_active":"2024-01-20T08:11:04.227839+0000","last_became_peered":"2024-01-20T08:11:04.227839+0000","last_unstale":"2024-01-20T08:11:05.283903+0000","last_undegraded":"2024-01-20T08:11:05.283903+0000","last_fullsized":"2024-01-20T08:11:05.283903+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:09.878605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.262924+0000","last_change":"2024-01-20T08:11:05.256215+0000","last_active":"2024-01-20T08:11:05.262924+0000","last_peered":"2024-01-20T08:11:05.262924+0000","last_clean":"2024-01-20T08:11:05.262924+0000","last_became_active":"2024-01-20T08:11:05.255935+0000","last_became_peered":"2024-01-20T08:11:05.255935+0000","last_unstale":"2024-01-20T08:11:05.262924+0000","last_undegraded":"2024-01-20T08:11:05.262924+0000","last_fullsized":"2024-01-20T08:11:05.262924+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:44:08.288480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.237933+0000","last_change":"2024-01-20T08:11:04.231418+0000","last_active":"2024-01-20T08:11:05.237933+0000","last_peered":"2024-01-20T08:11:05.237933+0000","last_clean":"2024-01-20T08:11:05.237933+0000","last_became_active":"2024-01-20T08:11:04.231150+0000","last_became_peered":"2024-01-20T08:11:04.231150+0000","last_unstale":"2024-01-20T08:11:05.237933+0000","last_undegraded":"2024-01-20T08:11:05.237933+0000","last_fullsized":"2024-01-20T08:11:05.237933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:56.187386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.252208+0000","last_change":"2024-01-20T08:11:05.246307+0000","last_active":"2024-01-20T08:11:05.252208+0000","last_peered":"2024-01-20T08:11:05.252208+0000","last_clean":"2024-01-20T08:11:05.252208+0000","last_became_active":"2024-01-20T08:11:05.245686+0000","last_became_peered":"2024-01-20T08:11:05.245686+0000","last_unstale":"2024-01-20T08:11:05.252208+0000","last_undegraded":"2024-01-20T08:11:05.252208+0000","last_fullsized":"2024-01-20T08:11:05.252208+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:41:03.273241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.283408+0000","last_change":"2024-01-20T08:11:04.234512+0000","last_active":"2024-01-20T08:11:05.283408+0000","last_peered":"2024-01-20T08:11:05.283408+0000","last_clean":"2024-01-20T08:11:05.283408+0000","last_became_active":"2024-01-20T08:11:04.234175+0000","last_became_peered":"2024-01-20T08:11:04.234175+0000","last_unstale":"2024-01-20T08:11:05.283408+0000","last_undegraded":"2024-01-20T08:11:05.283408+0000","last_fullsized":"2024-01-20T08:11:05.283408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.269318+0000","last_change":"2024-01-20T08:11:05.260221+0000","last_active":"2024-01-20T08:11:05.269318+0000","last_peered":"2024-01-20T08:11:05.269318+0000","last_clean":"2024-01-20T08:11:05.269318+0000","last_became_active":"2024-01-20T08:11:05.259763+0000","last_became_peered":"2024-01-20T08:11:05.259763+0000","last_unstale":"2024-01-20T08:11:05.269318+0000","last_undegraded":"2024-01-20T08:11:05.269318+0000","last_fullsized":"2024-01-20T08:11:05.269318+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:38:59.747699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.253007+0000","last_change":"2024-01-20T08:11:04.241959+0000","last_active":"2024-01-20T08:11:05.253007+0000","last_peered":"2024-01-20T08:11:05.253007+0000","last_clean":"2024-01-20T08:11:05.253007+0000","last_became_active":"2024-01-20T08:11:04.241594+0000","last_became_peered":"2024-01-20T08:11:04.241594+0000","last_unstale":"2024-01-20T08:11:05.253007+0000","last_undegraded":"2024-01-20T08:11:05.253007+0000","last_fullsized":"2024-01-20T08:11:05.253007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:45.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272557+0000","last_change":"2024-01-20T08:11:05.264028+0000","last_active":"2024-01-20T08:11:05.272557+0000","last_peered":"2024-01-20T08:11:05.272557+0000","last_clean":"2024-01-20T08:11:05.272557+0000","last_became_active":"2024-01-20T08:11:05.263766+0000","last_became_peered":"2024-01-20T08:11:05.263766+0000","last_unstale":"2024-01-20T08:11:05.272557+0000","last_undegraded":"2024-01-20T08:11:05.272557+0000","last_fullsized":"2024-01-20T08:11:05.272557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:05:59.623887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.240405+0000","last_change":"2024-01-20T08:11:04.236898+0000","last_active":"2024-01-20T08:11:05.240405+0000","last_peered":"2024-01-20T08:11:05.240405+0000","last_clean":"2024-01-20T08:11:05.240405+0000","last_became_active":"2024-01-20T08:11:04.236608+0000","last_became_peered":"2024-01-20T08:11:04.236608+0000","last_unstale":"2024-01-20T08:11:05.240405+0000","last_undegraded":"2024-01-20T08:11:05.240405+0000","last_fullsized":"2024-01-20T08:11:05.240405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:47:19.869135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.273395+0000","last_change":"2024-01-20T08:11:05.268170+0000","last_active":"2024-01-20T08:11:05.273395+0000","last_peered":"2024-01-20T08:11:05.273395+0000","last_clean":"2024-01-20T08:11:05.273395+0000","last_became_active":"2024-01-20T08:11:05.267444+0000","last_became_peered":"2024-01-20T08:11:05.267444+0000","last_unstale":"2024-01-20T08:11:05.273395+0000","last_undegraded":"2024-01-20T08:11:05.273395+0000","last_fullsized":"2024-01-20T08:11:05.273395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.244368+0000","last_change":"2024-01-20T08:11:04.243302+0000","last_active":"2024-01-20T08:11:05.244368+0000","last_peered":"2024-01-20T08:11:05.244368+0000","last_clean":"2024-01-20T08:11:05.244368+0000","last_became_active":"2024-01-20T08:11:04.243105+0000","last_became_peered":"2024-01-20T08:11:04.243105+0000","last_unstale":"2024-01-20T08:11:05.244368+0000","last_undegraded":"2024-01-20T08:11:05.244368+0000","last_fullsized":"2024-01-20T08:11:05.244368+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272221+0000","last_change":"2024-01-20T08:11:05.269356+0000","last_active":"2024-01-20T08:11:05.272221+0000","last_peered":"2024-01-20T08:11:05.272221+0000","last_clean":"2024-01-20T08:11:05.272221+0000","last_became_active":"2024-01-20T08:11:05.269074+0000","last_became_peered":"2024-01-20T08:11:05.269074+0000","last_unstale":"2024-01-20T08:11:05.272221+0000","last_undegraded":"2024-01-20T08:11:05.272221+0000","last_fullsized":"2024-01-20T08:11:05.272221+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:37:35.488913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.284864+0000","last_change":"2024-01-20T08:11:04.242771+0000","last_active":"2024-01-20T08:11:05.284864+0000","last_peered":"2024-01-20T08:11:05.284864+0000","last_clean":"2024-01-20T08:11:05.284864+0000","last_became_active":"2024-01-20T08:11:04.242500+0000","last_became_peered":"2024-01-20T08:11:04.242500+0000","last_unstale":"2024-01-20T08:11:05.284864+0000","last_undegraded":"2024-01-20T08:11:05.284864+0000","last_fullsized":"2024-01-20T08:11:05.284864+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274952+0000","last_change":"2024-01-20T08:11:05.269524+0000","last_active":"2024-01-20T08:11:05.274952+0000","last_peered":"2024-01-20T08:11:05.274952+0000","last_clean":"2024-01-20T08:11:05.274952+0000","last_became_active":"2024-01-20T08:11:05.269284+0000","last_became_peered":"2024-01-20T08:11:05.269284+0000","last_unstale":"2024-01-20T08:11:05.274952+0000","last_undegraded":"2024-01-20T08:11:05.274952+0000","last_fullsized":"2024-01-20T08:11:05.274952+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.254740+0000","last_change":"2024-01-20T08:11:04.229764+0000","last_active":"2024-01-20T08:11:05.254740+0000","last_peered":"2024-01-20T08:11:05.254740+0000","last_clean":"2024-01-20T08:11:05.254740+0000","last_became_active":"2024-01-20T08:11:04.229453+0000","last_became_peered":"2024-01-20T08:11:04.229453+0000","last_unstale":"2024-01-20T08:11:05.254740+0000","last_undegraded":"2024-01-20T08:11:05.254740+0000","last_fullsized":"2024-01-20T08:11:05.254740+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272117+0000","last_change":"2024-01-20T08:11:05.265952+0000","last_active":"2024-01-20T08:11:05.272117+0000","last_peered":"2024-01-20T08:11:05.272117+0000","last_clean":"2024-01-20T08:11:05.272117+0000","last_became_active":"2024-01-20T08:11:05.265641+0000","last_became_peered":"2024-01-20T08:11:05.265641+0000","last_unstale":"2024-01-20T08:11:05.272117+0000","last_undegraded":"2024-01-20T08:11:05.272117+0000","last_fullsized":"2024-01-20T08:11:05.272117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.259074+0000","last_change":"2024-01-20T08:11:04.228714+0000","last_active":"2024-01-20T08:11:05.259074+0000","last_peered":"2024-01-20T08:11:05.259074+0000","last_clean":"2024-01-20T08:11:05.259074+0000","last_became_active":"2024-01-20T08:11:04.227227+0000","last_became_peered":"2024-01-20T08:11:04.227227+0000","last_unstale":"2024-01-20T08:11:05.259074+0000","last_undegraded":"2024-01-20T08:11:05.259074+0000","last_fullsized":"2024-01-20T08:11:05.259074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.277833+0000","last_change":"2024-01-20T08:11:05.273342+0000","last_active":"2024-01-20T08:11:05.277833+0000","last_peered":"2024-01-20T08:11:05.277833+0000","last_clean":"2024-01-20T08:11:05.277833+0000","last_became_active":"2024-01-20T08:11:05.272929+0000","last_became_peered":"2024-01-20T08:11:05.272929+0000","last_unstale":"2024-01-20T08:11:05.277833+0000","last_undegraded":"2024-01-20T08:11:05.277833+0000","last_fullsized":"2024-01-20T08:11:05.277833+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:44.468877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.256460+0000","last_change":"2024-01-20T08:11:04.236506+0000","last_active":"2024-01-20T08:11:05.256460+0000","last_peered":"2024-01-20T08:11:05.256460+0000","last_clean":"2024-01-20T08:11:05.256460+0000","last_became_active":"2024-01-20T08:11:04.235965+0000","last_became_peered":"2024-01-20T08:11:04.235965+0000","last_unstale":"2024-01-20T08:11:05.256460+0000","last_undegraded":"2024-01-20T08:11:05.256460+0000","last_fullsized":"2024-01-20T08:11:05.256460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.274421+0000","last_change":"2024-01-20T08:11:05.267861+0000","last_active":"2024-01-20T08:11:05.274421+0000","last_peered":"2024-01-20T08:11:05.274421+0000","last_clean":"2024-01-20T08:11:05.274421+0000","last_became_active":"2024-01-20T08:11:05.267603+0000","last_became_peered":"2024-01-20T08:11:05.267603+0000","last_unstale":"2024-01-20T08:11:05.274421+0000","last_undegraded":"2024-01-20T08:11:05.274421+0000","last_fullsized":"2024-01-20T08:11:05.274421+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.259927+0000","last_change":"2024-01-20T08:11:04.236173+0000","last_active":"2024-01-20T08:11:05.259927+0000","last_peered":"2024-01-20T08:11:05.259927+0000","last_clean":"2024-01-20T08:11:05.259927+0000","last_became_active":"2024-01-20T08:11:04.235839+0000","last_became_peered":"2024-01-20T08:11:04.235839+0000","last_unstale":"2024-01-20T08:11:05.259927+0000","last_undegraded":"2024-01-20T08:11:05.259927+0000","last_fullsized":"2024-01-20T08:11:05.259927+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.272985+0000","last_change":"2024-01-20T08:11:05.258770+0000","last_active":"2024-01-20T08:11:05.272985+0000","last_peered":"2024-01-20T08:11:05.272985+0000","last_clean":"2024-01-20T08:11:05.272985+0000","last_became_active":"2024-01-20T08:11:05.258482+0000","last_became_peered":"2024-01-20T08:11:05.258482+0000","last_unstale":"2024-01-20T08:11:05.272985+0000","last_undegraded":"2024-01-20T08:11:05.272985+0000","last_fullsized":"2024-01-20T08:11:05.272985+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.240480+0000","last_change":"2024-01-20T08:11:04.242211+0000","last_active":"2024-01-20T08:11:05.240480+0000","last_peered":"2024-01-20T08:11:05.240480+0000","last_clean":"2024-01-20T08:11:05.240480+0000","last_became_active":"2024-01-20T08:11:04.241913+0000","last_became_peered":"2024-01-20T08:11:04.241913+0000","last_unstale":"2024-01-20T08:11:05.240480+0000","last_undegraded":"2024-01-20T08:11:05.240480+0000","last_fullsized":"2024-01-20T08:11:05.240480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:15.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.265030+0000","last_change":"2024-01-20T08:11:05.260184+0000","last_active":"2024-01-20T08:11:05.265030+0000","last_peered":"2024-01-20T08:11:05.265030+0000","last_clean":"2024-01-20T08:11:05.265030+0000","last_became_active":"2024-01-20T08:11:05.259912+0000","last_became_peered":"2024-01-20T08:11:05.259912+0000","last_unstale":"2024-01-20T08:11:05.265030+0000","last_undegraded":"2024-01-20T08:11:05.265030+0000","last_fullsized":"2024-01-20T08:11:05.265030+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:47.830275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.243323+0000","last_change":"2024-01-20T08:11:04.238908+0000","last_active":"2024-01-20T08:11:05.243323+0000","last_peered":"2024-01-20T08:11:05.243323+0000","last_clean":"2024-01-20T08:11:05.243323+0000","last_became_active":"2024-01-20T08:11:04.238633+0000","last_became_peered":"2024-01-20T08:11:04.238633+0000","last_unstale":"2024-01-20T08:11:05.243323+0000","last_undegraded":"2024-01-20T08:11:05.243323+0000","last_fullsized":"2024-01-20T08:11:05.243323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.271626+0000","last_change":"2024-01-20T08:11:05.264816+0000","last_active":"2024-01-20T08:11:05.271626+0000","last_peered":"2024-01-20T08:11:05.271626+0000","last_clean":"2024-01-20T08:11:05.271626+0000","last_became_active":"2024-01-20T08:11:05.264191+0000","last_became_peered":"2024-01-20T08:11:05.264191+0000","last_unstale":"2024-01-20T08:11:05.271626+0000","last_undegraded":"2024-01-20T08:11:05.271626+0000","last_fullsized":"2024-01-20T08:11:05.271626+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:55.533029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-01-20T08:11:05.257016+0000","last_change":"2024-01-20T08:11:04.245453+0000","last_active":"2024-01-20T08:11:05.257016+0000","last_peered":"2024-01-20T08:11:05.257016+0000","last_clean":"2024-01-20T08:11:05.257016+0000","last_became_active":"2024-01-20T08:11:04.244780+0000","last_became_peered":"2024-01-20T08:11:04.244780+0000","last_unstale":"2024-01-20T08:11:05.257016+0000","last_undegraded":"2024-01-20T08:11:05.257016+0000","last_fullsized":"2024-01-20T08:11:05.257016+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":173,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-01-20T08:11:04.239722+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:11:04.239722+0000","last_peered":"2024-01-20T08:11:04.239722+0000","last_clean":"2024-01-20T08:11:04.239722+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:11:04.239722+0000","last_undegraded":"2024-01-20T08:11:04.239722+0000","last_fullsized":"2024-01-20T08:11:04.239722+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32136,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339704,"statfs":{"total":96636764160,"available":96603856896,"internally_reserved":0,"allocated":970752,"data_stored":733702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":0.74399999999999999},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.3939999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.2210000000000001},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.45}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.173},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.1200000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.3129999999999999},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.82199999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":0.95899999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.5029999999999999},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.0509999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.3500000000000001},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.5620000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.671}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.3240000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.494},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.266}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.4399999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.8859999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.5900000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.7809999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.395}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.89200000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.2689999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":0.93999999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.96599999999999997}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.0720000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.147},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.24}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.369}]},{"osd":7,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.353},{"interface":"front","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4139999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31552,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340288,"statfs":{"total":96636764160,"available":96604454912,"internally_reserved":0,"allocated":380928,"data_stored":143348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":1.03},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.5029999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":7.3179999999999996,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.3740000000000001},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.298}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.482},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.5840000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4370000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.3380000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.7},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5309999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.276},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6539999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.778},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5660000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":389120,"data_stored":144878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82799999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":0.73199999999999998},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.76300000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.0800000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.145},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":0.92600000000000005}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.0469999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.103},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.97899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":143314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.78800000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.67400000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.389},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0169999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.0980000000000001},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.3280000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.429},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":3.2530000000000001,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.468}]},{"osd":7,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.218},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.3}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27376,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344464,"statfs":{"total":96636764160,"available":96608731136,"internally_reserved":0,"allocated":360448,"data_stored":136469,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.375},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.504}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.43099999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.54500000000000004}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":0.66000000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.64300000000000002}]},{"osd":6,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":0.71199999999999997}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.59199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27972,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343868,"statfs":{"total":96636764160,"available":96608120832,"internally_reserved":0,"allocated":966656,"data_stored":733612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0760000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.278}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.745},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.68000000000000005}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.4610000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":0.85299999999999998}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.129}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.236},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.413}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.361},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.91300000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:11:10.197 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:11:10.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-20T08:11:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.453+0000 7f8054a00640 1 Processor -- start 2024-01-20T08:11:10.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.454+0000 7f8054a00640 1 -- start start 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8054a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f804c151f30 0x7f804c0c0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8054a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c0c1810 con 0x7f804c0c26b0 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8054a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c0c0f70 con 0x7f804c1584f0 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8054a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0c1250 con 0x7f804c151f30 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8051600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f804c0c26b0 0x7f804c0c1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57506/0 (socket says 172.21.15.100:57506) 2024-01-20T08:11:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.455+0000 7f8051600640 1 -- 172.21.15.100:0/3765648861 learned_addr learned my addr 172.21.15.100:0/3765648861 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8052000640 1 --2- 172.21.15.100:0/3765648861 >> v2:172.21.15.110:3300/0 conn(0x7f804c151f30 0x7f804c0c0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2118723285 0 0) 0x7f804c0c1810 con 0x7f804c0c26b0 2024-01-20T08:11:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f802c003520 con 0x7f804c0c26b0 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3571153483 0 0) 0x7f802c003520 con 0x7f804c0c26b0 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 >> v2:172.21.15.110:3300/0 conn(0x7f804c151f30 msgr2=0x7f804c0c0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 --2- 172.21.15.100:0/3765648861 >> v2:172.21.15.110:3300/0 conn(0x7f804c151f30 0x7f804c0c0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 >> v1:172.21.15.110:6789/0 conn(0x7f804c1584f0 legacy=0x7f804c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c0c1530 con 0x7f804c0c26b0 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f8034001690 con 0x7f804c0c26b0 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 >> v1:172.21.15.100:6789/0 conn(0x7f804c0c26b0 legacy=0x7f804c0c1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.456+0000 7f8050c00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f802c003970 0x7f802c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8050c00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f802c0047c0 0x7f802c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8050c00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f802c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0c1250 con 0x7f802c005180 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00c120 con 0x7f802c0047c0 2024-01-20T08:11:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c00c2e0 con 0x7f802c003970 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f802c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8051600640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f802c0047c0 0x7f802c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052000640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f802c003970 0x7f802c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 -- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f802c003970 msgr2=0x7f802c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f802c003970 0x7f802c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 -- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f802c0047c0 msgr2=0x7f802c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f802c0047c0 0x7f802c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052a00640 1 -- 172.21.15.100:0/3765648861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c003520 con 0x7f802c005180 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.457+0000 7f8052000640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f802c003970 0x7f802c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.458+0000 7f8052a00640 1 -- 172.21.15.100:0/3765648861 reap_dead start 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.458+0000 7f8052a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f802c00b980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f803c001720 tx=0x7f802c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89271afa281e127e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0052d0 con 0x7f802c005180 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f803c02e050 con 0x7f802c005180 2024-01-20T08:11:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8050c00640 1 -- 172.21.15.100:0/3765648861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f803c0035f0 con 0x7f802c005180 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 -- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 msgr2=0x7f802c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f802c00b980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f803c001720 tx=0x7f802c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 -- 172.21.15.100:0/3765648861 shutdown_connections 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 --2- 172.21.15.100:0/3765648861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f802c00b980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 -- 172.21.15.100:0/3765648861 >> 172.21.15.100:0/3765648861 conn(0x7f804c06a5e0 msgr2=0x7f804c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 -- 172.21.15.100:0/3765648861 shutdown_connections 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.459+0000 7f8054a00640 1 -- 172.21.15.100:0/3765648861 wait complete. 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.461+0000 7f8054a00640 1 Processor -- start 2024-01-20T08:11:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.461+0000 7f8054a00640 1 -- start start 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 0x7f804c1455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f804c145b20 0x7f804c0a86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0a9f50 con 0x7f802c005180 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c14cbf0 con 0x7f804c145b20 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.462+0000 7f8054a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c1570a0 con 0x7f804c14fe80 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60974/0 (socket says 172.21.15.100:60974) 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 -- 172.21.15.100:0/811865315 learned_addr learned my addr 172.21.15.100:0/811865315 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f804c145b20 0x7f804c0a86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8051600640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 0x7f804c1455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 -- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 msgr2=0x7f804c1455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 0x7f804c1455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 -- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f804c145b20 msgr2=0x7f804c0a86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f804c145b20 0x7f804c0a86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 -- 172.21.15.100:0/811865315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c157b90 con 0x7f802c005180 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8051600640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 0x7f804c1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.463+0000 7f8052000640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f804400f380 tx=0x7f804400f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.464+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044003b90 con 0x7f802c005180 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.464+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8044011040 con 0x7f802c005180 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.464+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c156a90 con 0x7f802c005180 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.464+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8044004020 con 0x7f802c005180 2024-01-20T08:11:10.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.464+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c156d30 con 0x7f802c005180 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.465+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c067640 con 0x7f802c005180 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.466+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8044004180 con 0x7f802c005180 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.467+0000 7f804a000640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 0x7f802406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.467+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8044089d60 con 0x7f802c005180 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.467+0000 7f8051600640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 0x7f802406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.468+0000 7f8051600640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 0x7f802406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8034001220 tx=0x7f8034001190 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.471+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8044054c20 con 0x7f802c005180 2024-01-20T08:11:10.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.735+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f804c152310 con 0x7f802c005180 2024-01-20T08:11:10.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.740+0000 7f804a000640 1 -- 172.21.15.100:0/811865315 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v10) v1 ==== 190+0+147 (secure 0 0 0) 0x7f8044058240 con 0x7f802c005180 2024-01-20T08:11:10.743 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-01-20T08:11:10.743 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA== 2024-01-20T08:11:10.743 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:11:10.743 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:11:10.744 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T08:11:10.744 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 msgr2=0x7f802406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 0x7f802406d390 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8034001220 tx=0x7f8034001190 comp rx=0 tx=0).stop 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 msgr2=0x7f804c14f940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f804400f380 tx=0x7f804400f840 comp rx=0 tx=0).stop 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 shutdown_connections 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f804c145b20 0x7f804c0a86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f802406aed0 0x7f802406d390 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f804c14fe80 0x7f804c1455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 --2- 172.21.15.100:0/811865315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f802c005180 0x7f804c14f940 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 >> 172.21.15.100:0/811865315 conn(0x7f804c06a5e0 msgr2=0x7f804c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 shutdown_connections 2024-01-20T08:11:10.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.743+0000 7f8054a00640 1 -- 172.21.15.100:0/811865315 wait complete. 2024-01-20T08:11:10.764 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.966+0000 7f7ae7600640 1 Processor -- start 2024-01-20T08:11:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.967+0000 7f7ae7600640 1 -- start start 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ae0152030 0x7f7ae01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00707a0 0x7f7ae00c8320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7ae00c8860 0x7f7ae0154d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae0158cf0 con 0x7f7ae0152030 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ae01548e0 con 0x7f7ae00c8860 2024-01-20T08:11:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.968+0000 7f7ae7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00c2900 con 0x7f7ae00707a0 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ae0152030 0x7f7ae01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7ae0152030 0x7f7ae01587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60976/0 (socket says 172.21.15.100:60976) 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 -- 172.21.15.100:0/1178802275 learned_addr learned my addr 172.21.15.100:0/1178802275 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae5600640 1 --2- 172.21.15.100:0/1178802275 >> v2:172.21.15.110:3300/0 conn(0x7f7ae00c8860 0x7f7ae0154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7adfe00640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00707a0 0x7f7ae00c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 -- 172.21.15.100:0/1178802275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00707a0 msgr2=0x7f7ae00c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00707a0 0x7f7ae00c8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 -- 172.21.15.100:0/1178802275 >> v2:172.21.15.110:3300/0 conn(0x7f7ae00c8860 msgr2=0x7f7ae0154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/1178802275 >> v2:172.21.15.110:3300/0 conn(0x7f7ae00c8860 0x7f7ae0154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.969+0000 7f7ae4c00640 1 -- 172.21.15.100:0/1178802275 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae00c2ba0 con 0x7f7ae0152030 2024-01-20T08:11:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.970+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae0152030 0x7f7ae01587b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0072e20 tx=0x7f7ad002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50a5fafc3f9d1d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7adf400640 1 -- 172.21.15.100:0/1178802275 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00317e0 con 0x7f7ae0152030 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7adf400640 1 -- 172.21.15.100:0/1178802275 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0031940 con 0x7f7ae0152030 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7adf400640 1 -- 172.21.15.100:0/1178802275 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0031cd0 con 0x7f7ae0152030 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 -- 172.21.15.100:0/1178802275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae0152030 msgr2=0x7f7ae01587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae0152030 0x7f7ae01587b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7ae0072e20 tx=0x7f7ad002b880 comp rx=0 tx=0).stop 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 -- 172.21.15.100:0/1178802275 shutdown_connections 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 --2- 172.21.15.100:0/1178802275 >> v2:172.21.15.110:3300/0 conn(0x7f7ae00c8860 0x7f7ae0154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00707a0 0x7f7ae00c8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 --2- 172.21.15.100:0/1178802275 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae0152030 0x7f7ae01587b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.971+0000 7f7ae7600640 1 -- 172.21.15.100:0/1178802275 >> 172.21.15.100:0/1178802275 conn(0x7f7ae0066760 msgr2=0x7f7ae0066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.972+0000 7f7ae7600640 1 -- 172.21.15.100:0/1178802275 shutdown_connections 2024-01-20T08:11:10.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.972+0000 7f7ae7600640 1 -- 172.21.15.100:0/1178802275 wait complete. 2024-01-20T08:11:10.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.973+0000 7f7ae7600640 1 Processor -- start 2024-01-20T08:11:10.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.973+0000 7f7ae7600640 1 -- start start 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ae00c8860 0x7f7ae00abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00ac2f0 0x7f7ae01ed730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae0155f00 con 0x7f7ae00707a0 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae01556f0 con 0x7f7ae00c8860 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ae00ab920 con 0x7f7ae00ac2f0 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60980/0 (socket says 172.21.15.100:60980) 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.974+0000 7f7ae4c00640 1 -- 172.21.15.100:0/584075247 learned_addr learned my addr 172.21.15.100:0/584075247 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae5600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00ac2f0 0x7f7ae01ed730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7adfe00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ae00c8860 0x7f7ae00abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 -- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00ac2f0 msgr2=0x7f7ae01ed730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00ac2f0 0x7f7ae01ed730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 -- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ae00c8860 msgr2=0x7f7ae00abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ae00c8860 0x7f7ae00abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 -- 172.21.15.100:0/584075247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad00094d0 con 0x7f7ae00707a0 2024-01-20T08:11:10.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.975+0000 7f7ae4c00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.976+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0032880 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.976+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad0032a20 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.976+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ae00aca00 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.976+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ae0155c20 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.976+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0032dd0 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.977+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ae00ab6f0 con 0x7f7ae00707a0 2024-01-20T08:11:10.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.978+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7ad00453f0 con 0x7f7ae00707a0 2024-01-20T08:11:10.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.979+0000 7f7adcc00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 0x7f7ab806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.979+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ad00ab800 con 0x7f7ae00707a0 2024-01-20T08:11:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.979+0000 7f7adfe00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 0x7f7ab806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:10.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.980+0000 7f7adfe00640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 0x7f7ab806d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006fd0 tx=0x7f7ac8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:10.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:10.983+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7ae00ab6f0 con 0x7f7ae00707a0 2024-01-20T08:11:11.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.216+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ae00ab6f0 con 0x7f7ae00707a0 2024-01-20T08:11:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.217+0000 7f7adcc00640 1 -- 172.21.15.100:0/584075247 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f7ae00ab6f0 con 0x7f7ae00707a0 2024-01-20T08:11:11.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:11.220 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4669,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-01-20T08:11:11.220 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 16 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 msgr2=0x7f7ab806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 0x7f7ab806d390 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8006fd0 tx=0x7f7ac8008040 comp rx=0 tx=0).stop 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 msgr2=0x7f7ae0156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0000c00 tx=0x7f7ad00046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 shutdown_connections 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7ab806aed0 0x7f7ab806d390 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ae00ac2f0 0x7f7ae01ed730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ae00c8860 0x7f7ae00abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 --2- 172.21.15.100:0/584075247 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ae00707a0 0x7f7ae0156b20 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 >> 172.21.15.100:0/584075247 conn(0x7f7ae0066760 msgr2=0x7f7ae00c7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 shutdown_connections 2024-01-20T08:11:11.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.220+0000 7f7ae7600640 1 -- 172.21.15.100:0/584075247 wait complete. 2024-01-20T08:11:11.643 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T08:11:04.674090+0000', 'modified': '2024-01-20T08:11:07.748310+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4932}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4932': {'gid': 4932, 'name': 'c', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.100:6837/4185964362', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6835', 'nonce': 4185964362}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 4185964362}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T08:11:11.643 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T08:11:11.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-01-20T08:11:11.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.857+0000 7f08d4800640 1 Processor -- start 2024-01-20T08:11:11.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.857+0000 7f08d4800640 1 -- start start 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d4800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 0x7f08cc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d4800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08cc0c24f0 0x7f08cc06e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d4800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc06e760 con 0x7f08cc1550c0 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d4800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc154ca0 con 0x7f08cc0c24f0 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d4800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc071d00 con 0x7f08cc158af0 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08cc0c24f0 0x7f08cc06e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f08cc0c24f0 0x7f08cc06e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60982/0 (socket says 172.21.15.100:60982) 2024-01-20T08:11:11.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.859+0000 7f08d1400640 1 -- 172.21.15.100:0/1847005437 learned_addr learned my addr 172.21.15.100:0/1847005437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1e00640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 0x7f08cc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1400640 1 -- 172.21.15.100:0/1847005437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 msgr2=0x7f08cc157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1400640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 0x7f08cc157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1400640 1 -- 172.21.15.100:0/1847005437 >> v1:172.21.15.100:6789/0 conn(0x7f08cc1550c0 legacy=0x7f08cc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1400640 1 -- 172.21.15.100:0/1847005437 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc071fa0 con 0x7f08cc0c24f0 2024-01-20T08:11:11.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.860+0000 7f08d1e00640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 0x7f08cc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.861+0000 7f08d1400640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc0c24f0 0x7f08cc06e220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009870 tx=0x7f08b402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a18057c15c1cf53 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.861+0000 7f08d0a00640 1 -- 172.21.15.100:0/1847005437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40317c0 con 0x7f08cc0c24f0 2024-01-20T08:11:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.861+0000 7f08d0a00640 1 -- 172.21.15.100:0/1847005437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4031920 con 0x7f08cc0c24f0 2024-01-20T08:11:11.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.861+0000 7f08d0a00640 1 -- 172.21.15.100:0/1847005437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4031cb0 con 0x7f08cc0c24f0 2024-01-20T08:11:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 -- 172.21.15.100:0/1847005437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc0c24f0 msgr2=0x7f08cc06e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc0c24f0 0x7f08cc06e220 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f08b4009870 tx=0x7f08b402b860 comp rx=0 tx=0).stop 2024-01-20T08:11:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 -- 172.21.15.100:0/1847005437 shutdown_connections 2024-01-20T08:11:11.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc0c24f0 0x7f08cc06e220 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 --2- 172.21.15.100:0/1847005437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc158af0 0x7f08cc157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 -- 172.21.15.100:0/1847005437 >> 172.21.15.100:0/1847005437 conn(0x7f08cc0c2940 msgr2=0x7f08cc0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 -- 172.21.15.100:0/1847005437 shutdown_connections 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.862+0000 7f08d4800640 1 -- 172.21.15.100:0/1847005437 wait complete. 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.864+0000 7f08d4800640 1 Processor -- start 2024-01-20T08:11:11.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.864+0000 7f08d4800640 1 -- start start 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc0c24f0 0x7f08cc14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08cc158af0 0x7f08cc14d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc149db0 con 0x7f08cc1550c0 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1dfb40 con 0x7f08cc158af0 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d4800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc1497a0 con 0x7f08cc0c24f0 2024-01-20T08:11:11.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60984/0 (socket says 172.21.15.100:60984) 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d1400640 1 -- 172.21.15.100:0/18692997 learned_addr learned my addr 172.21.15.100:0/18692997 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.865+0000 7f08d1e00640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc0c24f0 0x7f08cc14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d2800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08cc158af0 0x7f08cc14d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 -- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc0c24f0 msgr2=0x7f08cc14b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc0c24f0 0x7f08cc14b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 -- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08cc158af0 msgr2=0x7f08cc14d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08cc158af0 0x7f08cc14d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 -- 172.21.15.100:0/18692997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b40094d0 con 0x7f08cc1550c0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08d1400640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.866+0000 7f08ca000640 1 -- 172.21.15.100:0/18692997 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4032860 con 0x7f08cc1550c0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.867+0000 7f08ca000640 1 -- 172.21.15.100:0/18692997 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b4032a00 con 0x7f08cc1550c0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.867+0000 7f08ca000640 1 -- 172.21.15.100:0/18692997 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4032db0 con 0x7f08cc1550c0 2024-01-20T08:11:11.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.867+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc1df860 con 0x7f08cc1550c0 2024-01-20T08:11:11.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.867+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc1e0b40 con 0x7f08cc1550c0 2024-01-20T08:11:11.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.869+0000 7f08ca000640 1 -- 172.21.15.100:0/18692997 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f08b404e450 con 0x7f08cc1550c0 2024-01-20T08:11:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.870+0000 7f08ca000640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 0x7f08a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.870+0000 7f08ca000640 1 -- 172.21.15.100:0/18692997 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b40ab840 con 0x7f08cc1550c0 2024-01-20T08:11:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.870+0000 7f08d1e00640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 0x7f08a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.870+0000 7f08d7603740 1 Processor -- start 2024-01-20T08:11:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d1e00640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 0x7f08a406d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0c0c70 tx=0x7f08bc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 -- start start 2024-01-20T08:11:11.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32cd0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d0a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32c3cd80 con 0x560c32cd1060 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32c3a470 con 0x560c32ccfd50 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.871+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c32c35d60 con 0x560c32d0c3e0 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60998/0 (socket says 172.21.15.100:60998) 2024-01-20T08:11:11.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 -- 172.21.15.100:0/1746747403 learned_addr learned my addr 172.21.15.100:0/1746747403 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1e00640 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32cd0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 -- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 msgr2=0x560c32d0a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d2800640 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d0a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d0a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 -- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 msgr2=0x560c32cd0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32cd0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 -- 172.21.15.100:0/1746747403 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c32beb280 con 0x560c32cd1060 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.872+0000 7f08d1400640 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f08b40768c0 tx=0x7f08b407aac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fb81ee063083dc5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08c2600640 1 -- 172.21.15.100:0/1746747403 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40ab040 con 0x560c32cd1060 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08c2600640 1 -- 172.21.15.100:0/1746747403 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b407e510 con 0x560c32cd1060 2024-01-20T08:11:11.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08c2600640 1 -- 172.21.15.100:0/1746747403 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40826c0 con 0x560c32cd1060 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 -- 172.21.15.100:0/1746747403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 msgr2=0x560c32d0bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f08b40768c0 tx=0x7f08b407aac0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 -- 172.21.15.100:0/1746747403 shutdown_connections 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d0a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d0bea0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 --2- 172.21.15.100:0/1746747403 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32cd0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 -- 172.21.15.100:0/1746747403 >> 172.21.15.100:0/1746747403 conn(0x560c32ccc930 msgr2=0x560c32cf10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 -- 172.21.15.100:0/1746747403 shutdown_connections 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.873+0000 7f08d7603740 1 -- 172.21.15.100:0/1746747403 wait complete. 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.874+0000 7f08d7603740 1 -- start start 2024-01-20T08:11:11.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.874+0000 7f08d7603740 1 Processor -- start 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d1c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32bd1740 con 0x560c32cd1060 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32bef0c0 con 0x560c32d06500 2024-01-20T08:11:11.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c32997f20 con 0x560c32d0c3e0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.875+0000 7f08d7603740 10 client.0 _ll_register_callbacks cb 0x560c32c2c200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32780/0 (socket says 172.21.15.100:32780) 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 -- 172.21.15.100:0/3610133320 learned_addr learned my addr 172.21.15.100:0/3610133320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d2800640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1400640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d1c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 -- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 msgr2=0x560c32d1c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d1c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 -- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 msgr2=0x560c32cebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cebbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 -- 172.21.15.100:0/3610133320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc1e0b40 con 0x560c32cd1060 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08d1e00640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0043f0 tx=0x7f08bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50002b66b64357c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.876+0000 7f08baa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08bc014780 con 0x560c32cd1060 2024-01-20T08:11:11.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08bc0148e0 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c32c2ebf0 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08bc014ae0 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 10 client.5106 fetch_fsmap learned FSMap version 16 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560c32c343e0 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560c32c2ebf0 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08bc014c40 con 0x560c32cd1060 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 10 client.5106 fetch_fsmap finished waiting for FSMap version 16 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 10 client.5106 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 20 client.5106 populate_metadata read hostname 'smithi100' 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d1f730 0x560c32d1fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 4 client.5106 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.877+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 --> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c32c2e910 con 0x560c32d1f730 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.878+0000 7f08d1400640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d1f730 0x560c32d1fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.878+0000 7f08d1400640 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d1f730 0x560c32d1fb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=885085a49bac266b server_cookie=ceb5f06ddaa32e52 in_seq=0 out_seq=0 2024-01-20T08:11:11.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.878+0000 7f08baa00640 10 client.5106 ms_handle_connect on v2:172.21.15.100:6835/4185964362 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08baa00640 1 -- 172.21.15.100:0/3610133320 <== mds.0 v2:172.21.15.100:6835/4185964362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560c32c2e910 con 0x560c32d1f730 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08baa00640 10 client.5106 handle_command_reply: tid=0 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 client.5106 shutdown 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 msgr2=0x560c32d09210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0043f0 tx=0x7f08bc013000 comp rx=0 tx=0).stop 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 shutdown_connections 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d1f730 0x560c32d1fb10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32d0c3e0 0x560c32d1c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 --2- 172.21.15.100:0/3610133320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32d09210 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08baa00640 0 client.5106 ms_handle_reset on v2:172.21.15.100:6835/4185964362 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.879+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 >> 172.21.15.100:0/3610133320 conn(0x560c32ccfd50 msgr2=0x560c32cee890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.880+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 shutdown_connections 2024-01-20T08:11:11.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.880+0000 7f08d7603740 1 -- 172.21.15.100:0/3610133320 wait complete. 2024-01-20T08:11:11.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.880+0000 7f08d7603740 20 client.5106 trim_cache size 0 max 16384 2024-01-20T08:11:11.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.897+0000 7f08d7603740 1 Processor -- start 2024-01-20T08:11:11.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.897+0000 7f08d7603740 1 -- start start 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32ccfd50 0x560c32d0da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cc9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32cc5450 con 0x560c32cd1060 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32d08670 con 0x560c32d06500 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c32ccc480 con 0x560c32ccfd50 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32786/0 (socket says 172.21.15.100:32786) 2024-01-20T08:11:11.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.898+0000 7f08d1400640 1 -- 172.21.15.100:0/836271481 learned_addr learned my addr 172.21.15.100:0/836271481 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1e00640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32ccfd50 0x560c32d0da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d2800640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cc9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 -- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32ccfd50 msgr2=0x560c32d0da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32ccfd50 0x560c32d0da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 -- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 msgr2=0x560c32cc9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cc9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 -- 172.21.15.100:0/836271481 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c32bd0fd0 con 0x560c32cd1060 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d2800640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cc9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08d1400640 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f08b4032040 tx=0x7f08b4091000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3082653fbf81b98f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08c1c00640 1 -- 172.21.15.100:0/836271481 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b40ab040 con 0x560c32cd1060 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08c1c00640 1 -- 172.21.15.100:0/836271481 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b407a190 con 0x560c32cd1060 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.899+0000 7f08c1c00640 1 -- 172.21.15.100:0/836271481 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b4076ad0 con 0x560c32cd1060 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 -- 172.21.15.100:0/836271481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 msgr2=0x560c32cc9900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f08b4032040 tx=0x7f08b4091000 comp rx=0 tx=0).stop 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 -- 172.21.15.100:0/836271481 shutdown_connections 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32d06500 0x560c32cc9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32cd1060 0x560c32cc9900 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 --2- 172.21.15.100:0/836271481 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32ccfd50 0x560c32d0da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 -- 172.21.15.100:0/836271481 >> 172.21.15.100:0/836271481 conn(0x560c32cf1cb0 msgr2=0x560c32d07f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 -- 172.21.15.100:0/836271481 shutdown_connections 2024-01-20T08:11:11.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.900+0000 7f08d7603740 1 -- 172.21.15.100:0/836271481 wait complete. 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.901+0000 7f08d7603740 1 -- start start 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.901+0000 7f08d7603740 1 Processor -- start 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32ceb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32cd1060 0x560c32d147d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32d13cb0 con 0x560c32d06500 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c32d7ac90 con 0x560c32ccfd50 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560c32d0ded0 con 0x560c32cd1060 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d7603740 10 client.0 _ll_register_callbacks cb 0x7f08b4006cd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:11:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32794/0 (socket says 172.21.15.100:32794) 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.902+0000 7f08d2800640 1 -- 172.21.15.100:0/840763790 learned_addr learned my addr 172.21.15.100:0/840763790 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d1e00640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32ceb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d1400640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32cd1060 0x560c32d147d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 -- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32cd1060 msgr2=0x560c32d147d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32cd1060 0x560c32d147d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 -- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 msgr2=0x560c32ceb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32ceb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 -- 172.21.15.100:0/840763790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c32beb280 con 0x560c32d06500 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d2800640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f08c40112b0 tx=0x7f08c4011770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3325f95637920e45 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08baa00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4019030 con 0x560c32d06500 2024-01-20T08:11:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08c401a070 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.903+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08b407e510 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08c40015f0 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 10 client.5112 fetch_fsmap learned FSMap version 16 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x560c32bf65c0 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b407e510 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 16) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f08c4012040 con 0x560c32d06500 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 10 client.5112 fetch_fsmap finished waiting for FSMap version 16 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 10 client.5112 resolve_mds: resolved name 'c' to daemon mds.c 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 20 client.5112 populate_metadata read hostname 'smithi100' 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d0c3e0 0x560c32d74580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 4 client.5112 mds_command: new command op to 4932 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 --> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560c329356c0 con 0x560c32d0c3e0 2024-01-20T08:11:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.904+0000 7f08d1e00640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d0c3e0 0x560c32d74580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d1e00640 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d0c3e0 0x560c32d74580 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=babd685d672ad044 server_cookie=942c290e6dc8ad39 in_seq=0 out_seq=0 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08baa00640 10 client.5112 ms_handle_connect on v2:172.21.15.100:6835/4185964362 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08baa00640 1 -- 172.21.15.100:0/840763790 <== mds.0 v2:172.21.15.100:6835/4185964362 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x560c329356c0 con 0x560c32d0c3e0 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08baa00640 10 client.5112 handle_command_reply: tid=0 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 client.5112 shutdown 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 msgr2=0x560c32d7a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f08c40112b0 tx=0x7f08c4011770 comp rx=0 tx=0).stop 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 shutdown_connections 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:6835/4185964362,v1:172.21.15.100:6837/4185964362] conn(0x560c32d0c3e0 0x560c32d74580 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560c32d06500 0x560c32d7a210 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560c32cd1060 0x560c32d147d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 --2- 172.21.15.100:0/840763790 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560c32ccfd50 0x560c32ceb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08baa00640 0 client.5112 ms_handle_reset on v2:172.21.15.100:6835/4185964362 2024-01-20T08:11:11.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.905+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 >> 172.21.15.100:0/840763790 conn(0x560c32cf1cb0 msgr2=0x560c32d2ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 shutdown_connections 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d7603740 1 -- 172.21.15.100:0/840763790 wait complete. 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d7603740 20 client.5112 trim_cache size 0 max 16384 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "10ce7bd0-b73e-4b66-b126-32ffded4722e", 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 4932, 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-20T08:11:11.912 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 6.6588093199999996, 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 16, 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 34, 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 34, 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 15.895290356 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:11:11.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 msgr2=0x7f08a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 0x7f08a406d390 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f08cc0c0c70 tx=0x7f08bc008040 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 msgr2=0x7f08cc1e0600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f08b4000c00 tx=0x7f08b40046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 shutdown_connections 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f08cc158af0 0x7f08cc14d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08cc1550c0 0x7f08cc1e0600 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f08a406aed0 0x7f08a406d390 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 --2- 172.21.15.100:0/18692997 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f08cc0c24f0 0x7f08cc14b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.906+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 >> 172.21.15.100:0/18692997 conn(0x7f08cc0c2940 msgr2=0x7f08cc0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.907+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 shutdown_connections 2024-01-20T08:11:11.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:11.907+0000 7f08d4800640 1 -- 172.21.15.100:0/18692997 wait complete. 2024-01-20T08:11:11.925 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:11:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.109+0000 7fb3ae000640 1 Processor -- start 2024-01-20T08:11:12.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.109+0000 7fb3ae000640 1 -- start start 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3ae000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3a80c3460 0x7fb3a8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb3a815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3ae000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3a8150190 con 0x7fb3a814fdb0 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3ae000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3a80a9ce0 con 0x7fb3a80c3460 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3ae000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80a93b0 con 0x7fb3a8153120 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3a7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb3a814fdb0 0x7fb3a80c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57520/0 (socket says 172.21.15.100:57520) 2024-01-20T08:11:12.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.111+0000 7fb3a7400640 1 -- 172.21.15.100:0/1601242618 learned_addr learned my addr 172.21.15.100:0/1601242618 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb3a815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/1601242618 >> v2:172.21.15.110:3300/0 conn(0x7fb3a80c3460 0x7fb3a8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1994557822 0 0) 0x7fb3a8150190 con 0x7fb3a814fdb0 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb388003520 con 0x7fb3a814fdb0 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4021928372 0 0) 0x7fb388003520 con 0x7fb3a814fdb0 2024-01-20T08:11:12.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 msgr2=0x7fb3a815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb3a815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 >> v2:172.21.15.110:3300/0 conn(0x7fb3a80c3460 msgr2=0x7fb3a8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 --2- 172.21.15.100:0/1601242618 >> v2:172.21.15.110:3300/0 conn(0x7fb3a80c3460 0x7fb3a8152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a81535b0 con 0x7fb3a814fdb0 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fb398001670 con 0x7fb3a814fdb0 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 >> v1:172.21.15.100:6789/0 conn(0x7fb3a814fdb0 legacy=0x7fb3a80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb388003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb388003f40 0x7fb3880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb388005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a80a93b0 con 0x7fb388004d00 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800b980 con 0x7fb388003f40 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.112+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb38800bac0 con 0x7fb3a8153120 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb388005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb388003f40 0x7fb3880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7400640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb388003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 -- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 msgr2=0x7fb388003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a8153120 0x7fb388003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 -- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb388003f40 msgr2=0x7fb3880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb388003f40 0x7fb3880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.113+0000 7fb3a7e00640 1 -- 172.21.15.100:0/1601242618 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb388003520 con 0x7fb388004d00 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.114+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb388005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000e170 tx=0x7fb3880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97b45d2ba5d2d9e0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.114+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a002cbf0 con 0x7fb388004d00 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.114+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a000f040 con 0x7fb388004d00 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.114+0000 7fb3a6000640 1 -- 172.21.15.100:0/1601242618 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a0034440 con 0x7fb388004d00 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 -- 172.21.15.100:0/1601242618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 msgr2=0x7fb388005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 --2- 172.21.15.100:0/1601242618 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb388005180 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb3a000e170 tx=0x7fb3880057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3a7e00640 1 -- 172.21.15.100:0/1601242618 reap_dead start 2024-01-20T08:11:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 -- 172.21.15.100:0/1601242618 shutdown_connections 2024-01-20T08:11:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 -- 172.21.15.100:0/1601242618 >> 172.21.15.100:0/1601242618 conn(0x7fb3a80c2940 msgr2=0x7fb3a80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 -- 172.21.15.100:0/1601242618 shutdown_connections 2024-01-20T08:11:12.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.115+0000 7fb3ae000640 1 -- 172.21.15.100:0/1601242618 wait complete. 2024-01-20T08:11:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.117+0000 7fb3ae000640 1 Processor -- start 2024-01-20T08:11:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.117+0000 7fb3ae000640 1 -- start start 2024-01-20T08:11:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 0x7fb3a81e8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3a8070400 0x7fb3a81eb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a8153e80 con 0x7fb388004d00 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81eb210 con 0x7fb3a8070400 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3ae000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a81416c0 con 0x7fb3a81404f0 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3a7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3a7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32812/0 (socket says 172.21.15.100:32812) 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.118+0000 7fb3a7400640 1 -- 172.21.15.100:0/3190861377 learned_addr learned my addr 172.21.15.100:0/3190861377 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7e00640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3a8070400 0x7fb3a81eb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 0x7fb3a81e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 -- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 msgr2=0x7fb3a81e8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 0x7fb3a81e8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 -- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3a8070400 msgr2=0x7fb3a81eb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3a8070400 0x7fb3a81eb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 -- 172.21.15.100:0/3190861377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a8140eb0 con 0x7fb388004d00 2024-01-20T08:11:12.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 0x7fb3a81e8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3a7400640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb39800e8c0 tx=0x7fb39800ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800c8d0 con 0x7fb388004d00 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb39800ca30 con 0x7fb388004d00 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb39800cde0 con 0x7fb388004d00 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3a8150ad0 con 0x7fb388004d00 2024-01-20T08:11:12.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.119+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3a8141100 con 0x7fb388004d00 2024-01-20T08:11:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.121+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3a804e970 con 0x7fb388004d00 2024-01-20T08:11:12.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.121+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb39801d460 con 0x7fb388004d00 2024-01-20T08:11:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.122+0000 7fb39f400640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 0x7fb38006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.122+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb398089700 con 0x7fb388004d00 2024-01-20T08:11:12.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.123+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 0x7fb38006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:12.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.123+0000 7fb3a6a00640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 0x7fb38006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80a96f0 tx=0x7fb390008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:12.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.127+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb3980545c0 con 0x7fb388004d00 2024-01-20T08:11:12.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.364+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb3a80c2260 con 0x7fb388004d00 2024-01-20T08:11:12.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.365+0000 7fb39f400640 1 -- 172.21.15.100:0/3190861377 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb398001610 con 0x7fb388004d00 2024-01-20T08:11:12.368 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 msgr2=0x7fb38006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 0x7fb38006d390 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80a96f0 tx=0x7fb390008040 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 msgr2=0x7fb3a8150590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb39800e8c0 tx=0x7fb39800ed80 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 shutdown_connections 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3a8070400 0x7fb3a81eb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb38006aed0 0x7fb38006d390 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb3a81404f0 0x7fb3a81e8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 --2- 172.21.15.100:0/3190861377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb388004d00 0x7fb3a8150590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 >> 172.21.15.100:0/3190861377 conn(0x7fb3a80c2940 msgr2=0x7fb3a8146160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:12.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 shutdown_connections 2024-01-20T08:11:12.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:12.368+0000 7fb3ae000640 1 -- 172.21.15.100:0/3190861377 wait complete. 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:11:12.389 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:12.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.389 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:11:12.438 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:12.439 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42601sec preferred_lft 42601sec 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:11:12.440 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:11:12.441 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:11:12.441 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:12.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.442 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:11:12.523 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:11:12.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.528 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:11:12.582 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:11:12.582 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:11:12.582 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:11:12.582 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:11:12.582 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:11:12.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:11:12.583 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:11:12.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.764 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:11:12.815 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:11:12.816 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:12.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:12.816 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:11:12.901 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:12.901 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:12.951 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:12.951 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:12.951 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:13.000 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-20T08:11:13.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:13.001 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:13.131 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:13.131 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:11:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:11:13.164 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:11:13.168 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T08:11:13.168 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:11:13.168 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:11:13.168 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:11:13.168 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:11:13.172 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:11:13.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:13.172 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:13.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:13.256 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:11:13.319 INFO:teuthology.orchestra.run.smithi100.stdout:client4571 2024-01-20T08:11:13.319 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:13.319 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:13.366 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:11:13.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.616+0000 7f6f93000640 1 Processor -- start 2024-01-20T08:11:13.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.617+0000 7f6f93000640 1 -- start start 2024-01-20T08:11:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.618+0000 7f6f93000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 0x7f6f8c157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.618+0000 7f6f93000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c071d00 con 0x7f6f8c1550c0 2024-01-20T08:11:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.618+0000 7f6f93000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f8c071fa0 con 0x7f6f8c158af0 2024-01-20T08:11:13.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.618+0000 7f6f93000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c154ca0 con 0x7f6f8c0c24f0 2024-01-20T08:11:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f91000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6f8c1550c0 0x7f6f8c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57522/0 (socket says 172.21.15.100:57522) 2024-01-20T08:11:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f91000640 1 -- 172.21.15.100:0/3895024352 learned_addr learned my addr 172.21.15.100:0/3895024352 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8b400640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 0x7f6f8c157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664810998 0 0) 0x7f6f8c071d00 con 0x7f6f8c1550c0 2024-01-20T08:11:13.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f6c003520 con 0x7f6f8c1550c0 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066380146 0 0) 0x7f6f6c003520 con 0x7f6f8c1550c0 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 msgr2=0x7f6f8c157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 0x7f6f8c157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 >> v1:172.21.15.110:6789/0 conn(0x7f6f8c158af0 legacy=0x7f6f8c06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c072280 con 0x7f6f8c1550c0 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.619+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6f840019f0 con 0x7f6f8c1550c0 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 >> v1:172.21.15.100:6789/0 conn(0x7f6f8c1550c0 legacy=0x7f6f8c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 0x7f6f6c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f6c003f20 0x7f6f6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c154ca0 con 0x7f6f6c004d00 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c00bbc0 con 0x7f6f6c003f20 2024-01-20T08:11:13.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f6c00bd80 con 0x7f6f8c0c24f0 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8b400640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f6c003f20 0x7f6f6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 -- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 msgr2=0x7f6f6c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c0c24f0 0x7f6f6c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 -- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f6c003f20 msgr2=0x7f6f6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f6c003f20 0x7f6f6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f91000640 1 -- 172.21.15.100:0/3895024352 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f6c003520 con 0x7f6f6c004d00 2024-01-20T08:11:13.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.620+0000 7f6f8b400640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f6c003f20 0x7f6f6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.621+0000 7f6f91000640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f6c005180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400a7f0 tx=0x7f6f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce198f88a7f29ac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84034630 con 0x7f6f6c004d00 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8402f070 con 0x7f6f6c004d00 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f8aa00640 1 -- 172.21.15.100:0/3895024352 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f840349f0 con 0x7f6f6c004d00 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f93000640 1 -- 172.21.15.100:0/3895024352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 msgr2=0x7f6f6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f93000640 1 --2- 172.21.15.100:0/3895024352 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f6c005180 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400a7f0 tx=0x7f6f6c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f91000640 1 -- 172.21.15.100:0/3895024352 reap_dead start 2024-01-20T08:11:13.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f93000640 1 -- 172.21.15.100:0/3895024352 shutdown_connections 2024-01-20T08:11:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.622+0000 7f6f93000640 1 -- 172.21.15.100:0/3895024352 >> 172.21.15.100:0/3895024352 conn(0x7f6f8c0c2940 msgr2=0x7f6f8c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.623+0000 7f6f93000640 1 -- 172.21.15.100:0/3895024352 shutdown_connections 2024-01-20T08:11:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.623+0000 7f6f93000640 1 -- 172.21.15.100:0/3895024352 wait complete. 2024-01-20T08:11:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.624+0000 7f6f93000640 1 Processor -- start 2024-01-20T08:11:13.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.624+0000 7f6f93000640 1 -- start start 2024-01-20T08:11:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f8c14d800 0x7f6f8c0aa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c1dde10 0x7f6f8c0aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0ab360 con 0x7f6f6c004d00 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c14f860 con 0x7f6f8c14d800 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.625+0000 7f6f93000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8c0c4c00 con 0x7f6f8c1dde10 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32836/0 (socket says 172.21.15.100:32836) 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 -- 172.21.15.100:0/249925622 learned_addr learned my addr 172.21.15.100:0/249925622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 -- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c1dde10 msgr2=0x7f6f8c0aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c1dde10 0x7f6f8c0aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 -- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f8c14d800 msgr2=0x7f6f8c0aa8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f8c14d800 0x7f6f8c0aa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 -- 172.21.15.100:0/249925622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f8c14fde0 con 0x7f6f6c004d00 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.626+0000 7f6f8be00640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c450 tx=0x7f6f7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:13.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.627+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c0052d0 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.627+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7c005430 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.627+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f8c14d520 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.627+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7c003830 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.627+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8c150270 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.628+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f8c04e970 con 0x7f6f6c004d00 2024-01-20T08:11:13.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.629+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6f7c003990 con 0x7f6f6c004d00 2024-01-20T08:11:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.630+0000 7f6f83e00640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 0x7f6f6406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.630+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f7c088cd0 con 0x7f6f6c004d00 2024-01-20T08:11:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.630+0000 7f6f8b400640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 0x7f6f6406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:13.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.631+0000 7f6f8b400640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 0x7f6f6406d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c152b20 tx=0x7f6f74008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:13.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.635+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6f7c053b00 con 0x7f6f6c004d00 2024-01-20T08:11:13.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.865+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f8c1581a0 con 0x7f6f6c004d00 2024-01-20T08:11:13.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.866+0000 7f6f83e00640 1 -- 172.21.15.100:0/249925622 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f7c017020 con 0x7f6f6c004d00 2024-01-20T08:11:13.869 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:11:13.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 msgr2=0x7f6f6406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 0x7f6f6406d3c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c152b20 tx=0x7f6f74008040 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 msgr2=0x7f6f8c150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c00c450 tx=0x7f6f7c00c910 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 shutdown_connections 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6f6406af00 0x7f6f6406d3c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6f8c1dde10 0x7f6f8c0aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6f8c14d800 0x7f6f8c0aa8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.868+0000 7f6f93000640 1 --2- 172.21.15.100:0/249925622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f6c004d00 0x7f6f8c150c00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.869+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 >> 172.21.15.100:0/249925622 conn(0x7f6f8c0c2940 msgr2=0x7f6f8c070b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.869+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 shutdown_connections 2024-01-20T08:11:13.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:13.869+0000 7f6f93000640 1 -- 172.21.15.100:0/249925622 wait complete. 2024-01-20T08:11:13.889 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:11:13.889 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:11:13.889 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:11:13.889 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:11:13.889 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:13.890 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:11:13.890 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:11:13.890 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:11:13.890 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:13.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:13.890 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:11:13.946 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:11:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:11:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:11:13.946 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42573sec preferred_lft 42573sec 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:11:13.947 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:11:13.948 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:13.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:13.949 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:11:14.037 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:11:14.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.041 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:11:14.090 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:11:14.090 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:11:14.091 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:11:14.091 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:11:14.091 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:11:14.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:11:14.091 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:11:14.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.268 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:11:14.320 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:11:14.321 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:14.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.321 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:11:14.410 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:14.411 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:14.459 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:14.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:14.460 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:14.510 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-20T08:11:14.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.510 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:14.645 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:14.646 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:14.681 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:14.681 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:14.681 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:11:14.681 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:11:14.681 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:11:14.683 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:11:14.683 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:11:14.684 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:11:14.684 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:11:14.684 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:11:14.687 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:11:14.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.687 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:14.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:14.763 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:11:14.821 INFO:teuthology.orchestra.run.smithi110.stdout:client4577 2024-01-20T08:11:14.821 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:14.821 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:14.872 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-20T08:11:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.091+0000 7fd25cc00640 1 Processor -- start 2024-01-20T08:11:15.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.091+0000 7fd25cc00640 1 -- start start 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd25cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd258155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd25cc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd258158b80 con 0x7fd258151d90 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd25cc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2580c8510 con 0x7fd2580c4880 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd25cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd258152170 con 0x7fd2580c4ce0 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd257400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd258151d90 0x7fd2580c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57524/0 (socket says 172.21.15.100:57524) 2024-01-20T08:11:15.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.093+0000 7fd257400640 1 -- 172.21.15.100:0/3592410254 learned_addr learned my addr 172.21.15.100:0/3592410254 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd257e00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd258155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3649390710 0 0) 0x7fd258158b80 con 0x7fd258151d90 2024-01-20T08:11:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd238003520 con 0x7fd258151d90 2024-01-20T08:11:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 818922070 0 0) 0x7fd238003520 con 0x7fd258151d90 2024-01-20T08:11:15.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 msgr2=0x7fd258155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd258155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 >> v1:172.21.15.110:6789/0 conn(0x7fd2580c4880 legacy=0x7fd258154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd258157c90 con 0x7fd258151d90 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fd248001670 con 0x7fd258151d90 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 >> v1:172.21.15.100:6789/0 conn(0x7fd258151d90 legacy=0x7fd2580c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd2380039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238003f70 0x7fd2380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd238004d00 0x7fd238005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258152170 con 0x7fd238004d00 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800bb70 con 0x7fd238003f70 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.094+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23800bd30 con 0x7fd2580c4ce0 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd238004d00 0x7fd238005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257400640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd2380039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.099 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd256a00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238003f70 0x7fd2380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 -- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 msgr2=0x7fd2380039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd2580c4ce0 0x7fd2380039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 -- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238003f70 msgr2=0x7fd2380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd238003f70 0x7fd2380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.095+0000 7fd257e00640 1 -- 172.21.15.100:0/3592410254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd238003520 con 0x7fd238004d00 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.097+0000 7fd257e00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd238004d00 0x7fd238005180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd250009ac0 tx=0x7fd2380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46c875c70a382fba server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.097+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25002c6b0 con 0x7fd238004d00 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.097+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25002c810 con 0x7fd238004d00 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.097+0000 7fd256000640 1 -- 172.21.15.100:0/3592410254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25002cba0 con 0x7fd238004d00 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 -- 172.21.15.100:0/3592410254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd238004d00 msgr2=0x7fd238005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 --2- 172.21.15.100:0/3592410254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd238004d00 0x7fd238005180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd250009ac0 tx=0x7fd2380057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd257e00640 1 -- 172.21.15.100:0/3592410254 reap_dead start 2024-01-20T08:11:15.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 -- 172.21.15.100:0/3592410254 shutdown_connections 2024-01-20T08:11:15.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 -- 172.21.15.100:0/3592410254 >> 172.21.15.100:0/3592410254 conn(0x7fd258071ef0 msgr2=0x7fd258072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:15.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 -- 172.21.15.100:0/3592410254 shutdown_connections 2024-01-20T08:11:15.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.098+0000 7fd25cc00640 1 -- 172.21.15.100:0/3592410254 wait complete. 2024-01-20T08:11:15.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.099+0000 7fd25cc00640 1 Processor -- start 2024-01-20T08:11:15.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.100+0000 7fd25cc00640 1 -- start start 2024-01-20T08:11:15.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.100+0000 7fd25cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd238004d00 0x7fd2580aab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd25cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2580adcc0 0x7fd2581ea670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd25cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd25cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581eb0f0 con 0x7fd2580acd60 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd25cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2580af9f0 con 0x7fd2580adcc0 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd25cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd258149a60 con 0x7fd238004d00 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32864/0 (socket says 172.21.15.100:32864) 2024-01-20T08:11:15.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 -- 172.21.15.100:0/762576406 learned_addr learned my addr 172.21.15.100:0/762576406 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:15.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 -- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd238004d00 msgr2=0x7fd2580aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257400640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd238004d00 0x7fd2580aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd256a00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2580adcc0 0x7fd2581ea670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd238004d00 0x7fd2580aab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 -- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2580adcc0 msgr2=0x7fd2581ea670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2580adcc0 0x7fd2581ea670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.101+0000 7fd257e00640 1 -- 172.21.15.100:0/762576406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2581eb620 con 0x7fd2580acd60 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd257e00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd250009ac0 tx=0x7fd250004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250003810 con 0x7fd2580acd60 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd250003970 con 0x7fd2580acd60 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2580af710 con 0x7fd2580acd60 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd250003ce0 con 0x7fd2580acd60 2024-01-20T08:11:15.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.102+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2580ab0a0 con 0x7fd2580acd60 2024-01-20T08:11:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.103+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2581498c0 con 0x7fd2580acd60 2024-01-20T08:11:15.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.104+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd25003e440 con 0x7fd2580acd60 2024-01-20T08:11:15.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.105+0000 7fd24f400640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 0x7fd23006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.105+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2500aabb0 con 0x7fd2580acd60 2024-01-20T08:11:15.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.105+0000 7fd257400640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 0x7fd23006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.106+0000 7fd257400640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 0x7fd23006d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd248001eb0 tx=0x7fd248000f10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.110+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd2581498c0 con 0x7fd2580acd60 2024-01-20T08:11:15.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.371+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7fd2581498c0 con 0x7fd2580acd60 2024-01-20T08:11:15.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.372+0000 7fd24f400640 1 -- 172.21.15.100:0/762576406 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v10) v1 ==== 84+0+0 (secure 0 0 0) 0x7fd2581498c0 con 0x7fd2580acd60 2024-01-20T08:11:15.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 msgr2=0x7fd23006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 0x7fd23006d3c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd248001eb0 tx=0x7fd248000f10 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 msgr2=0x7fd2581eabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd250009ac0 tx=0x7fd250004730 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 shutdown_connections 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2580acd60 0x7fd2581eabb0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2580adcc0 0x7fd2581ea670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.374+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd23006af00 0x7fd23006d3c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.375+0000 7fd25cc00640 1 --2- 172.21.15.100:0/762576406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd238004d00 0x7fd2580aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.375+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 >> 172.21.15.100:0/762576406 conn(0x7fd258071ef0 msgr2=0x7fd2580ca110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.375+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 shutdown_connections 2024-01-20T08:11:15.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.375+0000 7fd25cc00640 1 -- 172.21.15.100:0/762576406 wait complete. 2024-01-20T08:11:15.397 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.603+0000 7f7240400640 1 Processor -- start 2024-01-20T08:11:15.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.603+0000 7f7240400640 1 -- start start 2024-01-20T08:11:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.604+0000 7f7240400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72380abfd0 0x7f7238070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.604+0000 7f7240400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380c1670 con 0x7f7238147f20 2024-01-20T08:11:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.604+0000 7f7240400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72380c0d40 con 0x7f7238151f60 2024-01-20T08:11:15.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.604+0000 7f7240400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72380c2210 con 0x7f72380abfd0 2024-01-20T08:11:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f723da00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7238147f20 0x7f72380c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57534/0 (socket says 172.21.15.100:57534) 2024-01-20T08:11:15.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f723da00640 1 -- 172.21.15.100:0/3634074820 learned_addr learned my addr 172.21.15.100:0/3634074820 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:15.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1796478372 0 0) 0x7f72380c1670 con 0x7f7238147f20 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7218003520 con 0x7f7238147f20 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f723e400640 1 --2- 172.21.15.100:0/3634074820 >> v2:172.21.15.110:3300/0 conn(0x7f72380abfd0 0x7f7238070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3823013551 0 0) 0x7f7218003520 con 0x7f7238147f20 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 >> v2:172.21.15.110:3300/0 conn(0x7f72380abfd0 msgr2=0x7f7238070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 --2- 172.21.15.100:0/3634074820 >> v2:172.21.15.110:3300/0 conn(0x7f72380abfd0 0x7f7238070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 >> v1:172.21.15.110:6789/0 conn(0x7f7238151f60 legacy=0x7f72380c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72380c1020 con 0x7f7238147f20 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7220001670 con 0x7f7238147f20 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.605+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 >> v1:172.21.15.100:6789/0 conn(0x7f7238147f20 legacy=0x7f72380c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218003970 0x7f7218003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72180047c0 0x7f7218004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 0x7f721800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380c2210 con 0x7f7218005180 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721800e2c0 con 0x7f72180047c0 2024-01-20T08:11:15.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721800e480 con 0x7f7218003970 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 0x7f721800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723d000640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72180047c0 0x7f7218004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 -- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218003970 msgr2=0x7f7218003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218003970 0x7f7218003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 -- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72180047c0 msgr2=0x7f7218004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72180047c0 0x7f7218004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723e400640 1 -- 172.21.15.100:0/3634074820 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7218003520 con 0x7f7218005180 2024-01-20T08:11:15.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.606+0000 7f723d000640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72180047c0 0x7f7218004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.607+0000 7f723e400640 1 -- 172.21.15.100:0/3634074820 reap_dead start 2024-01-20T08:11:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f723e400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 0x7f721800db90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f723000ba00 tx=0x7f72180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6a984fe0c2c211 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230004020 con 0x7f7218005180 2024-01-20T08:11:15.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7230004180 con 0x7f7218005180 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7237e00640 1 -- 172.21.15.100:0/3634074820 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7230003610 con 0x7f7218005180 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7240400640 1 -- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 msgr2=0x7f721800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7240400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 0x7f721800db90 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f723000ba00 tx=0x7f72180057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7240400640 1 -- 172.21.15.100:0/3634074820 shutdown_connections 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7240400640 1 --2- 172.21.15.100:0/3634074820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7218005180 0x7f721800db90 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.608+0000 7f7240400640 1 -- 172.21.15.100:0/3634074820 >> 172.21.15.100:0/3634074820 conn(0x7f723806a5e0 msgr2=0x7f723806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.609+0000 7f7240400640 1 -- 172.21.15.100:0/3634074820 shutdown_connections 2024-01-20T08:11:15.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.609+0000 7f7240400640 1 -- 172.21.15.100:0/3634074820 wait complete. 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.610+0000 7f7240400640 1 Processor -- start 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.610+0000 7f7240400640 1 -- start start 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 0x7f723814bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 0x7f723813fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72381e6e40 con 0x7f72380c55a0 2024-01-20T08:11:15.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72380ab130 con 0x7f723814e160 2024-01-20T08:11:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f7240400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72381e6080 con 0x7f7218005180 2024-01-20T08:11:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f723e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f723e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32872/0 (socket says 172.21.15.100:32872) 2024-01-20T08:11:15.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.611+0000 7f723e400640 1 -- 172.21.15.100:0/482187585 learned_addr learned my addr 172.21.15.100:0/482187585 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723d000640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 0x7f723813fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723da00640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 0x7f723814bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 -- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 msgr2=0x7f723814bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 0x7f723814bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 -- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 msgr2=0x7f723813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 0x7f723813fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 -- 172.21.15.100:0/482187585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72381e6360 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723da00640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 0x7f723814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723d000640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 0x7f723813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f723e400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f723002bf90 tx=0x7f7230004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723003b440 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723003b5c0 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.612+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72381e6640 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.613+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723003b770 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.613+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72381402e0 con 0x7f72380c55a0 2024-01-20T08:11:15.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.614+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f723804e970 con 0x7f72380c55a0 2024-01-20T08:11:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.615+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f723003b8d0 con 0x7f72380c55a0 2024-01-20T08:11:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.615+0000 7f7235600640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.616+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72300ab1e0 con 0x7f72380c55a0 2024-01-20T08:11:15.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.616+0000 7f723da00640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:15.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.616+0000 7f723da00640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 0x7f721006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72200079b0 tx=0x7f7220009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:15.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.620+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f72300760a0 con 0x7f72380c55a0 2024-01-20T08:11:15.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.813+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72380c38d0 con 0x7f72380c55a0 2024-01-20T08:11:15.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.814+0000 7f7235600640 1 -- 172.21.15.100:0/482187585 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16546 (secure 0 0 0) 0x7f72300796c0 con 0x7f72380c55a0 2024-01-20T08:11:15.818 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:15.818 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":34,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:06.246580+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 msgr2=0x7f721006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 0x7f721006d3c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f72200079b0 tx=0x7f7220009040 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 msgr2=0x7f72380c5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f723002bf90 tx=0x7f7230004730 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 shutdown_connections 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72380c55a0 0x7f72380c5a20 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f723814e160 0x7f723813fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f721006af00 0x7f721006d3c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 --2- 172.21.15.100:0/482187585 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7218005180 0x7f723814bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:15.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 >> 172.21.15.100:0/482187585 conn(0x7f723806a5e0 msgr2=0x7f7238145760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 shutdown_connections 2024-01-20T08:11:15.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:15.817+0000 7f7240400640 1 -- 172.21.15.100:0/482187585 wait complete. 2024-01-20T08:11:15.839 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:11:02.438552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:11:03.706270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:15.840 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:16.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.056+0000 7ff9da200640 1 Processor -- start 2024-01-20T08:11:16.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.057+0000 7ff9da200640 1 -- start start 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9da200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff9d4158890 0x7ff9d40c4340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9da200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c0fb0 con 0x7ff9d406e0b0 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9da200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9d40c1270 con 0x7ff9d4072500 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9da200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9d40c1830 con 0x7ff9d4158890 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9d8e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff9d406e0b0 0x7ff9d40c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57542/0 (socket says 172.21.15.100:57542) 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9d8e00640 1 -- 172.21.15.100:0/312754545 learned_addr learned my addr 172.21.15.100:0/312754545 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:16.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.058+0000 7ff9d9800640 1 --2- 172.21.15.100:0/312754545 >> v2:172.21.15.100:3300/0 conn(0x7ff9d4158890 0x7ff9d40c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.059+0000 7ff9d9800640 1 -- 172.21.15.100:0/312754545 >> v1:172.21.15.110:6789/0 conn(0x7ff9d4072500 legacy=0x7ff9d40c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.059+0000 7ff9d9800640 1 -- 172.21.15.100:0/312754545 >> v1:172.21.15.100:6789/0 conn(0x7ff9d406e0b0 legacy=0x7ff9d40c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.059+0000 7ff9d9800640 1 -- 172.21.15.100:0/312754545 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d40c1550 con 0x7ff9d4158890 2024-01-20T08:11:16.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.060+0000 7ff9d9800640 1 --2- 172.21.15.100:0/312754545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d40c4340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40c1970 tx=0x7ff9cc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d98280c9a7a407fe server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.060+0000 7ff9d3e00640 1 -- 172.21.15.100:0/312754545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc02cc60 con 0x7ff9d4158890 2024-01-20T08:11:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.060+0000 7ff9d3e00640 1 -- 172.21.15.100:0/312754545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc02cdc0 con 0x7ff9d4158890 2024-01-20T08:11:16.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.060+0000 7ff9d3e00640 1 -- 172.21.15.100:0/312754545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc034660 con 0x7ff9d4158890 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 -- 172.21.15.100:0/312754545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 msgr2=0x7ff9d40c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 --2- 172.21.15.100:0/312754545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d40c4340 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff9d40c1970 tx=0x7ff9cc02beb0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 -- 172.21.15.100:0/312754545 shutdown_connections 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 --2- 172.21.15.100:0/312754545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d40c4340 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 -- 172.21.15.100:0/312754545 >> 172.21.15.100:0/312754545 conn(0x7ff9d40c5ba0 msgr2=0x7ff9d40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 -- 172.21.15.100:0/312754545 shutdown_connections 2024-01-20T08:11:16.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.061+0000 7ff9da200640 1 -- 172.21.15.100:0/312754545 wait complete. 2024-01-20T08:11:16.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.063+0000 7ff9da200640 1 Processor -- start 2024-01-20T08:11:16.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.063+0000 7ff9da200640 1 -- start start 2024-01-20T08:11:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 0x7ff9d40709a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 0x7ff9d41508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4070ee0 con 0x7ff9d4158890 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d40721d0 con 0x7ff9d4072500 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9da200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9d4071650 con 0x7ff9d406e0b0 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9d9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9d9800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32894/0 (socket says 172.21.15.100:32894) 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9d9800640 1 -- 172.21.15.100:0/4170924613 learned_addr learned my addr 172.21.15.100:0/4170924613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9cbe00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 0x7ff9d41508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.064+0000 7ff9d8e00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 0x7ff9d40709a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 -- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 msgr2=0x7ff9d40709a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 0x7ff9d40709a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 -- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 msgr2=0x7ff9d41508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 0x7ff9d41508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 -- 172.21.15.100:0/4170924613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc009a70 con 0x7ff9d4158890 2024-01-20T08:11:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9cbe00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 0x7ff9d41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d8e00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 0x7ff9d40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:16.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d9800640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc037040 tx=0x7ff9cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc03e610 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9cc03e770 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9d4071930 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9cc03eae0 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.065+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9d4071ef0 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.066+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9d4156ee0 con 0x7ff9d4158890 2024-01-20T08:11:16.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.067+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff9cc03b050 con 0x7ff9d4158890 2024-01-20T08:11:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.068+0000 7ff9d1600640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.068+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9cc0abdb0 con 0x7ff9d4158890 2024-01-20T08:11:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.068+0000 7ff9d8e00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.069+0000 7ff9d8e00640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000f60 tx=0x7ff9c4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.072+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff9d4156ee0 con 0x7ff9d4158890 2024-01-20T08:11:16.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.269+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff9d4156ee0 con 0x7ff9d4158890 2024-01-20T08:11:16.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.270+0000 7ff9d1600640 1 -- 172.21.15.100:0/4170924613 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff9d4156ee0 con 0x7ff9d4158890 2024-01-20T08:11:16.273 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 msgr2=0x7ff9ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff9c4000f60 tx=0x7ff9c4009040 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 msgr2=0x7ff9d41571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc037040 tx=0x7ff9cc004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 shutdown_connections 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff9d4158890 0x7ff9d41571c0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff9d4072500 0x7ff9d41508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff9ac06af00 0x7ff9ac06d3c0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 --2- 172.21.15.100:0/4170924613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff9d406e0b0 0x7ff9d40709a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 >> 172.21.15.100:0/4170924613 conn(0x7ff9d40c5ba0 msgr2=0x7ff9d40a5850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:16.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 shutdown_connections 2024-01-20T08:11:16.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.273+0000 7ff9da200640 1 -- 172.21.15.100:0/4170924613 wait complete. 2024-01-20T08:11:16.296 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:11:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.498+0000 7f7f40c00640 1 Processor -- start 2024-01-20T08:11:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.498+0000 7f7f40c00640 1 -- start start 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f40c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f3c1524b0 0x7f7f3c06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f40c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c06b640 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f40c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f3c0c69e0 con 0x7f7f3c0c5180 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f40c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3c06c600 con 0x7f7f3c1524b0 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f39400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7f3c0c60d0 0x7f7f3c151da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57548/0 (socket says 172.21.15.100:57548) 2024-01-20T08:11:16.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.500+0000 7f7f39400640 1 -- 172.21.15.100:0/518653427 learned_addr learned my addr 172.21.15.100:0/518653427 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f3a800640 1 --2- 172.21.15.100:0/518653427 >> v2:172.21.15.110:3300/0 conn(0x7f7f3c1524b0 0x7f7f3c06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1193937021 0 0) 0x7f7f3c06b640 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f1c003520 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117323630 0 0) 0x7f7f1c003520 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 >> v2:172.21.15.110:3300/0 conn(0x7f7f3c1524b0 msgr2=0x7f7f3c06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 --2- 172.21.15.100:0/518653427 >> v2:172.21.15.110:3300/0 conn(0x7f7f3c1524b0 0x7f7f3c06bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 >> v1:172.21.15.110:6789/0 conn(0x7f7f3c0c5180 legacy=0x7f7f3c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0c8af0 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7f24001670 con 0x7f7f3c0c60d0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 >> v1:172.21.15.100:6789/0 conn(0x7f7f3c0c60d0 legacy=0x7f7f3c151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 0x7f7f1c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c0047c0 0x7f7f1c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f1c005180 0x7f7f1c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c00c080 con 0x7f7f1c003970 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c00c1f0 con 0x7f7f1c005180 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.501+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c00c3b0 con 0x7f7f1c0047c0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 0x7f7f1c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39400640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c0047c0 0x7f7f1c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f3a800640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f1c005180 0x7f7f1c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 -- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c0047c0 msgr2=0x7f7f1c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c0047c0 0x7f7f1c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 -- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f1c005180 msgr2=0x7f7f1c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f1c005180 0x7f7f1c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f3a800640 1 -- 172.21.15.100:0/518653427 reap_dead start 2024-01-20T08:11:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.502+0000 7f7f39e00640 1 -- 172.21.15.100:0/518653427 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c003520 con 0x7f7f1c003970 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.504+0000 7f7f39e00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 0x7f7f1c003d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c003db0 tx=0x7f7f1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=153b5c06834044cf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.504+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c032600 con 0x7f7f1c003970 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.504+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c02e050 con 0x7f7f1c003970 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.504+0000 7f7f38a00640 1 -- 172.21.15.100:0/518653427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c0329e0 con 0x7f7f1c003970 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 -- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 msgr2=0x7f7f1c003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 0x7f7f1c003d70 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c003db0 tx=0x7f7f1c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 -- 172.21.15.100:0/518653427 shutdown_connections 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 --2- 172.21.15.100:0/518653427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f1c003970 0x7f7f1c003d70 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 -- 172.21.15.100:0/518653427 >> 172.21.15.100:0/518653427 conn(0x7f7f3c0ca5a0 msgr2=0x7f7f3c0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 -- 172.21.15.100:0/518653427 shutdown_connections 2024-01-20T08:11:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.505+0000 7f7f40c00640 1 -- 172.21.15.100:0/518653427 wait complete. 2024-01-20T08:11:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.507+0000 7f7f40c00640 1 Processor -- start 2024-01-20T08:11:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.507+0000 7f7f40c00640 1 -- start start 2024-01-20T08:11:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c003970 0x7f7f3c1e9dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3c0ae740 0x7f7f3c0ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0b0010 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0ad6a0 con 0x7f7f3c0ae740 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f40c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3c0ad980 con 0x7f7f1c003970 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32922/0 (socket says 172.21.15.100:32922) 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 -- 172.21.15.100:0/2180652063 learned_addr learned my addr 172.21.15.100:0/2180652063 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f39400640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3c0ae740 0x7f7f3c0ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 -- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c003970 msgr2=0x7f7f3c1e9dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c003970 0x7f7f3c1e9dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 -- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3c0ae740 msgr2=0x7f7f3c0ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3c0ae740 0x7f7f3c0ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.508+0000 7f7f3a800640 1 -- 172.21.15.100:0/2180652063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f3c0adc60 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f3a800640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c1528c0 tx=0x7f7f340115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f3400e070 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34011e10 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f34003990 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3c0adf40 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.509+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f3c0afc60 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.511+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3c0afdf0 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.511+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7f34003af0 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.513+0000 7f7f32000640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 0x7f7f1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.513+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f34089c40 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.513+0000 7f7f39e00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 0x7f7f1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.514+0000 7f7f39e00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 0x7f7f1406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c034000 tx=0x7f7f2c02f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.517+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7f34054ba0 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.709+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f3c0abb30 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.710+0000 7f7f32000640 1 -- 172.21.15.100:0/2180652063 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f340581c0 con 0x7f7f3c0af7e0 2024-01-20T08:11:16.713 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:16.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 msgr2=0x7f7f1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 0x7f7f1406d390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c034000 tx=0x7f7f2c02f000 comp rx=0 tx=0).stop 2024-01-20T08:11:16.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 msgr2=0x7f7f3c1eb240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c1528c0 tx=0x7f7f340115a0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 shutdown_connections 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f3c0af7e0 0x7f7f3c1eb240 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3c0ae740 0x7f7f3c0ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f1406aed0 0x7f7f1406d390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 --2- 172.21.15.100:0/2180652063 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f1c003970 0x7f7f3c1e9dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.713+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 >> 172.21.15.100:0/2180652063 conn(0x7f7f3c0ca5a0 msgr2=0x7f7f3c14a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.714+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 shutdown_connections 2024-01-20T08:11:16.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.714+0000 7f7f40c00640 1 -- 172.21.15.100:0/2180652063 wait complete. 2024-01-20T08:11:16.735 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:11:16.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.945+0000 7fd233600640 1 Processor -- start 2024-01-20T08:11:16.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.945+0000 7fd233600640 1 -- start start 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd233600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd22c0c3460 0x7fd22c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd233600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c153120 0x7fd22c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd233600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd22c150190 con 0x7fd22c14fdb0 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd233600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd22c0a9ce0 con 0x7fd22c0c3460 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd233600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c0a93b0 con 0x7fd22c153120 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd230c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd22c14fdb0 0x7fd22c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57558/0 (socket says 172.21.15.100:57558) 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd230c00640 1 -- 172.21.15.100:0/2867711331 learned_addr learned my addr 172.21.15.100:0/2867711331 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd22be00640 1 --2- 172.21.15.100:0/2867711331 >> v2:172.21.15.100:3300/0 conn(0x7fd22c0c3460 0x7fd22c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.947+0000 7fd231600640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c153120 0x7fd22c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.948+0000 7fd22be00640 1 -- 172.21.15.100:0/2867711331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c153120 msgr2=0x7fd22c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:16.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.948+0000 7fd22be00640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c153120 0x7fd22c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.948+0000 7fd22be00640 1 -- 172.21.15.100:0/2867711331 >> v1:172.21.15.100:6789/0 conn(0x7fd22c14fdb0 legacy=0x7fd22c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.948+0000 7fd22be00640 1 -- 172.21.15.100:0/2867711331 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd22c1535b0 con 0x7fd22c0c3460 2024-01-20T08:11:16.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.949+0000 7fd22be00640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c0c3460 0x7fd22c152be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca1e731601bea4d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.949+0000 7fd22b400640 1 -- 172.21.15.100:0/2867711331 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21402d040 con 0x7fd22c0c3460 2024-01-20T08:11:16.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.949+0000 7fd22b400640 1 -- 172.21.15.100:0/2867711331 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214031810 con 0x7fd22c0c3460 2024-01-20T08:11:16.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.949+0000 7fd22b400640 1 -- 172.21.15.100:0/2867711331 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd214031ba0 con 0x7fd22c0c3460 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 -- 172.21.15.100:0/2867711331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c0c3460 msgr2=0x7fd22c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c0c3460 0x7fd22c152be0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd2140097a0 tx=0x7fd21402b8b0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 -- 172.21.15.100:0/2867711331 shutdown_connections 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c153120 0x7fd22c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 --2- 172.21.15.100:0/2867711331 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c0c3460 0x7fd22c152be0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 -- 172.21.15.100:0/2867711331 >> 172.21.15.100:0/2867711331 conn(0x7fd22c0c2940 msgr2=0x7fd22c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 -- 172.21.15.100:0/2867711331 shutdown_connections 2024-01-20T08:11:16.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.950+0000 7fd233600640 1 -- 172.21.15.100:0/2867711331 wait complete. 2024-01-20T08:11:16.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.952+0000 7fd233600640 1 Processor -- start 2024-01-20T08:11:16.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.952+0000 7fd233600640 1 -- start start 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.952+0000 7fd233600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 0x7fd22c1551c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.952+0000 7fd233600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd233600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c153120 0x7fd22c06d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd233600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c1eb340 con 0x7fd22c14fdb0 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd233600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c14b9c0 con 0x7fd22c153120 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd233600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd22c14bca0 con 0x7fd22c0c3460 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32938/0 (socket says 172.21.15.100:32938) 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 -- 172.21.15.100:0/1479553205 learned_addr learned my addr 172.21.15.100:0/1479553205 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd230c00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 0x7fd22c1551c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 -- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 msgr2=0x7fd22c1551c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 0x7fd22c1551c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd231600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c153120 0x7fd22c06d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 -- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c153120 msgr2=0x7fd22c06d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c153120 0x7fd22c06d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd22be00640 1 -- 172.21.15.100:0/1479553205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214009400 con 0x7fd22c14fdb0 2024-01-20T08:11:16.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.953+0000 7fd230c00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 0x7fd22c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd22be00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd2140098c0 tx=0x7fd2140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21403ad60 con 0x7fd22c14fdb0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd214044400 con 0x7fd22c14fdb0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2140447b0 con 0x7fd22c14fdb0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd22c14bf80 con 0x7fd22c14fdb0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.954+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd22c14a330 con 0x7fd22c14fdb0 2024-01-20T08:11:16.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.955+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22c04e970 con 0x7fd22c14fdb0 2024-01-20T08:11:16.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.956+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd21404d440 con 0x7fd22c14fdb0 2024-01-20T08:11:16.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.957+0000 7fd228c00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 0x7fd20406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:16.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.957+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2140abab0 con 0x7fd22c14fdb0 2024-01-20T08:11:16.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.957+0000 7fd230c00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 0x7fd20406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:16.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.958+0000 7fd230c00640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 0x7fd20406d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd21c000f60 tx=0x7fd21c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:16.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:16.962+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd2140768e0 con 0x7fd22c14fdb0 2024-01-20T08:11:17.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.156+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd22c0c2260 con 0x7fd22c14fdb0 2024-01-20T08:11:17.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.157+0000 7fd228c00640 1 -- 172.21.15.100:0/1479553205 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd2140350a0 con 0x7fd22c14fdb0 2024-01-20T08:11:17.160 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 msgr2=0x7fd20406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 0x7fd20406d390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd21c000f60 tx=0x7fd21c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 msgr2=0x7fd22c1eae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fd2140098c0 tx=0x7fd2140046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 shutdown_connections 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd22c153120 0x7fd22c06d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd22c14fdb0 0x7fd22c1eae00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd20406aed0 0x7fd20406d390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 --2- 172.21.15.100:0/1479553205 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd22c0c3460 0x7fd22c1551c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 >> 172.21.15.100:0/1479553205 conn(0x7fd22c0c2940 msgr2=0x7fd22c0c0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 shutdown_connections 2024-01-20T08:11:17.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.160+0000 7fd233600640 1 -- 172.21.15.100:0/1479553205 wait complete. 2024-01-20T08:11:17.181 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:11:17.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.375+0000 7fe397e00640 1 Processor -- start 2024-01-20T08:11:17.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.375+0000 7fe397e00640 1 -- start start 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.376+0000 7fe397e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe39806d2c0 0x7fe398155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.376+0000 7fe397e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe39806d750 con 0x7fe3980c0ed0 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.376+0000 7fe397e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3981559b0 con 0x7fe3980c4e20 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.376+0000 7fe397e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3980c1930 con 0x7fe39806d2c0 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe396000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe3980c0ed0 0x7fe39806cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57570/0 (socket says 172.21.15.100:57570) 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe396000640 1 -- 172.21.15.100:0/1422604034 learned_addr learned my addr 172.21.15.100:0/1422604034 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe397400640 1 --2- 172.21.15.100:0/1422604034 >> v2:172.21.15.110:3300/0 conn(0x7fe39806d2c0 0x7fe398155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2687371706 0 0) 0x7fe39806d750 con 0x7fe3980c0ed0 2024-01-20T08:11:17.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe378003520 con 0x7fe3980c0ed0 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2814929780 0 0) 0x7fe378003520 con 0x7fe3980c0ed0 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 >> v2:172.21.15.110:3300/0 conn(0x7fe39806d2c0 msgr2=0x7fe398155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 --2- 172.21.15.100:0/1422604034 >> v2:172.21.15.110:3300/0 conn(0x7fe39806d2c0 0x7fe398155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 >> v1:172.21.15.110:6789/0 conn(0x7fe3980c4e20 legacy=0x7fe3980aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe39806c160 con 0x7fe3980c0ed0 2024-01-20T08:11:17.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.377+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe380001670 con 0x7fe3980c0ed0 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 >> v1:172.21.15.100:6789/0 conn(0x7fe3980c0ed0 legacy=0x7fe39806cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe378003970 0x7fe378003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3780047c0 0x7fe378004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe37800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3980c1930 con 0x7fe378005180 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37800c000 con 0x7fe378003970 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37800c1c0 con 0x7fe3780047c0 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe397400640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe37800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe396a00640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe378003970 0x7fe378003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe396000640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3780047c0 0x7fe378004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe397400640 1 -- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3780047c0 msgr2=0x7fe378004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe397400640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3780047c0 0x7fe378004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe397400640 1 -- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe378003970 msgr2=0x7fe378003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.378+0000 7fe397400640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe378003970 0x7fe378003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.379+0000 7fe397400640 1 -- 172.21.15.100:0/1422604034 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378003520 con 0x7fe378005180 2024-01-20T08:11:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.379+0000 7fe396a00640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe378003970 0x7fe378003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:11:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.379+0000 7fe396000640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3780047c0 0x7fe378004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.379+0000 7fe397400640 1 -- 172.21.15.100:0/1422604034 reap_dead start 2024-01-20T08:11:17.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397400640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe37800b980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe390009fc0 tx=0x7fe3780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13035a90b650b612 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe39002cc60 con 0x7fe378005180 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe39000f040 con 0x7fe378005180 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe395600640 1 -- 172.21.15.100:0/1422604034 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe390003990 con 0x7fe378005180 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397e00640 1 -- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 msgr2=0x7fe37800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397e00640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe37800b980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fe390009fc0 tx=0x7fe3780057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397e00640 1 -- 172.21.15.100:0/1422604034 shutdown_connections 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397e00640 1 --2- 172.21.15.100:0/1422604034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe37800b980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.380+0000 7fe397e00640 1 -- 172.21.15.100:0/1422604034 >> 172.21.15.100:0/1422604034 conn(0x7fe3980c5ba0 msgr2=0x7fe3980c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.381+0000 7fe397e00640 1 -- 172.21.15.100:0/1422604034 shutdown_connections 2024-01-20T08:11:17.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.381+0000 7fe397e00640 1 -- 172.21.15.100:0/1422604034 wait complete. 2024-01-20T08:11:17.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.382+0000 7fe397e00640 1 Processor -- start 2024-01-20T08:11:17.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.382+0000 7fe397e00640 1 -- start start 2024-01-20T08:11:17.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398151680 0x7fe3981de5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe39814ff40 0x7fe39814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981534d0 con 0x7fe378005180 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981ddc20 con 0x7fe398151680 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe397e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3981df6e0 con 0x7fe39814ff40 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe396a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe396a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32950/0 (socket says 172.21.15.100:32950) 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.383+0000 7fe396a00640 1 -- 172.21.15.100:0/2003370473 learned_addr learned my addr 172.21.15.100:0/2003370473 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe397400640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe39814ff40 0x7fe39814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396000640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398151680 0x7fe3981de5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 -- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe39814ff40 msgr2=0x7fe39814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe39814ff40 0x7fe39814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 -- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398151680 msgr2=0x7fe3981de5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398151680 0x7fe3981de5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 -- 172.21.15.100:0/2003370473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe398150840 con 0x7fe378005180 2024-01-20T08:11:17.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe396a00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f870 tx=0x7fe38800fd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388003b20 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe388005030 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe388005420 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.384+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe398150b20 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.385+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe39814d400 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.386+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe398067b60 con 0x7fe378005180 2024-01-20T08:11:17.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.386+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe38800d940 con 0x7fe378005180 2024-01-20T08:11:17.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.387+0000 7fe38f400640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 0x7fe37006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.387+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe388089740 con 0x7fe378005180 2024-01-20T08:11:17.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.387+0000 7fe396000640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 0x7fe37006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.388+0000 7fe396000640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 0x7fe37006d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe398151a60 tx=0x7fe380009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.391+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe388054600 con 0x7fe378005180 2024-01-20T08:11:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.572+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe398150d60 con 0x7fe378005180 2024-01-20T08:11:17.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.573+0000 7fe38f400640 1 -- 172.21.15.100:0/2003370473 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v34) v1 ==== 84+0+207 (secure 0 0 0) 0x7fe388018020 con 0x7fe378005180 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 4, 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_metadata" 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 5, 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_data" 2024-01-20T08:11:17.576 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:11:17.577 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.575+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 msgr2=0x7fe37006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.575+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 0x7fe37006d3c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe398151a60 tx=0x7fe380009040 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.575+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 msgr2=0x7fe3981de0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.575+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe38800f870 tx=0x7fe38800fd30 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 shutdown_connections 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe37006af00 0x7fe37006d3c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe39814ff40 0x7fe39814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe398151680 0x7fe3981de5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 --2- 172.21.15.100:0/2003370473 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe378005180 0x7fe3981de0b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 >> 172.21.15.100:0/2003370473 conn(0x7fe3980c5ba0 msgr2=0x7fe398070020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 shutdown_connections 2024-01-20T08:11:17.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.576+0000 7fe397e00640 1 -- 172.21.15.100:0/2003370473 wait complete. 2024-01-20T08:11:17.597 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-20T08:11:17.597 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-20T08:11:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.797+0000 7f9a00c00640 1 Processor -- start 2024-01-20T08:11:17.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.797+0000 7f9a00c00640 1 -- start start 2024-01-20T08:11:17.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f9a00c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99fc148080 0x7f99fc0c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f9a00c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99fc0a84a0 0x7f99fc15be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f9a00c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99fc06d1d0 con 0x7f99fc070c00 2024-01-20T08:11:17.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f9a00c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc0a8ce0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f9a00c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99fc148460 con 0x7f99fc148080 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f99fa800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99fc0a84a0 0x7f99fc15be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f99fa800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99fc0a84a0 0x7f99fc15be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32962/0 (socket says 172.21.15.100:32962) 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.799+0000 7f99fa800640 1 -- 172.21.15.100:0/1471180203 learned_addr learned my addr 172.21.15.100:0/1471180203 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.800+0000 7f99f9e00640 1 --2- 172.21.15.100:0/1471180203 >> v2:172.21.15.110:3300/0 conn(0x7f99fc148080 0x7f99fc0c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.800+0000 7f99fa800640 1 -- 172.21.15.100:0/1471180203 >> v2:172.21.15.110:3300/0 conn(0x7f99fc148080 msgr2=0x7f99fc0c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.800+0000 7f99fa800640 1 --2- 172.21.15.100:0/1471180203 >> v2:172.21.15.110:3300/0 conn(0x7f99fc148080 0x7f99fc0c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.800+0000 7f99fa800640 1 -- 172.21.15.100:0/1471180203 >> v1:172.21.15.110:6789/0 conn(0x7f99fc070c00 legacy=0x7f99fc06d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.800+0000 7f99fa800640 1 -- 172.21.15.100:0/1471180203 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0c2540 con 0x7f99fc0a84a0 2024-01-20T08:11:17.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.801+0000 7f99fa800640 1 --2- 172.21.15.100:0/1471180203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc15be30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009e50 tx=0x7f99f402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4789a8ef9f3eb3b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.802+0000 7f99f9400640 1 -- 172.21.15.100:0/1471180203 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f402ca80 con 0x7f99fc0a84a0 2024-01-20T08:11:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.802+0000 7f99f9400640 1 -- 172.21.15.100:0/1471180203 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f402cbe0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.802+0000 7f99f9400640 1 -- 172.21.15.100:0/1471180203 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f40343f0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.802+0000 7f9a00c00640 1 -- 172.21.15.100:0/1471180203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 msgr2=0x7f99fc15be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.802+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1471180203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc15be30 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f99f4009e50 tx=0x7f99f402bee0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 -- 172.21.15.100:0/1471180203 shutdown_connections 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1471180203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc15be30 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1471180203 >> v2:172.21.15.110:3300/0 conn(0x7f99fc148080 0x7f99fc0c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 -- 172.21.15.100:0/1471180203 >> 172.21.15.100:0/1471180203 conn(0x7f99fc0c2b00 msgr2=0x7f99fc0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 -- 172.21.15.100:0/1471180203 shutdown_connections 2024-01-20T08:11:17.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.803+0000 7f9a00c00640 1 -- 172.21.15.100:0/1471180203 wait complete. 2024-01-20T08:11:17.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.804+0000 7f9a00c00640 1 Processor -- start 2024-01-20T08:11:17.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.804+0000 7f9a00c00640 1 -- start start 2024-01-20T08:11:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99fc070c00 0x7f99fc150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99fc148080 0x7f99fc1432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc0ac1a0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc1ed750 con 0x7f99fc070c00 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.805+0000 7f9a00c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99fc151130 con 0x7f99fc148080 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32978/0 (socket says 172.21.15.100:32978) 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 -- 172.21.15.100:0/1634530248 learned_addr learned my addr 172.21.15.100:0/1634530248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f9e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99fc070c00 0x7f99fc150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 -- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99fc148080 msgr2=0x7f99fc1432e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99fc148080 0x7f99fc1432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 -- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99fc070c00 msgr2=0x7f99fc150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99fc070c00 0x7f99fc150830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 -- 172.21.15.100:0/1634530248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f4009b30 con 0x7f99fc0a84a0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f3e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c3c0 tx=0x7f99e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e40052d0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e4005450 con 0x7f99fc0a84a0 2024-01-20T08:11:17.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.806+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99e4007260 con 0x7f99fc0a84a0 2024-01-20T08:11:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.807+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99fc1ed9a0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.807+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99fc1edf60 con 0x7f99fc0a84a0 2024-01-20T08:11:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.808+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99fc144b30 con 0x7f99fc0a84a0 2024-01-20T08:11:17.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.809+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f99e40073c0 con 0x7f99fc0a84a0 2024-01-20T08:11:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.809+0000 7f99f2000640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 0x7f99d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.809+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99e4088920 con 0x7f99fc0a84a0 2024-01-20T08:11:17.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.810+0000 7f99f9e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 0x7f99d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:17.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.810+0000 7f99f9e00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 0x7f99d406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009a10 tx=0x7f99ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:17.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:17.814+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f99e4053880 con 0x7f99fc0a84a0 2024-01-20T08:11:18.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.005+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f99fc074450 con 0x7f99fc0a84a0 2024-01-20T08:11:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.454+0000 7f99f2000640 1 -- 172.21.15.100:0/1634530248 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v35) v1 ==== 140+0+0 (secure 0 0 0) 0x7f99e4056ea0 con 0x7f99fc0a84a0 2024-01-20T08:11:18.457 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' created 2024-01-20T08:11:18.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.458+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 msgr2=0x7f99d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.458+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 0x7f99d406d390 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99ec009a10 tx=0x7f99ec008040 comp rx=0 tx=0).stop 2024-01-20T08:11:18.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.458+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 msgr2=0x7f99fc1413a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.458+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f99e400c3c0 tx=0x7f99e400c880 comp rx=0 tx=0).stop 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 shutdown_connections 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d406aed0 0x7f99d406d390 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99fc148080 0x7f99fc1432e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99fc0a84a0 0x7f99fc1413a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 --2- 172.21.15.100:0/1634530248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99fc070c00 0x7f99fc150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 >> 172.21.15.100:0/1634530248 conn(0x7f99fc0c2b00 msgr2=0x7f99fc144420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 shutdown_connections 2024-01-20T08:11:18.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.459+0000 7f9a00c00640 1 -- 172.21.15.100:0/1634530248 wait complete. 2024-01-20T08:11:18.487 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:11:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.674+0000 7f9749600640 1 Processor -- start 2024-01-20T08:11:18.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.674+0000 7f9749600640 1 -- start start 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f9749600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97441584b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f9749600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440c4ba0 con 0x7f97440c5e00 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f9749600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97440c58d0 con 0x7f974406b5f0 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f9749600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c6290 con 0x7f974406eff0 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f973be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f97440c5e00 0x7f974415d0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:57586/0 (socket says 172.21.15.100:57586) 2024-01-20T08:11:18.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.676+0000 7f973be00640 1 -- 172.21.15.100:0/1157259738 learned_addr learned my addr 172.21.15.100:0/1157259738 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:18.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9743400640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97441584b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2507396020 0 0) 0x7f97440c4ba0 con 0x7f97440c5e00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9724003520 con 0x7f97440c5e00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2170316416 0 0) 0x7f9724003520 con 0x7f97440c5e00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 msgr2=0x7f97441584b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97441584b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 >> v1:172.21.15.110:6789/0 conn(0x7f974406b5f0 legacy=0x7f9744157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97440c4df0 con 0x7f97440c5e00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f972c001670 con 0x7f97440c5e00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 >> v1:172.21.15.100:6789/0 conn(0x7f97440c5e00 legacy=0x7f974415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97240039a0 0x7f9724003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f9724005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97440c6290 con 0x7f9724004d00 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f972400ba60 con 0x7f97240039a0 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.677+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f972400bc20 con 0x7f974406eff0 2024-01-20T08:11:18.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f9724005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9742a00640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97240039a0 0x7f9724003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f973be00640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 -- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 msgr2=0x7f97240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 -- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97240039a0 msgr2=0x7f9724003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97240039a0 0x7f9724003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9743400640 1 -- 172.21.15.100:0/1157259738 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9724003520 con 0x7f9724004d00 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f9742a00640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97240039a0 0x7f9724003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:18.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.678+0000 7f973be00640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974406eff0 0x7f97240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.679+0000 7f9743400640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f9724005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f974406f460 tx=0x7f97240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a21db3360f61a70 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c02cb90 con 0x7f9724004d00 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c00f040 con 0x7f9724004d00 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9742000640 1 -- 172.21.15.100:0/1157259738 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c034440 con 0x7f9724004d00 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 -- 172.21.15.100:0/1157259738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 msgr2=0x7f9724005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 --2- 172.21.15.100:0/1157259738 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f9724005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f974406f460 tx=0x7f97240057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9743400640 1 -- 172.21.15.100:0/1157259738 reap_dead start 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 -- 172.21.15.100:0/1157259738 shutdown_connections 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 -- 172.21.15.100:0/1157259738 >> 172.21.15.100:0/1157259738 conn(0x7f97440c3270 msgr2=0x7f97440c3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 -- 172.21.15.100:0/1157259738 shutdown_connections 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.680+0000 7f9749600640 1 -- 172.21.15.100:0/1157259738 wait complete. 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.682+0000 7f9749600640 1 Processor -- start 2024-01-20T08:11:18.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.682+0000 7f9749600640 1 -- start start 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 0x7f9744156fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 0x7f97441edc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97441ed820 con 0x7f9724004d00 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9744149b30 con 0x7f9744157500 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9749600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9744070a40 con 0x7f974414e520 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9742a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9742a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:32990/0 (socket says 172.21.15.100:32990) 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.683+0000 7f9742a00640 1 -- 172.21.15.100:0/2413448272 learned_addr learned my addr 172.21.15.100:0/2413448272 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9743400640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 0x7f97441edc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f973be00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 0x7f9744156fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 -- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 msgr2=0x7f9744156fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 0x7f9744156fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 -- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 msgr2=0x7f97441edc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:18.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 0x7f97441edc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:18.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 -- 172.21.15.100:0/2413448272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9744070d20 con 0x7f9724004d00 2024-01-20T08:11:18.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f973be00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 0x7f9744156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:18.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9743400640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 0x7f97441edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:18.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9742a00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f973400e580 tx=0x7f973400ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97340052e0 con 0x7f9724004d00 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9734005440 con 0x7f9724004d00 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9744071000 con 0x7f9724004d00 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.684+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734003830 con 0x7f9724004d00 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.685+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97441e0b70 con 0x7f9724004d00 2024-01-20T08:11:18.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.685+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9744067640 con 0x7f9724004d00 2024-01-20T08:11:18.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.688+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9734003990 con 0x7f9724004d00 2024-01-20T08:11:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.689+0000 7f973aa00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 0x7f971c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.689+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f9734089f20 con 0x7f9724004d00 2024-01-20T08:11:18.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.689+0000 7f973be00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 0x7f971c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:18.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.690+0000 7f973be00640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 0x7f971c06d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f972c001eb0 tx=0x7f972c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:18.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.693+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9734054c90 con 0x7f9724004d00 2024-01-20T08:11:18.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:18.885+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f97440c4980 con 0x7f9724004d00 2024-01-20T08:11:19.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.476+0000 7f973aa00640 1 -- 172.21.15.100:0/2413448272 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v36) v1 ==== 172+0+0 (secure 0 0 0) 0x7f97340582b0 con 0x7f9724004d00 2024-01-20T08:11:19.479 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' created 2024-01-20T08:11:19.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 msgr2=0x7f971c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 0x7f971c06d3c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f972c001eb0 tx=0x7f972c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:19.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 msgr2=0x7f97441eaa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f973400e580 tx=0x7f973400ea40 comp rx=0 tx=0).stop 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 shutdown_connections 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9744157500 0x7f97441edc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971c06af00 0x7f971c06d3c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f974414e520 0x7f9744156fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 --2- 172.21.15.100:0/2413448272 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9724004d00 0x7f97441eaa50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.480+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 >> 172.21.15.100:0/2413448272 conn(0x7f97440c3270 msgr2=0x7f974414ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.481+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 shutdown_connections 2024-01-20T08:11:19.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.481+0000 7f9749600640 1 -- 172.21.15.100:0/2413448272 wait complete. 2024-01-20T08:11:19.515 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-20T08:11:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.692+0000 7f5503e00640 1 Processor -- start 2024-01-20T08:11:19.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.692+0000 7f5503e00640 1 -- start start 2024-01-20T08:11:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f55040c4e20 0x7f5504155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f550406cbb0 0x7f550406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55041559b0 con 0x7f55040c0ed0 2024-01-20T08:11:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55040c1930 con 0x7f550406cbb0 2024-01-20T08:11:19.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550406c160 con 0x7f55040c4e20 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f550406cbb0 0x7f550406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f550406cbb0 0x7f550406d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45062/0 (socket says 172.21.15.100:45062) 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503400640 1 -- 172.21.15.100:0/1607034594 learned_addr learned my addr 172.21.15.100:0/1607034594 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5502a00640 1 --2- 172.21.15.100:0/1607034594 >> v2:172.21.15.110:3300/0 conn(0x7f55040c4e20 0x7f5504155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503400640 1 -- 172.21.15.100:0/1607034594 >> v2:172.21.15.110:3300/0 conn(0x7f55040c4e20 msgr2=0x7f5504155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.694+0000 7f5503400640 1 --2- 172.21.15.100:0/1607034594 >> v2:172.21.15.110:3300/0 conn(0x7f55040c4e20 0x7f5504155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.695+0000 7f5503400640 1 -- 172.21.15.100:0/1607034594 >> v1:172.21.15.100:6789/0 conn(0x7f55040c0ed0 legacy=0x7f55040aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.695+0000 7f5503400640 1 -- 172.21.15.100:0/1607034594 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55040c1b80 con 0x7f550406cbb0 2024-01-20T08:11:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5503400640 1 --2- 172.21.15.100:0/1607034594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f550406cbb0 0x7f550406d040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55040c6bb0 tx=0x7f54fc02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6feb6c35d26ea4a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5502000640 1 -- 172.21.15.100:0/1607034594 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc02cb20 con 0x7f550406cbb0 2024-01-20T08:11:19.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5502000640 1 -- 172.21.15.100:0/1607034594 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc02cc80 con 0x7f550406cbb0 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5502000640 1 -- 172.21.15.100:0/1607034594 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc0343f0 con 0x7f550406cbb0 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5503e00640 1 -- 172.21.15.100:0/1607034594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f550406cbb0 msgr2=0x7f550406d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.696+0000 7f5503e00640 1 --2- 172.21.15.100:0/1607034594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f550406cbb0 0x7f550406d040 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f55040c6bb0 tx=0x7f54fc02bf80 comp rx=0 tx=0).stop 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 -- 172.21.15.100:0/1607034594 shutdown_connections 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 --2- 172.21.15.100:0/1607034594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f550406cbb0 0x7f550406d040 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 --2- 172.21.15.100:0/1607034594 >> v2:172.21.15.110:3300/0 conn(0x7f55040c4e20 0x7f5504155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 -- 172.21.15.100:0/1607034594 >> 172.21.15.100:0/1607034594 conn(0x7f55040c5ba0 msgr2=0x7f55040c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 -- 172.21.15.100:0/1607034594 shutdown_connections 2024-01-20T08:11:19.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.697+0000 7f5503e00640 1 -- 172.21.15.100:0/1607034594 wait complete. 2024-01-20T08:11:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.698+0000 7f5503e00640 1 Processor -- start 2024-01-20T08:11:19.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.698+0000 7f5503e00640 1 -- start start 2024-01-20T08:11:19.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 0x7f5504152e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55040c0ed0 0x7f55041ea680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55041edbd0 con 0x7f55040c4e20 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55041edeb0 con 0x7f550406cbb0 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.699+0000 7f5503e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55041ee190 con 0x7f55040c0ed0 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45068/0 (socket says 172.21.15.100:45068) 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 -- 172.21.15.100:0/1335479699 learned_addr learned my addr 172.21.15.100:0/1335479699 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5502a00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 0x7f5504152e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 -- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55040c0ed0 msgr2=0x7f55041ea680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f54f9e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55040c0ed0 0x7f55041ea680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55040c0ed0 0x7f55041ea680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 -- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 msgr2=0x7f5504152e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:19.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 0x7f5504152e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 -- 172.21.15.100:0/1335479699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54fc009b30 con 0x7f55040c4e20 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5502a00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 0x7f5504152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.700+0000 7f5503400640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54fc036040 tx=0x7f54fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.701+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc007e70 con 0x7f55040c4e20 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.701+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54fc009510 con 0x7f55040c4e20 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.701+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54fc03e690 con 0x7f55040c4e20 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.701+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55041ee470 con 0x7f55040c4e20 2024-01-20T08:11:19.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.701+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55041ea0f0 con 0x7f55040c4e20 2024-01-20T08:11:19.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.702+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f550404e970 con 0x7f55040c4e20 2024-01-20T08:11:19.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.703+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f54fc03e7f0 con 0x7f55040c4e20 2024-01-20T08:11:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.704+0000 7f54fb400640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.704+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6463+0+0 (secure 0 0 0) 0x7f54fc0ac8f0 con 0x7f55040c4e20 2024-01-20T08:11:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.704+0000 7f5502a00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:19.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.705+0000 7f5502a00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 0x7f54dc06d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006fd0 tx=0x7f54f4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:19.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.708+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f54fc077760 con 0x7f55040c4e20 2024-01-20T08:11:19.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:19.935+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7f55040c0bd0 con 0x7f55040c4e20 2024-01-20T08:11:20.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.480+0000 7f54fb400640 1 -- 172.21.15.100:0/1335479699 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 175+0+0 (secure 0 0 0) 0x7f54fc07ad80 con 0x7f55040c4e20 2024-01-20T08:11:20.483 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 6 and data pool 7 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 msgr2=0x7f54dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 0x7f54dc06d3c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f54f4006fd0 tx=0x7f54f4008040 comp rx=0 tx=0).stop 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 msgr2=0x7f55041eabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f54fc036040 tx=0x7f54fc004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 shutdown_connections 2024-01-20T08:11:20.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55040c4e20 0x7f55041eabc0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f54dc06af00 0x7f54dc06d3c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55040c0ed0 0x7f55041ea680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 --2- 172.21.15.100:0/1335479699 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f550406cbb0 0x7f5504152e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 >> 172.21.15.100:0/1335479699 conn(0x7f55040c5ba0 msgr2=0x7f55040bf850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.485+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 shutdown_connections 2024-01-20T08:11:20.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.486+0000 7f5503e00640 1 -- 172.21.15.100:0/1335479699 wait complete. 2024-01-20T08:11:20.530 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:20.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.697+0000 7f36a4c00640 1 Processor -- start 2024-01-20T08:11:20.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.697+0000 7f36a4c00640 1 -- start start 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.698+0000 7f36a4c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36a00bfae0 0x7f36a0151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f36a4c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f36a4c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a00c0fb0 con 0x7f36a0071220 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f36a4c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a00c04a0 con 0x7f36a00bfae0 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f36a4c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0071d10 con 0x7f36a01521e0 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36a00bfae0 0x7f36a0151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36a00bfae0 0x7f36a0151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45082/0 (socket says 172.21.15.100:45082) 2024-01-20T08:11:20.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 -- 172.21.15.100:0/3195685405 learned_addr learned my addr 172.21.15.100:0/3195685405 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:20.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 -- 172.21.15.100:0/3195685405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 msgr2=0x7f36a0157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:20.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 --2- 172.21.15.100:0/3195685405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 -- 172.21.15.100:0/3195685405 >> v1:172.21.15.100:6789/0 conn(0x7f36a0071220 legacy=0x7f36a0071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.699+0000 7f3697e00640 1 -- 172.21.15.100:0/3195685405 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a006def0 con 0x7f36a00bfae0 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.700+0000 7f3697e00640 1 --2- 172.21.15.100:0/3195685405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a00bfae0 0x7f36a0151ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f368802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefcc0a72bd3a0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f369d400640 1 -- 172.21.15.100:0/3195685405 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36880317c0 con 0x7f36a00bfae0 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f369d400640 1 -- 172.21.15.100:0/3195685405 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3688031920 con 0x7f36a00bfae0 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f369d400640 1 -- 172.21.15.100:0/3195685405 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688031cb0 con 0x7f36a00bfae0 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 -- 172.21.15.100:0/3195685405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a00bfae0 msgr2=0x7f36a0151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 --2- 172.21.15.100:0/3195685405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a00bfae0 0x7f36a0151ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f368802b860 comp rx=0 tx=0).stop 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 -- 172.21.15.100:0/3195685405 shutdown_connections 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 --2- 172.21.15.100:0/3195685405 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 --2- 172.21.15.100:0/3195685405 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a00bfae0 0x7f36a0151ca0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 -- 172.21.15.100:0/3195685405 >> 172.21.15.100:0/3195685405 conn(0x7f36a006a5e0 msgr2=0x7f36a006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.701+0000 7f36a4c00640 1 -- 172.21.15.100:0/3195685405 shutdown_connections 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.702+0000 7f36a4c00640 1 -- 172.21.15.100:0/3195685405 wait complete. 2024-01-20T08:11:20.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.703+0000 7f36a4c00640 1 Processor -- start 2024-01-20T08:11:20.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.703+0000 7f36a4c00640 1 -- start start 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00bfae0 0x7f36a014cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a0156220 con 0x7f36a0071220 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a01ed960 con 0x7f36a00bfae0 2024-01-20T08:11:20.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f36a4c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a00c4120 con 0x7f36a01521e0 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f369de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f369de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45094/0 (socket says 172.21.15.100:45094) 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.704+0000 7f369de00640 1 -- 172.21.15.100:0/4013068390 learned_addr learned my addr 172.21.15.100:0/4013068390 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369e800640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f3697e00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00bfae0 0x7f36a014cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 -- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 msgr2=0x7f36a0144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 -- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00bfae0 msgr2=0x7f36a014cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00bfae0 0x7f36a014cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 -- 172.21.15.100:0/4013068390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880094d0 con 0x7f36a0071220 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f369de00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f369000c400 tx=0x7f369000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36900052d0 con 0x7f36a0071220 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3690005450 con 0x7f36a0071220 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a00c4400 con 0x7f36a0071220 2024-01-20T08:11:20.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690007260 con 0x7f36a0071220 2024-01-20T08:11:20.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.705+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a0149ae0 con 0x7f36a0071220 2024-01-20T08:11:20.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.706+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a00c4920 con 0x7f36a0071220 2024-01-20T08:11:20.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.707+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f36900073c0 con 0x7f36a0071220 2024-01-20T08:11:20.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.708+0000 7f3696000640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 0x7f367806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:20.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.708+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3690088da0 con 0x7f36a0071220 2024-01-20T08:11:20.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.708+0000 7f3697e00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 0x7f367806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:20.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.709+0000 7f3697e00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 0x7f367806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3688036000 tx=0x7f368803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:20.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.713+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f36a00c4920 con 0x7f36a0071220 2024-01-20T08:11:20.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.891+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36a00c4920 con 0x7f36a0071220 2024-01-20T08:11:20.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.894+0000 7f3696000640 1 -- 172.21.15.100:0/4013068390 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20219 (secure 0 0 0) 0x7f36a00c4920 con 0x7f36a0071220 2024-01-20T08:11:20.897 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:20.898 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:19.937060+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.896+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 msgr2=0x7f367806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.896+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 0x7f367806d3c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3688036000 tx=0x7f368803d040 comp rx=0 tx=0).stop 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.896+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 msgr2=0x7f36a01495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.896+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f369000c400 tx=0x7f369000c8c0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 shutdown_connections 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f367806af00 0x7f367806d3c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f36a01521e0 0x7f36a0144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36a00bfae0 0x7f36a014cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 --2- 172.21.15.100:0/4013068390 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36a0071220 0x7f36a01495a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:20.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 >> 172.21.15.100:0/4013068390 conn(0x7f36a006a5e0 msgr2=0x7f36a006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:20.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 shutdown_connections 2024-01-20T08:11:20.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:20.897+0000 7f36a4c00640 1 -- 172.21.15.100:0/4013068390 wait complete. 2024-01-20T08:11:20.917 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:21.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.112+0000 7fca59200640 1 Processor -- start 2024-01-20T08:11:21.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.112+0000 7fca59200640 1 -- start start 2024-01-20T08:11:21.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.113+0000 7fca59200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.113+0000 7fca59200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fca540aae00 0x7fca540ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.113+0000 7fca59200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca540a9940 con 0x7fca540a93c0 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.113+0000 7fca59200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca541500c0 con 0x7fca540aae00 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.113+0000 7fca59200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca54156810 con 0x7fca5414fce0 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca51400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fca540a93c0 0x7fca54152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51736/0 (socket says 172.21.15.100:51736) 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca51400640 1 -- 172.21.15.100:0/3803280478 learned_addr learned my addr 172.21.15.100:0/3803280478 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca52800640 1 --2- 172.21.15.100:0/3803280478 >> v2:172.21.15.100:3300/0 conn(0x7fca540aae00 0x7fca540ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca51e00640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca52800640 1 -- 172.21.15.100:0/3803280478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 msgr2=0x7fca54153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca52800640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca52800640 1 -- 172.21.15.100:0/3803280478 >> v1:172.21.15.100:6789/0 conn(0x7fca540a93c0 legacy=0x7fca54152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.114+0000 7fca52800640 1 -- 172.21.15.100:0/3803280478 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54156af0 con 0x7fca540aae00 2024-01-20T08:11:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.115+0000 7fca52800640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540aae00 0x7fca540ab290 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c28307a9475fac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca50a00640 1 -- 172.21.15.100:0/3803280478 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c02cc50 con 0x7fca540aae00 2024-01-20T08:11:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca50a00640 1 -- 172.21.15.100:0/3803280478 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4c02cdb0 con 0x7fca540aae00 2024-01-20T08:11:21.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca50a00640 1 -- 172.21.15.100:0/3803280478 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4c034660 con 0x7fca540aae00 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 -- 172.21.15.100:0/3803280478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540aae00 msgr2=0x7fca540ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540aae00 0x7fca540ab290 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fca4c009d90 tx=0x7fca4c02bea0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 -- 172.21.15.100:0/3803280478 shutdown_connections 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540aae00 0x7fca540ab290 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 --2- 172.21.15.100:0/3803280478 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 -- 172.21.15.100:0/3803280478 >> 172.21.15.100:0/3803280478 conn(0x7fca5406a5e0 msgr2=0x7fca5406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 -- 172.21.15.100:0/3803280478 shutdown_connections 2024-01-20T08:11:21.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.116+0000 7fca59200640 1 -- 172.21.15.100:0/3803280478 wait complete. 2024-01-20T08:11:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.118+0000 7fca59200640 1 Processor -- start 2024-01-20T08:11:21.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.118+0000 7fca59200640 1 -- start start 2024-01-20T08:11:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca540aae00 0x7fca540bfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca541e8180 con 0x7fca540a93c0 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca540bceb0 con 0x7fca540aae00 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca59200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541e8fa0 con 0x7fca5414fce0 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca51e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca51e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45112/0 (socket says 172.21.15.100:45112) 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.119+0000 7fca51e00640 1 -- 172.21.15.100:0/1988712816 learned_addr learned my addr 172.21.15.100:0/1988712816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51400640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca540aae00 0x7fca540bfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca52800640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 -- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 msgr2=0x7fca54155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 -- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca540aae00 msgr2=0x7fca540bfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca540aae00 0x7fca540bfa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 -- 172.21.15.100:0/1988712816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c009a70 con 0x7fca540a93c0 2024-01-20T08:11:21.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca51e00640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d620 tx=0x7fca4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400b620 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca4400b780 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca541e8390 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca4400bb10 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.120+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca541e8950 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.121+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca5404e970 con 0x7fca540a93c0 2024-01-20T08:11:21.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.122+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fca4400bc70 con 0x7fca540a93c0 2024-01-20T08:11:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.123+0000 7fca4a000640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 0x7fca2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.123+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca44089f30 con 0x7fca540a93c0 2024-01-20T08:11:21.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.123+0000 7fca51400640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 0x7fca2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.124+0000 7fca51400640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 0x7fca2c06d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fca541de440 tx=0x7fca3c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.127+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fca44054a10 con 0x7fca540a93c0 2024-01-20T08:11:21.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.313+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca5406b320 con 0x7fca540a93c0 2024-01-20T08:11:21.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.315+0000 7fca4a000640 1 -- 172.21.15.100:0/1988712816 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+20219 (secure 0 0 0) 0x7fca44058030 con 0x7fca540a93c0 2024-01-20T08:11:21.318 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:21.319 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:19.937060+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 msgr2=0x7fca2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 0x7fca2c06d390 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fca541de440 tx=0x7fca3c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 msgr2=0x7fca5414cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fca4400d620 tx=0x7fca4400dae0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 shutdown_connections 2024-01-20T08:11:21.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2c06aed0 0x7fca2c06d390 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca5414fce0 0x7fca54155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca540aae00 0x7fca540bfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 --2- 172.21.15.100:0/1988712816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca540a93c0 0x7fca5414cc20 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 >> 172.21.15.100:0/1988712816 conn(0x7fca5406a5e0 msgr2=0x7fca540c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 shutdown_connections 2024-01-20T08:11:21.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.318+0000 7fca59200640 1 -- 172.21.15.100:0/1988712816 wait complete. 2024-01-20T08:11:21.339 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-20T08:11:21.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.526+0000 7f7dd7c00640 1 Processor -- start 2024-01-20T08:11:21.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.527+0000 7f7dd7c00640 1 -- start start 2024-01-20T08:11:21.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd7c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7dd014ff70 0x7f7dd0156090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd7c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd7c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd00a84a0 con 0x7f7dd006a5e0 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd7c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd00c1aa0 con 0x7f7dd014ff70 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd7c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd00c3940 con 0x7f7dd00a9b70 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7dd014ff70 0x7f7dd0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7dd014ff70 0x7f7dd0156090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45114/0 (socket says 172.21.15.100:45114) 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.528+0000 7f7dd5200640 1 -- 172.21.15.100:0/1997409820 learned_addr learned my addr 172.21.15.100:0/1997409820 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.529+0000 7f7dcfe00640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.529+0000 7f7dd5200640 1 -- 172.21.15.100:0/1997409820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 msgr2=0x7f7dd01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.529+0000 7f7dd5200640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd01565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.529+0000 7f7dd5200640 1 -- 172.21.15.100:0/1997409820 >> v1:172.21.15.100:6789/0 conn(0x7f7dd006a5e0 legacy=0x7f7dd006aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.529+0000 7f7dd5200640 1 -- 172.21.15.100:0/1997409820 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0153220 con 0x7f7dd014ff70 2024-01-20T08:11:21.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.530+0000 7f7dd5200640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd014ff70 0x7f7dd0156090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=181c764808c16332 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.530+0000 7f7dcf400640 1 -- 172.21.15.100:0/1997409820 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8031640 con 0x7f7dd014ff70 2024-01-20T08:11:21.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dcf400640 1 -- 172.21.15.100:0/1997409820 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc80317a0 con 0x7f7dd014ff70 2024-01-20T08:11:21.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dcf400640 1 -- 172.21.15.100:0/1997409820 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8031b30 con 0x7f7dd014ff70 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 -- 172.21.15.100:0/1997409820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd014ff70 msgr2=0x7f7dd0156090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd014ff70 0x7f7dd0156090 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8009870 tx=0x7f7dc802b8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 -- 172.21.15.100:0/1997409820 shutdown_connections 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/1997409820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd014ff70 0x7f7dd0156090 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 -- 172.21.15.100:0/1997409820 >> 172.21.15.100:0/1997409820 conn(0x7f7dd00c3b10 msgr2=0x7f7dd00c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:21.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 -- 172.21.15.100:0/1997409820 shutdown_connections 2024-01-20T08:11:21.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.531+0000 7f7dd7c00640 1 -- 172.21.15.100:0/1997409820 wait complete. 2024-01-20T08:11:21.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.533+0000 7f7dd7c00640 1 Processor -- start 2024-01-20T08:11:21.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.533+0000 7f7dd7c00640 1 -- start start 2024-01-20T08:11:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd0145030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0145c50 0x7f7dd0145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd014a380 con 0x7f7dd006a5e0 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd0145ab0 con 0x7f7dd0145c50 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd7c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd01ea8b0 con 0x7f7dd00a9b70 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45130/0 (socket says 172.21.15.100:45130) 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.534+0000 7f7dd5200640 1 -- 172.21.15.100:0/87123638 learned_addr learned my addr 172.21.15.100:0/87123638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:21.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0145c50 0x7f7dd0145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dcfe00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd0145030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 -- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 msgr2=0x7f7dd0145030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd0145030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 -- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0145c50 msgr2=0x7f7dd0145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0145c50 0x7f7dd0145570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 -- 172.21.15.100:0/87123638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc80094d0 con 0x7f7dd006a5e0 2024-01-20T08:11:21.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd5200640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc803ac60 con 0x7f7dd006a5e0 2024-01-20T08:11:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc803ade0 con 0x7f7dd006a5e0 2024-01-20T08:11:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8044630 con 0x7f7dd006a5e0 2024-01-20T08:11:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd01eab90 con 0x7f7dd006a5e0 2024-01-20T08:11:21.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.535+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd01eb150 con 0x7f7dd006a5e0 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.536+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd004e970 con 0x7f7dd006a5e0 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.537+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7dc802f050 con 0x7f7dd006a5e0 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.538+0000 7f7dccc00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.538+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7dc80aba60 con 0x7f7dd006a5e0 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.539+0000 7f7dcfe00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:21.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.539+0000 7f7dcfe00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 0x7f7da806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00c67a0 tx=0x7f7db8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:21.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.542+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7dc80765c0 con 0x7f7dd006a5e0 2024-01-20T08:11:21.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:21.778+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7dd0073d50 con 0x7f7dd006a5e0 2024-01-20T08:11:21.783 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-20T08:11:21.781+0000 7fbe35e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:11:22.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.519+0000 7f7dccc00640 1 -- 172.21.15.100:0/87123638 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v20) v1 ==== 119+0+0 (secure 0 0 0) 0x7f7dc8079be0 con 0x7f7dd006a5e0 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 msgr2=0x7f7da806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 0x7f7da806d3c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7dd00c67a0 tx=0x7f7db8008040 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 msgr2=0x7f7dd00c5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8000c00 tx=0x7f7dc80046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 shutdown_connections 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7dd0145c50 0x7f7dd0145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7da806af00 0x7f7da806d3c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7dd00a9b70 0x7f7dd0145030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 --2- 172.21.15.100:0/87123638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7dd006a5e0 0x7f7dd00c5ec0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 >> 172.21.15.100:0/87123638 conn(0x7f7dd00c3b10 msgr2=0x7f7dd00c21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:22.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 shutdown_connections 2024-01-20T08:11:22.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.523+0000 7f7dd7c00640 1 -- 172.21.15.100:0/87123638 wait complete. 2024-01-20T08:11:22.546 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:11:22.546 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-20T08:11:22.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.758+0000 7f86ec800640 1 Processor -- start 2024-01-20T08:11:22.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.759+0000 7f86ec800640 1 -- start start 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 0x7f86e4155430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86e406d1d0 0x7f86e40c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 0x7f86e4070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e406cd40 con 0x7f86e406d1d0 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40c19e0 con 0x7f86e40c5f70 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86ec800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e40c1c80 con 0x7f86e414e8b0 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86e9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86e406d1d0 0x7f86e40c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86e9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86e406d1d0 0x7f86e40c14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45136/0 (socket says 172.21.15.100:45136) 2024-01-20T08:11:22.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.760+0000 7f86e9400640 1 -- 172.21.15.100:0/755592050 learned_addr learned my addr 172.21.15.100:0/755592050 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86ea800640 1 --2- 172.21.15.100:0/755592050 >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 0x7f86e4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9e00640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 0x7f86e4155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9400640 1 -- 172.21.15.100:0/755592050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 msgr2=0x7f86e4155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9400640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 0x7f86e4155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9400640 1 -- 172.21.15.100:0/755592050 >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 msgr2=0x7f86e4070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9400640 1 --2- 172.21.15.100:0/755592050 >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 0x7f86e4070560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9400640 1 -- 172.21.15.100:0/755592050 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e406c410 con 0x7f86e406d1d0 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86ea800640 1 --2- 172.21.15.100:0/755592050 >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 0x7f86e4070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:22.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.761+0000 7f86e9e00640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 0x7f86e4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.762+0000 7f86e9400640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e406d1d0 0x7f86e40c14a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86e4070300 tx=0x7f86cc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61eae1697f3fd1ae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.762+0000 7f86e8a00640 1 -- 172.21.15.100:0/755592050 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc031870 con 0x7f86e406d1d0 2024-01-20T08:11:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.762+0000 7f86e8a00640 1 -- 172.21.15.100:0/755592050 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86cc0319d0 con 0x7f86e406d1d0 2024-01-20T08:11:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.762+0000 7f86e8a00640 1 -- 172.21.15.100:0/755592050 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86cc031d60 con 0x7f86e406d1d0 2024-01-20T08:11:22.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 -- 172.21.15.100:0/755592050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e406d1d0 msgr2=0x7f86e40c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e406d1d0 0x7f86e40c14a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f86e4070300 tx=0x7f86cc02b910 comp rx=0 tx=0).stop 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 -- 172.21.15.100:0/755592050 shutdown_connections 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 --2- 172.21.15.100:0/755592050 >> v2:172.21.15.110:3300/0 conn(0x7f86e40c5f70 0x7f86e4070560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e406d1d0 0x7f86e40c14a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 --2- 172.21.15.100:0/755592050 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e414e8b0 0x7f86e4155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 -- 172.21.15.100:0/755592050 >> 172.21.15.100:0/755592050 conn(0x7f86e40a9e20 msgr2=0x7f86e40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 -- 172.21.15.100:0/755592050 shutdown_connections 2024-01-20T08:11:22.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.763+0000 7f86ec800640 1 -- 172.21.15.100:0/755592050 wait complete. 2024-01-20T08:11:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.765+0000 7f86ec800640 1 Processor -- start 2024-01-20T08:11:22.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.765+0000 7f86ec800640 1 -- start start 2024-01-20T08:11:22.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e406d1d0 0x7f86e4156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e40c5f70 0x7f86e4147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4148850 con 0x7f86e414e8b0 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4152070 con 0x7f86e40c5f70 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ec800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41ea950 con 0x7f86e406d1d0 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ea800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ea800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45138/0 (socket says 172.21.15.100:45138) 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.766+0000 7f86ea800640 1 -- 172.21.15.100:0/1358606252 learned_addr learned my addr 172.21.15.100:0/1358606252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86e9e00640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e406d1d0 0x7f86e4156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86e9400640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e40c5f70 0x7f86e4147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 -- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e406d1d0 msgr2=0x7f86e4156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e406d1d0 0x7f86e4156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 -- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e40c5f70 msgr2=0x7f86e4147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e40c5f70 0x7f86e4147dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:22.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 -- 172.21.15.100:0/1358606252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0094d0 con 0x7f86e414e8b0 2024-01-20T08:11:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86ea800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c7f0 tx=0x7f86dc00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.767+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007820 con 0x7f86e414e8b0 2024-01-20T08:11:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.768+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86dc007980 con 0x7f86e414e8b0 2024-01-20T08:11:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.768+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86dc007d70 con 0x7f86e414e8b0 2024-01-20T08:11:22.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.768+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e414ef90 con 0x7f86e414e8b0 2024-01-20T08:11:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.768+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e4148da0 con 0x7f86e414e8b0 2024-01-20T08:11:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.769+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e414f180 con 0x7f86e414e8b0 2024-01-20T08:11:22.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.770+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f86dc0113f0 con 0x7f86e414e8b0 2024-01-20T08:11:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.771+0000 7f86e2000640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 0x7f86bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.771+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f86dc089c40 con 0x7f86e414e8b0 2024-01-20T08:11:22.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.771+0000 7f86e9e00640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 0x7f86bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:22.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.772+0000 7f86e9e00640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 0x7f86bc06d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86d4007130 tx=0x7f86d4007060 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:22.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:22.775+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f86dc054840 con 0x7f86e414e8b0 2024-01-20T08:11:23.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.002+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86e4148f90 con 0x7f86e414e8b0 2024-01-20T08:11:23.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.531+0000 7f86e2000640 1 -- 172.21.15.100:0/1358606252 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v21) v1 ==== 123+0+0 (secure 0 0 0) 0x7f86dc01f0c0 con 0x7f86e414e8b0 2024-01-20T08:11:23.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.534+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 msgr2=0x7f86bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.534+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 0x7f86bc06d390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f86d4007130 tx=0x7f86d4007060 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.534+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 msgr2=0x7f86e4148310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.534+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f86dc00c7f0 tx=0x7f86dc00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 shutdown_connections 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86e414e8b0 0x7f86e4148310 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86e40c5f70 0x7f86e4147dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f86bc06aed0 0x7f86bc06d390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 --2- 172.21.15.100:0/1358606252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86e406d1d0 0x7f86e4156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 >> 172.21.15.100:0/1358606252 conn(0x7f86e40a9e20 msgr2=0x7f86e414c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:23.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 shutdown_connections 2024-01-20T08:11:23.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.535+0000 7f86ec800640 1 -- 172.21.15.100:0/1358606252 wait complete. 2024-01-20T08:11:23.559 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-20T08:11:23.559 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:23.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.764+0000 7fefad600640 1 Processor -- start 2024-01-20T08:11:23.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.764+0000 7fefad600640 1 -- start start 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefad600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa806dd90 0x7fefa8155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefad600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 0x7fefa8156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefad600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefa80c1720 con 0x7fefa8072320 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefad600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefa80c20a0 con 0x7fefa806dd90 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefad600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa806c7c0 con 0x7fefa80c3240 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefa7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa806dd90 0x7fefa8155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefa7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fefa806dd90 0x7fefa8155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45154/0 (socket says 172.21.15.100:45154) 2024-01-20T08:11:23.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefa7400640 1 -- 172.21.15.100:0/1968663162 learned_addr learned my addr 172.21.15.100:0/1968663162 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefa7400640 1 -- 172.21.15.100:0/1968663162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 msgr2=0x7fefa8156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.766+0000 7fefacc00640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 0x7fefa8156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.767+0000 7fefa7400640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 0x7fefa8156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.767+0000 7fefa7400640 1 -- 172.21.15.100:0/1968663162 >> v1:172.21.15.110:6789/0 conn(0x7fefa8072320 legacy=0x7fefa814f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.767+0000 7fefa7400640 1 -- 172.21.15.100:0/1968663162 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80a4f30 con 0x7fefa806dd90 2024-01-20T08:11:23.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.767+0000 7fefacc00640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 0x7fefa8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.768+0000 7fefa7400640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa806dd90 0x7fefa8155b00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef90009870 tx=0x7fef9002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9911d5865fa9736 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.768+0000 7fefa6a00640 1 -- 172.21.15.100:0/1968663162 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90031640 con 0x7fefa806dd90 2024-01-20T08:11:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.768+0000 7fefa6a00640 1 -- 172.21.15.100:0/1968663162 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef900317a0 con 0x7fefa806dd90 2024-01-20T08:11:23.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.768+0000 7fefa6a00640 1 -- 172.21.15.100:0/1968663162 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef90031b30 con 0x7fefa806dd90 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 -- 172.21.15.100:0/1968663162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa806dd90 msgr2=0x7fefa8155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa806dd90 0x7fefa8155b00 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fef90009870 tx=0x7fef9002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 -- 172.21.15.100:0/1968663162 shutdown_connections 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa80c3240 0x7fefa8156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 --2- 172.21.15.100:0/1968663162 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa806dd90 0x7fefa8155b00 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 -- 172.21.15.100:0/1968663162 >> 172.21.15.100:0/1968663162 conn(0x7fefa80c2590 msgr2=0x7fefa80c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 -- 172.21.15.100:0/1968663162 shutdown_connections 2024-01-20T08:11:23.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.769+0000 7fefad600640 1 -- 172.21.15.100:0/1968663162 wait complete. 2024-01-20T08:11:23.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.771+0000 7fefad600640 1 Processor -- start 2024-01-20T08:11:23.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.771+0000 7fefad600640 1 -- start start 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa806dd90 0x7fefa813f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefa8072320 0x7fefa814d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa81eac20 con 0x7fefa80c3240 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814d9d0 con 0x7fefa8072320 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefad600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefa814dca0 con 0x7fefa806dd90 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefacc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefacc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45162/0 (socket says 172.21.15.100:45162) 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.772+0000 7fefacc00640 1 -- 172.21.15.100:0/1132294342 learned_addr learned my addr 172.21.15.100:0/1132294342 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 -- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa806dd90 msgr2=0x7fefa813f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:23.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefa7e00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa806dd90 0x7fefa813f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefa7400640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefa8072320 0x7fefa814d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa806dd90 0x7fefa813f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 -- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefa8072320 msgr2=0x7fefa814d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefa8072320 0x7fefa814d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 -- 172.21.15.100:0/1132294342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef900094d0 con 0x7fefa80c3240 2024-01-20T08:11:23.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefacc00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ce40 tx=0x7fefa000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0003b90 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa0003d10 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefa81ea5d0 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.773+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa0004260 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.774+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefa8144680 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.775+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefa80c6300 con 0x7fefa80c3240 2024-01-20T08:11:23.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.776+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fefa00043c0 con 0x7fefa80c3240 2024-01-20T08:11:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.776+0000 7fef9fe00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 0x7fef8006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.777+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fefa008a1f0 con 0x7fefa80c3240 2024-01-20T08:11:23.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.777+0000 7fefa7e00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 0x7fef8006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:23.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.778+0000 7fefa7e00640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 0x7fef8006d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef98003d90 tx=0x7fef98009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:23.781+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fefa0054dd0 con 0x7fefa80c3240 2024-01-20T08:11:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.012+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefa80749e0 con 0x7fefa80c3240 2024-01-20T08:11:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.013+0000 7fef9fe00640 1 -- 172.21.15.100:0/1132294342 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6189 (secure 0 0 0) 0x7fefa00583f0 con 0x7fefa80c3240 2024-01-20T08:11:24.016 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:24.016 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.015+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 msgr2=0x7fef8006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.015+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 0x7fef8006d3c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fef98003d90 tx=0x7fef98009040 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.015+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 msgr2=0x7fefa80beec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.015+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fefa000ce40 tx=0x7fefa000a710 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 shutdown_connections 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fefa80c3240 0x7fefa80beec0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fefa8072320 0x7fefa814d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef8006af00 0x7fef8006d3c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 --2- 172.21.15.100:0/1132294342 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fefa806dd90 0x7fefa813f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 >> 172.21.15.100:0/1132294342 conn(0x7fefa80c2590 msgr2=0x7fefa80c4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 shutdown_connections 2024-01-20T08:11:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.016+0000 7fefad600640 1 -- 172.21.15.100:0/1132294342 wait complete. 2024-01-20T08:11:24.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.239+0000 7f8688000640 1 Processor -- start 2024-01-20T08:11:24.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.239+0000 7f8688000640 1 -- start start 2024-01-20T08:11:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.240+0000 7f8688000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f86800abfd0 0x7f8680070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.240+0000 7f8688000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800c1670 con 0x7f8680147f20 2024-01-20T08:11:24.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.240+0000 7f8688000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86800c0d40 con 0x7f8680151f60 2024-01-20T08:11:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.240+0000 7f8688000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86800c2210 con 0x7f86800abfd0 2024-01-20T08:11:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f8685600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8680147f20 0x7f86800c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51742/0 (socket says 172.21.15.100:51742) 2024-01-20T08:11:24.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f8685600640 1 -- 172.21.15.100:0/1733411569 learned_addr learned my addr 172.21.15.100:0/1733411569 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318926122 0 0) 0x7f86800c1670 con 0x7f8680147f20 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f8686000640 1 --2- 172.21.15.100:0/1733411569 >> v2:172.21.15.110:3300/0 conn(0x7f86800abfd0 0x7f8680070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8660005730 con 0x7f8680147f20 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462601192 0 0) 0x7f8660005730 con 0x7f8680147f20 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 >> v2:172.21.15.110:3300/0 conn(0x7f86800abfd0 msgr2=0x7f8680070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:24.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 --2- 172.21.15.100:0/1733411569 >> v2:172.21.15.110:3300/0 conn(0x7f86800abfd0 0x7f8680070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 >> v1:172.21.15.110:6789/0 conn(0x7f8680151f60 legacy=0x7f86800c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800c1020 con 0x7f8680147f20 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f86700019f0 con 0x7f8680147f20 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 >> v1:172.21.15.100:6789/0 conn(0x7f8680147f20 legacy=0x7f86800c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.241+0000 7f867fe00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8660005bd0 0x7f8660005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f867fe00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 0x7f8660006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f867fe00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600073e0 0x7f866000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800c2210 con 0x7f86600069d0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866000e310 con 0x7f86600073e0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866000e4d0 con 0x7f8660005bd0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 0x7f8660006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8685600640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8660005bd0 0x7f8660005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8686000640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600073e0 0x7f866000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 -- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8660005bd0 msgr2=0x7f8660005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8660005bd0 0x7f8660005fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 -- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600073e0 msgr2=0x7f866000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600073e0 0x7f866000db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8684c00640 1 -- 172.21.15.100:0/1733411569 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660005730 con 0x7f86600069d0 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.242+0000 7f8686000640 1 -- 172.21.15.100:0/1733411569 reap_dead start 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.243+0000 7f8684c00640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 0x7f8660006e50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8668003d80 tx=0x7f8660007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc85b3fce9c4534b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.243+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8668032600 con 0x7f86600069d0 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866802e050 con 0x7f86600069d0 2024-01-20T08:11:24.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f867fe00640 1 -- 172.21.15.100:0/1733411569 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86680329e0 con 0x7f86600069d0 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 -- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 msgr2=0x7f8660006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 0x7f8660006e50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f8668003d80 tx=0x7f8660007a00 comp rx=0 tx=0).stop 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 -- 172.21.15.100:0/1733411569 shutdown_connections 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 --2- 172.21.15.100:0/1733411569 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86600069d0 0x7f8660006e50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 -- 172.21.15.100:0/1733411569 >> 172.21.15.100:0/1733411569 conn(0x7f868006a5e0 msgr2=0x7f868006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 -- 172.21.15.100:0/1733411569 shutdown_connections 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.244+0000 7f8688000640 1 -- 172.21.15.100:0/1733411569 wait complete. 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.246+0000 7f8688000640 1 Processor -- start 2024-01-20T08:11:24.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.246+0000 7f8688000640 1 -- start start 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 0x7f86800c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f868014d7b0 0x7f8680141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86800c00d0 con 0x7f868014beb0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868014cc40 con 0x7f86600069d0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8688000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86800bfae0 con 0x7f868014d7b0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8684c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8684c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45184/0 (socket says 172.21.15.100:45184) 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8684c00640 1 -- 172.21.15.100:0/1769584740 learned_addr learned my addr 172.21.15.100:0/1769584740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8685600640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 0x7f86800c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8686000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f868014d7b0 0x7f8680141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.247+0000 7f8684c00640 1 -- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f868014d7b0 msgr2=0x7f8680141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8684c00640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f868014d7b0 0x7f8680141900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8684c00640 1 -- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 msgr2=0x7f86800c5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8684c00640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 0x7f86800c5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8684c00640 1 -- 172.21.15.100:0/1769584740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800c04f0 con 0x7f868014beb0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8685600640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 0x7f86800c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8684c00640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8668003d80 tx=0x7f86680036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866803c410 con 0x7f868014beb0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866803c570 con 0x7f868014beb0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866803c920 con 0x7f868014beb0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868014c680 con 0x7f868014beb0 2024-01-20T08:11:24.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.248+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86800bfcf0 con 0x7f868014beb0 2024-01-20T08:11:24.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.249+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868004e970 con 0x7f868014beb0 2024-01-20T08:11:24.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.250+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8668039050 con 0x7f868014beb0 2024-01-20T08:11:24.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.251+0000 7f867d600640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 0x7f865806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.251+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f86680aaf60 con 0x7f868014beb0 2024-01-20T08:11:24.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.251+0000 7f8685600640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 0x7f865806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.252+0000 7f8685600640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 0x7f865806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f868004fbe0 tx=0x7f8670009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.256+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8668075c90 con 0x7f868014beb0 2024-01-20T08:11:24.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.433+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f868014ee00 con 0x7f868014beb0 2024-01-20T08:11:24.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.437+0000 7f867d600640 1 -- 172.21.15.100:0/1769584740 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f866804b090 con 0x7f868014beb0 2024-01-20T08:11:24.440 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:24.440 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 msgr2=0x7f865806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 0x7f865806d390 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f868004fbe0 tx=0x7f8670009040 comp rx=0 tx=0).stop 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 msgr2=0x7f868014d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8668003d80 tx=0x7f86680036f0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 shutdown_connections 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f865806aed0 0x7f865806d390 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f868014d7b0 0x7f8680141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f868014beb0 0x7f868014d270 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 --2- 172.21.15.100:0/1769584740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86600069d0 0x7f86800c5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 >> 172.21.15.100:0/1769584740 conn(0x7f868006a5e0 msgr2=0x7f8680144220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 shutdown_connections 2024-01-20T08:11:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.440+0000 7f8688000640 1 -- 172.21.15.100:0/1769584740 wait complete. 2024-01-20T08:11:24.462 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:11:24.462 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:11:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.655+0000 7f15fbc00640 1 Processor -- start 2024-01-20T08:11:24.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.655+0000 7f15fbc00640 1 -- start start 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15fbc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15f4151f60 0x7f15f40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15fbc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f40c1670 con 0x7f15f4070370 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15fbc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15f4070800 con 0x7f15f4147f20 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15fbc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15f40c2210 con 0x7f15f4151f60 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15ebc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15f4151f60 0x7f15f40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15ebc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f15f4151f60 0x7f15f40abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45188/0 (socket says 172.21.15.100:45188) 2024-01-20T08:11:24.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.657+0000 7f15ebc00640 1 -- 172.21.15.100:0/737403514 learned_addr learned my addr 172.21.15.100:0/737403514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.658+0000 7f15ebc00640 1 -- 172.21.15.100:0/737403514 >> v1:172.21.15.110:6789/0 conn(0x7f15f4147f20 legacy=0x7f15f40c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.658+0000 7f15ebc00640 1 -- 172.21.15.100:0/737403514 >> v1:172.21.15.100:6789/0 conn(0x7f15f4070370 legacy=0x7f15f40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.658+0000 7f15ebc00640 1 -- 172.21.15.100:0/737403514 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40c0d40 con 0x7f15f4151f60 2024-01-20T08:11:24.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.659+0000 7f15ebc00640 1 --2- 172.21.15.100:0/737403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f40abfd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009870 tx=0x7f15dc02dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60bf738e6f7abc87 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.659+0000 7f15f3e00640 1 -- 172.21.15.100:0/737403514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc02e9e0 con 0x7f15f4151f60 2024-01-20T08:11:24.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.659+0000 7f15f3e00640 1 -- 172.21.15.100:0/737403514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15dc02eb40 con 0x7f15f4151f60 2024-01-20T08:11:24.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.659+0000 7f15f3e00640 1 -- 172.21.15.100:0/737403514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15dc036440 con 0x7f15f4151f60 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 -- 172.21.15.100:0/737403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 msgr2=0x7f15f40abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 --2- 172.21.15.100:0/737403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f40abfd0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009870 tx=0x7f15dc02dc30 comp rx=0 tx=0).stop 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 -- 172.21.15.100:0/737403514 shutdown_connections 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 --2- 172.21.15.100:0/737403514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f40abfd0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 -- 172.21.15.100:0/737403514 >> 172.21.15.100:0/737403514 conn(0x7f15f406a5e0 msgr2=0x7f15f406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 -- 172.21.15.100:0/737403514 shutdown_connections 2024-01-20T08:11:24.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.660+0000 7f15fbc00640 1 -- 172.21.15.100:0/737403514 wait complete. 2024-01-20T08:11:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.661+0000 7f15fbc00640 1 Processor -- start 2024-01-20T08:11:24.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.661+0000 7f15fbc00640 1 -- start start 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15f4070370 0x7f15f40c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15f4147f20 0x7f15f413f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f41db460 con 0x7f15f4151f60 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f4140360 con 0x7f15f4147f20 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.662+0000 7f15fbc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40c5c50 con 0x7f15f4070370 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45190/0 (socket says 172.21.15.100:45190) 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 -- 172.21.15.100:0/585208731 learned_addr learned my addr 172.21.15.100:0/585208731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15ebc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15f4147f20 0x7f15f413f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9200640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15f4070370 0x7f15f40c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 -- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15f4070370 msgr2=0x7f15f40c5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15f4070370 0x7f15f40c5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 -- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15f4147f20 msgr2=0x7f15f413f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15f4147f20 0x7f15f413f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 -- 172.21.15.100:0/585208731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15dc0094d0 con 0x7f15f4151f60 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.663+0000 7f15f9c00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c7d0 tx=0x7f15ec00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.664+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec003b70 con 0x7f15f4151f60 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.664+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15ec003cf0 con 0x7f15f4151f60 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.664+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15ec00aa90 con 0x7f15f4151f60 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.664+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f41ea4d0 con 0x7f15f4151f60 2024-01-20T08:11:24.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.664+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f41ea770 con 0x7f15f4151f60 2024-01-20T08:11:24.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.665+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f41ea990 con 0x7f15f4151f60 2024-01-20T08:11:24.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.666+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f15ec00abf0 con 0x7f15f4151f60 2024-01-20T08:11:24.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.667+0000 7f15f1600640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 0x7f15cc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:24.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.667+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f15ec089750 con 0x7f15f4151f60 2024-01-20T08:11:24.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.667+0000 7f15f9200640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 0x7f15cc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:24.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.668+0000 7f15f9200640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 0x7f15cc06d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15f4067b50 tx=0x7f15e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:24.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.671+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f15ec054350 con 0x7f15f4151f60 2024-01-20T08:11:24.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.856+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15f4148300 con 0x7f15cc06aed0 2024-01-20T08:11:24.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.888+0000 7f15f1600640 1 -- 172.21.15.100:0/585208731 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+524769 (secure 0 0 0) 0x7f15e4001c70 con 0x7f15cc06aed0 2024-01-20T08:11:24.899 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:24.903 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:11:24.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 msgr2=0x7f15cc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 0x7f15cc06d390 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f15f4067b50 tx=0x7f15e4009040 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 msgr2=0x7f15f413fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f15ec00c7d0 tx=0x7f15ec00cc90 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 shutdown_connections 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f15f4151f60 0x7f15f413fe20 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15f4147f20 0x7f15f413f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f15cc06aed0 0x7f15cc06d390 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 --2- 172.21.15.100:0/585208731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15f4070370 0x7f15f40c5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 >> 172.21.15.100:0/585208731 conn(0x7f15f406a5e0 msgr2=0x7f15f406ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 shutdown_connections 2024-01-20T08:11:24.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:24.899+0000 7f15fbc00640 1 -- 172.21.15.100:0/585208731 wait complete. 2024-01-20T08:11:24.925 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-20T08:11:23.907725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237348,"kb_used_data":4528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737372,"statfs":{"total":773094113280,"available":772851068928,"internally_reserved":0,"allocated":4636672,"data_stored":2536455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.451052"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.524972+0000","last_change":"2024-01-20T08:11:20.518593+0000","last_active":"2024-01-20T08:11:20.524972+0000","last_peered":"2024-01-20T08:11:20.524972+0000","last_clean":"2024-01-20T08:11:20.524972+0000","last_became_active":"2024-01-20T08:11:20.518322+0000","last_became_peered":"2024-01-20T08:11:20.518322+0000","last_unstale":"2024-01-20T08:11:20.524972+0000","last_undegraded":"2024-01-20T08:11:20.524972+0000","last_fullsized":"2024-01-20T08:11:20.524972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:16.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497091+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:11:19.497091+0000","last_peered":"2024-01-20T08:11:19.497091+0000","last_clean":"2024-01-20T08:11:19.497091+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:11:19.497091+0000","last_undegraded":"2024-01-20T08:11:19.497091+0000","last_fullsized":"2024-01-20T08:11:19.497091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.510548+0000","last_change":"2024-01-20T08:11:04.245453+0000","last_active":"2024-01-20T08:11:19.510548+0000","last_peered":"2024-01-20T08:11:19.510548+0000","last_clean":"2024-01-20T08:11:19.510548+0000","last_became_active":"2024-01-20T08:11:04.244780+0000","last_became_peered":"2024-01-20T08:11:04.244780+0000","last_unstale":"2024-01-20T08:11:19.510548+0000","last_undegraded":"2024-01-20T08:11:19.510548+0000","last_fullsized":"2024-01-20T08:11:19.510548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.493546+0000","last_change":"2024-01-20T08:11:05.264816+0000","last_active":"2024-01-20T08:11:19.493546+0000","last_peered":"2024-01-20T08:11:19.493546+0000","last_clean":"2024-01-20T08:11:19.493546+0000","last_became_active":"2024-01-20T08:11:05.264191+0000","last_became_peered":"2024-01-20T08:11:05.264191+0000","last_unstale":"2024-01-20T08:11:19.493546+0000","last_undegraded":"2024-01-20T08:11:19.493546+0000","last_fullsized":"2024-01-20T08:11:19.493546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533052+0000","last_change":"2024-01-20T08:11:19.517639+0000","last_active":"2024-01-20T08:11:20.533052+0000","last_peered":"2024-01-20T08:11:20.533052+0000","last_clean":"2024-01-20T08:11:20.533052+0000","last_became_active":"2024-01-20T08:11:19.517334+0000","last_became_peered":"2024-01-20T08:11:19.517334+0000","last_unstale":"2024-01-20T08:11:20.533052+0000","last_undegraded":"2024-01-20T08:11:20.533052+0000","last_fullsized":"2024-01-20T08:11:20.533052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:31.375264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534527+0000","last_change":"2024-01-20T08:11:20.530946+0000","last_active":"2024-01-20T08:11:20.534527+0000","last_peered":"2024-01-20T08:11:20.534527+0000","last_clean":"2024-01-20T08:11:20.534527+0000","last_became_active":"2024-01-20T08:11:20.530691+0000","last_became_peered":"2024-01-20T08:11:20.530691+0000","last_unstale":"2024-01-20T08:11:20.534527+0000","last_undegraded":"2024-01-20T08:11:20.534527+0000","last_fullsized":"2024-01-20T08:11:20.534527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:40:43.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488587+0000","last_change":"2024-01-20T08:11:04.238908+0000","last_active":"2024-01-20T08:11:19.488587+0000","last_peered":"2024-01-20T08:11:19.488587+0000","last_clean":"2024-01-20T08:11:19.488587+0000","last_became_active":"2024-01-20T08:11:04.238633+0000","last_became_peered":"2024-01-20T08:11:04.238633+0000","last_unstale":"2024-01-20T08:11:19.488587+0000","last_undegraded":"2024-01-20T08:11:19.488587+0000","last_fullsized":"2024-01-20T08:11:19.488587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502242+0000","last_change":"2024-01-20T08:11:05.260184+0000","last_active":"2024-01-20T08:11:19.502242+0000","last_peered":"2024-01-20T08:11:19.502242+0000","last_clean":"2024-01-20T08:11:19.502242+0000","last_became_active":"2024-01-20T08:11:05.259912+0000","last_became_peered":"2024-01-20T08:11:05.259912+0000","last_unstale":"2024-01-20T08:11:19.502242+0000","last_undegraded":"2024-01-20T08:11:19.502242+0000","last_fullsized":"2024-01-20T08:11:19.502242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.495117+0000","last_change":"2024-01-20T08:11:19.507992+0000","last_active":"2024-01-20T08:11:20.495117+0000","last_peered":"2024-01-20T08:11:20.495117+0000","last_clean":"2024-01-20T08:11:20.495117+0000","last_became_active":"2024-01-20T08:11:19.507643+0000","last_became_peered":"2024-01-20T08:11:19.507643+0000","last_unstale":"2024-01-20T08:11:20.495117+0000","last_undegraded":"2024-01-20T08:11:20.495117+0000","last_fullsized":"2024-01-20T08:11:20.495117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:24.172771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531736+0000","last_change":"2024-01-20T08:11:20.527141+0000","last_active":"2024-01-20T08:11:20.531736+0000","last_peered":"2024-01-20T08:11:20.531736+0000","last_clean":"2024-01-20T08:11:20.531736+0000","last_became_active":"2024-01-20T08:11:20.526852+0000","last_became_peered":"2024-01-20T08:11:20.526852+0000","last_unstale":"2024-01-20T08:11:20.531736+0000","last_undegraded":"2024-01-20T08:11:20.531736+0000","last_fullsized":"2024-01-20T08:11:20.531736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:29:32.495283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502449+0000","last_change":"2024-01-20T08:11:04.242211+0000","last_active":"2024-01-20T08:11:19.502449+0000","last_peered":"2024-01-20T08:11:19.502449+0000","last_clean":"2024-01-20T08:11:19.502449+0000","last_became_active":"2024-01-20T08:11:04.241913+0000","last_became_peered":"2024-01-20T08:11:04.241913+0000","last_unstale":"2024-01-20T08:11:19.502449+0000","last_undegraded":"2024-01-20T08:11:19.502449+0000","last_fullsized":"2024-01-20T08:11:19.502449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:15.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488109+0000","last_change":"2024-01-20T08:11:05.258770+0000","last_active":"2024-01-20T08:11:19.488109+0000","last_peered":"2024-01-20T08:11:19.488109+0000","last_clean":"2024-01-20T08:11:19.488109+0000","last_became_active":"2024-01-20T08:11:05.258482+0000","last_became_peered":"2024-01-20T08:11:05.258482+0000","last_unstale":"2024-01-20T08:11:19.488109+0000","last_undegraded":"2024-01-20T08:11:19.488109+0000","last_fullsized":"2024-01-20T08:11:19.488109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503935+0000","last_change":"2024-01-20T08:11:19.511480+0000","last_active":"2024-01-20T08:11:20.503935+0000","last_peered":"2024-01-20T08:11:20.503935+0000","last_clean":"2024-01-20T08:11:20.503935+0000","last_became_active":"2024-01-20T08:11:19.511221+0000","last_became_peered":"2024-01-20T08:11:19.511221+0000","last_unstale":"2024-01-20T08:11:20.503935+0000","last_undegraded":"2024-01-20T08:11:20.503935+0000","last_fullsized":"2024-01-20T08:11:20.503935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:52.667277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528319+0000","last_change":"2024-01-20T08:11:20.522922+0000","last_active":"2024-01-20T08:11:20.528319+0000","last_peered":"2024-01-20T08:11:20.528319+0000","last_clean":"2024-01-20T08:11:20.528319+0000","last_became_active":"2024-01-20T08:11:20.522571+0000","last_became_peered":"2024-01-20T08:11:20.522571+0000","last_unstale":"2024-01-20T08:11:20.528319+0000","last_undegraded":"2024-01-20T08:11:20.528319+0000","last_fullsized":"2024-01-20T08:11:20.528319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:09.652760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495269+0000","last_change":"2024-01-20T08:11:04.236173+0000","last_active":"2024-01-20T08:11:19.495269+0000","last_peered":"2024-01-20T08:11:19.495269+0000","last_clean":"2024-01-20T08:11:19.495269+0000","last_became_active":"2024-01-20T08:11:04.235839+0000","last_became_peered":"2024-01-20T08:11:04.235839+0000","last_unstale":"2024-01-20T08:11:19.495269+0000","last_undegraded":"2024-01-20T08:11:19.495269+0000","last_fullsized":"2024-01-20T08:11:19.495269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494003+0000","last_change":"2024-01-20T08:11:05.267861+0000","last_active":"2024-01-20T08:11:19.494003+0000","last_peered":"2024-01-20T08:11:19.494003+0000","last_clean":"2024-01-20T08:11:19.494003+0000","last_became_active":"2024-01-20T08:11:05.267603+0000","last_became_peered":"2024-01-20T08:11:05.267603+0000","last_unstale":"2024-01-20T08:11:19.494003+0000","last_undegraded":"2024-01-20T08:11:19.494003+0000","last_fullsized":"2024-01-20T08:11:19.494003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.504124+0000","last_change":"2024-01-20T08:11:19.500563+0000","last_active":"2024-01-20T08:11:20.504124+0000","last_peered":"2024-01-20T08:11:20.504124+0000","last_clean":"2024-01-20T08:11:20.504124+0000","last_became_active":"2024-01-20T08:11:19.500310+0000","last_became_peered":"2024-01-20T08:11:19.500310+0000","last_unstale":"2024-01-20T08:11:20.504124+0000","last_undegraded":"2024-01-20T08:11:20.504124+0000","last_fullsized":"2024-01-20T08:11:20.504124+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.743435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518573+0000","last_change":"2024-01-20T08:11:20.515296+0000","last_active":"2024-01-20T08:11:20.518573+0000","last_peered":"2024-01-20T08:11:20.518573+0000","last_clean":"2024-01-20T08:11:20.518573+0000","last_became_active":"2024-01-20T08:11:20.514630+0000","last_became_peered":"2024-01-20T08:11:20.514630+0000","last_unstale":"2024-01-20T08:11:20.518573+0000","last_undegraded":"2024-01-20T08:11:20.518573+0000","last_fullsized":"2024-01-20T08:11:20.518573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.865344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494396+0000","last_change":"2024-01-20T08:11:04.236506+0000","last_active":"2024-01-20T08:11:19.494396+0000","last_peered":"2024-01-20T08:11:19.494396+0000","last_clean":"2024-01-20T08:11:19.494396+0000","last_became_active":"2024-01-20T08:11:04.235965+0000","last_became_peered":"2024-01-20T08:11:04.235965+0000","last_unstale":"2024-01-20T08:11:19.494396+0000","last_undegraded":"2024-01-20T08:11:19.494396+0000","last_fullsized":"2024-01-20T08:11:19.494396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509967+0000","last_change":"2024-01-20T08:11:05.273342+0000","last_active":"2024-01-20T08:11:19.509967+0000","last_peered":"2024-01-20T08:11:19.509967+0000","last_clean":"2024-01-20T08:11:19.509967+0000","last_became_active":"2024-01-20T08:11:05.272929+0000","last_became_peered":"2024-01-20T08:11:05.272929+0000","last_unstale":"2024-01-20T08:11:19.509967+0000","last_undegraded":"2024-01-20T08:11:19.509967+0000","last_fullsized":"2024-01-20T08:11:19.509967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.500741+0000","last_change":"2024-01-20T08:11:19.514993+0000","last_active":"2024-01-20T08:11:20.500741+0000","last_peered":"2024-01-20T08:11:20.500741+0000","last_clean":"2024-01-20T08:11:20.500741+0000","last_became_active":"2024-01-20T08:11:19.514761+0000","last_became_peered":"2024-01-20T08:11:19.514761+0000","last_unstale":"2024-01-20T08:11:20.500741+0000","last_undegraded":"2024-01-20T08:11:20.500741+0000","last_fullsized":"2024-01-20T08:11:20.500741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:18.161134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534288+0000","last_change":"2024-01-20T08:11:20.528627+0000","last_active":"2024-01-20T08:11:20.534288+0000","last_peered":"2024-01-20T08:11:20.534288+0000","last_clean":"2024-01-20T08:11:20.534288+0000","last_became_active":"2024-01-20T08:11:20.528111+0000","last_became_peered":"2024-01-20T08:11:20.528111+0000","last_unstale":"2024-01-20T08:11:20.534288+0000","last_undegraded":"2024-01-20T08:11:20.534288+0000","last_fullsized":"2024-01-20T08:11:20.534288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:25.188656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495849+0000","last_change":"2024-01-20T08:11:04.228714+0000","last_active":"2024-01-20T08:11:19.495849+0000","last_peered":"2024-01-20T08:11:19.495849+0000","last_clean":"2024-01-20T08:11:19.495849+0000","last_became_active":"2024-01-20T08:11:04.227227+0000","last_became_peered":"2024-01-20T08:11:04.227227+0000","last_unstale":"2024-01-20T08:11:19.495849+0000","last_undegraded":"2024-01-20T08:11:19.495849+0000","last_fullsized":"2024-01-20T08:11:19.495849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.498861+0000","last_change":"2024-01-20T08:11:05.265952+0000","last_active":"2024-01-20T08:11:19.498861+0000","last_peered":"2024-01-20T08:11:19.498861+0000","last_clean":"2024-01-20T08:11:19.498861+0000","last_became_active":"2024-01-20T08:11:05.265641+0000","last_became_peered":"2024-01-20T08:11:05.265641+0000","last_unstale":"2024-01-20T08:11:19.498861+0000","last_undegraded":"2024-01-20T08:11:19.498861+0000","last_fullsized":"2024-01-20T08:11:19.498861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.505711+0000","last_change":"2024-01-20T08:11:19.511595+0000","last_active":"2024-01-20T08:11:20.505711+0000","last_peered":"2024-01-20T08:11:20.505711+0000","last_clean":"2024-01-20T08:11:20.505711+0000","last_became_active":"2024-01-20T08:11:19.511268+0000","last_became_peered":"2024-01-20T08:11:19.511268+0000","last_unstale":"2024-01-20T08:11:20.505711+0000","last_undegraded":"2024-01-20T08:11:20.505711+0000","last_fullsized":"2024-01-20T08:11:20.505711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.218836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531178+0000","last_change":"2024-01-20T08:11:20.526794+0000","last_active":"2024-01-20T08:11:20.531178+0000","last_peered":"2024-01-20T08:11:20.531178+0000","last_clean":"2024-01-20T08:11:20.531178+0000","last_became_active":"2024-01-20T08:11:20.526430+0000","last_became_peered":"2024-01-20T08:11:20.526430+0000","last_unstale":"2024-01-20T08:11:20.531178+0000","last_undegraded":"2024-01-20T08:11:20.531178+0000","last_fullsized":"2024-01-20T08:11:20.531178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501254+0000","last_change":"2024-01-20T08:11:04.229764+0000","last_active":"2024-01-20T08:11:19.501254+0000","last_peered":"2024-01-20T08:11:19.501254+0000","last_clean":"2024-01-20T08:11:19.501254+0000","last_became_active":"2024-01-20T08:11:04.229453+0000","last_became_peered":"2024-01-20T08:11:04.229453+0000","last_unstale":"2024-01-20T08:11:19.501254+0000","last_undegraded":"2024-01-20T08:11:19.501254+0000","last_fullsized":"2024-01-20T08:11:19.501254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506364+0000","last_change":"2024-01-20T08:11:05.269524+0000","last_active":"2024-01-20T08:11:19.506364+0000","last_peered":"2024-01-20T08:11:19.506364+0000","last_clean":"2024-01-20T08:11:19.506364+0000","last_became_active":"2024-01-20T08:11:05.269284+0000","last_became_peered":"2024-01-20T08:11:05.269284+0000","last_unstale":"2024-01-20T08:11:19.506364+0000","last_undegraded":"2024-01-20T08:11:19.506364+0000","last_fullsized":"2024-01-20T08:11:19.506364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:21.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.497462+0000","last_change":"2024-01-20T08:11:19.517890+0000","last_active":"2024-01-20T08:11:20.497462+0000","last_peered":"2024-01-20T08:11:20.497462+0000","last_clean":"2024-01-20T08:11:20.497462+0000","last_became_active":"2024-01-20T08:11:19.517345+0000","last_became_peered":"2024-01-20T08:11:19.517345+0000","last_unstale":"2024-01-20T08:11:20.497462+0000","last_undegraded":"2024-01-20T08:11:20.497462+0000","last_fullsized":"2024-01-20T08:11:20.497462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:44.733436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521859+0000","last_change":"2024-01-20T08:11:20.514726+0000","last_active":"2024-01-20T08:11:20.521859+0000","last_peered":"2024-01-20T08:11:20.521859+0000","last_clean":"2024-01-20T08:11:20.521859+0000","last_became_active":"2024-01-20T08:11:20.513734+0000","last_became_peered":"2024-01-20T08:11:20.513734+0000","last_unstale":"2024-01-20T08:11:20.521859+0000","last_undegraded":"2024-01-20T08:11:20.521859+0000","last_fullsized":"2024-01-20T08:11:20.521859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497263+0000","last_change":"2024-01-20T08:11:04.242771+0000","last_active":"2024-01-20T08:11:19.497263+0000","last_peered":"2024-01-20T08:11:19.497263+0000","last_clean":"2024-01-20T08:11:19.497263+0000","last_became_active":"2024-01-20T08:11:04.242500+0000","last_became_peered":"2024-01-20T08:11:04.242500+0000","last_unstale":"2024-01-20T08:11:19.497263+0000","last_undegraded":"2024-01-20T08:11:19.497263+0000","last_fullsized":"2024-01-20T08:11:19.497263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483290+0000","last_change":"2024-01-20T08:11:05.269356+0000","last_active":"2024-01-20T08:11:19.483290+0000","last_peered":"2024-01-20T08:11:19.483290+0000","last_clean":"2024-01-20T08:11:19.483290+0000","last_became_active":"2024-01-20T08:11:05.269074+0000","last_became_peered":"2024-01-20T08:11:05.269074+0000","last_unstale":"2024-01-20T08:11:19.483290+0000","last_undegraded":"2024-01-20T08:11:19.483290+0000","last_fullsized":"2024-01-20T08:11:19.483290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:28.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.505067+0000","last_change":"2024-01-20T08:11:19.519449+0000","last_active":"2024-01-20T08:11:20.505067+0000","last_peered":"2024-01-20T08:11:20.505067+0000","last_clean":"2024-01-20T08:11:20.505067+0000","last_became_active":"2024-01-20T08:11:19.519208+0000","last_became_peered":"2024-01-20T08:11:19.519208+0000","last_unstale":"2024-01-20T08:11:20.505067+0000","last_undegraded":"2024-01-20T08:11:20.505067+0000","last_fullsized":"2024-01-20T08:11:20.505067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:31.375264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.526706+0000","last_change":"2024-01-20T08:11:20.519860+0000","last_active":"2024-01-20T08:11:20.526706+0000","last_peered":"2024-01-20T08:11:20.526706+0000","last_clean":"2024-01-20T08:11:20.526706+0000","last_became_active":"2024-01-20T08:11:20.519651+0000","last_became_peered":"2024-01-20T08:11:20.519651+0000","last_unstale":"2024-01-20T08:11:20.526706+0000","last_undegraded":"2024-01-20T08:11:20.526706+0000","last_fullsized":"2024-01-20T08:11:20.526706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502890+0000","last_change":"2024-01-20T08:11:04.243302+0000","last_active":"2024-01-20T08:11:19.502890+0000","last_peered":"2024-01-20T08:11:19.502890+0000","last_clean":"2024-01-20T08:11:19.502890+0000","last_became_active":"2024-01-20T08:11:04.243105+0000","last_became_peered":"2024-01-20T08:11:04.243105+0000","last_unstale":"2024-01-20T08:11:19.502890+0000","last_undegraded":"2024-01-20T08:11:19.502890+0000","last_fullsized":"2024-01-20T08:11:19.502890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.491337+0000","last_change":"2024-01-20T08:11:05.268170+0000","last_active":"2024-01-20T08:11:19.491337+0000","last_peered":"2024-01-20T08:11:19.491337+0000","last_clean":"2024-01-20T08:11:19.491337+0000","last_became_active":"2024-01-20T08:11:05.267444+0000","last_became_peered":"2024-01-20T08:11:05.267444+0000","last_unstale":"2024-01-20T08:11:19.491337+0000","last_undegraded":"2024-01-20T08:11:19.491337+0000","last_fullsized":"2024-01-20T08:11:19.491337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.498553+0000","last_change":"2024-01-20T08:11:19.520261+0000","last_active":"2024-01-20T08:11:20.498553+0000","last_peered":"2024-01-20T08:11:20.498553+0000","last_clean":"2024-01-20T08:11:20.498553+0000","last_became_active":"2024-01-20T08:11:19.519362+0000","last_became_peered":"2024-01-20T08:11:19.519362+0000","last_unstale":"2024-01-20T08:11:20.498553+0000","last_undegraded":"2024-01-20T08:11:20.498553+0000","last_fullsized":"2024-01-20T08:11:20.498553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:52.667277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.537448+0000","last_change":"2024-01-20T08:11:20.534368+0000","last_active":"2024-01-20T08:11:20.537448+0000","last_peered":"2024-01-20T08:11:20.537448+0000","last_clean":"2024-01-20T08:11:20.537448+0000","last_became_active":"2024-01-20T08:11:20.534042+0000","last_became_peered":"2024-01-20T08:11:20.534042+0000","last_unstale":"2024-01-20T08:11:20.537448+0000","last_undegraded":"2024-01-20T08:11:20.537448+0000","last_fullsized":"2024-01-20T08:11:20.537448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:05:43.595092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502348+0000","last_change":"2024-01-20T08:11:04.236898+0000","last_active":"2024-01-20T08:11:19.502348+0000","last_peered":"2024-01-20T08:11:19.502348+0000","last_clean":"2024-01-20T08:11:19.502348+0000","last_became_active":"2024-01-20T08:11:04.236608+0000","last_became_peered":"2024-01-20T08:11:04.236608+0000","last_unstale":"2024-01-20T08:11:19.502348+0000","last_undegraded":"2024-01-20T08:11:19.502348+0000","last_fullsized":"2024-01-20T08:11:19.502348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:47:19.869135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482350+0000","last_change":"2024-01-20T08:11:05.264028+0000","last_active":"2024-01-20T08:11:19.482350+0000","last_peered":"2024-01-20T08:11:19.482350+0000","last_clean":"2024-01-20T08:11:19.482350+0000","last_became_active":"2024-01-20T08:11:05.263766+0000","last_became_peered":"2024-01-20T08:11:05.263766+0000","last_unstale":"2024-01-20T08:11:19.482350+0000","last_undegraded":"2024-01-20T08:11:19.482350+0000","last_fullsized":"2024-01-20T08:11:19.482350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:23.428838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534759+0000","last_change":"2024-01-20T08:11:19.502054+0000","last_active":"2024-01-20T08:11:20.534759+0000","last_peered":"2024-01-20T08:11:20.534759+0000","last_clean":"2024-01-20T08:11:20.534759+0000","last_became_active":"2024-01-20T08:11:19.501814+0000","last_became_peered":"2024-01-20T08:11:19.501814+0000","last_unstale":"2024-01-20T08:11:20.534759+0000","last_undegraded":"2024-01-20T08:11:20.534759+0000","last_fullsized":"2024-01-20T08:11:20.534759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:38.514416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516745+0000","last_change":"2024-01-20T08:11:20.508200+0000","last_active":"2024-01-20T08:11:20.516745+0000","last_peered":"2024-01-20T08:11:20.516745+0000","last_clean":"2024-01-20T08:11:20.516745+0000","last_became_active":"2024-01-20T08:11:20.507924+0000","last_became_peered":"2024-01-20T08:11:20.507924+0000","last_unstale":"2024-01-20T08:11:20.516745+0000","last_undegraded":"2024-01-20T08:11:20.516745+0000","last_fullsized":"2024-01-20T08:11:20.516745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:45.749321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.510146+0000","last_change":"2024-01-20T08:11:04.241959+0000","last_active":"2024-01-20T08:11:19.510146+0000","last_peered":"2024-01-20T08:11:19.510146+0000","last_clean":"2024-01-20T08:11:19.510146+0000","last_became_active":"2024-01-20T08:11:04.241594+0000","last_became_peered":"2024-01-20T08:11:04.241594+0000","last_unstale":"2024-01-20T08:11:19.510146+0000","last_undegraded":"2024-01-20T08:11:19.510146+0000","last_fullsized":"2024-01-20T08:11:19.510146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:45.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482746+0000","last_change":"2024-01-20T08:11:05.260221+0000","last_active":"2024-01-20T08:11:19.482746+0000","last_peered":"2024-01-20T08:11:19.482746+0000","last_clean":"2024-01-20T08:11:19.482746+0000","last_became_active":"2024-01-20T08:11:05.259763+0000","last_became_peered":"2024-01-20T08:11:05.259763+0000","last_unstale":"2024-01-20T08:11:19.482746+0000","last_undegraded":"2024-01-20T08:11:19.482746+0000","last_fullsized":"2024-01-20T08:11:19.482746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:10.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511265+0000","last_change":"2024-01-20T08:11:19.506267+0000","last_active":"2024-01-20T08:11:20.511265+0000","last_peered":"2024-01-20T08:11:20.511265+0000","last_clean":"2024-01-20T08:11:20.511265+0000","last_became_active":"2024-01-20T08:11:19.505966+0000","last_became_peered":"2024-01-20T08:11:19.505966+0000","last_unstale":"2024-01-20T08:11:20.511265+0000","last_undegraded":"2024-01-20T08:11:20.511265+0000","last_fullsized":"2024-01-20T08:11:20.511265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:35.213061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532934+0000","last_change":"2024-01-20T08:11:20.525846+0000","last_active":"2024-01-20T08:11:20.532934+0000","last_peered":"2024-01-20T08:11:20.532934+0000","last_clean":"2024-01-20T08:11:20.532934+0000","last_became_active":"2024-01-20T08:11:20.525585+0000","last_became_peered":"2024-01-20T08:11:20.525585+0000","last_unstale":"2024-01-20T08:11:20.532934+0000","last_undegraded":"2024-01-20T08:11:20.532934+0000","last_fullsized":"2024-01-20T08:11:20.532934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:35.296495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494240+0000","last_change":"2024-01-20T08:11:04.234512+0000","last_active":"2024-01-20T08:11:19.494240+0000","last_peered":"2024-01-20T08:11:19.494240+0000","last_clean":"2024-01-20T08:11:19.494240+0000","last_became_active":"2024-01-20T08:11:04.234175+0000","last_became_peered":"2024-01-20T08:11:04.234175+0000","last_unstale":"2024-01-20T08:11:19.494240+0000","last_undegraded":"2024-01-20T08:11:19.494240+0000","last_fullsized":"2024-01-20T08:11:19.494240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482632+0000","last_change":"2024-01-20T08:11:05.246307+0000","last_active":"2024-01-20T08:11:19.482632+0000","last_peered":"2024-01-20T08:11:19.482632+0000","last_clean":"2024-01-20T08:11:19.482632+0000","last_became_active":"2024-01-20T08:11:05.245686+0000","last_became_peered":"2024-01-20T08:11:05.245686+0000","last_unstale":"2024-01-20T08:11:19.482632+0000","last_undegraded":"2024-01-20T08:11:19.482632+0000","last_fullsized":"2024-01-20T08:11:19.482632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:46:31.071864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.496532+0000","last_change":"2024-01-20T08:11:19.505831+0000","last_active":"2024-01-20T08:11:20.496532+0000","last_peered":"2024-01-20T08:11:20.496532+0000","last_clean":"2024-01-20T08:11:20.496532+0000","last_became_active":"2024-01-20T08:11:19.505546+0000","last_became_peered":"2024-01-20T08:11:19.505546+0000","last_unstale":"2024-01-20T08:11:20.496532+0000","last_undegraded":"2024-01-20T08:11:20.496532+0000","last_fullsized":"2024-01-20T08:11:20.496532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:46.628374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528535+0000","last_change":"2024-01-20T08:11:20.522690+0000","last_active":"2024-01-20T08:11:20.528535+0000","last_peered":"2024-01-20T08:11:20.528535+0000","last_clean":"2024-01-20T08:11:20.528535+0000","last_became_active":"2024-01-20T08:11:20.522344+0000","last_became_peered":"2024-01-20T08:11:20.522344+0000","last_unstale":"2024-01-20T08:11:20.528535+0000","last_undegraded":"2024-01-20T08:11:20.528535+0000","last_fullsized":"2024-01-20T08:11:20.528535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:36.228946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503073+0000","last_change":"2024-01-20T08:11:04.231418+0000","last_active":"2024-01-20T08:11:19.503073+0000","last_peered":"2024-01-20T08:11:19.503073+0000","last_clean":"2024-01-20T08:11:19.503073+0000","last_became_active":"2024-01-20T08:11:04.231150+0000","last_became_peered":"2024-01-20T08:11:04.231150+0000","last_unstale":"2024-01-20T08:11:19.503073+0000","last_undegraded":"2024-01-20T08:11:19.503073+0000","last_fullsized":"2024-01-20T08:11:19.503073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:56.187386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483278+0000","last_change":"2024-01-20T08:11:05.256215+0000","last_active":"2024-01-20T08:11:19.483278+0000","last_peered":"2024-01-20T08:11:19.483278+0000","last_clean":"2024-01-20T08:11:19.483278+0000","last_became_active":"2024-01-20T08:11:05.255935+0000","last_became_peered":"2024-01-20T08:11:05.255935+0000","last_unstale":"2024-01-20T08:11:19.483278+0000","last_undegraded":"2024-01-20T08:11:19.483278+0000","last_fullsized":"2024-01-20T08:11:19.483278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:58.356059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531321+0000","last_change":"2024-01-20T08:11:19.508493+0000","last_active":"2024-01-20T08:11:20.531321+0000","last_peered":"2024-01-20T08:11:20.531321+0000","last_clean":"2024-01-20T08:11:20.531321+0000","last_became_active":"2024-01-20T08:11:19.507808+0000","last_became_peered":"2024-01-20T08:11:19.507808+0000","last_unstale":"2024-01-20T08:11:20.531321+0000","last_undegraded":"2024-01-20T08:11:20.531321+0000","last_fullsized":"2024-01-20T08:11:20.531321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.743435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527424+0000","last_change":"2024-01-20T08:11:20.513456+0000","last_active":"2024-01-20T08:11:20.527424+0000","last_peered":"2024-01-20T08:11:20.527424+0000","last_clean":"2024-01-20T08:11:20.527424+0000","last_became_active":"2024-01-20T08:11:20.513073+0000","last_became_peered":"2024-01-20T08:11:20.513073+0000","last_unstale":"2024-01-20T08:11:20.527424+0000","last_undegraded":"2024-01-20T08:11:20.527424+0000","last_fullsized":"2024-01-20T08:11:20.527424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:10.790945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505029+0000","last_change":"2024-01-20T08:11:04.228172+0000","last_active":"2024-01-20T08:11:19.505029+0000","last_peered":"2024-01-20T08:11:19.505029+0000","last_clean":"2024-01-20T08:11:19.505029+0000","last_became_active":"2024-01-20T08:11:04.227839+0000","last_became_peered":"2024-01-20T08:11:04.227839+0000","last_unstale":"2024-01-20T08:11:19.505029+0000","last_undegraded":"2024-01-20T08:11:19.505029+0000","last_fullsized":"2024-01-20T08:11:19.505029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:09.878605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495612+0000","last_change":"2024-01-20T08:11:05.273938+0000","last_active":"2024-01-20T08:11:19.495612+0000","last_peered":"2024-01-20T08:11:19.495612+0000","last_clean":"2024-01-20T08:11:19.495612+0000","last_became_active":"2024-01-20T08:11:05.273244+0000","last_became_peered":"2024-01-20T08:11:05.273244+0000","last_unstale":"2024-01-20T08:11:19.495612+0000","last_undegraded":"2024-01-20T08:11:19.495612+0000","last_fullsized":"2024-01-20T08:11:19.495612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532019+0000","last_change":"2024-01-20T08:11:19.499561+0000","last_active":"2024-01-20T08:11:20.532019+0000","last_peered":"2024-01-20T08:11:20.532019+0000","last_clean":"2024-01-20T08:11:20.532019+0000","last_became_active":"2024-01-20T08:11:19.499261+0000","last_became_peered":"2024-01-20T08:11:19.499261+0000","last_unstale":"2024-01-20T08:11:20.532019+0000","last_undegraded":"2024-01-20T08:11:20.532019+0000","last_fullsized":"2024-01-20T08:11:20.532019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:18:02.072306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527363+0000","last_change":"2024-01-20T08:11:20.521231+0000","last_active":"2024-01-20T08:11:20.527363+0000","last_peered":"2024-01-20T08:11:20.527363+0000","last_clean":"2024-01-20T08:11:20.527363+0000","last_became_active":"2024-01-20T08:11:20.518559+0000","last_became_peered":"2024-01-20T08:11:20.518559+0000","last_unstale":"2024-01-20T08:11:20.527363+0000","last_undegraded":"2024-01-20T08:11:20.527363+0000","last_fullsized":"2024-01-20T08:11:20.527363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:07.572579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506418+0000","last_change":"2024-01-20T08:11:04.240349+0000","last_active":"2024-01-20T08:11:19.506418+0000","last_peered":"2024-01-20T08:11:19.506418+0000","last_clean":"2024-01-20T08:11:19.506418+0000","last_became_active":"2024-01-20T08:11:04.240032+0000","last_became_peered":"2024-01-20T08:11:04.240032+0000","last_unstale":"2024-01-20T08:11:19.506418+0000","last_undegraded":"2024-01-20T08:11:19.506418+0000","last_fullsized":"2024-01-20T08:11:19.506418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:27:52.299223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506281+0000","last_change":"2024-01-20T08:11:05.254371+0000","last_active":"2024-01-20T08:11:19.506281+0000","last_peered":"2024-01-20T08:11:19.506281+0000","last_clean":"2024-01-20T08:11:19.506281+0000","last_became_active":"2024-01-20T08:11:05.253911+0000","last_became_peered":"2024-01-20T08:11:05.253911+0000","last_unstale":"2024-01-20T08:11:19.506281+0000","last_undegraded":"2024-01-20T08:11:19.506281+0000","last_fullsized":"2024-01-20T08:11:19.506281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:18.546758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.510984+0000","last_change":"2024-01-20T08:11:19.515934+0000","last_active":"2024-01-20T08:11:20.510984+0000","last_peered":"2024-01-20T08:11:20.510984+0000","last_clean":"2024-01-20T08:11:20.510984+0000","last_became_active":"2024-01-20T08:11:19.515687+0000","last_became_peered":"2024-01-20T08:11:19.515687+0000","last_unstale":"2024-01-20T08:11:20.510984+0000","last_undegraded":"2024-01-20T08:11:20.510984+0000","last_fullsized":"2024-01-20T08:11:20.510984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:23:47.145480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532822+0000","last_change":"2024-01-20T08:11:20.525253+0000","last_active":"2024-01-20T08:11:20.532822+0000","last_peered":"2024-01-20T08:11:20.532822+0000","last_clean":"2024-01-20T08:11:20.532822+0000","last_became_active":"2024-01-20T08:11:20.524929+0000","last_became_peered":"2024-01-20T08:11:20.524929+0000","last_unstale":"2024-01-20T08:11:20.532822+0000","last_undegraded":"2024-01-20T08:11:20.532822+0000","last_fullsized":"2024-01-20T08:11:20.532822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:40.801450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497077+0000","last_change":"2024-01-20T08:11:04.241452+0000","last_active":"2024-01-20T08:11:19.497077+0000","last_peered":"2024-01-20T08:11:19.497077+0000","last_clean":"2024-01-20T08:11:19.497077+0000","last_became_active":"2024-01-20T08:11:04.240981+0000","last_became_peered":"2024-01-20T08:11:04.240981+0000","last_unstale":"2024-01-20T08:11:19.497077+0000","last_undegraded":"2024-01-20T08:11:19.497077+0000","last_fullsized":"2024-01-20T08:11:19.497077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505835+0000","last_change":"2024-01-20T08:11:05.269731+0000","last_active":"2024-01-20T08:11:19.505835+0000","last_peered":"2024-01-20T08:11:19.505835+0000","last_clean":"2024-01-20T08:11:19.505835+0000","last_became_active":"2024-01-20T08:11:05.269500+0000","last_became_peered":"2024-01-20T08:11:05.269500+0000","last_unstale":"2024-01-20T08:11:19.505835+0000","last_undegraded":"2024-01-20T08:11:19.505835+0000","last_fullsized":"2024-01-20T08:11:19.505835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533844+0000","last_change":"2024-01-20T08:11:19.514268+0000","last_active":"2024-01-20T08:11:20.533844+0000","last_peered":"2024-01-20T08:11:20.533844+0000","last_clean":"2024-01-20T08:11:20.533844+0000","last_became_active":"2024-01-20T08:11:19.513969+0000","last_became_peered":"2024-01-20T08:11:19.513969+0000","last_unstale":"2024-01-20T08:11:20.533844+0000","last_undegraded":"2024-01-20T08:11:20.533844+0000","last_fullsized":"2024-01-20T08:11:20.533844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:03.473432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521748+0000","last_change":"2024-01-20T08:11:20.515344+0000","last_active":"2024-01-20T08:11:20.521748+0000","last_peered":"2024-01-20T08:11:20.521748+0000","last_clean":"2024-01-20T08:11:20.521748+0000","last_became_active":"2024-01-20T08:11:20.515050+0000","last_became_peered":"2024-01-20T08:11:20.515050+0000","last_unstale":"2024-01-20T08:11:20.521748+0000","last_undegraded":"2024-01-20T08:11:20.521748+0000","last_fullsized":"2024-01-20T08:11:20.521748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:09.652760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488494+0000","last_change":"2024-01-20T08:11:04.231466+0000","last_active":"2024-01-20T08:11:19.488494+0000","last_peered":"2024-01-20T08:11:19.488494+0000","last_clean":"2024-01-20T08:11:19.488494+0000","last_became_active":"2024-01-20T08:11:04.231224+0000","last_became_peered":"2024-01-20T08:11:04.231224+0000","last_unstale":"2024-01-20T08:11:19.488494+0000","last_undegraded":"2024-01-20T08:11:19.488494+0000","last_fullsized":"2024-01-20T08:11:19.488494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509766+0000","last_change":"2024-01-20T08:11:05.266758+0000","last_active":"2024-01-20T08:11:19.509766+0000","last_peered":"2024-01-20T08:11:19.509766+0000","last_clean":"2024-01-20T08:11:19.509766+0000","last_became_active":"2024-01-20T08:11:05.265820+0000","last_became_peered":"2024-01-20T08:11:05.265820+0000","last_unstale":"2024-01-20T08:11:19.509766+0000","last_undegraded":"2024-01-20T08:11:19.509766+0000","last_fullsized":"2024-01-20T08:11:19.509766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503587+0000","last_change":"2024-01-20T08:11:19.507738+0000","last_active":"2024-01-20T08:11:20.503587+0000","last_peered":"2024-01-20T08:11:20.503587+0000","last_clean":"2024-01-20T08:11:20.503587+0000","last_became_active":"2024-01-20T08:11:19.503990+0000","last_became_peered":"2024-01-20T08:11:19.503990+0000","last_unstale":"2024-01-20T08:11:20.503587+0000","last_undegraded":"2024-01-20T08:11:20.503587+0000","last_fullsized":"2024-01-20T08:11:20.503587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:08.636875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535685+0000","last_change":"2024-01-20T08:11:20.529671+0000","last_active":"2024-01-20T08:11:20.535685+0000","last_peered":"2024-01-20T08:11:20.535685+0000","last_clean":"2024-01-20T08:11:20.535685+0000","last_became_active":"2024-01-20T08:11:20.529204+0000","last_became_peered":"2024-01-20T08:11:20.529204+0000","last_unstale":"2024-01-20T08:11:20.535685+0000","last_undegraded":"2024-01-20T08:11:20.535685+0000","last_fullsized":"2024-01-20T08:11:20.535685+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:33.804674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489948+0000","last_change":"2024-01-20T08:11:04.238160+0000","last_active":"2024-01-20T08:11:19.489948+0000","last_peered":"2024-01-20T08:11:19.489948+0000","last_clean":"2024-01-20T08:11:19.489948+0000","last_became_active":"2024-01-20T08:11:04.237860+0000","last_became_peered":"2024-01-20T08:11:04.237860+0000","last_unstale":"2024-01-20T08:11:19.489948+0000","last_undegraded":"2024-01-20T08:11:19.489948+0000","last_fullsized":"2024-01-20T08:11:19.489948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495562+0000","last_change":"2024-01-20T08:11:05.263329+0000","last_active":"2024-01-20T08:11:19.495562+0000","last_peered":"2024-01-20T08:11:19.495562+0000","last_clean":"2024-01-20T08:11:19.495562+0000","last_became_active":"2024-01-20T08:11:05.263049+0000","last_became_peered":"2024-01-20T08:11:05.263049+0000","last_unstale":"2024-01-20T08:11:19.495562+0000","last_undegraded":"2024-01-20T08:11:19.495562+0000","last_fullsized":"2024-01-20T08:11:19.495562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532861+0000","last_change":"2024-01-20T08:11:19.501883+0000","last_active":"2024-01-20T08:11:20.532861+0000","last_peered":"2024-01-20T08:11:20.532861+0000","last_clean":"2024-01-20T08:11:20.532861+0000","last_became_active":"2024-01-20T08:11:19.501685+0000","last_became_peered":"2024-01-20T08:11:19.501685+0000","last_unstale":"2024-01-20T08:11:20.532861+0000","last_undegraded":"2024-01-20T08:11:20.532861+0000","last_fullsized":"2024-01-20T08:11:20.532861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:45:23.335652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533688+0000","last_change":"2024-01-20T08:11:20.526427+0000","last_active":"2024-01-20T08:11:20.533688+0000","last_peered":"2024-01-20T08:11:20.533688+0000","last_clean":"2024-01-20T08:11:20.533688+0000","last_became_active":"2024-01-20T08:11:20.523704+0000","last_became_peered":"2024-01-20T08:11:20.523704+0000","last_unstale":"2024-01-20T08:11:20.533688+0000","last_undegraded":"2024-01-20T08:11:20.533688+0000","last_fullsized":"2024-01-20T08:11:20.533688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:31:56.198135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495200+0000","last_change":"2024-01-20T08:11:04.240412+0000","last_active":"2024-01-20T08:11:19.495200+0000","last_peered":"2024-01-20T08:11:19.495200+0000","last_clean":"2024-01-20T08:11:19.495200+0000","last_became_active":"2024-01-20T08:11:04.240045+0000","last_became_peered":"2024-01-20T08:11:04.240045+0000","last_unstale":"2024-01-20T08:11:19.495200+0000","last_undegraded":"2024-01-20T08:11:19.495200+0000","last_fullsized":"2024-01-20T08:11:19.495200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494100+0000","last_change":"2024-01-20T08:11:05.262683+0000","last_active":"2024-01-20T08:11:19.494100+0000","last_peered":"2024-01-20T08:11:19.494100+0000","last_clean":"2024-01-20T08:11:19.494100+0000","last_became_active":"2024-01-20T08:11:05.259731+0000","last_became_peered":"2024-01-20T08:11:05.259731+0000","last_unstale":"2024-01-20T08:11:19.494100+0000","last_undegraded":"2024-01-20T08:11:19.494100+0000","last_fullsized":"2024-01-20T08:11:19.494100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534100+0000","last_change":"2024-01-20T08:11:19.509955+0000","last_active":"2024-01-20T08:11:20.534100+0000","last_peered":"2024-01-20T08:11:20.534100+0000","last_clean":"2024-01-20T08:11:20.534100+0000","last_became_active":"2024-01-20T08:11:19.509300+0000","last_became_peered":"2024-01-20T08:11:19.509300+0000","last_unstale":"2024-01-20T08:11:20.534100+0000","last_undegraded":"2024-01-20T08:11:20.534100+0000","last_fullsized":"2024-01-20T08:11:20.534100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:32.788789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533497+0000","last_change":"2024-01-20T08:11:20.529400+0000","last_active":"2024-01-20T08:11:20.533497+0000","last_peered":"2024-01-20T08:11:20.533497+0000","last_clean":"2024-01-20T08:11:20.533497+0000","last_became_active":"2024-01-20T08:11:20.529154+0000","last_became_peered":"2024-01-20T08:11:20.529154+0000","last_unstale":"2024-01-20T08:11:20.533497+0000","last_undegraded":"2024-01-20T08:11:20.533497+0000","last_fullsized":"2024-01-20T08:11:20.533497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:23.855964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503273+0000","last_change":"2024-01-20T08:11:04.239053+0000","last_active":"2024-01-20T08:11:19.503273+0000","last_peered":"2024-01-20T08:11:19.503273+0000","last_clean":"2024-01-20T08:11:19.503273+0000","last_became_active":"2024-01-20T08:11:04.238709+0000","last_became_peered":"2024-01-20T08:11:04.238709+0000","last_unstale":"2024-01-20T08:11:19.503273+0000","last_undegraded":"2024-01-20T08:11:19.503273+0000","last_fullsized":"2024-01-20T08:11:19.503273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:27.855678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495111+0000","last_change":"2024-01-20T08:11:05.277996+0000","last_active":"2024-01-20T08:11:19.495111+0000","last_peered":"2024-01-20T08:11:19.495111+0000","last_clean":"2024-01-20T08:11:19.495111+0000","last_became_active":"2024-01-20T08:11:05.277744+0000","last_became_peered":"2024-01-20T08:11:05.277744+0000","last_unstale":"2024-01-20T08:11:19.495111+0000","last_undegraded":"2024-01-20T08:11:19.495111+0000","last_fullsized":"2024-01-20T08:11:19.495111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.509223+0000","last_change":"2024-01-20T08:11:19.501251+0000","last_active":"2024-01-20T08:11:20.509223+0000","last_peered":"2024-01-20T08:11:20.509223+0000","last_clean":"2024-01-20T08:11:20.509223+0000","last_became_active":"2024-01-20T08:11:19.500967+0000","last_became_peered":"2024-01-20T08:11:19.500967+0000","last_unstale":"2024-01-20T08:11:20.509223+0000","last_undegraded":"2024-01-20T08:11:20.509223+0000","last_fullsized":"2024-01-20T08:11:20.509223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:44.685127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535928+0000","last_change":"2024-01-20T08:11:20.534882+0000","last_active":"2024-01-20T08:11:20.535928+0000","last_peered":"2024-01-20T08:11:20.535928+0000","last_clean":"2024-01-20T08:11:20.535928+0000","last_became_active":"2024-01-20T08:11:20.532433+0000","last_became_peered":"2024-01-20T08:11:20.532433+0000","last_unstale":"2024-01-20T08:11:20.535928+0000","last_undegraded":"2024-01-20T08:11:20.535928+0000","last_fullsized":"2024-01-20T08:11:20.535928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:36.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489329+0000","last_change":"2024-01-20T08:11:04.229958+0000","last_active":"2024-01-20T08:11:19.489329+0000","last_peered":"2024-01-20T08:11:19.489329+0000","last_clean":"2024-01-20T08:11:19.489329+0000","last_became_active":"2024-01-20T08:11:04.229708+0000","last_became_peered":"2024-01-20T08:11:04.229708+0000","last_unstale":"2024-01-20T08:11:19.489329+0000","last_undegraded":"2024-01-20T08:11:19.489329+0000","last_fullsized":"2024-01-20T08:11:19.489329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:19.024894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508085+0000","last_change":"2024-01-20T08:11:05.264063+0000","last_active":"2024-01-20T08:11:19.508085+0000","last_peered":"2024-01-20T08:11:19.508085+0000","last_clean":"2024-01-20T08:11:19.508085+0000","last_became_active":"2024-01-20T08:11:05.263343+0000","last_became_peered":"2024-01-20T08:11:05.263343+0000","last_unstale":"2024-01-20T08:11:19.508085+0000","last_undegraded":"2024-01-20T08:11:19.508085+0000","last_fullsized":"2024-01-20T08:11:19.508085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503909+0000","last_change":"2024-01-20T08:11:19.503318+0000","last_active":"2024-01-20T08:11:20.503909+0000","last_peered":"2024-01-20T08:11:20.503909+0000","last_clean":"2024-01-20T08:11:20.503909+0000","last_became_active":"2024-01-20T08:11:19.503051+0000","last_became_peered":"2024-01-20T08:11:19.503051+0000","last_unstale":"2024-01-20T08:11:20.503909+0000","last_undegraded":"2024-01-20T08:11:20.503909+0000","last_fullsized":"2024-01-20T08:11:20.503909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:24.172771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518850+0000","last_change":"2024-01-20T08:11:20.512137+0000","last_active":"2024-01-20T08:11:20.518850+0000","last_peered":"2024-01-20T08:11:20.518850+0000","last_clean":"2024-01-20T08:11:20.518850+0000","last_became_active":"2024-01-20T08:11:20.511819+0000","last_became_peered":"2024-01-20T08:11:20.511819+0000","last_unstale":"2024-01-20T08:11:20.518850+0000","last_undegraded":"2024-01-20T08:11:20.518850+0000","last_fullsized":"2024-01-20T08:11:20.518850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:19.177019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508295+0000","last_change":"2024-01-20T08:11:04.240118+0000","last_active":"2024-01-20T08:11:19.508295+0000","last_peered":"2024-01-20T08:11:19.508295+0000","last_clean":"2024-01-20T08:11:19.508295+0000","last_became_active":"2024-01-20T08:11:04.239850+0000","last_became_peered":"2024-01-20T08:11:04.239850+0000","last_unstale":"2024-01-20T08:11:19.508295+0000","last_undegraded":"2024-01-20T08:11:19.508295+0000","last_fullsized":"2024-01-20T08:11:19.508295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489239+0000","last_change":"2024-01-20T08:11:05.254926+0000","last_active":"2024-01-20T08:11:19.489239+0000","last_peered":"2024-01-20T08:11:19.489239+0000","last_clean":"2024-01-20T08:11:19.489239+0000","last_became_active":"2024-01-20T08:11:05.254655+0000","last_became_peered":"2024-01-20T08:11:05.254655+0000","last_unstale":"2024-01-20T08:11:19.489239+0000","last_undegraded":"2024-01-20T08:11:19.489239+0000","last_fullsized":"2024-01-20T08:11:19.489239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.504676+0000","last_change":"2024-01-20T08:11:19.511788+0000","last_active":"2024-01-20T08:11:20.504676+0000","last_peered":"2024-01-20T08:11:20.504676+0000","last_clean":"2024-01-20T08:11:20.504676+0000","last_became_active":"2024-01-20T08:11:19.511467+0000","last_became_peered":"2024-01-20T08:11:19.511467+0000","last_unstale":"2024-01-20T08:11:20.504676+0000","last_undegraded":"2024-01-20T08:11:20.504676+0000","last_fullsized":"2024-01-20T08:11:20.504676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:32.788789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531198+0000","last_change":"2024-01-20T08:11:20.527045+0000","last_active":"2024-01-20T08:11:20.531198+0000","last_peered":"2024-01-20T08:11:20.531198+0000","last_clean":"2024-01-20T08:11:20.531198+0000","last_became_active":"2024-01-20T08:11:20.524157+0000","last_became_peered":"2024-01-20T08:11:20.524157+0000","last_unstale":"2024-01-20T08:11:20.531198+0000","last_undegraded":"2024-01-20T08:11:20.531198+0000","last_fullsized":"2024-01-20T08:11:20.531198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.865344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501185+0000","last_change":"2024-01-20T08:11:04.231597+0000","last_active":"2024-01-20T08:11:19.501185+0000","last_peered":"2024-01-20T08:11:19.501185+0000","last_clean":"2024-01-20T08:11:19.501185+0000","last_became_active":"2024-01-20T08:11:04.231265+0000","last_became_peered":"2024-01-20T08:11:04.231265+0000","last_unstale":"2024-01-20T08:11:19.501185+0000","last_undegraded":"2024-01-20T08:11:19.501185+0000","last_fullsized":"2024-01-20T08:11:19.501185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489200+0000","last_change":"2024-01-20T08:11:05.271640+0000","last_active":"2024-01-20T08:11:19.489200+0000","last_peered":"2024-01-20T08:11:19.489200+0000","last_clean":"2024-01-20T08:11:19.489200+0000","last_became_active":"2024-01-20T08:11:05.271380+0000","last_became_peered":"2024-01-20T08:11:05.271380+0000","last_unstale":"2024-01-20T08:11:19.489200+0000","last_undegraded":"2024-01-20T08:11:19.489200+0000","last_fullsized":"2024-01-20T08:11:19.489200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:21.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.538318+0000","last_change":"2024-01-20T08:11:19.505147+0000","last_active":"2024-01-20T08:11:20.538318+0000","last_peered":"2024-01-20T08:11:20.538318+0000","last_clean":"2024-01-20T08:11:20.538318+0000","last_became_active":"2024-01-20T08:11:19.504675+0000","last_became_peered":"2024-01-20T08:11:19.504675+0000","last_unstale":"2024-01-20T08:11:20.538318+0000","last_undegraded":"2024-01-20T08:11:20.538318+0000","last_fullsized":"2024-01-20T08:11:20.538318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:24.478113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.536764+0000","last_change":"2024-01-20T08:11:20.533426+0000","last_active":"2024-01-20T08:11:20.536764+0000","last_peered":"2024-01-20T08:11:20.536764+0000","last_clean":"2024-01-20T08:11:20.536764+0000","last_became_active":"2024-01-20T08:11:20.533169+0000","last_became_peered":"2024-01-20T08:11:20.533169+0000","last_unstale":"2024-01-20T08:11:20.536764+0000","last_undegraded":"2024-01-20T08:11:20.536764+0000","last_fullsized":"2024-01-20T08:11:20.536764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:01:50.149523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489294+0000","last_change":"2024-01-20T08:11:04.238975+0000","last_active":"2024-01-20T08:11:19.489294+0000","last_peered":"2024-01-20T08:11:19.489294+0000","last_clean":"2024-01-20T08:11:19.489294+0000","last_became_active":"2024-01-20T08:11:04.238626+0000","last_became_peered":"2024-01-20T08:11:04.238626+0000","last_unstale":"2024-01-20T08:11:19.489294+0000","last_undegraded":"2024-01-20T08:11:19.489294+0000","last_fullsized":"2024-01-20T08:11:19.489294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:35.183036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508130+0000","last_change":"2024-01-20T08:11:05.270395+0000","last_active":"2024-01-20T08:11:19.508130+0000","last_peered":"2024-01-20T08:11:19.508130+0000","last_clean":"2024-01-20T08:11:19.508130+0000","last_became_active":"2024-01-20T08:11:05.269778+0000","last_became_peered":"2024-01-20T08:11:05.269778+0000","last_unstale":"2024-01-20T08:11:19.508130+0000","last_undegraded":"2024-01-20T08:11:19.508130+0000","last_fullsized":"2024-01-20T08:11:19.508130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:26.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531990+0000","last_change":"2024-01-20T08:11:19.517241+0000","last_active":"2024-01-20T08:11:20.531990+0000","last_peered":"2024-01-20T08:11:20.531990+0000","last_clean":"2024-01-20T08:11:20.531990+0000","last_became_active":"2024-01-20T08:11:19.516977+0000","last_became_peered":"2024-01-20T08:11:19.516977+0000","last_unstale":"2024-01-20T08:11:20.531990+0000","last_undegraded":"2024-01-20T08:11:20.531990+0000","last_fullsized":"2024-01-20T08:11:20.531990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:03.473432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516921+0000","last_change":"2024-01-20T08:11:20.509657+0000","last_active":"2024-01-20T08:11:20.516921+0000","last_peered":"2024-01-20T08:11:20.516921+0000","last_clean":"2024-01-20T08:11:20.516921+0000","last_became_active":"2024-01-20T08:11:20.508862+0000","last_became_peered":"2024-01-20T08:11:20.508862+0000","last_unstale":"2024-01-20T08:11:20.516921+0000","last_undegraded":"2024-01-20T08:11:20.516921+0000","last_fullsized":"2024-01-20T08:11:20.516921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:19.177019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503151+0000","last_change":"2024-01-20T08:11:04.238159+0000","last_active":"2024-01-20T08:11:19.503151+0000","last_peered":"2024-01-20T08:11:19.503151+0000","last_clean":"2024-01-20T08:11:19.503151+0000","last_became_active":"2024-01-20T08:11:04.237894+0000","last_became_peered":"2024-01-20T08:11:04.237894+0000","last_unstale":"2024-01-20T08:11:19.503151+0000","last_undegraded":"2024-01-20T08:11:19.503151+0000","last_fullsized":"2024-01-20T08:11:19.503151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:15.898827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494091+0000","last_change":"2024-01-20T08:11:05.270984+0000","last_active":"2024-01-20T08:11:19.494091+0000","last_peered":"2024-01-20T08:11:19.494091+0000","last_clean":"2024-01-20T08:11:19.494091+0000","last_became_active":"2024-01-20T08:11:05.270740+0000","last_became_peered":"2024-01-20T08:11:05.270740+0000","last_unstale":"2024-01-20T08:11:19.494091+0000","last_undegraded":"2024-01-20T08:11:19.494091+0000","last_fullsized":"2024-01-20T08:11:19.494091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.523489+0000","last_change":"2024-01-20T08:11:19.515905+0000","last_active":"2024-01-20T08:11:20.523489+0000","last_peered":"2024-01-20T08:11:20.523489+0000","last_clean":"2024-01-20T08:11:20.523489+0000","last_became_active":"2024-01-20T08:11:19.515110+0000","last_became_peered":"2024-01-20T08:11:19.515110+0000","last_unstale":"2024-01-20T08:11:20.523489+0000","last_undegraded":"2024-01-20T08:11:20.523489+0000","last_fullsized":"2024-01-20T08:11:20.523489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:46.628374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.529458+0000","last_change":"2024-01-20T08:11:20.523679+0000","last_active":"2024-01-20T08:11:20.529458+0000","last_peered":"2024-01-20T08:11:20.529458+0000","last_clean":"2024-01-20T08:11:20.529458+0000","last_became_active":"2024-01-20T08:11:20.523384+0000","last_became_peered":"2024-01-20T08:11:20.523384+0000","last_unstale":"2024-01-20T08:11:20.529458+0000","last_undegraded":"2024-01-20T08:11:20.529458+0000","last_fullsized":"2024-01-20T08:11:20.529458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:16.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489853+0000","last_change":"2024-01-20T08:11:04.228883+0000","last_active":"2024-01-20T08:11:19.489853+0000","last_peered":"2024-01-20T08:11:19.489853+0000","last_clean":"2024-01-20T08:11:19.489853+0000","last_became_active":"2024-01-20T08:11:04.228077+0000","last_became_peered":"2024-01-20T08:11:04.228077+0000","last_unstale":"2024-01-20T08:11:19.489853+0000","last_undegraded":"2024-01-20T08:11:19.489853+0000","last_fullsized":"2024-01-20T08:11:19.489853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503059+0000","last_change":"2024-01-20T08:11:05.265947+0000","last_active":"2024-01-20T08:11:19.503059+0000","last_peered":"2024-01-20T08:11:19.503059+0000","last_clean":"2024-01-20T08:11:19.503059+0000","last_became_active":"2024-01-20T08:11:05.265674+0000","last_became_peered":"2024-01-20T08:11:05.265674+0000","last_unstale":"2024-01-20T08:11:19.503059+0000","last_undegraded":"2024-01-20T08:11:19.503059+0000","last_fullsized":"2024-01-20T08:11:19.503059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531061+0000","last_change":"2024-01-20T08:11:19.508156+0000","last_active":"2024-01-20T08:11:20.531061+0000","last_peered":"2024-01-20T08:11:20.531061+0000","last_clean":"2024-01-20T08:11:20.531061+0000","last_became_active":"2024-01-20T08:11:19.507544+0000","last_became_peered":"2024-01-20T08:11:19.507544+0000","last_unstale":"2024-01-20T08:11:20.531061+0000","last_undegraded":"2024-01-20T08:11:20.531061+0000","last_fullsized":"2024-01-20T08:11:20.531061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:10.318192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527542+0000","last_change":"2024-01-20T08:11:20.525093+0000","last_active":"2024-01-20T08:11:20.527542+0000","last_peered":"2024-01-20T08:11:20.527542+0000","last_clean":"2024-01-20T08:11:20.527542+0000","last_became_active":"2024-01-20T08:11:20.524560+0000","last_became_peered":"2024-01-20T08:11:20.524560+0000","last_unstale":"2024-01-20T08:11:20.527542+0000","last_undegraded":"2024-01-20T08:11:20.527542+0000","last_fullsized":"2024-01-20T08:11:20.527542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:06:00.517140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503441+0000","last_change":"2024-01-20T08:11:04.233438+0000","last_active":"2024-01-20T08:11:19.503441+0000","last_peered":"2024-01-20T08:11:19.503441+0000","last_clean":"2024-01-20T08:11:19.503441+0000","last_became_active":"2024-01-20T08:11:04.232954+0000","last_became_peered":"2024-01-20T08:11:04.232954+0000","last_unstale":"2024-01-20T08:11:19.503441+0000","last_undegraded":"2024-01-20T08:11:19.503441+0000","last_fullsized":"2024-01-20T08:11:19.503441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:49.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.504461+0000","last_change":"2024-01-20T08:11:05.261155+0000","last_active":"2024-01-20T08:11:19.504461+0000","last_peered":"2024-01-20T08:11:19.504461+0000","last_clean":"2024-01-20T08:11:19.504461+0000","last_became_active":"2024-01-20T08:11:05.260746+0000","last_became_peered":"2024-01-20T08:11:05.260746+0000","last_unstale":"2024-01-20T08:11:19.504461+0000","last_undegraded":"2024-01-20T08:11:19.504461+0000","last_fullsized":"2024-01-20T08:11:19.504461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.506209+0000","last_change":"2024-01-20T08:11:19.499967+0000","last_active":"2024-01-20T08:11:20.506209+0000","last_peered":"2024-01-20T08:11:20.506209+0000","last_clean":"2024-01-20T08:11:20.506209+0000","last_became_active":"2024-01-20T08:11:19.499671+0000","last_became_peered":"2024-01-20T08:11:19.499671+0000","last_unstale":"2024-01-20T08:11:20.506209+0000","last_undegraded":"2024-01-20T08:11:20.506209+0000","last_fullsized":"2024-01-20T08:11:20.506209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:40.857724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530865+0000","last_change":"2024-01-20T08:11:20.525046+0000","last_active":"2024-01-20T08:11:20.530865+0000","last_peered":"2024-01-20T08:11:20.530865+0000","last_clean":"2024-01-20T08:11:20.530865+0000","last_became_active":"2024-01-20T08:11:20.524209+0000","last_became_peered":"2024-01-20T08:11:20.524209+0000","last_unstale":"2024-01-20T08:11:20.530865+0000","last_undegraded":"2024-01-20T08:11:20.530865+0000","last_fullsized":"2024-01-20T08:11:20.530865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503180+0000","last_change":"2024-01-20T08:11:04.234921+0000","last_active":"2024-01-20T08:11:19.503180+0000","last_peered":"2024-01-20T08:11:19.503180+0000","last_clean":"2024-01-20T08:11:19.503180+0000","last_became_active":"2024-01-20T08:11:04.232868+0000","last_became_peered":"2024-01-20T08:11:04.232868+0000","last_unstale":"2024-01-20T08:11:19.503180+0000","last_undegraded":"2024-01-20T08:11:19.503180+0000","last_fullsized":"2024-01-20T08:11:19.503180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:57.342375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.492491+0000","last_change":"2024-01-20T08:11:05.267543+0000","last_active":"2024-01-20T08:11:19.492491+0000","last_peered":"2024-01-20T08:11:19.492491+0000","last_clean":"2024-01-20T08:11:19.492491+0000","last_became_active":"2024-01-20T08:11:05.267013+0000","last_became_peered":"2024-01-20T08:11:05.267013+0000","last_unstale":"2024-01-20T08:11:19.492491+0000","last_undegraded":"2024-01-20T08:11:19.492491+0000","last_fullsized":"2024-01-20T08:11:19.492491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.493622+0000","last_change":"2024-01-20T08:11:19.510874+0000","last_active":"2024-01-20T08:11:20.493622+0000","last_peered":"2024-01-20T08:11:20.493622+0000","last_clean":"2024-01-20T08:11:20.493622+0000","last_became_active":"2024-01-20T08:11:19.510586+0000","last_became_peered":"2024-01-20T08:11:19.510586+0000","last_unstale":"2024-01-20T08:11:20.493622+0000","last_undegraded":"2024-01-20T08:11:20.493622+0000","last_fullsized":"2024-01-20T08:11:20.493622+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:15.534552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527252+0000","last_change":"2024-01-20T08:11:20.520499+0000","last_active":"2024-01-20T08:11:20.527252+0000","last_peered":"2024-01-20T08:11:20.527252+0000","last_clean":"2024-01-20T08:11:20.527252+0000","last_became_active":"2024-01-20T08:11:20.519690+0000","last_became_peered":"2024-01-20T08:11:20.519690+0000","last_unstale":"2024-01-20T08:11:20.527252+0000","last_undegraded":"2024-01-20T08:11:20.527252+0000","last_fullsized":"2024-01-20T08:11:20.527252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:01.212788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534874+0000","last_change":"2024-01-20T08:11:19.518798+0000","last_active":"2024-01-20T08:11:20.534874+0000","last_peered":"2024-01-20T08:11:20.534874+0000","last_clean":"2024-01-20T08:11:20.534874+0000","last_became_active":"2024-01-20T08:11:19.518478+0000","last_became_peered":"2024-01-20T08:11:19.518478+0000","last_unstale":"2024-01-20T08:11:20.534874+0000","last_undegraded":"2024-01-20T08:11:20.534874+0000","last_fullsized":"2024-01-20T08:11:20.534874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:40.857724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483225+0000","last_change":"2024-01-20T08:11:04.227383+0000","last_active":"2024-01-20T08:11:19.483225+0000","last_peered":"2024-01-20T08:11:19.483225+0000","last_clean":"2024-01-20T08:11:19.483225+0000","last_became_active":"2024-01-20T08:11:04.227109+0000","last_became_peered":"2024-01-20T08:11:04.227109+0000","last_unstale":"2024-01-20T08:11:19.483225+0000","last_undegraded":"2024-01-20T08:11:19.483225+0000","last_fullsized":"2024-01-20T08:11:19.483225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:04:40.346500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496047+0000","last_change":"2024-01-20T08:11:05.273419+0000","last_active":"2024-01-20T08:11:19.496047+0000","last_peered":"2024-01-20T08:11:19.496047+0000","last_clean":"2024-01-20T08:11:19.496047+0000","last_became_active":"2024-01-20T08:11:05.273110+0000","last_became_peered":"2024-01-20T08:11:05.273110+0000","last_unstale":"2024-01-20T08:11:19.496047+0000","last_undegraded":"2024-01-20T08:11:19.496047+0000","last_fullsized":"2024-01-20T08:11:19.496047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530566+0000","last_change":"2024-01-20T08:11:20.525731+0000","last_active":"2024-01-20T08:11:20.530566+0000","last_peered":"2024-01-20T08:11:20.530566+0000","last_clean":"2024-01-20T08:11:20.530566+0000","last_became_active":"2024-01-20T08:11:20.525414+0000","last_became_peered":"2024-01-20T08:11:20.525414+0000","last_unstale":"2024-01-20T08:11:20.530566+0000","last_undegraded":"2024-01-20T08:11:20.530566+0000","last_fullsized":"2024-01-20T08:11:20.530566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535945+0000","last_change":"2024-01-20T08:11:19.516000+0000","last_active":"2024-01-20T08:11:20.535945+0000","last_peered":"2024-01-20T08:11:20.535945+0000","last_clean":"2024-01-20T08:11:20.535945+0000","last_became_active":"2024-01-20T08:11:19.515755+0000","last_became_peered":"2024-01-20T08:11:19.515755+0000","last_unstale":"2024-01-20T08:11:20.535945+0000","last_undegraded":"2024-01-20T08:11:20.535945+0000","last_fullsized":"2024-01-20T08:11:20.535945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:57.365915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488739+0000","last_change":"2024-01-20T08:11:04.227503+0000","last_active":"2024-01-20T08:11:19.488739+0000","last_peered":"2024-01-20T08:11:19.488739+0000","last_clean":"2024-01-20T08:11:19.488739+0000","last_became_active":"2024-01-20T08:11:04.227241+0000","last_became_peered":"2024-01-20T08:11:04.227241+0000","last_unstale":"2024-01-20T08:11:19.488739+0000","last_undegraded":"2024-01-20T08:11:19.488739+0000","last_fullsized":"2024-01-20T08:11:19.488739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:45.729946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502991+0000","last_change":"2024-01-20T08:11:05.261271+0000","last_active":"2024-01-20T08:11:19.502991+0000","last_peered":"2024-01-20T08:11:19.502991+0000","last_clean":"2024-01-20T08:11:19.502991+0000","last_became_active":"2024-01-20T08:11:05.258484+0000","last_became_peered":"2024-01-20T08:11:05.258484+0000","last_unstale":"2024-01-20T08:11:19.502991+0000","last_undegraded":"2024-01-20T08:11:19.502991+0000","last_fullsized":"2024-01-20T08:11:19.502991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533688+0000","last_change":"2024-01-20T08:11:20.530010+0000","last_active":"2024-01-20T08:11:20.533688+0000","last_peered":"2024-01-20T08:11:20.533688+0000","last_clean":"2024-01-20T08:11:20.533688+0000","last_became_active":"2024-01-20T08:11:20.529531+0000","last_became_peered":"2024-01-20T08:11:20.529531+0000","last_unstale":"2024-01-20T08:11:20.533688+0000","last_undegraded":"2024-01-20T08:11:20.533688+0000","last_fullsized":"2024-01-20T08:11:20.533688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501096+0000","last_change":"2024-01-20T08:11:04.238741+0000","last_active":"2024-01-20T08:11:19.501096+0000","last_peered":"2024-01-20T08:11:19.501096+0000","last_clean":"2024-01-20T08:11:19.501096+0000","last_became_active":"2024-01-20T08:11:04.238272+0000","last_became_peered":"2024-01-20T08:11:04.238272+0000","last_unstale":"2024-01-20T08:11:19.501096+0000","last_undegraded":"2024-01-20T08:11:19.501096+0000","last_fullsized":"2024-01-20T08:11:19.501096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513545+0000","last_change":"2024-01-20T08:11:05.267631+0000","last_active":"2024-01-20T08:11:19.513545+0000","last_peered":"2024-01-20T08:11:19.513545+0000","last_clean":"2024-01-20T08:11:19.513545+0000","last_became_active":"2024-01-20T08:11:05.267310+0000","last_became_peered":"2024-01-20T08:11:05.267310+0000","last_unstale":"2024-01-20T08:11:19.513545+0000","last_undegraded":"2024-01-20T08:11:19.513545+0000","last_fullsized":"2024-01-20T08:11:19.513545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527285+0000","last_change":"2024-01-20T08:11:19.514806+0000","last_active":"2024-01-20T08:11:20.527285+0000","last_peered":"2024-01-20T08:11:20.527285+0000","last_clean":"2024-01-20T08:11:20.527285+0000","last_became_active":"2024-01-20T08:11:19.514457+0000","last_became_peered":"2024-01-20T08:11:19.514457+0000","last_unstale":"2024-01-20T08:11:20.527285+0000","last_undegraded":"2024-01-20T08:11:20.527285+0000","last_fullsized":"2024-01-20T08:11:20.527285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:15.534552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.526024+0000","last_change":"2024-01-20T08:11:20.522167+0000","last_active":"2024-01-20T08:11:20.526024+0000","last_peered":"2024-01-20T08:11:20.526024+0000","last_clean":"2024-01-20T08:11:20.526024+0000","last_became_active":"2024-01-20T08:11:20.521902+0000","last_became_peered":"2024-01-20T08:11:20.521902+0000","last_unstale":"2024-01-20T08:11:20.526024+0000","last_undegraded":"2024-01-20T08:11:20.526024+0000","last_fullsized":"2024-01-20T08:11:20.526024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:57.773276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513672+0000","last_change":"2024-01-20T08:11:04.244349+0000","last_active":"2024-01-20T08:11:19.513672+0000","last_peered":"2024-01-20T08:11:19.513672+0000","last_clean":"2024-01-20T08:11:19.513672+0000","last_became_active":"2024-01-20T08:11:04.244029+0000","last_became_peered":"2024-01-20T08:11:04.244029+0000","last_unstale":"2024-01-20T08:11:19.513672+0000","last_undegraded":"2024-01-20T08:11:19.513672+0000","last_fullsized":"2024-01-20T08:11:19.513672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501003+0000","last_change":"2024-01-20T08:11:05.264962+0000","last_active":"2024-01-20T08:11:19.501003+0000","last_peered":"2024-01-20T08:11:19.501003+0000","last_clean":"2024-01-20T08:11:19.501003+0000","last_became_active":"2024-01-20T08:11:05.264693+0000","last_became_peered":"2024-01-20T08:11:05.264693+0000","last_unstale":"2024-01-20T08:11:19.501003+0000","last_undegraded":"2024-01-20T08:11:19.501003+0000","last_fullsized":"2024-01-20T08:11:19.501003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527601+0000","last_change":"2024-01-20T08:11:19.520142+0000","last_active":"2024-01-20T08:11:20.527601+0000","last_peered":"2024-01-20T08:11:20.527601+0000","last_clean":"2024-01-20T08:11:20.527601+0000","last_became_active":"2024-01-20T08:11:19.519812+0000","last_became_peered":"2024-01-20T08:11:19.519812+0000","last_unstale":"2024-01-20T08:11:20.527601+0000","last_undegraded":"2024-01-20T08:11:20.527601+0000","last_fullsized":"2024-01-20T08:11:20.527601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:26.921580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.523458+0000","last_change":"2024-01-20T08:11:20.517223+0000","last_active":"2024-01-20T08:11:20.523458+0000","last_peered":"2024-01-20T08:11:20.523458+0000","last_clean":"2024-01-20T08:11:20.523458+0000","last_became_active":"2024-01-20T08:11:20.516944+0000","last_became_peered":"2024-01-20T08:11:20.516944+0000","last_unstale":"2024-01-20T08:11:20.523458+0000","last_undegraded":"2024-01-20T08:11:20.523458+0000","last_fullsized":"2024-01-20T08:11:20.523458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495344+0000","last_change":"2024-01-20T08:11:05.264877+0000","last_active":"2024-01-20T08:11:19.495344+0000","last_peered":"2024-01-20T08:11:19.495344+0000","last_clean":"2024-01-20T08:11:19.495344+0000","last_became_active":"2024-01-20T08:11:05.260771+0000","last_became_peered":"2024-01-20T08:11:05.260771+0000","last_unstale":"2024-01-20T08:11:19.495344+0000","last_undegraded":"2024-01-20T08:11:19.495344+0000","last_fullsized":"2024-01-20T08:11:19.495344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527248+0000","last_change":"2024-01-20T08:11:20.521484+0000","last_active":"2024-01-20T08:11:20.527248+0000","last_peered":"2024-01-20T08:11:20.527248+0000","last_clean":"2024-01-20T08:11:20.527248+0000","last_became_active":"2024-01-20T08:11:20.514403+0000","last_became_peered":"2024-01-20T08:11:20.514403+0000","last_unstale":"2024-01-20T08:11:20.527248+0000","last_undegraded":"2024-01-20T08:11:20.527248+0000","last_fullsized":"2024-01-20T08:11:20.527248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:53.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509638+0000","last_change":"2024-01-20T08:11:05.274553+0000","last_active":"2024-01-20T08:11:19.509638+0000","last_peered":"2024-01-20T08:11:19.509638+0000","last_clean":"2024-01-20T08:11:19.509638+0000","last_became_active":"2024-01-20T08:11:05.272535+0000","last_became_peered":"2024-01-20T08:11:05.272535+0000","last_unstale":"2024-01-20T08:11:19.509638+0000","last_undegraded":"2024-01-20T08:11:19.509638+0000","last_fullsized":"2024-01-20T08:11:19.509638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527145+0000","last_change":"2024-01-20T08:11:20.511628+0000","last_active":"2024-01-20T08:11:20.527145+0000","last_peered":"2024-01-20T08:11:20.527145+0000","last_clean":"2024-01-20T08:11:20.527145+0000","last_became_active":"2024-01-20T08:11:20.508039+0000","last_became_peered":"2024-01-20T08:11:20.508039+0000","last_unstale":"2024-01-20T08:11:20.527145+0000","last_undegraded":"2024-01-20T08:11:20.527145+0000","last_fullsized":"2024-01-20T08:11:20.527145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:59.726793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.492243+0000","last_change":"2024-01-20T08:11:05.267754+0000","last_active":"2024-01-20T08:11:19.492243+0000","last_peered":"2024-01-20T08:11:19.492243+0000","last_clean":"2024-01-20T08:11:19.492243+0000","last_became_active":"2024-01-20T08:11:05.267459+0000","last_became_peered":"2024-01-20T08:11:05.267459+0000","last_unstale":"2024-01-20T08:11:19.492243+0000","last_undegraded":"2024-01-20T08:11:19.492243+0000","last_fullsized":"2024-01-20T08:11:19.492243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527051+0000","last_change":"2024-01-20T08:11:20.521530+0000","last_active":"2024-01-20T08:11:20.527051+0000","last_peered":"2024-01-20T08:11:20.527051+0000","last_clean":"2024-01-20T08:11:20.527051+0000","last_became_active":"2024-01-20T08:11:20.521284+0000","last_became_peered":"2024-01-20T08:11:20.521284+0000","last_unstale":"2024-01-20T08:11:20.527051+0000","last_undegraded":"2024-01-20T08:11:20.527051+0000","last_fullsized":"2024-01-20T08:11:20.527051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:36:09.507052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503106+0000","last_change":"2024-01-20T08:11:05.253163+0000","last_active":"2024-01-20T08:11:19.503106+0000","last_peered":"2024-01-20T08:11:19.503106+0000","last_clean":"2024-01-20T08:11:19.503106+0000","last_became_active":"2024-01-20T08:11:05.252357+0000","last_became_peered":"2024-01-20T08:11:05.252357+0000","last_unstale":"2024-01-20T08:11:19.503106+0000","last_undegraded":"2024-01-20T08:11:19.503106+0000","last_fullsized":"2024-01-20T08:11:19.503106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532070+0000","last_change":"2024-01-20T08:11:20.523249+0000","last_active":"2024-01-20T08:11:20.532070+0000","last_peered":"2024-01-20T08:11:20.532070+0000","last_clean":"2024-01-20T08:11:20.532070+0000","last_became_active":"2024-01-20T08:11:20.522977+0000","last_became_peered":"2024-01-20T08:11:20.522977+0000","last_unstale":"2024-01-20T08:11:20.532070+0000","last_undegraded":"2024-01-20T08:11:20.532070+0000","last_fullsized":"2024-01-20T08:11:20.532070+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:48.728633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508993+0000","last_change":"2024-01-20T08:11:05.273526+0000","last_active":"2024-01-20T08:11:19.508993+0000","last_peered":"2024-01-20T08:11:19.508993+0000","last_clean":"2024-01-20T08:11:19.508993+0000","last_became_active":"2024-01-20T08:11:05.273257+0000","last_became_peered":"2024-01-20T08:11:05.273257+0000","last_unstale":"2024-01-20T08:11:19.508993+0000","last_undegraded":"2024-01-20T08:11:19.508993+0000","last_fullsized":"2024-01-20T08:11:19.508993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.522284+0000","last_change":"2024-01-20T08:11:20.516473+0000","last_active":"2024-01-20T08:11:20.522284+0000","last_peered":"2024-01-20T08:11:20.522284+0000","last_clean":"2024-01-20T08:11:20.522284+0000","last_became_active":"2024-01-20T08:11:20.513972+0000","last_became_peered":"2024-01-20T08:11:20.513972+0000","last_unstale":"2024-01-20T08:11:20.522284+0000","last_undegraded":"2024-01-20T08:11:20.522284+0000","last_fullsized":"2024-01-20T08:11:20.522284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:32.825140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495967+0000","last_change":"2024-01-20T08:11:05.274284+0000","last_active":"2024-01-20T08:11:19.495967+0000","last_peered":"2024-01-20T08:11:19.495967+0000","last_clean":"2024-01-20T08:11:19.495967+0000","last_became_active":"2024-01-20T08:11:05.274004+0000","last_became_peered":"2024-01-20T08:11:05.274004+0000","last_unstale":"2024-01-20T08:11:19.495967+0000","last_undegraded":"2024-01-20T08:11:19.495967+0000","last_fullsized":"2024-01-20T08:11:19.495967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511929+0000","last_change":"2024-01-20T08:11:20.509106+0000","last_active":"2024-01-20T08:11:20.511929+0000","last_peered":"2024-01-20T08:11:20.511929+0000","last_clean":"2024-01-20T08:11:20.511929+0000","last_became_active":"2024-01-20T08:11:20.508862+0000","last_became_peered":"2024-01-20T08:11:20.508862+0000","last_unstale":"2024-01-20T08:11:20.511929+0000","last_undegraded":"2024-01-20T08:11:20.511929+0000","last_fullsized":"2024-01-20T08:11:20.511929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:36.228946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496569+0000","last_change":"2024-01-20T08:11:05.257696+0000","last_active":"2024-01-20T08:11:19.496569+0000","last_peered":"2024-01-20T08:11:19.496569+0000","last_clean":"2024-01-20T08:11:19.496569+0000","last_became_active":"2024-01-20T08:11:05.257432+0000","last_became_peered":"2024-01-20T08:11:05.257432+0000","last_unstale":"2024-01-20T08:11:19.496569+0000","last_undegraded":"2024-01-20T08:11:19.496569+0000","last_fullsized":"2024-01-20T08:11:19.496569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:30.491405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.513842+0000","last_change":"2024-01-20T08:11:20.506122+0000","last_active":"2024-01-20T08:11:20.513842+0000","last_peered":"2024-01-20T08:11:20.513842+0000","last_clean":"2024-01-20T08:11:20.513842+0000","last_became_active":"2024-01-20T08:11:20.505841+0000","last_became_peered":"2024-01-20T08:11:20.505841+0000","last_unstale":"2024-01-20T08:11:20.513842+0000","last_undegraded":"2024-01-20T08:11:20.513842+0000","last_fullsized":"2024-01-20T08:11:20.513842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:45.749321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496935+0000","last_change":"2024-01-20T08:11:05.266720+0000","last_active":"2024-01-20T08:11:19.496935+0000","last_peered":"2024-01-20T08:11:19.496935+0000","last_clean":"2024-01-20T08:11:19.496935+0000","last_became_active":"2024-01-20T08:11:05.266340+0000","last_became_peered":"2024-01-20T08:11:05.266340+0000","last_unstale":"2024-01-20T08:11:19.496935+0000","last_undegraded":"2024-01-20T08:11:19.496935+0000","last_fullsized":"2024-01-20T08:11:19.496935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527808+0000","last_change":"2024-01-20T08:11:20.518728+0000","last_active":"2024-01-20T08:11:20.527808+0000","last_peered":"2024-01-20T08:11:20.527808+0000","last_clean":"2024-01-20T08:11:20.527808+0000","last_became_active":"2024-01-20T08:11:20.518395+0000","last_became_peered":"2024-01-20T08:11:20.518395+0000","last_unstale":"2024-01-20T08:11:20.527808+0000","last_undegraded":"2024-01-20T08:11:20.527808+0000","last_fullsized":"2024-01-20T08:11:20.527808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:53.683162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502796+0000","last_change":"2024-01-20T08:11:05.256694+0000","last_active":"2024-01-20T08:11:19.502796+0000","last_peered":"2024-01-20T08:11:19.502796+0000","last_clean":"2024-01-20T08:11:19.502796+0000","last_became_active":"2024-01-20T08:11:05.256285+0000","last_became_peered":"2024-01-20T08:11:05.256285+0000","last_unstale":"2024-01-20T08:11:19.502796+0000","last_undegraded":"2024-01-20T08:11:19.502796+0000","last_fullsized":"2024-01-20T08:11:19.502796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528199+0000","last_change":"2024-01-20T08:11:20.522242+0000","last_active":"2024-01-20T08:11:20.528199+0000","last_peered":"2024-01-20T08:11:20.528199+0000","last_clean":"2024-01-20T08:11:20.528199+0000","last_became_active":"2024-01-20T08:11:20.521953+0000","last_became_peered":"2024-01-20T08:11:20.521953+0000","last_unstale":"2024-01-20T08:11:20.528199+0000","last_undegraded":"2024-01-20T08:11:20.528199+0000","last_fullsized":"2024-01-20T08:11:20.528199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:00:26.570297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.490951+0000","last_change":"2024-01-20T08:11:05.264328+0000","last_active":"2024-01-20T08:11:19.490951+0000","last_peered":"2024-01-20T08:11:19.490951+0000","last_clean":"2024-01-20T08:11:19.490951+0000","last_became_active":"2024-01-20T08:11:05.263991+0000","last_became_peered":"2024-01-20T08:11:05.263991+0000","last_unstale":"2024-01-20T08:11:19.490951+0000","last_undegraded":"2024-01-20T08:11:19.490951+0000","last_fullsized":"2024-01-20T08:11:19.490951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533068+0000","last_change":"2024-01-20T08:11:20.526395+0000","last_active":"2024-01-20T08:11:20.533068+0000","last_peered":"2024-01-20T08:11:20.533068+0000","last_clean":"2024-01-20T08:11:20.533068+0000","last_became_active":"2024-01-20T08:11:20.525799+0000","last_became_peered":"2024-01-20T08:11:20.525799+0000","last_unstale":"2024-01-20T08:11:20.533068+0000","last_undegraded":"2024-01-20T08:11:20.533068+0000","last_fullsized":"2024-01-20T08:11:20.533068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:47.644259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503322+0000","last_change":"2024-01-20T08:11:05.258143+0000","last_active":"2024-01-20T08:11:19.503322+0000","last_peered":"2024-01-20T08:11:19.503322+0000","last_clean":"2024-01-20T08:11:19.503322+0000","last_became_active":"2024-01-20T08:11:05.257144+0000","last_became_peered":"2024-01-20T08:11:05.257144+0000","last_unstale":"2024-01-20T08:11:19.503322+0000","last_undegraded":"2024-01-20T08:11:19.503322+0000","last_fullsized":"2024-01-20T08:11:19.503322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527520+0000","last_change":"2024-01-20T08:11:20.521616+0000","last_active":"2024-01-20T08:11:20.527520+0000","last_peered":"2024-01-20T08:11:20.527520+0000","last_clean":"2024-01-20T08:11:20.527520+0000","last_became_active":"2024-01-20T08:11:20.521045+0000","last_became_peered":"2024-01-20T08:11:20.521045+0000","last_unstale":"2024-01-20T08:11:20.527520+0000","last_undegraded":"2024-01-20T08:11:20.527520+0000","last_fullsized":"2024-01-20T08:11:20.527520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:28.086806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502991+0000","last_change":"2024-01-20T08:11:05.264644+0000","last_active":"2024-01-20T08:11:19.502991+0000","last_peered":"2024-01-20T08:11:19.502991+0000","last_clean":"2024-01-20T08:11:19.502991+0000","last_became_active":"2024-01-20T08:11:05.264067+0000","last_became_peered":"2024-01-20T08:11:05.264067+0000","last_unstale":"2024-01-20T08:11:19.502991+0000","last_undegraded":"2024-01-20T08:11:19.502991+0000","last_fullsized":"2024-01-20T08:11:19.502991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.520351+0000","last_change":"2024-01-20T08:11:20.514912+0000","last_active":"2024-01-20T08:11:20.520351+0000","last_peered":"2024-01-20T08:11:20.520351+0000","last_clean":"2024-01-20T08:11:20.520351+0000","last_became_active":"2024-01-20T08:11:20.514635+0000","last_became_peered":"2024-01-20T08:11:20.514635+0000","last_unstale":"2024-01-20T08:11:20.520351+0000","last_undegraded":"2024-01-20T08:11:20.520351+0000","last_fullsized":"2024-01-20T08:11:20.520351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483037+0000","last_change":"2024-01-20T08:11:05.269680+0000","last_active":"2024-01-20T08:11:19.483037+0000","last_peered":"2024-01-20T08:11:19.483037+0000","last_clean":"2024-01-20T08:11:19.483037+0000","last_became_active":"2024-01-20T08:11:05.269407+0000","last_became_peered":"2024-01-20T08:11:05.269407+0000","last_unstale":"2024-01-20T08:11:19.483037+0000","last_undegraded":"2024-01-20T08:11:19.483037+0000","last_fullsized":"2024-01-20T08:11:19.483037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:57.201071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518554+0000","last_change":"2024-01-20T08:11:20.512382+0000","last_active":"2024-01-20T08:11:20.518554+0000","last_peered":"2024-01-20T08:11:20.518554+0000","last_clean":"2024-01-20T08:11:20.518554+0000","last_became_active":"2024-01-20T08:11:20.512091+0000","last_became_peered":"2024-01-20T08:11:20.512091+0000","last_unstale":"2024-01-20T08:11:20.518554+0000","last_undegraded":"2024-01-20T08:11:20.518554+0000","last_fullsized":"2024-01-20T08:11:20.518554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:27.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488609+0000","last_change":"2024-01-20T08:11:05.261388+0000","last_active":"2024-01-20T08:11:19.488609+0000","last_peered":"2024-01-20T08:11:19.488609+0000","last_clean":"2024-01-20T08:11:19.488609+0000","last_became_active":"2024-01-20T08:11:05.260589+0000","last_became_peered":"2024-01-20T08:11:05.260589+0000","last_unstale":"2024-01-20T08:11:19.488609+0000","last_undegraded":"2024-01-20T08:11:19.488609+0000","last_fullsized":"2024-01-20T08:11:19.488609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:18.546758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.529888+0000","last_change":"2024-01-20T08:11:20.508447+0000","last_active":"2024-01-20T08:11:20.529888+0000","last_peered":"2024-01-20T08:11:20.529888+0000","last_clean":"2024-01-20T08:11:20.529888+0000","last_became_active":"2024-01-20T08:11:20.507819+0000","last_became_peered":"2024-01-20T08:11:20.507819+0000","last_unstale":"2024-01-20T08:11:20.529888+0000","last_undegraded":"2024-01-20T08:11:20.529888+0000","last_fullsized":"2024-01-20T08:11:20.529888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:15.928608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497065+0000","last_change":"2024-01-20T08:11:05.258329+0000","last_active":"2024-01-20T08:11:19.497065+0000","last_peered":"2024-01-20T08:11:19.497065+0000","last_clean":"2024-01-20T08:11:19.497065+0000","last_became_active":"2024-01-20T08:11:05.258043+0000","last_became_peered":"2024-01-20T08:11:05.258043+0000","last_unstale":"2024-01-20T08:11:19.497065+0000","last_undegraded":"2024-01-20T08:11:19.497065+0000","last_fullsized":"2024-01-20T08:11:19.497065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:03.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521860+0000","last_change":"2024-01-20T08:11:20.518238+0000","last_active":"2024-01-20T08:11:20.521860+0000","last_peered":"2024-01-20T08:11:20.521860+0000","last_clean":"2024-01-20T08:11:20.521860+0000","last_became_active":"2024-01-20T08:11:20.513268+0000","last_became_peered":"2024-01-20T08:11:20.513268+0000","last_unstale":"2024-01-20T08:11:20.521860+0000","last_undegraded":"2024-01-20T08:11:20.521860+0000","last_fullsized":"2024-01-20T08:11:20.521860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:34.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496108+0000","last_change":"2024-01-20T08:11:05.271502+0000","last_active":"2024-01-20T08:11:19.496108+0000","last_peered":"2024-01-20T08:11:19.496108+0000","last_clean":"2024-01-20T08:11:19.496108+0000","last_became_active":"2024-01-20T08:11:05.271187+0000","last_became_peered":"2024-01-20T08:11:05.271187+0000","last_unstale":"2024-01-20T08:11:19.496108+0000","last_undegraded":"2024-01-20T08:11:19.496108+0000","last_fullsized":"2024-01-20T08:11:19.496108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516886+0000","last_change":"2024-01-20T08:11:20.511907+0000","last_active":"2024-01-20T08:11:20.516886+0000","last_peered":"2024-01-20T08:11:20.516886+0000","last_clean":"2024-01-20T08:11:20.516886+0000","last_became_active":"2024-01-20T08:11:20.511617+0000","last_became_peered":"2024-01-20T08:11:20.511617+0000","last_unstale":"2024-01-20T08:11:20.516886+0000","last_undegraded":"2024-01-20T08:11:20.516886+0000","last_fullsized":"2024-01-20T08:11:20.516886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496851+0000","last_change":"2024-01-20T08:11:05.276118+0000","last_active":"2024-01-20T08:11:19.496851+0000","last_peered":"2024-01-20T08:11:19.496851+0000","last_clean":"2024-01-20T08:11:19.496851+0000","last_became_active":"2024-01-20T08:11:05.273797+0000","last_became_peered":"2024-01-20T08:11:05.273797+0000","last_unstale":"2024-01-20T08:11:19.496851+0000","last_undegraded":"2024-01-20T08:11:19.496851+0000","last_fullsized":"2024-01-20T08:11:19.496851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532345+0000","last_change":"2024-01-20T08:11:20.524029+0000","last_active":"2024-01-20T08:11:20.532345+0000","last_peered":"2024-01-20T08:11:20.532345+0000","last_clean":"2024-01-20T08:11:20.532345+0000","last_became_active":"2024-01-20T08:11:20.523619+0000","last_became_peered":"2024-01-20T08:11:20.523619+0000","last_unstale":"2024-01-20T08:11:20.532345+0000","last_undegraded":"2024-01-20T08:11:20.532345+0000","last_fullsized":"2024-01-20T08:11:20.532345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:09:14.292319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501311+0000","last_change":"2024-01-20T08:11:05.262066+0000","last_active":"2024-01-20T08:11:19.501311+0000","last_peered":"2024-01-20T08:11:19.501311+0000","last_clean":"2024-01-20T08:11:19.501311+0000","last_became_active":"2024-01-20T08:11:05.261204+0000","last_became_peered":"2024-01-20T08:11:05.261204+0000","last_unstale":"2024-01-20T08:11:19.501311+0000","last_undegraded":"2024-01-20T08:11:19.501311+0000","last_fullsized":"2024-01-20T08:11:19.501311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530844+0000","last_change":"2024-01-20T08:11:20.521797+0000","last_active":"2024-01-20T08:11:20.530844+0000","last_peered":"2024-01-20T08:11:20.530844+0000","last_clean":"2024-01-20T08:11:20.530844+0000","last_became_active":"2024-01-20T08:11:20.516517+0000","last_became_peered":"2024-01-20T08:11:20.516517+0000","last_unstale":"2024-01-20T08:11:20.530844+0000","last_undegraded":"2024-01-20T08:11:20.530844+0000","last_fullsized":"2024-01-20T08:11:20.530844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:53.486046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489293+0000","last_change":"2024-01-20T08:11:05.258558+0000","last_active":"2024-01-20T08:11:19.489293+0000","last_peered":"2024-01-20T08:11:19.489293+0000","last_clean":"2024-01-20T08:11:19.489293+0000","last_became_active":"2024-01-20T08:11:05.253870+0000","last_became_peered":"2024-01-20T08:11:05.253870+0000","last_unstale":"2024-01-20T08:11:19.489293+0000","last_undegraded":"2024-01-20T08:11:19.489293+0000","last_fullsized":"2024-01-20T08:11:19.489293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.525155+0000","last_change":"2024-01-20T08:11:20.520062+0000","last_active":"2024-01-20T08:11:20.525155+0000","last_peered":"2024-01-20T08:11:20.525155+0000","last_clean":"2024-01-20T08:11:20.525155+0000","last_became_active":"2024-01-20T08:11:20.519757+0000","last_became_peered":"2024-01-20T08:11:20.519757+0000","last_unstale":"2024-01-20T08:11:20.525155+0000","last_undegraded":"2024-01-20T08:11:20.525155+0000","last_fullsized":"2024-01-20T08:11:20.525155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:15:26.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482670+0000","last_change":"2024-01-20T08:11:05.259975+0000","last_active":"2024-01-20T08:11:19.482670+0000","last_peered":"2024-01-20T08:11:19.482670+0000","last_clean":"2024-01-20T08:11:19.482670+0000","last_became_active":"2024-01-20T08:11:05.259444+0000","last_became_peered":"2024-01-20T08:11:05.259444+0000","last_unstale":"2024-01-20T08:11:19.482670+0000","last_undegraded":"2024-01-20T08:11:19.482670+0000","last_fullsized":"2024-01-20T08:11:19.482670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:16.912511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528376+0000","last_change":"2024-01-20T08:11:20.521720+0000","last_active":"2024-01-20T08:11:20.528376+0000","last_peered":"2024-01-20T08:11:20.528376+0000","last_clean":"2024-01-20T08:11:20.528376+0000","last_became_active":"2024-01-20T08:11:20.521375+0000","last_became_peered":"2024-01-20T08:11:20.521375+0000","last_unstale":"2024-01-20T08:11:20.528376+0000","last_undegraded":"2024-01-20T08:11:20.528376+0000","last_fullsized":"2024-01-20T08:11:20.528376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:04.489317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508930+0000","last_change":"2024-01-20T08:11:05.267733+0000","last_active":"2024-01-20T08:11:19.508930+0000","last_peered":"2024-01-20T08:11:19.508930+0000","last_clean":"2024-01-20T08:11:19.508930+0000","last_became_active":"2024-01-20T08:11:05.267455+0000","last_became_peered":"2024-01-20T08:11:05.267455+0000","last_unstale":"2024-01-20T08:11:19.508930+0000","last_undegraded":"2024-01-20T08:11:19.508930+0000","last_fullsized":"2024-01-20T08:11:19.508930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516900+0000","last_change":"2024-01-20T08:11:20.510074+0000","last_active":"2024-01-20T08:11:20.516900+0000","last_peered":"2024-01-20T08:11:20.516900+0000","last_clean":"2024-01-20T08:11:20.516900+0000","last_became_active":"2024-01-20T08:11:20.509816+0000","last_became_peered":"2024-01-20T08:11:20.509816+0000","last_unstale":"2024-01-20T08:11:20.516900+0000","last_undegraded":"2024-01-20T08:11:20.516900+0000","last_fullsized":"2024-01-20T08:11:20.516900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:27.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.498014+0000","last_change":"2024-01-20T08:11:05.272142+0000","last_active":"2024-01-20T08:11:19.498014+0000","last_peered":"2024-01-20T08:11:19.498014+0000","last_clean":"2024-01-20T08:11:19.498014+0000","last_became_active":"2024-01-20T08:11:05.271469+0000","last_became_peered":"2024-01-20T08:11:05.271469+0000","last_unstale":"2024-01-20T08:11:19.498014+0000","last_undegraded":"2024-01-20T08:11:19.498014+0000","last_fullsized":"2024-01-20T08:11:19.498014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511946+0000","last_change":"2024-01-20T08:11:20.509870+0000","last_active":"2024-01-20T08:11:20.511946+0000","last_peered":"2024-01-20T08:11:20.511946+0000","last_clean":"2024-01-20T08:11:20.511946+0000","last_became_active":"2024-01-20T08:11:20.509561+0000","last_became_peered":"2024-01-20T08:11:20.509561+0000","last_unstale":"2024-01-20T08:11:20.511946+0000","last_undegraded":"2024-01-20T08:11:20.511946+0000","last_fullsized":"2024-01-20T08:11:20.511946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496419+0000","last_change":"2024-01-20T08:11:05.269484+0000","last_active":"2024-01-20T08:11:19.496419+0000","last_peered":"2024-01-20T08:11:19.496419+0000","last_clean":"2024-01-20T08:11:19.496419+0000","last_became_active":"2024-01-20T08:11:05.269195+0000","last_became_peered":"2024-01-20T08:11:05.269195+0000","last_unstale":"2024-01-20T08:11:19.496419+0000","last_undegraded":"2024-01-20T08:11:19.496419+0000","last_fullsized":"2024-01-20T08:11:19.496419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.517239+0000","last_change":"2024-01-20T08:11:20.511473+0000","last_active":"2024-01-20T08:11:20.517239+0000","last_peered":"2024-01-20T08:11:20.517239+0000","last_clean":"2024-01-20T08:11:20.517239+0000","last_became_active":"2024-01-20T08:11:20.511215+0000","last_became_peered":"2024-01-20T08:11:20.511215+0000","last_unstale":"2024-01-20T08:11:20.517239+0000","last_undegraded":"2024-01-20T08:11:20.517239+0000","last_fullsized":"2024-01-20T08:11:20.517239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505455+0000","last_change":"2024-01-20T08:11:05.263501+0000","last_active":"2024-01-20T08:11:19.505455+0000","last_peered":"2024-01-20T08:11:19.505455+0000","last_clean":"2024-01-20T08:11:19.505455+0000","last_became_active":"2024-01-20T08:11:05.263158+0000","last_became_peered":"2024-01-20T08:11:05.263158+0000","last_unstale":"2024-01-20T08:11:19.505455+0000","last_undegraded":"2024-01-20T08:11:19.505455+0000","last_fullsized":"2024-01-20T08:11:19.505455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534613+0000","last_change":"2024-01-20T08:11:20.531595+0000","last_active":"2024-01-20T08:11:20.534613+0000","last_peered":"2024-01-20T08:11:20.534613+0000","last_clean":"2024-01-20T08:11:20.534613+0000","last_became_active":"2024-01-20T08:11:20.531147+0000","last_became_peered":"2024-01-20T08:11:20.531147+0000","last_unstale":"2024-01-20T08:11:20.534613+0000","last_undegraded":"2024-01-20T08:11:20.534613+0000","last_fullsized":"2024-01-20T08:11:20.534613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:54.913149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495124+0000","last_change":"2024-01-20T08:11:05.266849+0000","last_active":"2024-01-20T08:11:19.495124+0000","last_peered":"2024-01-20T08:11:19.495124+0000","last_clean":"2024-01-20T08:11:19.495124+0000","last_became_active":"2024-01-20T08:11:05.265215+0000","last_became_peered":"2024-01-20T08:11:05.265215+0000","last_unstale":"2024-01-20T08:11:19.495124+0000","last_undegraded":"2024-01-20T08:11:19.495124+0000","last_fullsized":"2024-01-20T08:11:19.495124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516007+0000","last_change":"2024-01-20T08:11:20.511272+0000","last_active":"2024-01-20T08:11:20.516007+0000","last_peered":"2024-01-20T08:11:20.516007+0000","last_clean":"2024-01-20T08:11:20.516007+0000","last_became_active":"2024-01-20T08:11:20.510998+0000","last_became_peered":"2024-01-20T08:11:20.510998+0000","last_unstale":"2024-01-20T08:11:20.516007+0000","last_undegraded":"2024-01-20T08:11:20.516007+0000","last_fullsized":"2024-01-20T08:11:20.516007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.491333+0000","last_change":"2024-01-20T08:11:05.269037+0000","last_active":"2024-01-20T08:11:19.491333+0000","last_peered":"2024-01-20T08:11:19.491333+0000","last_clean":"2024-01-20T08:11:19.491333+0000","last_became_active":"2024-01-20T08:11:05.268712+0000","last_became_peered":"2024-01-20T08:11:05.268712+0000","last_unstale":"2024-01-20T08:11:19.491333+0000","last_undegraded":"2024-01-20T08:11:19.491333+0000","last_fullsized":"2024-01-20T08:11:19.491333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530725+0000","last_change":"2024-01-20T08:11:20.524821+0000","last_active":"2024-01-20T08:11:20.530725+0000","last_peered":"2024-01-20T08:11:20.530725+0000","last_clean":"2024-01-20T08:11:20.530725+0000","last_became_active":"2024-01-20T08:11:20.523879+0000","last_became_peered":"2024-01-20T08:11:20.523879+0000","last_unstale":"2024-01-20T08:11:20.530725+0000","last_undegraded":"2024-01-20T08:11:20.530725+0000","last_fullsized":"2024-01-20T08:11:20.530725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489193+0000","last_change":"2024-01-20T08:11:05.258827+0000","last_active":"2024-01-20T08:11:19.489193+0000","last_peered":"2024-01-20T08:11:19.489193+0000","last_clean":"2024-01-20T08:11:19.489193+0000","last_became_active":"2024-01-20T08:11:05.257441+0000","last_became_peered":"2024-01-20T08:11:05.257441+0000","last_unstale":"2024-01-20T08:11:19.489193+0000","last_undegraded":"2024-01-20T08:11:19.489193+0000","last_fullsized":"2024-01-20T08:11:19.489193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528953+0000","last_change":"2024-01-20T08:11:20.522992+0000","last_active":"2024-01-20T08:11:20.528953+0000","last_peered":"2024-01-20T08:11:20.528953+0000","last_clean":"2024-01-20T08:11:20.528953+0000","last_became_active":"2024-01-20T08:11:20.522730+0000","last_became_peered":"2024-01-20T08:11:20.522730+0000","last_unstale":"2024-01-20T08:11:20.528953+0000","last_undegraded":"2024-01-20T08:11:20.528953+0000","last_fullsized":"2024-01-20T08:11:20.528953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482595+0000","last_change":"2024-01-20T08:11:05.263742+0000","last_active":"2024-01-20T08:11:19.482595+0000","last_peered":"2024-01-20T08:11:19.482595+0000","last_clean":"2024-01-20T08:11:19.482595+0000","last_became_active":"2024-01-20T08:11:05.263437+0000","last_became_peered":"2024-01-20T08:11:05.263437+0000","last_unstale":"2024-01-20T08:11:19.482595+0000","last_undegraded":"2024-01-20T08:11:19.482595+0000","last_fullsized":"2024-01-20T08:11:19.482595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:50.111314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.519604+0000","last_change":"2024-01-20T08:11:20.517677+0000","last_active":"2024-01-20T08:11:20.519604+0000","last_peered":"2024-01-20T08:11:20.519604+0000","last_clean":"2024-01-20T08:11:20.519604+0000","last_became_active":"2024-01-20T08:11:20.517415+0000","last_became_peered":"2024-01-20T08:11:20.517415+0000","last_unstale":"2024-01-20T08:11:20.519604+0000","last_undegraded":"2024-01-20T08:11:20.519604+0000","last_fullsized":"2024-01-20T08:11:20.519604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:31:56.198135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496202+0000","last_change":"2024-01-20T08:11:05.276439+0000","last_active":"2024-01-20T08:11:19.496202+0000","last_peered":"2024-01-20T08:11:19.496202+0000","last_clean":"2024-01-20T08:11:19.496202+0000","last_became_active":"2024-01-20T08:11:05.273677+0000","last_became_peered":"2024-01-20T08:11:05.273677+0000","last_unstale":"2024-01-20T08:11:19.496202+0000","last_undegraded":"2024-01-20T08:11:19.496202+0000","last_fullsized":"2024-01-20T08:11:19.496202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535432+0000","last_change":"2024-01-20T08:11:20.534294+0000","last_active":"2024-01-20T08:11:20.535432+0000","last_peered":"2024-01-20T08:11:20.535432+0000","last_clean":"2024-01-20T08:11:20.535432+0000","last_became_active":"2024-01-20T08:11:20.532430+0000","last_became_peered":"2024-01-20T08:11:20.532430+0000","last_unstale":"2024-01-20T08:11:20.535432+0000","last_undegraded":"2024-01-20T08:11:20.535432+0000","last_fullsized":"2024-01-20T08:11:20.535432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:57.773276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508190+0000","last_change":"2024-01-20T08:11:05.263675+0000","last_active":"2024-01-20T08:11:19.508190+0000","last_peered":"2024-01-20T08:11:19.508190+0000","last_clean":"2024-01-20T08:11:19.508190+0000","last_became_active":"2024-01-20T08:11:05.262876+0000","last_became_peered":"2024-01-20T08:11:05.262876+0000","last_unstale":"2024-01-20T08:11:19.508190+0000","last_undegraded":"2024-01-20T08:11:19.508190+0000","last_fullsized":"2024-01-20T08:11:19.508190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528423+0000","last_change":"2024-01-20T08:11:20.521916+0000","last_active":"2024-01-20T08:11:20.528423+0000","last_peered":"2024-01-20T08:11:20.528423+0000","last_clean":"2024-01-20T08:11:20.528423+0000","last_became_active":"2024-01-20T08:11:20.521458+0000","last_became_peered":"2024-01-20T08:11:20.521458+0000","last_unstale":"2024-01-20T08:11:20.528423+0000","last_undegraded":"2024-01-20T08:11:20.528423+0000","last_fullsized":"2024-01-20T08:11:20.528423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:32.391149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495192+0000","last_change":"2024-01-20T08:11:05.268340+0000","last_active":"2024-01-20T08:11:19.495192+0000","last_peered":"2024-01-20T08:11:19.495192+0000","last_clean":"2024-01-20T08:11:19.495192+0000","last_became_active":"2024-01-20T08:11:05.268008+0000","last_became_peered":"2024-01-20T08:11:05.268008+0000","last_unstale":"2024-01-20T08:11:19.495192+0000","last_undegraded":"2024-01-20T08:11:19.495192+0000","last_fullsized":"2024-01-20T08:11:19.495192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:26.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.519405+0000","last_change":"2024-01-20T08:11:20.509963+0000","last_active":"2024-01-20T08:11:20.519405+0000","last_peered":"2024-01-20T08:11:20.519405+0000","last_clean":"2024-01-20T08:11:20.519405+0000","last_became_active":"2024-01-20T08:11:20.508285+0000","last_became_peered":"2024-01-20T08:11:20.508285+0000","last_unstale":"2024-01-20T08:11:20.519405+0000","last_undegraded":"2024-01-20T08:11:20.519405+0000","last_fullsized":"2024-01-20T08:11:20.519405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513444+0000","last_change":"2024-01-20T08:11:05.275929+0000","last_active":"2024-01-20T08:11:19.513444+0000","last_peered":"2024-01-20T08:11:19.513444+0000","last_clean":"2024-01-20T08:11:19.513444+0000","last_became_active":"2024-01-20T08:11:05.275558+0000","last_became_peered":"2024-01-20T08:11:05.275558+0000","last_unstale":"2024-01-20T08:11:19.513444+0000","last_undegraded":"2024-01-20T08:11:19.513444+0000","last_fullsized":"2024-01-20T08:11:19.513444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1007616,"data_stored":753795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.131},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.5089999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.373},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4419999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.712}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.526},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.623}]},{"osd":5,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.198},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2869999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.579},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.339}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":438272,"data_stored":172258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.621},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.871}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.0960000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.139}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.323},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.377}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.254},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.431}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.93700000000000006}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.3740000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.548}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.206},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.335}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.129}]},{"osd":7,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":163441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1970000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":7.3179999999999996,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.87}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.399}]},{"osd":3,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.248}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.591},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.97899999999999998}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.353},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6379999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.179},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":174737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.2030000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.3480000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.635}]},{"osd":4,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.6080000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.524},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.4390000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.669},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.589}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":2.0859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":172674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.93999999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.995}]},{"osd":3,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.256},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.284},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.161}]},{"osd":6,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.397},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":3.2530000000000001,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.244}]},{"osd":7,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.361}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":166466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.1120000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.995},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.96599999999999997}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.2130000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.252}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1990000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":761372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.105},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.878}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2849999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.133},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.196}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.417}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.353},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.256}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.331},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.3720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:11:24.933 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:11:25.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.176+0000 7fb84de00640 1 Processor -- start 2024-01-20T08:11:25.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.176+0000 7fb84de00640 1 -- start start 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb84de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb848151f40 0x7fb8481551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb84de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb8480c7fb0 0x7fb84806b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb84de00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb848155710 con 0x7fb84806b660 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb84de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb84806bf90 con 0x7fb848151f40 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb84de00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8480c5310 con 0x7fb8480c7fb0 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb846a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb848151f40 0x7fb8481551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb846a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb848151f40 0x7fb8481551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45202/0 (socket says 172.21.15.100:45202) 2024-01-20T08:11:25.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.178+0000 7fb846a00640 1 -- 172.21.15.100:0/80965627 learned_addr learned my addr 172.21.15.100:0/80965627 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.179+0000 7fb846000640 1 --2- 172.21.15.100:0/80965627 >> v2:172.21.15.110:3300/0 conn(0x7fb8480c7fb0 0x7fb84806b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.179+0000 7fb846a00640 1 -- 172.21.15.100:0/80965627 >> v2:172.21.15.110:3300/0 conn(0x7fb8480c7fb0 msgr2=0x7fb84806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.179+0000 7fb846a00640 1 --2- 172.21.15.100:0/80965627 >> v2:172.21.15.110:3300/0 conn(0x7fb8480c7fb0 0x7fb84806b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.179+0000 7fb846a00640 1 -- 172.21.15.100:0/80965627 >> v1:172.21.15.100:6789/0 conn(0x7fb84806b660 legacy=0x7fb8480c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.179+0000 7fb846a00640 1 -- 172.21.15.100:0/80965627 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8480c4ff0 con 0x7fb848151f40 2024-01-20T08:11:25.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.180+0000 7fb846a00640 1 --2- 172.21.15.100:0/80965627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481551d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb8480acc00 tx=0x7fb83802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9911e5dc680613e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.180+0000 7fb845600640 1 -- 172.21.15.100:0/80965627 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83802f850 con 0x7fb848151f40 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb845600640 1 -- 172.21.15.100:0/80965627 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb83802f9b0 con 0x7fb848151f40 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb845600640 1 -- 172.21.15.100:0/80965627 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83802fd40 con 0x7fb848151f40 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 -- 172.21.15.100:0/80965627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 msgr2=0x7fb8481551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 --2- 172.21.15.100:0/80965627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481551d0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb8480acc00 tx=0x7fb83802ba30 comp rx=0 tx=0).stop 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 -- 172.21.15.100:0/80965627 shutdown_connections 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 --2- 172.21.15.100:0/80965627 >> v2:172.21.15.110:3300/0 conn(0x7fb8480c7fb0 0x7fb84806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 --2- 172.21.15.100:0/80965627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481551d0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 -- 172.21.15.100:0/80965627 >> 172.21.15.100:0/80965627 conn(0x7fb8480ca0b0 msgr2=0x7fb8480ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 -- 172.21.15.100:0/80965627 shutdown_connections 2024-01-20T08:11:25.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.181+0000 7fb84de00640 1 -- 172.21.15.100:0/80965627 wait complete. 2024-01-20T08:11:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.183+0000 7fb84de00640 1 Processor -- start 2024-01-20T08:11:25.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.183+0000 7fb84de00640 1 -- start start 2024-01-20T08:11:25.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb84806b660 0x7fb8480aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8480c7fb0 0x7fb8481eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848154440 con 0x7fb848151f40 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb848152fd0 con 0x7fb8480c7fb0 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb84de00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb848153500 con 0x7fb84806b660 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb847400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb847400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45214/0 (socket says 172.21.15.100:45214) 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.184+0000 7fb847400640 1 -- 172.21.15.100:0/126304151 learned_addr learned my addr 172.21.15.100:0/126304151 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb846000640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8480c7fb0 0x7fb8481eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb846a00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb84806b660 0x7fb8480aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 -- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb84806b660 msgr2=0x7fb8480aacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb84806b660 0x7fb8480aacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 -- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8480c7fb0 msgr2=0x7fb8481eb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8480c7fb0 0x7fb8481eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 -- 172.21.15.100:0/126304151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8380094d0 con 0x7fb848151f40 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb847400640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c7a0 tx=0x7fb84000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840003b70 con 0x7fb848151f40 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb840003cf0 con 0x7fb848151f40 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb840003ea0 con 0x7fb848151f40 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.185+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8480ab960 con 0x7fb848151f40 2024-01-20T08:11:25.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.186+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb848153d80 con 0x7fb848151f40 2024-01-20T08:11:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.187+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84804e970 con 0x7fb848151f40 2024-01-20T08:11:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.188+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb84000aa90 con 0x7fb848151f40 2024-01-20T08:11:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.188+0000 7fb83f400640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.189+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb840089780 con 0x7fb848151f40 2024-01-20T08:11:25.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.189+0000 7fb846a00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.189+0000 7fb846a00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 0x7fb82006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb838036000 tx=0x7fb838008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.193+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb8400542e0 con 0x7fb848151f40 2024-01-20T08:11:25.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.382+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb8480c5b90 con 0x7fb82006af00 2024-01-20T08:11:25.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.397+0000 7fb83f400640 1 -- 172.21.15.100:0/126304151 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+524769 (secure 0 0 0) 0x7fb83802fb70 con 0x7fb82006af00 2024-01-20T08:11:25.407 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:25.410 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 msgr2=0x7fb82006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 0x7fb82006d3c0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb838036000 tx=0x7fb838008030 comp rx=0 tx=0).stop 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 msgr2=0x7fb8481eb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb84000c7a0 tx=0x7fb84000cc60 comp rx=0 tx=0).stop 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 shutdown_connections 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb848151f40 0x7fb8481eb6a0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8480c7fb0 0x7fb8481eb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82006af00 0x7fb82006d3c0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 --2- 172.21.15.100:0/126304151 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb84806b660 0x7fb8480aacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 >> 172.21.15.100:0/126304151 conn(0x7fb8480ca0b0 msgr2=0x7fb8480c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:25.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 shutdown_connections 2024-01-20T08:11:25.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.404+0000 7fb84de00640 1 -- 172.21.15.100:0/126304151 wait complete. 2024-01-20T08:11:25.426 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2024-01-20T08:11:23.907725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":250,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":222,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":237348,"kb_used_data":4528,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737372,"statfs":{"total":773094113280,"available":772851068928,"internally_reserved":0,"allocated":4636672,"data_stored":2536455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.451052"},"pg_stats":[{"pgid":"7.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.524972+0000","last_change":"2024-01-20T08:11:20.518593+0000","last_active":"2024-01-20T08:11:20.524972+0000","last_peered":"2024-01-20T08:11:20.524972+0000","last_clean":"2024-01-20T08:11:20.524972+0000","last_became_active":"2024-01-20T08:11:20.518322+0000","last_became_peered":"2024-01-20T08:11:20.518322+0000","last_unstale":"2024-01-20T08:11:20.524972+0000","last_undegraded":"2024-01-20T08:11:20.524972+0000","last_fullsized":"2024-01-20T08:11:20.524972+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:16.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497091+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:11:19.497091+0000","last_peered":"2024-01-20T08:11:19.497091+0000","last_clean":"2024-01-20T08:11:19.497091+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:11:19.497091+0000","last_undegraded":"2024-01-20T08:11:19.497091+0000","last_fullsized":"2024-01-20T08:11:19.497091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.510548+0000","last_change":"2024-01-20T08:11:04.245453+0000","last_active":"2024-01-20T08:11:19.510548+0000","last_peered":"2024-01-20T08:11:19.510548+0000","last_clean":"2024-01-20T08:11:19.510548+0000","last_became_active":"2024-01-20T08:11:04.244780+0000","last_became_peered":"2024-01-20T08:11:04.244780+0000","last_unstale":"2024-01-20T08:11:19.510548+0000","last_undegraded":"2024-01-20T08:11:19.510548+0000","last_fullsized":"2024-01-20T08:11:19.510548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.493546+0000","last_change":"2024-01-20T08:11:05.264816+0000","last_active":"2024-01-20T08:11:19.493546+0000","last_peered":"2024-01-20T08:11:19.493546+0000","last_clean":"2024-01-20T08:11:19.493546+0000","last_became_active":"2024-01-20T08:11:05.264191+0000","last_became_peered":"2024-01-20T08:11:05.264191+0000","last_unstale":"2024-01-20T08:11:19.493546+0000","last_undegraded":"2024-01-20T08:11:19.493546+0000","last_fullsized":"2024-01-20T08:11:19.493546+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533052+0000","last_change":"2024-01-20T08:11:19.517639+0000","last_active":"2024-01-20T08:11:20.533052+0000","last_peered":"2024-01-20T08:11:20.533052+0000","last_clean":"2024-01-20T08:11:20.533052+0000","last_became_active":"2024-01-20T08:11:19.517334+0000","last_became_peered":"2024-01-20T08:11:19.517334+0000","last_unstale":"2024-01-20T08:11:20.533052+0000","last_undegraded":"2024-01-20T08:11:20.533052+0000","last_fullsized":"2024-01-20T08:11:20.533052+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:31.375264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534527+0000","last_change":"2024-01-20T08:11:20.530946+0000","last_active":"2024-01-20T08:11:20.534527+0000","last_peered":"2024-01-20T08:11:20.534527+0000","last_clean":"2024-01-20T08:11:20.534527+0000","last_became_active":"2024-01-20T08:11:20.530691+0000","last_became_peered":"2024-01-20T08:11:20.530691+0000","last_unstale":"2024-01-20T08:11:20.534527+0000","last_undegraded":"2024-01-20T08:11:20.534527+0000","last_fullsized":"2024-01-20T08:11:20.534527+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:40:43.873835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488587+0000","last_change":"2024-01-20T08:11:04.238908+0000","last_active":"2024-01-20T08:11:19.488587+0000","last_peered":"2024-01-20T08:11:19.488587+0000","last_clean":"2024-01-20T08:11:19.488587+0000","last_became_active":"2024-01-20T08:11:04.238633+0000","last_became_peered":"2024-01-20T08:11:04.238633+0000","last_unstale":"2024-01-20T08:11:19.488587+0000","last_undegraded":"2024-01-20T08:11:19.488587+0000","last_fullsized":"2024-01-20T08:11:19.488587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502242+0000","last_change":"2024-01-20T08:11:05.260184+0000","last_active":"2024-01-20T08:11:19.502242+0000","last_peered":"2024-01-20T08:11:19.502242+0000","last_clean":"2024-01-20T08:11:19.502242+0000","last_became_active":"2024-01-20T08:11:05.259912+0000","last_became_peered":"2024-01-20T08:11:05.259912+0000","last_unstale":"2024-01-20T08:11:19.502242+0000","last_undegraded":"2024-01-20T08:11:19.502242+0000","last_fullsized":"2024-01-20T08:11:19.502242+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.495117+0000","last_change":"2024-01-20T08:11:19.507992+0000","last_active":"2024-01-20T08:11:20.495117+0000","last_peered":"2024-01-20T08:11:20.495117+0000","last_clean":"2024-01-20T08:11:20.495117+0000","last_became_active":"2024-01-20T08:11:19.507643+0000","last_became_peered":"2024-01-20T08:11:19.507643+0000","last_unstale":"2024-01-20T08:11:20.495117+0000","last_undegraded":"2024-01-20T08:11:20.495117+0000","last_fullsized":"2024-01-20T08:11:20.495117+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:24.172771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531736+0000","last_change":"2024-01-20T08:11:20.527141+0000","last_active":"2024-01-20T08:11:20.531736+0000","last_peered":"2024-01-20T08:11:20.531736+0000","last_clean":"2024-01-20T08:11:20.531736+0000","last_became_active":"2024-01-20T08:11:20.526852+0000","last_became_peered":"2024-01-20T08:11:20.526852+0000","last_unstale":"2024-01-20T08:11:20.531736+0000","last_undegraded":"2024-01-20T08:11:20.531736+0000","last_fullsized":"2024-01-20T08:11:20.531736+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:29:32.495283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502449+0000","last_change":"2024-01-20T08:11:04.242211+0000","last_active":"2024-01-20T08:11:19.502449+0000","last_peered":"2024-01-20T08:11:19.502449+0000","last_clean":"2024-01-20T08:11:19.502449+0000","last_became_active":"2024-01-20T08:11:04.241913+0000","last_became_peered":"2024-01-20T08:11:04.241913+0000","last_unstale":"2024-01-20T08:11:19.502449+0000","last_undegraded":"2024-01-20T08:11:19.502449+0000","last_fullsized":"2024-01-20T08:11:19.502449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:15.128809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488109+0000","last_change":"2024-01-20T08:11:05.258770+0000","last_active":"2024-01-20T08:11:19.488109+0000","last_peered":"2024-01-20T08:11:19.488109+0000","last_clean":"2024-01-20T08:11:19.488109+0000","last_became_active":"2024-01-20T08:11:05.258482+0000","last_became_peered":"2024-01-20T08:11:05.258482+0000","last_unstale":"2024-01-20T08:11:19.488109+0000","last_undegraded":"2024-01-20T08:11:19.488109+0000","last_fullsized":"2024-01-20T08:11:19.488109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503935+0000","last_change":"2024-01-20T08:11:19.511480+0000","last_active":"2024-01-20T08:11:20.503935+0000","last_peered":"2024-01-20T08:11:20.503935+0000","last_clean":"2024-01-20T08:11:20.503935+0000","last_became_active":"2024-01-20T08:11:19.511221+0000","last_became_peered":"2024-01-20T08:11:19.511221+0000","last_unstale":"2024-01-20T08:11:20.503935+0000","last_undegraded":"2024-01-20T08:11:20.503935+0000","last_fullsized":"2024-01-20T08:11:20.503935+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:52.667277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528319+0000","last_change":"2024-01-20T08:11:20.522922+0000","last_active":"2024-01-20T08:11:20.528319+0000","last_peered":"2024-01-20T08:11:20.528319+0000","last_clean":"2024-01-20T08:11:20.528319+0000","last_became_active":"2024-01-20T08:11:20.522571+0000","last_became_peered":"2024-01-20T08:11:20.522571+0000","last_unstale":"2024-01-20T08:11:20.528319+0000","last_undegraded":"2024-01-20T08:11:20.528319+0000","last_fullsized":"2024-01-20T08:11:20.528319+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:09.652760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495269+0000","last_change":"2024-01-20T08:11:04.236173+0000","last_active":"2024-01-20T08:11:19.495269+0000","last_peered":"2024-01-20T08:11:19.495269+0000","last_clean":"2024-01-20T08:11:19.495269+0000","last_became_active":"2024-01-20T08:11:04.235839+0000","last_became_peered":"2024-01-20T08:11:04.235839+0000","last_unstale":"2024-01-20T08:11:19.495269+0000","last_undegraded":"2024-01-20T08:11:19.495269+0000","last_fullsized":"2024-01-20T08:11:19.495269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494003+0000","last_change":"2024-01-20T08:11:05.267861+0000","last_active":"2024-01-20T08:11:19.494003+0000","last_peered":"2024-01-20T08:11:19.494003+0000","last_clean":"2024-01-20T08:11:19.494003+0000","last_became_active":"2024-01-20T08:11:05.267603+0000","last_became_peered":"2024-01-20T08:11:05.267603+0000","last_unstale":"2024-01-20T08:11:19.494003+0000","last_undegraded":"2024-01-20T08:11:19.494003+0000","last_fullsized":"2024-01-20T08:11:19.494003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.504124+0000","last_change":"2024-01-20T08:11:19.500563+0000","last_active":"2024-01-20T08:11:20.504124+0000","last_peered":"2024-01-20T08:11:20.504124+0000","last_clean":"2024-01-20T08:11:20.504124+0000","last_became_active":"2024-01-20T08:11:19.500310+0000","last_became_peered":"2024-01-20T08:11:19.500310+0000","last_unstale":"2024-01-20T08:11:20.504124+0000","last_undegraded":"2024-01-20T08:11:20.504124+0000","last_fullsized":"2024-01-20T08:11:20.504124+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.743435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518573+0000","last_change":"2024-01-20T08:11:20.515296+0000","last_active":"2024-01-20T08:11:20.518573+0000","last_peered":"2024-01-20T08:11:20.518573+0000","last_clean":"2024-01-20T08:11:20.518573+0000","last_became_active":"2024-01-20T08:11:20.514630+0000","last_became_peered":"2024-01-20T08:11:20.514630+0000","last_unstale":"2024-01-20T08:11:20.518573+0000","last_undegraded":"2024-01-20T08:11:20.518573+0000","last_fullsized":"2024-01-20T08:11:20.518573+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.865344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494396+0000","last_change":"2024-01-20T08:11:04.236506+0000","last_active":"2024-01-20T08:11:19.494396+0000","last_peered":"2024-01-20T08:11:19.494396+0000","last_clean":"2024-01-20T08:11:19.494396+0000","last_became_active":"2024-01-20T08:11:04.235965+0000","last_became_peered":"2024-01-20T08:11:04.235965+0000","last_unstale":"2024-01-20T08:11:19.494396+0000","last_undegraded":"2024-01-20T08:11:19.494396+0000","last_fullsized":"2024-01-20T08:11:19.494396+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509967+0000","last_change":"2024-01-20T08:11:05.273342+0000","last_active":"2024-01-20T08:11:19.509967+0000","last_peered":"2024-01-20T08:11:19.509967+0000","last_clean":"2024-01-20T08:11:19.509967+0000","last_became_active":"2024-01-20T08:11:05.272929+0000","last_became_peered":"2024-01-20T08:11:05.272929+0000","last_unstale":"2024-01-20T08:11:19.509967+0000","last_undegraded":"2024-01-20T08:11:19.509967+0000","last_fullsized":"2024-01-20T08:11:19.509967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.500741+0000","last_change":"2024-01-20T08:11:19.514993+0000","last_active":"2024-01-20T08:11:20.500741+0000","last_peered":"2024-01-20T08:11:20.500741+0000","last_clean":"2024-01-20T08:11:20.500741+0000","last_became_active":"2024-01-20T08:11:19.514761+0000","last_became_peered":"2024-01-20T08:11:19.514761+0000","last_unstale":"2024-01-20T08:11:20.500741+0000","last_undegraded":"2024-01-20T08:11:20.500741+0000","last_fullsized":"2024-01-20T08:11:20.500741+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:18.161134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534288+0000","last_change":"2024-01-20T08:11:20.528627+0000","last_active":"2024-01-20T08:11:20.534288+0000","last_peered":"2024-01-20T08:11:20.534288+0000","last_clean":"2024-01-20T08:11:20.534288+0000","last_became_active":"2024-01-20T08:11:20.528111+0000","last_became_peered":"2024-01-20T08:11:20.528111+0000","last_unstale":"2024-01-20T08:11:20.534288+0000","last_undegraded":"2024-01-20T08:11:20.534288+0000","last_fullsized":"2024-01-20T08:11:20.534288+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:25.188656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495849+0000","last_change":"2024-01-20T08:11:04.228714+0000","last_active":"2024-01-20T08:11:19.495849+0000","last_peered":"2024-01-20T08:11:19.495849+0000","last_clean":"2024-01-20T08:11:19.495849+0000","last_became_active":"2024-01-20T08:11:04.227227+0000","last_became_peered":"2024-01-20T08:11:04.227227+0000","last_unstale":"2024-01-20T08:11:19.495849+0000","last_undegraded":"2024-01-20T08:11:19.495849+0000","last_fullsized":"2024-01-20T08:11:19.495849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.498861+0000","last_change":"2024-01-20T08:11:05.265952+0000","last_active":"2024-01-20T08:11:19.498861+0000","last_peered":"2024-01-20T08:11:19.498861+0000","last_clean":"2024-01-20T08:11:19.498861+0000","last_became_active":"2024-01-20T08:11:05.265641+0000","last_became_peered":"2024-01-20T08:11:05.265641+0000","last_unstale":"2024-01-20T08:11:19.498861+0000","last_undegraded":"2024-01-20T08:11:19.498861+0000","last_fullsized":"2024-01-20T08:11:19.498861+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.505711+0000","last_change":"2024-01-20T08:11:19.511595+0000","last_active":"2024-01-20T08:11:20.505711+0000","last_peered":"2024-01-20T08:11:20.505711+0000","last_clean":"2024-01-20T08:11:20.505711+0000","last_became_active":"2024-01-20T08:11:19.511268+0000","last_became_peered":"2024-01-20T08:11:19.511268+0000","last_unstale":"2024-01-20T08:11:20.505711+0000","last_undegraded":"2024-01-20T08:11:20.505711+0000","last_fullsized":"2024-01-20T08:11:20.505711+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.218836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531178+0000","last_change":"2024-01-20T08:11:20.526794+0000","last_active":"2024-01-20T08:11:20.531178+0000","last_peered":"2024-01-20T08:11:20.531178+0000","last_clean":"2024-01-20T08:11:20.531178+0000","last_became_active":"2024-01-20T08:11:20.526430+0000","last_became_peered":"2024-01-20T08:11:20.526430+0000","last_unstale":"2024-01-20T08:11:20.531178+0000","last_undegraded":"2024-01-20T08:11:20.531178+0000","last_fullsized":"2024-01-20T08:11:20.531178+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501254+0000","last_change":"2024-01-20T08:11:04.229764+0000","last_active":"2024-01-20T08:11:19.501254+0000","last_peered":"2024-01-20T08:11:19.501254+0000","last_clean":"2024-01-20T08:11:19.501254+0000","last_became_active":"2024-01-20T08:11:04.229453+0000","last_became_peered":"2024-01-20T08:11:04.229453+0000","last_unstale":"2024-01-20T08:11:19.501254+0000","last_undegraded":"2024-01-20T08:11:19.501254+0000","last_fullsized":"2024-01-20T08:11:19.501254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506364+0000","last_change":"2024-01-20T08:11:05.269524+0000","last_active":"2024-01-20T08:11:19.506364+0000","last_peered":"2024-01-20T08:11:19.506364+0000","last_clean":"2024-01-20T08:11:19.506364+0000","last_became_active":"2024-01-20T08:11:05.269284+0000","last_became_peered":"2024-01-20T08:11:05.269284+0000","last_unstale":"2024-01-20T08:11:19.506364+0000","last_undegraded":"2024-01-20T08:11:19.506364+0000","last_fullsized":"2024-01-20T08:11:19.506364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:21.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.497462+0000","last_change":"2024-01-20T08:11:19.517890+0000","last_active":"2024-01-20T08:11:20.497462+0000","last_peered":"2024-01-20T08:11:20.497462+0000","last_clean":"2024-01-20T08:11:20.497462+0000","last_became_active":"2024-01-20T08:11:19.517345+0000","last_became_peered":"2024-01-20T08:11:19.517345+0000","last_unstale":"2024-01-20T08:11:20.497462+0000","last_undegraded":"2024-01-20T08:11:20.497462+0000","last_fullsized":"2024-01-20T08:11:20.497462+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:44.733436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521859+0000","last_change":"2024-01-20T08:11:20.514726+0000","last_active":"2024-01-20T08:11:20.521859+0000","last_peered":"2024-01-20T08:11:20.521859+0000","last_clean":"2024-01-20T08:11:20.521859+0000","last_became_active":"2024-01-20T08:11:20.513734+0000","last_became_peered":"2024-01-20T08:11:20.513734+0000","last_unstale":"2024-01-20T08:11:20.521859+0000","last_undegraded":"2024-01-20T08:11:20.521859+0000","last_fullsized":"2024-01-20T08:11:20.521859+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497263+0000","last_change":"2024-01-20T08:11:04.242771+0000","last_active":"2024-01-20T08:11:19.497263+0000","last_peered":"2024-01-20T08:11:19.497263+0000","last_clean":"2024-01-20T08:11:19.497263+0000","last_became_active":"2024-01-20T08:11:04.242500+0000","last_became_peered":"2024-01-20T08:11:04.242500+0000","last_unstale":"2024-01-20T08:11:19.497263+0000","last_undegraded":"2024-01-20T08:11:19.497263+0000","last_fullsized":"2024-01-20T08:11:19.497263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483290+0000","last_change":"2024-01-20T08:11:05.269356+0000","last_active":"2024-01-20T08:11:19.483290+0000","last_peered":"2024-01-20T08:11:19.483290+0000","last_clean":"2024-01-20T08:11:19.483290+0000","last_became_active":"2024-01-20T08:11:05.269074+0000","last_became_peered":"2024-01-20T08:11:05.269074+0000","last_unstale":"2024-01-20T08:11:19.483290+0000","last_undegraded":"2024-01-20T08:11:19.483290+0000","last_fullsized":"2024-01-20T08:11:19.483290+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:28.869363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.505067+0000","last_change":"2024-01-20T08:11:19.519449+0000","last_active":"2024-01-20T08:11:20.505067+0000","last_peered":"2024-01-20T08:11:20.505067+0000","last_clean":"2024-01-20T08:11:20.505067+0000","last_became_active":"2024-01-20T08:11:19.519208+0000","last_became_peered":"2024-01-20T08:11:19.519208+0000","last_unstale":"2024-01-20T08:11:20.505067+0000","last_undegraded":"2024-01-20T08:11:20.505067+0000","last_fullsized":"2024-01-20T08:11:20.505067+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:31.375264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.526706+0000","last_change":"2024-01-20T08:11:20.519860+0000","last_active":"2024-01-20T08:11:20.526706+0000","last_peered":"2024-01-20T08:11:20.526706+0000","last_clean":"2024-01-20T08:11:20.526706+0000","last_became_active":"2024-01-20T08:11:20.519651+0000","last_became_peered":"2024-01-20T08:11:20.519651+0000","last_unstale":"2024-01-20T08:11:20.526706+0000","last_undegraded":"2024-01-20T08:11:20.526706+0000","last_fullsized":"2024-01-20T08:11:20.526706+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502890+0000","last_change":"2024-01-20T08:11:04.243302+0000","last_active":"2024-01-20T08:11:19.502890+0000","last_peered":"2024-01-20T08:11:19.502890+0000","last_clean":"2024-01-20T08:11:19.502890+0000","last_became_active":"2024-01-20T08:11:04.243105+0000","last_became_peered":"2024-01-20T08:11:04.243105+0000","last_unstale":"2024-01-20T08:11:19.502890+0000","last_undegraded":"2024-01-20T08:11:19.502890+0000","last_fullsized":"2024-01-20T08:11:19.502890+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:32.457033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.491337+0000","last_change":"2024-01-20T08:11:05.268170+0000","last_active":"2024-01-20T08:11:19.491337+0000","last_peered":"2024-01-20T08:11:19.491337+0000","last_clean":"2024-01-20T08:11:19.491337+0000","last_became_active":"2024-01-20T08:11:05.267444+0000","last_became_peered":"2024-01-20T08:11:05.267444+0000","last_unstale":"2024-01-20T08:11:19.491337+0000","last_undegraded":"2024-01-20T08:11:19.491337+0000","last_fullsized":"2024-01-20T08:11:19.491337+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.498553+0000","last_change":"2024-01-20T08:11:19.520261+0000","last_active":"2024-01-20T08:11:20.498553+0000","last_peered":"2024-01-20T08:11:20.498553+0000","last_clean":"2024-01-20T08:11:20.498553+0000","last_became_active":"2024-01-20T08:11:19.519362+0000","last_became_peered":"2024-01-20T08:11:19.519362+0000","last_unstale":"2024-01-20T08:11:20.498553+0000","last_undegraded":"2024-01-20T08:11:20.498553+0000","last_fullsized":"2024-01-20T08:11:20.498553+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:52.667277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.537448+0000","last_change":"2024-01-20T08:11:20.534368+0000","last_active":"2024-01-20T08:11:20.537448+0000","last_peered":"2024-01-20T08:11:20.537448+0000","last_clean":"2024-01-20T08:11:20.537448+0000","last_became_active":"2024-01-20T08:11:20.534042+0000","last_became_peered":"2024-01-20T08:11:20.534042+0000","last_unstale":"2024-01-20T08:11:20.537448+0000","last_undegraded":"2024-01-20T08:11:20.537448+0000","last_fullsized":"2024-01-20T08:11:20.537448+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:05:43.595092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502348+0000","last_change":"2024-01-20T08:11:04.236898+0000","last_active":"2024-01-20T08:11:19.502348+0000","last_peered":"2024-01-20T08:11:19.502348+0000","last_clean":"2024-01-20T08:11:19.502348+0000","last_became_active":"2024-01-20T08:11:04.236608+0000","last_became_peered":"2024-01-20T08:11:04.236608+0000","last_unstale":"2024-01-20T08:11:19.502348+0000","last_undegraded":"2024-01-20T08:11:19.502348+0000","last_fullsized":"2024-01-20T08:11:19.502348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:47:19.869135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482350+0000","last_change":"2024-01-20T08:11:05.264028+0000","last_active":"2024-01-20T08:11:19.482350+0000","last_peered":"2024-01-20T08:11:19.482350+0000","last_clean":"2024-01-20T08:11:19.482350+0000","last_became_active":"2024-01-20T08:11:05.263766+0000","last_became_peered":"2024-01-20T08:11:05.263766+0000","last_unstale":"2024-01-20T08:11:19.482350+0000","last_undegraded":"2024-01-20T08:11:19.482350+0000","last_fullsized":"2024-01-20T08:11:19.482350+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:25:23.428838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534759+0000","last_change":"2024-01-20T08:11:19.502054+0000","last_active":"2024-01-20T08:11:20.534759+0000","last_peered":"2024-01-20T08:11:20.534759+0000","last_clean":"2024-01-20T08:11:20.534759+0000","last_became_active":"2024-01-20T08:11:19.501814+0000","last_became_peered":"2024-01-20T08:11:19.501814+0000","last_unstale":"2024-01-20T08:11:20.534759+0000","last_undegraded":"2024-01-20T08:11:20.534759+0000","last_fullsized":"2024-01-20T08:11:20.534759+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:38.514416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516745+0000","last_change":"2024-01-20T08:11:20.508200+0000","last_active":"2024-01-20T08:11:20.516745+0000","last_peered":"2024-01-20T08:11:20.516745+0000","last_clean":"2024-01-20T08:11:20.516745+0000","last_became_active":"2024-01-20T08:11:20.507924+0000","last_became_peered":"2024-01-20T08:11:20.507924+0000","last_unstale":"2024-01-20T08:11:20.516745+0000","last_undegraded":"2024-01-20T08:11:20.516745+0000","last_fullsized":"2024-01-20T08:11:20.516745+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:45.749321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.510146+0000","last_change":"2024-01-20T08:11:04.241959+0000","last_active":"2024-01-20T08:11:19.510146+0000","last_peered":"2024-01-20T08:11:19.510146+0000","last_clean":"2024-01-20T08:11:19.510146+0000","last_became_active":"2024-01-20T08:11:04.241594+0000","last_became_peered":"2024-01-20T08:11:04.241594+0000","last_unstale":"2024-01-20T08:11:19.510146+0000","last_undegraded":"2024-01-20T08:11:19.510146+0000","last_fullsized":"2024-01-20T08:11:19.510146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:55:45.601881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482746+0000","last_change":"2024-01-20T08:11:05.260221+0000","last_active":"2024-01-20T08:11:19.482746+0000","last_peered":"2024-01-20T08:11:19.482746+0000","last_clean":"2024-01-20T08:11:19.482746+0000","last_became_active":"2024-01-20T08:11:05.259763+0000","last_became_peered":"2024-01-20T08:11:05.259763+0000","last_unstale":"2024-01-20T08:11:19.482746+0000","last_undegraded":"2024-01-20T08:11:19.482746+0000","last_fullsized":"2024-01-20T08:11:19.482746+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:10.892290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511265+0000","last_change":"2024-01-20T08:11:19.506267+0000","last_active":"2024-01-20T08:11:20.511265+0000","last_peered":"2024-01-20T08:11:20.511265+0000","last_clean":"2024-01-20T08:11:20.511265+0000","last_became_active":"2024-01-20T08:11:19.505966+0000","last_became_peered":"2024-01-20T08:11:19.505966+0000","last_unstale":"2024-01-20T08:11:20.511265+0000","last_undegraded":"2024-01-20T08:11:20.511265+0000","last_fullsized":"2024-01-20T08:11:20.511265+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:35.213061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532934+0000","last_change":"2024-01-20T08:11:20.525846+0000","last_active":"2024-01-20T08:11:20.532934+0000","last_peered":"2024-01-20T08:11:20.532934+0000","last_clean":"2024-01-20T08:11:20.532934+0000","last_became_active":"2024-01-20T08:11:20.525585+0000","last_became_peered":"2024-01-20T08:11:20.525585+0000","last_unstale":"2024-01-20T08:11:20.532934+0000","last_undegraded":"2024-01-20T08:11:20.532934+0000","last_fullsized":"2024-01-20T08:11:20.532934+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:35.296495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494240+0000","last_change":"2024-01-20T08:11:04.234512+0000","last_active":"2024-01-20T08:11:19.494240+0000","last_peered":"2024-01-20T08:11:19.494240+0000","last_clean":"2024-01-20T08:11:19.494240+0000","last_became_active":"2024-01-20T08:11:04.234175+0000","last_became_peered":"2024-01-20T08:11:04.234175+0000","last_unstale":"2024-01-20T08:11:19.494240+0000","last_undegraded":"2024-01-20T08:11:19.494240+0000","last_fullsized":"2024-01-20T08:11:19.494240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:49.247999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482632+0000","last_change":"2024-01-20T08:11:05.246307+0000","last_active":"2024-01-20T08:11:19.482632+0000","last_peered":"2024-01-20T08:11:19.482632+0000","last_clean":"2024-01-20T08:11:19.482632+0000","last_became_active":"2024-01-20T08:11:05.245686+0000","last_became_peered":"2024-01-20T08:11:05.245686+0000","last_unstale":"2024-01-20T08:11:19.482632+0000","last_undegraded":"2024-01-20T08:11:19.482632+0000","last_fullsized":"2024-01-20T08:11:19.482632+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:46:31.071864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.496532+0000","last_change":"2024-01-20T08:11:19.505831+0000","last_active":"2024-01-20T08:11:20.496532+0000","last_peered":"2024-01-20T08:11:20.496532+0000","last_clean":"2024-01-20T08:11:20.496532+0000","last_became_active":"2024-01-20T08:11:19.505546+0000","last_became_peered":"2024-01-20T08:11:19.505546+0000","last_unstale":"2024-01-20T08:11:20.496532+0000","last_undegraded":"2024-01-20T08:11:20.496532+0000","last_fullsized":"2024-01-20T08:11:20.496532+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:46.628374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528535+0000","last_change":"2024-01-20T08:11:20.522690+0000","last_active":"2024-01-20T08:11:20.528535+0000","last_peered":"2024-01-20T08:11:20.528535+0000","last_clean":"2024-01-20T08:11:20.528535+0000","last_became_active":"2024-01-20T08:11:20.522344+0000","last_became_peered":"2024-01-20T08:11:20.522344+0000","last_unstale":"2024-01-20T08:11:20.528535+0000","last_undegraded":"2024-01-20T08:11:20.528535+0000","last_fullsized":"2024-01-20T08:11:20.528535+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:36.228946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503073+0000","last_change":"2024-01-20T08:11:04.231418+0000","last_active":"2024-01-20T08:11:19.503073+0000","last_peered":"2024-01-20T08:11:19.503073+0000","last_clean":"2024-01-20T08:11:19.503073+0000","last_became_active":"2024-01-20T08:11:04.231150+0000","last_became_peered":"2024-01-20T08:11:04.231150+0000","last_unstale":"2024-01-20T08:11:19.503073+0000","last_undegraded":"2024-01-20T08:11:19.503073+0000","last_fullsized":"2024-01-20T08:11:19.503073+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:56.187386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483278+0000","last_change":"2024-01-20T08:11:05.256215+0000","last_active":"2024-01-20T08:11:19.483278+0000","last_peered":"2024-01-20T08:11:19.483278+0000","last_clean":"2024-01-20T08:11:19.483278+0000","last_became_active":"2024-01-20T08:11:05.255935+0000","last_became_peered":"2024-01-20T08:11:05.255935+0000","last_unstale":"2024-01-20T08:11:19.483278+0000","last_undegraded":"2024-01-20T08:11:19.483278+0000","last_fullsized":"2024-01-20T08:11:19.483278+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:58.356059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531321+0000","last_change":"2024-01-20T08:11:19.508493+0000","last_active":"2024-01-20T08:11:20.531321+0000","last_peered":"2024-01-20T08:11:20.531321+0000","last_clean":"2024-01-20T08:11:20.531321+0000","last_became_active":"2024-01-20T08:11:19.507808+0000","last_became_peered":"2024-01-20T08:11:19.507808+0000","last_unstale":"2024-01-20T08:11:20.531321+0000","last_undegraded":"2024-01-20T08:11:20.531321+0000","last_fullsized":"2024-01-20T08:11:20.531321+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:35.743435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527424+0000","last_change":"2024-01-20T08:11:20.513456+0000","last_active":"2024-01-20T08:11:20.527424+0000","last_peered":"2024-01-20T08:11:20.527424+0000","last_clean":"2024-01-20T08:11:20.527424+0000","last_became_active":"2024-01-20T08:11:20.513073+0000","last_became_peered":"2024-01-20T08:11:20.513073+0000","last_unstale":"2024-01-20T08:11:20.527424+0000","last_undegraded":"2024-01-20T08:11:20.527424+0000","last_fullsized":"2024-01-20T08:11:20.527424+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:20:10.790945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505029+0000","last_change":"2024-01-20T08:11:04.228172+0000","last_active":"2024-01-20T08:11:19.505029+0000","last_peered":"2024-01-20T08:11:19.505029+0000","last_clean":"2024-01-20T08:11:19.505029+0000","last_became_active":"2024-01-20T08:11:04.227839+0000","last_became_peered":"2024-01-20T08:11:04.227839+0000","last_unstale":"2024-01-20T08:11:19.505029+0000","last_undegraded":"2024-01-20T08:11:19.505029+0000","last_fullsized":"2024-01-20T08:11:19.505029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:04:09.878605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495612+0000","last_change":"2024-01-20T08:11:05.273938+0000","last_active":"2024-01-20T08:11:19.495612+0000","last_peered":"2024-01-20T08:11:19.495612+0000","last_clean":"2024-01-20T08:11:19.495612+0000","last_became_active":"2024-01-20T08:11:05.273244+0000","last_became_peered":"2024-01-20T08:11:05.273244+0000","last_unstale":"2024-01-20T08:11:19.495612+0000","last_undegraded":"2024-01-20T08:11:19.495612+0000","last_fullsized":"2024-01-20T08:11:19.495612+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532019+0000","last_change":"2024-01-20T08:11:19.499561+0000","last_active":"2024-01-20T08:11:20.532019+0000","last_peered":"2024-01-20T08:11:20.532019+0000","last_clean":"2024-01-20T08:11:20.532019+0000","last_became_active":"2024-01-20T08:11:19.499261+0000","last_became_peered":"2024-01-20T08:11:19.499261+0000","last_unstale":"2024-01-20T08:11:20.532019+0000","last_undegraded":"2024-01-20T08:11:20.532019+0000","last_fullsized":"2024-01-20T08:11:20.532019+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:18:02.072306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527363+0000","last_change":"2024-01-20T08:11:20.521231+0000","last_active":"2024-01-20T08:11:20.527363+0000","last_peered":"2024-01-20T08:11:20.527363+0000","last_clean":"2024-01-20T08:11:20.527363+0000","last_became_active":"2024-01-20T08:11:20.518559+0000","last_became_peered":"2024-01-20T08:11:20.518559+0000","last_unstale":"2024-01-20T08:11:20.527363+0000","last_undegraded":"2024-01-20T08:11:20.527363+0000","last_fullsized":"2024-01-20T08:11:20.527363+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:07.572579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506418+0000","last_change":"2024-01-20T08:11:04.240349+0000","last_active":"2024-01-20T08:11:19.506418+0000","last_peered":"2024-01-20T08:11:19.506418+0000","last_clean":"2024-01-20T08:11:19.506418+0000","last_became_active":"2024-01-20T08:11:04.240032+0000","last_became_peered":"2024-01-20T08:11:04.240032+0000","last_unstale":"2024-01-20T08:11:19.506418+0000","last_undegraded":"2024-01-20T08:11:19.506418+0000","last_fullsized":"2024-01-20T08:11:19.506418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:27:52.299223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.506281+0000","last_change":"2024-01-20T08:11:05.254371+0000","last_active":"2024-01-20T08:11:19.506281+0000","last_peered":"2024-01-20T08:11:19.506281+0000","last_clean":"2024-01-20T08:11:19.506281+0000","last_became_active":"2024-01-20T08:11:05.253911+0000","last_became_peered":"2024-01-20T08:11:05.253911+0000","last_unstale":"2024-01-20T08:11:19.506281+0000","last_undegraded":"2024-01-20T08:11:19.506281+0000","last_fullsized":"2024-01-20T08:11:19.506281+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:18.546758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.510984+0000","last_change":"2024-01-20T08:11:19.515934+0000","last_active":"2024-01-20T08:11:20.510984+0000","last_peered":"2024-01-20T08:11:20.510984+0000","last_clean":"2024-01-20T08:11:20.510984+0000","last_became_active":"2024-01-20T08:11:19.515687+0000","last_became_peered":"2024-01-20T08:11:19.515687+0000","last_unstale":"2024-01-20T08:11:20.510984+0000","last_undegraded":"2024-01-20T08:11:20.510984+0000","last_fullsized":"2024-01-20T08:11:20.510984+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:23:47.145480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532822+0000","last_change":"2024-01-20T08:11:20.525253+0000","last_active":"2024-01-20T08:11:20.532822+0000","last_peered":"2024-01-20T08:11:20.532822+0000","last_clean":"2024-01-20T08:11:20.532822+0000","last_became_active":"2024-01-20T08:11:20.524929+0000","last_became_peered":"2024-01-20T08:11:20.524929+0000","last_unstale":"2024-01-20T08:11:20.532822+0000","last_undegraded":"2024-01-20T08:11:20.532822+0000","last_fullsized":"2024-01-20T08:11:20.532822+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:40.801450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497077+0000","last_change":"2024-01-20T08:11:04.241452+0000","last_active":"2024-01-20T08:11:19.497077+0000","last_peered":"2024-01-20T08:11:19.497077+0000","last_clean":"2024-01-20T08:11:19.497077+0000","last_became_active":"2024-01-20T08:11:04.240981+0000","last_became_peered":"2024-01-20T08:11:04.240981+0000","last_unstale":"2024-01-20T08:11:19.497077+0000","last_undegraded":"2024-01-20T08:11:19.497077+0000","last_fullsized":"2024-01-20T08:11:19.497077+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505835+0000","last_change":"2024-01-20T08:11:05.269731+0000","last_active":"2024-01-20T08:11:19.505835+0000","last_peered":"2024-01-20T08:11:19.505835+0000","last_clean":"2024-01-20T08:11:19.505835+0000","last_became_active":"2024-01-20T08:11:05.269500+0000","last_became_peered":"2024-01-20T08:11:05.269500+0000","last_unstale":"2024-01-20T08:11:19.505835+0000","last_undegraded":"2024-01-20T08:11:19.505835+0000","last_fullsized":"2024-01-20T08:11:19.505835+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:12:50.834244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533844+0000","last_change":"2024-01-20T08:11:19.514268+0000","last_active":"2024-01-20T08:11:20.533844+0000","last_peered":"2024-01-20T08:11:20.533844+0000","last_clean":"2024-01-20T08:11:20.533844+0000","last_became_active":"2024-01-20T08:11:19.513969+0000","last_became_peered":"2024-01-20T08:11:19.513969+0000","last_unstale":"2024-01-20T08:11:20.533844+0000","last_undegraded":"2024-01-20T08:11:20.533844+0000","last_fullsized":"2024-01-20T08:11:20.533844+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:03.473432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521748+0000","last_change":"2024-01-20T08:11:20.515344+0000","last_active":"2024-01-20T08:11:20.521748+0000","last_peered":"2024-01-20T08:11:20.521748+0000","last_clean":"2024-01-20T08:11:20.521748+0000","last_became_active":"2024-01-20T08:11:20.515050+0000","last_became_peered":"2024-01-20T08:11:20.515050+0000","last_unstale":"2024-01-20T08:11:20.521748+0000","last_undegraded":"2024-01-20T08:11:20.521748+0000","last_fullsized":"2024-01-20T08:11:20.521748+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:09.652760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488494+0000","last_change":"2024-01-20T08:11:04.231466+0000","last_active":"2024-01-20T08:11:19.488494+0000","last_peered":"2024-01-20T08:11:19.488494+0000","last_clean":"2024-01-20T08:11:19.488494+0000","last_became_active":"2024-01-20T08:11:04.231224+0000","last_became_peered":"2024-01-20T08:11:04.231224+0000","last_unstale":"2024-01-20T08:11:19.488494+0000","last_undegraded":"2024-01-20T08:11:19.488494+0000","last_fullsized":"2024-01-20T08:11:19.488494+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:54.519344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509766+0000","last_change":"2024-01-20T08:11:05.266758+0000","last_active":"2024-01-20T08:11:19.509766+0000","last_peered":"2024-01-20T08:11:19.509766+0000","last_clean":"2024-01-20T08:11:19.509766+0000","last_became_active":"2024-01-20T08:11:05.265820+0000","last_became_peered":"2024-01-20T08:11:05.265820+0000","last_unstale":"2024-01-20T08:11:19.509766+0000","last_undegraded":"2024-01-20T08:11:19.509766+0000","last_fullsized":"2024-01-20T08:11:19.509766+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503587+0000","last_change":"2024-01-20T08:11:19.507738+0000","last_active":"2024-01-20T08:11:20.503587+0000","last_peered":"2024-01-20T08:11:20.503587+0000","last_clean":"2024-01-20T08:11:20.503587+0000","last_became_active":"2024-01-20T08:11:19.503990+0000","last_became_peered":"2024-01-20T08:11:19.503990+0000","last_unstale":"2024-01-20T08:11:20.503587+0000","last_undegraded":"2024-01-20T08:11:20.503587+0000","last_fullsized":"2024-01-20T08:11:20.503587+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:08.636875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535685+0000","last_change":"2024-01-20T08:11:20.529671+0000","last_active":"2024-01-20T08:11:20.535685+0000","last_peered":"2024-01-20T08:11:20.535685+0000","last_clean":"2024-01-20T08:11:20.535685+0000","last_became_active":"2024-01-20T08:11:20.529204+0000","last_became_peered":"2024-01-20T08:11:20.529204+0000","last_unstale":"2024-01-20T08:11:20.535685+0000","last_undegraded":"2024-01-20T08:11:20.535685+0000","last_fullsized":"2024-01-20T08:11:20.535685+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:33.804674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489948+0000","last_change":"2024-01-20T08:11:04.238160+0000","last_active":"2024-01-20T08:11:19.489948+0000","last_peered":"2024-01-20T08:11:19.489948+0000","last_clean":"2024-01-20T08:11:19.489948+0000","last_became_active":"2024-01-20T08:11:04.237860+0000","last_became_peered":"2024-01-20T08:11:04.237860+0000","last_unstale":"2024-01-20T08:11:19.489948+0000","last_undegraded":"2024-01-20T08:11:19.489948+0000","last_fullsized":"2024-01-20T08:11:19.489948+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:43.455193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495562+0000","last_change":"2024-01-20T08:11:05.263329+0000","last_active":"2024-01-20T08:11:19.495562+0000","last_peered":"2024-01-20T08:11:19.495562+0000","last_clean":"2024-01-20T08:11:19.495562+0000","last_became_active":"2024-01-20T08:11:05.263049+0000","last_became_peered":"2024-01-20T08:11:05.263049+0000","last_unstale":"2024-01-20T08:11:19.495562+0000","last_undegraded":"2024-01-20T08:11:19.495562+0000","last_fullsized":"2024-01-20T08:11:19.495562+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532861+0000","last_change":"2024-01-20T08:11:19.501883+0000","last_active":"2024-01-20T08:11:20.532861+0000","last_peered":"2024-01-20T08:11:20.532861+0000","last_clean":"2024-01-20T08:11:20.532861+0000","last_became_active":"2024-01-20T08:11:19.501685+0000","last_became_peered":"2024-01-20T08:11:19.501685+0000","last_unstale":"2024-01-20T08:11:20.532861+0000","last_undegraded":"2024-01-20T08:11:20.532861+0000","last_fullsized":"2024-01-20T08:11:20.532861+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:45:23.335652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533688+0000","last_change":"2024-01-20T08:11:20.526427+0000","last_active":"2024-01-20T08:11:20.533688+0000","last_peered":"2024-01-20T08:11:20.533688+0000","last_clean":"2024-01-20T08:11:20.533688+0000","last_became_active":"2024-01-20T08:11:20.523704+0000","last_became_peered":"2024-01-20T08:11:20.523704+0000","last_unstale":"2024-01-20T08:11:20.533688+0000","last_undegraded":"2024-01-20T08:11:20.533688+0000","last_fullsized":"2024-01-20T08:11:20.533688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:31:56.198135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495200+0000","last_change":"2024-01-20T08:11:04.240412+0000","last_active":"2024-01-20T08:11:19.495200+0000","last_peered":"2024-01-20T08:11:19.495200+0000","last_clean":"2024-01-20T08:11:19.495200+0000","last_became_active":"2024-01-20T08:11:04.240045+0000","last_became_peered":"2024-01-20T08:11:04.240045+0000","last_unstale":"2024-01-20T08:11:19.495200+0000","last_undegraded":"2024-01-20T08:11:19.495200+0000","last_fullsized":"2024-01-20T08:11:19.495200+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:59.657008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494100+0000","last_change":"2024-01-20T08:11:05.262683+0000","last_active":"2024-01-20T08:11:19.494100+0000","last_peered":"2024-01-20T08:11:19.494100+0000","last_clean":"2024-01-20T08:11:19.494100+0000","last_became_active":"2024-01-20T08:11:05.259731+0000","last_became_peered":"2024-01-20T08:11:05.259731+0000","last_unstale":"2024-01-20T08:11:19.494100+0000","last_undegraded":"2024-01-20T08:11:19.494100+0000","last_fullsized":"2024-01-20T08:11:19.494100+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'8","reported_seq":19,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534100+0000","last_change":"2024-01-20T08:11:19.509955+0000","last_active":"2024-01-20T08:11:20.534100+0000","last_peered":"2024-01-20T08:11:20.534100+0000","last_clean":"2024-01-20T08:11:20.534100+0000","last_became_active":"2024-01-20T08:11:19.509300+0000","last_became_peered":"2024-01-20T08:11:19.509300+0000","last_unstale":"2024-01-20T08:11:20.534100+0000","last_undegraded":"2024-01-20T08:11:20.534100+0000","last_fullsized":"2024-01-20T08:11:20.534100+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:32.788789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533497+0000","last_change":"2024-01-20T08:11:20.529400+0000","last_active":"2024-01-20T08:11:20.533497+0000","last_peered":"2024-01-20T08:11:20.533497+0000","last_clean":"2024-01-20T08:11:20.533497+0000","last_became_active":"2024-01-20T08:11:20.529154+0000","last_became_peered":"2024-01-20T08:11:20.529154+0000","last_unstale":"2024-01-20T08:11:20.533497+0000","last_undegraded":"2024-01-20T08:11:20.533497+0000","last_fullsized":"2024-01-20T08:11:20.533497+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:23.855964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503273+0000","last_change":"2024-01-20T08:11:04.239053+0000","last_active":"2024-01-20T08:11:19.503273+0000","last_peered":"2024-01-20T08:11:19.503273+0000","last_clean":"2024-01-20T08:11:19.503273+0000","last_became_active":"2024-01-20T08:11:04.238709+0000","last_became_peered":"2024-01-20T08:11:04.238709+0000","last_unstale":"2024-01-20T08:11:19.503273+0000","last_undegraded":"2024-01-20T08:11:19.503273+0000","last_fullsized":"2024-01-20T08:11:19.503273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:27.855678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495111+0000","last_change":"2024-01-20T08:11:05.277996+0000","last_active":"2024-01-20T08:11:19.495111+0000","last_peered":"2024-01-20T08:11:19.495111+0000","last_clean":"2024-01-20T08:11:19.495111+0000","last_became_active":"2024-01-20T08:11:05.277744+0000","last_became_peered":"2024-01-20T08:11:05.277744+0000","last_unstale":"2024-01-20T08:11:19.495111+0000","last_undegraded":"2024-01-20T08:11:19.495111+0000","last_fullsized":"2024-01-20T08:11:19.495111+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.509223+0000","last_change":"2024-01-20T08:11:19.501251+0000","last_active":"2024-01-20T08:11:20.509223+0000","last_peered":"2024-01-20T08:11:20.509223+0000","last_clean":"2024-01-20T08:11:20.509223+0000","last_became_active":"2024-01-20T08:11:19.500967+0000","last_became_peered":"2024-01-20T08:11:19.500967+0000","last_unstale":"2024-01-20T08:11:20.509223+0000","last_undegraded":"2024-01-20T08:11:20.509223+0000","last_fullsized":"2024-01-20T08:11:20.509223+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:44.685127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535928+0000","last_change":"2024-01-20T08:11:20.534882+0000","last_active":"2024-01-20T08:11:20.535928+0000","last_peered":"2024-01-20T08:11:20.535928+0000","last_clean":"2024-01-20T08:11:20.535928+0000","last_became_active":"2024-01-20T08:11:20.532433+0000","last_became_peered":"2024-01-20T08:11:20.532433+0000","last_unstale":"2024-01-20T08:11:20.535928+0000","last_undegraded":"2024-01-20T08:11:20.535928+0000","last_fullsized":"2024-01-20T08:11:20.535928+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:36.234721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"34'8","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489329+0000","last_change":"2024-01-20T08:11:04.229958+0000","last_active":"2024-01-20T08:11:19.489329+0000","last_peered":"2024-01-20T08:11:19.489329+0000","last_clean":"2024-01-20T08:11:19.489329+0000","last_became_active":"2024-01-20T08:11:04.229708+0000","last_became_peered":"2024-01-20T08:11:04.229708+0000","last_unstale":"2024-01-20T08:11:19.489329+0000","last_undegraded":"2024-01-20T08:11:19.489329+0000","last_fullsized":"2024-01-20T08:11:19.489329+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:19.024894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508085+0000","last_change":"2024-01-20T08:11:05.264063+0000","last_active":"2024-01-20T08:11:19.508085+0000","last_peered":"2024-01-20T08:11:19.508085+0000","last_clean":"2024-01-20T08:11:19.508085+0000","last_became_active":"2024-01-20T08:11:05.263343+0000","last_became_peered":"2024-01-20T08:11:05.263343+0000","last_unstale":"2024-01-20T08:11:19.508085+0000","last_undegraded":"2024-01-20T08:11:19.508085+0000","last_fullsized":"2024-01-20T08:11:19.508085+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.503909+0000","last_change":"2024-01-20T08:11:19.503318+0000","last_active":"2024-01-20T08:11:20.503909+0000","last_peered":"2024-01-20T08:11:20.503909+0000","last_clean":"2024-01-20T08:11:20.503909+0000","last_became_active":"2024-01-20T08:11:19.503051+0000","last_became_peered":"2024-01-20T08:11:19.503051+0000","last_unstale":"2024-01-20T08:11:20.503909+0000","last_undegraded":"2024-01-20T08:11:20.503909+0000","last_fullsized":"2024-01-20T08:11:20.503909+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:24.172771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518850+0000","last_change":"2024-01-20T08:11:20.512137+0000","last_active":"2024-01-20T08:11:20.518850+0000","last_peered":"2024-01-20T08:11:20.518850+0000","last_clean":"2024-01-20T08:11:20.518850+0000","last_became_active":"2024-01-20T08:11:20.511819+0000","last_became_peered":"2024-01-20T08:11:20.511819+0000","last_unstale":"2024-01-20T08:11:20.518850+0000","last_undegraded":"2024-01-20T08:11:20.518850+0000","last_fullsized":"2024-01-20T08:11:20.518850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:19.177019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508295+0000","last_change":"2024-01-20T08:11:04.240118+0000","last_active":"2024-01-20T08:11:19.508295+0000","last_peered":"2024-01-20T08:11:19.508295+0000","last_clean":"2024-01-20T08:11:19.508295+0000","last_became_active":"2024-01-20T08:11:04.239850+0000","last_became_peered":"2024-01-20T08:11:04.239850+0000","last_unstale":"2024-01-20T08:11:19.508295+0000","last_undegraded":"2024-01-20T08:11:19.508295+0000","last_fullsized":"2024-01-20T08:11:19.508295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489239+0000","last_change":"2024-01-20T08:11:05.254926+0000","last_active":"2024-01-20T08:11:19.489239+0000","last_peered":"2024-01-20T08:11:19.489239+0000","last_clean":"2024-01-20T08:11:19.489239+0000","last_became_active":"2024-01-20T08:11:05.254655+0000","last_became_peered":"2024-01-20T08:11:05.254655+0000","last_unstale":"2024-01-20T08:11:19.489239+0000","last_undegraded":"2024-01-20T08:11:19.489239+0000","last_fullsized":"2024-01-20T08:11:19.489239+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.504676+0000","last_change":"2024-01-20T08:11:19.511788+0000","last_active":"2024-01-20T08:11:20.504676+0000","last_peered":"2024-01-20T08:11:20.504676+0000","last_clean":"2024-01-20T08:11:20.504676+0000","last_became_active":"2024-01-20T08:11:19.511467+0000","last_became_peered":"2024-01-20T08:11:19.511467+0000","last_unstale":"2024-01-20T08:11:20.504676+0000","last_undegraded":"2024-01-20T08:11:20.504676+0000","last_fullsized":"2024-01-20T08:11:20.504676+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:32.788789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531198+0000","last_change":"2024-01-20T08:11:20.527045+0000","last_active":"2024-01-20T08:11:20.531198+0000","last_peered":"2024-01-20T08:11:20.531198+0000","last_clean":"2024-01-20T08:11:20.531198+0000","last_became_active":"2024-01-20T08:11:20.524157+0000","last_became_peered":"2024-01-20T08:11:20.524157+0000","last_unstale":"2024-01-20T08:11:20.531198+0000","last_undegraded":"2024-01-20T08:11:20.531198+0000","last_fullsized":"2024-01-20T08:11:20.531198+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.865344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501185+0000","last_change":"2024-01-20T08:11:04.231597+0000","last_active":"2024-01-20T08:11:19.501185+0000","last_peered":"2024-01-20T08:11:19.501185+0000","last_clean":"2024-01-20T08:11:19.501185+0000","last_became_active":"2024-01-20T08:11:04.231265+0000","last_became_peered":"2024-01-20T08:11:04.231265+0000","last_unstale":"2024-01-20T08:11:19.501185+0000","last_undegraded":"2024-01-20T08:11:19.501185+0000","last_fullsized":"2024-01-20T08:11:19.501185+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:09.222397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489200+0000","last_change":"2024-01-20T08:11:05.271640+0000","last_active":"2024-01-20T08:11:19.489200+0000","last_peered":"2024-01-20T08:11:19.489200+0000","last_clean":"2024-01-20T08:11:19.489200+0000","last_became_active":"2024-01-20T08:11:05.271380+0000","last_became_peered":"2024-01-20T08:11:05.271380+0000","last_unstale":"2024-01-20T08:11:19.489200+0000","last_undegraded":"2024-01-20T08:11:19.489200+0000","last_fullsized":"2024-01-20T08:11:19.489200+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:51:21.501404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"37'6","reported_seq":17,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.538318+0000","last_change":"2024-01-20T08:11:19.505147+0000","last_active":"2024-01-20T08:11:20.538318+0000","last_peered":"2024-01-20T08:11:20.538318+0000","last_clean":"2024-01-20T08:11:20.538318+0000","last_became_active":"2024-01-20T08:11:19.504675+0000","last_became_peered":"2024-01-20T08:11:19.504675+0000","last_unstale":"2024-01-20T08:11:20.538318+0000","last_undegraded":"2024-01-20T08:11:20.538318+0000","last_fullsized":"2024-01-20T08:11:20.538318+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:06:24.478113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.536764+0000","last_change":"2024-01-20T08:11:20.533426+0000","last_active":"2024-01-20T08:11:20.536764+0000","last_peered":"2024-01-20T08:11:20.536764+0000","last_clean":"2024-01-20T08:11:20.536764+0000","last_became_active":"2024-01-20T08:11:20.533169+0000","last_became_peered":"2024-01-20T08:11:20.533169+0000","last_unstale":"2024-01-20T08:11:20.536764+0000","last_undegraded":"2024-01-20T08:11:20.536764+0000","last_fullsized":"2024-01-20T08:11:20.536764+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:01:50.149523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489294+0000","last_change":"2024-01-20T08:11:04.238975+0000","last_active":"2024-01-20T08:11:19.489294+0000","last_peered":"2024-01-20T08:11:19.489294+0000","last_clean":"2024-01-20T08:11:19.489294+0000","last_became_active":"2024-01-20T08:11:04.238626+0000","last_became_peered":"2024-01-20T08:11:04.238626+0000","last_unstale":"2024-01-20T08:11:19.489294+0000","last_undegraded":"2024-01-20T08:11:19.489294+0000","last_fullsized":"2024-01-20T08:11:19.489294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:35.183036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508130+0000","last_change":"2024-01-20T08:11:05.270395+0000","last_active":"2024-01-20T08:11:19.508130+0000","last_peered":"2024-01-20T08:11:19.508130+0000","last_clean":"2024-01-20T08:11:19.508130+0000","last_became_active":"2024-01-20T08:11:05.269778+0000","last_became_peered":"2024-01-20T08:11:05.269778+0000","last_unstale":"2024-01-20T08:11:19.508130+0000","last_undegraded":"2024-01-20T08:11:19.508130+0000","last_fullsized":"2024-01-20T08:11:19.508130+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:26.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"37'3","reported_seq":14,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531990+0000","last_change":"2024-01-20T08:11:19.517241+0000","last_active":"2024-01-20T08:11:20.531990+0000","last_peered":"2024-01-20T08:11:20.531990+0000","last_clean":"2024-01-20T08:11:20.531990+0000","last_became_active":"2024-01-20T08:11:19.516977+0000","last_became_peered":"2024-01-20T08:11:19.516977+0000","last_unstale":"2024-01-20T08:11:20.531990+0000","last_undegraded":"2024-01-20T08:11:20.531990+0000","last_fullsized":"2024-01-20T08:11:20.531990+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:03.473432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516921+0000","last_change":"2024-01-20T08:11:20.509657+0000","last_active":"2024-01-20T08:11:20.516921+0000","last_peered":"2024-01-20T08:11:20.516921+0000","last_clean":"2024-01-20T08:11:20.516921+0000","last_became_active":"2024-01-20T08:11:20.508862+0000","last_became_peered":"2024-01-20T08:11:20.508862+0000","last_unstale":"2024-01-20T08:11:20.516921+0000","last_undegraded":"2024-01-20T08:11:20.516921+0000","last_fullsized":"2024-01-20T08:11:20.516921+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:19.177019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503151+0000","last_change":"2024-01-20T08:11:04.238159+0000","last_active":"2024-01-20T08:11:19.503151+0000","last_peered":"2024-01-20T08:11:19.503151+0000","last_clean":"2024-01-20T08:11:19.503151+0000","last_became_active":"2024-01-20T08:11:04.237894+0000","last_became_peered":"2024-01-20T08:11:04.237894+0000","last_unstale":"2024-01-20T08:11:19.503151+0000","last_undegraded":"2024-01-20T08:11:19.503151+0000","last_fullsized":"2024-01-20T08:11:19.503151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:15.898827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.494091+0000","last_change":"2024-01-20T08:11:05.270984+0000","last_active":"2024-01-20T08:11:19.494091+0000","last_peered":"2024-01-20T08:11:19.494091+0000","last_clean":"2024-01-20T08:11:19.494091+0000","last_became_active":"2024-01-20T08:11:05.270740+0000","last_became_peered":"2024-01-20T08:11:05.270740+0000","last_unstale":"2024-01-20T08:11:19.494091+0000","last_undegraded":"2024-01-20T08:11:19.494091+0000","last_fullsized":"2024-01-20T08:11:19.494091+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.523489+0000","last_change":"2024-01-20T08:11:19.515905+0000","last_active":"2024-01-20T08:11:20.523489+0000","last_peered":"2024-01-20T08:11:20.523489+0000","last_clean":"2024-01-20T08:11:20.523489+0000","last_became_active":"2024-01-20T08:11:19.515110+0000","last_became_peered":"2024-01-20T08:11:19.515110+0000","last_unstale":"2024-01-20T08:11:20.523489+0000","last_undegraded":"2024-01-20T08:11:20.523489+0000","last_fullsized":"2024-01-20T08:11:20.523489+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:46.628374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.529458+0000","last_change":"2024-01-20T08:11:20.523679+0000","last_active":"2024-01-20T08:11:20.529458+0000","last_peered":"2024-01-20T08:11:20.529458+0000","last_clean":"2024-01-20T08:11:20.529458+0000","last_became_active":"2024-01-20T08:11:20.523384+0000","last_became_peered":"2024-01-20T08:11:20.523384+0000","last_unstale":"2024-01-20T08:11:20.529458+0000","last_undegraded":"2024-01-20T08:11:20.529458+0000","last_fullsized":"2024-01-20T08:11:20.529458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:16.550437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489853+0000","last_change":"2024-01-20T08:11:04.228883+0000","last_active":"2024-01-20T08:11:19.489853+0000","last_peered":"2024-01-20T08:11:19.489853+0000","last_clean":"2024-01-20T08:11:19.489853+0000","last_became_active":"2024-01-20T08:11:04.228077+0000","last_became_peered":"2024-01-20T08:11:04.228077+0000","last_unstale":"2024-01-20T08:11:19.489853+0000","last_undegraded":"2024-01-20T08:11:19.489853+0000","last_fullsized":"2024-01-20T08:11:19.489853+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:58.020719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503059+0000","last_change":"2024-01-20T08:11:05.265947+0000","last_active":"2024-01-20T08:11:19.503059+0000","last_peered":"2024-01-20T08:11:19.503059+0000","last_clean":"2024-01-20T08:11:19.503059+0000","last_became_active":"2024-01-20T08:11:05.265674+0000","last_became_peered":"2024-01-20T08:11:05.265674+0000","last_unstale":"2024-01-20T08:11:19.503059+0000","last_undegraded":"2024-01-20T08:11:19.503059+0000","last_fullsized":"2024-01-20T08:11:19.503059+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.531061+0000","last_change":"2024-01-20T08:11:19.508156+0000","last_active":"2024-01-20T08:11:20.531061+0000","last_peered":"2024-01-20T08:11:20.531061+0000","last_clean":"2024-01-20T08:11:20.531061+0000","last_became_active":"2024-01-20T08:11:19.507544+0000","last_became_peered":"2024-01-20T08:11:19.507544+0000","last_unstale":"2024-01-20T08:11:20.531061+0000","last_undegraded":"2024-01-20T08:11:20.531061+0000","last_fullsized":"2024-01-20T08:11:20.531061+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:10.318192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527542+0000","last_change":"2024-01-20T08:11:20.525093+0000","last_active":"2024-01-20T08:11:20.527542+0000","last_peered":"2024-01-20T08:11:20.527542+0000","last_clean":"2024-01-20T08:11:20.527542+0000","last_became_active":"2024-01-20T08:11:20.524560+0000","last_became_peered":"2024-01-20T08:11:20.524560+0000","last_unstale":"2024-01-20T08:11:20.527542+0000","last_undegraded":"2024-01-20T08:11:20.527542+0000","last_fullsized":"2024-01-20T08:11:20.527542+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:06:00.517140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503441+0000","last_change":"2024-01-20T08:11:04.233438+0000","last_active":"2024-01-20T08:11:19.503441+0000","last_peered":"2024-01-20T08:11:19.503441+0000","last_clean":"2024-01-20T08:11:19.503441+0000","last_became_active":"2024-01-20T08:11:04.232954+0000","last_became_peered":"2024-01-20T08:11:04.232954+0000","last_unstale":"2024-01-20T08:11:19.503441+0000","last_undegraded":"2024-01-20T08:11:19.503441+0000","last_fullsized":"2024-01-20T08:11:19.503441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:49.097630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.504461+0000","last_change":"2024-01-20T08:11:05.261155+0000","last_active":"2024-01-20T08:11:19.504461+0000","last_peered":"2024-01-20T08:11:19.504461+0000","last_clean":"2024-01-20T08:11:19.504461+0000","last_became_active":"2024-01-20T08:11:05.260746+0000","last_became_peered":"2024-01-20T08:11:05.260746+0000","last_unstale":"2024-01-20T08:11:19.504461+0000","last_undegraded":"2024-01-20T08:11:19.504461+0000","last_fullsized":"2024-01-20T08:11:19.504461+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.506209+0000","last_change":"2024-01-20T08:11:19.499967+0000","last_active":"2024-01-20T08:11:20.506209+0000","last_peered":"2024-01-20T08:11:20.506209+0000","last_clean":"2024-01-20T08:11:20.506209+0000","last_became_active":"2024-01-20T08:11:19.499671+0000","last_became_peered":"2024-01-20T08:11:19.499671+0000","last_unstale":"2024-01-20T08:11:20.506209+0000","last_undegraded":"2024-01-20T08:11:20.506209+0000","last_fullsized":"2024-01-20T08:11:20.506209+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:40.857724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530865+0000","last_change":"2024-01-20T08:11:20.525046+0000","last_active":"2024-01-20T08:11:20.530865+0000","last_peered":"2024-01-20T08:11:20.530865+0000","last_clean":"2024-01-20T08:11:20.530865+0000","last_became_active":"2024-01-20T08:11:20.524209+0000","last_became_peered":"2024-01-20T08:11:20.524209+0000","last_unstale":"2024-01-20T08:11:20.530865+0000","last_undegraded":"2024-01-20T08:11:20.530865+0000","last_fullsized":"2024-01-20T08:11:20.530865+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503180+0000","last_change":"2024-01-20T08:11:04.234921+0000","last_active":"2024-01-20T08:11:19.503180+0000","last_peered":"2024-01-20T08:11:19.503180+0000","last_clean":"2024-01-20T08:11:19.503180+0000","last_became_active":"2024-01-20T08:11:04.232868+0000","last_became_peered":"2024-01-20T08:11:04.232868+0000","last_unstale":"2024-01-20T08:11:19.503180+0000","last_undegraded":"2024-01-20T08:11:19.503180+0000","last_fullsized":"2024-01-20T08:11:19.503180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:42:57.342375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.492491+0000","last_change":"2024-01-20T08:11:05.267543+0000","last_active":"2024-01-20T08:11:19.492491+0000","last_peered":"2024-01-20T08:11:19.492491+0000","last_clean":"2024-01-20T08:11:19.492491+0000","last_became_active":"2024-01-20T08:11:05.267013+0000","last_became_peered":"2024-01-20T08:11:05.267013+0000","last_unstale":"2024-01-20T08:11:19.492491+0000","last_undegraded":"2024-01-20T08:11:19.492491+0000","last_fullsized":"2024-01-20T08:11:19.492491+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.493622+0000","last_change":"2024-01-20T08:11:19.510874+0000","last_active":"2024-01-20T08:11:20.493622+0000","last_peered":"2024-01-20T08:11:20.493622+0000","last_clean":"2024-01-20T08:11:20.493622+0000","last_became_active":"2024-01-20T08:11:19.510586+0000","last_became_peered":"2024-01-20T08:11:19.510586+0000","last_unstale":"2024-01-20T08:11:20.493622+0000","last_undegraded":"2024-01-20T08:11:20.493622+0000","last_fullsized":"2024-01-20T08:11:20.493622+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:15.534552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527252+0000","last_change":"2024-01-20T08:11:20.520499+0000","last_active":"2024-01-20T08:11:20.527252+0000","last_peered":"2024-01-20T08:11:20.527252+0000","last_clean":"2024-01-20T08:11:20.527252+0000","last_became_active":"2024-01-20T08:11:20.519690+0000","last_became_peered":"2024-01-20T08:11:20.519690+0000","last_unstale":"2024-01-20T08:11:20.527252+0000","last_undegraded":"2024-01-20T08:11:20.527252+0000","last_fullsized":"2024-01-20T08:11:20.527252+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:01.212788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"37'1","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534874+0000","last_change":"2024-01-20T08:11:19.518798+0000","last_active":"2024-01-20T08:11:20.534874+0000","last_peered":"2024-01-20T08:11:20.534874+0000","last_clean":"2024-01-20T08:11:20.534874+0000","last_became_active":"2024-01-20T08:11:19.518478+0000","last_became_peered":"2024-01-20T08:11:19.518478+0000","last_unstale":"2024-01-20T08:11:20.534874+0000","last_undegraded":"2024-01-20T08:11:20.534874+0000","last_fullsized":"2024-01-20T08:11:20.534874+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:40.857724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483225+0000","last_change":"2024-01-20T08:11:04.227383+0000","last_active":"2024-01-20T08:11:19.483225+0000","last_peered":"2024-01-20T08:11:19.483225+0000","last_clean":"2024-01-20T08:11:19.483225+0000","last_became_active":"2024-01-20T08:11:04.227109+0000","last_became_peered":"2024-01-20T08:11:04.227109+0000","last_unstale":"2024-01-20T08:11:19.483225+0000","last_undegraded":"2024-01-20T08:11:19.483225+0000","last_fullsized":"2024-01-20T08:11:19.483225+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:04:40.346500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496047+0000","last_change":"2024-01-20T08:11:05.273419+0000","last_active":"2024-01-20T08:11:19.496047+0000","last_peered":"2024-01-20T08:11:19.496047+0000","last_clean":"2024-01-20T08:11:19.496047+0000","last_became_active":"2024-01-20T08:11:05.273110+0000","last_became_peered":"2024-01-20T08:11:05.273110+0000","last_unstale":"2024-01-20T08:11:19.496047+0000","last_undegraded":"2024-01-20T08:11:19.496047+0000","last_fullsized":"2024-01-20T08:11:19.496047+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530566+0000","last_change":"2024-01-20T08:11:20.525731+0000","last_active":"2024-01-20T08:11:20.530566+0000","last_peered":"2024-01-20T08:11:20.530566+0000","last_clean":"2024-01-20T08:11:20.530566+0000","last_became_active":"2024-01-20T08:11:20.525414+0000","last_became_peered":"2024-01-20T08:11:20.525414+0000","last_unstale":"2024-01-20T08:11:20.530566+0000","last_undegraded":"2024-01-20T08:11:20.530566+0000","last_fullsized":"2024-01-20T08:11:20.530566+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"37'4","reported_seq":15,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535945+0000","last_change":"2024-01-20T08:11:19.516000+0000","last_active":"2024-01-20T08:11:20.535945+0000","last_peered":"2024-01-20T08:11:20.535945+0000","last_clean":"2024-01-20T08:11:20.535945+0000","last_became_active":"2024-01-20T08:11:19.515755+0000","last_became_peered":"2024-01-20T08:11:19.515755+0000","last_unstale":"2024-01-20T08:11:20.535945+0000","last_undegraded":"2024-01-20T08:11:20.535945+0000","last_fullsized":"2024-01-20T08:11:20.535945+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:57.365915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488739+0000","last_change":"2024-01-20T08:11:04.227503+0000","last_active":"2024-01-20T08:11:19.488739+0000","last_peered":"2024-01-20T08:11:19.488739+0000","last_clean":"2024-01-20T08:11:19.488739+0000","last_became_active":"2024-01-20T08:11:04.227241+0000","last_became_peered":"2024-01-20T08:11:04.227241+0000","last_unstale":"2024-01-20T08:11:19.488739+0000","last_undegraded":"2024-01-20T08:11:19.488739+0000","last_fullsized":"2024-01-20T08:11:19.488739+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:45.729946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502991+0000","last_change":"2024-01-20T08:11:05.261271+0000","last_active":"2024-01-20T08:11:19.502991+0000","last_peered":"2024-01-20T08:11:19.502991+0000","last_clean":"2024-01-20T08:11:19.502991+0000","last_became_active":"2024-01-20T08:11:05.258484+0000","last_became_peered":"2024-01-20T08:11:05.258484+0000","last_unstale":"2024-01-20T08:11:19.502991+0000","last_undegraded":"2024-01-20T08:11:19.502991+0000","last_fullsized":"2024-01-20T08:11:19.502991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:23.907789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533688+0000","last_change":"2024-01-20T08:11:20.530010+0000","last_active":"2024-01-20T08:11:20.533688+0000","last_peered":"2024-01-20T08:11:20.533688+0000","last_clean":"2024-01-20T08:11:20.533688+0000","last_became_active":"2024-01-20T08:11:20.529531+0000","last_became_peered":"2024-01-20T08:11:20.529531+0000","last_unstale":"2024-01-20T08:11:20.533688+0000","last_undegraded":"2024-01-20T08:11:20.533688+0000","last_fullsized":"2024-01-20T08:11:20.533688+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501096+0000","last_change":"2024-01-20T08:11:04.238741+0000","last_active":"2024-01-20T08:11:19.501096+0000","last_peered":"2024-01-20T08:11:19.501096+0000","last_clean":"2024-01-20T08:11:19.501096+0000","last_became_active":"2024-01-20T08:11:04.238272+0000","last_became_peered":"2024-01-20T08:11:04.238272+0000","last_unstale":"2024-01-20T08:11:19.501096+0000","last_undegraded":"2024-01-20T08:11:19.501096+0000","last_fullsized":"2024-01-20T08:11:19.501096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513545+0000","last_change":"2024-01-20T08:11:05.267631+0000","last_active":"2024-01-20T08:11:19.513545+0000","last_peered":"2024-01-20T08:11:19.513545+0000","last_clean":"2024-01-20T08:11:19.513545+0000","last_became_active":"2024-01-20T08:11:05.267310+0000","last_became_peered":"2024-01-20T08:11:05.267310+0000","last_unstale":"2024-01-20T08:11:19.513545+0000","last_undegraded":"2024-01-20T08:11:19.513545+0000","last_fullsized":"2024-01-20T08:11:19.513545+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527285+0000","last_change":"2024-01-20T08:11:19.514806+0000","last_active":"2024-01-20T08:11:20.527285+0000","last_peered":"2024-01-20T08:11:20.527285+0000","last_clean":"2024-01-20T08:11:20.527285+0000","last_became_active":"2024-01-20T08:11:19.514457+0000","last_became_peered":"2024-01-20T08:11:19.514457+0000","last_unstale":"2024-01-20T08:11:20.527285+0000","last_undegraded":"2024-01-20T08:11:20.527285+0000","last_fullsized":"2024-01-20T08:11:20.527285+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:15.534552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.526024+0000","last_change":"2024-01-20T08:11:20.522167+0000","last_active":"2024-01-20T08:11:20.526024+0000","last_peered":"2024-01-20T08:11:20.526024+0000","last_clean":"2024-01-20T08:11:20.526024+0000","last_became_active":"2024-01-20T08:11:20.521902+0000","last_became_peered":"2024-01-20T08:11:20.521902+0000","last_unstale":"2024-01-20T08:11:20.526024+0000","last_undegraded":"2024-01-20T08:11:20.526024+0000","last_fullsized":"2024-01-20T08:11:20.526024+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:57.773276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513672+0000","last_change":"2024-01-20T08:11:04.244349+0000","last_active":"2024-01-20T08:11:19.513672+0000","last_peered":"2024-01-20T08:11:19.513672+0000","last_clean":"2024-01-20T08:11:19.513672+0000","last_became_active":"2024-01-20T08:11:04.244029+0000","last_became_peered":"2024-01-20T08:11:04.244029+0000","last_unstale":"2024-01-20T08:11:19.513672+0000","last_undegraded":"2024-01-20T08:11:19.513672+0000","last_fullsized":"2024-01-20T08:11:19.513672+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:03.184162+0000","last_clean_scrub_stamp":"2024-01-20T08:11:03.184162+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:17:46.816590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501003+0000","last_change":"2024-01-20T08:11:05.264962+0000","last_active":"2024-01-20T08:11:19.501003+0000","last_peered":"2024-01-20T08:11:19.501003+0000","last_clean":"2024-01-20T08:11:19.501003+0000","last_became_active":"2024-01-20T08:11:05.264693+0000","last_became_peered":"2024-01-20T08:11:05.264693+0000","last_unstale":"2024-01-20T08:11:19.501003+0000","last_undegraded":"2024-01-20T08:11:19.501003+0000","last_fullsized":"2024-01-20T08:11:19.501003+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'2","reported_seq":13,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527601+0000","last_change":"2024-01-20T08:11:19.520142+0000","last_active":"2024-01-20T08:11:20.527601+0000","last_peered":"2024-01-20T08:11:20.527601+0000","last_clean":"2024-01-20T08:11:20.527601+0000","last_became_active":"2024-01-20T08:11:19.519812+0000","last_became_peered":"2024-01-20T08:11:19.519812+0000","last_unstale":"2024-01-20T08:11:20.527601+0000","last_undegraded":"2024-01-20T08:11:20.527601+0000","last_fullsized":"2024-01-20T08:11:20.527601+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:18.439877+0000","last_clean_scrub_stamp":"2024-01-20T08:11:18.439877+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:26.921580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.523458+0000","last_change":"2024-01-20T08:11:20.517223+0000","last_active":"2024-01-20T08:11:20.523458+0000","last_peered":"2024-01-20T08:11:20.523458+0000","last_clean":"2024-01-20T08:11:20.523458+0000","last_became_active":"2024-01-20T08:11:20.516944+0000","last_became_peered":"2024-01-20T08:11:20.516944+0000","last_unstale":"2024-01-20T08:11:20.523458+0000","last_undegraded":"2024-01-20T08:11:20.523458+0000","last_fullsized":"2024-01-20T08:11:20.523458+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:24.410291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495344+0000","last_change":"2024-01-20T08:11:05.264877+0000","last_active":"2024-01-20T08:11:19.495344+0000","last_peered":"2024-01-20T08:11:19.495344+0000","last_clean":"2024-01-20T08:11:19.495344+0000","last_became_active":"2024-01-20T08:11:05.260771+0000","last_became_peered":"2024-01-20T08:11:05.260771+0000","last_unstale":"2024-01-20T08:11:19.495344+0000","last_undegraded":"2024-01-20T08:11:19.495344+0000","last_fullsized":"2024-01-20T08:11:19.495344+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:19.333809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527248+0000","last_change":"2024-01-20T08:11:20.521484+0000","last_active":"2024-01-20T08:11:20.527248+0000","last_peered":"2024-01-20T08:11:20.527248+0000","last_clean":"2024-01-20T08:11:20.527248+0000","last_became_active":"2024-01-20T08:11:20.514403+0000","last_became_peered":"2024-01-20T08:11:20.514403+0000","last_unstale":"2024-01-20T08:11:20.527248+0000","last_undegraded":"2024-01-20T08:11:20.527248+0000","last_fullsized":"2024-01-20T08:11:20.527248+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:53.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.509638+0000","last_change":"2024-01-20T08:11:05.274553+0000","last_active":"2024-01-20T08:11:19.509638+0000","last_peered":"2024-01-20T08:11:19.509638+0000","last_clean":"2024-01-20T08:11:19.509638+0000","last_became_active":"2024-01-20T08:11:05.272535+0000","last_became_peered":"2024-01-20T08:11:05.272535+0000","last_unstale":"2024-01-20T08:11:19.509638+0000","last_undegraded":"2024-01-20T08:11:19.509638+0000","last_fullsized":"2024-01-20T08:11:19.509638+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527145+0000","last_change":"2024-01-20T08:11:20.511628+0000","last_active":"2024-01-20T08:11:20.527145+0000","last_peered":"2024-01-20T08:11:20.527145+0000","last_clean":"2024-01-20T08:11:20.527145+0000","last_became_active":"2024-01-20T08:11:20.508039+0000","last_became_peered":"2024-01-20T08:11:20.508039+0000","last_unstale":"2024-01-20T08:11:20.527145+0000","last_undegraded":"2024-01-20T08:11:20.527145+0000","last_fullsized":"2024-01-20T08:11:20.527145+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:06:59.726793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.492243+0000","last_change":"2024-01-20T08:11:05.267754+0000","last_active":"2024-01-20T08:11:19.492243+0000","last_peered":"2024-01-20T08:11:19.492243+0000","last_clean":"2024-01-20T08:11:19.492243+0000","last_became_active":"2024-01-20T08:11:05.267459+0000","last_became_peered":"2024-01-20T08:11:05.267459+0000","last_unstale":"2024-01-20T08:11:19.492243+0000","last_undegraded":"2024-01-20T08:11:19.492243+0000","last_fullsized":"2024-01-20T08:11:19.492243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:38.228130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527051+0000","last_change":"2024-01-20T08:11:20.521530+0000","last_active":"2024-01-20T08:11:20.527051+0000","last_peered":"2024-01-20T08:11:20.527051+0000","last_clean":"2024-01-20T08:11:20.527051+0000","last_became_active":"2024-01-20T08:11:20.521284+0000","last_became_peered":"2024-01-20T08:11:20.521284+0000","last_unstale":"2024-01-20T08:11:20.527051+0000","last_undegraded":"2024-01-20T08:11:20.527051+0000","last_fullsized":"2024-01-20T08:11:20.527051+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:36:09.507052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503106+0000","last_change":"2024-01-20T08:11:05.253163+0000","last_active":"2024-01-20T08:11:19.503106+0000","last_peered":"2024-01-20T08:11:19.503106+0000","last_clean":"2024-01-20T08:11:19.503106+0000","last_became_active":"2024-01-20T08:11:05.252357+0000","last_became_peered":"2024-01-20T08:11:05.252357+0000","last_unstale":"2024-01-20T08:11:19.503106+0000","last_undegraded":"2024-01-20T08:11:19.503106+0000","last_fullsized":"2024-01-20T08:11:19.503106+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:46.743631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532070+0000","last_change":"2024-01-20T08:11:20.523249+0000","last_active":"2024-01-20T08:11:20.532070+0000","last_peered":"2024-01-20T08:11:20.532070+0000","last_clean":"2024-01-20T08:11:20.532070+0000","last_became_active":"2024-01-20T08:11:20.522977+0000","last_became_peered":"2024-01-20T08:11:20.522977+0000","last_unstale":"2024-01-20T08:11:20.532070+0000","last_undegraded":"2024-01-20T08:11:20.532070+0000","last_fullsized":"2024-01-20T08:11:20.532070+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:50:48.728633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508993+0000","last_change":"2024-01-20T08:11:05.273526+0000","last_active":"2024-01-20T08:11:19.508993+0000","last_peered":"2024-01-20T08:11:19.508993+0000","last_clean":"2024-01-20T08:11:19.508993+0000","last_became_active":"2024-01-20T08:11:05.273257+0000","last_became_peered":"2024-01-20T08:11:05.273257+0000","last_unstale":"2024-01-20T08:11:19.508993+0000","last_undegraded":"2024-01-20T08:11:19.508993+0000","last_fullsized":"2024-01-20T08:11:19.508993+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.522284+0000","last_change":"2024-01-20T08:11:20.516473+0000","last_active":"2024-01-20T08:11:20.522284+0000","last_peered":"2024-01-20T08:11:20.522284+0000","last_clean":"2024-01-20T08:11:20.522284+0000","last_became_active":"2024-01-20T08:11:20.513972+0000","last_became_peered":"2024-01-20T08:11:20.513972+0000","last_unstale":"2024-01-20T08:11:20.522284+0000","last_undegraded":"2024-01-20T08:11:20.522284+0000","last_fullsized":"2024-01-20T08:11:20.522284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:32.825140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495967+0000","last_change":"2024-01-20T08:11:05.274284+0000","last_active":"2024-01-20T08:11:19.495967+0000","last_peered":"2024-01-20T08:11:19.495967+0000","last_clean":"2024-01-20T08:11:19.495967+0000","last_became_active":"2024-01-20T08:11:05.274004+0000","last_became_peered":"2024-01-20T08:11:05.274004+0000","last_unstale":"2024-01-20T08:11:19.495967+0000","last_undegraded":"2024-01-20T08:11:19.495967+0000","last_fullsized":"2024-01-20T08:11:19.495967+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:45:45.954872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511929+0000","last_change":"2024-01-20T08:11:20.509106+0000","last_active":"2024-01-20T08:11:20.511929+0000","last_peered":"2024-01-20T08:11:20.511929+0000","last_clean":"2024-01-20T08:11:20.511929+0000","last_became_active":"2024-01-20T08:11:20.508862+0000","last_became_peered":"2024-01-20T08:11:20.508862+0000","last_unstale":"2024-01-20T08:11:20.511929+0000","last_undegraded":"2024-01-20T08:11:20.511929+0000","last_fullsized":"2024-01-20T08:11:20.511929+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:32:36.228946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496569+0000","last_change":"2024-01-20T08:11:05.257696+0000","last_active":"2024-01-20T08:11:19.496569+0000","last_peered":"2024-01-20T08:11:19.496569+0000","last_clean":"2024-01-20T08:11:19.496569+0000","last_became_active":"2024-01-20T08:11:05.257432+0000","last_became_peered":"2024-01-20T08:11:05.257432+0000","last_unstale":"2024-01-20T08:11:19.496569+0000","last_undegraded":"2024-01-20T08:11:19.496569+0000","last_fullsized":"2024-01-20T08:11:19.496569+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:30.491405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.513842+0000","last_change":"2024-01-20T08:11:20.506122+0000","last_active":"2024-01-20T08:11:20.513842+0000","last_peered":"2024-01-20T08:11:20.513842+0000","last_clean":"2024-01-20T08:11:20.513842+0000","last_became_active":"2024-01-20T08:11:20.505841+0000","last_became_peered":"2024-01-20T08:11:20.505841+0000","last_unstale":"2024-01-20T08:11:20.513842+0000","last_undegraded":"2024-01-20T08:11:20.513842+0000","last_fullsized":"2024-01-20T08:11:20.513842+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:47:45.749321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496935+0000","last_change":"2024-01-20T08:11:05.266720+0000","last_active":"2024-01-20T08:11:19.496935+0000","last_peered":"2024-01-20T08:11:19.496935+0000","last_clean":"2024-01-20T08:11:19.496935+0000","last_became_active":"2024-01-20T08:11:05.266340+0000","last_became_peered":"2024-01-20T08:11:05.266340+0000","last_unstale":"2024-01-20T08:11:19.496935+0000","last_undegraded":"2024-01-20T08:11:19.496935+0000","last_fullsized":"2024-01-20T08:11:19.496935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527808+0000","last_change":"2024-01-20T08:11:20.518728+0000","last_active":"2024-01-20T08:11:20.527808+0000","last_peered":"2024-01-20T08:11:20.527808+0000","last_clean":"2024-01-20T08:11:20.527808+0000","last_became_active":"2024-01-20T08:11:20.518395+0000","last_became_peered":"2024-01-20T08:11:20.518395+0000","last_unstale":"2024-01-20T08:11:20.527808+0000","last_undegraded":"2024-01-20T08:11:20.527808+0000","last_fullsized":"2024-01-20T08:11:20.527808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:03:53.683162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502796+0000","last_change":"2024-01-20T08:11:05.256694+0000","last_active":"2024-01-20T08:11:19.502796+0000","last_peered":"2024-01-20T08:11:19.502796+0000","last_clean":"2024-01-20T08:11:19.502796+0000","last_became_active":"2024-01-20T08:11:05.256285+0000","last_became_peered":"2024-01-20T08:11:05.256285+0000","last_unstale":"2024-01-20T08:11:19.502796+0000","last_undegraded":"2024-01-20T08:11:19.502796+0000","last_fullsized":"2024-01-20T08:11:19.502796+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528199+0000","last_change":"2024-01-20T08:11:20.522242+0000","last_active":"2024-01-20T08:11:20.528199+0000","last_peered":"2024-01-20T08:11:20.528199+0000","last_clean":"2024-01-20T08:11:20.528199+0000","last_became_active":"2024-01-20T08:11:20.521953+0000","last_became_peered":"2024-01-20T08:11:20.521953+0000","last_unstale":"2024-01-20T08:11:20.528199+0000","last_undegraded":"2024-01-20T08:11:20.528199+0000","last_fullsized":"2024-01-20T08:11:20.528199+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:00:26.570297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.490951+0000","last_change":"2024-01-20T08:11:05.264328+0000","last_active":"2024-01-20T08:11:19.490951+0000","last_peered":"2024-01-20T08:11:19.490951+0000","last_clean":"2024-01-20T08:11:19.490951+0000","last_became_active":"2024-01-20T08:11:05.263991+0000","last_became_peered":"2024-01-20T08:11:05.263991+0000","last_unstale":"2024-01-20T08:11:19.490951+0000","last_undegraded":"2024-01-20T08:11:19.490951+0000","last_fullsized":"2024-01-20T08:11:19.490951+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:51:19.113994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.533068+0000","last_change":"2024-01-20T08:11:20.526395+0000","last_active":"2024-01-20T08:11:20.533068+0000","last_peered":"2024-01-20T08:11:20.533068+0000","last_clean":"2024-01-20T08:11:20.533068+0000","last_became_active":"2024-01-20T08:11:20.525799+0000","last_became_peered":"2024-01-20T08:11:20.525799+0000","last_unstale":"2024-01-20T08:11:20.533068+0000","last_undegraded":"2024-01-20T08:11:20.533068+0000","last_fullsized":"2024-01-20T08:11:20.533068+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:47.644259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.503322+0000","last_change":"2024-01-20T08:11:05.258143+0000","last_active":"2024-01-20T08:11:19.503322+0000","last_peered":"2024-01-20T08:11:19.503322+0000","last_clean":"2024-01-20T08:11:19.503322+0000","last_became_active":"2024-01-20T08:11:05.257144+0000","last_became_peered":"2024-01-20T08:11:05.257144+0000","last_unstale":"2024-01-20T08:11:19.503322+0000","last_undegraded":"2024-01-20T08:11:19.503322+0000","last_fullsized":"2024-01-20T08:11:19.503322+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:21:20.038579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.527520+0000","last_change":"2024-01-20T08:11:20.521616+0000","last_active":"2024-01-20T08:11:20.527520+0000","last_peered":"2024-01-20T08:11:20.527520+0000","last_clean":"2024-01-20T08:11:20.527520+0000","last_became_active":"2024-01-20T08:11:20.521045+0000","last_became_peered":"2024-01-20T08:11:20.521045+0000","last_unstale":"2024-01-20T08:11:20.527520+0000","last_undegraded":"2024-01-20T08:11:20.527520+0000","last_fullsized":"2024-01-20T08:11:20.527520+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:28.086806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.502991+0000","last_change":"2024-01-20T08:11:05.264644+0000","last_active":"2024-01-20T08:11:19.502991+0000","last_peered":"2024-01-20T08:11:19.502991+0000","last_clean":"2024-01-20T08:11:19.502991+0000","last_became_active":"2024-01-20T08:11:05.264067+0000","last_became_peered":"2024-01-20T08:11:05.264067+0000","last_unstale":"2024-01-20T08:11:19.502991+0000","last_undegraded":"2024-01-20T08:11:19.502991+0000","last_fullsized":"2024-01-20T08:11:19.502991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:08:59.034403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.520351+0000","last_change":"2024-01-20T08:11:20.514912+0000","last_active":"2024-01-20T08:11:20.520351+0000","last_peered":"2024-01-20T08:11:20.520351+0000","last_clean":"2024-01-20T08:11:20.520351+0000","last_became_active":"2024-01-20T08:11:20.514635+0000","last_became_peered":"2024-01-20T08:11:20.514635+0000","last_unstale":"2024-01-20T08:11:20.520351+0000","last_undegraded":"2024-01-20T08:11:20.520351+0000","last_fullsized":"2024-01-20T08:11:20.520351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.483037+0000","last_change":"2024-01-20T08:11:05.269680+0000","last_active":"2024-01-20T08:11:19.483037+0000","last_peered":"2024-01-20T08:11:19.483037+0000","last_clean":"2024-01-20T08:11:19.483037+0000","last_became_active":"2024-01-20T08:11:05.269407+0000","last_became_peered":"2024-01-20T08:11:05.269407+0000","last_unstale":"2024-01-20T08:11:19.483037+0000","last_undegraded":"2024-01-20T08:11:19.483037+0000","last_fullsized":"2024-01-20T08:11:19.483037+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:47:57.201071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.518554+0000","last_change":"2024-01-20T08:11:20.512382+0000","last_active":"2024-01-20T08:11:20.518554+0000","last_peered":"2024-01-20T08:11:20.518554+0000","last_clean":"2024-01-20T08:11:20.518554+0000","last_became_active":"2024-01-20T08:11:20.512091+0000","last_became_peered":"2024-01-20T08:11:20.512091+0000","last_unstale":"2024-01-20T08:11:20.518554+0000","last_undegraded":"2024-01-20T08:11:20.518554+0000","last_fullsized":"2024-01-20T08:11:20.518554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:27.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.488609+0000","last_change":"2024-01-20T08:11:05.261388+0000","last_active":"2024-01-20T08:11:19.488609+0000","last_peered":"2024-01-20T08:11:19.488609+0000","last_clean":"2024-01-20T08:11:19.488609+0000","last_became_active":"2024-01-20T08:11:05.260589+0000","last_became_peered":"2024-01-20T08:11:05.260589+0000","last_unstale":"2024-01-20T08:11:19.488609+0000","last_undegraded":"2024-01-20T08:11:19.488609+0000","last_fullsized":"2024-01-20T08:11:19.488609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:00:18.546758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.529888+0000","last_change":"2024-01-20T08:11:20.508447+0000","last_active":"2024-01-20T08:11:20.529888+0000","last_peered":"2024-01-20T08:11:20.529888+0000","last_clean":"2024-01-20T08:11:20.529888+0000","last_became_active":"2024-01-20T08:11:20.507819+0000","last_became_peered":"2024-01-20T08:11:20.507819+0000","last_unstale":"2024-01-20T08:11:20.529888+0000","last_undegraded":"2024-01-20T08:11:20.529888+0000","last_fullsized":"2024-01-20T08:11:20.529888+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:14:15.928608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.497065+0000","last_change":"2024-01-20T08:11:05.258329+0000","last_active":"2024-01-20T08:11:19.497065+0000","last_peered":"2024-01-20T08:11:19.497065+0000","last_clean":"2024-01-20T08:11:19.497065+0000","last_became_active":"2024-01-20T08:11:05.258043+0000","last_became_peered":"2024-01-20T08:11:05.258043+0000","last_unstale":"2024-01-20T08:11:19.497065+0000","last_undegraded":"2024-01-20T08:11:19.497065+0000","last_fullsized":"2024-01-20T08:11:19.497065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:03.919103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.521860+0000","last_change":"2024-01-20T08:11:20.518238+0000","last_active":"2024-01-20T08:11:20.521860+0000","last_peered":"2024-01-20T08:11:20.521860+0000","last_clean":"2024-01-20T08:11:20.521860+0000","last_became_active":"2024-01-20T08:11:20.513268+0000","last_became_peered":"2024-01-20T08:11:20.513268+0000","last_unstale":"2024-01-20T08:11:20.521860+0000","last_undegraded":"2024-01-20T08:11:20.521860+0000","last_fullsized":"2024-01-20T08:11:20.521860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:58:34.591725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496108+0000","last_change":"2024-01-20T08:11:05.271502+0000","last_active":"2024-01-20T08:11:19.496108+0000","last_peered":"2024-01-20T08:11:19.496108+0000","last_clean":"2024-01-20T08:11:19.496108+0000","last_became_active":"2024-01-20T08:11:05.271187+0000","last_became_peered":"2024-01-20T08:11:05.271187+0000","last_unstale":"2024-01-20T08:11:19.496108+0000","last_undegraded":"2024-01-20T08:11:19.496108+0000","last_fullsized":"2024-01-20T08:11:19.496108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516886+0000","last_change":"2024-01-20T08:11:20.511907+0000","last_active":"2024-01-20T08:11:20.516886+0000","last_peered":"2024-01-20T08:11:20.516886+0000","last_clean":"2024-01-20T08:11:20.516886+0000","last_became_active":"2024-01-20T08:11:20.511617+0000","last_became_peered":"2024-01-20T08:11:20.511617+0000","last_unstale":"2024-01-20T08:11:20.516886+0000","last_undegraded":"2024-01-20T08:11:20.516886+0000","last_fullsized":"2024-01-20T08:11:20.516886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:31:25.215254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496851+0000","last_change":"2024-01-20T08:11:05.276118+0000","last_active":"2024-01-20T08:11:19.496851+0000","last_peered":"2024-01-20T08:11:19.496851+0000","last_clean":"2024-01-20T08:11:19.496851+0000","last_became_active":"2024-01-20T08:11:05.273797+0000","last_became_peered":"2024-01-20T08:11:05.273797+0000","last_unstale":"2024-01-20T08:11:19.496851+0000","last_undegraded":"2024-01-20T08:11:19.496851+0000","last_fullsized":"2024-01-20T08:11:19.496851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:21:12.828890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.532345+0000","last_change":"2024-01-20T08:11:20.524029+0000","last_active":"2024-01-20T08:11:20.532345+0000","last_peered":"2024-01-20T08:11:20.532345+0000","last_clean":"2024-01-20T08:11:20.532345+0000","last_became_active":"2024-01-20T08:11:20.523619+0000","last_became_peered":"2024-01-20T08:11:20.523619+0000","last_unstale":"2024-01-20T08:11:20.532345+0000","last_undegraded":"2024-01-20T08:11:20.532345+0000","last_fullsized":"2024-01-20T08:11:20.532345+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:09:14.292319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.501311+0000","last_change":"2024-01-20T08:11:05.262066+0000","last_active":"2024-01-20T08:11:19.501311+0000","last_peered":"2024-01-20T08:11:19.501311+0000","last_clean":"2024-01-20T08:11:19.501311+0000","last_became_active":"2024-01-20T08:11:05.261204+0000","last_became_peered":"2024-01-20T08:11:05.261204+0000","last_unstale":"2024-01-20T08:11:19.501311+0000","last_undegraded":"2024-01-20T08:11:19.501311+0000","last_fullsized":"2024-01-20T08:11:19.501311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530844+0000","last_change":"2024-01-20T08:11:20.521797+0000","last_active":"2024-01-20T08:11:20.530844+0000","last_peered":"2024-01-20T08:11:20.530844+0000","last_clean":"2024-01-20T08:11:20.530844+0000","last_became_active":"2024-01-20T08:11:20.516517+0000","last_became_peered":"2024-01-20T08:11:20.516517+0000","last_unstale":"2024-01-20T08:11:20.530844+0000","last_undegraded":"2024-01-20T08:11:20.530844+0000","last_fullsized":"2024-01-20T08:11:20.530844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:53.486046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489293+0000","last_change":"2024-01-20T08:11:05.258558+0000","last_active":"2024-01-20T08:11:19.489293+0000","last_peered":"2024-01-20T08:11:19.489293+0000","last_clean":"2024-01-20T08:11:19.489293+0000","last_became_active":"2024-01-20T08:11:05.253870+0000","last_became_peered":"2024-01-20T08:11:05.253870+0000","last_unstale":"2024-01-20T08:11:19.489293+0000","last_undegraded":"2024-01-20T08:11:19.489293+0000","last_fullsized":"2024-01-20T08:11:19.489293+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.525155+0000","last_change":"2024-01-20T08:11:20.520062+0000","last_active":"2024-01-20T08:11:20.525155+0000","last_peered":"2024-01-20T08:11:20.525155+0000","last_clean":"2024-01-20T08:11:20.525155+0000","last_became_active":"2024-01-20T08:11:20.519757+0000","last_became_peered":"2024-01-20T08:11:20.519757+0000","last_unstale":"2024-01-20T08:11:20.525155+0000","last_undegraded":"2024-01-20T08:11:20.525155+0000","last_fullsized":"2024-01-20T08:11:20.525155+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:15:26.762409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482670+0000","last_change":"2024-01-20T08:11:05.259975+0000","last_active":"2024-01-20T08:11:19.482670+0000","last_peered":"2024-01-20T08:11:19.482670+0000","last_clean":"2024-01-20T08:11:19.482670+0000","last_became_active":"2024-01-20T08:11:05.259444+0000","last_became_peered":"2024-01-20T08:11:05.259444+0000","last_unstale":"2024-01-20T08:11:19.482670+0000","last_undegraded":"2024-01-20T08:11:19.482670+0000","last_fullsized":"2024-01-20T08:11:19.482670+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:13:16.912511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528376+0000","last_change":"2024-01-20T08:11:20.521720+0000","last_active":"2024-01-20T08:11:20.528376+0000","last_peered":"2024-01-20T08:11:20.528376+0000","last_clean":"2024-01-20T08:11:20.528376+0000","last_became_active":"2024-01-20T08:11:20.521375+0000","last_became_peered":"2024-01-20T08:11:20.521375+0000","last_unstale":"2024-01-20T08:11:20.528376+0000","last_undegraded":"2024-01-20T08:11:20.528376+0000","last_fullsized":"2024-01-20T08:11:20.528376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:04.489317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508930+0000","last_change":"2024-01-20T08:11:05.267733+0000","last_active":"2024-01-20T08:11:19.508930+0000","last_peered":"2024-01-20T08:11:19.508930+0000","last_clean":"2024-01-20T08:11:19.508930+0000","last_became_active":"2024-01-20T08:11:05.267455+0000","last_became_peered":"2024-01-20T08:11:05.267455+0000","last_unstale":"2024-01-20T08:11:19.508930+0000","last_undegraded":"2024-01-20T08:11:19.508930+0000","last_fullsized":"2024-01-20T08:11:19.508930+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:23:25.543534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516900+0000","last_change":"2024-01-20T08:11:20.510074+0000","last_active":"2024-01-20T08:11:20.516900+0000","last_peered":"2024-01-20T08:11:20.516900+0000","last_clean":"2024-01-20T08:11:20.516900+0000","last_became_active":"2024-01-20T08:11:20.509816+0000","last_became_peered":"2024-01-20T08:11:20.509816+0000","last_unstale":"2024-01-20T08:11:20.516900+0000","last_undegraded":"2024-01-20T08:11:20.516900+0000","last_fullsized":"2024-01-20T08:11:20.516900+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:21:27.937465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.498014+0000","last_change":"2024-01-20T08:11:05.272142+0000","last_active":"2024-01-20T08:11:19.498014+0000","last_peered":"2024-01-20T08:11:19.498014+0000","last_clean":"2024-01-20T08:11:19.498014+0000","last_became_active":"2024-01-20T08:11:05.271469+0000","last_became_peered":"2024-01-20T08:11:05.271469+0000","last_unstale":"2024-01-20T08:11:19.498014+0000","last_undegraded":"2024-01-20T08:11:19.498014+0000","last_fullsized":"2024-01-20T08:11:19.498014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:25:09.930740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.511946+0000","last_change":"2024-01-20T08:11:20.509870+0000","last_active":"2024-01-20T08:11:20.511946+0000","last_peered":"2024-01-20T08:11:20.511946+0000","last_clean":"2024-01-20T08:11:20.511946+0000","last_became_active":"2024-01-20T08:11:20.509561+0000","last_became_peered":"2024-01-20T08:11:20.509561+0000","last_unstale":"2024-01-20T08:11:20.511946+0000","last_undegraded":"2024-01-20T08:11:20.511946+0000","last_fullsized":"2024-01-20T08:11:20.511946+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496419+0000","last_change":"2024-01-20T08:11:05.269484+0000","last_active":"2024-01-20T08:11:19.496419+0000","last_peered":"2024-01-20T08:11:19.496419+0000","last_clean":"2024-01-20T08:11:19.496419+0000","last_became_active":"2024-01-20T08:11:05.269195+0000","last_became_peered":"2024-01-20T08:11:05.269195+0000","last_unstale":"2024-01-20T08:11:19.496419+0000","last_undegraded":"2024-01-20T08:11:19.496419+0000","last_fullsized":"2024-01-20T08:11:19.496419+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:52.314663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.517239+0000","last_change":"2024-01-20T08:11:20.511473+0000","last_active":"2024-01-20T08:11:20.517239+0000","last_peered":"2024-01-20T08:11:20.517239+0000","last_clean":"2024-01-20T08:11:20.517239+0000","last_became_active":"2024-01-20T08:11:20.511215+0000","last_became_peered":"2024-01-20T08:11:20.511215+0000","last_unstale":"2024-01-20T08:11:20.517239+0000","last_undegraded":"2024-01-20T08:11:20.517239+0000","last_fullsized":"2024-01-20T08:11:20.517239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.505455+0000","last_change":"2024-01-20T08:11:05.263501+0000","last_active":"2024-01-20T08:11:19.505455+0000","last_peered":"2024-01-20T08:11:19.505455+0000","last_clean":"2024-01-20T08:11:19.505455+0000","last_became_active":"2024-01-20T08:11:05.263158+0000","last_became_peered":"2024-01-20T08:11:05.263158+0000","last_unstale":"2024-01-20T08:11:19.505455+0000","last_undegraded":"2024-01-20T08:11:19.505455+0000","last_fullsized":"2024-01-20T08:11:19.505455+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:19:14.663826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.534613+0000","last_change":"2024-01-20T08:11:20.531595+0000","last_active":"2024-01-20T08:11:20.534613+0000","last_peered":"2024-01-20T08:11:20.534613+0000","last_clean":"2024-01-20T08:11:20.534613+0000","last_became_active":"2024-01-20T08:11:20.531147+0000","last_became_peered":"2024-01-20T08:11:20.531147+0000","last_unstale":"2024-01-20T08:11:20.534613+0000","last_undegraded":"2024-01-20T08:11:20.534613+0000","last_fullsized":"2024-01-20T08:11:20.534613+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:54.913149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495124+0000","last_change":"2024-01-20T08:11:05.266849+0000","last_active":"2024-01-20T08:11:19.495124+0000","last_peered":"2024-01-20T08:11:19.495124+0000","last_clean":"2024-01-20T08:11:19.495124+0000","last_became_active":"2024-01-20T08:11:05.265215+0000","last_became_peered":"2024-01-20T08:11:05.265215+0000","last_unstale":"2024-01-20T08:11:19.495124+0000","last_undegraded":"2024-01-20T08:11:19.495124+0000","last_fullsized":"2024-01-20T08:11:19.495124+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.516007+0000","last_change":"2024-01-20T08:11:20.511272+0000","last_active":"2024-01-20T08:11:20.516007+0000","last_peered":"2024-01-20T08:11:20.516007+0000","last_clean":"2024-01-20T08:11:20.516007+0000","last_became_active":"2024-01-20T08:11:20.510998+0000","last_became_peered":"2024-01-20T08:11:20.510998+0000","last_unstale":"2024-01-20T08:11:20.516007+0000","last_undegraded":"2024-01-20T08:11:20.516007+0000","last_fullsized":"2024-01-20T08:11:20.516007+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:30:47.307296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.491333+0000","last_change":"2024-01-20T08:11:05.269037+0000","last_active":"2024-01-20T08:11:19.491333+0000","last_peered":"2024-01-20T08:11:19.491333+0000","last_clean":"2024-01-20T08:11:19.491333+0000","last_became_active":"2024-01-20T08:11:05.268712+0000","last_became_peered":"2024-01-20T08:11:05.268712+0000","last_unstale":"2024-01-20T08:11:19.491333+0000","last_undegraded":"2024-01-20T08:11:19.491333+0000","last_fullsized":"2024-01-20T08:11:19.491333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:12:38.564801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.530725+0000","last_change":"2024-01-20T08:11:20.524821+0000","last_active":"2024-01-20T08:11:20.530725+0000","last_peered":"2024-01-20T08:11:20.530725+0000","last_clean":"2024-01-20T08:11:20.530725+0000","last_became_active":"2024-01-20T08:11:20.523879+0000","last_became_peered":"2024-01-20T08:11:20.523879+0000","last_unstale":"2024-01-20T08:11:20.530725+0000","last_undegraded":"2024-01-20T08:11:20.530725+0000","last_fullsized":"2024-01-20T08:11:20.530725+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.489193+0000","last_change":"2024-01-20T08:11:05.258827+0000","last_active":"2024-01-20T08:11:19.489193+0000","last_peered":"2024-01-20T08:11:19.489193+0000","last_clean":"2024-01-20T08:11:19.489193+0000","last_became_active":"2024-01-20T08:11:05.257441+0000","last_became_peered":"2024-01-20T08:11:05.257441+0000","last_unstale":"2024-01-20T08:11:19.489193+0000","last_undegraded":"2024-01-20T08:11:19.489193+0000","last_fullsized":"2024-01-20T08:11:19.489193+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:45.259224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528953+0000","last_change":"2024-01-20T08:11:20.522992+0000","last_active":"2024-01-20T08:11:20.528953+0000","last_peered":"2024-01-20T08:11:20.528953+0000","last_clean":"2024-01-20T08:11:20.528953+0000","last_became_active":"2024-01-20T08:11:20.522730+0000","last_became_peered":"2024-01-20T08:11:20.522730+0000","last_unstale":"2024-01-20T08:11:20.528953+0000","last_undegraded":"2024-01-20T08:11:20.528953+0000","last_fullsized":"2024-01-20T08:11:20.528953+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:36.488212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.482595+0000","last_change":"2024-01-20T08:11:05.263742+0000","last_active":"2024-01-20T08:11:19.482595+0000","last_peered":"2024-01-20T08:11:19.482595+0000","last_clean":"2024-01-20T08:11:19.482595+0000","last_became_active":"2024-01-20T08:11:05.263437+0000","last_became_peered":"2024-01-20T08:11:05.263437+0000","last_unstale":"2024-01-20T08:11:19.482595+0000","last_undegraded":"2024-01-20T08:11:19.482595+0000","last_fullsized":"2024-01-20T08:11:19.482595+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:08:50.111314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.519604+0000","last_change":"2024-01-20T08:11:20.517677+0000","last_active":"2024-01-20T08:11:20.519604+0000","last_peered":"2024-01-20T08:11:20.519604+0000","last_clean":"2024-01-20T08:11:20.519604+0000","last_became_active":"2024-01-20T08:11:20.517415+0000","last_became_peered":"2024-01-20T08:11:20.517415+0000","last_unstale":"2024-01-20T08:11:20.519604+0000","last_undegraded":"2024-01-20T08:11:20.519604+0000","last_fullsized":"2024-01-20T08:11:20.519604+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:31:56.198135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.496202+0000","last_change":"2024-01-20T08:11:05.276439+0000","last_active":"2024-01-20T08:11:19.496202+0000","last_peered":"2024-01-20T08:11:19.496202+0000","last_clean":"2024-01-20T08:11:19.496202+0000","last_became_active":"2024-01-20T08:11:05.273677+0000","last_became_peered":"2024-01-20T08:11:05.273677+0000","last_unstale":"2024-01-20T08:11:19.496202+0000","last_undegraded":"2024-01-20T08:11:19.496202+0000","last_fullsized":"2024-01-20T08:11:19.496202+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:28:17.567224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.3f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.535432+0000","last_change":"2024-01-20T08:11:20.534294+0000","last_active":"2024-01-20T08:11:20.535432+0000","last_peered":"2024-01-20T08:11:20.535432+0000","last_clean":"2024-01-20T08:11:20.535432+0000","last_became_active":"2024-01-20T08:11:20.532430+0000","last_became_peered":"2024-01-20T08:11:20.532430+0000","last_unstale":"2024-01-20T08:11:20.535432+0000","last_undegraded":"2024-01-20T08:11:20.535432+0000","last_fullsized":"2024-01-20T08:11:20.535432+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:57.773276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.508190+0000","last_change":"2024-01-20T08:11:05.263675+0000","last_active":"2024-01-20T08:11:19.508190+0000","last_peered":"2024-01-20T08:11:19.508190+0000","last_clean":"2024-01-20T08:11:19.508190+0000","last_became_active":"2024-01-20T08:11:05.262876+0000","last_became_peered":"2024-01-20T08:11:05.262876+0000","last_unstale":"2024-01-20T08:11:19.508190+0000","last_undegraded":"2024-01-20T08:11:19.508190+0000","last_fullsized":"2024-01-20T08:11:19.508190+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:34:32.386343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.528423+0000","last_change":"2024-01-20T08:11:20.521916+0000","last_active":"2024-01-20T08:11:20.528423+0000","last_peered":"2024-01-20T08:11:20.528423+0000","last_clean":"2024-01-20T08:11:20.528423+0000","last_became_active":"2024-01-20T08:11:20.521458+0000","last_became_peered":"2024-01-20T08:11:20.521458+0000","last_unstale":"2024-01-20T08:11:20.528423+0000","last_undegraded":"2024-01-20T08:11:20.528423+0000","last_fullsized":"2024-01-20T08:11:20.528423+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:32.391149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.495192+0000","last_change":"2024-01-20T08:11:05.268340+0000","last_active":"2024-01-20T08:11:19.495192+0000","last_peered":"2024-01-20T08:11:19.495192+0000","last_clean":"2024-01-20T08:11:19.495192+0000","last_became_active":"2024-01-20T08:11:05.268008+0000","last_became_peered":"2024-01-20T08:11:05.268008+0000","last_unstale":"2024-01-20T08:11:19.495192+0000","last_undegraded":"2024-01-20T08:11:19.495192+0000","last_fullsized":"2024-01-20T08:11:19.495192+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:01:26.615693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-01-20T08:11:20.519405+0000","last_change":"2024-01-20T08:11:20.509963+0000","last_active":"2024-01-20T08:11:20.519405+0000","last_peered":"2024-01-20T08:11:20.519405+0000","last_clean":"2024-01-20T08:11:20.519405+0000","last_became_active":"2024-01-20T08:11:20.508285+0000","last_became_peered":"2024-01-20T08:11:20.508285+0000","last_unstale":"2024-01-20T08:11:20.519405+0000","last_undegraded":"2024-01-20T08:11:20.519405+0000","last_fullsized":"2024-01-20T08:11:20.519405+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:19.455763+0000","last_clean_scrub_stamp":"2024-01-20T08:11:19.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:29.381750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.3f","version":"0'0","reported_seq":14,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-01-20T08:11:19.513444+0000","last_change":"2024-01-20T08:11:05.275929+0000","last_active":"2024-01-20T08:11:19.513444+0000","last_peered":"2024-01-20T08:11:19.513444+0000","last_clean":"2024-01-20T08:11:19.513444+0000","last_became_active":"2024-01-20T08:11:05.275558+0000","last_became_peered":"2024-01-20T08:11:05.275558+0000","last_unstale":"2024-01-20T08:11:19.513444+0000","last_undegraded":"2024-01-20T08:11:19.513444+0000","last_fullsized":"2024-01-20T08:11:19.513444+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:11:04.197847+0000","last_clean_scrub_stamp":"2024-01-20T08:11:04.197847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:02:36.196721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574867,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32168,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339672,"statfs":{"total":96636764160,"available":96603824128,"internally_reserved":0,"allocated":1007616,"data_stored":753795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":3.008,"5min":3.008,"15min":3.008},"last":1.131},{"interface":"front","average":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":1.5089999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.843,"5min":1.843,"15min":1.843},"last":1.373},{"interface":"front","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.4419999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":2.1019999999999999,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.4810000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.712}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.7599999999999998,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.349,"5min":1.349,"15min":1.349},"min":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"max":{"1min":2.5710000000000002,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":0.97899999999999998}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.3570000000000002,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.526},{"interface":"front","average":{"1min":1.7210000000000001,"5min":1.7210000000000001,"15min":1.7210000000000001},"min":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":3.54,"5min":3.54,"15min":3.54},"last":1.623}]},{"osd":5,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"max":{"1min":3.069,"5min":3.069,"15min":3.069},"last":1.198},{"interface":"front","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"max":{"1min":3.1040000000000001,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.2869999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"max":{"1min":3.0840000000000001,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.579},{"interface":"front","average":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"min":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"max":{"1min":3.786,"5min":3.786,"15min":3.786},"last":1.339}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":438272,"data_stored":172258,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.621},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.56399999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":0.92400000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.871}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.0960000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.139}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.323},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.377}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.254},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.431}]}]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":434176,"data_stored":171712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.319,"5min":1.319,"15min":1.319},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.93700000000000006}]},{"osd":1,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1.2909999999999999},{"interface":"front","average":{"1min":1.129,"5min":1.129,"15min":1.129},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.615,"5min":1.615,"15min":1.615},"last":1.3740000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"min":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":2.4249999999999998,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.548}]},{"osd":3,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"max":{"1min":1.776,"5min":1.776,"15min":1.776},"last":1.206},{"interface":"front","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.6739999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.335}]},{"osd":4,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.4059999999999999,"5min":1.4059999999999999,"15min":1.4059999999999999},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3069999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.4359999999999999},{"interface":"front","average":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"min":{"1min":0.753,"5min":0.753,"15min":0.753},"max":{"1min":2.7949999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.0049999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.538,"5min":1.538,"15min":1.538},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":4.2220000000000004,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2509999999999999},{"interface":"front","average":{"1min":1.579,"5min":1.579,"15min":1.579},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.8399999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.129}]},{"osd":7,"last update":"Sat Jan 20 08:11:03 2024","interfaces":[{"interface":"back","average":{"1min":1.577,"5min":1.577,"15min":1.577},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.4990000000000001,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.758,"5min":1.758,"15min":1.758},"min":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"max":{"1min":4.1159999999999997,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4099999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31592,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340248,"statfs":{"total":96636764160,"available":96604413952,"internally_reserved":0,"allocated":417792,"data_stored":163441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":3.165,"5min":3.165,"15min":3.165},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.022,"15min":1.022},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.71,"5min":1.71,"15min":1.71},"last":1.1970000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":7.3179999999999996,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":6.7089999999999996,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.87}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.3479999999999999,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.399}]},{"osd":3,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":2.613,"5min":2.613,"15min":2.613},"last":1.248}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.591},{"interface":"front","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.6589999999999998,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.97899999999999998}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.353},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":2.2429999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6379999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"max":{"1min":3.0019999999999998,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.179},{"interface":"front","average":{"1min":1.603,"5min":1.603,"15min":1.603},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":2.7149999999999999,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5329999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":450560,"data_stored":174737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.996},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":1.2030000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.2629999999999999},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7529999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.3480000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.101,"15min":1.101},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":3.02,"5min":3.02,"15min":3.02},"last":1.4750000000000001},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.3959999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.635}]},{"osd":4,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.256,"5min":1.256,"15min":1.256},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.2090000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.2080000000000002,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.6080000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":1.524},{"interface":"front","average":{"1min":1.369,"5min":1.369,"15min":1.369},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.359,"5min":2.359,"15min":2.359},"last":1.4390000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.4319999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.669},{"interface":"front","average":{"1min":1.337,"5min":1.337,"15min":1.337},"min":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.589}]},{"osd":7,"last update":"Sat Jan 20 08:11:00 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"min":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.286,"5min":2.286,"15min":2.286},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":2.0859999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":172674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.93999999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":2.0249999999999999,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.995}]},{"osd":3,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.3460000000000001,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.177,"5min":2.177,"15min":2.177},"last":0.84799999999999998}]},{"osd":4,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":1,"5min":1,"15min":1},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.256},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9790000000000001,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3240000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":1.034,"5min":1.034,"15min":1.034},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.284},{"interface":"front","average":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"min":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"max":{"1min":2.29,"5min":2.29,"15min":2.29},"last":1.161}]},{"osd":6,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.734,"5min":2.734,"15min":2.734},"last":1.397},{"interface":"front","average":{"1min":1.569,"5min":1.569,"15min":1.569},"min":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"max":{"1min":3.2530000000000001,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.244}]},{"osd":7,"last update":"Sat Jan 20 08:11:02 2024","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"min":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"max":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.669,"5min":1.669,"15min":1.669},"min":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.361}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":425984,"data_stored":166466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.64400000000000002}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.1120000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.995},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.4219999999999999,"5min":1.4219999999999999,"15min":1.4219999999999999},"last":0.96599999999999997}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.7949999999999999,"5min":1.7949999999999999,"15min":1.7949999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.069,"5min":2.069,"15min":2.069},"last":1.2130000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.1599999999999999},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5049999999999999},{"interface":"front","average":{"1min":1.407,"5min":1.407,"15min":1.407},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.845,"5min":1.845,"15min":1.845},"last":1.252}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.74,"5min":1.74,"15min":1.74},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.1299999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1990000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1019904,"data_stored":761372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.105},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.878}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0309999999999999},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2849999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.133},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.196}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.3080000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.417}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.353},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.256}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.331},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.3720000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:11:25.434 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:11:25.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-20T08:11:25.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.686+0000 7f1536800640 1 Processor -- start 2024-01-20T08:11:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.686+0000 7f1536800640 1 -- start start 2024-01-20T08:11:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.687+0000 7f1536800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f153006b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f1536800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15300c4f70 con 0x7f1530157e70 2024-01-20T08:11:25.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f1536800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1530158a20 con 0x7f15300c4ae0 2024-01-20T08:11:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f1536800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1530152360 con 0x7f15300c9b10 2024-01-20T08:11:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f152f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1530157e70 0x7f1530158250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51782/0 (socket says 172.21.15.100:51782) 2024-01-20T08:11:25.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f152f400640 1 -- 172.21.15.100:0/917995078 learned_addr learned my addr 172.21.15.100:0/917995078 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f1526800640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f153006b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1543175503 0 0) 0x7f15300c4f70 con 0x7f1530157e70 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.688+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1510003520 con 0x7f1530157e70 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 95998132 0 0) 0x7f1510003520 con 0x7f1530157e70 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 msgr2=0x7f153006b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f153006b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 >> v1:172.21.15.110:6789/0 conn(0x7f15300c4ae0 legacy=0x7f1530155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1530158d00 con 0x7f1530157e70 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f1520001670 con 0x7f1530157e70 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 >> v1:172.21.15.100:6789/0 conn(0x7f1530157e70 legacy=0x7f1530158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f15100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1510003f20 0x7f15100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f1510005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1530152360 con 0x7f1510004d00 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151000bb10 con 0x7f1510003f20 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f151000bcd0 con 0x7f15300c9b10 2024-01-20T08:11:25.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.689+0000 7f152fe00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f1510005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f1526800640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1510003f20 0x7f15100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152f400640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f15100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152fe00640 1 -- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 msgr2=0x7f15100039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152fe00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f15100039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152fe00640 1 -- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1510003f20 msgr2=0x7f15100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152fe00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1510003f20 0x7f15100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152fe00640 1 -- 172.21.15.100:0/917995078 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1510003520 con 0x7f1510004d00 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.690+0000 7f152f400640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15300c9b10 0x7f15100039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.691+0000 7f152fe00640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f1510005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1528001e50 tx=0x7f15100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5077af7c016686fb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.691+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528003b70 con 0x7f1510004d00 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.691+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1528003cd0 con 0x7f1510004d00 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.691+0000 7f152ea00640 1 -- 172.21.15.100:0/917995078 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1528005310 con 0x7f1510004d00 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 -- 172.21.15.100:0/917995078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 msgr2=0x7f1510005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 --2- 172.21.15.100:0/917995078 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f1510005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1528001e50 tx=0x7f15100057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f152fe00640 1 -- 172.21.15.100:0/917995078 reap_dead start 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 -- 172.21.15.100:0/917995078 shutdown_connections 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 -- 172.21.15.100:0/917995078 >> 172.21.15.100:0/917995078 conn(0x7f15300abcf0 msgr2=0x7f15300ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 -- 172.21.15.100:0/917995078 shutdown_connections 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.692+0000 7f1536800640 1 -- 172.21.15.100:0/917995078 wait complete. 2024-01-20T08:11:25.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.694+0000 7f1536800640 1 Processor -- start 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.694+0000 7f1536800640 1 -- start start 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 0x7f15301ed390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15301ed8d0 0x7f1530154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300bd7f0 con 0x7f1510004d00 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15300be270 con 0x7f15300c4050 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1536800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15301edd60 con 0x7f15301ed8d0 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f152f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f152f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45236/0 (socket says 172.21.15.100:45236) 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f152f400640 1 -- 172.21.15.100:0/1949094926 learned_addr learned my addr 172.21.15.100:0/1949094926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:25.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.695+0000 7f1526800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 0x7f15301ed390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152fe00640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15301ed8d0 0x7f1530154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 -- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15301ed8d0 msgr2=0x7f1530154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15301ed8d0 0x7f1530154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 -- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 msgr2=0x7f15301ed390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 0x7f15301ed390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 -- 172.21.15.100:0/1949094926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15300bdcb0 con 0x7f1510004d00 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f1526800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 0x7f15301ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f152f400640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f152000d910 tx=0x7f152000ddd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.696+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200074e0 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.697+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1520007640 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.697+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15200049e0 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.697+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15300bdf90 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.697+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1530155450 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.698+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15300ab9e0 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.699+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1520004b40 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.699+0000 7f1527e00640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 0x7f150806d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.700+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1520089720 con 0x7f1510004d00 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.700+0000 7f1526800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 0x7f150806d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.700+0000 7f1526800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 0x7f150806d3e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15301e7a80 tx=0x7f1518008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:25.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.704+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1520054350 con 0x7f1510004d00 2024-01-20T08:11:25.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.966+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f15300c98f0 con 0x7f1510004d00 2024-01-20T08:11:25.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.971+0000 7f1527e00640 1 -- 172.21.15.100:0/1949094926 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v11) v1 ==== 185+0+142 (secure 0 0 0) 0x7f15200190e0 con 0x7f1510004d00 2024-01-20T08:11:25.974 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-01-20T08:11:25.974 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw== 2024-01-20T08:11:25.975 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:11:25.975 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:11:25.975 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-20T08:11:25.975 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.1 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 msgr2=0x7f150806d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 0x7f150806d3e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f15301e7a80 tx=0x7f1518008040 comp rx=0 tx=0).stop 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 msgr2=0x7f15300bd2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f152000d910 tx=0x7f152000ddd0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 shutdown_connections 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f150806af20 0x7f150806d3e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f15301ed8d0 0x7f1530154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f15300c4050 0x7f15301ed390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 --2- 172.21.15.100:0/1949094926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1510004d00 0x7f15300bd2b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:25.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 >> 172.21.15.100:0/1949094926 conn(0x7f15300abcf0 msgr2=0x7f1530155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:25.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 shutdown_connections 2024-01-20T08:11:25.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:25.975+0000 7f1536800640 1 -- 172.21.15.100:0/1949094926 wait complete. 2024-01-20T08:11:25.998 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:25.998 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:26.056 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:26.057 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:26.110 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:26.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.318+0000 7f39c6600640 1 Processor -- start 2024-01-20T08:11:26.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.318+0000 7f39c6600640 1 -- start start 2024-01-20T08:11:26.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f39c014fce0 0x7f39c0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c00a93c0 0x7f39c0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0153440 0x7f39c00aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00a9940 con 0x7f39c00a93c0 2024-01-20T08:11:26.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c01500c0 con 0x7f39c014fce0 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39c6600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0156810 con 0x7f39c0153440 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39b6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c00a93c0 0x7f39c0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39b6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39c00a93c0 0x7f39c0152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45250/0 (socket says 172.21.15.100:45250) 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.320+0000 7f39b6800640 1 -- 172.21.15.100:0/4078346922 learned_addr learned my addr 172.21.15.100:0/4078346922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39bfe00640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0153440 0x7f39c00aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39bf400640 1 --2- 172.21.15.100:0/4078346922 >> v2:172.21.15.110:3300/0 conn(0x7f39c014fce0 0x7f39c0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39b6800640 1 -- 172.21.15.100:0/4078346922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0153440 msgr2=0x7f39c00aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39b6800640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0153440 0x7f39c00aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39b6800640 1 -- 172.21.15.100:0/4078346922 >> v2:172.21.15.110:3300/0 conn(0x7f39c014fce0 msgr2=0x7f39c0153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:26.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39b6800640 1 --2- 172.21.15.100:0/4078346922 >> v2:172.21.15.110:3300/0 conn(0x7f39c014fce0 0x7f39c0153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.321+0000 7f39b6800640 1 -- 172.21.15.100:0/4078346922 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0156af0 con 0x7f39c00a93c0 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.322+0000 7f39b6800640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c00a93c0 0x7f39c0152f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39c006f970 tx=0x7f39a802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd872f881669b89f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.322+0000 7f39bea00640 1 -- 172.21.15.100:0/4078346922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8031870 con 0x7f39c00a93c0 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.322+0000 7f39bea00640 1 -- 172.21.15.100:0/4078346922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a80319d0 con 0x7f39c00a93c0 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.322+0000 7f39bea00640 1 -- 172.21.15.100:0/4078346922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8031d60 con 0x7f39c00a93c0 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 -- 172.21.15.100:0/4078346922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c00a93c0 msgr2=0x7f39c0152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c00a93c0 0x7f39c0152f00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f39c006f970 tx=0x7f39a802b910 comp rx=0 tx=0).stop 2024-01-20T08:11:26.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 -- 172.21.15.100:0/4078346922 shutdown_connections 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c0153440 0x7f39c00aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 --2- 172.21.15.100:0/4078346922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c00a93c0 0x7f39c0152f00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 --2- 172.21.15.100:0/4078346922 >> v2:172.21.15.110:3300/0 conn(0x7f39c014fce0 0x7f39c0153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 -- 172.21.15.100:0/4078346922 >> 172.21.15.100:0/4078346922 conn(0x7f39c006a5e0 msgr2=0x7f39c006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 -- 172.21.15.100:0/4078346922 shutdown_connections 2024-01-20T08:11:26.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.323+0000 7f39c6600640 1 -- 172.21.15.100:0/4078346922 wait complete. 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.325+0000 7f39c6600640 1 Processor -- start 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.325+0000 7f39c6600640 1 -- start start 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c00a93c0 0x7f39c01eae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c014fce0 0x7f39c01ee2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01ee820 con 0x7f39c0153440 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c01ea360 con 0x7f39c014fce0 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39c6600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00c27c0 con 0x7f39c00a93c0 2024-01-20T08:11:26.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.326+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45254/0 (socket says 172.21.15.100:45254) 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 -- 172.21.15.100:0/1999837472 learned_addr learned my addr 172.21.15.100:0/1999837472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39b6800640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c014fce0 0x7f39c01ee2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bf400640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c00a93c0 0x7f39c01eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 -- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c00a93c0 msgr2=0x7f39c01eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c00a93c0 0x7f39c01eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 -- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c014fce0 msgr2=0x7f39c01ee2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c014fce0 0x7f39c01ee2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 -- 172.21.15.100:0/1999837472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80094d0 con 0x7f39c0153440 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.327+0000 7f39bfe00640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007e30 tx=0x7f39b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.328+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b8014620 con 0x7f39c0153440 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.328+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b800ee90 con 0x7f39c0153440 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.328+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c00c2aa0 con 0x7f39c0153440 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.328+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b80149c0 con 0x7f39c0153440 2024-01-20T08:11:26.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.328+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01ea900 con 0x7f39c0153440 2024-01-20T08:11:26.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.329+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c004e970 con 0x7f39c0153440 2024-01-20T08:11:26.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.330+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f39b8014b20 con 0x7f39c0153440 2024-01-20T08:11:26.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.331+0000 7f39b7e00640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 0x7f399806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.331+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f39b808a340 con 0x7f39c0153440 2024-01-20T08:11:26.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.331+0000 7f39bf400640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 0x7f399806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.332+0000 7f39bf400640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 0x7f399806d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39b0006fd0 tx=0x7f39b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.335+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f39b8054ea0 con 0x7f39c0153440 2024-01-20T08:11:26.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.528+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f39c006b320 con 0x7f39c0153440 2024-01-20T08:11:26.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.530+0000 7f39b7e00640 1 -- 172.21.15.100:0/1999837472 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f39b80584c0 con 0x7f39c0153440 2024-01-20T08:11:26.534 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:26.534 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 msgr2=0x7f399806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 0x7f399806d3c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f39b0006fd0 tx=0x7f39b0008040 comp rx=0 tx=0).stop 2024-01-20T08:11:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 msgr2=0x7f39c00c5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f39b8007e30 tx=0x7f39b800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 shutdown_connections 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39c0153440 0x7f39c00c5390 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39c014fce0 0x7f39c01ee2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f399806af00 0x7f399806d3c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 --2- 172.21.15.100:0/1999837472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f39c00a93c0 0x7f39c01eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 >> 172.21.15.100:0/1999837472 conn(0x7f39c006a5e0 msgr2=0x7f39c0151b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 shutdown_connections 2024-01-20T08:11:26.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.533+0000 7f39c6600640 1 -- 172.21.15.100:0/1999837472 wait complete. 2024-01-20T08:11:26.558 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:11:02.438552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:11:03.706270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:11:18.055571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:11:18.935347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:26.558 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.746+0000 7f9cbec00640 1 Processor -- start 2024-01-20T08:11:26.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.746+0000 7f9cbec00640 1 -- start start 2024-01-20T08:11:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.747+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 0x7f9cb8155060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.747+0000 7f9cbec00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb8158b80 con 0x7f9cb80c4880 2024-01-20T08:11:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.747+0000 7f9cbec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb80c8510 con 0x7f9cb8151d90 2024-01-20T08:11:26.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.747+0000 7f9cbec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8152170 con 0x7f9cb80c4ce0 2024-01-20T08:11:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cbce00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9cb80c4880 0x7f9cb8154950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51794/0 (socket says 172.21.15.100:51794) 2024-01-20T08:11:26.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cbce00640 1 -- 172.21.15.100:0/3844594747 learned_addr learned my addr 172.21.15.100:0/3844594747 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:26.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649180136 0 0) 0x7f9cb8158b80 con 0x7f9cb80c4880 2024-01-20T08:11:26.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 0x7f9cb8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c98003520 con 0x7f9cb80c4880 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 961535515 0 0) 0x7f9c98003520 con 0x7f9cb80c4880 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 msgr2=0x7f9cb8155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.748+0000 7f9cb7e00640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 0x7f9cb8155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 >> v1:172.21.15.110:6789/0 conn(0x7f9cb8151d90 legacy=0x7f9cb80c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8157c90 con 0x7f9cb80c4880 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f9ca0001670 con 0x7f9cb80c4880 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 >> v1:172.21.15.100:6789/0 conn(0x7f9cb80c4880 legacy=0x7f9cb8154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 0x7f9c980039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98003f70 0x7f9c980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c98004d00 0x7f9c98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8152170 con 0x7f9c98004d00 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9800bb70 con 0x7f9c98003f70 2024-01-20T08:11:26.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9800bd30 con 0x7f9cb80c4ce0 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c98004d00 0x7f9c98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 -- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 msgr2=0x7f9c980039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb80c4ce0 0x7f9c980039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 -- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98003f70 msgr2=0x7f9c980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98003f70 0x7f9c980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.749+0000 7f9cbe200640 1 -- 172.21.15.100:0/3844594747 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c98003520 con 0x7f9c98004d00 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.750+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c98004d00 0x7f9c98005180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009fa0 tx=0x7f9c980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889ad63db865bdf1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb002cce0 con 0x7f9c98004d00 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb000f040 con 0x7f9c98004d00 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cb7e00640 1 -- 172.21.15.100:0/3844594747 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0034660 con 0x7f9c98004d00 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 -- 172.21.15.100:0/3844594747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c98004d00 msgr2=0x7f9c98005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3844594747 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c98004d00 0x7f9c98005180 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0009fa0 tx=0x7f9c980057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbe200640 1 -- 172.21.15.100:0/3844594747 reap_dead start 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 -- 172.21.15.100:0/3844594747 shutdown_connections 2024-01-20T08:11:26.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 -- 172.21.15.100:0/3844594747 >> 172.21.15.100:0/3844594747 conn(0x7f9cb8071ef0 msgr2=0x7f9cb8072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 -- 172.21.15.100:0/3844594747 shutdown_connections 2024-01-20T08:11:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.751+0000 7f9cbec00640 1 -- 172.21.15.100:0/3844594747 wait complete. 2024-01-20T08:11:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.753+0000 7f9cbec00640 1 Processor -- start 2024-01-20T08:11:26.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.753+0000 7f9cbec00640 1 -- start start 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98004d00 0x7f9cb80af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb8147050 0x7f9cb81474d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8156d20 con 0x7f9cb80c3890 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80ad960 con 0x7f9c98004d00 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80afb90 con 0x7f9cb8147050 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45276/0 (socket says 172.21.15.100:45276) 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.754+0000 7f9cbce00640 1 -- 172.21.15.100:0/3208009785 learned_addr learned my addr 172.21.15.100:0/3208009785 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbd800640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98004d00 0x7f9cb80af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbe200640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb8147050 0x7f9cb81474d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 -- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb8147050 msgr2=0x7f9cb81474d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb8147050 0x7f9cb81474d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 -- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98004d00 msgr2=0x7f9cb80af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98004d00 0x7f9cb80af110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 -- 172.21.15.100:0/3208009785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80c34e0 con 0x7f9cb80c3890 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbce00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000fd0 tx=0x7f9ca000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca00074e0 con 0x7f9cb80c3890 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca0007640 con 0x7f9cb80c3890 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0004a00 con 0x7f9cb80c3890 2024-01-20T08:11:26.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb80ad680 con 0x7f9cb80c3890 2024-01-20T08:11:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.755+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb80c3e70 con 0x7f9cb80c3890 2024-01-20T08:11:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.757+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb81571b0 con 0x7f9cb80c3890 2024-01-20T08:11:26.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.757+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9ca0004b60 con 0x7f9cb80c3890 2024-01-20T08:11:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.759+0000 7f9cb5600640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 0x7f9c9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:26.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.759+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9ca0088d50 con 0x7f9cb80c3890 2024-01-20T08:11:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.759+0000 7f9cbd800640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 0x7f9c9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:26.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.759+0000 7f9cbd800640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 0x7f9c9006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c3310 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:26.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.763+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9cb81571b0 con 0x7f9cb80c3890 2024-01-20T08:11:26.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.954+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cb81571b0 con 0x7f9cb80c3890 2024-01-20T08:11:26.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.955+0000 7f9cb5600640 1 -- 172.21.15.100:0/3208009785 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cb81571b0 con 0x7f9cb80c3890 2024-01-20T08:11:26.958 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 msgr2=0x7f9c9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 0x7f9c9006d3c0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9cb80c3310 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 msgr2=0x7f9cb80af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0000fd0 tx=0x7f9ca000cc20 comp rx=0 tx=0).stop 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 shutdown_connections 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c9006af00 0x7f9c9006d3c0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9cb8147050 0x7f9cb81474d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cb80c3890 0x7f9cb80af650 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 --2- 172.21.15.100:0/3208009785 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c98004d00 0x7f9cb80af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 >> 172.21.15.100:0/3208009785 conn(0x7f9cb8071ef0 msgr2=0x7f9cb80c86a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 shutdown_connections 2024-01-20T08:11:26.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:26.958+0000 7f9cbec00640 1 -- 172.21.15.100:0/3208009785 wait complete. 2024-01-20T08:11:26.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:11:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.187+0000 7f1094600640 1 Processor -- start 2024-01-20T08:11:27.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.187+0000 7f1094600640 1 -- start start 2024-01-20T08:11:27.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c0c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f108c06d0c0 0x7f108c156030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 0x7f108c156570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c0709b0 con 0x7f108c06d0c0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108c06e250 con 0x7f108c0c0fd0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1094600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c06dc90 con 0x7f108c15c4e0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1091200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f108c06d0c0 0x7f108c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1091200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f108c06d0c0 0x7f108c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45292/0 (socket says 172.21.15.100:45292) 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1091200640 1 -- 172.21.15.100:0/4162953948 learned_addr learned my addr 172.21.15.100:0/4162953948 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1091c00640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c0c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.189+0000 7f1092600640 1 --2- 172.21.15.100:0/4162953948 >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 0x7f108c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1091200640 1 -- 172.21.15.100:0/4162953948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 msgr2=0x7f108c0c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1091200640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c0c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1091200640 1 -- 172.21.15.100:0/4162953948 >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 msgr2=0x7f108c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1091200640 1 --2- 172.21.15.100:0/4162953948 >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 0x7f108c156570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1091200640 1 -- 172.21.15.100:0/4162953948 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f108c06df70 con 0x7f108c06d0c0 2024-01-20T08:11:27.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.190+0000 7f1092600640 1 --2- 172.21.15.100:0/4162953948 >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 0x7f108c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.191+0000 7f1091200640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c156030 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f108c0c2770 tx=0x7f107402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7996322181136725 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.191+0000 7f108be00640 1 -- 172.21.15.100:0/4162953948 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074031750 con 0x7f108c06d0c0 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.191+0000 7f108be00640 1 -- 172.21.15.100:0/4162953948 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10740318b0 con 0x7f108c06d0c0 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.191+0000 7f108be00640 1 -- 172.21.15.100:0/4162953948 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1074031c40 con 0x7f108c06d0c0 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 -- 172.21.15.100:0/4162953948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 msgr2=0x7f108c156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c156030 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f108c0c2770 tx=0x7f107402b7f0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 -- 172.21.15.100:0/4162953948 shutdown_connections 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 --2- 172.21.15.100:0/4162953948 >> v2:172.21.15.110:3300/0 conn(0x7f108c0c0fd0 0x7f108c156570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c156030 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 --2- 172.21.15.100:0/4162953948 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c0c0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 -- 172.21.15.100:0/4162953948 >> 172.21.15.100:0/4162953948 conn(0x7f108c0c6090 msgr2=0x7f108c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 -- 172.21.15.100:0/4162953948 shutdown_connections 2024-01-20T08:11:27.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.192+0000 7f1094600640 1 -- 172.21.15.100:0/4162953948 wait complete. 2024-01-20T08:11:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.194+0000 7f1094600640 1 Processor -- start 2024-01-20T08:11:27.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.194+0000 7f1094600640 1 -- start start 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f108c0c0fd0 0x7f108c14e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c1ee840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1ee420 con 0x7f108c06d0c0 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108c0abce0 con 0x7f108c0c0fd0 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1094600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108c1ee0a0 con 0x7f108c15c4e0 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45296/0 (socket says 172.21.15.100:45296) 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 -- 172.21.15.100:0/1777141003 learned_addr learned my addr 172.21.15.100:0/1777141003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 -- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 msgr2=0x7f108c1ee840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c1ee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 -- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f108c0c0fd0 msgr2=0x7f108c14e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f108c0c0fd0 0x7f108c14e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.195+0000 7f1091c00640 1 -- 172.21.15.100:0/1777141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740094d0 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1091c00640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d830 tx=0x7f107c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00b6c0 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107c00b820 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f107c00bbb0 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f108c15b800 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.196+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108c15baa0 con 0x7f108c06d0c0 2024-01-20T08:11:27.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.197+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f108c04ea50 con 0x7f108c06d0c0 2024-01-20T08:11:27.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.198+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f107c01e460 con 0x7f108c06d0c0 2024-01-20T08:11:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.199+0000 7f1089600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 0x7f106406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.199+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f107c08a080 con 0x7f108c06d0c0 2024-01-20T08:11:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.199+0000 7f1091200640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 0x7f106406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.200+0000 7f1091200640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 0x7f106406d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1074035000 tx=0x7f1074030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.203+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f107c0bd0d0 con 0x7f108c06d0c0 2024-01-20T08:11:27.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.380+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f108c1ee690 con 0x7f108c06d0c0 2024-01-20T08:11:27.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.381+0000 7f1089600640 1 -- 172.21.15.100:0/1777141003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f107c054be0 con 0x7f108c06d0c0 2024-01-20T08:11:27.384 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 msgr2=0x7f106406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 0x7f106406d390 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1074035000 tx=0x7f1074030000 comp rx=0 tx=0).stop 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 msgr2=0x7f108c1f20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f107c00d830 tx=0x7f107c00dcf0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 shutdown_connections 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f106406aed0 0x7f106406d390 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f108c15c4e0 0x7f108c1ee840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f108c0c0fd0 0x7f108c14e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 --2- 172.21.15.100:0/1777141003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f108c06d0c0 0x7f108c1f20a0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 >> 172.21.15.100:0/1777141003 conn(0x7f108c0c6090 msgr2=0x7f108c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.383+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 shutdown_connections 2024-01-20T08:11:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.384+0000 7f1094600640 1 -- 172.21.15.100:0/1777141003 wait complete. 2024-01-20T08:11:27.405 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:11:27.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.613+0000 7f362c200640 1 Processor -- start 2024-01-20T08:11:27.616 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.613+0000 7f362c200640 1 -- start start 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f362c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362414b720 0x7f36241515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f362c200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36240c1850 0x7f36240c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f362c200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3624154ba0 con 0x7f362406c8d0 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f362c200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362414bb00 con 0x7f36240c1850 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f362c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3624155a00 con 0x7f362414b720 2024-01-20T08:11:27.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f3628e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36240c1850 0x7f36240c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.615+0000 7f3628e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f36240c1850 0x7f36240c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45310/0 (socket says 172.21.15.100:45310) 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3628e00640 1 -- 172.21.15.100:0/2620382920 learned_addr learned my addr 172.21.15.100:0/2620382920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3629800640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362414b720 0x7f36241515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3628e00640 1 -- 172.21.15.100:0/2620382920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362414b720 msgr2=0x7f36241515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3628e00640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362414b720 0x7f36241515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3628e00640 1 -- 172.21.15.100:0/2620382920 >> v1:172.21.15.100:6789/0 conn(0x7f362406c8d0 legacy=0x7f362406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.616+0000 7f3628e00640 1 -- 172.21.15.100:0/2620382920 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3624154df0 con 0x7f36240c1850 2024-01-20T08:11:27.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.617+0000 7f3628e00640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36240c1850 0x7f36240c1cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f360c009e50 tx=0x7f360c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad97a61ec7da5f91 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.617+0000 7f3623e00640 1 -- 172.21.15.100:0/2620382920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c02ec80 con 0x7f36240c1850 2024-01-20T08:11:27.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.617+0000 7f3623e00640 1 -- 172.21.15.100:0/2620382920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f360c02ede0 con 0x7f36240c1850 2024-01-20T08:11:27.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.617+0000 7f3623e00640 1 -- 172.21.15.100:0/2620382920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f360c036610 con 0x7f36240c1850 2024-01-20T08:11:27.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 -- 172.21.15.100:0/2620382920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36240c1850 msgr2=0x7f36240c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36240c1850 0x7f36240c1cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f360c009e50 tx=0x7f360c02e0e0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 -- 172.21.15.100:0/2620382920 shutdown_connections 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f36240c1850 0x7f36240c1cd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 --2- 172.21.15.100:0/2620382920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362414b720 0x7f36241515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 -- 172.21.15.100:0/2620382920 >> 172.21.15.100:0/2620382920 conn(0x7f36240c2940 msgr2=0x7f36240c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 -- 172.21.15.100:0/2620382920 shutdown_connections 2024-01-20T08:11:27.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.618+0000 7f362c200640 1 -- 172.21.15.100:0/2620382920 wait complete. 2024-01-20T08:11:27.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.620+0000 7f362c200640 1 Processor -- start 2024-01-20T08:11:27.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.620+0000 7f362c200640 1 -- start start 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362406c8d0 0x7f36241dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 0x7f36241e9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241e5ed0 con 0x7f362414b720 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36241dacb0 con 0x7f36240c1850 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36241daf50 con 0x7f362406c8d0 2024-01-20T08:11:27.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45322/0 (socket says 172.21.15.100:45322) 2024-01-20T08:11:27.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.621+0000 7f362a200640 1 -- 172.21.15.100:0/3677147578 learned_addr learned my addr 172.21.15.100:0/3677147578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3629800640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362406c8d0 0x7f36241dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3628e00640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 0x7f36241e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 -- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362406c8d0 msgr2=0x7f36241dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362406c8d0 0x7f36241dd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 -- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 msgr2=0x7f36241e9770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 0x7f36241e9770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 -- 172.21.15.100:0/3677147578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c009b30 con 0x7f362414b720 2024-01-20T08:11:27.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3628e00640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 0x7f36241e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f362a200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c390 tx=0x7f361c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c0052d0 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361c005430 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.622+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361c003810 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.623+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36241db5d0 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.623+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36241dd950 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.624+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362404e970 con 0x7f362414b720 2024-01-20T08:11:27.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.625+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f361c003970 con 0x7f362414b720 2024-01-20T08:11:27.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.626+0000 7f3621600640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 0x7f35fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:27.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.626+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f361c088ee0 con 0x7f362414b720 2024-01-20T08:11:27.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.626+0000 7f3629800640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 0x7f35fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:27.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.627+0000 7f3629800640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 0x7f35fc06d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3614006fd0 tx=0x7f3614008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:27.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.631+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f361c053a40 con 0x7f362414b720 2024-01-20T08:11:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.821+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f36241e94d0 con 0x7f362414b720 2024-01-20T08:11:27.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.822+0000 7f3621600640 1 -- 172.21.15.100:0/3677147578 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f361c0170a0 con 0x7f362414b720 2024-01-20T08:11:27.826 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.824+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 msgr2=0x7f35fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.824+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 0x7f35fc06d390 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3614006fd0 tx=0x7f3614008040 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.824+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 msgr2=0x7f36241e9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.824+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f361c00c390 tx=0x7f361c00c850 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 shutdown_connections 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f362414b720 0x7f36241e9cb0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f36240c1850 0x7f36241e9770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f35fc06aed0 0x7f35fc06d390 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 --2- 172.21.15.100:0/3677147578 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f362406c8d0 0x7f36241dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 >> 172.21.15.100:0/3677147578 conn(0x7f36240c2940 msgr2=0x7f36240c5190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 shutdown_connections 2024-01-20T08:11:27.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:27.825+0000 7f362c200640 1 -- 172.21.15.100:0/3677147578 wait complete. 2024-01-20T08:11:27.845 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:11:28.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.051+0000 7fe4f5400640 1 Processor -- start 2024-01-20T08:11:28.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.052+0000 7fe4f5400640 1 -- start start 2024-01-20T08:11:28.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.053+0000 7fe4f5400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe4f00c5180 0x7fe4f00c60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.053+0000 7fe4f5400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f006b640 con 0x7fe4f006bad0 2024-01-20T08:11:28.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.053+0000 7fe4f5400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4f006bf40 con 0x7fe4f0155500 2024-01-20T08:11:28.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.053+0000 7fe4f5400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4f006c600 con 0x7fe4f00c5180 2024-01-20T08:11:28.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.054+0000 7fe4ede00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe4f006bad0 0x7fe4f00c83e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51824/0 (socket says 172.21.15.100:51824) 2024-01-20T08:11:28.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.054+0000 7fe4ede00640 1 -- 172.21.15.100:0/4002291727 learned_addr learned my addr 172.21.15.100:0/4002291727 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:28.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.054+0000 7fe4ee800640 1 --2- 172.21.15.100:0/4002291727 >> v2:172.21.15.110:3300/0 conn(0x7fe4f00c5180 0x7fe4f00c60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.054+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 290438830 0 0) 0x7fe4f006b640 con 0x7fe4f006bad0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.054+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4d0003520 con 0x7fe4f006bad0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 498274421 0 0) 0x7fe4d0003520 con 0x7fe4f006bad0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 >> v2:172.21.15.110:3300/0 conn(0x7fe4f00c5180 msgr2=0x7fe4f00c60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 --2- 172.21.15.100:0/4002291727 >> v2:172.21.15.110:3300/0 conn(0x7fe4f00c5180 0x7fe4f00c60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 >> v1:172.21.15.110:6789/0 conn(0x7fe4f0155500 legacy=0x7fe4f0151da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f00c69e0 con 0x7fe4f006bad0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe4d80019f0 con 0x7fe4f006bad0 2024-01-20T08:11:28.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 >> v1:172.21.15.100:6789/0 conn(0x7fe4f006bad0 legacy=0x7fe4f00c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 0x7fe4d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d00047c0 0x7fe4d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0005180 0x7fe4d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d000c0f0 con 0x7fe4d0003970 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d000c260 con 0x7fe4d00047c0 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4d000c420 con 0x7fe4d0005180 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ee800640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 0x7fe4d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ede00640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d00047c0 0x7fe4d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ef200640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0005180 0x7fe4d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ee800640 1 -- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0005180 msgr2=0x7fe4d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ee800640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0005180 0x7fe4d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.055+0000 7fe4ee800640 1 -- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d00047c0 msgr2=0x7fe4d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.056+0000 7fe4ee800640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4d00047c0 0x7fe4d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.056+0000 7fe4ee800640 1 -- 172.21.15.100:0/4002291727 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0003520 con 0x7fe4d0003970 2024-01-20T08:11:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.056+0000 7fe4ef200640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0005180 0x7fe4d000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:28.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.056+0000 7fe4ef200640 1 -- 172.21.15.100:0/4002291727 reap_dead start 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.057+0000 7fe4ee800640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 0x7fe4d0003d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009ac0 tx=0x7fe4d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dde4f9224fcc134 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.057+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e002c6b0 con 0x7fe4d0003970 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.057+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4e002c810 con 0x7fe4d0003970 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.057+0000 7fe4ed400640 1 -- 172.21.15.100:0/4002291727 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4e002cba0 con 0x7fe4d0003970 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 -- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 msgr2=0x7fe4d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 0x7fe4d0003d90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0009ac0 tx=0x7fe4d00057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 -- 172.21.15.100:0/4002291727 shutdown_connections 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 --2- 172.21.15.100:0/4002291727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4d0003970 0x7fe4d0003d90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 -- 172.21.15.100:0/4002291727 >> 172.21.15.100:0/4002291727 conn(0x7fe4f00ca5a0 msgr2=0x7fe4f00ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 -- 172.21.15.100:0/4002291727 shutdown_connections 2024-01-20T08:11:28.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.058+0000 7fe4f5400640 1 -- 172.21.15.100:0/4002291727 wait complete. 2024-01-20T08:11:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.059+0000 7fe4f5400640 1 Processor -- start 2024-01-20T08:11:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.060+0000 7fe4f5400640 1 -- start start 2024-01-20T08:11:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.060+0000 7fe4f5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0003970 0x7fe4f00af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.060+0000 7fe4f5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.060+0000 7fe4f5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 0x7fe4f01ed3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4f5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01534f0 con 0x7fe4f0153030 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4f5400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f01537d0 con 0x7fe4f0156be0 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4f5400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4f0153ab0 con 0x7fe4d0003970 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45342/0 (socket says 172.21.15.100:45342) 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 -- 172.21.15.100:0/1545890164 learned_addr learned my addr 172.21.15.100:0/1545890164 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ee800640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0003970 0x7fe4f00af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ef200640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 0x7fe4f01ed3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 -- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0003970 msgr2=0x7fe4f00af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0003970 0x7fe4f00af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 -- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 msgr2=0x7fe4f01ed3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 0x7fe4f01ed3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ede00640 1 -- 172.21.15.100:0/1545890164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f0153d90 con 0x7fe4f0153030 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.061+0000 7fe4ef200640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 0x7fe4f01ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:28.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4ede00640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8001580 tx=0x7fe4d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d800ee20 con 0x7fe4f0153030 2024-01-20T08:11:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4d8013420 con 0x7fe4f0153030 2024-01-20T08:11:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d80137d0 con 0x7fe4f0153030 2024-01-20T08:11:28.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4f01572e0 con 0x7fe4f0153030 2024-01-20T08:11:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.062+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4f01edad0 con 0x7fe4f0153030 2024-01-20T08:11:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.063+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4f0157520 con 0x7fe4f0153030 2024-01-20T08:11:28.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.064+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe4d8013930 con 0x7fe4f0153030 2024-01-20T08:11:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.065+0000 7fe4e6a00640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 0x7fe4c806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.065+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe4d808a100 con 0x7fe4f0153030 2024-01-20T08:11:28.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.066+0000 7fe4ee800640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 0x7fe4c806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.066+0000 7fe4ee800640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 0x7fe4c806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0036000 tx=0x7fe4e0030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.070+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe4f0157520 con 0x7fe4f0153030 2024-01-20T08:11:28.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.264+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4f0157520 con 0x7fe4f0153030 2024-01-20T08:11:28.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.265+0000 7fe4e6a00640 1 -- 172.21.15.100:0/1545890164 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe4f0157520 con 0x7fe4f0153030 2024-01-20T08:11:28.268 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:28.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 msgr2=0x7fe4c806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 0x7fe4c806d3c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fe4e0036000 tx=0x7fe4e0030000 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 msgr2=0x7fe4f00afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe4d8001580 tx=0x7fe4d800e530 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 shutdown_connections 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe4f0156be0 0x7fe4f01ed3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4f0153030 0x7fe4f00afc20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4c806af00 0x7fe4c806d3c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 --2- 172.21.15.100:0/1545890164 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe4d0003970 0x7fe4f00af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 >> 172.21.15.100:0/1545890164 conn(0x7fe4f00ca5a0 msgr2=0x7fe4f014a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 shutdown_connections 2024-01-20T08:11:28.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.268+0000 7fe4f5400640 1 -- 172.21.15.100:0/1545890164 wait complete. 2024-01-20T08:11:28.288 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:11:28.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.488+0000 7fbb51400640 1 Processor -- start 2024-01-20T08:11:28.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.488+0000 7fbb51400640 1 -- start start 2024-01-20T08:11:28.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb51400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb4c0a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb51400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c156710 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb51400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb4c155b00 con 0x7fbb4c0a5240 2024-01-20T08:11:28.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb51400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14fff0 con 0x7fbb4c14fc10 2024-01-20T08:11:28.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb4b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbb4c0c4ed0 0x7fbb4c0c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:51840/0 (socket says 172.21.15.100:51840) 2024-01-20T08:11:28.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb4b400640 1 -- 172.21.15.100:0/1846967947 learned_addr learned my addr 172.21.15.100:0/1846967947 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb4be00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb4c0a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.490+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 931477976 0 0) 0x7fbb4c156710 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb2c003520 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 765410703 0 0) 0x7fbb2c003520 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 msgr2=0x7fbb4c0a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb4c0a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 >> v1:172.21.15.110:6789/0 conn(0x7fbb4c0a5240 legacy=0x7fbb4c0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c155de0 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fbb34001670 con 0x7fbb4c0c4ed0 2024-01-20T08:11:28.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 >> v1:172.21.15.100:6789/0 conn(0x7fbb4c0c4ed0 legacy=0x7fbb4c0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb2c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c003f20 0x7fbb2c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c004d00 0x7fbb2c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14fff0 con 0x7fbb2c004d00 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c00bbc0 con 0x7fbb2c003f20 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2c00bd80 con 0x7fbb4c14fc10 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.491+0000 7fbb50a00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c004d00 0x7fbb2c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb4be00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb2c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb4b400640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c003f20 0x7fbb2c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb50a00640 1 -- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 msgr2=0x7fbb2c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb50a00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c14fc10 0x7fbb2c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb50a00640 1 -- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c003f20 msgr2=0x7fbb2c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb50a00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c003f20 0x7fbb2c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.492+0000 7fbb50a00640 1 -- 172.21.15.100:0/1846967947 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2c003520 con 0x7fbb2c004d00 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.493+0000 7fbb50a00640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c004d00 0x7fbb2c005180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001e50 tx=0x7fbb2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e860ff16cfe153 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.493+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44003b70 con 0x7fbb2c004d00 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.493+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb44003cd0 con 0x7fbb2c004d00 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.493+0000 7fbb4aa00640 1 -- 172.21.15.100:0/1846967947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44005310 con 0x7fbb2c004d00 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 -- 172.21.15.100:0/1846967947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c004d00 msgr2=0x7fbb2c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 --2- 172.21.15.100:0/1846967947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb2c004d00 0x7fbb2c005180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbb44001e50 tx=0x7fbb2c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb50a00640 1 -- 172.21.15.100:0/1846967947 reap_dead start 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 -- 172.21.15.100:0/1846967947 shutdown_connections 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 -- 172.21.15.100:0/1846967947 >> 172.21.15.100:0/1846967947 conn(0x7fbb4c0c5ba0 msgr2=0x7fbb4c0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 -- 172.21.15.100:0/1846967947 shutdown_connections 2024-01-20T08:11:28.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.494+0000 7fbb51400640 1 -- 172.21.15.100:0/1846967947 wait complete. 2024-01-20T08:11:28.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.496+0000 7fbb51400640 1 Processor -- start 2024-01-20T08:11:28.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.496+0000 7fbb51400640 1 -- start start 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 0x7fbb4c153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 0x7fbb4c155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c150ce0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c1504d0 con 0x7fbb2c004d00 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb51400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb4c14c350 con 0x7fbb4c154dc0 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45352/0 (socket says 172.21.15.100:45352) 2024-01-20T08:11:28.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 -- 172.21.15.100:0/2503157212 learned_addr learned my addr 172.21.15.100:0/2503157212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb50a00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 0x7fbb4c155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4be00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 0x7fbb4c153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 -- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 msgr2=0x7fbb4c155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 0x7fbb4c155270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 -- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 msgr2=0x7fbb4c153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 0x7fbb4c153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4b400640 1 -- 172.21.15.100:0/2503157212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c150720 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.497+0000 7fbb4be00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 0x7fbb4c153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb50a00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 0x7fbb4c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb4b400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400d7a0 tx=0x7fbb3400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb340074e0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb34007640 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb4c150a00 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb34004a00 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.498+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb4c1eb0e0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.499+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb4c04e970 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.503 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.500+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbb34004b60 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.501+0000 7fbb43e00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 0x7fbb2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.501+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fbb34089650 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.501+0000 7fbb4be00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 0x7fbb2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.502+0000 7fbb4be00640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 0x7fbb2406d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0a8840 tx=0x7fbb3c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.506+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbb340541b0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.705+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fbb4c0c4cb0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.705+0000 7fbb43e00640 1 -- 172.21.15.100:0/2503157212 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7fbb340577d0 con 0x7fbb4c0a7b80 2024-01-20T08:11:28.708 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 msgr2=0x7fbb2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 0x7fbb2406d390 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c0a8840 tx=0x7fbb3c008040 comp rx=0 tx=0).stop 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 msgr2=0x7fbb4c0a8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbb3400d7a0 tx=0x7fbb3400dc60 comp rx=0 tx=0).stop 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 shutdown_connections 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbb2406aed0 0x7fbb2406d390 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbb4c154dc0 0x7fbb4c155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbb4c0a7b80 0x7fbb4c0a8000 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 --2- 172.21.15.100:0/2503157212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbb2c004d00 0x7fbb4c153fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 >> 172.21.15.100:0/2503157212 conn(0x7fbb4c0c5ba0 msgr2=0x7fbb4c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 shutdown_connections 2024-01-20T08:11:28.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.708+0000 7fbb51400640 1 -- 172.21.15.100:0/2503157212 wait complete. 2024-01-20T08:11:28.730 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:11:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.925+0000 7efec8e00640 1 Processor -- start 2024-01-20T08:11:28.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.925+0000 7efec8e00640 1 -- start start 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec8e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efec414b720 0x7efec41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec8e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efec40c1d00 0x7efec406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec8e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efec4154ba0 con 0x7efec40c1850 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec8e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec414bb00 con 0x7efec414b720 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec8e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efec4155a00 con 0x7efec40c1d00 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.926+0000 7efec1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efec414b720 0x7efec41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efec414b720 0x7efec41515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45362/0 (socket says 172.21.15.100:45362) 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 -- 172.21.15.100:0/3746403551 learned_addr learned my addr 172.21.15.100:0/3746403551 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 -- 172.21.15.100:0/3746403551 >> v2:172.21.15.110:3300/0 conn(0x7efec40c1d00 msgr2=0x7efec406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 --2- 172.21.15.100:0/3746403551 >> v2:172.21.15.110:3300/0 conn(0x7efec40c1d00 0x7efec406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 -- 172.21.15.100:0/3746403551 >> v1:172.21.15.110:6789/0 conn(0x7efec40c1850 legacy=0x7efec406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:28.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.927+0000 7efec1e00640 1 -- 172.21.15.100:0/3746403551 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec4154df0 con 0x7efec414b720 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.928+0000 7efec1e00640 1 --2- 172.21.15.100:0/3746403551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec414b720 0x7efec41515b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efec4074650 tx=0x7efeb402e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1743b7366054b62 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.928+0000 7efec0a00640 1 -- 172.21.15.100:0/3746403551 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb402ee00 con 0x7efec414b720 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.928+0000 7efec0a00640 1 -- 172.21.15.100:0/3746403551 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4036440 con 0x7efec414b720 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.928+0000 7efec0a00640 1 -- 172.21.15.100:0/3746403551 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40367d0 con 0x7efec414b720 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 -- 172.21.15.100:0/3746403551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec414b720 msgr2=0x7efec41515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 --2- 172.21.15.100:0/3746403551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec414b720 0x7efec41515b0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7efec4074650 tx=0x7efeb402e050 comp rx=0 tx=0).stop 2024-01-20T08:11:28.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 -- 172.21.15.100:0/3746403551 shutdown_connections 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 --2- 172.21.15.100:0/3746403551 >> v2:172.21.15.110:3300/0 conn(0x7efec40c1d00 0x7efec406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 --2- 172.21.15.100:0/3746403551 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec414b720 0x7efec41515b0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 -- 172.21.15.100:0/3746403551 >> 172.21.15.100:0/3746403551 conn(0x7efec40c2940 msgr2=0x7efec40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 -- 172.21.15.100:0/3746403551 shutdown_connections 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.929+0000 7efec8e00640 1 -- 172.21.15.100:0/3746403551 wait complete. 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.931+0000 7efec8e00640 1 Processor -- start 2024-01-20T08:11:28.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.931+0000 7efec8e00640 1 -- start start 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec40c1d00 0x7efec413dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec414b720 0x7efec413dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec41ea010 con 0x7efec40c1850 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efec4142dc0 con 0x7efec414b720 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec8e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efec40720d0 con 0x7efec40c1d00 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45372/0 (socket says 172.21.15.100:45372) 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 -- 172.21.15.100:0/3219312297 learned_addr learned my addr 172.21.15.100:0/3219312297 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 -- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec40c1d00 msgr2=0x7efec413dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec40c1d00 0x7efec413dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 -- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec414b720 msgr2=0x7efec413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec414b720 0x7efec413dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.932+0000 7efec1e00640 1 -- 172.21.15.100:0/3219312297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb400b770 con 0x7efec40c1850 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efec1e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efeb402e090 tx=0x7efeb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4034b80 con 0x7efec40c1850 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4034ce0 con 0x7efec40c1850 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efec41e9390 con 0x7efec40c1850 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb403f640 con 0x7efec40c1850 2024-01-20T08:11:28.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.933+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efec41e9950 con 0x7efec40c1850 2024-01-20T08:11:28.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.934+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efec41ea150 con 0x7efec40c1850 2024-01-20T08:11:28.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.935+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efeb403d040 con 0x7efec40c1850 2024-01-20T08:11:28.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.936+0000 7efeba000640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 0x7efe9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:28.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.937+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efeb40ae580 con 0x7efec40c1850 2024-01-20T08:11:28.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.937+0000 7efec1400640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 0x7efe9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:28.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.937+0000 7efec1400640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 0x7efe9c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efec406df40 tx=0x7efeac0079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:28.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:28.941+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efec41ea150 con 0x7efec40c1850 2024-01-20T08:11:29.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.143+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efec41ea150 con 0x7efec40c1850 2024-01-20T08:11:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.144+0000 7efeba000640 1 -- 172.21.15.100:0/3219312297 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7efec41ea150 con 0x7efec40c1850 2024-01-20T08:11:29.147 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:11:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 msgr2=0x7efe9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 0x7efe9c06d390 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efec406df40 tx=0x7efeac0079b0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 msgr2=0x7efec40714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7efeb402e090 tx=0x7efeb40046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 shutdown_connections 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efec414b720 0x7efec413dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9c06aed0 0x7efe9c06d390 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efec40c1d00 0x7efec413dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 --2- 172.21.15.100:0/3219312297 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efec40c1850 0x7efec40714e0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 >> 172.21.15.100:0/3219312297 conn(0x7efec40c2940 msgr2=0x7efec406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.146+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 shutdown_connections 2024-01-20T08:11:29.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.147+0000 7efec8e00640 1 -- 172.21.15.100:0/3219312297 wait complete. 2024-01-20T08:11:29.167 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:11:29.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:29.167 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:29.286 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:11:29.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:29.286 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:11:29.332 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:29.332 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:29.429 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:11:29.429 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:11:29.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.643+0000 7f667f200640 1 Processor -- start 2024-01-20T08:11:29.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.643+0000 7f667f200640 1 -- start start 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 0x7f6680155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66800c0ed0 0x7f66800aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 0x7f668006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66801559b0 con 0x7f66800c0ed0 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66800c1930 con 0x7f66800c4e20 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668006c160 con 0x7f66800aae30 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f6675200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66800c0ed0 0x7f66800aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f6675200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f66800c0ed0 0x7f66800aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41204/0 (socket says 172.21.15.100:41204) 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f6675200640 1 -- 172.21.15.100:0/3294176759 learned_addr learned my addr 172.21.15.100:0/3294176759 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:29.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667de00640 1 --2- 172.21.15.100:0/3294176759 >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 0x7f6680155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f6675200640 1 -- 172.21.15.100:0/3294176759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 msgr2=0x7f668006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.645+0000 7f667e800640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 0x7f668006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f6675200640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 0x7f668006cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f6675200640 1 -- 172.21.15.100:0/3294176759 >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 msgr2=0x7f6680155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f6675200640 1 --2- 172.21.15.100:0/3294176759 >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 0x7f6680155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f6675200640 1 -- 172.21.15.100:0/3294176759 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66800c1b80 con 0x7f66800c0ed0 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f667de00640 1 --2- 172.21.15.100:0/3294176759 >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 0x7f6680155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:29.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.646+0000 7f667e800640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 0x7f668006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:29.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.647+0000 7f6675200640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f66800aa8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66800c6bb0 tx=0x7f666802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ef7ef7ad350ef3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:29.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.647+0000 7f667d400640 1 -- 172.21.15.100:0/3294176759 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668031640 con 0x7f66800c0ed0 2024-01-20T08:11:29.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.647+0000 7f667d400640 1 -- 172.21.15.100:0/3294176759 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680317a0 con 0x7f66800c0ed0 2024-01-20T08:11:29.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.647+0000 7f667d400640 1 -- 172.21.15.100:0/3294176759 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668031b30 con 0x7f66800c0ed0 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 -- 172.21.15.100:0/3294176759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 msgr2=0x7f66800aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f66800aa8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f66800c6bb0 tx=0x7f666802b8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 -- 172.21.15.100:0/3294176759 shutdown_connections 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800aae30 0x7f668006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 --2- 172.21.15.100:0/3294176759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f66800aa8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 --2- 172.21.15.100:0/3294176759 >> v2:172.21.15.110:3300/0 conn(0x7f66800c4e20 0x7f6680155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 -- 172.21.15.100:0/3294176759 >> 172.21.15.100:0/3294176759 conn(0x7f66800c5ba0 msgr2=0x7f66800c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 -- 172.21.15.100:0/3294176759 shutdown_connections 2024-01-20T08:11:29.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.648+0000 7f667f200640 1 -- 172.21.15.100:0/3294176759 wait complete. 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.649+0000 7f667f200640 1 Processor -- start 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 -- start start 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800aae30 0x7f668014fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c4e20 0x7f6680149e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66801546d0 con 0x7f66800c0ed0 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66800a6220 con 0x7f66800aae30 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.650+0000 7f667f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6680153910 con 0x7f66800c4e20 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41210/0 (socket says 172.21.15.100:41210) 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 -- 172.21.15.100:0/1756541528 learned_addr learned my addr 172.21.15.100:0/1756541528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:29.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 -- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c4e20 msgr2=0x7f6680149e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c4e20 0x7f6680149e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f667de00640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800aae30 0x7f668014fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 -- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800aae30 msgr2=0x7f668014fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800aae30 0x7f668014fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.651+0000 7f6675200640 1 -- 172.21.15.100:0/1756541528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680094d0 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f6675200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f66680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666803ac60 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f666803ade0 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6668044630 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6680153bf0 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.652+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66801541b0 con 0x7f66800c0ed0 2024-01-20T08:11:29.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.653+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66801543a0 con 0x7f66800c0ed0 2024-01-20T08:11:29.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.654+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f666802f050 con 0x7f66800c0ed0 2024-01-20T08:11:29.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.655+0000 7f6676a00640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 0x7f665806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:29.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.655+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f66680aba90 con 0x7f66800c0ed0 2024-01-20T08:11:29.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.655+0000 7f667de00640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 0x7f665806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:29.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.656+0000 7f667de00640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 0x7f665806d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66801ec430 tx=0x7f6670008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:29.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.660+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f66680765f0 con 0x7f66800c0ed0 2024-01-20T08:11:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.895+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f668004e970 con 0x7f66800c0ed0 2024-01-20T08:11:29.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.896+0000 7f6676a00640 1 -- 172.21.15.100:0/1756541528 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7f66680350b0 con 0x7f66800c0ed0 2024-01-20T08:11:29.899 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:11:29.899 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 msgr2=0x7f665806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 0x7f665806d390 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f66801ec430 tx=0x7f6670008040 comp rx=0 tx=0).stop 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 msgr2=0x7f6680152e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6668000c00 tx=0x7f66680046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 shutdown_connections 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f665806aed0 0x7f665806d390 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f66800c4e20 0x7f6680149e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66800c0ed0 0x7f6680152e00 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 --2- 172.21.15.100:0/1756541528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f66800aae30 0x7f668014fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:29.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 >> 172.21.15.100:0/1756541528 conn(0x7f66800c5ba0 msgr2=0x7f66800c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:29.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 shutdown_connections 2024-01-20T08:11:29.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:29.898+0000 7f667f200640 1 -- 172.21.15.100:0/1756541528 wait complete. 2024-01-20T08:11:29.920 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:11:29.920 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:11:29.920 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:11:29.920 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:11:29.920 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:29.921 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:11:29.921 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:11:29.921 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:11:29.921 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:29.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:29.921 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:11:29.974 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:11:29.974 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:11:29.975 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42557sec preferred_lft 42557sec 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:11:29.976 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:29.977 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:11:30.058 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:11:30.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.062 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:11:30.115 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:11:30.115 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:11:30.115 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:11:30.115 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:11:30.115 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:11:30.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:11:30.116 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:11:30.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.293 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:11:30.341 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:11:30.341 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:30.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.341 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:11:30.430 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:30.431 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:30.487 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:11:30.487 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:30.488 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:30.538 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-20T08:11:30.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.539 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:30.678 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:30.678 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:11:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:11:30.714 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:11:30.718 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:11:30.718 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:11:30.718 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:11:30.718 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:11:30.718 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:11:30.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:11:30.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.724 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:30.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:30.818 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:11:30.888 INFO:teuthology.orchestra.run.smithi110.stdout:client5301 2024-01-20T08:11:30.888 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:30.888 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:30.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs authorize cephfs client.testuser / rw 2024-01-20T08:11:31.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.168+0000 7f622c000640 1 Processor -- start 2024-01-20T08:11:31.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.168+0000 7f622c000640 1 -- start start 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 0x7f62240c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622c000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6224070680 0x7f62241587f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6224154d50 con 0x7f622406c4c0 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622c000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62241547f0 con 0x7f6224070680 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6224158d30 con 0x7f62240c1330 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f622406c4c0 0x7f62241551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55192/0 (socket says 172.21.15.100:55192) 2024-01-20T08:11:31.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f622a000640 1 -- 172.21.15.100:0/2913926322 learned_addr learned my addr 172.21.15.100:0/2913926322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.170+0000 7f6228c00640 1 --2- 172.21.15.100:0/2913926322 >> v2:172.21.15.110:3300/0 conn(0x7f6224070680 0x7f62241587f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6229600640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 0x7f62240c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239577332 0 0) 0x7f6224154d50 con 0x7f622406c4c0 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6204003520 con 0x7f622406c4c0 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2435142185 0 0) 0x7f6204003520 con 0x7f622406c4c0 2024-01-20T08:11:31.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 msgr2=0x7f62240c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 0x7f62240c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 >> v2:172.21.15.110:3300/0 conn(0x7f6224070680 msgr2=0x7f62241587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 --2- 172.21.15.100:0/2913926322 >> v2:172.21.15.110:3300/0 conn(0x7f6224070680 0x7f62241587f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62240c70d0 con 0x7f622406c4c0 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f621c001670 con 0x7f622406c4c0 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 >> v1:172.21.15.100:6789/0 conn(0x7f622406c4c0 legacy=0x7f62241551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 0x7f6204003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6204004d00 0x7f6204005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6224158d30 con 0x7f6204003f40 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620400b980 con 0x7f6204004d00 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620400bac0 con 0x7f62240c1330 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.171+0000 7f6228c00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f622a000640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6204004d00 0x7f6204005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f6228c00640 1 -- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 msgr2=0x7f6204003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f6228c00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240c1330 0x7f6204003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f6228c00640 1 -- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6204004d00 msgr2=0x7f6204005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f6228c00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6204004d00 0x7f6204005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.172+0000 7f6228c00640 1 -- 172.21.15.100:0/2913926322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6204003520 con 0x7f6204003f40 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.173+0000 7f6228c00640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62040047c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f620c00e170 tx=0x7f62040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a4b90d0a50d857 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.173+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c02cc20 con 0x7f6204003f40 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.173+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f620c00f040 con 0x7f6204003f40 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.173+0000 7f6223e00640 1 -- 172.21.15.100:0/2913926322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620c034440 con 0x7f6204003f40 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 -- 172.21.15.100:0/2913926322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 msgr2=0x7f62040047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 --2- 172.21.15.100:0/2913926322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62040047c0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f620c00e170 tx=0x7f62040057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622a000640 1 -- 172.21.15.100:0/2913926322 reap_dead start 2024-01-20T08:11:31.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 -- 172.21.15.100:0/2913926322 shutdown_connections 2024-01-20T08:11:31.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 -- 172.21.15.100:0/2913926322 >> 172.21.15.100:0/2913926322 conn(0x7f62240a9cb0 msgr2=0x7f62240aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:31.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 -- 172.21.15.100:0/2913926322 shutdown_connections 2024-01-20T08:11:31.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.174+0000 7f622c000640 1 -- 172.21.15.100:0/2913926322 wait complete. 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.176+0000 7f622c000640 1 Processor -- start 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.176+0000 7f622c000640 1 -- start start 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240aada0 0x7f62241586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f622406e2f0 0x7f62241eb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62241ea3a0 con 0x7f6204003f40 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62241ee3b0 con 0x7f622406e2f0 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f622c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62241ea640 con 0x7f62240aada0 2024-01-20T08:11:31.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41226/0 (socket says 172.21.15.100:41226) 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 -- 172.21.15.100:0/3844231690 learned_addr learned my addr 172.21.15.100:0/3844231690 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 -- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240aada0 msgr2=0x7f62241586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240aada0 0x7f62241586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 -- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f622406e2f0 msgr2=0x7f62241eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f622406e2f0 0x7f62241eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.177+0000 7f6229600640 1 -- 172.21.15.100:0/3844231690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62241ea920 con 0x7f6204003f40 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f6229600640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f621400e7c0 tx=0x7f621400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400eed0 con 0x7f6204003f40 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f621400c940 con 0x7f6204003f40 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400ccd0 con 0x7f6204003f40 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62241ee690 con 0x7f6204003f40 2024-01-20T08:11:31.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.178+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62241ebc40 con 0x7f6204003f40 2024-01-20T08:11:31.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.179+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f622406aad0 con 0x7f6204003f40 2024-01-20T08:11:31.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.180+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6214013470 con 0x7f6204003f40 2024-01-20T08:11:31.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.181+0000 7f6221600640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 0x7f61fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.181+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f62140899f0 con 0x7f6204003f40 2024-01-20T08:11:31.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.181+0000 7f6228c00640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 0x7f61fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.182+0000 7f6228c00640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 0x7f61fc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f620c036000 tx=0x7f620c02e070 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.185+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6214054560 con 0x7f6204003f40 2024-01-20T08:11:31.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.413+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]} v 0) v1 -- 0x7f62241eaab0 con 0x7f6204003f40 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.418+0000 7f6221600640 1 -- 172.21.15.100:0/3844231690 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs authorize", "filesystem": "cephfs", "entity": "client.testuser", "caps": ["/", "rw"]}]=0 v12) v1 ==== 134+0+185 (secure 0 0 0) 0x7f62140210d0 con 0x7f6204003f40 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stdout:[client.testuser] 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg== 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r fsname=cephfs" 2024-01-20T08:11:31.421 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 msgr2=0x7f61fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 0x7f61fc06d3c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f620c036000 tx=0x7f620c02e070 comp rx=0 tx=0).stop 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 msgr2=0x7f62241eae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f621400e7c0 tx=0x7f621400ec80 comp rx=0 tx=0).stop 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 shutdown_connections 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f622406e2f0 0x7f62241eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f61fc06af00 0x7f61fc06d3c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f62240aada0 0x7f62241586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 --2- 172.21.15.100:0/3844231690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6204003f40 0x7f62241eae40 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 >> 172.21.15.100:0/3844231690 conn(0x7f62240a9cb0 msgr2=0x7f62241501c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:31.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 shutdown_connections 2024-01-20T08:11:31.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.421+0000 7f622c000640 1 -- 172.21.15.100:0/3844231690 wait complete. 2024-01-20T08:11:31.441 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:11:31.487 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.ixEEY4P06d 2024-01-20T08:11:31.487 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:31.487 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/tmp/tmp.ixEEY4P06d 2024-01-20T08:11:31.534 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:31.534 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:31.628 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:31.629 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:31.678 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:31.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.932+0000 7f0686200640 1 Processor -- start 2024-01-20T08:11:31.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.932+0000 7f0686200640 1 -- start start 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.933+0000 7f0686200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f06800bfae0 0x7f0680151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f0686200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06800c0fb0 con 0x7f06801521e0 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f0686200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068006def0 con 0x7f0680071220 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f0686200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06800c04a0 con 0x7f06800bfae0 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f067fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f06801521e0 0x7f0680157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55194/0 (socket says 172.21.15.100:55194) 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f067fe00640 1 -- 172.21.15.100:0/1817884613 learned_addr learned my addr 172.21.15.100:0/1817884613 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:31.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f067ea00640 1 --2- 172.21.15.100:0/1817884613 >> v2:172.21.15.110:3300/0 conn(0x7f06800bfae0 0x7f0680151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501261721 0 0) 0x7f06800c0fb0 con 0x7f06801521e0 2024-01-20T08:11:31.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.934+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0660003520 con 0x7f06801521e0 2024-01-20T08:11:31.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622433809 0 0) 0x7f0660003520 con 0x7f06801521e0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 >> v2:172.21.15.110:3300/0 conn(0x7f06800bfae0 msgr2=0x7f0680151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 --2- 172.21.15.100:0/1817884613 >> v2:172.21.15.110:3300/0 conn(0x7f06800bfae0 0x7f0680151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 >> v1:172.21.15.110:6789/0 conn(0x7f0680071220 legacy=0x7f0680071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068006e1d0 con 0x7f06801521e0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f06780019f0 con 0x7f06801521e0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 >> v1:172.21.15.100:6789/0 conn(0x7f06801521e0 legacy=0x7f0680157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0660003970 0x7f0660003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06600047c0 0x7f0660004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 0x7f066000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06800c04a0 con 0x7f06600052a0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066000c170 con 0x7f06600047c0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f066000c330 con 0x7f0660003970 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.935+0000 7f067fe00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 0x7f066000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067f400640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0660003970 0x7f0660003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067ea00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06600047c0 0x7f0660004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067fe00640 1 -- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0660003970 msgr2=0x7f0660003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067fe00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0660003970 0x7f0660003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067fe00640 1 -- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06600047c0 msgr2=0x7f0660004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067fe00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06600047c0 0x7f0660004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067fe00640 1 -- 172.21.15.100:0/1817884613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0660003520 con 0x7f06600052a0 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.936+0000 7f067ea00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06600047c0 0x7f0660004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.937+0000 7f067fe00640 1 -- 172.21.15.100:0/1817884613 reap_dead start 2024-01-20T08:11:31.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.937+0000 7f067fe00640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 0x7f066000b980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f067800a800 tx=0x7f06600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d0d40722dd8502 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.937+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06780072d0 con 0x7f06600052a0 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.937+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067802f070 con 0x7f06600052a0 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.937+0000 7f067e000640 1 -- 172.21.15.100:0/1817884613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0678007670 con 0x7f06600052a0 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 -- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 msgr2=0x7f066000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 0x7f066000b980 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f067800a800 tx=0x7f06600057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 -- 172.21.15.100:0/1817884613 shutdown_connections 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 --2- 172.21.15.100:0/1817884613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06600052a0 0x7f066000b980 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 -- 172.21.15.100:0/1817884613 >> 172.21.15.100:0/1817884613 conn(0x7f068006a5e0 msgr2=0x7f068006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 -- 172.21.15.100:0/1817884613 shutdown_connections 2024-01-20T08:11:31.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.938+0000 7f0686200640 1 -- 172.21.15.100:0/1817884613 wait complete. 2024-01-20T08:11:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.940+0000 7f0686200640 1 Processor -- start 2024-01-20T08:11:31.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.940+0000 7f0686200640 1 -- start start 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06600052a0 0x7f06801ed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 0x7f06801477d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06801ee180 con 0x7f06800c3220 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06801e9cf0 con 0x7f06801ea490 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f0686200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06801528b0 con 0x7f06600052a0 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41244/0 (socket says 172.21.15.100:41244) 2024-01-20T08:11:31.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 -- 172.21.15.100:0/2546113217 learned_addr learned my addr 172.21.15.100:0/2546113217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067fe00640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 0x7f06801477d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 -- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06600052a0 msgr2=0x7f06801ed1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06600052a0 0x7f06801ed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 -- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 msgr2=0x7f06801477d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 0x7f06801477d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067ea00640 1 -- 172.21.15.100:0/2546113217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0680152b90 con 0x7f06800c3220 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.941+0000 7f067fe00640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 0x7f06801477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f067ea00640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06680108b0 tx=0x7f0668010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800eb60 con 0x7f06800c3220 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f066800ecc0 con 0x7f06800c3220 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801c400 con 0x7f06800c3220 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06801e9f90 con 0x7f06800c3220 2024-01-20T08:11:31.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.942+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0680152e70 con 0x7f06800c3220 2024-01-20T08:11:31.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.943+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068004e970 con 0x7f06800c3220 2024-01-20T08:11:31.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.944+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f066801c560 con 0x7f06800c3220 2024-01-20T08:11:31.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.945+0000 7f0677400640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 0x7f065806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:31.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.945+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0668089ff0 con 0x7f06800c3220 2024-01-20T08:11:31.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.945+0000 7f067f400640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 0x7f065806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:31.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.946+0000 7f067f400640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 0x7f065806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06700014f0 tx=0x7f0670009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:31.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:31.950+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f06680bd0d0 con 0x7f06800c3220 2024-01-20T08:11:32.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.144+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f068014e480 con 0x7f06800c3220 2024-01-20T08:11:32.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.147+0000 7f0677400640 1 -- 172.21.15.100:0/2546113217 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f0668054c40 con 0x7f06800c3220 2024-01-20T08:11:32.151 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:32.151 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 msgr2=0x7f065806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 0x7f065806d390 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f06700014f0 tx=0x7f0670009040 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 msgr2=0x7f06801586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f06680108b0 tx=0x7f0668010d70 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 shutdown_connections 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f06801ea490 0x7f06801477d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f06800c3220 0x7f06801586d0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f065806aed0 0x7f065806d390 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 --2- 172.21.15.100:0/2546113217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f06600052a0 0x7f06801ed1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 >> 172.21.15.100:0/2546113217 conn(0x7f068006a5e0 msgr2=0x7f06800717b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:32.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 shutdown_connections 2024-01-20T08:11:32.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.150+0000 7f0686200640 1 -- 172.21.15.100:0/2546113217 wait complete. 2024-01-20T08:11:32.172 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:11:02.438552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:11:03.706270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:11:18.055571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:11:18.935347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:32.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.381+0000 7f37c7800640 1 Processor -- start 2024-01-20T08:11:32.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.381+0000 7f37c7800640 1 -- start start 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c7800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37c01515b0 0x7f37c006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c7800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c0154ba0 con 0x7f37c006ce10 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c7800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c0155a00 con 0x7f37c014b720 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c7800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c014bb00 con 0x7f37c01515b0 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37b7c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f37c01515b0 0x7f37c006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c5800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f37c006ce10 0x7f37c015bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55210/0 (socket says 172.21.15.100:55210) 2024-01-20T08:11:32.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.383+0000 7f37c5800640 1 -- 172.21.15.100:0/1399894902 learned_addr learned my addr 172.21.15.100:0/1399894902 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.384+0000 7f37b7c00640 1 -- 172.21.15.100:0/1399894902 >> v1:172.21.15.110:6789/0 conn(0x7f37c014b720 legacy=0x7f37c00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.384+0000 7f37b7c00640 1 -- 172.21.15.100:0/1399894902 >> v1:172.21.15.100:6789/0 conn(0x7f37c006ce10 legacy=0x7f37c015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.384+0000 7f37b7c00640 1 -- 172.21.15.100:0/1399894902 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c0154df0 con 0x7f37c01515b0 2024-01-20T08:11:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.384+0000 7f37bfe00640 1 -- 172.21.15.100:0/1399894902 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528234992 0 0) 0x7f37c0154ba0 con 0x7f37c006ce10 2024-01-20T08:11:32.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.385+0000 7f37b7c00640 1 --2- 172.21.15.100:0/1399894902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c006c8d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f37a80097a0 tx=0x7f37a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea88264d76f87d9c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.385+0000 7f37bfe00640 1 -- 172.21.15.100:0/1399894902 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8031830 con 0x7f37c01515b0 2024-01-20T08:11:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.385+0000 7f37bfe00640 1 -- 172.21.15.100:0/1399894902 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a8031990 con 0x7f37c01515b0 2024-01-20T08:11:32.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.385+0000 7f37bfe00640 1 -- 172.21.15.100:0/1399894902 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a8031d20 con 0x7f37c01515b0 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 -- 172.21.15.100:0/1399894902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 msgr2=0x7f37c006c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 --2- 172.21.15.100:0/1399894902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c006c8d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f37a80097a0 tx=0x7f37a802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 -- 172.21.15.100:0/1399894902 shutdown_connections 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 --2- 172.21.15.100:0/1399894902 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c006c8d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 -- 172.21.15.100:0/1399894902 >> 172.21.15.100:0/1399894902 conn(0x7f37c00c2940 msgr2=0x7f37c00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 -- 172.21.15.100:0/1399894902 shutdown_connections 2024-01-20T08:11:32.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.386+0000 7f37c7800640 1 -- 172.21.15.100:0/1399894902 wait complete. 2024-01-20T08:11:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.388+0000 7f37c7800640 1 Processor -- start 2024-01-20T08:11:32.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.388+0000 7f37c7800640 1 -- start start 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c006ce10 0x7f37c0071450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c014b720 0x7f37c01eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c01dced0 con 0x7f37c01515b0 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0154360 con 0x7f37c006ce10 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0153b50 con 0x7f37c014b720 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41256/0 (socket says 172.21.15.100:41256) 2024-01-20T08:11:32.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c5800640 1 -- 172.21.15.100:0/1426888146 learned_addr learned my addr 172.21.15.100:0/1426888146 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c4e00640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c006ce10 0x7f37c0071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37b7c00640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c014b720 0x7f37c01eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c5800640 1 -- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c014b720 msgr2=0x7f37c01eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.389+0000 7f37c5800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c014b720 0x7f37c01eab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c5800640 1 -- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c006ce10 msgr2=0x7f37c0071450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c5800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c006ce10 0x7f37c0071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c5800640 1 -- 172.21.15.100:0/1426888146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8009400 con 0x7f37c01515b0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c5800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c450 tx=0x7f37b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b80074e0 con 0x7f37c01515b0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8007660 con 0x7f37c01515b0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c01ea6f0 con 0x7f37c01515b0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8004a20 con 0x7f37c01515b0 2024-01-20T08:11:32.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.390+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c0153da0 con 0x7f37c01515b0 2024-01-20T08:11:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.391+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c01ea880 con 0x7f37c01515b0 2024-01-20T08:11:32.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.392+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f37b8004b80 con 0x7f37c01515b0 2024-01-20T08:11:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.394+0000 7f37bd600640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 0x7f379806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.394+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f37b8088e50 con 0x7f37c01515b0 2024-01-20T08:11:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.394+0000 7f37c4e00640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 0x7f379806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.395+0000 7f37c4e00640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 0x7f379806d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37b0007fd0 tx=0x7f37b0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.398+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f37b80539b0 con 0x7f37c01515b0 2024-01-20T08:11:32.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.597+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f37c0066f60 con 0x7f37c01515b0 2024-01-20T08:11:32.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.598+0000 7f37bd600640 1 -- 172.21.15.100:0/1426888146 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f37b8018020 con 0x7f37c01515b0 2024-01-20T08:11:32.601 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:32.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 msgr2=0x7f379806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 0x7f379806d390 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37b0007fd0 tx=0x7f37b0009040 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 msgr2=0x7f37c01dc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f37b800c450 tx=0x7f37b800c910 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 shutdown_connections 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f37c01515b0 0x7f37c01dc170 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f379806aed0 0x7f379806d390 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f37c014b720 0x7f37c01eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 --2- 172.21.15.100:0/1426888146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f37c006ce10 0x7f37c0071450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 >> 172.21.15.100:0/1426888146 conn(0x7f37c00c2940 msgr2=0x7f37c00c16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 shutdown_connections 2024-01-20T08:11:32.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.601+0000 7f37c7800640 1 -- 172.21.15.100:0/1426888146 wait complete. 2024-01-20T08:11:32.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:11:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.833+0000 7fc4aea00640 1 Processor -- start 2024-01-20T08:11:32.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.833+0000 7fc4aea00640 1 -- start start 2024-01-20T08:11:32.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.834+0000 7fc4aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4a80c0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4aea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a80709b0 con 0x7fc4a8156740 2024-01-20T08:11:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4aea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4a806e250 con 0x7fc4a806d0c0 2024-01-20T08:11:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4aea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a806dc90 con 0x7fc4a815c4e0 2024-01-20T08:11:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4aca00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc4a8156740 0x7fc4a8163600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55226/0 (socket says 172.21.15.100:55226) 2024-01-20T08:11:32.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4aca00640 1 -- 172.21.15.100:0/480088567 learned_addr learned my addr 172.21.15.100:0/480088567 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.835+0000 7fc4a7e00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4a80c0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4281884640 0 0) 0x7fc4a80709b0 con 0x7fc4a8156740 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc488003520 con 0x7fc4a8156740 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 914895414 0 0) 0x7fc488003520 con 0x7fc4a8156740 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 msgr2=0x7fc4a80c0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4a80c0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 >> v1:172.21.15.110:6789/0 conn(0x7fc4a806d0c0 legacy=0x7fc4a8156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a806df70 con 0x7fc4a8156740 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fc4a00019f0 con 0x7fc4a8156740 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 >> v1:172.21.15.100:6789/0 conn(0x7fc4a8156740 legacy=0x7fc4a8163600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4880039a0 0x7fc488003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc488004d00 0x7fc488005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a806dc90 con 0x7fc488004d00 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48800bb90 con 0x7fc4880039a0 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.836+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48800bd50 con 0x7fc4a815c4e0 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc488004d00 0x7fc488005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4a7e00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4880039a0 0x7fc488003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc49fe00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 -- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 msgr2=0x7fc4880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 -- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4880039a0 msgr2=0x7fc488003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:32.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc4880039a0 0x7fc488003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc4aca00640 1 -- 172.21.15.100:0/480088567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488003520 con 0x7fc488004d00 2024-01-20T08:11:32.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.837+0000 7fc49fe00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a815c4e0 0x7fc4880047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.838+0000 7fc4aca00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc488004d00 0x7fc488005160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806bff0 tx=0x7fc4880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cc4e0aa5004145 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.838+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0034630 con 0x7fc488004d00 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.838+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a002f070 con 0x7fc488004d00 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.838+0000 7fc4a7400640 1 -- 172.21.15.100:0/480088567 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a00349f0 con 0x7fc488004d00 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 -- 172.21.15.100:0/480088567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc488004d00 msgr2=0x7fc488005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 --2- 172.21.15.100:0/480088567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc488004d00 0x7fc488005160 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fc4a806bff0 tx=0x7fc4880057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aca00640 1 -- 172.21.15.100:0/480088567 reap_dead start 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 -- 172.21.15.100:0/480088567 shutdown_connections 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 -- 172.21.15.100:0/480088567 >> 172.21.15.100:0/480088567 conn(0x7fc4a80c6090 msgr2=0x7fc4a80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 -- 172.21.15.100:0/480088567 shutdown_connections 2024-01-20T08:11:32.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.839+0000 7fc4aea00640 1 -- 172.21.15.100:0/480088567 wait complete. 2024-01-20T08:11:32.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.841+0000 7fc4aea00640 1 Processor -- start 2024-01-20T08:11:32.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.841+0000 7fc4aea00640 1 -- start start 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc488004d00 0x7fc4a81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a81eea80 0x7fc4a814d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81508f0 con 0x7fc4a81519d0 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a80679d0 con 0x7fc488004d00 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4a81f1ce0 con 0x7fc4a81eea80 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41278/0 (socket says 172.21.15.100:41278) 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.842+0000 7fc4aca00640 1 -- 172.21.15.100:0/3804723177 learned_addr learned my addr 172.21.15.100:0/3804723177 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4a7e00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc488004d00 0x7fc4a81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc49fe00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a81eea80 0x7fc4a814d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 -- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a81eea80 msgr2=0x7fc4a814d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a81eea80 0x7fc4a814d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 -- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc488004d00 msgr2=0x7fc4a81f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc488004d00 0x7fc4a81f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 -- 172.21.15.100:0/3804723177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4a814e3b0 con 0x7fc4a81519d0 2024-01-20T08:11:32.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4aca00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000a820 tx=0x7fc4a0001cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0034430 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0034590 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.843+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0034900 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.844+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a80a91b0 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.844+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a81f1690 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.845+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4a80c0200 con 0x7fc4a81519d0 2024-01-20T08:11:32.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.846+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc4a0031030 con 0x7fc4a81519d0 2024-01-20T08:11:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.847+0000 7fc4a4c00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 0x7fc48006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.847+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc4a00abb30 con 0x7fc4a81519d0 2024-01-20T08:11:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.847+0000 7fc4a7e00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 0x7fc48006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:32.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.848+0000 7fc4a7e00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 0x7fc48006d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc498009a10 tx=0x7fc498008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:32.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:32.852+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc4a0076730 con 0x7fc4a81519d0 2024-01-20T08:11:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.044+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc4a80c0200 con 0x7fc4a81519d0 2024-01-20T08:11:33.047 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.045+0000 7fc4a4c00640 1 -- 172.21.15.100:0/3804723177 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc4a0079d50 con 0x7fc4a81519d0 2024-01-20T08:11:33.048 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 msgr2=0x7fc48006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 0x7fc48006d390 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc498009a10 tx=0x7fc498008040 comp rx=0 tx=0).stop 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 msgr2=0x7fc4a81441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fc4a000a820 tx=0x7fc4a0001cb0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 shutdown_connections 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc4a81519d0 0x7fc4a81441f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc48006aed0 0x7fc48006d390 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc4a81eea80 0x7fc4a814d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 --2- 172.21.15.100:0/3804723177 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc488004d00 0x7fc4a81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 >> 172.21.15.100:0/3804723177 conn(0x7fc4a80c6090 msgr2=0x7fc4a806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.047+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 shutdown_connections 2024-01-20T08:11:33.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.048+0000 7fc4aea00640 1 -- 172.21.15.100:0/3804723177 wait complete. 2024-01-20T08:11:33.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:11:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.276+0000 7f1be8600640 1 Processor -- start 2024-01-20T08:11:33.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.276+0000 7f1be8600640 1 -- start start 2024-01-20T08:11:33.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be8600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be8600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1be00c1850 0x7f1be00c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be8600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be0154ba0 con 0x7f1be006c8d0 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be8600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1be014bb00 con 0x7f1be00c1850 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be8600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0155a00 con 0x7f1be014b720 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be6600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1be006c8d0 0x7f1be006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55228/0 (socket says 172.21.15.100:55228) 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1be00c1850 0x7f1be00c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.278+0000 7f1be6600640 1 -- 172.21.15.100:0/2746095559 learned_addr learned my addr 172.21.15.100:0/2746095559 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1be5c00640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1bdfe00640 1 -- 172.21.15.100:0/2746095559 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2648195462 0 0) 0x7f1be0154ba0 con 0x7f1be006c8d0 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1bdfe00640 1 -- 172.21.15.100:0/2746095559 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc0003520 con 0x7f1be006c8d0 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1be5200640 1 -- 172.21.15.100:0/2746095559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 msgr2=0x7f1be01515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:33.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1be5200640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be01515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1be5200640 1 -- 172.21.15.100:0/2746095559 >> v1:172.21.15.100:6789/0 conn(0x7f1be006c8d0 legacy=0x7f1be006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.279+0000 7f1be5200640 1 -- 172.21.15.100:0/2746095559 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be0154df0 con 0x7f1be00c1850 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.280+0000 7f1be5200640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be00c1cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097a0 tx=0x7f1bc802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fd143b568242750 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.280+0000 7f1bdfe00640 1 -- 172.21.15.100:0/2746095559 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8031780 con 0x7f1be00c1850 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.280+0000 7f1bdfe00640 1 -- 172.21.15.100:0/2746095559 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80318e0 con 0x7f1be00c1850 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.280+0000 7f1bdfe00640 1 -- 172.21.15.100:0/2746095559 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8031c70 con 0x7f1be00c1850 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 -- 172.21.15.100:0/2746095559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 msgr2=0x7f1be00c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be00c1cd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f1bc80097a0 tx=0x7f1bc802b820 comp rx=0 tx=0).stop 2024-01-20T08:11:33.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 -- 172.21.15.100:0/2746095559 shutdown_connections 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be00c1cd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 --2- 172.21.15.100:0/2746095559 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be01515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 -- 172.21.15.100:0/2746095559 >> 172.21.15.100:0/2746095559 conn(0x7f1be00c2940 msgr2=0x7f1be00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 -- 172.21.15.100:0/2746095559 shutdown_connections 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.281+0000 7f1be8600640 1 -- 172.21.15.100:0/2746095559 wait complete. 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.283+0000 7f1be8600640 1 Processor -- start 2024-01-20T08:11:33.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.283+0000 7f1be8600640 1 -- start start 2024-01-20T08:11:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 0x7f1be00aaf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be014e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01510b0 con 0x7f1be00c1850 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01ec270 con 0x7f1be006c8d0 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be8600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0151e20 con 0x7f1be014b720 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41292/0 (socket says 172.21.15.100:41292) 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be5200640 1 -- 172.21.15.100:0/649538746 learned_addr learned my addr 172.21.15.100:0/649538746 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.284+0000 7f1be5c00640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 0x7f1be00aaf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be6600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be014e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 -- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 msgr2=0x7f1be014e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be014e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 -- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 msgr2=0x7f1be00aaf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 0x7f1be00aaf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 -- 172.21.15.100:0/649538746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8009400 con 0x7f1be00c1850 2024-01-20T08:11:33.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5c00640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 0x7f1be00aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.285+0000 7f1be5200640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8034040 tx=0x7f1bc80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.286+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8032820 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.286+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc80329a0 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.286+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be01eb380 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.286+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8032d50 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.286+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be01eb940 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.287+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be004e970 con 0x7f1be00c1850 2024-01-20T08:11:33.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.288+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1bc804e440 con 0x7f1be00c1850 2024-01-20T08:11:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.289+0000 7f1bdd600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 0x7f1bb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.289+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f1bc80abb00 con 0x7f1be00c1850 2024-01-20T08:11:33.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.290+0000 7f1be5c00640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 0x7f1bb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.290+0000 7f1be5c00640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 0x7f1bb806d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006fd0 tx=0x7f1bd0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.293+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1bc80ade60 con 0x7f1be00c1850 2024-01-20T08:11:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.486+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1be014a630 con 0x7f1be00c1850 2024-01-20T08:11:33.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.487+0000 7f1bdd600640 1 -- 172.21.15.100:0/649538746 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1bc8076660 con 0x7f1be00c1850 2024-01-20T08:11:33.489 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.489+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 msgr2=0x7f1bb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.489+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 0x7f1bb806d390 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006fd0 tx=0x7f1bd0008040 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.489+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 msgr2=0x7f1be014df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.489+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1bc8034040 tx=0x7f1bc80046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 shutdown_connections 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1bb806aed0 0x7f1bb806d390 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1be014b720 0x7f1be014e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1be00c1850 0x7f1be014df00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 --2- 172.21.15.100:0/649538746 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1be006c8d0 0x7f1be00aaf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 >> 172.21.15.100:0/649538746 conn(0x7f1be00c2940 msgr2=0x7f1be006d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:33.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 shutdown_connections 2024-01-20T08:11:33.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.490+0000 7f1be8600640 1 -- 172.21.15.100:0/649538746 wait complete. 2024-01-20T08:11:33.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:11:33.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.718+0000 7fd214c00640 1 Processor -- start 2024-01-20T08:11:33.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.718+0000 7fd214c00640 1 -- start start 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd214c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd2100bf900 0x7fd2100c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd214c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2100bfd30 con 0x7fd21013dcc0 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd214c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd210071a30 con 0x7fd2100bf4c0 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd214c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2100707d0 con 0x7fd2100bf900 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd20de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd21013dcc0 0x7fd210071020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55240/0 (socket says 172.21.15.100:55240) 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd20de00640 1 -- 172.21.15.100:0/888374617 learned_addr learned my addr 172.21.15.100:0/888374617 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:33.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd20e800640 1 --2- 172.21.15.100:0/888374617 >> v2:172.21.15.100:3300/0 conn(0x7fd2100bf900 0x7fd2100c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd20d400640 1 -- 172.21.15.100:0/888374617 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4071655997 0 0) 0x7fd200001110 con 0x7fd21013dcc0 2024-01-20T08:11:33.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.720+0000 7fd20d400640 1 -- 172.21.15.100:0/888374617 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1f0003520 con 0x7fd21013dcc0 2024-01-20T08:11:33.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.721+0000 7fd20e800640 1 -- 172.21.15.100:0/888374617 >> v1:172.21.15.110:6789/0 conn(0x7fd2100bf4c0 legacy=0x7fd2100c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.721+0000 7fd20e800640 1 -- 172.21.15.100:0/888374617 >> v1:172.21.15.100:6789/0 conn(0x7fd21013dcc0 legacy=0x7fd210071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.721+0000 7fd20e800640 1 -- 172.21.15.100:0/888374617 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2100c0b30 con 0x7fd2100bf900 2024-01-20T08:11:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd20e800640 1 --2- 172.21.15.100:0/888374617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf900 0x7fd2100c1d20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd208009d90 tx=0x7fd20802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734fead7ba4828f7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd20d400640 1 -- 172.21.15.100:0/888374617 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20802cd00 con 0x7fd2100bf900 2024-01-20T08:11:33.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd20d400640 1 -- 172.21.15.100:0/888374617 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20802ce60 con 0x7fd2100bf900 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd20d400640 1 -- 172.21.15.100:0/888374617 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208034660 con 0x7fd2100bf900 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd214c00640 1 -- 172.21.15.100:0/888374617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf900 msgr2=0x7fd2100c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.722+0000 7fd214c00640 1 --2- 172.21.15.100:0/888374617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf900 0x7fd2100c1d20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd208009d90 tx=0x7fd20802bf50 comp rx=0 tx=0).stop 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.723+0000 7fd214c00640 1 -- 172.21.15.100:0/888374617 shutdown_connections 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.723+0000 7fd214c00640 1 --2- 172.21.15.100:0/888374617 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf900 0x7fd2100c1d20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.723+0000 7fd214c00640 1 -- 172.21.15.100:0/888374617 >> 172.21.15.100:0/888374617 conn(0x7fd2100c6090 msgr2=0x7fd2100c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.723+0000 7fd214c00640 1 -- 172.21.15.100:0/888374617 shutdown_connections 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.723+0000 7fd214c00640 1 -- 172.21.15.100:0/888374617 wait complete. 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.724+0000 7fd214c00640 1 Processor -- start 2024-01-20T08:11:33.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 -- start start 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 0x7fd2101ee210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21013dcc0 0x7fd210153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd210152ee0 con 0x7fd2100bf4c0 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2101ee750 con 0x7fd2100bf900 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.725+0000 7fd214c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd210152510 con 0x7fd21013dcc0 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41300/0 (socket says 172.21.15.100:41300) 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 -- 172.21.15.100:0/4193109841 learned_addr learned my addr 172.21.15.100:0/4193109841 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd207e00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 0x7fd2101ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 -- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21013dcc0 msgr2=0x7fd210153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20e800640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21013dcc0 0x7fd210153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21013dcc0 0x7fd210153fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 -- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 msgr2=0x7fd2101ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 0x7fd2101ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd20de00640 1 -- 172.21.15.100:0/4193109841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd208009a70 con 0x7fd2100bf4c0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.726+0000 7fd207e00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 0x7fd2101ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd20de00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd20000c420 tx=0x7fd20000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200005ce0 con 0x7fd2100bf4c0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200005e40 con 0x7fd2100bf4c0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000072f0 con 0x7fd2100bf4c0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2101ea430 con 0x7fd2100bf4c0 2024-01-20T08:11:33.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.727+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2101ea6d0 con 0x7fd2100bf4c0 2024-01-20T08:11:33.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.728+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2101ea290 con 0x7fd2100bf4c0 2024-01-20T08:11:33.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.729+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd200007510 con 0x7fd2100bf4c0 2024-01-20T08:11:33.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.730+0000 7fd206000640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 0x7fd1e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.730+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd200088ee0 con 0x7fd2100bf4c0 2024-01-20T08:11:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.730+0000 7fd207e00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 0x7fd1e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:33.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.731+0000 7fd207e00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 0x7fd1e806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd210132b90 tx=0x7fd1f8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:33.737 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.734+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd2101ea290 con 0x7fd2100bf4c0 2024-01-20T08:11:33.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.930+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2100bfd30 con 0x7fd2100bf4c0 2024-01-20T08:11:33.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.931+0000 7fd206000640 1 -- 172.21.15.100:0/4193109841 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7fd2100bfd30 con 0x7fd2100bf4c0 2024-01-20T08:11:33.934 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:33.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 msgr2=0x7fd1e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 0x7fd1e806d390 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd210132b90 tx=0x7fd1f8009040 comp rx=0 tx=0).stop 2024-01-20T08:11:33.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 msgr2=0x7fd210151440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:33.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fd20000c420 tx=0x7fd20000c8e0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 shutdown_connections 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1e806aed0 0x7fd1e806d390 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd21013dcc0 0x7fd210153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd2100bf900 0x7fd2101ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 --2- 172.21.15.100:0/4193109841 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd2100bf4c0 0x7fd210151440 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 >> 172.21.15.100:0/4193109841 conn(0x7fd2100c6090 msgr2=0x7fd21013b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 shutdown_connections 2024-01-20T08:11:33.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:33.934+0000 7fd214c00640 1 -- 172.21.15.100:0/4193109841 wait complete. 2024-01-20T08:11:33.954 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:11:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.155+0000 7f3493e00640 1 Processor -- start 2024-01-20T08:11:34.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.156+0000 7f3493e00640 1 -- start start 2024-01-20T08:11:34.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3493e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34941550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3493e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3494157d00 con 0x7f349414e690 2024-01-20T08:11:34.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3493e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34940c4890 con 0x7f34941581e0 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3493e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349406cd00 con 0x7f34940c7e10 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3492a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f349414e690 0x7f34940ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55254/0 (socket says 172.21.15.100:55254) 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.157+0000 7f3492a00640 1 -- 172.21.15.100:0/3533039482 learned_addr learned my addr 172.21.15.100:0/3533039482 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222147762 0 0) 0x7f3494157d00 con 0x7f349414e690 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3474003520 con 0x7f349414e690 2024-01-20T08:11:34.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3492000640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34941550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1461899860 0 0) 0x7f3474003520 con 0x7f349414e690 2024-01-20T08:11:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 msgr2=0x7f34941550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:34.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34941550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 >> v1:172.21.15.110:6789/0 conn(0x7f34941581e0 legacy=0x7f34941585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940c4b50 con 0x7f349414e690 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3484001670 con 0x7f349414e690 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 >> v1:172.21.15.100:6789/0 conn(0x7f349414e690 legacy=0x7f34940ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34740039a0 0x7f3474003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34740047c0 0x7f3474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349406cd00 con 0x7f34740039a0 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f347400bab0 con 0x7f34740047c0 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f347400bc70 con 0x7f34940c7e10 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.158+0000 7f3492a00640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34740039a0 0x7f3474003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492000640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34740047c0 0x7f3474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492a00640 1 -- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 msgr2=0x7f34740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3493400640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492a00640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492a00640 1 -- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34740047c0 msgr2=0x7f3474004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492a00640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34740047c0 0x7f3474004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492a00640 1 -- 172.21.15.100:0/3533039482 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474003520 con 0x7f34740039a0 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3492000640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34740047c0 0x7f3474004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.159+0000 7f3493400640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34940c7e10 0x7f34740051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.160+0000 7f3492a00640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34740039a0 0x7f3474003dc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f348400c190 tx=0x7f34740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96b81081c1e77f0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.160+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484005ad0 con 0x7f34740039a0 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.160+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3484005c30 con 0x7f34740039a0 2024-01-20T08:11:34.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3491600640 1 -- 172.21.15.100:0/3533039482 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348402c8a0 con 0x7f34740039a0 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 -- 172.21.15.100:0/3533039482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34740039a0 msgr2=0x7f3474003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 --2- 172.21.15.100:0/3533039482 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34740039a0 0x7f3474003dc0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f348400c190 tx=0x7f34740057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493400640 1 -- 172.21.15.100:0/3533039482 reap_dead start 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 -- 172.21.15.100:0/3533039482 shutdown_connections 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 -- 172.21.15.100:0/3533039482 >> 172.21.15.100:0/3533039482 conn(0x7f3494072130 msgr2=0x7f3494072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 -- 172.21.15.100:0/3533039482 shutdown_connections 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.161+0000 7f3493e00640 1 -- 172.21.15.100:0/3533039482 wait complete. 2024-01-20T08:11:34.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.163+0000 7f3493e00640 1 Processor -- start 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.163+0000 7f3493e00640 1 -- start start 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740039a0 0x7f34940c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34941ee2e0 0x7f349414ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941ea700 con 0x7f34941eab90 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34941ee760 con 0x7f34941ee2e0 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34940c1bf0 con 0x7f34740039a0 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41330/0 (socket says 172.21.15.100:41330) 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3493400640 1 -- 172.21.15.100:0/1745313125 learned_addr learned my addr 172.21.15.100:0/1745313125 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3492a00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740039a0 0x7f34940c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.164+0000 7f3492000640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34941ee2e0 0x7f349414ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 -- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740039a0 msgr2=0x7f34940c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740039a0 0x7f34940c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 -- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34941ee2e0 msgr2=0x7f349414ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34941ee2e0 0x7f349414ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 -- 172.21.15.100:0/1745313125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34940c1ed0 con 0x7f34941eab90 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493400640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34940ca3b0 tx=0x7f348c00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c00b070 con 0x7f34941eab90 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f348c0054e0 con 0x7f34941eab90 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348c003810 con 0x7f34941eab90 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34940c21b0 con 0x7f34941eab90 2024-01-20T08:11:34.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.165+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349414dc20 con 0x7f34941eab90 2024-01-20T08:11:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.167+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349404e970 con 0x7f34941eab90 2024-01-20T08:11:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.167+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f348c003970 con 0x7f34941eab90 2024-01-20T08:11:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.168+0000 7f348b400640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 0x7f346c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.168+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f348c088ff0 con 0x7f34941eab90 2024-01-20T08:11:34.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.169+0000 7f3492a00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 0x7f346c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.169+0000 7f3492a00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 0x7f346c06d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3484034000 tx=0x7f3484009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.173+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f348c053b50 con 0x7f34941eab90 2024-01-20T08:11:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.366+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f34940c0ca0 con 0x7f34941eab90 2024-01-20T08:11:34.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.366+0000 7f348b400640 1 -- 172.21.15.100:0/1745313125 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f348c018020 con 0x7f34941eab90 2024-01-20T08:11:34.369 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 msgr2=0x7f346c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 0x7f346c06d390 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3484034000 tx=0x7f3484009030 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 msgr2=0x7f3494148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f34940ca3b0 tx=0x7f348c00d890 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 shutdown_connections 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f34941eab90 0x7f3494148f80 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34941ee2e0 0x7f349414ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f346c06aed0 0x7f346c06d390 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 --2- 172.21.15.100:0/1745313125 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34740039a0 0x7f34940c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.369+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 >> 172.21.15.100:0/1745313125 conn(0x7f3494072130 msgr2=0x7f34941535b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.370+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 shutdown_connections 2024-01-20T08:11:34.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.370+0000 7f3493e00640 1 -- 172.21.15.100:0/1745313125 wait complete. 2024-01-20T08:11:34.391 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:11:34.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.594+0000 7fac27e00640 1 Processor -- start 2024-01-20T08:11:34.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.594+0000 7fac27e00640 1 -- start start 2024-01-20T08:11:34.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.595+0000 7fac27e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac280c4880 0x7fac280c4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.595+0000 7fac27e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28154950 0x7fac28154de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.595+0000 7fac27e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac28158b80 con 0x7fac28151d90 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.595+0000 7fac27e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac28152170 con 0x7fac280c4880 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.595+0000 7fac27e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac280bd840 con 0x7fac28154950 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.596+0000 7fac26a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac28151d90 0x7fac280c7e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55264/0 (socket says 172.21.15.100:55264) 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.596+0000 7fac26a00640 1 -- 172.21.15.100:0/1646514656 learned_addr learned my addr 172.21.15.100:0/1646514656 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.596+0000 7fac1de00640 1 --2- 172.21.15.100:0/1646514656 >> v2:172.21.15.110:3300/0 conn(0x7fac280c4880 0x7fac280c4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.596+0000 7fac27400640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28154950 0x7fac28154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.597+0000 7fac1de00640 1 -- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28154950 msgr2=0x7fac28154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.597+0000 7fac1de00640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28154950 0x7fac28154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.597+0000 7fac1de00640 1 -- 172.21.15.100:0/1646514656 >> v1:172.21.15.100:6789/0 conn(0x7fac28151d90 legacy=0x7fac280c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.597+0000 7fac1de00640 1 -- 172.21.15.100:0/1646514656 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac280c8510 con 0x7fac280c4880 2024-01-20T08:11:34.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.598+0000 7fac1de00640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac280c4ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac100097a0 tx=0x7fac1002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d660ed861193a71f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.603+0000 7fac26000640 1 -- 172.21.15.100:0/1646514656 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10031780 con 0x7fac280c4880 2024-01-20T08:11:34.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.603+0000 7fac26000640 1 -- 172.21.15.100:0/1646514656 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac100318e0 con 0x7fac280c4880 2024-01-20T08:11:34.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.603+0000 7fac26000640 1 -- 172.21.15.100:0/1646514656 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac10031c70 con 0x7fac280c4880 2024-01-20T08:11:34.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.603+0000 7fac27e00640 1 -- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 msgr2=0x7fac280c4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.603+0000 7fac27e00640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac280c4ce0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fac100097a0 tx=0x7fac1002b820 comp rx=0 tx=0).stop 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 -- 172.21.15.100:0/1646514656 shutdown_connections 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28154950 0x7fac28154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 --2- 172.21.15.100:0/1646514656 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac280c4ce0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 -- 172.21.15.100:0/1646514656 >> 172.21.15.100:0/1646514656 conn(0x7fac28071ef0 msgr2=0x7fac28072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 -- 172.21.15.100:0/1646514656 shutdown_connections 2024-01-20T08:11:34.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.604+0000 7fac27e00640 1 -- 172.21.15.100:0/1646514656 wait complete. 2024-01-20T08:11:34.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.606+0000 7fac27e00640 1 Processor -- start 2024-01-20T08:11:34.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.606+0000 7fac27e00640 1 -- start start 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac28156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28151d90 0x7fac28149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281537c0 con 0x7fac28154950 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28156ff0 con 0x7fac280c4880 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.607+0000 7fac27e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac281572d0 con 0x7fac28151d90 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.611 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41334/0 (socket says 172.21.15.100:41334) 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 -- 172.21.15.100:0/4034924922 learned_addr learned my addr 172.21.15.100:0/4034924922 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac1de00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28151d90 0x7fac28149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac26a00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac28156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 -- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28151d90 msgr2=0x7fac28149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28151d90 0x7fac28149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 -- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 msgr2=0x7fac28156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac28156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.608+0000 7fac27400640 1 -- 172.21.15.100:0/4034924922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10009400 con 0x7fac28154950 2024-01-20T08:11:34.612 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac27400640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fac2000efc0 tx=0x7fac2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20009ba0 con 0x7fac28154950 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2000f040 con 0x7fac28154950 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200146c0 con 0x7fac28154950 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac281575b0 con 0x7fac28154950 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.609+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281ed560 con 0x7fac28154950 2024-01-20T08:11:34.613 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.610+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2804e970 con 0x7fac28154950 2024-01-20T08:11:34.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.611+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fac20014820 con 0x7fac28154950 2024-01-20T08:11:34.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.612+0000 7fac1f400640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 0x7fac0006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:34.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.612+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fac2008a530 con 0x7fac28154950 2024-01-20T08:11:34.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.612+0000 7fac26a00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 0x7fac0006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:34.615 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.613+0000 7fac26a00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 0x7fac0006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac18009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:34.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.618+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fac20055090 con 0x7fac28154950 2024-01-20T08:11:34.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.821+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fac281466f0 con 0x7fac28154950 2024-01-20T08:11:34.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.822+0000 7fac1f400640 1 -- 172.21.15.100:0/4034924922 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7fac200586b0 con 0x7fac28154950 2024-01-20T08:11:34.825 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.824+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 msgr2=0x7fac0006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.824+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 0x7fac0006d3c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fac18000f60 tx=0x7fac18009040 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.824+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 msgr2=0x7fac28146a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.824+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fac2000efc0 tx=0x7fac2000c490 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 shutdown_connections 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac28154950 0x7fac28146a40 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac0006af00 0x7fac0006d3c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac28151d90 0x7fac28149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 --2- 172.21.15.100:0/4034924922 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac280c4880 0x7fac28156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 >> 172.21.15.100:0/4034924922 conn(0x7fac28071ef0 msgr2=0x7fac280c6910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:34.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 shutdown_connections 2024-01-20T08:11:34.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:34.825+0000 7fac27e00640 1 -- 172.21.15.100:0/4034924922 wait complete. 2024-01-20T08:11:34.846 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T08:11:34.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:34.847 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:34.945 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:11:34.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:34.945 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T08:11:34.993 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:34.993 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:35.088 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:11:35.088 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:11:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.293+0000 7fd739200640 1 Processor -- start 2024-01-20T08:11:35.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.293+0000 7fd739200640 1 -- start start 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.293+0000 7fd739200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7340c7e10 0x7fd7341550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd739200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7341581e0 0x7fd734158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd739200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd734158bb0 con 0x7fd73414e690 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd739200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd734157d00 con 0x7fd7341581e0 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd739200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7340c4890 con 0x7fd7340c7e10 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7341581e0 0x7fd734158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd73414e690 0x7fd7340ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55276/0 (socket says 172.21.15.100:55276) 2024-01-20T08:11:35.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733400640 1 -- 172.21.15.100:0/525619656 learned_addr learned my addr 172.21.15.100:0/525619656 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd72be00640 1 --2- 172.21.15.100:0/525619656 >> v2:172.21.15.110:3300/0 conn(0x7fd7340c7e10 0x7fd7341550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733e00640 1 -- 172.21.15.100:0/525619656 >> v2:172.21.15.110:3300/0 conn(0x7fd7340c7e10 msgr2=0x7fd7341550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733e00640 1 --2- 172.21.15.100:0/525619656 >> v2:172.21.15.110:3300/0 conn(0x7fd7340c7e10 0x7fd7341550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733e00640 1 -- 172.21.15.100:0/525619656 >> v1:172.21.15.100:6789/0 conn(0x7fd73414e690 legacy=0x7fd7340ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd733e00640 1 -- 172.21.15.100:0/525619656 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd73406cd00 con 0x7fd7341581e0 2024-01-20T08:11:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.295+0000 7fd732a00640 1 -- 172.21.15.100:0/525619656 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3761994417 0 0) 0x7fd734158bb0 con 0x7fd73414e690 2024-01-20T08:11:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd733e00640 1 --2- 172.21.15.100:0/525619656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7341581e0 0x7fd734158670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd7340caf80 tx=0x7fd72c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13d9922012e10f2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:35.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd732a00640 1 -- 172.21.15.100:0/525619656 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c02cbf0 con 0x7fd7341581e0 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd732a00640 1 -- 172.21.15.100:0/525619656 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd72c02cd50 con 0x7fd7341581e0 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd732a00640 1 -- 172.21.15.100:0/525619656 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd72c034660 con 0x7fd7341581e0 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd739200640 1 -- 172.21.15.100:0/525619656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7341581e0 msgr2=0x7fd734158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.296+0000 7fd739200640 1 --2- 172.21.15.100:0/525619656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7341581e0 0x7fd734158670 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd7340caf80 tx=0x7fd72c02be40 comp rx=0 tx=0).stop 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 -- 172.21.15.100:0/525619656 shutdown_connections 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 --2- 172.21.15.100:0/525619656 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7341581e0 0x7fd734158670 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 --2- 172.21.15.100:0/525619656 >> v2:172.21.15.110:3300/0 conn(0x7fd7340c7e10 0x7fd7341550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 -- 172.21.15.100:0/525619656 >> 172.21.15.100:0/525619656 conn(0x7fd734072130 msgr2=0x7fd734072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 -- 172.21.15.100:0/525619656 shutdown_connections 2024-01-20T08:11:35.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.297+0000 7fd739200640 1 -- 172.21.15.100:0/525619656 wait complete. 2024-01-20T08:11:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.299+0000 7fd739200640 1 Processor -- start 2024-01-20T08:11:35.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.299+0000 7fd739200640 1 -- start start 2024-01-20T08:11:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd73414e690 0x7fd7340aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7341581e0 0x7fd7341e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd734148e70 con 0x7fd7340c7e10 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341eb540 con 0x7fd7341581e0 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd739200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7341ee080 con 0x7fd73414e690 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41340/0 (socket says 172.21.15.100:41340) 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 -- 172.21.15.100:0/2078483514 learned_addr learned my addr 172.21.15.100:0/2078483514 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 -- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd73414e690 msgr2=0x7fd7340aef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd73414e690 0x7fd7340aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 -- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7341581e0 msgr2=0x7fd7341e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7341581e0 0x7fd7341e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.300+0000 7fd733400640 1 -- 172.21.15.100:0/2078483514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd72c009a70 con 0x7fd7340c7e10 2024-01-20T08:11:35.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd733400640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd72400c4d0 tx=0x7fd72400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:35.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7240074e0 con 0x7fd7340c7e10 2024-01-20T08:11:35.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd724007660 con 0x7fd7340c7e10 2024-01-20T08:11:35.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd734157610 con 0x7fd7340c7e10 2024-01-20T08:11:35.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd724004a20 con 0x7fd7340c7e10 2024-01-20T08:11:35.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.301+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7341eb1d0 con 0x7fd7340c7e10 2024-01-20T08:11:35.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.302+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd734157b30 con 0x7fd7340c7e10 2024-01-20T08:11:35.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.303+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd724004b80 con 0x7fd7340c7e10 2024-01-20T08:11:35.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.304+0000 7fd72b400640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 0x7fd70c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:35.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.304+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd724088ea0 con 0x7fd7340c7e10 2024-01-20T08:11:35.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.304+0000 7fd72be00640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 0x7fd70c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:35.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.305+0000 7fd72be00640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 0x7fd70c06d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd71c006fd0 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:35.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.309+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd734157b30 con 0x7fd7340c7e10 2024-01-20T08:11:35.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.542+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7341eb030 con 0x7fd7340c7e10 2024-01-20T08:11:35.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.543+0000 7fd72b400640 1 -- 172.21.15.100:0/2078483514 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v21) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd7341eb030 con 0x7fd7340c7e10 2024-01-20T08:11:35.546 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:11:35.546 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.545+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 msgr2=0x7fd70c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.545+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 0x7fd70c06d3c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd71c006fd0 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.545+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 msgr2=0x7fd7341edb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.545+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd72400c4d0 tx=0x7fd72400c990 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 shutdown_connections 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7341581e0 0x7fd7341e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd70c06af00 0x7fd70c06d3c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd73414e690 0x7fd7340aef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 --2- 172.21.15.100:0/2078483514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7340c7e10 0x7fd7341edb40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 >> 172.21.15.100:0/2078483514 conn(0x7fd734072130 msgr2=0x7fd734072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 shutdown_connections 2024-01-20T08:11:35.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:35.546+0000 7fd739200640 1 -- 172.21.15.100:0/2078483514 wait complete. 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:11:35.566 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.ixEEY4P06d 2024-01-20T08:11:35.566 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:11:35.614 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.gN6Ie3tTyE 2024-01-20T08:11:35.614 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /tmp/tmp.ixEEY4P06d /tmp/tmp.gN6Ie3tTyE 2024-01-20T08:11:35.697 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.gN6Ie3tTyE 2024-01-20T08:11:35.846 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.gN6Ie3tTyE is 185B 2024-01-20T08:11:35.904 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.gN6Ie3tTyE 2024-01-20T08:11:35.954 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg== caps mds = "allow rw fsname=cephfs" caps mon = "allow r fsname=cephfs" caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T08:11:35.954 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:35.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:35.954 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:11:36.006 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:11:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:11:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:11:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.006 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42577sec preferred_lft 42577sec 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:11:36.007 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:11:36.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.009 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:11:36.095 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:11:36.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.099 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:11:36.132 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:11:36.149 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:11:36.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.151 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:11:36.152 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:11:36.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:11:36.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:11:36.152 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:11:36.152 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:11:36.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.358 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:11:36.405 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:11:36.406 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:36.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:11:36.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:36.496 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:36.547 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:11:36.547 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:11:36.547 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:11:36.593 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:36.593 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/tmp/tmp.ixEEY4P06d of=/dev/stdout 2024-01-20T08:11:36.688 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-20T08:11:36.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:36.688 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:36.833 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:36.833 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:36.834 INFO:teuthology.orchestra.run.smithi100.stdout:keyring.get_secret failed 2024-01-20T08:11:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:mount.ceph: kernel BUG! 2024-01-20T08:11:36.870 INFO:teuthology.orchestra.run.smithi100.stderr:mount error: no mds server is up or the cluster is laggy 2024-01-20T08:11:36.871 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:11:36.871 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:11:36.871 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:11:36.871 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: testuser@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:11:36.871 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:11:36.877 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-20T08:11:36.878 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-20T08:11:36.878 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:11:36.878 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:11:36.983 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:11:37.106 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:11:37.106 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:11:37.106 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:37.164 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:11:37.164 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:37.164 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:37.221 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:11:37.221 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:11:37.275 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:37.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.487+0000 7fcd30a00640 1 Processor -- start 2024-01-20T08:11:37.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.487+0000 7fcd30a00640 1 -- start start 2024-01-20T08:11:37.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.488+0000 7fcd30a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.488+0000 7fcd30a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd2c0c0920 0x7fcd2c0a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.488+0000 7fcd30a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd2c0c0490 con 0x7fcd2c155230 2024-01-20T08:11:37.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.488+0000 7fcd30a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd2c0c2100 con 0x7fcd2c0c0920 2024-01-20T08:11:37.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.488+0000 7fcd30a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0c1260 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.489+0000 7fcd2be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd2c0c0920 0x7fcd2c0a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.489+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.489+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:48982/0 (socket says 172.21.15.100:48982) 2024-01-20T08:11:37.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.489+0000 7fcd23e00640 1 -- 172.21.15.100:0/615920621 learned_addr learned my addr 172.21.15.100:0/615920621 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:37.491 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.489+0000 7fcd2b400640 1 --1- 172.21.15.100:0/615920621 >> v1:172.21.15.110:6789/0 conn(0x7fcd2c155230 0x7fcd2c0c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:58574/0 (socket says 172.21.15.100:58574) 2024-01-20T08:11:37.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.490+0000 7fcd23e00640 1 -- 172.21.15.100:0/615920621 >> v2:172.21.15.110:3300/0 conn(0x7fcd2c0c0920 msgr2=0x7fcd2c0a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:37.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.490+0000 7fcd23e00640 1 --2- 172.21.15.100:0/615920621 >> v2:172.21.15.110:3300/0 conn(0x7fcd2c0c0920 0x7fcd2c0a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.490+0000 7fcd23e00640 1 -- 172.21.15.100:0/615920621 >> v1:172.21.15.110:6789/0 conn(0x7fcd2c155230 legacy=0x7fcd2c0c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.490+0000 7fcd23e00640 1 -- 172.21.15.100:0/615920621 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c0c1540 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.492 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.491+0000 7fcd23e00640 1 --2- 172.21.15.100:0/615920621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009870 tx=0x7fcd1402b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d15780cfca391359 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.491+0000 7fcd2aa00640 1 -- 172.21.15.100:0/615920621 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14031860 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.491+0000 7fcd2aa00640 1 -- 172.21.15.100:0/615920621 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd140319c0 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.491+0000 7fcd2aa00640 1 -- 172.21.15.100:0/615920621 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14031d50 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 -- 172.21.15.100:0/615920621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 msgr2=0x7fcd2c072250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 --2- 172.21.15.100:0/615920621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009870 tx=0x7fcd1402b900 comp rx=0 tx=0).stop 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 -- 172.21.15.100:0/615920621 shutdown_connections 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 --2- 172.21.15.100:0/615920621 >> v2:172.21.15.110:3300/0 conn(0x7fcd2c0c0920 0x7fcd2c0a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 --2- 172.21.15.100:0/615920621 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c072250 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 -- 172.21.15.100:0/615920621 >> 172.21.15.100:0/615920621 conn(0x7fcd2c0c2590 msgr2=0x7fcd2c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 -- 172.21.15.100:0/615920621 shutdown_connections 2024-01-20T08:11:37.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.492+0000 7fcd30a00640 1 -- 172.21.15.100:0/615920621 wait complete. 2024-01-20T08:11:37.495 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.494+0000 7fcd30a00640 1 Processor -- start 2024-01-20T08:11:37.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.494+0000 7fcd30a00640 1 -- start start 2024-01-20T08:11:37.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c14f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 0x7fcd2c0a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c0aaaf0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c156340 con 0x7fcd2c155230 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd30a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c156590 con 0x7fcd2c0bfc30 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41348/0 (socket says 172.21.15.100:41348) 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.495+0000 7fcd23e00640 1 -- 172.21.15.100:0/3842672062 learned_addr learned my addr 172.21.15.100:0/3842672062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd2be00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 0x7fcd2c0a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd2b400640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c14f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 -- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 msgr2=0x7fcd2c14f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c14f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 -- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 msgr2=0x7fcd2c0a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 0x7fcd2c0a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 -- 172.21.15.100:0/3842672062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd140094d0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd2be00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 0x7fcd2c0a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:37.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23e00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009870 tx=0x7fcd140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd1403ac60 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd1403adc0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd14044630 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.496+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd2c0a89d0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.497+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd2c0a8f90 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.498+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd2c0a9120 con 0x7fcd2c0c0920 2024-01-20T08:11:37.500 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.498+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcd1404d450 con 0x7fcd2c0c0920 2024-01-20T08:11:37.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.499+0000 7fcd23400640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 0x7fcd0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.499+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcd140abec0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.500+0000 7fcd2b400640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 0x7fcd0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.500+0000 7fcd2b400640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 0x7fcd0406d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000f60 tx=0x7fcd1c007ce0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.504+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcd14076a20 con 0x7fcd2c0c0920 2024-01-20T08:11:37.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.696+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcd2c0749e0 con 0x7fcd2c0c0920 2024-01-20T08:11:37.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.698+0000 7fcd23400640 1 -- 172.21.15.100:0/3842672062 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7fcd14035020 con 0x7fcd2c0c0920 2024-01-20T08:11:37.701 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:37.701 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.701+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 msgr2=0x7fcd0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.701+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 0x7fcd0406d390 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcd1c000f60 tx=0x7fcd1c007ce0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.701+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 msgr2=0x7fcd2c0a94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.701+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fcd14009870 tx=0x7fcd140046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.701+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 shutdown_connections 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd2c155230 0x7fcd2c0a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd2c0c0920 0x7fcd2c0a94b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd0406aed0 0x7fcd0406d390 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 --2- 172.21.15.100:0/3842672062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd2c0bfc30 0x7fcd2c14f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 >> 172.21.15.100:0/3842672062 conn(0x7fcd2c0c2590 msgr2=0x7fcd2c0c4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 shutdown_connections 2024-01-20T08:11:37.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.702+0000 7fcd30a00640 1 -- 172.21.15.100:0/3842672062 wait complete. 2024-01-20T08:11:37.722 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:11:02.438552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:11:03.706270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:11:18.055571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:11:18.935347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:37.723 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:37.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.923+0000 7f3f93e00640 1 Processor -- start 2024-01-20T08:11:37.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.923+0000 7f3f93e00640 1 -- start start 2024-01-20T08:11:37.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 0x7f3f941550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f93e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f94157d00 con 0x7f3f9414e690 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f93e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f940c4890 con 0x7f3f940c7e10 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f93e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9406cd00 con 0x7f3f941588f0 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f92a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3f9414e690 0x7f3f940ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55288/0 (socket says 172.21.15.100:55288) 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.925+0000 7f3f92a00640 1 -- 172.21.15.100:0/3826544463 learned_addr learned my addr 172.21.15.100:0/3826544463 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f93400640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 0x7f3f941550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548648404 0 0) 0x7f3f94157d00 con 0x7f3f9414e690 2024-01-20T08:11:37.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f74003520 con 0x7f3f9414e690 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701938466 0 0) 0x7f3f74003520 con 0x7f3f9414e690 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 msgr2=0x7f3f941550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 0x7f3f941550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 >> v1:172.21.15.110:6789/0 conn(0x7f3f940c7e10 legacy=0x7f3f941581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940c4b50 con 0x7f3f9414e690 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3f84001670 con 0x7f3f9414e690 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 >> v1:172.21.15.100:6789/0 conn(0x7f3f9414e690 legacy=0x7f3f940ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740039a0 0x7f3f74003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f740047c0 0x7f3f74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 0x7f3f7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9406cd00 con 0x7f3f740047c0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f740054e0 con 0x7f3f740039a0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.926+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f7400bec0 con 0x7f3f941588f0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f740047c0 0x7f3f74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f92a00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740039a0 0x7f3f74003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 -- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 msgr2=0x7f3f7400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f941588f0 0x7f3f7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 -- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740039a0 msgr2=0x7f3f74003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740039a0 0x7f3f74003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f89e00640 1 -- 172.21.15.100:0/3826544463 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f74003520 con 0x7f3f740047c0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.927+0000 7f3f92a00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740039a0 0x7f3f74003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.928+0000 7f3f89e00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f740047c0 0x7f3f74004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3f940c40c0 tx=0x7f3f740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc2c92a1d405bf2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.928+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0052d0 con 0x7f3f740047c0 2024-01-20T08:11:37.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.928+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c02e050 con 0x7f3f740047c0 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.928+0000 7f3f92000640 1 -- 172.21.15.100:0/3826544463 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c0035f0 con 0x7f3f740047c0 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 -- 172.21.15.100:0/3826544463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f740047c0 msgr2=0x7f3f74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3826544463 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f740047c0 0x7f3f74004c40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3f940c40c0 tx=0x7f3f740057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93400640 1 -- 172.21.15.100:0/3826544463 reap_dead start 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 -- 172.21.15.100:0/3826544463 shutdown_connections 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 -- 172.21.15.100:0/3826544463 >> 172.21.15.100:0/3826544463 conn(0x7f3f94072130 msgr2=0x7f3f94072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 -- 172.21.15.100:0/3826544463 shutdown_connections 2024-01-20T08:11:37.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.929+0000 7f3f93e00640 1 -- 172.21.15.100:0/3826544463 wait complete. 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.931+0000 7f3f93e00640 1 Processor -- start 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.931+0000 7f3f93e00640 1 -- start start 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740047c0 0x7f3f941ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f940c0380 0x7f3f940bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c0a60 con 0x7f3f940c0fe0 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940ac1d0 con 0x7f3f740047c0 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940c4310 con 0x7f3f940c0380 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41374/0 (socket says 172.21.15.100:41374) 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 -- 172.21.15.100:0/3274172908 learned_addr learned my addr 172.21.15.100:0/3274172908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 -- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f940c0380 msgr2=0x7f3f940bf4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f940c0380 0x7f3f940bf4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 -- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740047c0 msgr2=0x7f3f941ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740047c0 0x7f3f941ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.932+0000 7f3f93400640 1 -- 172.21.15.100:0/3274172908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940bff50 con 0x7f3f940c0fe0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f93400640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3f940ca3b0 tx=0x7f3f8c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c018070 con 0x7f3f940c0fe0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c00eb30 con 0x7f3f940c0fe0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f940c0cb0 con 0x7f3f940c0fe0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c003990 con 0x7f3f940c0fe0 2024-01-20T08:11:37.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.933+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f941ed770 con 0x7f3f940c0fe0 2024-01-20T08:11:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.934+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940ac310 con 0x7f3f940c0fe0 2024-01-20T08:11:37.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.935+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3f8c014420 con 0x7f3f940c0fe0 2024-01-20T08:11:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.936+0000 7f3f8b400640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 0x7f3f6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.936+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3f8c089860 con 0x7f3f940c0fe0 2024-01-20T08:11:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.936+0000 7f3f92a00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 0x7f3f6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:37.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.937+0000 7f3f92a00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 0x7f3f6c06d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f840079f0 tx=0x7f3f84009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:37.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:37.940+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f940ac310 con 0x7f3f940c0fe0 2024-01-20T08:11:38.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.132+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f940ac310 con 0x7f3f940c0fe0 2024-01-20T08:11:38.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.132+0000 7f3f8b400640 1 -- 172.21.15.100:0/3274172908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f940ac310 con 0x7f3f940c0fe0 2024-01-20T08:11:38.135 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 msgr2=0x7f3f6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 0x7f3f6c06d390 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3f840079f0 tx=0x7f3f84009040 comp rx=0 tx=0).stop 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 msgr2=0x7f3f940bfa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f3f940ca3b0 tx=0x7f3f8c00e4b0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 shutdown_connections 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f940c0fe0 0x7f3f940bfa10 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6c06aed0 0x7f3f6c06d390 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f940c0380 0x7f3f940bf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 --2- 172.21.15.100:0/3274172908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f740047c0 0x7f3f941ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 >> 172.21.15.100:0/3274172908 conn(0x7f3f94072130 msgr2=0x7f3f94153e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:38.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 shutdown_connections 2024-01-20T08:11:38.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.135+0000 7f3f93e00640 1 -- 172.21.15.100:0/3274172908 wait complete. 2024-01-20T08:11:38.156 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:11:38.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.367+0000 7fc638600640 1 Processor -- start 2024-01-20T08:11:38.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.367+0000 7fc638600640 1 -- start start 2024-01-20T08:11:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.369+0000 7fc638600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6300c05a0 0x7fc63006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.369+0000 7fc638600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc630154af0 0x7fc630154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.369+0000 7fc638600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc63006d220 con 0x7fc6301481a0 2024-01-20T08:11:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.369+0000 7fc638600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc63006dbf0 con 0x7fc630154af0 2024-01-20T08:11:38.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.369+0000 7fc638600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6301557a0 con 0x7fc6300c05a0 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc630154af0 0x7fc630154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc630154af0 0x7fc630154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:60110/0 (socket says 172.21.15.100:60110) 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 -- 172.21.15.100:0/1968811782 learned_addr learned my addr 172.21.15.100:0/1968811782 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc635200640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6300c05a0 0x7fc63006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 -- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6300c05a0 msgr2=0x7fc63006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:38.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6300c05a0 0x7fc63006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 -- 172.21.15.100:0/1968811782 >> v1:172.21.15.110:6789/0 conn(0x7fc6301481a0 legacy=0x7fc6300701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.370+0000 7fc636600640 1 -- 172.21.15.100:0/1968811782 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63006c8f0 con 0x7fc630154af0 2024-01-20T08:11:38.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.372+0000 7fc636600640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc630154af0 0x7fc630154f60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc628009e50 tx=0x7fc62802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=533d73a481f1f708 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.372+0000 7fc62fe00640 1 -- 172.21.15.100:0/1968811782 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62802cb00 con 0x7fc630154af0 2024-01-20T08:11:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.372+0000 7fc62fe00640 1 -- 172.21.15.100:0/1968811782 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62802cc60 con 0x7fc630154af0 2024-01-20T08:11:38.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.372+0000 7fc62fe00640 1 -- 172.21.15.100:0/1968811782 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6280343f0 con 0x7fc630154af0 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 -- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc630154af0 msgr2=0x7fc630154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc630154af0 0x7fc630154f60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc628009e50 tx=0x7fc62802bf60 comp rx=0 tx=0).stop 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 -- 172.21.15.100:0/1968811782 shutdown_connections 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc630154af0 0x7fc630154f60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 --2- 172.21.15.100:0/1968811782 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6300c05a0 0x7fc63006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 -- 172.21.15.100:0/1968811782 >> 172.21.15.100:0/1968811782 conn(0x7fc6300c6090 msgr2=0x7fc6300c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 -- 172.21.15.100:0/1968811782 shutdown_connections 2024-01-20T08:11:38.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.373+0000 7fc638600640 1 -- 172.21.15.100:0/1968811782 wait complete. 2024-01-20T08:11:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.375+0000 7fc638600640 1 Processor -- start 2024-01-20T08:11:38.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.375+0000 7fc638600640 1 -- start start 2024-01-20T08:11:38.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.375+0000 7fc638600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc638600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc630071fb0 0x7fc6301ea690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc638600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6301528d0 0x7fc6301eabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc638600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc630070ad0 con 0x7fc630154af0 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc638600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300700e0 con 0x7fc6301528d0 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc638600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300aba30 con 0x7fc630071fb0 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41376/0 (socket says 172.21.15.100:41376) 2024-01-20T08:11:38.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 -- 172.21.15.100:0/646420528 learned_addr learned my addr 172.21.15.100:0/646420528 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 -- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc630071fb0 msgr2=0x7fc6301ea690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc630071fb0 0x7fc6301ea690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc636600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6301528d0 0x7fc6301eabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 -- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6301528d0 msgr2=0x7fc6301eabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6301528d0 0x7fc6301eabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.376+0000 7fc635c00640 1 -- 172.21.15.100:0/646420528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc628009b30 con 0x7fc630154af0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc635c00640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c450 tx=0x7fc62000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6200052d0 con 0x7fc630154af0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc620005430 con 0x7fc630154af0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620012870 con 0x7fc630154af0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300706a0 con 0x7fc630154af0 2024-01-20T08:11:38.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.377+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc630070330 con 0x7fc630154af0 2024-01-20T08:11:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.378+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6300a9540 con 0x7fc630154af0 2024-01-20T08:11:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.379+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc6200129d0 con 0x7fc630154af0 2024-01-20T08:11:38.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.380+0000 7fc62d600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 0x7fc60806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.380+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc620089410 con 0x7fc630154af0 2024-01-20T08:11:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.380+0000 7fc635200640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 0x7fc60806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.381+0000 7fc635200640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 0x7fc60806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc618006a90 tx=0x7fc618006a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.384+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc620054010 con 0x7fc630154af0 2024-01-20T08:11:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.575+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc6300c67d0 con 0x7fc630154af0 2024-01-20T08:11:38.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.576+0000 7fc62d600640 1 -- 172.21.15.100:0/646420528 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc620057630 con 0x7fc630154af0 2024-01-20T08:11:38.578 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 msgr2=0x7fc60806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 0x7fc60806d390 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc618006a90 tx=0x7fc618006a20 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 msgr2=0x7fc6300bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc62000c450 tx=0x7fc62000c910 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 shutdown_connections 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6301528d0 0x7fc6301eabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc60806aed0 0x7fc60806d390 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc630071fb0 0x7fc6301ea690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 --2- 172.21.15.100:0/646420528 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc630154af0 0x7fc6300bf730 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.578+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 >> 172.21.15.100:0/646420528 conn(0x7fc6300c6090 msgr2=0x7fc6301454f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.579+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 shutdown_connections 2024-01-20T08:11:38.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.579+0000 7fc638600640 1 -- 172.21.15.100:0/646420528 wait complete. 2024-01-20T08:11:38.600 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:11:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.810+0000 7f273a200640 1 Processor -- start 2024-01-20T08:11:38.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.810+0000 7f273a200640 1 -- start start 2024-01-20T08:11:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.811+0000 7f273a200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 0x7f27341550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.811+0000 7f273a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27341581e0 0x7f2734158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.811+0000 7f273a200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2734158bb0 con 0x7f273414e690 2024-01-20T08:11:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.811+0000 7f273a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2734157d00 con 0x7f27341581e0 2024-01-20T08:11:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.811+0000 7f273a200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340c4890 con 0x7f27340c7e10 2024-01-20T08:11:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2738e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f273414e690 0x7f27340ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:55294/0 (socket says 172.21.15.100:55294) 2024-01-20T08:11:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2738e00640 1 -- 172.21.15.100:0/2413298868 learned_addr learned my addr 172.21.15.100:0/2413298868 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:38.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2739800640 1 --2- 172.21.15.100:0/2413298868 >> v2:172.21.15.100:3300/0 conn(0x7f27341581e0 0x7f2734158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2733e00640 1 --2- 172.21.15.100:0/2413298868 >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 0x7f27341550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2733400640 1 -- 172.21.15.100:0/2413298868 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2695106167 0 0) 0x7f2734158bb0 con 0x7f273414e690 2024-01-20T08:11:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2733400640 1 -- 172.21.15.100:0/2413298868 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714003520 con 0x7f273414e690 2024-01-20T08:11:38.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2739800640 1 -- 172.21.15.100:0/2413298868 >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 msgr2=0x7f27341550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2739800640 1 --2- 172.21.15.100:0/2413298868 >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 0x7f27341550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2739800640 1 -- 172.21.15.100:0/2413298868 >> v1:172.21.15.100:6789/0 conn(0x7f273414e690 legacy=0x7f27340ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2739800640 1 -- 172.21.15.100:0/2413298868 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273406cd00 con 0x7f27341581e0 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.812+0000 7f2733e00640 1 --2- 172.21.15.100:0/2413298868 >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 0x7f27341550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.813+0000 7f2739800640 1 --2- 172.21.15.100:0/2413298868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27341581e0 0x7f2734158670 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f27340caf80 tx=0x7f272c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d859dfa78770cb54 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.813+0000 7f2733400640 1 -- 172.21.15.100:0/2413298868 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c02e070 con 0x7f27341581e0 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f2733400640 1 -- 172.21.15.100:0/2413298868 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272c0315a0 con 0x7f27341581e0 2024-01-20T08:11:38.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f2733400640 1 -- 172.21.15.100:0/2413298868 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272c031930 con 0x7f27341581e0 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 -- 172.21.15.100:0/2413298868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27341581e0 msgr2=0x7f2734158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 --2- 172.21.15.100:0/2413298868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27341581e0 0x7f2734158670 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f27340caf80 tx=0x7f272c02b840 comp rx=0 tx=0).stop 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 -- 172.21.15.100:0/2413298868 shutdown_connections 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 --2- 172.21.15.100:0/2413298868 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27341581e0 0x7f2734158670 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 --2- 172.21.15.100:0/2413298868 >> v2:172.21.15.110:3300/0 conn(0x7f27340c7e10 0x7f27341550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 -- 172.21.15.100:0/2413298868 >> 172.21.15.100:0/2413298868 conn(0x7f2734072130 msgr2=0x7f2734072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 -- 172.21.15.100:0/2413298868 shutdown_connections 2024-01-20T08:11:38.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.814+0000 7f273a200640 1 -- 172.21.15.100:0/2413298868 wait complete. 2024-01-20T08:11:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.816+0000 7f273a200640 1 Processor -- start 2024-01-20T08:11:38.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.816+0000 7f273a200640 1 -- start start 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273414e690 0x7f2734147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27341581e0 0x7f27341481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c3e90 con 0x7f27340c7e10 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27341eda20 con 0x7f273414e690 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f273a200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27341edd00 con 0x7f27341581e0 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41400/0 (socket says 172.21.15.100:41400) 2024-01-20T08:11:38.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 -- 172.21.15.100:0/3095024292 learned_addr learned my addr 172.21.15.100:0/3095024292 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 -- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27341581e0 msgr2=0x7f27341481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27341581e0 0x7f27341481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 -- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273414e690 msgr2=0x7f2734147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273414e690 0x7f2734147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.817+0000 7f2738e00640 1 -- 172.21.15.100:0/3095024292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f272c009400 con 0x7f27340c7e10 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f2738e00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f272400cb40 tx=0x7f272400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272400aca0 con 0x7f27340c7e10 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400ae00 con 0x7f27340c7e10 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724012620 con 0x7f27340c7e10 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27340c2030 con 0x7f27340c7e10 2024-01-20T08:11:38.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.818+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2734152370 con 0x7f27340c7e10 2024-01-20T08:11:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.819+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734152590 con 0x7f27340c7e10 2024-01-20T08:11:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.820+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2724007070 con 0x7f27340c7e10 2024-01-20T08:11:38.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.821+0000 7f2730c00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 0x7f270c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.821+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2724089960 con 0x7f27340c7e10 2024-01-20T08:11:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.821+0000 7f2733e00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 0x7f270c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:38.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.822+0000 7f2733e00640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 0x7f270c06d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f271c006fd0 tx=0x7f271c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:38.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:38.825+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2734152590 con 0x7f27340c7e10 2024-01-20T08:11:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.017+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27340c2550 con 0x7f27340c7e10 2024-01-20T08:11:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.018+0000 7f2730c00640 1 -- 172.21.15.100:0/3095024292 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27340c2550 con 0x7f27340c7e10 2024-01-20T08:11:39.020 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.020+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 msgr2=0x7f270c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.020+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 0x7f270c06d390 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f271c006fd0 tx=0x7f271c008040 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.020+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 msgr2=0x7f27341570d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.020+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f272400cb40 tx=0x7f272400a060 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 shutdown_connections 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06aed0 0x7f270c06d390 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27341581e0 0x7f27341481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f273414e690 0x7f2734147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 --2- 172.21.15.100:0/3095024292 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27340c7e10 0x7f27341570d0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 >> 172.21.15.100:0/3095024292 conn(0x7f2734072130 msgr2=0x7f2734153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 shutdown_connections 2024-01-20T08:11:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.021+0000 7f273a200640 1 -- 172.21.15.100:0/3095024292 wait complete. 2024-01-20T08:11:39.043 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:11:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.254+0000 7f8669800640 1 Processor -- start 2024-01-20T08:11:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.254+0000 7f8669800640 1 -- start start 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.255+0000 7f8669800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866414c750 0x7f8664153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.255+0000 7f8669800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86640ab0b0 0x7f86640a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.255+0000 7f8669800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86640ab620 con 0x7f86640a96f0 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.255+0000 7f8669800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866414cb30 con 0x7f86640ab0b0 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.255+0000 7f8669800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640ab900 con 0x7f866414c750 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86640ab0b0 0x7f86640a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86640ab0b0 0x7f86640a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58772/0 (socket says 172.21.15.100:58772) 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 -- 172.21.15.100:0/2110449198 learned_addr learned my addr 172.21.15.100:0/2110449198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662a00640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866414c750 0x7f8664153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 -- 172.21.15.100:0/2110449198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866414c750 msgr2=0x7f8664153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866414c750 0x7f8664153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 -- 172.21.15.100:0/2110449198 >> v1:172.21.15.110:6789/0 conn(0x7f86640a96f0 legacy=0x7f86640715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:39.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.256+0000 7f8662000640 1 -- 172.21.15.100:0/2110449198 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640abbe0 con 0x7f86640ab0b0 2024-01-20T08:11:39.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.257+0000 7f8662000640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86640ab0b0 0x7f86640a91b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f864c009870 tx=0x7f864c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1adf5e8412286b0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8661600640 1 -- 172.21.15.100:0/2110449198 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c031640 con 0x7f86640ab0b0 2024-01-20T08:11:39.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8661600640 1 -- 172.21.15.100:0/2110449198 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0317a0 con 0x7f86640ab0b0 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8661600640 1 -- 172.21.15.100:0/2110449198 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c031b30 con 0x7f86640ab0b0 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 -- 172.21.15.100:0/2110449198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86640ab0b0 msgr2=0x7f86640a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86640ab0b0 0x7f86640a91b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f864c009870 tx=0x7f864c02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 -- 172.21.15.100:0/2110449198 shutdown_connections 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86640ab0b0 0x7f86640a91b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 --2- 172.21.15.100:0/2110449198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866414c750 0x7f8664153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 -- 172.21.15.100:0/2110449198 >> 172.21.15.100:0/2110449198 conn(0x7f86640c6090 msgr2=0x7f86640c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.258+0000 7f8669800640 1 -- 172.21.15.100:0/2110449198 shutdown_connections 2024-01-20T08:11:39.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.259+0000 7f8669800640 1 -- 172.21.15.100:0/2110449198 wait complete. 2024-01-20T08:11:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.260+0000 7f8669800640 1 Processor -- start 2024-01-20T08:11:39.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.260+0000 7f8669800640 1 -- start start 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86640a96f0 0x7f86640bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86640ab0b0 0x7f8664144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c3ed0 con 0x7f866414c750 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664145780 con 0x7f86640ab0b0 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8669800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866406d0f0 con 0x7f86640a96f0 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.261+0000 7f8663400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58786/0 (socket says 172.21.15.100:58786) 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 -- 172.21.15.100:0/3645154943 learned_addr learned my addr 172.21.15.100:0/3645154943 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8662a00640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86640a96f0 0x7f86640bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8662000640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86640ab0b0 0x7f8664144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 -- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86640a96f0 msgr2=0x7f86640bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86640a96f0 0x7f86640bf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 -- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86640ab0b0 msgr2=0x7f8664144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86640ab0b0 0x7f8664144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 -- 172.21.15.100:0/3645154943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0094d0 con 0x7f866414c750 2024-01-20T08:11:39.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.262+0000 7f8663400640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c780 tx=0x7f865c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.263+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c004b60 con 0x7f866414c750 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.263+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c00ce90 con 0x7f866414c750 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.263+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866414d550 con 0x7f866414c750 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.263+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c00a850 con 0x7f866414c750 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.263+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86641eea20 con 0x7f866414c750 2024-01-20T08:11:39.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.264+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8664071940 con 0x7f866414c750 2024-01-20T08:11:39.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.265+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f865c00a9b0 con 0x7f866414c750 2024-01-20T08:11:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.266+0000 7f865aa00640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 0x7f863c06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.266+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f865c089b00 con 0x7f866414c750 2024-01-20T08:11:39.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.267+0000 7f8662a00640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 0x7f863c06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.267+0000 7f8662a00640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 0x7f863c06d3e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8654006fd0 tx=0x7f8654008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.271+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f865c08be60 con 0x7f866414c750 2024-01-20T08:11:39.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.461+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f866404ea50 con 0x7f866414c750 2024-01-20T08:11:39.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.462+0000 7f865aa00640 1 -- 172.21.15.100:0/3645154943 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f865c0546e0 con 0x7f866414c750 2024-01-20T08:11:39.464 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.465+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 msgr2=0x7f863c06d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.465+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 0x7f863c06d3e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f8654006fd0 tx=0x7f8654008040 comp rx=0 tx=0).stop 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.465+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 msgr2=0x7f8664145240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.465+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f865c00c780 tx=0x7f865c00cc40 comp rx=0 tx=0).stop 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 shutdown_connections 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f866414c750 0x7f8664145240 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86640ab0b0 0x7f8664144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f863c06af20 0x7f863c06d3e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 --2- 172.21.15.100:0/3645154943 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f86640a96f0 0x7f86640bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 >> 172.21.15.100:0/3645154943 conn(0x7f86640c6090 msgr2=0x7f866414aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:39.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 shutdown_connections 2024-01-20T08:11:39.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.466+0000 7f8669800640 1 -- 172.21.15.100:0/3645154943 wait complete. 2024-01-20T08:11:39.485 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:11:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.694+0000 7f88dcc00640 1 Processor -- start 2024-01-20T08:11:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.694+0000 7f88dcc00640 1 -- start start 2024-01-20T08:11:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88dcc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f88d814b720 0x7f88d81515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88dcc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d8154ba0 con 0x7f88d80c1850 2024-01-20T08:11:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88dcc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88d8155a00 con 0x7f88d80c1d00 2024-01-20T08:11:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88dcc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88d814bb00 con 0x7f88d814b720 2024-01-20T08:11:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88cfe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f88d80c1850 0x7f88d806c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49300/0 (socket says 172.21.15.100:49300) 2024-01-20T08:11:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88cfe00640 1 -- 172.21.15.100:0/3421486979 learned_addr learned my addr 172.21.15.100:0/3421486979 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88d5e00640 1 --2- 172.21.15.100:0/3421486979 >> v2:172.21.15.110:3300/0 conn(0x7f88d814b720 0x7f88d81515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 475998960 0 0) 0x7f88d8154ba0 con 0x7f88d80c1850 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.696+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b8003520 con 0x7f88d80c1850 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 830833995 0 0) 0x7f88b8003520 con 0x7f88d80c1850 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 >> v2:172.21.15.110:3300/0 conn(0x7f88d814b720 msgr2=0x7f88d81515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 --2- 172.21.15.100:0/3421486979 >> v2:172.21.15.110:3300/0 conn(0x7f88d814b720 0x7f88d81515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 >> v1:172.21.15.110:6789/0 conn(0x7f88d80c1d00 legacy=0x7f88d806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8154df0 con 0x7f88d80c1850 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f88c0001670 con 0x7f88d80c1850 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 >> v1:172.21.15.100:6789/0 conn(0x7f88d80c1850 legacy=0x7f88d806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 0x7f88b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b80047c0 0x7f88b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88b80052a0 0x7f88b800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814bb00 con 0x7f88b8003970 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b800e380 con 0x7f88b80047c0 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b800e540 con 0x7f88b80052a0 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.697+0000 7f88d5e00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 0x7f88b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d5e00640 1 -- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88b80052a0 msgr2=0x7f88b800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d5e00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88b80052a0 0x7f88b800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d5e00640 1 -- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b80047c0 msgr2=0x7f88b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d5e00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b80047c0 0x7f88b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d5e00640 1 -- 172.21.15.100:0/3421486979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b8003520 con 0x7f88b8003970 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.698+0000 7f88d6800640 1 -- 172.21.15.100:0/3421486979 reap_dead start 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88d5e00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 0x7f88b8003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009a90 tx=0x7f88b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83aa42f42f7c8921 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c802c6b0 con 0x7f88b8003970 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c802c810 con 0x7f88b8003970 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88d5400640 1 -- 172.21.15.100:0/3421486979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c802cba0 con 0x7f88b8003970 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88dcc00640 1 -- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 msgr2=0x7f88b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.699+0000 7f88dcc00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 0x7f88b8003d90 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009a90 tx=0x7f88b80057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.700+0000 7f88dcc00640 1 -- 172.21.15.100:0/3421486979 shutdown_connections 2024-01-20T08:11:39.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.700+0000 7f88dcc00640 1 --2- 172.21.15.100:0/3421486979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88b8003970 0x7f88b8003d90 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.700+0000 7f88dcc00640 1 -- 172.21.15.100:0/3421486979 >> 172.21.15.100:0/3421486979 conn(0x7f88d80c2940 msgr2=0x7f88d80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:39.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.700+0000 7f88dcc00640 1 -- 172.21.15.100:0/3421486979 shutdown_connections 2024-01-20T08:11:39.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.700+0000 7f88dcc00640 1 -- 172.21.15.100:0/3421486979 wait complete. 2024-01-20T08:11:39.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.701+0000 7f88dcc00640 1 Processor -- start 2024-01-20T08:11:39.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.701+0000 7f88dcc00640 1 -- start start 2024-01-20T08:11:39.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 0x7f88d81de3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 0x7f88d81ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814a5c0 con 0x7f88d814aaf0 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d80aaeb0 con 0x7f88b8003970 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.702+0000 7f88dcc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d814a810 con 0x7f88d8149db0 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58804/0 (socket says 172.21.15.100:58804) 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 -- 172.21.15.100:0/2332472235 learned_addr learned my addr 172.21.15.100:0/2332472235 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88d5e00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 0x7f88d81de3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88d6800640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 0x7f88d81ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 -- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 msgr2=0x7f88d81ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 0x7f88d81ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 -- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 msgr2=0x7f88d81de3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 0x7f88d81de3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 -- 172.21.15.100:0/2332472235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d80aa860 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88d5e00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 0x7f88d81de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88d6800640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 0x7f88d81ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.703+0000 7f88cfe00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c740 tx=0x7f88c000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.704+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00074e0 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.704+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c0007640 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.704+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c0004a00 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.704+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88d80aab40 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.704+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88d80ab4e0 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.705+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88d804e970 con 0x7f88d814aaf0 2024-01-20T08:11:39.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.706+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f88c0004b60 con 0x7f88d814aaf0 2024-01-20T08:11:39.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.707+0000 7f88ce000640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:39.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.707+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f88c0088e00 con 0x7f88d814aaf0 2024-01-20T08:11:39.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.707+0000 7f88d5e00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:39.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.708+0000 7f88d5e00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 0x7f88b006d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88c8036000 tx=0x7f88c8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:39.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.711+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f88c0053960 con 0x7f88d814aaf0 2024-01-20T08:11:39.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.902+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f88d80aacd0 con 0x7f88d814aaf0 2024-01-20T08:11:39.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.903+0000 7f88ce000640 1 -- 172.21.15.100:0/2332472235 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f88c0018070 con 0x7f88d814aaf0 2024-01-20T08:11:39.905 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.905+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 msgr2=0x7f88b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.905+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 0x7f88b006d390 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f88c8036000 tx=0x7f88c8030000 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.905+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 msgr2=0x7f88d8149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f88c000c740 tx=0x7f88c000cc00 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 shutdown_connections 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f88b006aed0 0x7f88b006d390 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f88d8149db0 0x7f88d81ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f88d814aaf0 0x7f88d8149870 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 --2- 172.21.15.100:0/2332472235 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88b8003970 0x7f88d81de3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:39.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 >> 172.21.15.100:0/2332472235 conn(0x7f88d80c2940 msgr2=0x7f88d80c0ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:39.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 shutdown_connections 2024-01-20T08:11:39.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:39.906+0000 7f88dcc00640 1 -- 172.21.15.100:0/2332472235 wait complete. 2024-01-20T08:11:39.926 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:11:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.137+0000 7f74bd600640 1 Processor -- start 2024-01-20T08:11:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.137+0000 7f74bd600640 1 -- start start 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74bd600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f74b8070190 0x7f74b815c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74bd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74b815cb60 0x7f74b81635d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74bd600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b806d420 con 0x7f74b815c240 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74bd600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80705b0 con 0x7f74b815cb60 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74bd600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74b80c2260 con 0x7f74b8070190 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74b6a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f74b815c240 0x7f74b806cd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49310/0 (socket says 172.21.15.100:49310) 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74b6a00640 1 -- 172.21.15.100:0/4015296690 learned_addr learned my addr 172.21.15.100:0/4015296690 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:40.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.139+0000 7f74b7400640 1 --2- 172.21.15.100:0/4015296690 >> v2:172.21.15.100:3300/0 conn(0x7f74b815cb60 0x7f74b81635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b6000640 1 --2- 172.21.15.100:0/4015296690 >> v2:172.21.15.110:3300/0 conn(0x7f74b8070190 0x7f74b815c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b7400640 1 -- 172.21.15.100:0/4015296690 >> v2:172.21.15.110:3300/0 conn(0x7f74b8070190 msgr2=0x7f74b815c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b7400640 1 --2- 172.21.15.100:0/4015296690 >> v2:172.21.15.110:3300/0 conn(0x7f74b8070190 0x7f74b815c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b7400640 1 -- 172.21.15.100:0/4015296690 >> v1:172.21.15.100:6789/0 conn(0x7f74b815c240 legacy=0x7f74b806cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b5600640 1 -- 172.21.15.100:0/4015296690 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041377690 0 0) 0x7f74b806d420 con 0x7f74b815c240 2024-01-20T08:11:40.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.140+0000 7f74b7400640 1 -- 172.21.15.100:0/4015296690 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80c2540 con 0x7f74b815cb60 2024-01-20T08:11:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.141+0000 7f74b7400640 1 --2- 172.21.15.100:0/4015296690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815cb60 0x7f74b81635d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f74b806fde0 tx=0x7f74b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a644210eecb2f3b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.141+0000 7f74b5600640 1 -- 172.21.15.100:0/4015296690 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b002e070 con 0x7f74b815cb60 2024-01-20T08:11:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.141+0000 7f74b5600640 1 -- 172.21.15.100:0/4015296690 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b00315a0 con 0x7f74b815cb60 2024-01-20T08:11:40.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.141+0000 7f74b5600640 1 -- 172.21.15.100:0/4015296690 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b0031930 con 0x7f74b815cb60 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 -- 172.21.15.100:0/4015296690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815cb60 msgr2=0x7f74b81635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 --2- 172.21.15.100:0/4015296690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815cb60 0x7f74b81635d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f74b806fde0 tx=0x7f74b002b840 comp rx=0 tx=0).stop 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 -- 172.21.15.100:0/4015296690 shutdown_connections 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 --2- 172.21.15.100:0/4015296690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815cb60 0x7f74b81635d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 --2- 172.21.15.100:0/4015296690 >> v2:172.21.15.110:3300/0 conn(0x7f74b8070190 0x7f74b815c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 -- 172.21.15.100:0/4015296690 >> 172.21.15.100:0/4015296690 conn(0x7f74b80c2940 msgr2=0x7f74b80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:40.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 -- 172.21.15.100:0/4015296690 shutdown_connections 2024-01-20T08:11:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.142+0000 7f74bd600640 1 -- 172.21.15.100:0/4015296690 wait complete. 2024-01-20T08:11:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.144+0000 7f74bd600640 1 Processor -- start 2024-01-20T08:11:40.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.144+0000 7f74bd600640 1 -- start start 2024-01-20T08:11:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74b8070190 0x7f74b81ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74b815cb60 0x7f74b80c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81ef960 con 0x7f74b815c240 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8144000 con 0x7f74b8070190 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74bd600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b814e4a0 con 0x7f74b815cb60 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58834/0 (socket says 172.21.15.100:58834) 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6000640 1 -- 172.21.15.100:0/190775124 learned_addr learned my addr 172.21.15.100:0/190775124 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6a00640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74b8070190 0x7f74b81ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6000640 1 -- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74b815cb60 msgr2=0x7f74b80c48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.145+0000 7f74b6000640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74b815cb60 0x7f74b80c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74b6000640 1 -- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74b8070190 msgr2=0x7f74b81ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74b6000640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74b8070190 0x7f74b81ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74b6000640 1 -- 172.21.15.100:0/190775124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009400 con 0x7f74b815c240 2024-01-20T08:11:40.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74b6000640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74a0007e40 tx=0x7f74a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a0014620 con 0x7f74b815c240 2024-01-20T08:11:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a000ee90 con 0x7f74b815c240 2024-01-20T08:11:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a00149c0 con 0x7f74b815c240 2024-01-20T08:11:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b814e780 con 0x7f74b815c240 2024-01-20T08:11:40.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.146+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b814d2d0 con 0x7f74b815c240 2024-01-20T08:11:40.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.147+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b814eca0 con 0x7f74b815c240 2024-01-20T08:11:40.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.148+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f74a0014b20 con 0x7f74b815c240 2024-01-20T08:11:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.149+0000 7f74aea00640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 0x7f749006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.149+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f74a008a3d0 con 0x7f74b815c240 2024-01-20T08:11:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.149+0000 7f74b6a00640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 0x7f749006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.150+0000 7f74b6a00640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 0x7f749006d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74a8000f60 tx=0x7f74a8007c00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.154+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f74b814eca0 con 0x7f74b815c240 2024-01-20T08:11:40.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.359+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74b814d130 con 0x7f74b815c240 2024-01-20T08:11:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.360+0000 7f74aea00640 1 -- 172.21.15.100:0/190775124 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v38) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74b814d130 con 0x7f74b815c240 2024-01-20T08:11:40.362 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:11:40.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 msgr2=0x7f749006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 0x7f749006d390 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f74a8000f60 tx=0x7f74a8007c00 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 msgr2=0x7f74b81e33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f74a0007e40 tx=0x7f74a000e4b0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 shutdown_connections 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f749006aed0 0x7f749006d390 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f74b815cb60 0x7f74b80c48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74b815c240 0x7f74b81e33d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 --2- 172.21.15.100:0/190775124 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f74b8070190 0x7f74b81ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.362+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 >> 172.21.15.100:0/190775124 conn(0x7f74b80c2940 msgr2=0x7f74b8071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.363+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 shutdown_connections 2024-01-20T08:11:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.363+0000 7f74bd600640 1 -- 172.21.15.100:0/190775124 wait complete. 2024-01-20T08:11:40.383 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:11:40.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:40.384 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:11:40.487 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:11:40.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:11:40.488 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:11:40.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:40.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.753+0000 7fdf02400640 1 Processor -- start 2024-01-20T08:11:40.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.753+0000 7fdf02400640 1 -- start start 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdf02400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdefc0c11a0 0x7fdefc1589f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdf02400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0c2300 con 0x7fdefc152c10 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdf02400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdefc0c16f0 con 0x7fdefc15a180 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdf02400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdefc15be00 con 0x7fdefc0c11a0 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdef3c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdefc0c11a0 0x7fdefc1589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdef3c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdefc0c11a0 0x7fdefc1589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58840/0 (socket says 172.21.15.100:58840) 2024-01-20T08:11:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.755+0000 7fdef3c00640 1 -- 172.21.15.100:0/2973637427 learned_addr learned my addr 172.21.15.100:0/2973637427 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.756+0000 7fdef3c00640 1 -- 172.21.15.100:0/2973637427 >> v1:172.21.15.110:6789/0 conn(0x7fdefc15a180 legacy=0x7fdefc15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.756+0000 7fdef3c00640 1 -- 172.21.15.100:0/2973637427 >> v1:172.21.15.100:6789/0 conn(0x7fdefc152c10 legacy=0x7fdefc06c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.756+0000 7fdef3c00640 1 -- 172.21.15.100:0/2973637427 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdefc0c19d0 con 0x7fdefc0c11a0 2024-01-20T08:11:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.757+0000 7fdef3c00640 1 --2- 172.21.15.100:0/2973637427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc0c11a0 0x7fdefc1589f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009870 tx=0x7fdee402ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c56c6f498fd19e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.757+0000 7fdefbe00640 1 -- 172.21.15.100:0/2973637427 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee402f850 con 0x7fdefc0c11a0 2024-01-20T08:11:40.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.757+0000 7fdefbe00640 1 -- 172.21.15.100:0/2973637427 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee402f9b0 con 0x7fdefc0c11a0 2024-01-20T08:11:40.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.757+0000 7fdefbe00640 1 -- 172.21.15.100:0/2973637427 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee402fd40 con 0x7fdefc0c11a0 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 -- 172.21.15.100:0/2973637427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc0c11a0 msgr2=0x7fdefc1589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 --2- 172.21.15.100:0/2973637427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc0c11a0 0x7fdefc1589f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009870 tx=0x7fdee402ba30 comp rx=0 tx=0).stop 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 -- 172.21.15.100:0/2973637427 shutdown_connections 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 --2- 172.21.15.100:0/2973637427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc0c11a0 0x7fdefc1589f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 -- 172.21.15.100:0/2973637427 >> 172.21.15.100:0/2973637427 conn(0x7fdefc0c2590 msgr2=0x7fdefc0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 -- 172.21.15.100:0/2973637427 shutdown_connections 2024-01-20T08:11:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.758+0000 7fdf02400640 1 -- 172.21.15.100:0/2973637427 wait complete. 2024-01-20T08:11:40.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.760+0000 7fdf02400640 1 Processor -- start 2024-01-20T08:11:40.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.760+0000 7fdf02400640 1 -- start start 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 0x7fdefc0a8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdefc15a180 0x7fdefc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1535c0 con 0x7fdefc152c10 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc0c3b30 con 0x7fdefc0c11a0 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdf02400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdefc1540d0 con 0x7fdefc15a180 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdef3c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdef3c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58856/0 (socket says 172.21.15.100:58856) 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.761+0000 7fdef3c00640 1 -- 172.21.15.100:0/1686772740 learned_addr learned my addr 172.21.15.100:0/1686772740 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdf01000640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 0x7fdefc0a8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 -- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdefc15a180 msgr2=0x7fdefc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdf01a00640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdefc15a180 0x7fdefc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdefc15a180 0x7fdefc154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 -- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 msgr2=0x7fdefc0a8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 0x7fdefc0a8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 -- 172.21.15.100:0/1686772740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee40094d0 con 0x7fdefc152c10 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdf01000640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 0x7fdefc0a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:40.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef3c00640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000c00 tx=0x7fdee4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee402f820 con 0x7fdefc152c10 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.762+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdee4041400 con 0x7fdefc152c10 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.763+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdee40417d0 con 0x7fdefc152c10 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.763+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdefc1537a0 con 0x7fdefc152c10 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.763+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdefc153d60 con 0x7fdefc152c10 2024-01-20T08:11:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.764+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdefc06e470 con 0x7fdefc152c10 2024-01-20T08:11:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.765+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdee4041930 con 0x7fdefc152c10 2024-01-20T08:11:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.766+0000 7fdef9600640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 0x7fded406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.766+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdee403c070 con 0x7fdefc152c10 2024-01-20T08:11:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.766+0000 7fdf01000640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 0x7fded406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.767+0000 7fdf01000640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 0x7fded406d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdeec000f60 tx=0x7fdeec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:40.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:40.771+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdee40774b0 con 0x7fdefc152c10 2024-01-20T08:11:41.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.003+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdefc154240 con 0x7fdefc152c10 2024-01-20T08:11:41.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.004+0000 7fdef9600640 1 -- 172.21.15.100:0/1686772740 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6189 (secure 0 0 0) 0x7fdee407aad0 con 0x7fdefc152c10 2024-01-20T08:11:41.007 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:41.007 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:41.008 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-01-20T08:11:41.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 msgr2=0x7fded406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 0x7fded406d390 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fdeec000f60 tx=0x7fdeec009040 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 msgr2=0x7fdefc154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fdee4000c00 tx=0x7fdee4004730 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 shutdown_connections 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fded406aed0 0x7fded406d390 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdefc15a180 0x7fdefc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdefc152c10 0x7fdefc154560 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 --2- 172.21.15.100:0/1686772740 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdefc0c11a0 0x7fdefc0a8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.007+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 >> 172.21.15.100:0/1686772740 conn(0x7fdefc0c2590 msgr2=0x7fdefc070fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.008+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 shutdown_connections 2024-01-20T08:11:41.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.008+0000 7fdf02400640 1 -- 172.21.15.100:0/1686772740 wait complete. 2024-01-20T08:11:41.032 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.232+0000 7f6d73c00640 1 Processor -- start 2024-01-20T08:11:41.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.232+0000 7f6d73c00640 1 -- start start 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d73c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6d6c151f60 0x7f6d6c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d73c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c0c1670 con 0x7f6d6c147f20 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d73c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c070800 con 0x7f6d6c070370 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d73c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c2210 con 0x7f6d6c151f60 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d71200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6d6c147f20 0x7f6d6c0c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49334/0 (socket says 172.21.15.100:49334) 2024-01-20T08:11:41.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d71200640 1 -- 172.21.15.100:0/3191107396 learned_addr learned my addr 172.21.15.100:0/3191107396 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299939386 0 0) 0x7f6d6c0c1670 con 0x7f6d6c147f20 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d4c003520 con 0x7f6d6c147f20 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.234+0000 7f6d63c00640 1 --2- 172.21.15.100:0/3191107396 >> v2:172.21.15.110:3300/0 conn(0x7f6d6c151f60 0x7f6d6c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 232586468 0 0) 0x7f6d4c003520 con 0x7f6d6c147f20 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 >> v2:172.21.15.110:3300/0 conn(0x7f6d6c151f60 msgr2=0x7f6d6c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 --2- 172.21.15.100:0/3191107396 >> v2:172.21.15.110:3300/0 conn(0x7f6d6c151f60 0x7f6d6c0abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 >> v1:172.21.15.110:6789/0 conn(0x7f6d6c070370 legacy=0x7f6d6c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c0c0d40 con 0x7f6d6c147f20 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6d5c0019f0 con 0x7f6d6c147f20 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 >> v1:172.21.15.100:6789/0 conn(0x7f6d6c147f20 legacy=0x7f6d6c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c003970 0x7f6d4c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d4c0047c0 0x7f6d4c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 0x7f6d4c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0c2210 con 0x7f6d4c005180 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c00c0b0 con 0x7f6d4c0047c0 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d4c00e480 con 0x7f6d4c003970 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.235+0000 7f6d71c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 0x7f6d4c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d63c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d4c0047c0 0x7f6d4c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71200640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c003970 0x7f6d4c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71c00640 1 -- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c003970 msgr2=0x7f6d4c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c003970 0x7f6d4c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71c00640 1 -- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d4c0047c0 msgr2=0x7f6d4c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d4c0047c0 0x7f6d4c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.236+0000 7f6d71c00640 1 -- 172.21.15.100:0/3191107396 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d4c003520 con 0x7f6d4c005180 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.237+0000 7f6d71c00640 1 -- 172.21.15.100:0/3191107396 reap_dead start 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.237+0000 7f6d71c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 0x7f6d4c00b980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6d64003d80 tx=0x7f6d4c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8768dd4bcdc6d19 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.237+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d64007220 con 0x7f6d4c005180 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.237+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6402e050 con 0x7f6d4c005180 2024-01-20T08:11:41.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.237+0000 7f6d6be00640 1 -- 172.21.15.100:0/3191107396 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640075e0 con 0x7f6d4c005180 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 -- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 msgr2=0x7f6d4c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 0x7f6d4c00b980 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f6d64003d80 tx=0x7f6d4c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 -- 172.21.15.100:0/3191107396 shutdown_connections 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 --2- 172.21.15.100:0/3191107396 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d4c005180 0x7f6d4c00b980 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 -- 172.21.15.100:0/3191107396 >> 172.21.15.100:0/3191107396 conn(0x7f6d6c06a5e0 msgr2=0x7f6d6c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 -- 172.21.15.100:0/3191107396 shutdown_connections 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.238+0000 7f6d73c00640 1 -- 172.21.15.100:0/3191107396 wait complete. 2024-01-20T08:11:41.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.240+0000 7f6d73c00640 1 Processor -- start 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.240+0000 7f6d73c00640 1 -- start start 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c005180 0x7f6d6c1441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c1508e0 0x7f6d6c1ed520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c1535b0 con 0x7f6d6c144e60 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c14e4f0 con 0x7f6d6c1508e0 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d73c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c14e910 con 0x7f6d4c005180 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58876/0 (socket says 172.21.15.100:58876) 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 -- 172.21.15.100:0/1722013326 learned_addr learned my addr 172.21.15.100:0/1722013326 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d71200640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c005180 0x7f6d6c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d71c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c1508e0 0x7f6d6c1ed520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 -- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c005180 msgr2=0x7f6d6c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c005180 0x7f6d6c1441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.241+0000 7f6d63c00640 1 -- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c1508e0 msgr2=0x7f6d6c1ed520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d63c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c1508e0 0x7f6d6c1ed520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d63c00640 1 -- 172.21.15.100:0/1722013326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c144930 con 0x7f6d6c144e60 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d63c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400f550 tx=0x7f6d5400fa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54013810 con 0x7f6d6c144e60 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d54013970 con 0x7f6d6c144e60 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d54013ce0 con 0x7f6d6c144e60 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c144720 con 0x7f6d6c144e60 2024-01-20T08:11:41.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.242+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c152ff0 con 0x7f6d6c144e60 2024-01-20T08:11:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.243+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0c0700 con 0x7f6d6c144e60 2024-01-20T08:11:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.244+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6d5401f460 con 0x7f6d6c144e60 2024-01-20T08:11:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.245+0000 7f6d69600640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 0x7f6d4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.245+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6d54089cf0 con 0x7f6d6c144e60 2024-01-20T08:11:41.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.245+0000 7f6d71200640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 0x7f6d4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.246+0000 7f6d71200640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 0x7f6d4406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0013d0 tx=0x7f6d5c0012c0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.250+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6d54054850 con 0x7f6d6c144e60 2024-01-20T08:11:41.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.442+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6d6c14e630 con 0x7f6d6c144e60 2024-01-20T08:11:41.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.444+0000 7f6d69600640 1 -- 172.21.15.100:0/1722013326 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f6d6c14e630 con 0x7f6d6c144e60 2024-01-20T08:11:41.448 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:41.448 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 msgr2=0x7f6d4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 0x7f6d4406d3c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c0013d0 tx=0x7f6d5c0012c0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 msgr2=0x7f6d6c1503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f6d5400f550 tx=0x7f6d5400fa10 comp rx=0 tx=0).stop 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 shutdown_connections 2024-01-20T08:11:41.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d6c1508e0 0x7f6d6c1ed520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d6c144e60 0x7f6d6c1503a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d4406af00 0x7f6d4406d3c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 --2- 172.21.15.100:0/1722013326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d4c005180 0x7f6d6c1441e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 >> 172.21.15.100:0/1722013326 conn(0x7f6d6c06a5e0 msgr2=0x7f6d6c073600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 shutdown_connections 2024-01-20T08:11:41.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.447+0000 7f6d73c00640 1 -- 172.21.15.100:0/1722013326 wait complete. 2024-01-20T08:11:41.469 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:11:02.438552+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:11:03.706270+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:11:18.055571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:11:18.935347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:41.470 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:41.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.674+0000 7f9043600640 1 Processor -- start 2024-01-20T08:11:41.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.674+0000 7f9043600640 1 -- start start 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f9043600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f903c06b5a0 0x7f903c0c6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f9043600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0c5880 con 0x7f903c06b140 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f9043600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f903c0c9a40 con 0x7f903c151d50 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f9043600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f903c06b9f0 con 0x7f903c06b5a0 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f903be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f903c06b140 0x7f903c0c5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49346/0 (socket says 172.21.15.100:49346) 2024-01-20T08:11:41.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f903be00640 1 -- 172.21.15.100:0/3307442741 learned_addr learned my addr 172.21.15.100:0/3307442741 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f9041600640 1 --2- 172.21.15.100:0/3307442741 >> v2:172.21.15.110:3300/0 conn(0x7f903c06b5a0 0x7f903c0c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2435065803 0 0) 0x7f903c0c5880 con 0x7f903c06b140 2024-01-20T08:11:41.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.676+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f901c003520 con 0x7f903c06b140 2024-01-20T08:11:41.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 213064280 0 0) 0x7f901c003520 con 0x7f903c06b140 2024-01-20T08:11:41.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 >> v2:172.21.15.110:3300/0 conn(0x7f903c06b5a0 msgr2=0x7f903c0c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 --2- 172.21.15.100:0/3307442741 >> v2:172.21.15.110:3300/0 conn(0x7f903c06b5a0 0x7f903c0c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 >> v1:172.21.15.110:6789/0 conn(0x7f903c151d50 legacy=0x7f903c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0c9f10 con 0x7f903c06b140 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f902c0019f0 con 0x7f903c06b140 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 >> v1:172.21.15.100:6789/0 conn(0x7f903c06b140 legacy=0x7f903c0c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 0x7f901c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0051d0 0x7f901c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c06b9f0 con 0x7f901c0039c0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c00c120 con 0x7f901c0047c0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c00c2e0 con 0x7f901c0051d0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.677+0000 7f9040c00640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 0x7f901c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f903be00640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9041600640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0051d0 0x7f901c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9040c00640 1 -- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0051d0 msgr2=0x7f901c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9040c00640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f901c0051d0 0x7f901c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9040c00640 1 -- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0047c0 msgr2=0x7f901c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9040c00640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0047c0 0x7f901c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9041600640 1 -- 172.21.15.100:0/3307442741 reap_dead start 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.678+0000 7f9040c00640 1 -- 172.21.15.100:0/3307442741 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c003520 con 0x7f901c0039c0 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f9040c00640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 0x7f901c003de0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9024001720 tx=0x7f901c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db79cbb04473a423 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90240052d0 con 0x7f901c0039c0 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902402e050 con 0x7f901c0039c0 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f903b400640 1 -- 172.21.15.100:0/3307442741 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9024003830 con 0x7f901c0039c0 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f9043600640 1 -- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 msgr2=0x7f901c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.679+0000 7f9043600640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 0x7f901c003de0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9024001720 tx=0x7f901c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.680+0000 7f9043600640 1 -- 172.21.15.100:0/3307442741 shutdown_connections 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.680+0000 7f9043600640 1 --2- 172.21.15.100:0/3307442741 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f901c0039c0 0x7f901c003de0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.680+0000 7f9043600640 1 -- 172.21.15.100:0/3307442741 >> 172.21.15.100:0/3307442741 conn(0x7f903c0ca0e0 msgr2=0x7f903c0ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.680+0000 7f9043600640 1 -- 172.21.15.100:0/3307442741 shutdown_connections 2024-01-20T08:11:41.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.680+0000 7f9043600640 1 -- 172.21.15.100:0/3307442741 wait complete. 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.681+0000 7f9043600640 1 Processor -- start 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.681+0000 7f9043600640 1 -- start start 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 0x7f903c0c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 0x7f903c0aad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c1e9f10 con 0x7f903c0c3a20 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f903c0c1650 con 0x7f901c0039c0 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.682+0000 7f9043600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f903c150b70 con 0x7f903c1eabe0 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58894/0 (socket says 172.21.15.100:58894) 2024-01-20T08:11:41.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 -- 172.21.15.100:0/2211895613 learned_addr learned my addr 172.21.15.100:0/2211895613 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9040c00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 0x7f903c0c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f903be00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 0x7f903c0aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 -- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 msgr2=0x7f903c0aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 0x7f903c0aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 -- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 msgr2=0x7f903c0c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 0x7f903c0c3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 -- 172.21.15.100:0/2211895613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0c3fe0 con 0x7f903c0c3a20 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9040c00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 0x7f903c0c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f903be00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 0x7f903c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9041600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f903c0c1140 tx=0x7f9034010c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400e870 con 0x7f903c0c3a20 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.683+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903400e9f0 con 0x7f903c0c3a20 2024-01-20T08:11:41.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.684+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903400eda0 con 0x7f903c0c3a20 2024-01-20T08:11:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.684+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f903c1ea100 con 0x7f903c0c3a20 2024-01-20T08:11:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.684+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f903c1ea6c0 con 0x7f903c0c3a20 2024-01-20T08:11:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.685+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f903c04e970 con 0x7f903c0c3a20 2024-01-20T08:11:41.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.685+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9034021460 con 0x7f903c0c3a20 2024-01-20T08:11:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.686+0000 7f9038c00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 0x7f901406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.686+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9034089850 con 0x7f903c0c3a20 2024-01-20T08:11:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.687+0000 7f9040c00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 0x7f901406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:41.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.687+0000 7f9040c00640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 0x7f901406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9024033000 tx=0x7f9024009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:41.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.691+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f90340543c0 con 0x7f903c0c3a20 2024-01-20T08:11:41.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.882+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f903c06bb50 con 0x7f903c0c3a20 2024-01-20T08:11:41.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.883+0000 7f9038c00640 1 -- 172.21.15.100:0/2211895613 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9034000e60 con 0x7f903c0c3a20 2024-01-20T08:11:41.886 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 msgr2=0x7f901406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 0x7f901406d3c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9024033000 tx=0x7f9024009030 comp rx=0 tx=0).stop 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 msgr2=0x7f903c1ed500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f903c0c1140 tx=0x7f9034010c20 comp rx=0 tx=0).stop 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 shutdown_connections 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f903c0c3a20 0x7f903c1ed500 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f901406af00 0x7f901406d3c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f903c1eabe0 0x7f903c0aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 --2- 172.21.15.100:0/2211895613 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f901c0039c0 0x7f903c0c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 >> 172.21.15.100:0/2211895613 conn(0x7f903c0ca0e0 msgr2=0x7f903c1551e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 shutdown_connections 2024-01-20T08:11:41.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:41.886+0000 7f9043600640 1 -- 172.21.15.100:0/2211895613 wait complete. 2024-01-20T08:11:41.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:11:42.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.119+0000 7f5a91600640 1 Processor -- start 2024-01-20T08:11:42.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.119+0000 7f5a91600640 1 -- start start 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a91600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a91600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 0x7f5a8c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a91600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c06d220 con 0x7f5a8c0c05a0 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a91600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c06dbf0 con 0x7f5a8c1481a0 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a91600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c1557a0 con 0x7f5a8c154af0 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58902/0 (socket says 172.21.15.100:58902) 2024-01-20T08:11:42.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 -- 172.21.15.100:0/4101417054 learned_addr learned my addr 172.21.15.100:0/4101417054 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 -- 172.21.15.100:0/4101417054 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 msgr2=0x7f5a8c154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8b400640 1 --2- 172.21.15.100:0/4101417054 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 0x7f5a8c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 --2- 172.21.15.100:0/4101417054 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 0x7f5a8c154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8aa00640 1 -- 172.21.15.100:0/4101417054 >> v1:172.21.15.100:6789/0 conn(0x7f5a8c0c05a0 legacy=0x7f5a8c0701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.122+0000 7f5a8aa00640 1 -- 172.21.15.100:0/4101417054 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c06c8f0 con 0x7f5a8c1481a0 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.121+0000 7f5a8a000640 1 -- 172.21.15.100:0/4101417054 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535774381 0 0) 0x7f5a8c06d220 con 0x7f5a8c0c05a0 2024-01-20T08:11:42.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.122+0000 7f5a8b400640 1 --2- 172.21.15.100:0/4101417054 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 0x7f5a8c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.123+0000 7f5a8aa00640 1 --2- 172.21.15.100:0/4101417054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0c7130 tx=0x7f5a7c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b448907b3f07b00 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.123+0000 7f5a8a000640 1 -- 172.21.15.100:0/4101417054 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c030860 con 0x7f5a8c1481a0 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.123+0000 7f5a8a000640 1 -- 172.21.15.100:0/4101417054 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c0309c0 con 0x7f5a8c1481a0 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.123+0000 7f5a8a000640 1 -- 172.21.15.100:0/4101417054 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c030d50 con 0x7f5a8c1481a0 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 -- 172.21.15.100:0/4101417054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c1481a0 msgr2=0x7f5a8c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 --2- 172.21.15.100:0/4101417054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f5a8c0c7130 tx=0x7f5a7c02b9a0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 -- 172.21.15.100:0/4101417054 shutdown_connections 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 --2- 172.21.15.100:0/4101417054 >> v2:172.21.15.110:3300/0 conn(0x7f5a8c154af0 0x7f5a8c154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 --2- 172.21.15.100:0/4101417054 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c1481a0 0x7f5a8c06d6b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 -- 172.21.15.100:0/4101417054 >> 172.21.15.100:0/4101417054 conn(0x7f5a8c0c6090 msgr2=0x7f5a8c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 -- 172.21.15.100:0/4101417054 shutdown_connections 2024-01-20T08:11:42.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.124+0000 7f5a91600640 1 -- 172.21.15.100:0/4101417054 wait complete. 2024-01-20T08:11:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.125+0000 7f5a91600640 1 Processor -- start 2024-01-20T08:11:42.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 -- start start 2024-01-20T08:11:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c153ce0 0x7f5a8c13c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c13cd00 0x7f5a8c1ed840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c0abb70 con 0x7f5a8c154af0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c070f70 con 0x7f5a8c13cd00 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.126+0000 7f5a91600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1eb1c0 con 0x7f5a8c153ce0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58918/0 (socket says 172.21.15.100:58918) 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 -- 172.21.15.100:0/21994655 learned_addr learned my addr 172.21.15.100:0/21994655 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 -- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c153ce0 msgr2=0x7f5a8c13c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a81e00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c153ce0 0x7f5a8c13c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8b400640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c13cd00 0x7f5a8c1ed840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c153ce0 0x7f5a8c13c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 -- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c13cd00 msgr2=0x7f5a8c1ed840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c13cd00 0x7f5a8c1ed840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 -- 172.21.15.100:0/21994655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c0094d0 con 0x7f5a8c154af0 2024-01-20T08:11:42.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.127+0000 7f5a8aa00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0090b0 tx=0x7f5a7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.128+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c03e040 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.128+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c039e20 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.128+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c004270 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.128+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c070940 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.128+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c071800 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.129+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c0a9540 con 0x7f5a8c154af0 2024-01-20T08:11:42.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.130+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5a7c0043d0 con 0x7f5a8c154af0 2024-01-20T08:11:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.131+0000 7f5a83400640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.131+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5a7c0ac370 con 0x7f5a8c154af0 2024-01-20T08:11:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.131+0000 7f5a81e00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.132+0000 7f5a81e00640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a74000f60 tx=0x7f5a74009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.135+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5a7c076f70 con 0x7f5a8c154af0 2024-01-20T08:11:42.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.327+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a8c06ce90 con 0x7f5a8c154af0 2024-01-20T08:11:42.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.328+0000 7f5a83400640 1 -- 172.21.15.100:0/21994655 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v38) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a8c06ce90 con 0x7f5a8c154af0 2024-01-20T08:11:42.331 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 msgr2=0x7f5a6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5a74000f60 tx=0x7f5a74009040 comp rx=0 tx=0).stop 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 msgr2=0x7f5a8c1eac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c0090b0 tx=0x7f5a7c004730 comp rx=0 tx=0).stop 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 shutdown_connections 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c13cd00 0x7f5a8c1ed840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c153ce0 0x7f5a8c13c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 --2- 172.21.15.100:0/21994655 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c154af0 0x7f5a8c1eac80 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 >> 172.21.15.100:0/21994655 conn(0x7f5a8c0c6090 msgr2=0x7f5a8c143ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:42.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 shutdown_connections 2024-01-20T08:11:42.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.331+0000 7f5a91600640 1 -- 172.21.15.100:0/21994655 wait complete. 2024-01-20T08:11:42.353 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:11:42.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.561+0000 7f482f200640 1 Processor -- start 2024-01-20T08:11:42.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.561+0000 7f482f200640 1 -- start start 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.562+0000 7f482f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 0x7f48300a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f482f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4830156710 con 0x7f48300c4ed0 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f482f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4830155b00 con 0x7f48300a5240 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f482f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483014fff0 con 0x7f483014fc10 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f4827e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f48300c4ed0 0x7f48300c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49352/0 (socket says 172.21.15.100:49352) 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f4827e00640 1 -- 172.21.15.100:0/3456628552 learned_addr learned my addr 172.21.15.100:0/3456628552 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:42.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.563+0000 7f482de00640 1 --2- 172.21.15.100:0/3456628552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 0x7f48300a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.564+0000 7f482d400640 1 -- 172.21.15.100:0/3456628552 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1399182784 0 0) 0x7f4830156710 con 0x7f48300c4ed0 2024-01-20T08:11:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.564+0000 7f482d400640 1 -- 172.21.15.100:0/3456628552 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4810003520 con 0x7f48300c4ed0 2024-01-20T08:11:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.564+0000 7f482de00640 1 -- 172.21.15.100:0/3456628552 >> v1:172.21.15.110:6789/0 conn(0x7f48300a5240 legacy=0x7f48300c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.564+0000 7f482de00640 1 -- 172.21.15.100:0/3456628552 >> v1:172.21.15.100:6789/0 conn(0x7f48300c4ed0 legacy=0x7f48300c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.564+0000 7f482de00640 1 -- 172.21.15.100:0/3456628552 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4830155de0 con 0x7f483014fc10 2024-01-20T08:11:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.565+0000 7f482de00640 1 --2- 172.21.15.100:0/3456628552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 0x7f48300a4d00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48200097d0 tx=0x7f482002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7f5e49b6112a2a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482d400640 1 -- 172.21.15.100:0/3456628552 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820031770 con 0x7f483014fc10 2024-01-20T08:11:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482d400640 1 -- 172.21.15.100:0/3456628552 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48200318d0 con 0x7f483014fc10 2024-01-20T08:11:42.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482d400640 1 -- 172.21.15.100:0/3456628552 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4820031c60 con 0x7f483014fc10 2024-01-20T08:11:42.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 -- 172.21.15.100:0/3456628552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 msgr2=0x7f48300a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 --2- 172.21.15.100:0/3456628552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 0x7f48300a4d00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48200097d0 tx=0x7f482002b810 comp rx=0 tx=0).stop 2024-01-20T08:11:42.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 -- 172.21.15.100:0/3456628552 shutdown_connections 2024-01-20T08:11:42.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 --2- 172.21.15.100:0/3456628552 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f483014fc10 0x7f48300a4d00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 -- 172.21.15.100:0/3456628552 >> 172.21.15.100:0/3456628552 conn(0x7f48300c5ba0 msgr2=0x7f48300c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:42.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 -- 172.21.15.100:0/3456628552 shutdown_connections 2024-01-20T08:11:42.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.566+0000 7f482f200640 1 -- 172.21.15.100:0/3456628552 wait complete. 2024-01-20T08:11:42.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.568+0000 7f482f200640 1 Processor -- start 2024-01-20T08:11:42.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.568+0000 7f482f200640 1 -- start start 2024-01-20T08:11:42.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48300a5240 0x7f48301513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48300c4ed0 0x7f4830099dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830150a30 con 0x7f483014fc10 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4830150470 con 0x7f48300c4ed0 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4830150750 con 0x7f48300a5240 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.569+0000 7f482e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58932/0 (socket says 172.21.15.100:58932) 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 -- 172.21.15.100:0/3169031312 learned_addr learned my addr 172.21.15.100:0/3169031312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482de00640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48300a5240 0x7f48301513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f4827e00640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48300c4ed0 0x7f4830099dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 -- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48300a5240 msgr2=0x7f48301513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48300a5240 0x7f48301513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 -- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48300c4ed0 msgr2=0x7f4830099dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48300c4ed0 0x7f4830099dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 -- 172.21.15.100:0/3169031312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4820009400 con 0x7f483014fc10 2024-01-20T08:11:42.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f482e800640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f482800c7a0 tx=0x7f482800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.570+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828003b70 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.571+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4828003cf0 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.571+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4828003ea0 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.571+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48300c13c0 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.571+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f483009a300 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.572+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f483009a520 con 0x7f483014fc10 2024-01-20T08:11:42.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.573+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f482800aa90 con 0x7f483014fc10 2024-01-20T08:11:42.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.574+0000 7f4826000640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 0x7f480806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:42.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.575+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f48280897e0 con 0x7f483014fc10 2024-01-20T08:11:42.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.575+0000 7f482de00640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 0x7f480806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:42.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.575+0000 7f482de00640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 0x7f480806d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4820036000 tx=0x7f482003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:42.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.581+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f483009a520 con 0x7f483014fc10 2024-01-20T08:11:42.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.774+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48300c18e0 con 0x7f483014fc10 2024-01-20T08:11:42.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.775+0000 7f4826000640 1 -- 172.21.15.100:0/3169031312 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v38) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48300c18e0 con 0x7f483014fc10 2024-01-20T08:11:42.778 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.777+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 msgr2=0x7f480806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 0x7f480806d390 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4820036000 tx=0x7f482003d040 comp rx=0 tx=0).stop 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 msgr2=0x7f48300c1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f482800c7a0 tx=0x7f482800cc60 comp rx=0 tx=0).stop 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 shutdown_connections 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f483014fc10 0x7f48300c1bc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f48300c4ed0 0x7f4830099dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f480806aed0 0x7f480806d390 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 --2- 172.21.15.100:0/3169031312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f48300a5240 0x7f48301513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:42.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 >> 172.21.15.100:0/3169031312 conn(0x7f48300c5ba0 msgr2=0x7f48300c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:42.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 shutdown_connections 2024-01-20T08:11:42.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:42.778+0000 7f482f200640 1 -- 172.21.15.100:0/3169031312 wait complete. 2024-01-20T08:11:42.799 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:11:43.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.007+0000 7f2456400640 1 Processor -- start 2024-01-20T08:11:43.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.008+0000 7f2456400640 1 -- start start 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2456400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2450151e10 0x7f24500c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2456400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f24500c4e90 0x7f2450154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2456400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500c8720 con 0x7f24500c4a00 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2456400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2450158790 con 0x7f2450151e10 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2456400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500c84c0 con 0x7f24500c4e90 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2455000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2450151e10 0x7f24500c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.009+0000 7f2455000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2450151e10 0x7f24500c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58936/0 (socket says 172.21.15.100:58936) 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455000640 1 -- 172.21.15.100:0/2548996579 learned_addr learned my addr 172.21.15.100:0/2548996579 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455a00640 1 --2- 172.21.15.100:0/2548996579 >> v2:172.21.15.110:3300/0 conn(0x7f24500c4e90 0x7f2450154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455000640 1 -- 172.21.15.100:0/2548996579 >> v2:172.21.15.110:3300/0 conn(0x7f24500c4e90 msgr2=0x7f2450154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:43.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455000640 1 --2- 172.21.15.100:0/2548996579 >> v2:172.21.15.110:3300/0 conn(0x7f24500c4e90 0x7f2450154f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455000640 1 -- 172.21.15.100:0/2548996579 >> v1:172.21.15.110:6789/0 conn(0x7f24500c4a00 legacy=0x7f2450154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:43.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.010+0000 7f2455000640 1 -- 172.21.15.100:0/2548996579 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450158c20 con 0x7f2450151e10 2024-01-20T08:11:43.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.012+0000 7f2455000640 1 --2- 172.21.15.100:0/2548996579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24500c7f80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2440009870 tx=0x7f244002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5cff175f6adf5cb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.012+0000 7f244f400640 1 -- 172.21.15.100:0/2548996579 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24400317e0 con 0x7f2450151e10 2024-01-20T08:11:43.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.012+0000 7f244f400640 1 -- 172.21.15.100:0/2548996579 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2440031940 con 0x7f2450151e10 2024-01-20T08:11:43.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.012+0000 7f244f400640 1 -- 172.21.15.100:0/2548996579 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2440031cd0 con 0x7f2450151e10 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 -- 172.21.15.100:0/2548996579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 msgr2=0x7f24500c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 --2- 172.21.15.100:0/2548996579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24500c7f80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2440009870 tx=0x7f244002b880 comp rx=0 tx=0).stop 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 -- 172.21.15.100:0/2548996579 shutdown_connections 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 --2- 172.21.15.100:0/2548996579 >> v2:172.21.15.110:3300/0 conn(0x7f24500c4e90 0x7f2450154f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 --2- 172.21.15.100:0/2548996579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24500c7f80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 -- 172.21.15.100:0/2548996579 >> 172.21.15.100:0/2548996579 conn(0x7f2450071ef0 msgr2=0x7f2450072300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 -- 172.21.15.100:0/2548996579 shutdown_connections 2024-01-20T08:11:43.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.013+0000 7f2456400640 1 -- 172.21.15.100:0/2548996579 wait complete. 2024-01-20T08:11:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.015+0000 7f2456400640 1 Processor -- start 2024-01-20T08:11:43.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.015+0000 7f2456400640 1 -- start start 2024-01-20T08:11:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24500c4a00 0x7f24500c3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24500c4e90 0x7f24500bf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450145010 con 0x7f2450151e10 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c3b40 con 0x7f24500c4e90 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2456400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c2bb0 con 0x7f24500c4a00 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2455a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2455a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58948/0 (socket says 172.21.15.100:58948) 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2455a00640 1 -- 172.21.15.100:0/2836067635 learned_addr learned my addr 172.21.15.100:0/2836067635 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f2455000640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24500c4a00 0x7f24500c3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.016+0000 7f244fe00640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24500c4e90 0x7f24500bf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 -- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24500c4a00 msgr2=0x7f24500c3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24500c4a00 0x7f24500c3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 -- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24500c4e90 msgr2=0x7f24500bf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24500c4e90 0x7f24500bf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 -- 172.21.15.100:0/2836067635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24400094d0 con 0x7f2450151e10 2024-01-20T08:11:43.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2455a00640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2448007e90 tx=0x7f244800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448014420 con 0x7f2450151e10 2024-01-20T08:11:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2448014580 con 0x7f2450151e10 2024-01-20T08:11:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24500c3170 con 0x7f2450151e10 2024-01-20T08:11:43.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448014930 con 0x7f2450151e10 2024-01-20T08:11:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.017+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245014c860 con 0x7f2450151e10 2024-01-20T08:11:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.019+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24500c3300 con 0x7f2450151e10 2024-01-20T08:11:43.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.019+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2448014a90 con 0x7f2450151e10 2024-01-20T08:11:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.021+0000 7f244cc00640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 0x7f242806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.021+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f244808a200 con 0x7f2450151e10 2024-01-20T08:11:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.021+0000 7f2455000640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 0x7f242806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.022+0000 7f2455000640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 0x7f242806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440036000 tx=0x7f244003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.025+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2448054e00 con 0x7f2450151e10 2024-01-20T08:11:43.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.220+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2450067290 con 0x7f2450151e10 2024-01-20T08:11:43.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.221+0000 7f244cc00640 1 -- 172.21.15.100:0/2836067635 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v38) v1 ==== 105+0+11 (secure 0 0 0) 0x7f2448058420 con 0x7f2450151e10 2024-01-20T08:11:43.224 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.223+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 msgr2=0x7f242806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.223+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 0x7f242806d3c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440036000 tx=0x7f244003d040 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.223+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 msgr2=0x7f24501e7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.223+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2448007e90 tx=0x7f244800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.223+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 shutdown_connections 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450151e10 0x7f24501e7190 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24500c4e90 0x7f24500bf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f242806af00 0x7f242806d3c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 --2- 172.21.15.100:0/2836067635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24500c4a00 0x7f24500c3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 >> 172.21.15.100:0/2836067635 conn(0x7f2450071ef0 msgr2=0x7f24500c9200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 shutdown_connections 2024-01-20T08:11:43.227 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.224+0000 7f2456400640 1 -- 172.21.15.100:0/2836067635 wait complete. 2024-01-20T08:11:43.246 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:11:43.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.452+0000 7f0c14e00640 1 Processor -- start 2024-01-20T08:11:43.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.453+0000 7f0c14e00640 1 -- start start 2024-01-20T08:11:43.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.454+0000 7f0c14e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1014fdb0 0x7f0c100c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.454+0000 7f0c14e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c100c1d90 0x7f0c10152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.454+0000 7f0c14e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c10150190 con 0x7f0c100c3460 2024-01-20T08:11:43.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.454+0000 7f0c14e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c100a9ce0 con 0x7f0c100c1d90 2024-01-20T08:11:43.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.454+0000 7f0c14e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c100a93b0 con 0x7f0c1014fdb0 2024-01-20T08:11:43.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.455+0000 7f0c0d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c100c1d90 0x7f0c10152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.455+0000 7f0c0d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c100c1d90 0x7f0c10152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:60276/0 (socket says 172.21.15.100:60276) 2024-01-20T08:11:43.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.455+0000 7f0c0d400640 1 -- 172.21.15.100:0/381285338 learned_addr learned my addr 172.21.15.100:0/381285338 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:43.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.455+0000 7f0c0de00640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1014fdb0 0x7f0c100c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.456+0000 7f0c0d400640 1 -- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1014fdb0 msgr2=0x7f0c100c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:43.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.456+0000 7f0c0d400640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1014fdb0 0x7f0c100c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.456+0000 7f0c0d400640 1 -- 172.21.15.100:0/381285338 >> v1:172.21.15.110:6789/0 conn(0x7f0c100c3460 legacy=0x7f0c10155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.456+0000 7f0c0d400640 1 -- 172.21.15.100:0/381285338 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c100a8810 con 0x7f0c100c1d90 2024-01-20T08:11:43.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.457+0000 7f0c0d400640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c1d90 0x7f0c10152be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88af93fddb7dd786 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.457+0000 7f0c0ca00640 1 -- 172.21.15.100:0/381285338 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8030840 con 0x7f0c100c1d90 2024-01-20T08:11:43.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c0ca00640 1 -- 172.21.15.100:0/381285338 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bf80309a0 con 0x7f0c100c1d90 2024-01-20T08:11:43.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c0ca00640 1 -- 172.21.15.100:0/381285338 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8030d30 con 0x7f0c100c1d90 2024-01-20T08:11:43.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 -- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c1d90 msgr2=0x7f0c10152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c1d90 0x7f0c10152be0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8009870 tx=0x7f0bf802b980 comp rx=0 tx=0).stop 2024-01-20T08:11:43.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 -- 172.21.15.100:0/381285338 shutdown_connections 2024-01-20T08:11:43.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c1d90 0x7f0c10152be0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 --2- 172.21.15.100:0/381285338 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c1014fdb0 0x7f0c100c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 -- 172.21.15.100:0/381285338 >> 172.21.15.100:0/381285338 conn(0x7f0c100c2940 msgr2=0x7f0c100c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:43.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 -- 172.21.15.100:0/381285338 shutdown_connections 2024-01-20T08:11:43.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.458+0000 7f0c14e00640 1 -- 172.21.15.100:0/381285338 wait complete. 2024-01-20T08:11:43.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.460+0000 7f0c14e00640 1 Processor -- start 2024-01-20T08:11:43.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.460+0000 7f0c14e00640 1 -- start start 2024-01-20T08:11:43.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c100c1d90 0x7f0c101521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c3460 0x7f0c101e9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10151910 con 0x7f0c1014fdb0 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c10152730 con 0x7f0c100c3460 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c14e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c101eb640 con 0x7f0c100c1d90 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c0e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c0e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58964/0 (socket says 172.21.15.100:58964) 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.461+0000 7f0c0e800640 1 -- 172.21.15.100:0/1910628102 learned_addr learned my addr 172.21.15.100:0/1910628102 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0de00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c100c1d90 0x7f0c101521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0d400640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c3460 0x7f0c101e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 -- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c100c1d90 msgr2=0x7f0c101521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c100c1d90 0x7f0c101521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 -- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c3460 msgr2=0x7f0c101e9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c3460 0x7f0c101e9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 -- 172.21.15.100:0/1910628102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf80094d0 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.462+0000 7f0c0e800640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001eb0 tx=0x7f0c0800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.463+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c080052d0 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.463+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c08005430 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.463+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c08003810 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.463+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c101e8680 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.463+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c101e9590 con 0x7f0c1014fdb0 2024-01-20T08:11:43.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.464+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c101e8b30 con 0x7f0c1014fdb0 2024-01-20T08:11:43.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.465+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0c08003970 con 0x7f0c1014fdb0 2024-01-20T08:11:43.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.466+0000 7f0c06000640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 0x7f0be806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.466+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0c08088e80 con 0x7f0c1014fdb0 2024-01-20T08:11:43.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.466+0000 7f0c0de00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 0x7f0be806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.467+0000 7f0c0de00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 0x7f0be806d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c10070e60 tx=0x7f0c0000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.470+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0c101e8b30 con 0x7f0c1014fdb0 2024-01-20T08:11:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.667+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f0c101e8b30 con 0x7f0c1014fdb0 2024-01-20T08:11:43.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.668+0000 7f0c06000640 1 -- 172.21.15.100:0/1910628102 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v38) v1 ==== 101+0+11 (secure 0 0 0) 0x7f0c101e8b30 con 0x7f0c1014fdb0 2024-01-20T08:11:43.671 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:43.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 msgr2=0x7f0be806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 0x7f0be806d390 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0c10070e60 tx=0x7f0c0000b040 comp rx=0 tx=0).stop 2024-01-20T08:11:43.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 msgr2=0x7f0c101ebad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f0c08001eb0 tx=0x7f0c0800c890 comp rx=0 tx=0).stop 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 shutdown_connections 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c1014fdb0 0x7f0c101ebad0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c100c3460 0x7f0c101e9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0be806aed0 0x7f0be806d390 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 --2- 172.21.15.100:0/1910628102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c100c1d90 0x7f0c101521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 >> 172.21.15.100:0/1910628102 conn(0x7f0c100c2940 msgr2=0x7f0c10070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 shutdown_connections 2024-01-20T08:11:43.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.672+0000 7f0c14e00640 1 -- 172.21.15.100:0/1910628102 wait complete. 2024-01-20T08:11:43.693 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.894+0000 7f3d9f200640 1 Processor -- start 2024-01-20T08:11:43.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.894+0000 7f3d9f200640 1 -- start start 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.895+0000 7f3d9f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d9806d2b0 0x7f3d9806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.895+0000 7f3d9f200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3d980c3e00 0x7f3d9806c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.895+0000 7f3d9f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d981523a0 con 0x7f3d980c5570 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.895+0000 7f3d9f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d980706a0 con 0x7f3d9806d2b0 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.895+0000 7f3d9f200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d98151ee0 con 0x7f3d980c3e00 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3d9806d2b0 0x7f3d9806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3d980c5570 0x7f3d9806c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49366/0 (socket says 172.21.15.100:49366) 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9e800640 1 -- 172.21.15.100:0/3679705192 learned_addr learned my addr 172.21.15.100:0/3679705192 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9d400640 1 --2- 172.21.15.100:0/3679705192 >> v2:172.21.15.110:3300/0 conn(0x7f3d980c3e00 0x7f3d9806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9de00640 1 -- 172.21.15.100:0/3679705192 >> v2:172.21.15.110:3300/0 conn(0x7f3d980c3e00 msgr2=0x7f3d9806c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9de00640 1 --2- 172.21.15.100:0/3679705192 >> v2:172.21.15.110:3300/0 conn(0x7f3d980c3e00 0x7f3d9806c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9de00640 1 -- 172.21.15.100:0/3679705192 >> v1:172.21.15.100:6789/0 conn(0x7f3d980c5570 legacy=0x7f3d9806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.896+0000 7f3d9de00640 1 -- 172.21.15.100:0/3679705192 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d980a53f0 con 0x7f3d9806d2b0 2024-01-20T08:11:43.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.897+0000 7f3d9de00640 1 --2- 172.21.15.100:0/3679705192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d9806d2b0 0x7f3d9806d690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d98066e90 tx=0x7f3d8802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5205541a6fc9489 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9ca00640 1 -- 172.21.15.100:0/3679705192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8802f050 con 0x7f3d9806d2b0 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9ca00640 1 -- 172.21.15.100:0/3679705192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d88031700 con 0x7f3d9806d2b0 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9ca00640 1 -- 172.21.15.100:0/3679705192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d88031a90 con 0x7f3d9806d2b0 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 -- 172.21.15.100:0/3679705192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d9806d2b0 msgr2=0x7f3d9806d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 --2- 172.21.15.100:0/3679705192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d9806d2b0 0x7f3d9806d690 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3d98066e90 tx=0x7f3d8802b7a0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 -- 172.21.15.100:0/3679705192 shutdown_connections 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 --2- 172.21.15.100:0/3679705192 >> v2:172.21.15.110:3300/0 conn(0x7f3d980c3e00 0x7f3d9806c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 --2- 172.21.15.100:0/3679705192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d9806d2b0 0x7f3d9806d690 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 -- 172.21.15.100:0/3679705192 >> 172.21.15.100:0/3679705192 conn(0x7f3d980c2590 msgr2=0x7f3d980c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.898+0000 7f3d9f200640 1 -- 172.21.15.100:0/3679705192 shutdown_connections 2024-01-20T08:11:43.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.899+0000 7f3d9f200640 1 -- 172.21.15.100:0/3679705192 wait complete. 2024-01-20T08:11:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.900+0000 7f3d9f200640 1 Processor -- start 2024-01-20T08:11:43.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.900+0000 7f3d9f200640 1 -- start start 2024-01-20T08:11:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9806d2b0 0x7f3d981486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d980c5570 0x7f3d9814c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d980aac10 con 0x7f3d980c3e00 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9814bd10 con 0x7f3d9806d2b0 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9814e1e0 con 0x7f3d980c5570 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:58990/0 (socket says 172.21.15.100:58990) 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.901+0000 7f3d9d400640 1 -- 172.21.15.100:0/755728529 learned_addr learned my addr 172.21.15.100:0/755728529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9e800640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d980c5570 0x7f3d9814c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9de00640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9806d2b0 0x7f3d981486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 -- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d980c5570 msgr2=0x7f3d9814c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d980c5570 0x7f3d9814c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 -- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9806d2b0 msgr2=0x7f3d981486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9806d2b0 0x7f3d981486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 -- 172.21.15.100:0/755728529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88009400 con 0x7f3d980c3e00 2024-01-20T08:11:43.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d9d400640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c7f0 tx=0x7f3d8000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.902+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80004220 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.903+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d80004380 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.903+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d80007840 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.903+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d9814e4c0 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.903+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9814bfb0 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.904+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d980a4b80 con 0x7f3d980c3e00 2024-01-20T08:11:43.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.905+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3d80007bb0 con 0x7f3d980c3e00 2024-01-20T08:11:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.906+0000 7f3d96000640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 0x7f3d7006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.906+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3d800898a0 con 0x7f3d980c3e00 2024-01-20T08:11:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.906+0000 7f3d9de00640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 0x7f3d7006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:43.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.907+0000 7f3d9de00640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 0x7f3d7006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d88035000 tx=0x7f3d88008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:43.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:43.911+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3d80054410 con 0x7f3d980c3e00 2024-01-20T08:11:44.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.146+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d9814c1d0 con 0x7f3d980c3e00 2024-01-20T08:11:44.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.147+0000 7f3d96000640 1 -- 172.21.15.100:0/755728529 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f3d80007e60 con 0x7f3d980c3e00 2024-01-20T08:11:44.150 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:44.150 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:44.151 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 msgr2=0x7f3d7006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 0x7f3d7006d390 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d88035000 tx=0x7f3d88008030 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 msgr2=0x7f3d98152a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000c7f0 tx=0x7f3d8000ccb0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 shutdown_connections 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3d7006aed0 0x7f3d7006d390 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3d980c5570 0x7f3d9814c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3d980c3e00 0x7f3d98152a40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 --2- 172.21.15.100:0/755728529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3d9806d2b0 0x7f3d981486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 >> 172.21.15.100:0/755728529 conn(0x7f3d980c2590 msgr2=0x7f3d98070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:44.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 shutdown_connections 2024-01-20T08:11:44.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.150+0000 7f3d9f200640 1 -- 172.21.15.100:0/755728529 wait complete. 2024-01-20T08:11:44.170 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:44.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.374+0000 7fca53a00640 1 Processor -- start 2024-01-20T08:11:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.374+0000 7fca53a00640 1 -- start start 2024-01-20T08:11:44.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca53a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fca4c06ecd0 0x7fca4c0725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca53a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0a6030 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca53a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0a65f0 con 0x7fca4c06b2e0 2024-01-20T08:11:44.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca53a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4c0a6c60 con 0x7fca4c06ecd0 2024-01-20T08:11:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca51a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fca4c0c2ca0 0x7fca4c15c030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49382/0 (socket says 172.21.15.100:49382) 2024-01-20T08:11:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.376+0000 7fca51a00640 1 -- 172.21.15.100:0/2404164362 learned_addr learned my addr 172.21.15.100:0/2404164362 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca51000640 1 --2- 172.21.15.100:0/2404164362 >> v2:172.21.15.110:3300/0 conn(0x7fca4c06ecd0 0x7fca4c0725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2987931302 0 0) 0x7fca4c0a6030 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca2c003520 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2920607528 0 0) 0x7fca2c003520 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 >> v2:172.21.15.110:3300/0 conn(0x7fca4c06ecd0 msgr2=0x7fca4c0725a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 --2- 172.21.15.100:0/2404164362 >> v2:172.21.15.110:3300/0 conn(0x7fca4c06ecd0 0x7fca4c0725a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 >> v1:172.21.15.110:6789/0 conn(0x7fca4c06b2e0 legacy=0x7fca4c14e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c1522b0 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fca44001670 con 0x7fca4c0c2ca0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 >> v1:172.21.15.100:6789/0 conn(0x7fca4c0c2ca0 legacy=0x7fca4c15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca2c0047c0 0x7fca2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca2c005380 0x7fca2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00c1e0 con 0x7fca2c003970 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00c350 con 0x7fca2c005380 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.377+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca2c00c510 con 0x7fca2c0047c0 2024-01-20T08:11:44.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51a00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca2c005380 0x7fca2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca43c00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca2c0047c0 0x7fca2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 -- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca2c0047c0 msgr2=0x7fca2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca2c0047c0 0x7fca2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 -- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca2c005380 msgr2=0x7fca2c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca2c005380 0x7fca2c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51000640 1 -- 172.21.15.100:0/2404164362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2c003520 con 0x7fca2c003970 2024-01-20T08:11:44.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.378+0000 7fca51a00640 1 -- 172.21.15.100:0/2404164362 reap_dead start 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.380+0000 7fca51000640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca2c003d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fca3c007360 tx=0x7fca2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95bc7524386def30 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.380+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c02ccd0 con 0x7fca2c003970 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.380+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c02ce30 con 0x7fca2c003970 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.380+0000 7fca4be00640 1 -- 172.21.15.100:0/2404164362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c034660 con 0x7fca2c003970 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 -- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 msgr2=0x7fca2c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca2c003d90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fca3c007360 tx=0x7fca2c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 -- 172.21.15.100:0/2404164362 shutdown_connections 2024-01-20T08:11:44.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 --2- 172.21.15.100:0/2404164362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca2c003d90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 -- 172.21.15.100:0/2404164362 >> 172.21.15.100:0/2404164362 conn(0x7fca4c06a5e0 msgr2=0x7fca4c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:44.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 -- 172.21.15.100:0/2404164362 shutdown_connections 2024-01-20T08:11:44.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.381+0000 7fca53a00640 1 -- 172.21.15.100:0/2404164362 wait complete. 2024-01-20T08:11:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.383+0000 7fca53a00640 1 Processor -- start 2024-01-20T08:11:44.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.383+0000 7fca53a00640 1 -- start start 2024-01-20T08:11:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c1daf90 0x7fca4c14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c1502e0 0x7fca4c0bfb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c150760 con 0x7fca2c003970 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c0fa0 con 0x7fca4c1502e0 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca53a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c0c1280 con 0x7fca4c1daf90 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca51000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca51000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59000/0 (socket says 172.21.15.100:59000) 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.384+0000 7fca51000640 1 -- 172.21.15.100:0/53143073 learned_addr learned my addr 172.21.15.100:0/53143073 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c1502e0 0x7fca4c0bfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca43c00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c1daf90 0x7fca4c14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 -- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c1daf90 msgr2=0x7fca4c14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c1daf90 0x7fca4c14fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 -- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c1502e0 msgr2=0x7fca4c0bfb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c1502e0 0x7fca4c0bfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 -- 172.21.15.100:0/53143073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c0c1710 con 0x7fca2c003970 2024-01-20T08:11:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca51000640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fca3c037040 tx=0x7fca3c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c003b90 con 0x7fca2c003970 2024-01-20T08:11:44.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c003d10 con 0x7fca2c003970 2024-01-20T08:11:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c14e840 con 0x7fca2c003970 2024-01-20T08:11:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.385+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c004260 con 0x7fca2c003970 2024-01-20T08:11:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.386+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c1477f0 con 0x7fca2c003970 2024-01-20T08:11:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.387+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c0a9370 con 0x7fca2c003970 2024-01-20T08:11:44.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.388+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fca3c03b040 con 0x7fca2c003970 2024-01-20T08:11:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.388+0000 7fca49600640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 0x7fca2406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.388+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fca3c0ab680 con 0x7fca2c003970 2024-01-20T08:11:44.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.389+0000 7fca43c00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 0x7fca2406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.389+0000 7fca43c00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 0x7fca2406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca34007fd0 tx=0x7fca34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.393+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fca3c0763c0 con 0x7fca2c003970 2024-01-20T08:11:44.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.592+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca4c0c2a00 con 0x7fca2c003970 2024-01-20T08:11:44.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.596+0000 7fca49600640 1 -- 172.21.15.100:0/53143073 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7fca3c07ee60 con 0x7fca2c003970 2024-01-20T08:11:44.600 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:44.600 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 msgr2=0x7fca2406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 0x7fca2406d390 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fca34007fd0 tx=0x7fca34009040 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 msgr2=0x7fca4c14a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fca3c037040 tx=0x7fca3c004ab0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 shutdown_connections 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fca4c1502e0 0x7fca4c0bfb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fca2406aed0 0x7fca2406d390 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fca4c1daf90 0x7fca4c14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 --2- 172.21.15.100:0/53143073 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fca2c003970 0x7fca4c14a1c0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 >> 172.21.15.100:0/53143073 conn(0x7fca4c06a5e0 msgr2=0x7fca4c0c5ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:44.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 shutdown_connections 2024-01-20T08:11:44.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.599+0000 7fca53a00640 1 -- 172.21.15.100:0/53143073 wait complete. 2024-01-20T08:11:44.622 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T08:11:44.622 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:44.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.827+0000 7fab6c400640 1 Processor -- start 2024-01-20T08:11:44.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.827+0000 7fab6c400640 1 -- start start 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.828+0000 7fab6c400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab64071220 0x7fab64071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6c400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 0x7fab64151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab64157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6c400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640c04a0 con 0x7fab64071220 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6c400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab640c0fb0 con 0x7fab640bfae0 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab6406def0 con 0x7fab641521e0 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab64071220 0x7fab64071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fab64071220 0x7fab64071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59004/0 (socket says 172.21.15.100:59004) 2024-01-20T08:11:44.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 -- 172.21.15.100:0/2973022767 learned_addr learned my addr 172.21.15.100:0/2973022767 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69000640 1 --2- 172.21.15.100:0/2973022767 >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 0x7fab64151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6a400640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab64157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 -- 172.21.15.100:0/2973022767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 msgr2=0x7fab64157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab64157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 -- 172.21.15.100:0/2973022767 >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 msgr2=0x7fab64151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 --2- 172.21.15.100:0/2973022767 >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 0x7fab64151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69a00640 1 -- 172.21.15.100:0/2973022767 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab6406e1d0 con 0x7fab64071220 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab69000640 1 --2- 172.21.15.100:0/2973022767 >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 0x7fab64151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.829+0000 7fab6a400640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab64157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.831+0000 7fab69a00640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64071220 0x7fab64071600 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fab6406e620 tx=0x7fab5402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fa8a55c3366985 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.831+0000 7fab63e00640 1 -- 172.21.15.100:0/2973022767 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54031740 con 0x7fab64071220 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.831+0000 7fab63e00640 1 -- 172.21.15.100:0/2973022767 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab540318a0 con 0x7fab64071220 2024-01-20T08:11:44.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.831+0000 7fab63e00640 1 -- 172.21.15.100:0/2973022767 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54031c30 con 0x7fab64071220 2024-01-20T08:11:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 -- 172.21.15.100:0/2973022767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64071220 msgr2=0x7fab64071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64071220 0x7fab64071600 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fab6406e620 tx=0x7fab5402b7e0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 -- 172.21.15.100:0/2973022767 shutdown_connections 2024-01-20T08:11:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab64157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 --2- 172.21.15.100:0/2973022767 >> v2:172.21.15.110:3300/0 conn(0x7fab640bfae0 0x7fab64151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 --2- 172.21.15.100:0/2973022767 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab64071220 0x7fab64071600 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 -- 172.21.15.100:0/2973022767 >> 172.21.15.100:0/2973022767 conn(0x7fab6406a5e0 msgr2=0x7fab6406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:44.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 -- 172.21.15.100:0/2973022767 shutdown_connections 2024-01-20T08:11:44.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.832+0000 7fab6c400640 1 -- 172.21.15.100:0/2973022767 wait complete. 2024-01-20T08:11:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.834+0000 7fab6c400640 1 Processor -- start 2024-01-20T08:11:44.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.834+0000 7fab6c400640 1 -- start start 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 0x7fab64149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab640aa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640ac450 con 0x7fab640bfae0 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab640abfc0 con 0x7fab64071220 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.835+0000 7fab6c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab64152bf0 con 0x7fab641521e0 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59008/0 (socket says 172.21.15.100:59008) 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 -- 172.21.15.100:0/3093548252 learned_addr learned my addr 172.21.15.100:0/3093548252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 -- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 msgr2=0x7fab640aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab640aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 -- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 msgr2=0x7fab64149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69a00640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 0x7fab64149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 0x7fab64149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 -- 172.21.15.100:0/3093548252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab540094d0 con 0x7fab640bfae0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69a00640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 0x7fab64149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.836+0000 7fab69000640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7f0 tx=0x7fab4c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.837+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c007820 con 0x7fab640bfae0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.837+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab4c007980 con 0x7fab640bfae0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.837+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab64152e90 con 0x7fab640bfae0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.837+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4c007d30 con 0x7fab640bfae0 2024-01-20T08:11:44.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.837+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab640abc50 con 0x7fab640bfae0 2024-01-20T08:11:44.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.838+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab640ac170 con 0x7fab640bfae0 2024-01-20T08:11:44.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.839+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fab4c0113f0 con 0x7fab640bfae0 2024-01-20T08:11:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.840+0000 7fab61600640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 0x7fab3c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.840+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fab4c089ce0 con 0x7fab640bfae0 2024-01-20T08:11:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.840+0000 7fab69a00640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 0x7fab3c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:44.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.841+0000 7fab69a00640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 0x7fab3c06d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab54035000 tx=0x7fab54008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:44.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:44.844+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fab640ac170 con 0x7fab640bfae0 2024-01-20T08:11:45.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.077+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fab640ac130 con 0x7fab640bfae0 2024-01-20T08:11:45.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.078+0000 7fab61600640 1 -- 172.21.15.100:0/3093548252 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6189 (secure 0 0 0) 0x7fab4c0547c0 con 0x7fab640bfae0 2024-01-20T08:11:45.081 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:45.082 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:45.082 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-01-20T08:11:45.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 msgr2=0x7fab3c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 0x7fab3c06d390 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab54035000 tx=0x7fab54008030 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 msgr2=0x7fab640a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fab4c00c7f0 tx=0x7fab4c00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 shutdown_connections 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fab3c06aed0 0x7fab3c06d390 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fab641521e0 0x7fab640aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fab640bfae0 0x7fab640a9f00 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 --2- 172.21.15.100:0/3093548252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fab64071220 0x7fab64149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.081+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 >> 172.21.15.100:0/3093548252 conn(0x7fab6406a5e0 msgr2=0x7fab64150240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.082+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 shutdown_connections 2024-01-20T08:11:45.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.082+0000 7fab6c400640 1 -- 172.21.15.100:0/3093548252 wait complete. 2024-01-20T08:11:45.104 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:45.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.300+0000 7f3c68e00640 1 Processor -- start 2024-01-20T08:11:45.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.301+0000 7f3c68e00640 1 -- start start 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c68e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c64153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c68e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c640a9940 con 0x7f3c6414fce0 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c68e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c641500c0 con 0x7f3c640aae00 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c68e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64156810 con 0x7f3c640a93c0 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c61e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3c6414fce0 0x7f3c64152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49384/0 (socket says 172.21.15.100:49384) 2024-01-20T08:11:45.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.302+0000 7f3c61e00640 1 -- 172.21.15.100:0/636289707 learned_addr learned my addr 172.21.15.100:0/636289707 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965377652 0 0) 0x7f3c640a9940 con 0x7f3c6414fce0 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c44003520 con 0x7f3c6414fce0 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c59200640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c64153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 128997644 0 0) 0x7f3c44003520 con 0x7f3c6414fce0 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 msgr2=0x7f3c64153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c64153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 >> v1:172.21.15.110:6789/0 conn(0x7f3c640aae00 legacy=0x7f3c640ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c64156af0 con 0x7f3c6414fce0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3c54001670 con 0x7f3c6414fce0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 >> v1:172.21.15.100:6789/0 conn(0x7f3c6414fce0 legacy=0x7f3c64152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c440039a0 0x7f3c44003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c44004d00 0x7f3c44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c64156810 con 0x7f3c440039a0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4400bb10 con 0x7f3c44004d00 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4400bcd0 con 0x7f3c640a93c0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.303+0000 7f3c61e00640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c440039a0 0x7f3c44003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c59200640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c61e00640 1 -- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 msgr2=0x7f3c440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c62800640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c44004d00 0x7f3c44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c61e00640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c61e00640 1 -- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c44004d00 msgr2=0x7f3c44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c61e00640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c44004d00 0x7f3c44005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c61e00640 1 -- 172.21.15.100:0/636289707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c44003520 con 0x7f3c440039a0 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.304+0000 7f3c59200640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c640a93c0 0x7f3c440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.305+0000 7f3c61e00640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c440039a0 0x7f3c44003da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c190 tx=0x7f3c440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba9da5bc1d642a9a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.305+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c54005ad0 con 0x7f3c440039a0 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.305+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c54005c30 con 0x7f3c440039a0 2024-01-20T08:11:45.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.305+0000 7f3c61400640 1 -- 172.21.15.100:0/636289707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5402c820 con 0x7f3c440039a0 2024-01-20T08:11:45.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 -- 172.21.15.100:0/636289707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c440039a0 msgr2=0x7f3c44003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 --2- 172.21.15.100:0/636289707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c440039a0 0x7f3c44003da0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3c5400c190 tx=0x7f3c440057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c62800640 1 -- 172.21.15.100:0/636289707 reap_dead start 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 -- 172.21.15.100:0/636289707 shutdown_connections 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 -- 172.21.15.100:0/636289707 >> 172.21.15.100:0/636289707 conn(0x7f3c6406a5e0 msgr2=0x7f3c6406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 -- 172.21.15.100:0/636289707 shutdown_connections 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.306+0000 7f3c68e00640 1 -- 172.21.15.100:0/636289707 wait complete. 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 Processor -- start 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 -- start start 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c440039a0 0x7f3c64071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c641ed7a0 0x7f3c641dcc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640c2c80 con 0x7f3c641dd170 2024-01-20T08:11:45.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c640c1ed0 con 0x7f3c440039a0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.308+0000 7f3c68e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c6414d6e0 con 0x7f3c641ed7a0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59030/0 (socket says 172.21.15.100:59030) 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 -- 172.21.15.100:0/1097503889 learned_addr learned my addr 172.21.15.100:0/1097503889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c59200640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c641ed7a0 0x7f3c641dcc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 -- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c641ed7a0 msgr2=0x7f3c641dcc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c61e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c440039a0 0x7f3c64071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c641ed7a0 0x7f3c641dcc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 -- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c440039a0 msgr2=0x7f3c64071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c440039a0 0x7f3c64071630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 -- 172.21.15.100:0/1097503889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c640c2ed0 con 0x7f3c641dd170 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.309+0000 7f3c62800640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c44004740 tx=0x7f3c5c00d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.310+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012800 con 0x7f3c641dd170 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.310+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c012960 con 0x7f3c641dd170 2024-01-20T08:11:45.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.310+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c012d50 con 0x7f3c641dd170 2024-01-20T08:11:45.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.310+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c640c1b60 con 0x7f3c641dd170 2024-01-20T08:11:45.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.310+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c64071b70 con 0x7f3c641dd170 2024-01-20T08:11:45.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.311+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c640c19c0 con 0x7f3c641dd170 2024-01-20T08:11:45.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.312+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3c5c023350 con 0x7f3c641dd170 2024-01-20T08:11:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.312+0000 7f3c5aa00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 0x7f3c3c06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.313+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c5c089870 con 0x7f3c641dd170 2024-01-20T08:11:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.313+0000 7f3c61e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 0x7f3c3c06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.313+0000 7f3c61e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 0x7f3c3c06d410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c54034000 tx=0x7f3c54009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.317+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3c640c19c0 con 0x7f3c641dd170 2024-01-20T08:11:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.550+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3c640c19c0 con 0x7f3c641dd170 2024-01-20T08:11:45.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.550+0000 7f3c5aa00640 1 -- 172.21.15.100:0/1097503889 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+6189 (secure 0 0 0) 0x7f3c640c19c0 con 0x7f3c641dd170 2024-01-20T08:11:45.553 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:45.554 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":21,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:04.674090+0000","modified":"2024-01-20T08:11:07.748310+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4932},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4932":{"gid":4932,"name":"c","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.100:6837/4185964362","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":4185964362},{"type":"v1","addr":"172.21.15.100:6837","nonce":4185964362}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2},{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:45.554 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 21 2024-01-20T08:11:45.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 msgr2=0x7f3c3c06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 0x7f3c3c06d410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3c54034000 tx=0x7f3c54009030 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 msgr2=0x7f3c640c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c44004740 tx=0x7f3c5c00d9d0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 shutdown_connections 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c641dd170 0x7f3c640c0890 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c3c06af50 0x7f3c3c06d410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c641ed7a0 0x7f3c641dcc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 --2- 172.21.15.100:0/1097503889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c440039a0 0x7f3c64071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 >> 172.21.15.100:0/1097503889 conn(0x7f3c6406a5e0 msgr2=0x7f3c64154490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 shutdown_connections 2024-01-20T08:11:45.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.553+0000 7f3c68e00640 1 -- 172.21.15.100:0/1097503889 wait complete. 2024-01-20T08:11:45.575 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:45.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.771+0000 7f42c3e00640 1 Processor -- start 2024-01-20T08:11:45.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.772+0000 7f42c3e00640 1 -- start start 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f42c406ffa0 0x7f42c40c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c3e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c40c7570 con 0x7f42c406d260 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c3e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c41589c0 con 0x7f42c40c1400 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c3e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42c40c7bf0 con 0x7f42c406ffa0 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c2a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f42c406d260 0x7f42c40c4500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49400/0 (socket says 172.21.15.100:49400) 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c2a00640 1 -- 172.21.15.100:0/3433033520 learned_addr learned my addr 172.21.15.100:0/3433033520 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:45.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3433033520 >> v2:172.21.15.110:3300/0 conn(0x7f42c406ffa0 0x7f42c40c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.773+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4222920215 0 0) 0x7f42c40c7570 con 0x7f42c406d260 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42a4003520 con 0x7f42c406d260 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2648318539 0 0) 0x7f42a4003520 con 0x7f42c406d260 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 >> v2:172.21.15.110:3300/0 conn(0x7f42c406ffa0 msgr2=0x7f42c40c30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 --2- 172.21.15.100:0/3433033520 >> v2:172.21.15.110:3300/0 conn(0x7f42c406ffa0 0x7f42c40c30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 >> v1:172.21.15.110:6789/0 conn(0x7f42c40c1400 legacy=0x7f42c40c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40c6f20 con 0x7f42c406d260 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f42b40019f0 con 0x7f42c406d260 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 >> v1:172.21.15.100:6789/0 conn(0x7f42c406d260 legacy=0x7f42c40c4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a40039c0 0x7f42a4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a40052a0 0x7f42a400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c40c7bf0 con 0x7f42a40047c0 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a400c1a0 con 0x7f42a40052a0 2024-01-20T08:11:45.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42a400c360 con 0x7f42a40039c0 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.774+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42c3400640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a40052a0 0x7f42a400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42c2a00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a40039c0 0x7f42a4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42b9e00640 1 -- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a40039c0 msgr2=0x7f42a4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a40039c0 0x7f42a4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42b9e00640 1 -- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a40052a0 msgr2=0x7f42a400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42a40052a0 0x7f42a400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42b9e00640 1 -- 172.21.15.100:0/3433033520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a4003520 con 0x7f42a40047c0 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42c3400640 1 -- 172.21.15.100:0/3433033520 reap_dead start 2024-01-20T08:11:45.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.775+0000 7f42c2a00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42a40039c0 0x7f42a4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.776+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42a4004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009ac0 tx=0x7f42a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0c6e788e21f281 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.776+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac02c6b0 con 0x7f42a40047c0 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.776+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac02c810 con 0x7f42a40047c0 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.776+0000 7f42c2000640 1 -- 172.21.15.100:0/3433033520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac02cba0 con 0x7f42a40047c0 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 -- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 msgr2=0x7f42a4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42a4004c40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f42ac009ac0 tx=0x7f42a40057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 -- 172.21.15.100:0/3433033520 shutdown_connections 2024-01-20T08:11:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3433033520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42a4004c40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 -- 172.21.15.100:0/3433033520 >> 172.21.15.100:0/3433033520 conn(0x7f42c40c7d30 msgr2=0x7f42c40c8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 -- 172.21.15.100:0/3433033520 shutdown_connections 2024-01-20T08:11:45.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.777+0000 7f42c3e00640 1 -- 172.21.15.100:0/3433033520 wait complete. 2024-01-20T08:11:45.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.779+0000 7f42c3e00640 1 Processor -- start 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.779+0000 7f42c3e00640 1 -- start start 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42c409aa50 0x7f42c40a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 0x7f42c41ed230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c409d0a0 con 0x7f42a40047c0 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c409a260 con 0x7f42c40a9ba0 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c3e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c41ea810 con 0x7f42c409aa50 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59048/0 (socket says 172.21.15.100:59048) 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.780+0000 7f42c2a00640 1 -- 172.21.15.100:0/3643660833 learned_addr learned my addr 172.21.15.100:0/3643660833 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c3400640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 0x7f42c41ed230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42c409aa50 0x7f42c40a9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 -- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42c409aa50 msgr2=0x7f42c40a9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42c409aa50 0x7f42c40a9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 -- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 msgr2=0x7f42c41ed230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 0x7f42c41ed230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 -- 172.21.15.100:0/3643660833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c41eaab0 con 0x7f42a40047c0 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c3400640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 0x7f42c41ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c2a00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f42b4002060 tx=0x7f42b400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b4004d60 con 0x7f42a40047c0 2024-01-20T08:11:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b400be80 con 0x7f42a40047c0 2024-01-20T08:11:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c4099c10 con 0x7f42a40047c0 2024-01-20T08:11:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.781+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b40072d0 con 0x7f42a40047c0 2024-01-20T08:11:45.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.782+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c406bda0 con 0x7f42a40047c0 2024-01-20T08:11:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.783+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42c40749e0 con 0x7f42a40047c0 2024-01-20T08:11:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.784+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f42b4007430 con 0x7f42a40047c0 2024-01-20T08:11:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.785+0000 7f42bbe00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.785+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f42b4089c70 con 0x7f42a40047c0 2024-01-20T08:11:45.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.786+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:45.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.786+0000 7f42b9e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 0x7f429c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42ac036000 tx=0x7f42ac030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:45.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.790+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f42b4054850 con 0x7f42a40047c0 2024-01-20T08:11:45.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.990+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42c406c2a0 con 0x7f42a40047c0 2024-01-20T08:11:45.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.991+0000 7f42bbe00640 1 -- 172.21.15.100:0/3643660833 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+20206 (secure 0 0 0) 0x7f42b4019020 con 0x7f42a40047c0 2024-01-20T08:11:45.995 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:45.995 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":38,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:21.499197+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:11:02.438552+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-01-20T08:11:03.706270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 msgr2=0x7f429c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 0x7f429c06d3c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f42ac036000 tx=0x7f42ac030000 comp rx=0 tx=0).stop 2024-01-20T08:11:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 msgr2=0x7f42c41e9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f42b4002060 tx=0x7f42b400b4a0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 shutdown_connections 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42c40a9ba0 0x7f42c41ed230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f429c06af00 0x7f429c06d3c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42c409aa50 0x7f42c40a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 --2- 172.21.15.100:0/3643660833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42a40047c0 0x7f42c41e9f40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 >> 172.21.15.100:0/3643660833 conn(0x7f42c40c7d30 msgr2=0x7f42c4157fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 shutdown_connections 2024-01-20T08:11:45.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:45.994+0000 7f42c3e00640 1 -- 172.21.15.100:0/3643660833 wait complete. 2024-01-20T08:11:46.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T08:11:46.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.197+0000 7f3f93c00640 1 Processor -- start 2024-01-20T08:11:46.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.197+0000 7f3f93c00640 1 -- start start 2024-01-20T08:11:46.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.198+0000 7f3f93c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3f8c155430 0x7f3f8c0c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.198+0000 7f3f93c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c06cd40 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.198+0000 7f3f93c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f8c0c19e0 con 0x7f3f8c0c5f70 2024-01-20T08:11:46.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.198+0000 7f3f93c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c1c80 con 0x7f3f8c155430 2024-01-20T08:11:46.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f91200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3f8c14e8b0 0x7f3f8c06d1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49402/0 (socket says 172.21.15.100:49402) 2024-01-20T08:11:46.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f91200640 1 -- 172.21.15.100:0/2139894257 learned_addr learned my addr 172.21.15.100:0/2139894257 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2139894257 >> v2:172.21.15.110:3300/0 conn(0x7f3f8c155430 0x7f3f8c0c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3590794907 0 0) 0x7f3f8c06cd40 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f6c003520 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1643023443 0 0) 0x7f3f6c003520 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 >> v2:172.21.15.110:3300/0 conn(0x7f3f8c155430 msgr2=0x7f3f8c0c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 --2- 172.21.15.100:0/2139894257 >> v2:172.21.15.110:3300/0 conn(0x7f3f8c155430 0x7f3f8c0c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 >> v1:172.21.15.110:6789/0 conn(0x7f3f8c0c5f70 legacy=0x7f3f8c070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c06c410 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.199+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3f7c001670 con 0x7f3f8c14e8b0 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 >> v1:172.21.15.100:6789/0 conn(0x7f3f8c14e8b0 legacy=0x7f3f8c06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f6c003970 0x7f3f6c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c005180 0x7f3f6c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c0c1c80 con 0x7f3f6c0047c0 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00c000 con 0x7f3f6c005180 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6c00c1c0 con 0x7f3f6c003970 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 -- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f6c003970 msgr2=0x7f3f6c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f6c003970 0x7f3f6c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 -- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c005180 msgr2=0x7f3f6c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f91c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c005180 0x7f3f6c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c005180 0x7f3f6c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f91c00640 1 -- 172.21.15.100:0/2139894257 reap_dead start 2024-01-20T08:11:46.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.200+0000 7f3f83c00640 1 -- 172.21.15.100:0/2139894257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f6c003520 con 0x7f3f6c0047c0 2024-01-20T08:11:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.201+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009fc0 tx=0x7f3f6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b231c4e8fd8f46 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7402cc20 con 0x7f3f6c0047c0 2024-01-20T08:11:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7400f040 con 0x7f3f6c0047c0 2024-01-20T08:11:46.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f8be00640 1 -- 172.21.15.100:0/2139894257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74034440 con 0x7f3f6c0047c0 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 -- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 msgr2=0x7f3f6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3f74009fc0 tx=0x7f3f6c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 -- 172.21.15.100:0/2139894257 shutdown_connections 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2139894257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f6c0047c0 0x7f3f6c004c40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 -- 172.21.15.100:0/2139894257 >> 172.21.15.100:0/2139894257 conn(0x7f3f8c0a9e20 msgr2=0x7f3f8c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 -- 172.21.15.100:0/2139894257 shutdown_connections 2024-01-20T08:11:46.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.202+0000 7f3f93c00640 1 -- 172.21.15.100:0/2139894257 wait complete. 2024-01-20T08:11:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.204+0000 7f3f93c00640 1 Processor -- start 2024-01-20T08:11:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.204+0000 7f3f93c00640 1 -- start start 2024-01-20T08:11:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c0047c0 0x7f3f8c153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f8c1587b0 0x7f3f8c14a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c14afc0 con 0x7f3f8c14ab40 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1585f0 con 0x7f3f6c0047c0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f93c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8c1580c0 con 0x7f3f8c1587b0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f91c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f91c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59074/0 (socket says 172.21.15.100:59074) 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.205+0000 7f3f91c00640 1 -- 172.21.15.100:0/2699323114 learned_addr learned my addr 172.21.15.100:0/2699323114 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91200640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c0047c0 0x7f3f8c153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f83c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f8c1587b0 0x7f3f8c14a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 -- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f8c1587b0 msgr2=0x7f3f8c14a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f8c1587b0 0x7f3f8c14a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 -- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c0047c0 msgr2=0x7f3f8c153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c0047c0 0x7f3f8c153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 -- 172.21.15.100:0/2699323114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c14bc70 con 0x7f3f8c14ab40 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f91c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0aaee0 tx=0x7f3f8400d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400b070 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f840052d0 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f8c158310 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84003830 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.206+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8c0ab5a0 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.208+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f8c0ab120 con 0x7f3f8c14ab40 2024-01-20T08:11:46.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.209+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3f84003990 con 0x7f3f8c14ab40 2024-01-20T08:11:46.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.209+0000 7f3f89600640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 0x7f3f6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.210+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3f84088dd0 con 0x7f3f8c14ab40 2024-01-20T08:11:46.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.210+0000 7f3f91200640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 0x7f3f6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.210+0000 7f3f91200640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 0x7f3f6406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0017a0 tx=0x7f3f7c001710 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.214+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3f8c0ab120 con 0x7f3f8c14ab40 2024-01-20T08:11:46.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.443+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3f8c0ab120 con 0x7f3f8c14ab40 2024-01-20T08:11:46.447 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:11:46.445+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:11:46.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.448+0000 7f3f89600640 1 -- 172.21.15.100:0/2699323114 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v22) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3f8c0ab120 con 0x7f3f8c14ab40 2024-01-20T08:11:46.452 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:11:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 msgr2=0x7f3f6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 0x7f3f6406d390 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c0017a0 tx=0x7f3f7c001710 comp rx=0 tx=0).stop 2024-01-20T08:11:46.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 msgr2=0x7f3f8c0ad3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c0aaee0 tx=0x7f3f8400d890 comp rx=0 tx=0).stop 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 shutdown_connections 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f8c14ab40 0x7f3f8c0ad3a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f6406aed0 0x7f3f6406d390 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f8c1587b0 0x7f3f8c14a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 --2- 172.21.15.100:0/2699323114 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f6c0047c0 0x7f3f8c153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 >> 172.21.15.100:0/2699323114 conn(0x7f3f8c0a9e20 msgr2=0x7f3f8c0c66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 shutdown_connections 2024-01-20T08:11:46.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.452+0000 7f3f93c00640 1 -- 172.21.15.100:0/2699323114 wait complete. 2024-01-20T08:11:46.465 INFO:tasks.ceph.mds.c.smithi100.stderr: -3072> 2024-01-20T08:11:06.778+0000 7f760f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:11:46.475 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T08:11:46.523 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:11:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.648+0000 7f3173200640 1 Processor -- start 2024-01-20T08:11:46.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.648+0000 7f3173200640 1 -- start start 2024-01-20T08:11:46.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.649+0000 7f3173200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f316c1515b0 0x7f316c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.649+0000 7f3173200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c154ba0 con 0x7f316c06ce10 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.649+0000 7f3173200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f316c155a00 con 0x7f316c14b720 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3173200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f316c14bb00 con 0x7f316c1515b0 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3163200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f316c1515b0 0x7f316c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3171200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f316c06ce10 0x7f316c15bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:49426/0 (socket says 172.21.15.100:49426) 2024-01-20T08:11:46.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3171200640 1 -- 172.21.15.100:0/2513082438 learned_addr learned my addr 172.21.15.100:0/2513082438 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f316b400640 1 -- 172.21.15.100:0/2513082438 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 907519717 0 0) 0x7f316c154ba0 con 0x7f316c06ce10 2024-01-20T08:11:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3163200640 1 -- 172.21.15.100:0/2513082438 >> v1:172.21.15.110:6789/0 conn(0x7f316c14b720 legacy=0x7f316c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3163200640 1 -- 172.21.15.100:0/2513082438 >> v1:172.21.15.100:6789/0 conn(0x7f316c06ce10 legacy=0x7f316c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.650+0000 7f3163200640 1 -- 172.21.15.100:0/2513082438 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f316c154df0 con 0x7f316c1515b0 2024-01-20T08:11:46.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.652+0000 7f3163200640 1 --2- 172.21.15.100:0/2513082438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c06c8d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f315402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c23276a1f564965 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.652+0000 7f316b400640 1 -- 172.21.15.100:0/2513082438 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031830 con 0x7f316c1515b0 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.652+0000 7f316b400640 1 -- 172.21.15.100:0/2513082438 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3154031990 con 0x7f316c1515b0 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.652+0000 7f316b400640 1 -- 172.21.15.100:0/2513082438 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3154031d20 con 0x7f316c1515b0 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 -- 172.21.15.100:0/2513082438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 msgr2=0x7f316c06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 --2- 172.21.15.100:0/2513082438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c06c8d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f31540097a0 tx=0x7f315402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 -- 172.21.15.100:0/2513082438 shutdown_connections 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 --2- 172.21.15.100:0/2513082438 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c06c8d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 -- 172.21.15.100:0/2513082438 >> 172.21.15.100:0/2513082438 conn(0x7f316c0c2940 msgr2=0x7f316c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 -- 172.21.15.100:0/2513082438 shutdown_connections 2024-01-20T08:11:46.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.653+0000 7f3173200640 1 -- 172.21.15.100:0/2513082438 wait complete. 2024-01-20T08:11:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.654+0000 7f3173200640 1 Processor -- start 2024-01-20T08:11:46.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 -- start start 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 0x7f316c0c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f316c14b720 0x7f316c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1ee570 con 0x7f316c1515b0 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1536f0 con 0x7f316c06ce10 2024-01-20T08:11:46.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.655+0000 7f3173200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f316c1545d0 con 0x7f316c14b720 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59104/0 (socket says 172.21.15.100:59104) 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 -- 172.21.15.100:0/2475894844 learned_addr learned my addr 172.21.15.100:0/2475894844 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f316be00640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 0x7f316c0c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3163200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f316c14b720 0x7f316c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 -- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f316c14b720 msgr2=0x7f316c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f316c14b720 0x7f316c152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 -- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 msgr2=0x7f316c0c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 0x7f316c0c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f3171200640 1 -- 172.21.15.100:0/2475894844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3154009400 con 0x7f316c1515b0 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.656+0000 7f316be00640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 0x7f316c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:46.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3171200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f316400c450 tx=0x7f316400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31640074e0 con 0x7f316c1515b0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3164007660 con 0x7f316c1515b0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f316c1548b0 con 0x7f316c1515b0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3164004a20 con 0x7f316c1515b0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.657+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f316c0c1660 con 0x7f316c1515b0 2024-01-20T08:11:46.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.658+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f316c0aa320 con 0x7f316c1515b0 2024-01-20T08:11:46.663 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.660+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3164004b80 con 0x7f316c1515b0 2024-01-20T08:11:46.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.661+0000 7f3168c00640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 0x7f314406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.662+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f3164088f10 con 0x7f316c1515b0 2024-01-20T08:11:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.662+0000 7f316be00640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 0x7f314406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:46.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.662+0000 7f316be00640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 0x7f314406d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f315c0012e0 tx=0x7f315c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:46.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.666+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f316c0aa320 con 0x7f316c1515b0 2024-01-20T08:11:46.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:46.881+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f316c0aa320 con 0x7f316c1515b0 2024-01-20T08:11:47.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.452+0000 7f3168c00640 1 -- 172.21.15.100:0/2475894844 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f316c0aa320 con 0x7f316c1515b0 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.456+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 msgr2=0x7f314406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.456+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 0x7f314406d390 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f315c0012e0 tx=0x7f315c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.456+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 msgr2=0x7f316c1531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.456+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f316400c450 tx=0x7f316400c910 comp rx=0 tx=0).stop 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 shutdown_connections 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f316c1515b0 0x7f316c1531b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f314406aed0 0x7f314406d390 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f316c14b720 0x7f316c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 --2- 172.21.15.100:0/2475894844 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f316c06ce10 0x7f316c0c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 >> 172.21.15.100:0/2475894844 conn(0x7f316c0c2940 msgr2=0x7f316c150ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:47.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 shutdown_connections 2024-01-20T08:11:47.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.457+0000 7f3173200640 1 -- 172.21.15.100:0/2475894844 wait complete. 2024-01-20T08:11:47.479 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T08:11:47.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.684+0000 7f7fb9600640 1 Processor -- start 2024-01-20T08:11:47.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.684+0000 7f7fb9600640 1 -- start start 2024-01-20T08:11:47.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.686+0000 7f7fb9600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 0x7f7fb4154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.686+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 0x7f7fb415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.686+0000 7f7fb9600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fb40c8f50 con 0x7f7fb40c4ec0 2024-01-20T08:11:47.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.686+0000 7f7fb9600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fb40c9af0 con 0x7f7fb40c4ae0 2024-01-20T08:11:47.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.686+0000 7f7fb9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c5320 con 0x7f7fb406b520 2024-01-20T08:11:47.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb2a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 0x7f7fb4154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb3400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 0x7f7fb415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb2000640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f7fb40c4ec0 0x7f7fb40c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:47988/0 (socket says 172.21.15.100:47988) 2024-01-20T08:11:47.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb2000640 1 -- 172.21.15.100:0/4038831234 learned_addr learned my addr 172.21.15.100:0/4038831234 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb1600640 1 -- 172.21.15.100:0/4038831234 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754651488 0 0) 0x7f7fb40c8f50 con 0x7f7fb40c4ec0 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.687+0000 7f7fb1600640 1 -- 172.21.15.100:0/4038831234 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f94003520 con 0x7f7fb40c4ec0 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.688+0000 7f7fb3400640 1 -- 172.21.15.100:0/4038831234 >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 msgr2=0x7f7fb4154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.688+0000 7f7fb3400640 1 --2- 172.21.15.100:0/4038831234 >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 0x7f7fb4154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.688+0000 7f7fb3400640 1 -- 172.21.15.100:0/4038831234 >> v1:172.21.15.110:6789/0 conn(0x7f7fb40c4ec0 legacy=0x7f7fb40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.688+0000 7f7fb3400640 1 -- 172.21.15.100:0/4038831234 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb406b9b0 con 0x7f7fb406b520 2024-01-20T08:11:47.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.688+0000 7f7fb2a00640 1 --2- 172.21.15.100:0/4038831234 >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 0x7f7fb4154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:11:47.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.689+0000 7f7fb3400640 1 --2- 172.21.15.100:0/4038831234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 0x7f7fb415f1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0097a0 tx=0x7f7fac02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=992f2176e5c1fa12 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:47.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.689+0000 7f7fb1600640 1 -- 172.21.15.100:0/4038831234 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac031780 con 0x7f7fb406b520 2024-01-20T08:11:47.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb1600640 1 -- 172.21.15.100:0/4038831234 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fac0318e0 con 0x7f7fb406b520 2024-01-20T08:11:47.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb1600640 1 -- 172.21.15.100:0/4038831234 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fac031c70 con 0x7f7fb406b520 2024-01-20T08:11:47.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 -- 172.21.15.100:0/4038831234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 msgr2=0x7f7fb415f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 --2- 172.21.15.100:0/4038831234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 0x7f7fb415f1d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7fac0097a0 tx=0x7f7fac02b820 comp rx=0 tx=0).stop 2024-01-20T08:11:47.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 -- 172.21.15.100:0/4038831234 shutdown_connections 2024-01-20T08:11:47.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 --2- 172.21.15.100:0/4038831234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb406b520 0x7f7fb415f1d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 --2- 172.21.15.100:0/4038831234 >> v2:172.21.15.110:3300/0 conn(0x7f7fb40c4ae0 0x7f7fb4154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 -- 172.21.15.100:0/4038831234 >> 172.21.15.100:0/4038831234 conn(0x7f7fb40ca160 msgr2=0x7f7fb40ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:47.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.690+0000 7f7fb9600640 1 -- 172.21.15.100:0/4038831234 shutdown_connections 2024-01-20T08:11:47.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.691+0000 7f7fb9600640 1 -- 172.21.15.100:0/4038831234 wait complete. 2024-01-20T08:11:47.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.693+0000 7f7fb9600640 1 Processor -- start 2024-01-20T08:11:47.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.693+0000 7f7fb9600640 1 -- start start 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 0x7f7fb40aeb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 0x7f7fb40af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb4156380 con 0x7f7fb406b520 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb41ee8e0 con 0x7f7fb40c4ec0 2024-01-20T08:11:47.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fb40c3680 con 0x7f7fb40c4ae0 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59116/0 (socket says 172.21.15.100:59116) 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb2a00640 1 -- 172.21.15.100:0/3272451141 learned_addr learned my addr 172.21.15.100:0/3272451141 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.694+0000 7f7fb3400640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 0x7f7fb40af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2000640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 0x7f7fb40aeb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 -- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 msgr2=0x7f7fb40aeb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 0x7f7fb40aeb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 -- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 msgr2=0x7f7fb40af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 0x7f7fb40af3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 -- 172.21.15.100:0/3272451141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fa4009a70 con 0x7f7fb406b520 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb3400640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 0x7f7fb40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2000640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 0x7f7fb40aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb2a00640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ec0 tx=0x7f7fa400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4014680 con 0x7f7fb406b520 2024-01-20T08:11:47.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fa400f040 con 0x7f7fb406b520 2024-01-20T08:11:47.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fac009400 con 0x7f7fb406b520 2024-01-20T08:11:47.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fa4014a00 con 0x7f7fb406b520 2024-01-20T08:11:47.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.695+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fb41edf40 con 0x7f7fb406b520 2024-01-20T08:11:47.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.696+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fb4151440 con 0x7f7fb406b520 2024-01-20T08:11:47.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.698+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7fa4014b60 con 0x7f7fb406b520 2024-01-20T08:11:47.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.699+0000 7f7faaa00640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 0x7f7f8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:47.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.699+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f7fa408a9a0 con 0x7f7fb406b520 2024-01-20T08:11:47.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.699+0000 7f7fb2000640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 0x7f7f8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:47.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.700+0000 7f7fb2000640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 0x7f7f8c06d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fb41e8490 tx=0x7f7f9c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:47.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.703+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fa40554b0 con 0x7f7fb406b520 2024-01-20T08:11:47.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:47.880+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7fb40c6160 con 0x7f7fb406b520 2024-01-20T08:11:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.461+0000 7f7faaa00640 1 -- 172.21.15.100:0/3272451141 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v40) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7fa4058ad0 con 0x7f7fb406b520 2024-01-20T08:11:48.465 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-20T08:11:48.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.465+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 msgr2=0x7f7f8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.465+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 0x7f7f8c06d390 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fb41e8490 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.465+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 msgr2=0x7f7fb40acd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.465+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7fa4009ec0 tx=0x7f7fa400c490 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.465+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 shutdown_connections 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.466+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fb40c4ec0 0x7f7fb40af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.466+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f8c06aed0 0x7f7f8c06d390 secure :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f7fb41e8490 tx=0x7f7f9c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.466+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fb40c4ae0 0x7f7fb40aeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.466+0000 7f7fb9600640 1 --2- 172.21.15.100:0/3272451141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fb406b520 0x7f7fb40acd40 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.466+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 >> 172.21.15.100:0/3272451141 conn(0x7f7fb40ca160 msgr2=0x7f7fb40c7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:48.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.471+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 shutdown_connections 2024-01-20T08:11:48.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.472+0000 7f7fb9600640 1 -- 172.21.15.100:0/3272451141 wait complete. 2024-01-20T08:11:48.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T08:11:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.682+0000 7ff63a200640 1 Processor -- start 2024-01-20T08:11:48.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.683+0000 7ff63a200640 1 -- start start 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff63414c5a0 0x7ff634153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff63406bdb0 0x7ff6340c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6340c1f50 0x7ff63406d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff634153560 con 0x7ff63414c5a0 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63406d0e0 con 0x7ff63406bdb0 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.684+0000 7ff63a200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6340aaf10 con 0x7ff6340c1f50 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff63414c5a0 0x7ff634153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff63414c5a0 0x7ff634153020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59120/0 (socket says 172.21.15.100:59120) 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 -- 172.21.15.100:0/1686684098 learned_addr learned my addr 172.21.15.100:0/1686684098 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff632a00640 1 --2- 172.21.15.100:0/1686684098 >> v2:172.21.15.110:3300/0 conn(0x7ff63406bdb0 0x7ff6340c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633e00640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6340c1f50 0x7ff63406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 -- 172.21.15.100:0/1686684098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6340c1f50 msgr2=0x7ff63406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6340c1f50 0x7ff63406d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 -- 172.21.15.100:0/1686684098 >> v2:172.21.15.110:3300/0 conn(0x7ff63406bdb0 msgr2=0x7ff6340c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 --2- 172.21.15.100:0/1686684098 >> v2:172.21.15.110:3300/0 conn(0x7ff63406bdb0 0x7ff6340c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.685+0000 7ff633400640 1 -- 172.21.15.100:0/1686684098 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63414c980 con 0x7ff63414c5a0 2024-01-20T08:11:48.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.687+0000 7ff633400640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff634153020 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff6340c70c0 tx=0x7ff62402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=330198e90fb625f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:48.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.687+0000 7ff632000640 1 -- 172.21.15.100:0/1686684098 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624031750 con 0x7ff63414c5a0 2024-01-20T08:11:48.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.687+0000 7ff632000640 1 -- 172.21.15.100:0/1686684098 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6240318b0 con 0x7ff63414c5a0 2024-01-20T08:11:48.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.687+0000 7ff632000640 1 -- 172.21.15.100:0/1686684098 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624031c40 con 0x7ff63414c5a0 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 -- 172.21.15.100:0/1686684098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 msgr2=0x7ff634153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff634153020 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7ff6340c70c0 tx=0x7ff62402b7f0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 -- 172.21.15.100:0/1686684098 shutdown_connections 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6340c1f50 0x7ff63406d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 --2- 172.21.15.100:0/1686684098 >> v2:172.21.15.110:3300/0 conn(0x7ff63406bdb0 0x7ff6340c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 --2- 172.21.15.100:0/1686684098 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff634153020 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 -- 172.21.15.100:0/1686684098 >> 172.21.15.100:0/1686684098 conn(0x7ff6340c2b00 msgr2=0x7ff6340c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 -- 172.21.15.100:0/1686684098 shutdown_connections 2024-01-20T08:11:48.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.688+0000 7ff63a200640 1 -- 172.21.15.100:0/1686684098 wait complete. 2024-01-20T08:11:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.690+0000 7ff63a200640 1 Processor -- start 2024-01-20T08:11:48.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.690+0000 7ff63a200640 1 -- start start 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63406bdb0 0x7ff63414f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6340c1f50 0x7ff634143030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634155df0 con 0x7ff63414c5a0 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff634156a50 con 0x7ff6340c1f50 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.691+0000 7ff63a200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff634155960 con 0x7ff63406bdb0 2024-01-20T08:11:48.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59128/0 (socket says 172.21.15.100:59128) 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 -- 172.21.15.100:0/1572075045 learned_addr learned my addr 172.21.15.100:0/1572075045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff632a00640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6340c1f50 0x7ff634143030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633400640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63406bdb0 0x7ff63414f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 -- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63406bdb0 msgr2=0x7ff63414f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63406bdb0 0x7ff63414f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 -- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6340c1f50 msgr2=0x7ff634143030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6340c1f50 0x7ff634143030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.692+0000 7ff633e00640 1 -- 172.21.15.100:0/1572075045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6240094d0 con 0x7ff63414c5a0 2024-01-20T08:11:48.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff633e00640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff62c007e90 tx=0x7ff62c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c014420 con 0x7ff63414c5a0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff634142d50 con 0x7ff63414c5a0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c014580 con 0x7ff63414c5a0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c014930 con 0x7ff63414c5a0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.693+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6341555f0 con 0x7ff63414c5a0 2024-01-20T08:11:48.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.694+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63414a6c0 con 0x7ff63414c5a0 2024-01-20T08:11:48.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.695+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff62c014a90 con 0x7ff63414c5a0 2024-01-20T08:11:48.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.697+0000 7ff62b400640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 0x7ff60c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:48.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.697+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6213+0+0 (secure 0 0 0) 0x7ff62c08a120 con 0x7ff63414c5a0 2024-01-20T08:11:48.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.697+0000 7ff633400640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 0x7ff60c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:48.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.698+0000 7ff633400640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 0x7ff60c06d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff624035000 tx=0x7ff624008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.701+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff62c054d60 con 0x7ff63414c5a0 2024-01-20T08:11:48.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:48.893+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff634074450 con 0x7ff63414c5a0 2024-01-20T08:11:49.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.465+0000 7ff62b400640 1 -- 172.21.15.100:0/1572075045 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v41) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff62c058380 con 0x7ff63414c5a0 2024-01-20T08:11:49.469 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-20T08:11:49.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 msgr2=0x7ff60c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 0x7ff60c06d390 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff624035000 tx=0x7ff624008030 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 msgr2=0x7ff63414de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff62c007e90 tx=0x7ff62c00e4b0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 shutdown_connections 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff63414c5a0 0x7ff63414de40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6340c1f50 0x7ff634143030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff60c06aed0 0x7ff60c06d390 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 --2- 172.21.15.100:0/1572075045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff63406bdb0 0x7ff63414f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 >> 172.21.15.100:0/1572075045 conn(0x7ff6340c2b00 msgr2=0x7ff634149dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.469+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 shutdown_connections 2024-01-20T08:11:49.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.470+0000 7ff63a200640 1 -- 172.21.15.100:0/1572075045 wait complete. 2024-01-20T08:11:49.496 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:49.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.685+0000 7f58cb400640 1 Processor -- start 2024-01-20T08:11:49.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.686+0000 7f58cb400640 1 -- start start 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58cb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58c4070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58cb400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40c1670 con 0x7f58c4147f20 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58cb400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c40c0d40 con 0x7f58c4151f60 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58cb400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40c2210 con 0x7f58c40abfd0 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58c8a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f58c4147f20 0x7f58c40c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42212/0 (socket says 172.21.15.100:42212) 2024-01-20T08:11:49.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.687+0000 7f58c8a00640 1 -- 172.21.15.100:0/740794238 learned_addr learned my addr 172.21.15.100:0/740794238 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c9400640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58c4070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2878476578 0 0) 0x7f58c40c1670 con 0x7f58c4147f20 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58a4003520 con 0x7f58c4147f20 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 168817416 0 0) 0x7f58a4003520 con 0x7f58c4147f20 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 msgr2=0x7f58c4070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58c4070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 >> v1:172.21.15.110:6789/0 conn(0x7f58c4151f60 legacy=0x7f58c40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40c1020 con 0x7f58c4147f20 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f58b40019f0 con 0x7f58c4147f20 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.688+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 >> v1:172.21.15.100:6789/0 conn(0x7f58c4147f20 legacy=0x7f58c40c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a40039a0 0x7f58a4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40047c0 0x7f58a4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40c2210 con 0x7f58a40039a0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a400ba60 con 0x7f58a40047c0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a400bc20 con 0x7f58c40abfd0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a40039a0 0x7f58a4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c9400640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 -- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 msgr2=0x7f58a4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58a4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 -- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40047c0 msgr2=0x7f58a4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58bbc00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40047c0 0x7f58a4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40047c0 0x7f58a4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c8a00640 1 -- 172.21.15.100:0/740794238 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a4003520 con 0x7f58a40039a0 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58c9400640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c40abfd0 0x7f58a4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:49.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.689+0000 7f58bbc00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40047c0 0x7f58a4004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58c8a00640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a40039a0 0x7f58a4003dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f58b4002230 tx=0x7f58a40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98bfe6da5ac4f41 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4034630 con 0x7f58a40039a0 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b402f070 con 0x7f58a40039a0 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58c3e00640 1 -- 172.21.15.100:0/740794238 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b40349f0 con 0x7f58a40039a0 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58cb400640 1 -- 172.21.15.100:0/740794238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a40039a0 msgr2=0x7f58a4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58cb400640 1 --2- 172.21.15.100:0/740794238 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58a40039a0 0x7f58a4003dc0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f58b4002230 tx=0x7f58a40057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58c9400640 1 -- 172.21.15.100:0/740794238 reap_dead start 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58cb400640 1 -- 172.21.15.100:0/740794238 shutdown_connections 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.691+0000 7f58cb400640 1 -- 172.21.15.100:0/740794238 >> 172.21.15.100:0/740794238 conn(0x7f58c406a5e0 msgr2=0x7f58c406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:49.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.692+0000 7f58cb400640 1 -- 172.21.15.100:0/740794238 shutdown_connections 2024-01-20T08:11:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.692+0000 7f58cb400640 1 -- 172.21.15.100:0/740794238 wait complete. 2024-01-20T08:11:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.693+0000 7f58cb400640 1 Processor -- start 2024-01-20T08:11:49.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.693+0000 7f58cb400640 1 -- start start 2024-01-20T08:11:49.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40039a0 0x7f58c41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 0x7f58c4143e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414db50 con 0x7f58c41536a0 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414e990 con 0x7f58a40039a0 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58cb400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c414d730 con 0x7f58c4154060 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.694+0000 7f58bbc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50218/0 (socket says 172.21.15.100:50218) 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 -- 172.21.15.100:0/752869529 learned_addr learned my addr 172.21.15.100:0/752869529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58c8a00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40039a0 0x7f58c41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58c9400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 0x7f58c4143e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 -- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 msgr2=0x7f58c4143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 0x7f58c4143e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 -- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40039a0 msgr2=0x7f58c41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40039a0 0x7f58c41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 -- 172.21.15.100:0/752869529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c414dd80 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58c9400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 0x7f58c4143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58bbc00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00d7d0 tx=0x7f58ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.695+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac017070 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.696+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ac005070 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.696+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ac005400 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.696+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c414e060 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.696+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c414e620 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.697+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c414eb40 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.698+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f58ac007030 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.699+0000 7f58c1600640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 0x7f589c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.699+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f58ac088ff0 con 0x7f58c41536a0 2024-01-20T08:11:49.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.699+0000 7f58c8a00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 0x7f589c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:49.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.700+0000 7f58c8a00640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 0x7f589c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58b4034000 tx=0x7f58b402f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:49.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.704+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f58c414eb40 con 0x7f58c41536a0 2024-01-20T08:11:49.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.897+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f58c414eb40 con 0x7f58c41536a0 2024-01-20T08:11:49.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.900+0000 7f58c1600640 1 -- 172.21.15.100:0/752869529 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16625 (secure 0 0 0) 0x7f58c414eb40 con 0x7f58c41536a0 2024-01-20T08:11:49.903 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:49.903 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:49.462525+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/4185964362":"2024-01-21T08:11:46.445693+0000","172.21.15.100:6835/4185964362":"2024-01-21T08:11:46.445693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 msgr2=0x7f589c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 0x7f589c06d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f58b4034000 tx=0x7f58b402f000 comp rx=0 tx=0).stop 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 msgr2=0x7f58c4153b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00d7d0 tx=0x7f58ac00dc90 comp rx=0 tx=0).stop 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 shutdown_connections 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f589c06ae70 0x7f589c06d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f58c4154060 0x7f58c4143e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f58c41536a0 0x7f58c4153b20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.902+0000 7f58cb400640 1 --2- 172.21.15.100:0/752869529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f58a40039a0 0x7f58c41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:49.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.903+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 >> 172.21.15.100:0/752869529 conn(0x7f58c406a5e0 msgr2=0x7f58c40c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:49.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.903+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 shutdown_connections 2024-01-20T08:11:49.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:49.903+0000 7f58cb400640 1 -- 172.21.15.100:0/752869529 wait complete. 2024-01-20T08:11:49.924 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:11:18.055571+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:11:18.935347+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:49.925 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.139+0000 7f3cd6400640 1 Processor -- start 2024-01-20T08:11:50.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.139+0000 7f3cd6400640 1 -- start start 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3cd6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd00c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3cd6400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3cd0155290 0x7f3cd006b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3cd6400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd00c9f30 con 0x7f3cd00c4a50 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3cd6400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd006c5a0 con 0x7f3cd0155290 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3cd6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c87a0 con 0x7f3cd0151e40 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3ccea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3cd00c4a50 0x7f3cd0155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42224/0 (socket says 172.21.15.100:42224) 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3ccea00640 1 -- 172.21.15.100:0/2941809212 learned_addr learned my addr 172.21.15.100:0/2941809212 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:50.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.140+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/2941809212 >> v2:172.21.15.100:3300/0 conn(0x7f3cd0155290 0x7f3cd006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3cce000640 1 -- 172.21.15.100:0/2941809212 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3282565631 0 0) 0x7f3cb8001110 con 0x7f3cd00c4a50 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3cce000640 1 -- 172.21.15.100:0/2941809212 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cb0003520 con 0x7f3cd00c4a50 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccf400640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd00c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccfe00640 1 -- 172.21.15.100:0/2941809212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 msgr2=0x7f3cd00c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd00c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccfe00640 1 -- 172.21.15.100:0/2941809212 >> v1:172.21.15.100:6789/0 conn(0x7f3cd00c4a50 legacy=0x7f3cd0155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccfe00640 1 -- 172.21.15.100:0/2941809212 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0156410 con 0x7f3cd0155290 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.141+0000 7f3ccf400640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd00c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:50.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.142+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd006b140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009d90 tx=0x7f3cc802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf9a6d9408b9ce38 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.142+0000 7f3cce000640 1 -- 172.21.15.100:0/2941809212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc802cbc0 con 0x7f3cd0155290 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.142+0000 7f3cce000640 1 -- 172.21.15.100:0/2941809212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc802cd20 con 0x7f3cd0155290 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.142+0000 7f3cce000640 1 -- 172.21.15.100:0/2941809212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8034640 con 0x7f3cd0155290 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 -- 172.21.15.100:0/2941809212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 msgr2=0x7f3cd006b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd006b140 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009d90 tx=0x7f3cc802be10 comp rx=0 tx=0).stop 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 -- 172.21.15.100:0/2941809212 shutdown_connections 2024-01-20T08:11:50.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd006b140 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 --2- 172.21.15.100:0/2941809212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd00c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 -- 172.21.15.100:0/2941809212 >> 172.21.15.100:0/2941809212 conn(0x7f3cd00abde0 msgr2=0x7f3cd00ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 -- 172.21.15.100:0/2941809212 shutdown_connections 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.143+0000 7f3cd6400640 1 -- 172.21.15.100:0/2941809212 wait complete. 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.144+0000 7f3cd6400640 1 Processor -- start 2024-01-20T08:11:50.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 -- start start 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd00c4a50 0x7f3cd0152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd014cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd00c6740 con 0x7f3cd0155290 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01ea6a0 con 0x7f3cd00c4a50 2024-01-20T08:11:50.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.145+0000 7f3cd6400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd01ea8a0 con 0x7f3cd0151e40 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50230/0 (socket says 172.21.15.100:50230) 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 -- 172.21.15.100:0/585422828 learned_addr learned my addr 172.21.15.100:0/585422828 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccf400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd00c4a50 0x7f3cd0152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccea00640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd014cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 -- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 msgr2=0x7f3cd014cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd014cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 -- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd00c4a50 msgr2=0x7f3cd0152680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd00c4a50 0x7f3cd0152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.146+0000 7f3ccfe00640 1 -- 172.21.15.100:0/585422828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc8009a70 con 0x7f3cd0155290 2024-01-20T08:11:50.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3ccfe00640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009eb0 tx=0x7f3cc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc8007000 con 0x7f3cd0155290 2024-01-20T08:11:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc802ce90 con 0x7f3cd0155290 2024-01-20T08:11:50.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd014c490 con 0x7f3cd0155290 2024-01-20T08:11:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc80408b0 con 0x7f3cd0155290 2024-01-20T08:11:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.147+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd014e1f0 con 0x7f3cd0155290 2024-01-20T08:11:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.148+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd014c9b0 con 0x7f3cd0155290 2024-01-20T08:11:50.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.149+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3cc8040a10 con 0x7f3cd0155290 2024-01-20T08:11:50.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.150+0000 7f3cc7400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 0x7f3ca806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.150+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f3cc80ac380 con 0x7f3cd0155290 2024-01-20T08:11:50.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.150+0000 7f3ccf400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 0x7f3ca806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.151+0000 7f3ccf400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 0x7f3ca806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0008850 tx=0x7f3cc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.154+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3cd014c9b0 con 0x7f3cd0155290 2024-01-20T08:11:50.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.345+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3cd014c9b0 con 0x7f3cd0155290 2024-01-20T08:11:50.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.346+0000 7f3cc7400640 1 -- 172.21.15.100:0/585422828 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3cd014c9b0 con 0x7f3cd0155290 2024-01-20T08:11:50.348 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:50.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 msgr2=0x7f3ca806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 0x7f3ca806d390 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0008850 tx=0x7f3cc0008040 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 msgr2=0x7f3cd0148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8009eb0 tx=0x7f3cc8004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 shutdown_connections 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cd0155290 0x7f3cd0148710 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ca806aed0 0x7f3ca806d390 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cd0151e40 0x7f3cd014cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 --2- 172.21.15.100:0/585422828 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cd00c4a50 0x7f3cd0152680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.348+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 >> 172.21.15.100:0/585422828 conn(0x7f3cd00abde0 msgr2=0x7f3cd00c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.349+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 shutdown_connections 2024-01-20T08:11:50.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.349+0000 7f3cd6400640 1 -- 172.21.15.100:0/585422828 wait complete. 2024-01-20T08:11:50.371 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:11:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.586+0000 7f6d7e600640 1 Processor -- start 2024-01-20T08:11:50.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.586+0000 7f6d7e600640 1 -- start start 2024-01-20T08:11:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.587+0000 7f6d7e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d78071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.587+0000 7f6d7e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d78151e50 con 0x7f6d78072040 2024-01-20T08:11:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.587+0000 7f6d7e600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d7814ee30 con 0x7f6d780c2310 2024-01-20T08:11:50.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.587+0000 7f6d7e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780a9180 con 0x7f6d7814ea50 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d6fe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6d78072040 0x7f6d780c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42232/0 (socket says 172.21.15.100:42232) 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d6fe00640 1 -- 172.21.15.100:0/466753808 learned_addr learned my addr 172.21.15.100:0/466753808 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d7d200640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d78071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25361235 0 0) 0x7f6d78151e50 con 0x7f6d78072040 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d58003520 con 0x7f6d78072040 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 619922060 0 0) 0x7f6d58003520 con 0x7f6d78072040 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 msgr2=0x7f6d78071b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d78071b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 >> v1:172.21.15.110:6789/0 conn(0x7f6d780c2310 legacy=0x7f6d7815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d78152380 con 0x7f6d78072040 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6d68001670 con 0x7f6d78072040 2024-01-20T08:11:50.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.588+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 >> v1:172.21.15.100:6789/0 conn(0x7f6d78072040 legacy=0x7f6d780c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d58004e20 0x7f6d5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d58005610 con 0x7f6d58004020 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800bec0 con 0x7f6d58004e20 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5800c000 con 0x7f6d7814ea50 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d7d200640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d7dc00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d58004e20 0x7f6d5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 -- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 msgr2=0x7f6d580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:50.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 -- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d58004e20 msgr2=0x7f6d5800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:50.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d58004e20 0x7f6d5800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d6fe00640 1 -- 172.21.15.100:0/466753808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d58003520 con 0x7f6d58004020 2024-01-20T08:11:50.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.589+0000 7f6d7d200640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d7814ea50 0x7f6d580039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.590+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d580047c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c0e0 tx=0x7f6d580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfa031f99e1bb6f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d68005ad0 con 0x7f6d58004020 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d68005c30 con 0x7f6d58004020 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d77e00640 1 -- 172.21.15.100:0/466753808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6802c7f0 con 0x7f6d58004020 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7e600640 1 -- 172.21.15.100:0/466753808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 msgr2=0x7f6d580047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7e600640 1 --2- 172.21.15.100:0/466753808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d580047c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f6d6800c0e0 tx=0x7f6d580057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7dc00640 1 -- 172.21.15.100:0/466753808 reap_dead start 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7e600640 1 -- 172.21.15.100:0/466753808 shutdown_connections 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7e600640 1 -- 172.21.15.100:0/466753808 >> 172.21.15.100:0/466753808 conn(0x7f6d780c2940 msgr2=0x7f6d780c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.591+0000 7f6d7e600640 1 -- 172.21.15.100:0/466753808 shutdown_connections 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.592+0000 7f6d7e600640 1 -- 172.21.15.100:0/466753808 wait complete. 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.593+0000 7f6d7e600640 1 Processor -- start 2024-01-20T08:11:50.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.593+0000 7f6d7e600640 1 -- start start 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d7813ee40 0x7f6d7814f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d78140170 0x7f6d7814f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c5460 con 0x7f6d58004020 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d78138f90 con 0x7f6d7813ee40 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.594+0000 7f6d7e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c5670 con 0x7f6d78140170 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50236/0 (socket says 172.21.15.100:50236) 2024-01-20T08:11:50.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 -- 172.21.15.100:0/3557799499 learned_addr learned my addr 172.21.15.100:0/3557799499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d7813ee40 0x7f6d7814f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 -- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d78140170 msgr2=0x7f6d7814f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d78140170 0x7f6d7814f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 -- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d7813ee40 msgr2=0x7f6d7814f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d7813ee40 0x7f6d7814f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 -- 172.21.15.100:0/3557799499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7813db10 con 0x7f6d58004020 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.595+0000 7f6d7d200640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000e7e0 tx=0x7f6d6000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.596+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000c6d0 con 0x7f6d58004020 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.596+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6000c830 con 0x7f6d58004020 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.596+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d780ab540 con 0x7f6d58004020 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.596+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6000cba0 con 0x7f6d58004020 2024-01-20T08:11:50.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.596+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d78139340 con 0x7f6d58004020 2024-01-20T08:11:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.597+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d780c5880 con 0x7f6d58004020 2024-01-20T08:11:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.598+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6d6000cd00 con 0x7f6d58004020 2024-01-20T08:11:50.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.599+0000 7f6d75600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 0x7f6d5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.599+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6d60089490 con 0x7f6d58004020 2024-01-20T08:11:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.599+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 0x7f6d5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:50.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.600+0000 7f6d6fe00640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 0x7f6d5006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d68034000 tx=0x7f6d68009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:50.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.604+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6d600542f0 con 0x7f6d58004020 2024-01-20T08:11:50.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.796+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6d7813dca0 con 0x7f6d58004020 2024-01-20T08:11:50.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.797+0000 7f6d75600640 1 -- 172.21.15.100:0/3557799499 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v41) v1 ==== 105+0+11 (secure 0 0 0) 0x7f6d60057910 con 0x7f6d58004020 2024-01-20T08:11:50.800 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:11:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 msgr2=0x7f6d5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 0x7f6d5006d390 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d68034000 tx=0x7f6d68009030 comp rx=0 tx=0).stop 2024-01-20T08:11:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 msgr2=0x7f6d780ab000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:50.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6d6000e7e0 tx=0x7f6d6000eca0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 shutdown_connections 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6d5006aed0 0x7f6d5006d390 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6d78140170 0x7f6d7814f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6d7813ee40 0x7f6d7814f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 --2- 172.21.15.100:0/3557799499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6d58004020 0x7f6d780ab000 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.800+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 >> 172.21.15.100:0/3557799499 conn(0x7f6d780c2940 msgr2=0x7f6d780c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.801+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 shutdown_connections 2024-01-20T08:11:50.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:50.801+0000 7f6d7e600640 1 -- 172.21.15.100:0/3557799499 wait complete. 2024-01-20T08:11:50.822 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:11:51.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.031+0000 7f9e33400640 1 Processor -- start 2024-01-20T08:11:51.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.031+0000 7f9e33400640 1 -- start start 2024-01-20T08:11:51.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e33400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9e2c0a7e50 0x7f9e2c0ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e33400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9e2c0ac4b0 0x7f9e2c0ab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e33400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2c0c2830 con 0x7f9e2c14fdc0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e33400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c0aaec0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e33400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2c1569d0 con 0x7f9e2c0a7e50 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e30a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9e2c14fdc0 0x7f9e2c06b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42248/0 (socket says 172.21.15.100:42248) 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e30a00640 1 -- 172.21.15.100:0/3841254159 learned_addr learned my addr 172.21.15.100:0/3841254159 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e31400640 1 --2- 172.21.15.100:0/3841254159 >> v2:172.21.15.100:3300/0 conn(0x7f9e2c0ac4b0 0x7f9e2c0ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.033+0000 7f9e23e00640 1 --2- 172.21.15.100:0/3841254159 >> v2:172.21.15.110:3300/0 conn(0x7f9e2c0a7e50 0x7f9e2c0ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e2be00640 1 -- 172.21.15.100:0/3841254159 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252188859 0 0) 0x7f9e2c0c2830 con 0x7f9e2c14fdc0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e2be00640 1 -- 172.21.15.100:0/3841254159 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e0c003520 con 0x7f9e2c14fdc0 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e31400640 1 -- 172.21.15.100:0/3841254159 >> v2:172.21.15.110:3300/0 conn(0x7f9e2c0a7e50 msgr2=0x7f9e2c0ab3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e31400640 1 --2- 172.21.15.100:0/3841254159 >> v2:172.21.15.110:3300/0 conn(0x7f9e2c0a7e50 0x7f9e2c0ab3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e31400640 1 -- 172.21.15.100:0/3841254159 >> v1:172.21.15.100:6789/0 conn(0x7f9e2c14fdc0 legacy=0x7f9e2c06b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.034+0000 7f9e31400640 1 -- 172.21.15.100:0/3841254159 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c0c2a80 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.035+0000 7f9e31400640 1 --2- 172.21.15.100:0/3841254159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c0ab920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0709c0 tx=0x7f9e2402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92740ff9b9bbee09 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.035+0000 7f9e2be00640 1 -- 172.21.15.100:0/3841254159 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2402cc80 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.035+0000 7f9e2be00640 1 -- 172.21.15.100:0/3841254159 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2402cde0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.035+0000 7f9e2be00640 1 -- 172.21.15.100:0/3841254159 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24034660 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 -- 172.21.15.100:0/3841254159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 msgr2=0x7f9e2c0ab920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 --2- 172.21.15.100:0/3841254159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c0ab920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c0709c0 tx=0x7f9e2402bed0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 -- 172.21.15.100:0/3841254159 shutdown_connections 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 --2- 172.21.15.100:0/3841254159 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c0ab920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 --2- 172.21.15.100:0/3841254159 >> v2:172.21.15.110:3300/0 conn(0x7f9e2c0a7e50 0x7f9e2c0ab3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 -- 172.21.15.100:0/3841254159 >> 172.21.15.100:0/3841254159 conn(0x7f9e2c0c3170 msgr2=0x7f9e2c0c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 -- 172.21.15.100:0/3841254159 shutdown_connections 2024-01-20T08:11:51.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.036+0000 7f9e33400640 1 -- 172.21.15.100:0/3841254159 wait complete. 2024-01-20T08:11:51.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.038+0000 7f9e33400640 1 Processor -- start 2024-01-20T08:11:51.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.038+0000 7f9e33400640 1 -- start start 2024-01-20T08:11:51.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.038+0000 7f9e33400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0a7e50 0x7f9e2c150930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e33400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e33400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c14fdc0 0x7f9e2c149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e33400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c1540b0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e33400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c14aaf0 con 0x7f9e2c0a7e50 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e33400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c14b020 con 0x7f9e2c14fdc0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50256/0 (socket says 172.21.15.100:50256) 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 -- 172.21.15.100:0/3005110926 learned_addr learned my addr 172.21.15.100:0/3005110926 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e31400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c14fdc0 0x7f9e2c149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e30a00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0a7e50 0x7f9e2c150930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 -- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c14fdc0 msgr2=0x7f9e2c149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c14fdc0 0x7f9e2c149ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 -- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0a7e50 msgr2=0x7f9e2c150930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0a7e50 0x7f9e2c150930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.039+0000 7f9e23e00640 1 -- 172.21.15.100:0/3005110926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24009a70 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e23e00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d800 tx=0x7f9e1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400b6c0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1400b820 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1400bbb0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e2c14ad40 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.040+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2c153dd0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.041+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2c04e970 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.042+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9e1400bd10 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.043+0000 7f9e29600640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 0x7f9e0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.043+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9e14089c50 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.043+0000 7f9e30a00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 0x7f9e0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.044+0000 7f9e30a00640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 0x7f9e0406d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c000f60 tx=0x7f9e1c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.047+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9e14054ab0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.241+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f9e2c150550 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.242+0000 7f9e29600640 1 -- 172.21.15.100:0/3005110926 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v41) v1 ==== 101+0+11 (secure 0 0 0) 0x7f9e140580d0 con 0x7f9e2c0ac4b0 2024-01-20T08:11:51.245 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 msgr2=0x7f9e0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 0x7f9e0406d390 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9e1c000f60 tx=0x7f9e1c009040 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 msgr2=0x7f9e2c155190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f9e1400d800 tx=0x7f9e1400dcc0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 shutdown_connections 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9e0406aed0 0x7f9e0406d390 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9e2c14fdc0 0x7f9e2c149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9e2c0ac4b0 0x7f9e2c155190 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 --2- 172.21.15.100:0/3005110926 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9e2c0a7e50 0x7f9e2c150930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 >> 172.21.15.100:0/3005110926 conn(0x7f9e2c0c3170 msgr2=0x7f9e2c06e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:51.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 shutdown_connections 2024-01-20T08:11:51.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.245+0000 7f9e33400640 1 -- 172.21.15.100:0/3005110926 wait complete. 2024-01-20T08:11:51.268 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:51.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.465+0000 7f6bc9600640 1 Processor -- start 2024-01-20T08:11:51.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.466+0000 7f6bc9600640 1 -- start start 2024-01-20T08:11:51.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc9600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bc4071220 0x7f6bc4071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc40bfae0 0x7f6bc4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc9600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc40c0fb0 con 0x7f6bc41521e0 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc9600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc40c04a0 con 0x7f6bc4071220 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc406def0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bc4071220 0x7f6bc4071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6bc4071220 0x7f6bc4071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50262/0 (socket says 172.21.15.100:50262) 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.467+0000 7f6bc2a00640 1 -- 172.21.15.100:0/591016933 learned_addr learned my addr 172.21.15.100:0/591016933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.468+0000 7f6bc2a00640 1 -- 172.21.15.100:0/591016933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc40bfae0 msgr2=0x7f6bc4151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.468+0000 7f6bc2a00640 1 --2- 172.21.15.100:0/591016933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc40bfae0 0x7f6bc4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.468+0000 7f6bc2a00640 1 -- 172.21.15.100:0/591016933 >> v1:172.21.15.110:6789/0 conn(0x7f6bc41521e0 legacy=0x7f6bc4157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:51.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.468+0000 7f6bc2a00640 1 -- 172.21.15.100:0/591016933 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc406e1d0 con 0x7f6bc4071220 2024-01-20T08:11:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.469+0000 7f6bc2a00640 1 --2- 172.21.15.100:0/591016933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4071220 0x7f6bc4071600 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009870 tx=0x7f6bb402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63b8142d858acc2f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.469+0000 7f6bc2000640 1 -- 172.21.15.100:0/591016933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4031740 con 0x7f6bc4071220 2024-01-20T08:11:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.469+0000 7f6bc2000640 1 -- 172.21.15.100:0/591016933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb40318a0 con 0x7f6bc4071220 2024-01-20T08:11:51.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.469+0000 7f6bc2000640 1 -- 172.21.15.100:0/591016933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb4031c30 con 0x7f6bc4071220 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 -- 172.21.15.100:0/591016933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4071220 msgr2=0x7f6bc4071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 --2- 172.21.15.100:0/591016933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4071220 0x7f6bc4071600 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4009870 tx=0x7f6bb402b7e0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 -- 172.21.15.100:0/591016933 shutdown_connections 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 --2- 172.21.15.100:0/591016933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc40bfae0 0x7f6bc4151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 --2- 172.21.15.100:0/591016933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc4071220 0x7f6bc4071600 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 -- 172.21.15.100:0/591016933 >> 172.21.15.100:0/591016933 conn(0x7f6bc406a5e0 msgr2=0x7f6bc406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 -- 172.21.15.100:0/591016933 shutdown_connections 2024-01-20T08:11:51.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.470+0000 7f6bc9600640 1 -- 172.21.15.100:0/591016933 wait complete. 2024-01-20T08:11:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.472+0000 7f6bc9600640 1 Processor -- start 2024-01-20T08:11:51.474 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.472+0000 7f6bc9600640 1 -- start start 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bc4071220 0x7f6bc40a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc41521e0 0x7f6bc41ed970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40aa7e0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc4153ab0 con 0x7f6bc4071220 2024-01-20T08:11:51.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bc9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc40aa3e0 con 0x7f6bc41521e0 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50266/0 (socket says 172.21.15.100:50266) 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1654693763 learned_addr learned my addr 172.21.15.100:0/1654693763 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc41521e0 msgr2=0x7f6bc41ed970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc41521e0 0x7f6bc41ed970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bc4071220 msgr2=0x7f6bc40a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bc4071220 0x7f6bc40a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.473+0000 7f6bb9e00640 1 -- 172.21.15.100:0/1654693763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb40094d0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bb9e00640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b4d0 tx=0x7f6bac00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010870 con 0x7f6bc40bfae0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac0109d0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc4148060 con 0x7f6bc40bfae0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac010d80 con 0x7f6bc40bfae0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.474+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc4147d80 con 0x7f6bc40bfae0 2024-01-20T08:11:51.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.475+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc40707b0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.479 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.476+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6bac00f3c0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.477+0000 7f6bbb400640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 0x7f6b9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.477+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f6bac089680 con 0x7f6bc40bfae0 2024-01-20T08:11:51.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.477+0000 7f6bc2a00640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 0x7f6b9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.478+0000 7f6bc2a00640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 0x7f6b9c06d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4035000 tx=0x7f6bb4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.481+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6bac0544e0 con 0x7f6bc40bfae0 2024-01-20T08:11:51.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.714+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bc404e970 con 0x7f6bc40bfae0 2024-01-20T08:11:51.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.715+0000 7f6bbb400640 1 -- 172.21.15.100:0/1654693763 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f6bac057b00 con 0x7f6bc40bfae0 2024-01-20T08:11:51.718 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:51.719 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/566641086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":566641086},{"type":"v1","addr":"172.21.15.100:6837","nonce":566641086}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:51.719 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 msgr2=0x7f6b9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 0x7f6b9c06d390 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6bb4035000 tx=0x7f6bb4030000 comp rx=0 tx=0).stop 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 msgr2=0x7f6bc40c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00b4d0 tx=0x7f6bac00b990 comp rx=0 tx=0).stop 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 shutdown_connections 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b9c06aed0 0x7f6b9c06d390 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6bc41521e0 0x7f6bc41ed970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6bc40bfae0 0x7f6bc40c5260 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 --2- 172.21.15.100:0/1654693763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6bc4071220 0x7f6bc40a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 >> 172.21.15.100:0/1654693763 conn(0x7f6bc406a5e0 msgr2=0x7f6bc406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 shutdown_connections 2024-01-20T08:11:51.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.718+0000 7f6bc9600640 1 -- 172.21.15.100:0/1654693763 wait complete. 2024-01-20T08:11:51.739 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.941+0000 7ff66dc00640 1 Processor -- start 2024-01-20T08:11:51.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.941+0000 7ff66dc00640 1 -- start start 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.942+0000 7ff66dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff668153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.942+0000 7ff66dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6680aae00 0x7ff6680ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.942+0000 7ff66dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6680a9940 con 0x7ff6680a93c0 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.942+0000 7ff66dc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6681500c0 con 0x7ff6680aae00 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.942+0000 7ff66dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff668156810 con 0x7ff66814fce0 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6680aae00 0x7ff6680ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff6680aae00 0x7ff6680ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50270/0 (socket says 172.21.15.100:50270) 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 -- 172.21.15.100:0/454643144 learned_addr learned my addr 172.21.15.100:0/454643144 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff666a00640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff668153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 -- 172.21.15.100:0/454643144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 msgr2=0x7ff668153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff668153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 -- 172.21.15.100:0/454643144 >> v1:172.21.15.110:6789/0 conn(0x7ff6680a93c0 legacy=0x7ff668152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.943+0000 7ff667400640 1 -- 172.21.15.100:0/454643144 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff668156af0 con 0x7ff6680aae00 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.944+0000 7ff667400640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680aae00 0x7ff6680ab290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff660009e50 tx=0x7ff66002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b87c82830e9575 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff666000640 1 -- 172.21.15.100:0/454643144 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66002ca70 con 0x7ff6680aae00 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff666000640 1 -- 172.21.15.100:0/454643144 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66002cbd0 con 0x7ff6680aae00 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff666000640 1 -- 172.21.15.100:0/454643144 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6600343f0 con 0x7ff6680aae00 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 -- 172.21.15.100:0/454643144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680aae00 msgr2=0x7ff6680ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680aae00 0x7ff6680ab290 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff660009e50 tx=0x7ff66002bed0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 -- 172.21.15.100:0/454643144 shutdown_connections 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680aae00 0x7ff6680ab290 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 --2- 172.21.15.100:0/454643144 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff668153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.945+0000 7ff66dc00640 1 -- 172.21.15.100:0/454643144 >> 172.21.15.100:0/454643144 conn(0x7ff66806a5e0 msgr2=0x7ff66806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.946+0000 7ff66dc00640 1 -- 172.21.15.100:0/454643144 shutdown_connections 2024-01-20T08:11:51.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.946+0000 7ff66dc00640 1 -- 172.21.15.100:0/454643144 wait complete. 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.947+0000 7ff66dc00640 1 Processor -- start 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.947+0000 7ff66dc00640 1 -- start start 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6680aae00 0x7ff66814ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff66814b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6681dc090 con 0x7ff6680a93c0 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6681ede00 con 0x7ff6680aae00 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.948+0000 7ff66dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6680c5b00 con 0x7ff66814fce0 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50272/0 (socket says 172.21.15.100:50272) 2024-01-20T08:11:51.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 -- 172.21.15.100:0/2135080526 learned_addr learned my addr 172.21.15.100:0/2135080526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff65de00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6680aae00 0x7ff66814ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 -- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 msgr2=0x7ff66814b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff66814b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 -- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6680aae00 msgr2=0x7ff66814ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6680aae00 0x7ff66814ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 -- 172.21.15.100:0/2135080526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff660009b30 con 0x7ff6680a93c0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.949+0000 7ff666a00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c7f0 tx=0x7ff65800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.950+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658004220 con 0x7ff6680a93c0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.950+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff658004380 con 0x7ff6680a93c0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.950+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6681ee050 con 0x7ff6680a93c0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.950+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff658007840 con 0x7ff6680a93c0 2024-01-20T08:11:51.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.950+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6681ee610 con 0x7ff6680a93c0 2024-01-20T08:11:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.951+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6680ab7c0 con 0x7ff6680a93c0 2024-01-20T08:11:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.952+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff658007bb0 con 0x7ff6680a93c0 2024-01-20T08:11:51.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.953+0000 7ff65f400640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 0x7ff64006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:51.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.953+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7ff658089570 con 0x7ff6680a93c0 2024-01-20T08:11:51.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.953+0000 7ff65de00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 0x7ff64006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:51.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.954+0000 7ff65de00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 0x7ff64006d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6680c6710 tx=0x7ff650009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:51.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:51.957+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff6580543d0 con 0x7ff6680a93c0 2024-01-20T08:11:52.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.151+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff66804e970 con 0x7ff6680a93c0 2024-01-20T08:11:52.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.153+0000 7ff65f400640 1 -- 172.21.15.100:0/2135080526 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16625 (secure 0 0 0) 0x7ff658007e60 con 0x7ff6680a93c0 2024-01-20T08:11:52.156 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:52.156 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:49.462525+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/4185964362":"2024-01-21T08:11:46.445693+0000","172.21.15.100:6835/4185964362":"2024-01-21T08:11:46.445693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 msgr2=0x7ff64006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 0x7ff64006d390 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff6680c6710 tx=0x7ff650009040 comp rx=0 tx=0).stop 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 msgr2=0x7ff6680c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff65800c7f0 tx=0x7ff65800ccb0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 shutdown_connections 2024-01-20T08:11:52.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff64006aed0 0x7ff64006d390 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff66814fce0 0x7ff66814b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6680aae00 0x7ff66814ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 --2- 172.21.15.100:0/2135080526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6680a93c0 0x7ff6680c5260 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 >> 172.21.15.100:0/2135080526 conn(0x7ff66806a5e0 msgr2=0x7ff668153790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 shutdown_connections 2024-01-20T08:11:52.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.156+0000 7ff66dc00640 1 -- 172.21.15.100:0/2135080526 wait complete. 2024-01-20T08:11:52.178 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-20T08:11:52.178 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:52.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.380+0000 7fcd3cc00640 1 Processor -- start 2024-01-20T08:11:52.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.381+0000 7fcd3cc00640 1 -- start start 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd3cc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd3814fce0 0x7fcd38153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd38152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd3cc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd380a9940 con 0x7fcd38153440 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd3cc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd381500c0 con 0x7fcd3814fce0 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd38156810 con 0x7fcd380a93c0 2024-01-20T08:11:52.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd36800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcd38153440 0x7fcd380aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42264/0 (socket says 172.21.15.100:42264) 2024-01-20T08:11:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd36800640 1 -- 172.21.15.100:0/3430679707 learned_addr learned my addr 172.21.15.100:0/3430679707 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.382+0000 7fcd35e00640 1 --2- 172.21.15.100:0/3430679707 >> v2:172.21.15.100:3300/0 conn(0x7fcd3814fce0 0x7fcd38153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099216330 0 0) 0x7fcd380a9940 con 0x7fcd38153440 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd2d200640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd38152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd18003520 con 0x7fcd38153440 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35e00640 1 -- 172.21.15.100:0/3430679707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 msgr2=0x7fcd38152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35e00640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd38152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35e00640 1 -- 172.21.15.100:0/3430679707 >> v1:172.21.15.100:6789/0 conn(0x7fcd38153440 legacy=0x7fcd380aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3227500539 0 0) 0x7fcd18003520 con 0x7fcd38153440 2024-01-20T08:11:52.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.383+0000 7fcd35e00640 1 -- 172.21.15.100:0/3430679707 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38156af0 con 0x7fcd3814fce0 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd35e00640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd3814fce0 0x7fcd38153b80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd280097a0 tx=0x7fcd2802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ace2d46e0c62153 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300019f0 con 0x7fcd3814fce0 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2802e050 con 0x7fcd3814fce0 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd35400640 1 -- 172.21.15.100:0/3430679707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd28030730 con 0x7fcd3814fce0 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd3cc00640 1 -- 172.21.15.100:0/3430679707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd3814fce0 msgr2=0x7fcd38153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.385+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd3814fce0 0x7fcd38153b80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fcd280097a0 tx=0x7fcd2802b790 comp rx=0 tx=0).stop 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 -- 172.21.15.100:0/3430679707 shutdown_connections 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd38152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/3430679707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd3814fce0 0x7fcd38153b80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 -- 172.21.15.100:0/3430679707 >> 172.21.15.100:0/3430679707 conn(0x7fcd3806a5e0 msgr2=0x7fcd3806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 -- 172.21.15.100:0/3430679707 shutdown_connections 2024-01-20T08:11:52.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.386+0000 7fcd3cc00640 1 -- 172.21.15.100:0/3430679707 wait complete. 2024-01-20T08:11:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.387+0000 7fcd3cc00640 1 Processor -- start 2024-01-20T08:11:52.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 -- start start 2024-01-20T08:11:52.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd381ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd3814fce0 0x7fcd381e8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381471c0 con 0x7fcd38153440 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd381e8030 con 0x7fcd3814fce0 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.388+0000 7fcd3cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd380c2410 con 0x7fcd380a93c0 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50288/0 (socket says 172.21.15.100:50288) 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 -- 172.21.15.100:0/2863188199 learned_addr learned my addr 172.21.15.100:0/2863188199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 -- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 msgr2=0x7fcd381ebfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd35e00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd381ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd381ebfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 -- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd3814fce0 msgr2=0x7fcd381e8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd3814fce0 0x7fcd381e8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 -- 172.21.15.100:0/2863188199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd28009400 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.389+0000 7fcd36800640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000cc00 tx=0x7fcd3000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.390+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000ce10 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.390+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30012400 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.390+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300127b0 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.390+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd380c26f0 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.390+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd381e8240 con 0x7fcd38153440 2024-01-20T08:11:52.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.391+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd380c2c10 con 0x7fcd38153440 2024-01-20T08:11:52.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.392+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcd30012910 con 0x7fcd38153440 2024-01-20T08:11:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.393+0000 7fcd2ea00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 0x7fcd1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.393+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fcd30089d60 con 0x7fcd38153440 2024-01-20T08:11:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.393+0000 7fcd35e00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 0x7fcd1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.394+0000 7fcd35e00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 0x7fcd1006d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd28034000 tx=0x7fcd2802f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.397+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcd380c2c10 con 0x7fcd38153440 2024-01-20T08:11:52.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.635+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd380c2c10 con 0x7fcd38153440 2024-01-20T08:11:52.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.636+0000 7fcd2ea00640 1 -- 172.21.15.100:0/2863188199 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4946 (secure 0 0 0) 0x7fcd380c2c10 con 0x7fcd38153440 2024-01-20T08:11:52.639 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:52.640 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/566641086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":566641086},{"type":"v1","addr":"172.21.15.100:6837","nonce":566641086}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:52.640 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-01-20T08:11:52.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 msgr2=0x7fcd1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 0x7fcd1006d390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd28034000 tx=0x7fcd2802f000 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 msgr2=0x7fcd380c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000cc00 tx=0x7fcd3000a430 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 shutdown_connections 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd38153440 0x7fcd380c5260 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd3814fce0 0x7fcd381e8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd1006aed0 0x7fcd1006d390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 --2- 172.21.15.100:0/2863188199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd380a93c0 0x7fcd381ebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 >> 172.21.15.100:0/2863188199 conn(0x7fcd3806a5e0 msgr2=0x7fcd38155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.639+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 shutdown_connections 2024-01-20T08:11:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.640+0000 7fcd3cc00640 1 -- 172.21.15.100:0/2863188199 wait complete. 2024-01-20T08:11:52.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:11:52.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.858+0000 7f5e7e000640 1 Processor -- start 2024-01-20T08:11:52.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.858+0000 7f5e7e000640 1 -- start start 2024-01-20T08:11:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.859+0000 7f5e7e000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e780a93c0 0x7f5e78153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.859+0000 7f5e7e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.859+0000 7f5e7e000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e780a9940 con 0x7f5e7814fce0 2024-01-20T08:11:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.859+0000 7f5e7e000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e781500c0 con 0x7f5e780a93c0 2024-01-20T08:11:52.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.859+0000 7f5e7e000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78156810 con 0x7f5e780aae00 2024-01-20T08:11:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.860+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.860+0000 7f5e6fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e780a93c0 0x7f5e78153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.860+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:59634/0 (socket says 172.21.15.100:59634) 2024-01-20T08:11:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.860+0000 7f5e77e00640 1 -- 172.21.15.100:0/4189746620 learned_addr learned my addr 172.21.15.100:0/4189746620 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.861+0000 7f5e6fe00640 1 -- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 msgr2=0x7f5e780ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.861+0000 7f5e6fe00640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.861+0000 7f5e6fe00640 1 -- 172.21.15.100:0/4189746620 >> v1:172.21.15.110:6789/0 conn(0x7f5e7814fce0 legacy=0x7f5e78152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.861+0000 7f5e6fe00640 1 -- 172.21.15.100:0/4189746620 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e78156af0 con 0x7f5e780a93c0 2024-01-20T08:11:52.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.861+0000 7f5e77e00640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:11:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.862+0000 7f5e6fe00640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780a93c0 0x7f5e78153b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e600097a0 tx=0x7f5e6002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aba522e31e98fbdf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.863+0000 7f5e76a00640 1 -- 172.21.15.100:0/4189746620 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6002d040 con 0x7f5e780a93c0 2024-01-20T08:11:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.863+0000 7f5e76a00640 1 -- 172.21.15.100:0/4189746620 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e60031810 con 0x7f5e780a93c0 2024-01-20T08:11:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.863+0000 7f5e76a00640 1 -- 172.21.15.100:0/4189746620 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60031ba0 con 0x7f5e780a93c0 2024-01-20T08:11:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.863+0000 7f5e7e000640 1 -- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780a93c0 msgr2=0x7f5e78153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.863+0000 7f5e7e000640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780a93c0 0x7f5e78153b80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5e600097a0 tx=0x7f5e6002b8b0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 -- 172.21.15.100:0/4189746620 shutdown_connections 2024-01-20T08:11:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780aae00 0x7f5e780ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 --2- 172.21.15.100:0/4189746620 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780a93c0 0x7f5e78153b80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 -- 172.21.15.100:0/4189746620 >> 172.21.15.100:0/4189746620 conn(0x7f5e7806a5e0 msgr2=0x7f5e7806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 -- 172.21.15.100:0/4189746620 shutdown_connections 2024-01-20T08:11:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.864+0000 7f5e7e000640 1 -- 172.21.15.100:0/4189746620 wait complete. 2024-01-20T08:11:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.865+0000 7f5e7e000640 1 Processor -- start 2024-01-20T08:11:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.865+0000 7f5e7e000640 1 -- start start 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780a93c0 0x7f5e781ed7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780aae00 0x7f5e780c2850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e7814cd30 con 0x7f5e7814fce0 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e781ee090 con 0x7f5e780aae00 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.866+0000 7f5e7e000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e78072240 con 0x7f5e780a93c0 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50290/0 (socket says 172.21.15.100:50290) 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 -- 172.21.15.100:0/1354989795 learned_addr learned my addr 172.21.15.100:0/1354989795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e6fe00640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780aae00 0x7f5e780c2850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77400640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780a93c0 0x7f5e781ed7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 -- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780a93c0 msgr2=0x7f5e781ed7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780a93c0 0x7f5e781ed7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 -- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780aae00 msgr2=0x7f5e780c2850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780aae00 0x7f5e780c2850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 -- 172.21.15.100:0/1354989795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e70009b30 con 0x7f5e7814fce0 2024-01-20T08:11:52.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.867+0000 7f5e77e00640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000efc0 tx=0x7f5e7000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.868+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e70018070 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.868+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7000f040 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.868+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7000ce00 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.868+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e60009400 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.868+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e781ee370 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.869+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e7804e970 con 0x7f5e7814fce0 2024-01-20T08:11:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.870+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5e70014480 con 0x7f5e7814fce0 2024-01-20T08:11:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.871+0000 7f5e6f400640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 0x7f5e5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.871+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f5e70089a20 con 0x7f5e7814fce0 2024-01-20T08:11:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.871+0000 7f5e77400640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 0x7f5e5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.872+0000 7f5e77400640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 0x7f5e5006d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001500 tx=0x7f5e68009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:52.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:52.875+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5e70054880 con 0x7f5e7814fce0 2024-01-20T08:11:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.113+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e78152660 con 0x7f5e7814fce0 2024-01-20T08:11:53.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.114+0000 7f5e6f400640 1 -- 172.21.15.100:0/1354989795 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+4946 (secure 0 0 0) 0x7f5e70057ea0 con 0x7f5e7814fce0 2024-01-20T08:11:53.117 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:53.117 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":23,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":5496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/566641086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":566641086},{"type":"v1","addr":"172.21.15.100:6837","nonce":566641086}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:11:19.937659+0000","modified":"2024-01-20T08:11:23.004574+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4669},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4669":{"gid":4669,"name":"b","rank":0,"incarnation":17,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/4037788508","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":4037788508},{"type":"v1","addr":"172.21.15.110:6834","nonce":4037788508}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-01-20T08:11:53.117 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 23 2024-01-20T08:11:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 msgr2=0x7f5e5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 0x7f5e5006d390 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5e68001500 tx=0x7f5e68009040 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 msgr2=0x7f5e78070500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f5e7000efc0 tx=0x7f5e7000c490 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 shutdown_connections 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e7814fce0 0x7f5e78070500 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e780aae00 0x7f5e780c2850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e5006aed0 0x7f5e5006d390 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 --2- 172.21.15.100:0/1354989795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e780a93c0 0x7f5e781ed7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 >> 172.21.15.100:0/1354989795 conn(0x7f5e7806a5e0 msgr2=0x7f5e780c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 shutdown_connections 2024-01-20T08:11:53.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.116+0000 7f5e7e000640 1 -- 172.21.15.100:0/1354989795 wait complete. 2024-01-20T08:11:53.139 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.342+0000 7fee41600640 1 Processor -- start 2024-01-20T08:11:53.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.342+0000 7fee41600640 1 -- start start 2024-01-20T08:11:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.343+0000 7fee41600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee3c14fce0 0x7fee3c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.343+0000 7fee41600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c0a93c0 0x7fee3c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.343+0000 7fee41600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3c0a9940 con 0x7fee3c153440 2024-01-20T08:11:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.343+0000 7fee41600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3c1500c0 con 0x7fee3c14fce0 2024-01-20T08:11:53.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.343+0000 7fee41600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c156810 con 0x7fee3c0a93c0 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee3c14fce0 0x7fee3c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee3c14fce0 0x7fee3c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50300/0 (socket says 172.21.15.100:50300) 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 -- 172.21.15.100:0/4235862217 learned_addr learned my addr 172.21.15.100:0/4235862217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee33e00640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c0a93c0 0x7fee3c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 -- 172.21.15.100:0/4235862217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c0a93c0 msgr2=0x7fee3c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c0a93c0 0x7fee3c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 -- 172.21.15.100:0/4235862217 >> v1:172.21.15.110:6789/0 conn(0x7fee3c153440 legacy=0x7fee3c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:53.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.344+0000 7fee3aa00640 1 -- 172.21.15.100:0/4235862217 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3c156af0 con 0x7fee3c14fce0 2024-01-20T08:11:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.345+0000 7fee3aa00640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c14fce0 0x7fee3c153b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009870 tx=0x7fee2c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f628f4369cd249e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee3a000640 1 -- 172.21.15.100:0/4235862217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c031640 con 0x7fee3c14fce0 2024-01-20T08:11:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee3a000640 1 -- 172.21.15.100:0/4235862217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c0317a0 con 0x7fee3c14fce0 2024-01-20T08:11:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee3a000640 1 -- 172.21.15.100:0/4235862217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c031b30 con 0x7fee3c14fce0 2024-01-20T08:11:53.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 -- 172.21.15.100:0/4235862217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c14fce0 msgr2=0x7fee3c153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c14fce0 0x7fee3c153b80 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009870 tx=0x7fee2c02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 -- 172.21.15.100:0/4235862217 shutdown_connections 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c0a93c0 0x7fee3c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 --2- 172.21.15.100:0/4235862217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c14fce0 0x7fee3c153b80 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 -- 172.21.15.100:0/4235862217 >> 172.21.15.100:0/4235862217 conn(0x7fee3c06a5e0 msgr2=0x7fee3c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:53.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 -- 172.21.15.100:0/4235862217 shutdown_connections 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.346+0000 7fee41600640 1 -- 172.21.15.100:0/4235862217 wait complete. 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.348+0000 7fee41600640 1 Processor -- start 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.348+0000 7fee41600640 1 -- start start 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 0x7fee3c144570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 0x7fee3c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c1ed940 con 0x7fee3c0a93c0 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c071be0 con 0x7fee3c153440 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee41600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3c071ec0 con 0x7fee3c14fce0 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee3aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee3aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50314/0 (socket says 172.21.15.100:50314) 2024-01-20T08:11:53.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.349+0000 7fee3aa00640 1 -- 172.21.15.100:0/1967036872 learned_addr learned my addr 172.21.15.100:0/1967036872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee33e00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 0x7fee3c144570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3b400640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 0x7fee3c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 -- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 msgr2=0x7fee3c144570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 0x7fee3c144570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 -- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 msgr2=0x7fee3c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 0x7fee3c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 -- 172.21.15.100:0/1967036872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c0094d0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee33e00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 0x7fee3c144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3b400640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 0x7fee3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee3aa00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009870 tx=0x7fee2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c03ac60 con 0x7fee3c0a93c0 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2c03ade0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2c044630 con 0x7fee3c0a93c0 2024-01-20T08:11:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.350+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3c0721a0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.351+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3c14af40 con 0x7fee3c0a93c0 2024-01-20T08:11:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.352+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3c0c70a0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.353+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fee2c02f050 con 0x7fee3c0a93c0 2024-01-20T08:11:53.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.353+0000 7fee32a00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 0x7fee1406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.354+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fee2c0ab8f0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.354+0000 7fee33e00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 0x7fee1406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.354+0000 7fee33e00640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 0x7fee1406d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee3c14ac30 tx=0x7fee24008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.358+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fee2c076630 con 0x7fee3c0a93c0 2024-01-20T08:11:53.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.549+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee3c0723b0 con 0x7fee3c0a93c0 2024-01-20T08:11:53.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.552+0000 7fee32a00640 1 -- 172.21.15.100:0/1967036872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16625 (secure 0 0 0) 0x7fee2c035020 con 0x7fee3c0a93c0 2024-01-20T08:11:53.555 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:53.555 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:49.462525+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:11:18.055571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:11:18.935347+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/4185964362":"2024-01-21T08:11:46.445693+0000","172.21.15.100:6835/4185964362":"2024-01-21T08:11:46.445693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:53.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 msgr2=0x7fee1406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 0x7fee1406d3c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fee3c14ac30 tx=0x7fee24008040 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 msgr2=0x7fee3c1ea1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fee2c009870 tx=0x7fee2c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 shutdown_connections 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee3c153440 0x7fee3c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee1406af00 0x7fee1406d3c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee3c14fce0 0x7fee3c144570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 --2- 172.21.15.100:0/1967036872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee3c0a93c0 0x7fee3c1ea1a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.554+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 >> 172.21.15.100:0/1967036872 conn(0x7fee3c06a5e0 msgr2=0x7fee3c0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.555+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 shutdown_connections 2024-01-20T08:11:53.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.555+0000 7fee41600640 1 -- 172.21.15.100:0/1967036872 wait complete. 2024-01-20T08:11:53.577 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-20T08:11:53.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.777+0000 7f9a00400640 1 Processor -- start 2024-01-20T08:11:53.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.777+0000 7f9a00400640 1 -- start start 2024-01-20T08:11:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.778+0000 7f9a00400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f81515b0 0x7f99f806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.778+0000 7f9a00400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99f806ce10 0x7f99f815bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.778+0000 7f9a00400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99f8154ba0 con 0x7f99f814b720 2024-01-20T08:11:53.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.778+0000 7f9a00400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99f814bb00 con 0x7f99f806ce10 2024-01-20T08:11:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.778+0000 7f9a00400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8155a00 con 0x7f99f81515b0 2024-01-20T08:11:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99f806ce10 0x7f99f815bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f99f806ce10 0x7f99f815bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50318/0 (socket says 172.21.15.100:50318) 2024-01-20T08:11:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 -- 172.21.15.100:0/866728947 learned_addr learned my addr 172.21.15.100:0/866728947 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:53.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fd000640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f81515b0 0x7f99f806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 -- 172.21.15.100:0/866728947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f81515b0 msgr2=0x7f99f806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f81515b0 0x7f99f806c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 -- 172.21.15.100:0/866728947 >> v1:172.21.15.110:6789/0 conn(0x7f99f814b720 legacy=0x7f99f80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.779+0000 7f99fe400640 1 -- 172.21.15.100:0/866728947 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f8154df0 con 0x7f99f806ce10 2024-01-20T08:11:53.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.780+0000 7f99fe400640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f806ce10 0x7f99f815bf30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009e50 tx=0x7f99f002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d19aeafcdd150d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.780+0000 7f99f7e00640 1 -- 172.21.15.100:0/866728947 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f002c9e0 con 0x7f99f806ce10 2024-01-20T08:11:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f99f7e00640 1 -- 172.21.15.100:0/866728947 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f002cb40 con 0x7f99f806ce10 2024-01-20T08:11:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f99f7e00640 1 -- 172.21.15.100:0/866728947 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f00343f0 con 0x7f99f806ce10 2024-01-20T08:11:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 -- 172.21.15.100:0/866728947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f806ce10 msgr2=0x7f99f815bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f806ce10 0x7f99f815bf30 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f99f0009e50 tx=0x7f99f002be40 comp rx=0 tx=0).stop 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 -- 172.21.15.100:0/866728947 shutdown_connections 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f806ce10 0x7f99f815bf30 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 --2- 172.21.15.100:0/866728947 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f81515b0 0x7f99f806c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 -- 172.21.15.100:0/866728947 >> 172.21.15.100:0/866728947 conn(0x7f99f80c2940 msgr2=0x7f99f80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 -- 172.21.15.100:0/866728947 shutdown_connections 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.781+0000 7f9a00400640 1 -- 172.21.15.100:0/866728947 wait complete. 2024-01-20T08:11:53.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.783+0000 7f9a00400640 1 Processor -- start 2024-01-20T08:11:53.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.783+0000 7f9a00400640 1 -- start start 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f806ce10 0x7f99f80c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f814b720 0x7f99f8153160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8145d30 con 0x7f99f81515b0 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99f81441e0 con 0x7f99f806ce10 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f9a00400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99f8153b60 con 0x7f99f814b720 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f99fe400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f99fe400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50332/0 (socket says 172.21.15.100:50332) 2024-01-20T08:11:53.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f99fe400640 1 -- 172.21.15.100:0/3693811354 learned_addr learned my addr 172.21.15.100:0/3693811354 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:53.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.784+0000 7f99fe400640 1 -- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f814b720 msgr2=0x7f99f8153160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99fe400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f814b720 0x7f99f8153160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99fe400640 1 -- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f806ce10 msgr2=0x7f99f80c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99fe400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f806ce10 0x7f99f80c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99fe400640 1 -- 172.21.15.100:0/3693811354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99f0009b30 con 0x7f99f81515b0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99fe400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f99f0036040 tx=0x7f99f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f003e450 con 0x7f99f81515b0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f003e5d0 con 0x7f99f81515b0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99f8153e40 con 0x7f99f81515b0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f003e980 con 0x7f99f81515b0 2024-01-20T08:11:53.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.785+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99f8143e70 con 0x7f99f81515b0 2024-01-20T08:11:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.786+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99f8143cd0 con 0x7f99f81515b0 2024-01-20T08:11:53.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.787+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f99f003eae0 con 0x7f99f81515b0 2024-01-20T08:11:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.788+0000 7f99f5600640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 0x7f99d006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.788+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f99f00ac540 con 0x7f99f81515b0 2024-01-20T08:11:53.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.788+0000 7f99fda00640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 0x7f99d006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:53.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.789+0000 7f99fda00640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 0x7f99d006d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99e8003cc0 tx=0x7f99e80079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:53.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:53.793+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f99f8143cd0 con 0x7f99f81515b0 2024-01-20T08:11:54.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.025+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f99f8143cd0 con 0x7f99f81515b0 2024-01-20T08:11:54.029 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:11:54.026+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:11:54.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.030+0000 7f99f5600640 1 -- 172.21.15.100:0/3693811354 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) v1 ==== 163+0+0 (secure 0 0 0) 0x7f99f8143cd0 con 0x7f99f81515b0 2024-01-20T08:11:54.033 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 msgr2=0x7f99d006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 0x7f99d006d390 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f99e8003cc0 tx=0x7f99e80079b0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 msgr2=0x7f99f8134560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f99f0036040 tx=0x7f99f0004a40 comp rx=0 tx=0).stop 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 shutdown_connections 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99f81515b0 0x7f99f8134560 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f99d006aed0 0x7f99d006d390 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99f814b720 0x7f99f8153160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 --2- 172.21.15.100:0/3693811354 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f99f806ce10 0x7f99f80c5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 >> 172.21.15.100:0/3693811354 conn(0x7f99f80c2940 msgr2=0x7f99f8146e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 shutdown_connections 2024-01-20T08:11:54.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.033+0000 7f9a00400640 1 -- 172.21.15.100:0/3693811354 wait complete. 2024-01-20T08:11:54.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-20T08:11:54.058 INFO:tasks.ceph.mds.b.smithi110.stderr: -2277> 2024-01-20T08:11:21.781+0000 7fbe35e00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:11:54.136 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:11:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.263+0000 7fef8d800640 1 Processor -- start 2024-01-20T08:11:54.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.263+0000 7fef8d800640 1 -- start start 2024-01-20T08:11:54.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.264+0000 7fef8d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef8814fc10 0x7fef880a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.264+0000 7fef8d800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fef880a5240 0x7fef880c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.264+0000 7fef8d800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef88156710 con 0x7fef880c4ed0 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.264+0000 7fef8d800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8814fff0 con 0x7fef880a5240 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.264+0000 7fef8d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88072d10 con 0x7fef8814fc10 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef7f200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fef880c4ed0 0x7fef880c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42272/0 (socket says 172.21.15.100:42272) 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef7f200640 1 -- 172.21.15.100:0/2972478725 learned_addr learned my addr 172.21.15.100:0/2972478725 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef87e00640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef8814fc10 0x7fef880a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:54.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef8ce00640 1 --2- 172.21.15.100:0/2972478725 >> v2:172.21.15.110:3300/0 conn(0x7fef880a5240 0x7fef880c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691877393 0 0) 0x7fef88156710 con 0x7fef880c4ed0 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.265+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef68003520 con 0x7fef880c4ed0 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.266+0000 7fef8ce00640 1 -- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef8814fc10 msgr2=0x7fef880a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.266+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2723482814 0 0) 0x7fef68003520 con 0x7fef880c4ed0 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.266+0000 7fef8ce00640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef8814fc10 0x7fef880a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.266+0000 7fef8ce00640 1 -- 172.21.15.100:0/2972478725 >> v1:172.21.15.100:6789/0 conn(0x7fef880c4ed0 legacy=0x7fef880c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.266+0000 7fef8ce00640 1 -- 172.21.15.100:0/2972478725 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef88155b00 con 0x7fef880a5240 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.267+0000 7fef8ce00640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef880a5240 0x7fef880c41b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef80009d90 tx=0x7fef8002bce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91bf30eaf786ef0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.267+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70001670 con 0x7fef880a5240 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.267+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8002c810 con 0x7fef880a5240 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.267+0000 7fef87400640 1 -- 172.21.15.100:0/2972478725 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8002cba0 con 0x7fef880a5240 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 -- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef880a5240 msgr2=0x7fef880c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef880a5240 0x7fef880c41b0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fef80009d90 tx=0x7fef8002bce0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 -- 172.21.15.100:0/2972478725 shutdown_connections 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef880a5240 0x7fef880c41b0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 --2- 172.21.15.100:0/2972478725 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef8814fc10 0x7fef880a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 -- 172.21.15.100:0/2972478725 >> 172.21.15.100:0/2972478725 conn(0x7fef880c5ba0 msgr2=0x7fef880c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 -- 172.21.15.100:0/2972478725 shutdown_connections 2024-01-20T08:11:54.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.268+0000 7fef8d800640 1 -- 172.21.15.100:0/2972478725 wait complete. 2024-01-20T08:11:54.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.270+0000 7fef8d800640 1 Processor -- start 2024-01-20T08:11:54.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.270+0000 7fef8d800640 1 -- start start 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.270+0000 7fef8d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef8d800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef880c4ed0 0x7fef881eb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef8d800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef8814fc10 0x7fef881eba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef8d800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881ee230 con 0x7fef880a5240 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef8d800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef881ed640 con 0x7fef8814fc10 2024-01-20T08:11:54.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef8d800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef88154250 con 0x7fef880c4ed0 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50338/0 (socket says 172.21.15.100:50338) 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 -- 172.21.15.100:0/2979476240 learned_addr learned my addr 172.21.15.100:0/2979476240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 -- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef880c4ed0 msgr2=0x7fef881eb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef880c4ed0 0x7fef881eb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 -- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef8814fc10 msgr2=0x7fef881eba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef8814fc10 0x7fef881eba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.271+0000 7fef87e00640 1 -- 172.21.15.100:0/2979476240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef80009a70 con 0x7fef880a5240 2024-01-20T08:11:54.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef87e00640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef7800e870 tx=0x7fef7800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780094f0 con 0x7fef880a5240 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7800c940 con 0x7fef880a5240 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef881ed900 con 0x7fef880a5240 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7800ccf0 con 0x7fef880a5240 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.272+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef881edec0 con 0x7fef880a5240 2024-01-20T08:11:54.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.273+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8804e970 con 0x7fef880a5240 2024-01-20T08:11:54.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.274+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fef78013470 con 0x7fef880a5240 2024-01-20T08:11:54.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.275+0000 7fef84c00640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 0x7fef6006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:54.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.275+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fef78089720 con 0x7fef880a5240 2024-01-20T08:11:54.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.276+0000 7fef7f200640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 0x7fef6006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:54.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.276+0000 7fef7f200640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 0x7fef6006d3e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef700011e0 tx=0x7fef70001a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:54.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.280+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fef78054620 con 0x7fef880a5240 2024-01-20T08:11:54.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:54.513+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fef880aa280 con 0x7fef880a5240 2024-01-20T08:11:55.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.033+0000 7fef84c00640 1 -- 172.21.15.100:0/2979476240 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v25) v1 ==== 105+0+0 (secure 0 0 0) 0x7fef7805e070 con 0x7fef880a5240 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.037+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 msgr2=0x7fef6006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 0x7fef6006d3e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fef700011e0 tx=0x7fef70001a00 comp rx=0 tx=0).stop 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 msgr2=0x7fef881505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fef7800e870 tx=0x7fef7800ed30 comp rx=0 tx=0).stop 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 shutdown_connections 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fef8814fc10 0x7fef881eba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fef6006af20 0x7fef6006d3e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fef880c4ed0 0x7fef881eb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 --2- 172.21.15.100:0/2979476240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fef880a5240 0x7fef881505b0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 >> 172.21.15.100:0/2979476240 conn(0x7fef880c5ba0 msgr2=0x7fef88154d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 shutdown_connections 2024-01-20T08:11:55.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.038+0000 7fef8d800640 1 -- 172.21.15.100:0/2979476240 wait complete. 2024-01-20T08:11:55.061 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-20T08:11:55.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.271+0000 7f23bbe00640 1 Processor -- start 2024-01-20T08:11:55.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.271+0000 7f23bbe00640 1 -- start start 2024-01-20T08:11:55.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23bbe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23b40c4ae0 0x7f23b4154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b415f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23bbe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b40c8f50 con 0x7f23b40c4ec0 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23bbe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b40c9af0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23bbe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40c5320 con 0x7f23b406b520 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23b9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23b40c4ae0 0x7f23b4154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23b9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f23b40c4ae0 0x7f23b4154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50348/0 (socket says 172.21.15.100:50348) 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23b8a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f23b40c4ec0 0x7f23b40c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42278/0 (socket says 172.21.15.100:42278) 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.273+0000 7f23b9400640 1 -- 172.21.15.100:0/2917080168 learned_addr learned my addr 172.21.15.100:0/2917080168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.274+0000 7f23b9e00640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b415f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.274+0000 7f23b9400640 1 -- 172.21.15.100:0/2917080168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 msgr2=0x7f23b415f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.274+0000 7f23b9400640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b415f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.274+0000 7f23b9400640 1 -- 172.21.15.100:0/2917080168 >> v1:172.21.15.100:6789/0 conn(0x7f23b40c4ec0 legacy=0x7f23b40c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.274+0000 7f23b9400640 1 -- 172.21.15.100:0/2917080168 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b406b9b0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.275+0000 7f23b9400640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b4154850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dceac906021be0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.275+0000 7f23b3e00640 1 -- 172.21.15.100:0/2917080168 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a402ca70 con 0x7f23b40c4ae0 2024-01-20T08:11:55.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.275+0000 7f23b3e00640 1 -- 172.21.15.100:0/2917080168 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a402cbd0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.275+0000 7f23b3e00640 1 -- 172.21.15.100:0/2917080168 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40343f0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 -- 172.21.15.100:0/2917080168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 msgr2=0x7f23b4154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b4154850 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009e50 tx=0x7f23a402bed0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 -- 172.21.15.100:0/2917080168 shutdown_connections 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b415f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 --2- 172.21.15.100:0/2917080168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b4154850 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 -- 172.21.15.100:0/2917080168 >> 172.21.15.100:0/2917080168 conn(0x7f23b40ca160 msgr2=0x7f23b40ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 -- 172.21.15.100:0/2917080168 shutdown_connections 2024-01-20T08:11:55.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.276+0000 7f23bbe00640 1 -- 172.21.15.100:0/2917080168 wait complete. 2024-01-20T08:11:55.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.278+0000 7f23bbe00640 1 Processor -- start 2024-01-20T08:11:55.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.278+0000 7f23bbe00640 1 -- start start 2024-01-20T08:11:55.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.278+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b41edc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.278+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23bbe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23b40c4ec0 0x7f23b4157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23bbe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40c3af0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23bbe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40c2d30 con 0x7f23b40c4ec0 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23bbe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40c3010 con 0x7f23b406b520 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50350/0 (socket says 172.21.15.100:50350) 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 -- 172.21.15.100:0/1929993198 learned_addr learned my addr 172.21.15.100:0/1929993198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 -- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 msgr2=0x7f23b41edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b41edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 -- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23b40c4ec0 msgr2=0x7f23b4157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23b40c4ec0 0x7f23b4157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 -- 172.21.15.100:0/1929993198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a4009b30 con 0x7f23b40c4ae0 2024-01-20T08:11:55.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.279+0000 7f23b8a00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c400 tx=0x7f239c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.280+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c0074e0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.280+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f239c007640 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.280+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b40c32f0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.280+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239c004a00 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.280+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b41ee8a0 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.281+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b40c3810 con 0x7f23b40c4ae0 2024-01-20T08:11:55.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.282+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f239c004b60 con 0x7f23b40c4ae0 2024-01-20T08:11:55.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.282+0000 7f23b1600640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 0x7f238c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.282+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f239c089060 con 0x7f23b40c4ae0 2024-01-20T08:11:55.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.283+0000 7f23b9400640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 0x7f238c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.283+0000 7f23b9400640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 0x7f238c06d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23a4035000 tx=0x7f23a402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.287+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f23b40c3810 con 0x7f23b40c4ae0 2024-01-20T08:11:55.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.484+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f23b40c3810 con 0x7f23b40c4ae0 2024-01-20T08:11:55.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.521+0000 7f23b1600640 1 -- 172.21.15.100:0/1929993198 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v43) v1 ==== 184+0+0 (secure 0 0 0) 0x7f23b40c3810 con 0x7f23b40c4ae0 2024-01-20T08:11:55.524 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' removed 2024-01-20T08:11:55.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 msgr2=0x7f238c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 0x7f238c06d390 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f23a4035000 tx=0x7f23a402e000 comp rx=0 tx=0).stop 2024-01-20T08:11:55.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 msgr2=0x7f23b41ee1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f239c00c400 tx=0x7f239c00c8c0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 shutdown_connections 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23b40c4ec0 0x7f23b4157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23b40c4ae0 0x7f23b41ee1b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f238c06aed0 0x7f238c06d390 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 --2- 172.21.15.100:0/1929993198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23b406b520 0x7f23b41edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.523+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 >> 172.21.15.100:0/1929993198 conn(0x7f23b40ca160 msgr2=0x7f23b40ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:55.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.524+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 shutdown_connections 2024-01-20T08:11:55.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.525+0000 7f23bbe00640 1 -- 172.21.15.100:0/1929993198 wait complete. 2024-01-20T08:11:55.553 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-20T08:11:55.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.739+0000 7fa3b7200640 1 Processor -- start 2024-01-20T08:11:55.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.739+0000 7fa3b7200640 1 -- start start 2024-01-20T08:11:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.740+0000 7fa3b7200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa3b00c1a10 0x7fa3b006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.740+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 0x7fa3b01595f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.740+0000 7fa3b7200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b0159b30 con 0x7fa3b0070150 2024-01-20T08:11:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.740+0000 7fa3b7200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b0072340 con 0x7fa3b00c1a10 2024-01-20T08:11:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.740+0000 7fa3b7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b006e260 con 0x7fa3b00c1df0 2024-01-20T08:11:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3b5200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa3b0070150 0x7fa3b015c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42290/0 (socket says 172.21.15.100:42290) 2024-01-20T08:11:55.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3b5200640 1 -- 172.21.15.100:0/2235131208 learned_addr learned my addr 172.21.15.100:0/2235131208 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3afe00640 1 --2- 172.21.15.100:0/2235131208 >> v2:172.21.15.110:3300/0 conn(0x7fa3b00c1a10 0x7fa3b006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3af400640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 0x7fa3b01595f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417173242 0 0) 0x7fa3b0159b30 con 0x7fa3b0070150 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.741+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa390003520 con 0x7fa3b0070150 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 614114075 0 0) 0x7fa390003520 con 0x7fa3b0070150 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 msgr2=0x7fa3b01595f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 0x7fa3b01595f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 >> v2:172.21.15.110:3300/0 conn(0x7fa3b00c1a10 msgr2=0x7fa3b006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 --2- 172.21.15.100:0/2235131208 >> v2:172.21.15.110:3300/0 conn(0x7fa3b00c1a10 0x7fa3b006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00c2250 con 0x7fa3b0070150 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fa3a8001670 con 0x7fa3b0070150 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 >> v1:172.21.15.100:6789/0 conn(0x7fa3b0070150 legacy=0x7fa3b015c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa390003970 0x7fa390003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3900047c0 0x7fa390004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 0x7fa390005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b006e260 con 0x7fa3900047c0 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39000b980 con 0x7fa390003970 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa39000bac0 con 0x7fa3b00c1df0 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3900047c0 0x7fa390004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 -- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 msgr2=0x7fa390005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b00c1df0 0x7fa390005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 -- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa390003970 msgr2=0x7fa390003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa390003970 0x7fa390003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.742+0000 7fa3af400640 1 -- 172.21.15.100:0/2235131208 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa390003520 con 0x7fa3900047c0 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.743+0000 7fa3af400640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3900047c0 0x7fa390004c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa398009a90 tx=0x7fa3900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2079846591e0da73 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802c6b0 con 0x7fa3900047c0 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39802c810 con 0x7fa3900047c0 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3aea00640 1 -- 172.21.15.100:0/2235131208 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39802cbc0 con 0x7fa3900047c0 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3b7200640 1 -- 172.21.15.100:0/2235131208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3900047c0 msgr2=0x7fa390004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2235131208 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3900047c0 0x7fa390004c40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fa398009a90 tx=0x7fa3900057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3b5200640 1 -- 172.21.15.100:0/2235131208 reap_dead start 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3b7200640 1 -- 172.21.15.100:0/2235131208 shutdown_connections 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.744+0000 7fa3b7200640 1 -- 172.21.15.100:0/2235131208 >> 172.21.15.100:0/2235131208 conn(0x7fa3b00c2b00 msgr2=0x7fa3b00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.745+0000 7fa3b7200640 1 -- 172.21.15.100:0/2235131208 shutdown_connections 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.745+0000 7fa3b7200640 1 -- 172.21.15.100:0/2235131208 wait complete. 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.746+0000 7fa3b7200640 1 Processor -- start 2024-01-20T08:11:55.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.746+0000 7fa3b7200640 1 -- start start 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3900047c0 0x7fa3b00c5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b01571a0 0x7fa3b0146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0159b30 con 0x7fa3b01526e0 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b01eea20 con 0x7fa3900047c0 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.747+0000 7fa3b7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0159850 con 0x7fa3b01571a0 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50364/0 (socket says 172.21.15.100:50364) 2024-01-20T08:11:55.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 -- 172.21.15.100:0/2652000576 learned_addr learned my addr 172.21.15.100:0/2652000576 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3afe00640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3900047c0 0x7fa3b00c5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3b5200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b01571a0 0x7fa3b0146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 -- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b01571a0 msgr2=0x7fa3b0146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b01571a0 0x7fa3b0146630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 -- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3900047c0 msgr2=0x7fa3b00c5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3900047c0 0x7fa3b00c5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 -- 172.21.15.100:0/2652000576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0156ad0 con 0x7fa3b01526e0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.748+0000 7fa3af400640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa398037040 tx=0x7fa398004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.749+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398034b80 con 0x7fa3b01526e0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.749+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa398034d00 con 0x7fa3b01526e0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.749+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa398040690 con 0x7fa3b01526e0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.749+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b0156db0 con 0x7fa3b01526e0 2024-01-20T08:11:55.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.749+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b00c5560 con 0x7fa3b01526e0 2024-01-20T08:11:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.750+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b014ceb0 con 0x7fa3b01526e0 2024-01-20T08:11:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.751+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa3980407f0 con 0x7fa3b01526e0 2024-01-20T08:11:55.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.752+0000 7fa3a7e00640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 0x7fa38806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.752+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5503+0+0 (secure 0 0 0) 0x7fa3980ab6d0 con 0x7fa3b01526e0 2024-01-20T08:11:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.752+0000 7fa3afe00640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 0x7fa38806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:55.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.752+0000 7fa3afe00640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 0x7fa38806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0007520 tx=0x7fa3a000b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:55.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.756+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa3980766e0 con 0x7fa3b01526e0 2024-01-20T08:11:55.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:55.938+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3b01eeb90 con 0x7fa3b01526e0 2024-01-20T08:11:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.523+0000 7fa3a7e00640 1 -- 172.21.15.100:0/2652000576 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v44) v1 ==== 172+0+0 (secure 0 0 0) 0x7fa398079d00 con 0x7fa3b01526e0 2024-01-20T08:11:56.527 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' removed 2024-01-20T08:11:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 msgr2=0x7fa38806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 0x7fa38806d390 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0007520 tx=0x7fa3a000b040 comp rx=0 tx=0).stop 2024-01-20T08:11:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 msgr2=0x7fa3b01460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fa398037040 tx=0x7fa398004730 comp rx=0 tx=0).stop 2024-01-20T08:11:56.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 shutdown_connections 2024-01-20T08:11:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa38806aed0 0x7fa38806d390 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa3b01571a0 0x7fa3b0146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa3b01526e0 0x7fa3b01460f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 --2- 172.21.15.100:0/2652000576 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa3900047c0 0x7fa3b00c5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.527+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 >> 172.21.15.100:0/2652000576 conn(0x7fa3b00c2b00 msgr2=0x7fa3b0071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:56.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.530+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 shutdown_connections 2024-01-20T08:11:56.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.531+0000 7fa3b7200640 1 -- 172.21.15.100:0/2652000576 wait complete. 2024-01-20T08:11:56.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-20T08:11:56.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.736+0000 7f9618800640 1 Processor -- start 2024-01-20T08:11:56.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.737+0000 7f9618800640 1 -- start start 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9618800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f961015dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9618800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9610150190 con 0x7f96100c3460 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9618800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96100a8810 con 0x7f961014fdb0 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9618800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96100a9ce0 con 0x7f96101532f0 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9615400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f96100c3460 0x7f9610152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42302/0 (socket says 172.21.15.100:42302) 2024-01-20T08:11:56.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.738+0000 7f9615400640 1 -- 172.21.15.100:0/2517600664 learned_addr learned my addr 172.21.15.100:0/2517600664 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9616800640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f961015dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3014390903 0 0) 0x7f9610150190 con 0x7f96100c3460 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f0003520 con 0x7f96100c3460 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 71141271 0 0) 0x7f95f0003520 con 0x7f96100c3460 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 msgr2=0x7f961015dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f961015dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 >> v1:172.21.15.110:6789/0 conn(0x7f961014fdb0 legacy=0x7f96100c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96100a8df0 con 0x7f96100c3460 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f95f8001670 con 0x7f96100c3460 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 >> v1:172.21.15.100:6789/0 conn(0x7f96100c3460 legacy=0x7f9610152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f95f0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f000ba30 con 0x7f95f00047c0 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f000bba0 con 0x7f95f00039a0 2024-01-20T08:11:56.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.739+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f000bd60 con 0x7f96101532f0 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615e00640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9616800640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f95f0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 -- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 msgr2=0x7f95f0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f96101532f0 0x7f95f0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 -- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00039a0 msgr2=0x7f95f0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00039a0 0x7f95f0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.740+0000 7f9615400640 1 -- 172.21.15.100:0/2517600664 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f0003520 con 0x7f95f00047c0 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.741+0000 7f9615400640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c210 tx=0x7f95f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a552ccb028aff1a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f8005ad0 con 0x7f95f00047c0 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f8005c50 con 0x7f95f00047c0 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9614a00640 1 -- 172.21.15.100:0/2517600664 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f802c870 con 0x7f95f00047c0 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 -- 172.21.15.100:0/2517600664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95f00047c0 msgr2=0x7f95f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 --2- 172.21.15.100:0/2517600664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95f00047c0 0x7f95f0004c40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f95f800c210 tx=0x7f95f00057f0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9616800640 1 -- 172.21.15.100:0/2517600664 reap_dead start 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 -- 172.21.15.100:0/2517600664 shutdown_connections 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 -- 172.21.15.100:0/2517600664 >> 172.21.15.100:0/2517600664 conn(0x7f96100c2940 msgr2=0x7f96100c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 -- 172.21.15.100:0/2517600664 shutdown_connections 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.742+0000 7f9618800640 1 -- 172.21.15.100:0/2517600664 wait complete. 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.744+0000 7f9618800640 1 Processor -- start 2024-01-20T08:11:56.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.744+0000 7f9618800640 1 -- start start 2024-01-20T08:11:56.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00047c0 0x7f96100c1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961006df60 0x7f9610142420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961006db50 con 0x7f96100c1c70 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9610150640 con 0x7f95f00047c0 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9618800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9610071d70 con 0x7f961006df60 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9616800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9616800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50382/0 (socket says 172.21.15.100:50382) 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.745+0000 7f9616800640 1 -- 172.21.15.100:0/2843475301 learned_addr learned my addr 172.21.15.100:0/2843475301 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9615e00640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00047c0 0x7f96100c1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9615400640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961006df60 0x7f9610142420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 -- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961006df60 msgr2=0x7f9610142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961006df60 0x7f9610142420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 -- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00047c0 msgr2=0x7f96100c1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00047c0 0x7f96100c1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 -- 172.21.15.100:0/2843475301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9610072050 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9616800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f96101536d0 tx=0x7f96080115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e070 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9608011ed0 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9608003990 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.746+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961006d2b0 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.747+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961006d870 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.748+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96101ed100 con 0x7f96100c1c70 2024-01-20T08:11:56.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.749+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9608003b10 con 0x7f96100c1c70 2024-01-20T08:11:56.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.749+0000 7f960e000640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 0x7f95e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:56.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.750+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f9608089a80 con 0x7f96100c1c70 2024-01-20T08:11:56.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.750+0000 7f9615e00640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 0x7f95e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:56.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.750+0000 7f9615e00640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 0x7f95e806d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9600005490 tx=0x7f9600009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:56.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.754+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f96101ed100 con 0x7f96100c1c70 2024-01-20T08:11:56.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.940+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f96101ed100 con 0x7f96100c1c70 2024-01-20T08:11:56.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.944+0000 7f960e000640 1 -- 172.21.15.100:0/2843475301 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96101ed100 con 0x7f96100c1c70 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 msgr2=0x7f95e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 0x7f95e806d3c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9600005490 tx=0x7f9600009040 comp rx=0 tx=0).stop 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 msgr2=0x7f9610142960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f96101536d0 tx=0x7f96080115a0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 shutdown_connections 2024-01-20T08:11:56.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f96100c1c70 0x7f9610142960 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f95e806af00 0x7f95e806d3c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f961006df60 0x7f9610142420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 --2- 172.21.15.100:0/2843475301 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95f00047c0 0x7f96100c1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 >> 172.21.15.100:0/2843475301 conn(0x7f96100c2940 msgr2=0x7f961014dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 shutdown_connections 2024-01-20T08:11:56.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:56.947+0000 7f9618800640 1 -- 172.21.15.100:0/2843475301 wait complete. 2024-01-20T08:11:56.969 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent' 2024-01-20T08:11:57.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.159+0000 7f0faae00640 1 Processor -- start 2024-01-20T08:11:57.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.160+0000 7f0faae00640 1 -- start start 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0faae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fa414fc10 0x7f0fa40a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0faae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0fa40c4ed0 0x7f0fa40c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0faae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa4156710 con 0x7f0fa40a5240 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0faae00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa414fff0 con 0x7f0fa414fc10 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0faae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa4072d10 con 0x7f0fa40c4ed0 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0fa9a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fa414fc10 0x7f0fa40a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0fa9a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0fa414fc10 0x7f0fa40a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50390/0 (socket says 172.21.15.100:50390) 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.161+0000 7f0fa9a00640 1 -- 172.21.15.100:0/101433872 learned_addr learned my addr 172.21.15.100:0/101433872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.162+0000 7f0fa9000640 1 --2- 172.21.15.100:0/101433872 >> v2:172.21.15.110:3300/0 conn(0x7f0fa40c4ed0 0x7f0fa40c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.162+0000 7f0fa9a00640 1 -- 172.21.15.100:0/101433872 >> v2:172.21.15.110:3300/0 conn(0x7f0fa40c4ed0 msgr2=0x7f0fa40c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.162+0000 7f0fa9a00640 1 --2- 172.21.15.100:0/101433872 >> v2:172.21.15.110:3300/0 conn(0x7f0fa40c4ed0 0x7f0fa40c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.162+0000 7f0fa9a00640 1 -- 172.21.15.100:0/101433872 >> v1:172.21.15.110:6789/0 conn(0x7f0fa40a5240 legacy=0x7f0fa40c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:57.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.162+0000 7f0fa9a00640 1 -- 172.21.15.100:0/101433872 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa4155b00 con 0x7f0fa414fc10 2024-01-20T08:11:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.163+0000 7f0fa9a00640 1 --2- 172.21.15.100:0/101433872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa414fc10 0x7f0fa40a4d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0fa406e370 tx=0x7f0f9402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9888e5102512d8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0fa3e00640 1 -- 172.21.15.100:0/101433872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f940317e0 con 0x7f0fa414fc10 2024-01-20T08:11:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0fa3e00640 1 -- 172.21.15.100:0/101433872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94031940 con 0x7f0fa414fc10 2024-01-20T08:11:57.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0fa3e00640 1 -- 172.21.15.100:0/101433872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94031cd0 con 0x7f0fa414fc10 2024-01-20T08:11:57.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 -- 172.21.15.100:0/101433872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa414fc10 msgr2=0x7f0fa40a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 --2- 172.21.15.100:0/101433872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa414fc10 0x7f0fa40a4d00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f0fa406e370 tx=0x7f0f9402b880 comp rx=0 tx=0).stop 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 -- 172.21.15.100:0/101433872 shutdown_connections 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 --2- 172.21.15.100:0/101433872 >> v2:172.21.15.110:3300/0 conn(0x7f0fa40c4ed0 0x7f0fa40c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 --2- 172.21.15.100:0/101433872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa414fc10 0x7f0fa40a4d00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.164+0000 7f0faae00640 1 -- 172.21.15.100:0/101433872 >> 172.21.15.100:0/101433872 conn(0x7f0fa40c5ba0 msgr2=0x7f0fa40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.165+0000 7f0faae00640 1 -- 172.21.15.100:0/101433872 shutdown_connections 2024-01-20T08:11:57.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.165+0000 7f0faae00640 1 -- 172.21.15.100:0/101433872 wait complete. 2024-01-20T08:11:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.167+0000 7f0faae00640 1 Processor -- start 2024-01-20T08:11:57.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.167+0000 7f0faae00640 1 -- start start 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40c4ed0 0x7f0fa41e80b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa414fc10 0x7f0fa40c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41533c0 con 0x7f0fa40a5240 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41dceb0 con 0x7f0fa414fc10 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0faae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41ea090 con 0x7f0fa40c4ed0 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50398/0 (socket says 172.21.15.100:50398) 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 -- 172.21.15.100:0/2100231577 learned_addr learned my addr 172.21.15.100:0/2100231577 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 -- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40c4ed0 msgr2=0x7f0fa41e80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40c4ed0 0x7f0fa41e80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 -- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa414fc10 msgr2=0x7f0fa40c1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa414fc10 0x7f0fa40c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.168+0000 7f0fa9a00640 1 -- 172.21.15.100:0/2100231577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f940094d0 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0fa9a00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f9402b8c0 tx=0x7f0f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94032880 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f940329e0 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa41eb020 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94032d90 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.169+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa4152e00 con 0x7f0fa40a5240 2024-01-20T08:11:57.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.170+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa404e970 con 0x7f0fa40a5240 2024-01-20T08:11:57.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.171+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0f9404e450 con 0x7f0fa40a5240 2024-01-20T08:11:57.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.172+0000 7f0fa1600640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 0x7f0f7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.172+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0f940ab470 con 0x7f0fa40a5240 2024-01-20T08:11:57.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.173+0000 7f0fa9000640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 0x7f0f7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.173+0000 7f0fa9000640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 0x7f0f7c06d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4155620 tx=0x7f0f8c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.178+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0f94076680 con 0x7f0fa40a5240 2024-01-20T08:11:57.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.420+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]} v 0) v1 -- 0x7f0fa40a95c0 con 0x7f0fa40a5240 2024-01-20T08:11:57.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.543+0000 7f0fa1600640 1 -- 172.21.15.100:0/2100231577 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_all_caps_absent"]}]=0 v122) v1 ==== 159+0+0 (secure 0 0 0) 0x7f0f94079ca0 con 0x7f0fa40a5240 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.545+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 msgr2=0x7f0f7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.545+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 0x7f0f7c06d390 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4155620 tx=0x7f0f8c008040 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 msgr2=0x7f0fa41eaae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f0f9402b8c0 tx=0x7f0f940046c0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 shutdown_connections 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0fa414fc10 0x7f0fa40c1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0f7c06aed0 0x7f0f7c06d390 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0fa40c4ed0 0x7f0fa41e80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 --2- 172.21.15.100:0/2100231577 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0fa40a5240 0x7f0fa41eaae0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 >> 172.21.15.100:0/2100231577 conn(0x7f0fa40c5ba0 msgr2=0x7f0fa40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:57.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 shutdown_connections 2024-01-20T08:11:57.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.546+0000 7f0faae00640 1 -- 172.21.15.100:0/2100231577 wait complete. 2024-01-20T08:11:57.567 INFO:tasks.cephfs_test_runner:test_mount_all_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-01-20T08:11:57.567 INFO:tasks.cephfs_test_runner:Starting test: test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) 2024-01-20T08:11:57.568 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:11:57.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.770+0000 7f2e00600640 1 Processor -- start 2024-01-20T08:11:57.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.770+0000 7f2e00600640 1 -- start start 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.771+0000 7f2e00600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2df8151f40 0x7f2df81551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2e00600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2df80c4a30 0x7f2df80c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2e00600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df8155710 con 0x7f2df80c7fb0 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2e00600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df806bf90 con 0x7f2df8151f40 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2e00600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80c5310 con 0x7f2df80c4a30 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2df8151f40 0x7f2df81551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2df8151f40 0x7f2df81551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50412/0 (socket says 172.21.15.100:50412) 2024-01-20T08:11:57.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 -- 172.21.15.100:0/477055524 learned_addr learned my addr 172.21.15.100:0/477055524 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:57.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 -- 172.21.15.100:0/477055524 >> v2:172.21.15.110:3300/0 conn(0x7f2df80c4a30 msgr2=0x7f2df80c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:57.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 --2- 172.21.15.100:0/477055524 >> v2:172.21.15.110:3300/0 conn(0x7f2df80c4a30 0x7f2df80c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 -- 172.21.15.100:0/477055524 >> v1:172.21.15.100:6789/0 conn(0x7f2df80c7fb0 legacy=0x7f2df806b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.772+0000 7f2dfdc00640 1 -- 172.21.15.100:0/477055524 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80c4ff0 con 0x7f2df8151f40 2024-01-20T08:11:57.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.773+0000 7f2dfdc00640 1 --2- 172.21.15.100:0/477055524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df8151f40 0x7f2df81551d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2df808bab0 tx=0x7f2de802ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f6e57d48d1591c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2df7e00640 1 -- 172.21.15.100:0/477055524 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802f850 con 0x7f2df8151f40 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2df7e00640 1 -- 172.21.15.100:0/477055524 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de802f9b0 con 0x7f2df8151f40 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2df7e00640 1 -- 172.21.15.100:0/477055524 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802fd40 con 0x7f2df8151f40 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 -- 172.21.15.100:0/477055524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df8151f40 msgr2=0x7f2df81551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 --2- 172.21.15.100:0/477055524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df8151f40 0x7f2df81551d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f2df808bab0 tx=0x7f2de802ba30 comp rx=0 tx=0).stop 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 -- 172.21.15.100:0/477055524 shutdown_connections 2024-01-20T08:11:57.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 --2- 172.21.15.100:0/477055524 >> v2:172.21.15.110:3300/0 conn(0x7f2df80c4a30 0x7f2df80c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 --2- 172.21.15.100:0/477055524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df8151f40 0x7f2df81551d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 -- 172.21.15.100:0/477055524 >> 172.21.15.100:0/477055524 conn(0x7f2df80ca0b0 msgr2=0x7f2df80ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:57.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.774+0000 7f2e00600640 1 -- 172.21.15.100:0/477055524 shutdown_connections 2024-01-20T08:11:57.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.775+0000 7f2e00600640 1 -- 172.21.15.100:0/477055524 wait complete. 2024-01-20T08:11:57.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.776+0000 7f2e00600640 1 Processor -- start 2024-01-20T08:11:57.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.776+0000 7f2e00600640 1 -- start start 2024-01-20T08:11:57.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df80c7fb0 0x7f2df80af5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df8151f40 0x7f2df8153880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80ae4f0 con 0x7f2df80c4a30 2024-01-20T08:11:57.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df81ea8f0 con 0x7f2df8151f40 2024-01-20T08:11:57.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2e00600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80afcd0 con 0x7f2df80c7fb0 2024-01-20T08:11:57.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2dfdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2dfdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50416/0 (socket says 172.21.15.100:50416) 2024-01-20T08:11:57.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.777+0000 7f2dfdc00640 1 -- 172.21.15.100:0/202016412 learned_addr learned my addr 172.21.15.100:0/202016412 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 -- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df80c7fb0 msgr2=0x7f2df80af5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df80c7fb0 0x7f2df80af5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 -- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df8151f40 msgr2=0x7f2df8153880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfe600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df8151f40 0x7f2df8153880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df8151f40 0x7f2df8153880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 -- 172.21.15.100:0/202016412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de80094d0 con 0x7f2df80c4a30 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2dfdc00640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de802f820 con 0x7f2df80c4a30 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de8041400 con 0x7f2df80c4a30 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de80417b0 con 0x7f2df80c4a30 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.778+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df81ea2a0 con 0x7f2df80c4a30 2024-01-20T08:11:57.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.779+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80affb0 con 0x7f2df80c4a30 2024-01-20T08:11:57.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.780+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df804e970 con 0x7f2df80c4a30 2024-01-20T08:11:57.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.781+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2de8041910 con 0x7f2df80c4a30 2024-01-20T08:11:57.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.782+0000 7f2df5600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 0x7f2dd006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:57.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.782+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2de803c070 con 0x7f2df80c4a30 2024-01-20T08:11:57.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.782+0000 7f2dfd200640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 0x7f2dd006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:57.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.783+0000 7f2dfd200640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 0x7f2dd006d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000f60 tx=0x7f2de00079d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:57.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.786+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2de8077400 con 0x7f2df80c4a30 2024-01-20T08:11:57.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.979+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2df80c9bf0 con 0x7f2df80c4a30 2024-01-20T08:11:57.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.981+0000 7f2df5600640 1 -- 172.21.15.100:0/202016412 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13097 (secure 0 0 0) 0x7f2de807aa20 con 0x7f2df80c4a30 2024-01-20T08:11:57.985 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:11:57.985 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":44,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:11:56.521045+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6834/4037788508":"2024-01-21T08:11:54.027231+0000","172.21.15.110:6832/4037788508":"2024-01-21T08:11:54.027231+0000","172.21.15.100:6837/4185964362":"2024-01-21T08:11:46.445693+0000","172.21.15.100:6835/4185964362":"2024-01-21T08:11:46.445693+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 msgr2=0x7f2dd006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 0x7f2dd006d3c0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2de0000f60 tx=0x7f2de00079d0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 msgr2=0x7f2df81ead80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f2de8000c00 tx=0x7f2de8004730 comp rx=0 tx=0).stop 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 shutdown_connections 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2df8151f40 0x7f2df8153880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2dd006af00 0x7f2dd006d3c0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2df80c7fb0 0x7f2df80af5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 --2- 172.21.15.100:0/202016412 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2df80c4a30 0x7f2df81ead80 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:57.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.984+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 >> 172.21.15.100:0/202016412 conn(0x7f2df80ca0b0 msgr2=0x7f2df806b120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:57.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.985+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 shutdown_connections 2024-01-20T08:11:57.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:57.985+0000 7f2e00600640 1 -- 172.21.15.100:0/202016412 wait complete. 2024-01-20T08:11:58.005 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:11:58.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:11:58.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.202+0000 7f4dc0000640 1 Processor -- start 2024-01-20T08:11:58.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.203+0000 7f4dc0000640 1 -- start start 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4db814fdb0 0x7f4db80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 0x7f4db8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80a9ce0 con 0x7f4db814fdb0 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db80a93b0 con 0x7f4db80c1d90 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dc0000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db8152790 con 0x7f4db80c3460 2024-01-20T08:11:58.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dbd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4db814fdb0 0x7f4db80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dbd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4db814fdb0 0x7f4db80c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50418/0 (socket says 172.21.15.100:50418) 2024-01-20T08:11:58.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.204+0000 7f4dbd600640 1 -- 172.21.15.100:0/1656586489 learned_addr learned my addr 172.21.15.100:0/1656586489 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbe000640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbcc00640 1 --2- 172.21.15.100:0/1656586489 >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 0x7f4db8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbd600640 1 -- 172.21.15.100:0/1656586489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 msgr2=0x7f4db8153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbd600640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbd600640 1 -- 172.21.15.100:0/1656586489 >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 msgr2=0x7f4db8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbd600640 1 --2- 172.21.15.100:0/1656586489 >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 0x7f4db8152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbd600640 1 -- 172.21.15.100:0/1656586489 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db8150190 con 0x7f4db814fdb0 2024-01-20T08:11:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbe000640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.205+0000 7f4dbcc00640 1 --2- 172.21.15.100:0/1656586489 >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 0x7f4db8152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.206+0000 7f4dbd600640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db80c1850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4db806be40 tx=0x7f4da802b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734d3d295aa1a903 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.206+0000 7f4db7e00640 1 -- 172.21.15.100:0/1656586489 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8031860 con 0x7f4db814fdb0 2024-01-20T08:11:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.206+0000 7f4db7e00640 1 -- 172.21.15.100:0/1656586489 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da80319c0 con 0x7f4db814fdb0 2024-01-20T08:11:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.206+0000 7f4db7e00640 1 -- 172.21.15.100:0/1656586489 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da8031d50 con 0x7f4db814fdb0 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 -- 172.21.15.100:0/1656586489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 msgr2=0x7f4db80c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db80c1850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f4db806be40 tx=0x7f4da802b900 comp rx=0 tx=0).stop 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 -- 172.21.15.100:0/1656586489 shutdown_connections 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 --2- 172.21.15.100:0/1656586489 >> v2:172.21.15.110:3300/0 conn(0x7f4db80c1d90 0x7f4db8152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 --2- 172.21.15.100:0/1656586489 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db80c1850 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 -- 172.21.15.100:0/1656586489 >> 172.21.15.100:0/1656586489 conn(0x7f4db80c2940 msgr2=0x7f4db80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 -- 172.21.15.100:0/1656586489 shutdown_connections 2024-01-20T08:11:58.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.207+0000 7f4dc0000640 1 -- 172.21.15.100:0/1656586489 wait complete. 2024-01-20T08:11:58.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.209+0000 7f4dc0000640 1 Processor -- start 2024-01-20T08:11:58.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.209+0000 7f4dc0000640 1 -- start start 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4db80c1d90 0x7f4db81ebcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81ec200 con 0x7f4db814fdb0 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db80710c0 con 0x7f4db80c1d90 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dc0000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db81e7cc0 con 0x7f4db80c3460 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dbe000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dbe000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50434/0 (socket says 172.21.15.100:50434) 2024-01-20T08:11:58.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.210+0000 7f4dbe000640 1 -- 172.21.15.100:0/2692027999 learned_addr learned my addr 172.21.15.100:0/2692027999 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbd600640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4db80c1d90 0x7f4db81ebcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbcc00640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 -- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 msgr2=0x7f4db8140c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8140c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 -- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4db80c1d90 msgr2=0x7f4db81ebcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4db80c1d90 0x7f4db81ebcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 -- 172.21.15.100:0/2692027999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80094d0 con 0x7f4db814fdb0 2024-01-20T08:11:58.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.211+0000 7f4dbe000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4db000cef0 tx=0x7f4db000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.212+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000d840 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.212+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db000d9c0 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.212+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db000dd70 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.212+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db80c5250 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.212+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db81e8260 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.213+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db804e970 con 0x7f4db814fdb0 2024-01-20T08:11:58.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.214+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4db001e3b0 con 0x7f4db814fdb0 2024-01-20T08:11:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.214+0000 7f4db5600640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 0x7f4d9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.215+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4db0089e90 con 0x7f4db814fdb0 2024-01-20T08:11:58.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.215+0000 7f4dbd600640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 0x7f4d9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.215+0000 7f4dbd600640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 0x7f4d9006d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.219+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4db00550b0 con 0x7f4db814fdb0 2024-01-20T08:11:58.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.410+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4db814d210 con 0x7f4db814fdb0 2024-01-20T08:11:58.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.411+0000 7f4db5600640 1 -- 172.21.15.100:0/2692027999 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v44) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4db001a0a0 con 0x7f4db814fdb0 2024-01-20T08:11:58.414 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 msgr2=0x7f4d9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 0x7f4d9006d390 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4da8036000 tx=0x7f4da803c040 comp rx=0 tx=0).stop 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 msgr2=0x7f4db8148f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f4db000cef0 tx=0x7f4db000a710 comp rx=0 tx=0).stop 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 shutdown_connections 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db814fdb0 0x7f4db8148f60 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4d9006aed0 0x7f4d9006d390 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4db80c3460 0x7f4db8140c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 --2- 172.21.15.100:0/2692027999 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4db80c1d90 0x7f4db81ebcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 >> 172.21.15.100:0/2692027999 conn(0x7f4db80c2940 msgr2=0x7f4db80c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:58.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 shutdown_connections 2024-01-20T08:11:58.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.414+0000 7f4dc0000640 1 -- 172.21.15.100:0/2692027999 wait complete. 2024-01-20T08:11:58.436 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-01-20T08:11:58.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.638+0000 7fe0a3a00640 1 Processor -- start 2024-01-20T08:11:58.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.639+0000 7fe0a3a00640 1 -- start start 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a3a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c3460 0x7fe09c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a3a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe09c153120 0x7fe09c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a3a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe09c150190 con 0x7fe09c14fdb0 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a3a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0a9ce0 con 0x7fe09c153120 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a3a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe09c0a93b0 con 0x7fe09c0c3460 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe09c153120 0x7fe09c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe09c153120 0x7fe09c15cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50438/0 (socket says 172.21.15.100:50438) 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.640+0000 7fe0a1a00640 1 -- 172.21.15.100:0/2054824274 learned_addr learned my addr 172.21.15.100:0/2054824274 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.641+0000 7fe093e00640 1 --2- 172.21.15.100:0/2054824274 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c3460 0x7fe09c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.641+0000 7fe0a1a00640 1 -- 172.21.15.100:0/2054824274 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c3460 msgr2=0x7fe09c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.641+0000 7fe0a1a00640 1 --2- 172.21.15.100:0/2054824274 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c3460 0x7fe09c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.641+0000 7fe0a1a00640 1 -- 172.21.15.100:0/2054824274 >> v1:172.21.15.110:6789/0 conn(0x7fe09c14fdb0 legacy=0x7fe09c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:58.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.641+0000 7fe0a1a00640 1 -- 172.21.15.100:0/2054824274 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c1535b0 con 0x7fe09c153120 2024-01-20T08:11:58.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.642+0000 7fe0a1a00640 1 --2- 172.21.15.100:0/2054824274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c153120 0x7fe09c15cfc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe09c06be40 tx=0x7fe09402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411c0276275c617e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.642+0000 7fe09be00640 1 -- 172.21.15.100:0/2054824274 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09402ca80 con 0x7fe09c153120 2024-01-20T08:11:58.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.642+0000 7fe09be00640 1 -- 172.21.15.100:0/2054824274 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09402cbe0 con 0x7fe09c153120 2024-01-20T08:11:58.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.642+0000 7fe09be00640 1 -- 172.21.15.100:0/2054824274 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0940343f0 con 0x7fe09c153120 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2054824274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c153120 msgr2=0x7fe09c15cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2054824274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c153120 0x7fe09c15cfc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe09c06be40 tx=0x7fe09402bee0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2054824274 shutdown_connections 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2054824274 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c153120 0x7fe09c15cfc0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2054824274 >> v2:172.21.15.110:3300/0 conn(0x7fe09c0c3460 0x7fe09c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2054824274 >> 172.21.15.100:0/2054824274 conn(0x7fe09c0c2940 msgr2=0x7fe09c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2054824274 shutdown_connections 2024-01-20T08:11:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.643+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2054824274 wait complete. 2024-01-20T08:11:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.645+0000 7fe0a3a00640 1 Processor -- start 2024-01-20T08:11:58.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.645+0000 7fe0a3a00640 1 -- start start 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe09c14fdb0 0x7fe09c150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c153120 0x7fe09c150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1ed490 con 0x7fe09c0c3460 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c14b400 con 0x7fe09c153120 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a3a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09c1ed6a0 con 0x7fe09c14fdb0 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50454/0 (socket says 172.21.15.100:50454) 2024-01-20T08:11:58.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 -- 172.21.15.100:0/2359514587 learned_addr learned my addr 172.21.15.100:0/2359514587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:58.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe093e00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe09c14fdb0 0x7fe09c150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 -- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe09c14fdb0 msgr2=0x7fe09c150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe09c14fdb0 0x7fe09c150590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c153120 0x7fe09c150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 -- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c153120 msgr2=0x7fe09c150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.646+0000 7fe0a1000640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c153120 0x7fe09c150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe0a1000640 1 -- 172.21.15.100:0/2359514587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094009b30 con 0x7fe09c0c3460 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe0a1000640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c430 tx=0x7fe08c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011790 con 0x7fe09c0c3460 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c0118f0 con 0x7fe09c0c3460 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c011ce0 con 0x7fe09c0c3460 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe09c1ed980 con 0x7fe09c0c3460 2024-01-20T08:11:58.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.647+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe09c1e1ab0 con 0x7fe09c0c3460 2024-01-20T08:11:58.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.648+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe09c04e970 con 0x7fe09c0c3460 2024-01-20T08:11:58.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.649+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe08c01c460 con 0x7fe09c0c3460 2024-01-20T08:11:58.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.650+0000 7fe099600640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 0x7fe07406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:58.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.650+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe08c089210 con 0x7fe09c0c3460 2024-01-20T08:11:58.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.650+0000 7fe093e00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 0x7fe07406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:58.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.651+0000 7fe093e00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 0x7fe07406d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0c0d00 tx=0x7fe084008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:58.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.654+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe08c054410 con 0x7fe09c0c3460 2024-01-20T08:11:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:58.914+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7fe09c072580 con 0x7fe09c0c3460 2024-01-20T08:11:59.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.555+0000 7fe099600640 1 -- 172.21.15.100:0/2359514587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v124) v1 ==== 187+0+0 (secure 0 0 0) 0x7fe08c057a30 con 0x7fe09c0c3460 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 msgr2=0x7fe07406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 0x7fe07406d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0c0d00 tx=0x7fe084008040 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 msgr2=0x7fe09c1e1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe08c00c430 tx=0x7fe08c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 shutdown_connections 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe09c153120 0x7fe09c150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe07406af00 0x7fe07406d3c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe09c14fdb0 0x7fe09c150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 --2- 172.21.15.100:0/2359514587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe09c0c3460 0x7fe09c1e1570 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 >> 172.21.15.100:0/2359514587 conn(0x7fe09c0c2940 msgr2=0x7fe09c070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 shutdown_connections 2024-01-20T08:11:59.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.559+0000 7fe0a3a00640 1 -- 172.21.15.100:0/2359514587 wait complete. 2024-01-20T08:11:59.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-20T08:11:59.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.786+0000 7f7a81800640 1 Processor -- start 2024-01-20T08:11:59.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.786+0000 7f7a81800640 1 -- start start 2024-01-20T08:11:59.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a81800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 0x7f7a7c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a81800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7a7c0c1d90 0x7f7a7c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a81800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a7c150190 con 0x7f7a7c0c3460 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a81800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0a9ce0 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a81800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a7c0a93b0 con 0x7f7a7c14fdb0 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7a7c0c1d90 0x7f7a7c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7a7c0c3460 0x7f7a7c155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47086/0 (socket says 172.21.15.100:47086) 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7a000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7a7c0c1d90 0x7f7a7c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54864/0 (socket says 172.21.15.100:54864) 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7b400640 1 -- 172.21.15.100:0/3698528739 learned_addr learned my addr 172.21.15.100:0/3698528739 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7a000640 1 -- 172.21.15.100:0/3698528739 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 msgr2=0x7f7a7c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7aa00640 1 --2- 172.21.15.100:0/3698528739 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 0x7f7a7c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7a000640 1 --2- 172.21.15.100:0/3698528739 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 0x7f7a7c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.788+0000 7f7a7a000640 1 -- 172.21.15.100:0/3698528739 >> v1:172.21.15.100:6789/0 conn(0x7f7a7c0c3460 legacy=0x7f7a7c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.789+0000 7f7a7a000640 1 -- 172.21.15.100:0/3698528739 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a7c0a8810 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.789+0000 7f7a79600640 1 -- 172.21.15.100:0/3698528739 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241851432 0 0) 0x7f7a7c150190 con 0x7f7a7c0c3460 2024-01-20T08:11:59.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.789+0000 7f7a7aa00640 1 --2- 172.21.15.100:0/3698528739 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 0x7f7a7c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a7a000640 1 --2- 172.21.15.100:0/3698528739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c152be0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c06e580 tx=0x7f7a6402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad75fe4f8575829 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a79600640 1 -- 172.21.15.100:0/3698528739 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031830 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a79600640 1 -- 172.21.15.100:0/3698528739 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64031990 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a79600640 1 -- 172.21.15.100:0/3698528739 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031d20 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a81800640 1 -- 172.21.15.100:0/3698528739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 msgr2=0x7f7a7c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.790+0000 7f7a81800640 1 --2- 172.21.15.100:0/3698528739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c152be0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c06e580 tx=0x7f7a6402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 -- 172.21.15.100:0/3698528739 shutdown_connections 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 --2- 172.21.15.100:0/3698528739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c152be0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 --2- 172.21.15.100:0/3698528739 >> v2:172.21.15.110:3300/0 conn(0x7f7a7c14fdb0 0x7f7a7c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 -- 172.21.15.100:0/3698528739 >> 172.21.15.100:0/3698528739 conn(0x7f7a7c0c2940 msgr2=0x7f7a7c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:11:59.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 -- 172.21.15.100:0/3698528739 shutdown_connections 2024-01-20T08:11:59.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.791+0000 7f7a81800640 1 -- 172.21.15.100:0/3698528739 wait complete. 2024-01-20T08:11:59.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.792+0000 7f7a81800640 1 Processor -- start 2024-01-20T08:11:59.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.792+0000 7f7a81800640 1 -- start start 2024-01-20T08:11:59.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c0c3460 0x7f7a7c1ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c14fdb0 0x7f7a7c1edc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c146d60 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c150cb0 con 0x7f7a7c0c3460 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a81800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a7c1511a0 con 0x7f7a7c14fdb0 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a7aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54880/0 (socket says 172.21.15.100:54880) 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.793+0000 7f7a7aa00640 1 -- 172.21.15.100:0/2079782753 learned_addr learned my addr 172.21.15.100:0/2079782753 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7a000640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c0c3460 0x7f7a7c1ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 -- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c14fdb0 msgr2=0x7f7a7c1edc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c14fdb0 0x7f7a7c1edc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 -- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c0c3460 msgr2=0x7f7a7c1ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c0c3460 0x7f7a7c1ed6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 -- 172.21.15.100:0/2079782753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a64009400 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a7aa00640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:59.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c0077c0 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6c007920 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a7c06dd00 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.794+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6c007c90 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.795+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a7c150ec0 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.796+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a7c04e970 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.796+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7a6c0113f0 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.797+0000 7f7a72a00640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 0x7f7a5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:11:59.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.797+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7a6c089670 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.797+0000 7f7a7a000640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 0x7f7a5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:11:59.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.798+0000 7f7a7a000640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 0x7f7a5406d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7a64036000 tx=0x7f7a64008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:11:59.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.802+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7a6c0547d0 con 0x7f7a7c0c1d90 2024-01-20T08:11:59.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:11:59.996+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7a7c0c2260 con 0x7f7a7c0c1d90 2024-01-20T08:12:00.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.001+0000 7f7a72a00640 1 -- 172.21.15.100:0/2079782753 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7a6c057df0 con 0x7f7a7c0c1d90 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 msgr2=0x7f7a5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 0x7f7a5406d390 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f7a64036000 tx=0x7f7a64008030 comp rx=0 tx=0).stop 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 msgr2=0x7f7a7c0bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7a6c00c7f0 tx=0x7f7a6c00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 shutdown_connections 2024-01-20T08:12:00.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7a5406aed0 0x7f7a5406d390 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7a7c14fdb0 0x7f7a7c1edc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7a7c0c3460 0x7f7a7c1ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 --2- 172.21.15.100:0/2079782753 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7a7c0c1d90 0x7f7a7c0bf4e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 >> 172.21.15.100:0/2079782753 conn(0x7f7a7c0c2940 msgr2=0x7f7a7c0ab310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 shutdown_connections 2024-01-20T08:12:00.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.004+0000 7f7a81800640 1 -- 172.21.15.100:0/2079782753 wait complete. 2024-01-20T08:12:00.026 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:12:00.026 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:12:00.133 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:12:00.255 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:12:00.255 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:00.255 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:00.308 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:12:00.309 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:00.309 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:00.366 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:12:00.366 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-20T08:12:00.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:00.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.585+0000 7f43e4000640 1 Processor -- start 2024-01-20T08:12:00.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.586+0000 7f43e4000640 1 -- start start 2024-01-20T08:12:00.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e4000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43dc0bfae0 0x7f43dc151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e4000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f43dc1521e0 0x7f43dc157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e4000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43dc0c0fb0 con 0x7f43dc071220 2024-01-20T08:12:00.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e4000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc0c04a0 con 0x7f43dc0bfae0 2024-01-20T08:12:00.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e4000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43dc071d10 con 0x7f43dc1521e0 2024-01-20T08:12:00.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e1600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f43dc071220 0x7f43dc071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47092/0 (socket says 172.21.15.100:47092) 2024-01-20T08:12:00.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.587+0000 7f43e1600640 1 -- 172.21.15.100:0/3792707250 learned_addr learned my addr 172.21.15.100:0/3792707250 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:00.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e0c00640 1 --2- 172.21.15.100:0/3792707250 >> v2:172.21.15.100:3300/0 conn(0x7f43dc0bfae0 0x7f43dc151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:00.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43dbe00640 1 -- 172.21.15.100:0/3792707250 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2448466411 0 0) 0x7f43dc0c0fb0 con 0x7f43dc071220 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e2000640 1 --2- 172.21.15.100:0/3792707250 >> v2:172.21.15.110:3300/0 conn(0x7f43dc1521e0 0x7f43dc157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43dbe00640 1 -- 172.21.15.100:0/3792707250 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43bc003520 con 0x7f43dc071220 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e0c00640 1 -- 172.21.15.100:0/3792707250 >> v2:172.21.15.110:3300/0 conn(0x7f43dc1521e0 msgr2=0x7f43dc157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e0c00640 1 --2- 172.21.15.100:0/3792707250 >> v2:172.21.15.110:3300/0 conn(0x7f43dc1521e0 0x7f43dc157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e0c00640 1 -- 172.21.15.100:0/3792707250 >> v1:172.21.15.100:6789/0 conn(0x7f43dc071220 legacy=0x7f43dc071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.588+0000 7f43e0c00640 1 -- 172.21.15.100:0/3792707250 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc06def0 con 0x7f43dc0bfae0 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.589+0000 7f43e0c00640 1 --2- 172.21.15.100:0/3792707250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc0bfae0 0x7f43dc151ca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43dc06b420 tx=0x7f43c402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ec322bf5f6bf9f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.589+0000 7f43dbe00640 1 -- 172.21.15.100:0/3792707250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4031520 con 0x7f43dc0bfae0 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.589+0000 7f43dbe00640 1 -- 172.21.15.100:0/3792707250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43c4031680 con 0x7f43dc0bfae0 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.589+0000 7f43dbe00640 1 -- 172.21.15.100:0/3792707250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43c4031a10 con 0x7f43dc0bfae0 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 -- 172.21.15.100:0/3792707250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc0bfae0 msgr2=0x7f43dc151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 --2- 172.21.15.100:0/3792707250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc0bfae0 0x7f43dc151ca0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f43dc06b420 tx=0x7f43c402b7c0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 -- 172.21.15.100:0/3792707250 shutdown_connections 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 --2- 172.21.15.100:0/3792707250 >> v2:172.21.15.110:3300/0 conn(0x7f43dc1521e0 0x7f43dc157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 --2- 172.21.15.100:0/3792707250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc0bfae0 0x7f43dc151ca0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 -- 172.21.15.100:0/3792707250 >> 172.21.15.100:0/3792707250 conn(0x7f43dc06a5e0 msgr2=0x7f43dc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 -- 172.21.15.100:0/3792707250 shutdown_connections 2024-01-20T08:12:00.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.590+0000 7f43e4000640 1 -- 172.21.15.100:0/3792707250 wait complete. 2024-01-20T08:12:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.592+0000 7f43e4000640 1 Processor -- start 2024-01-20T08:12:00.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.592+0000 7f43e4000640 1 -- start start 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0bfae0 0x7f43dc1ed740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc1521e0 0x7f43dc1edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1ee1c0 con 0x7f43dc071220 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc146950 con 0x7f43dc1521e0 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e4000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43dc1538a0 con 0x7f43dc0bfae0 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54908/0 (socket says 172.21.15.100:54908) 2024-01-20T08:12:00.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.593+0000 7f43e1600640 1 -- 172.21.15.100:0/2922451374 learned_addr learned my addr 172.21.15.100:0/2922451374 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e2000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc1521e0 0x7f43dc1edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 -- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0bfae0 msgr2=0x7f43dc1ed740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0bfae0 0x7f43dc1ed740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 -- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc1521e0 msgr2=0x7f43dc1edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc1521e0 0x7f43dc1edc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 -- 172.21.15.100:0/2922451374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43c4009400 con 0x7f43dc071220 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e1600640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c430 tx=0x7f43cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc005ce0 con 0x7f43dc071220 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43cc005e40 con 0x7f43dc071220 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43cc0072f0 con 0x7f43dc071220 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43dc146ae0 con 0x7f43dc071220 2024-01-20T08:12:00.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.594+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43dc0a9470 con 0x7f43dc071220 2024-01-20T08:12:00.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.596+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43dc0bf920 con 0x7f43dc071220 2024-01-20T08:12:00.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.596+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f43cc007450 con 0x7f43dc071220 2024-01-20T08:12:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.598+0000 7f43d9600640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 0x7f43b406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.598+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f43cc088a40 con 0x7f43dc071220 2024-01-20T08:12:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.598+0000 7f43e0c00640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 0x7f43b406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:00.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.599+0000 7f43e0c00640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 0x7f43b406d390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43c4035000 tx=0x7f43c402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:00.605 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.602+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f43cc057630 con 0x7f43dc071220 2024-01-20T08:12:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.837+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43dc0728c0 con 0x7f43dc071220 2024-01-20T08:12:00.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.838+0000 7f43d9600640 1 -- 172.21.15.100:0/2922451374 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+3705 (secure 0 0 0) 0x7f43cc017020 con 0x7f43dc071220 2024-01-20T08:12:00.841 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:00.842 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":25,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4526,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1616225651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1616225651},{"type":"v1","addr":"172.21.15.110:6835","nonce":1616225651}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4663,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/443237243","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":443237243},{"type":"v1","addr":"172.21.15.100:6836","nonce":443237243}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2638428107","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2638428107},{"type":"v1","addr":"172.21.15.110:6834","nonce":2638428107}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":25},{"gid":5496,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/566641086","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":566641086},{"type":"v1","addr":"172.21.15.100:6837","nonce":566641086}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":23}],"filesystems":[]} 2024-01-20T08:12:00.842 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 25 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 msgr2=0x7f43b406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 0x7f43b406d390 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f43c4035000 tx=0x7f43c402e000 comp rx=0 tx=0).stop 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 msgr2=0x7f43dc155400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f43cc00c430 tx=0x7f43cc00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 shutdown_connections 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43dc1521e0 0x7f43dc1edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43b406aed0 0x7f43b406d390 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43dc0bfae0 0x7f43dc1ed740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 --2- 172.21.15.100:0/2922451374 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43dc071220 0x7f43dc155400 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 >> 172.21.15.100:0/2922451374 conn(0x7f43dc06a5e0 msgr2=0x7f43dc14a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 shutdown_connections 2024-01-20T08:12:00.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:00.841+0000 7f43e4000640 1 -- 172.21.15.100:0/2922451374 wait complete. 2024-01-20T08:12:00.861 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T08:12:00.861 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-20T08:12:00.862 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T08:12:00.862 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:12:00.862 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T08:12:00.862 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-20T08:12:00.862 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T08:12:00.862 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:12:00.863 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T08:12:00.863 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-20T08:12:00.863 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T08:12:00.863 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:12:00.863 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T08:12:00.863 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-20T08:12:00.863 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T08:12:00.864 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:12:00.880 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T08:12:00.881 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T08:12:00.881 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T08:12:00.882 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T08:12:00.886 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T08:12:00.886 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T08:12:00.889 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T08:12:00.889 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T08:12:00.928 INFO:tasks.ceph.mds.a:Started 2024-01-20T08:12:00.928 DEBUG:teuthology.parallel:result is None 2024-01-20T08:12:00.933 INFO:tasks.ceph.mds.c:Started 2024-01-20T08:12:00.934 DEBUG:teuthology.parallel:result is None 2024-01-20T08:12:00.936 INFO:tasks.ceph.mds.b:Started 2024-01-20T08:12:00.936 DEBUG:teuthology.parallel:result is None 2024-01-20T08:12:00.943 INFO:tasks.ceph.mds.d:Started 2024-01-20T08:12:00.943 DEBUG:teuthology.parallel:result is None 2024-01-20T08:12:00.943 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-20T08:12:01.079 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-20T08:12:01.080 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:12:01.103 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-20T08:12:01.104 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:12:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.126+0000 7f838c800640 1 Processor -- start 2024-01-20T08:12:01.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.126+0000 7f838c800640 1 -- start start 2024-01-20T08:12:01.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.127+0000 7f838c800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f838414fdb0 0x7f83840c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.127+0000 7f838c800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83840c1d90 0x7f8384152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.127+0000 7f838c800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8384150190 con 0x7f83840c3460 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.127+0000 7f838c800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83840a9ce0 con 0x7f83840c1d90 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.127+0000 7f838c800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83840a93b0 con 0x7f838414fdb0 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83840c1d90 0x7f8384152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83840c1d90 0x7f8384152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54936/0 (socket says 172.21.15.100:54936) 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 -- 172.21.15.100:0/1324667703 learned_addr learned my addr 172.21.15.100:0/1324667703 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389e00640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f838414fdb0 0x7f83840c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 -- 172.21.15.100:0/1324667703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f838414fdb0 msgr2=0x7f83840c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:01.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f838414fdb0 0x7f83840c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 -- 172.21.15.100:0/1324667703 >> v1:172.21.15.110:6789/0 conn(0x7f83840c3460 legacy=0x7f8384155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.128+0000 7f8389400640 1 -- 172.21.15.100:0/1324667703 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83840a8810 con 0x7f83840c1d90 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.129+0000 7f8389400640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83840c1d90 0x7f8384152be0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d794070c9068dcbb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f8388a00640 1 -- 172.21.15.100:0/1324667703 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c030840 con 0x7f83840c1d90 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f8388a00640 1 -- 172.21.15.100:0/1324667703 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f836c0309a0 con 0x7f83840c1d90 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f8388a00640 1 -- 172.21.15.100:0/1324667703 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c030d30 con 0x7f83840c1d90 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 -- 172.21.15.100:0/1324667703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83840c1d90 msgr2=0x7f8384152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83840c1d90 0x7f8384152be0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f836c009870 tx=0x7f836c02b980 comp rx=0 tx=0).stop 2024-01-20T08:12:01.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 -- 172.21.15.100:0/1324667703 shutdown_connections 2024-01-20T08:12:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83840c1d90 0x7f8384152be0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 --2- 172.21.15.100:0/1324667703 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f838414fdb0 0x7f83840c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 -- 172.21.15.100:0/1324667703 >> 172.21.15.100:0/1324667703 conn(0x7f83840c2940 msgr2=0x7f83840c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 -- 172.21.15.100:0/1324667703 shutdown_connections 2024-01-20T08:12:01.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.130+0000 7f838c800640 1 -- 172.21.15.100:0/1324667703 wait complete. 2024-01-20T08:12:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.132+0000 7f838c800640 1 Processor -- start 2024-01-20T08:12:01.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.132+0000 7f838c800640 1 -- start start 2024-01-20T08:12:01.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83840c3460 0x7f83841e7230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f838414fdb0 0x7f83841ea160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f838414a750 con 0x7f838414fdb0 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83841ee160 con 0x7f83840c3460 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838c800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8384151dc0 con 0x7f83840c1d90 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f8389e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f838a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f838414fdb0 0x7f83841ea160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f8389400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83840c3460 0x7f83841e7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f8389e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:52064/0 (socket says 172.21.15.100:52064) 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.133+0000 7f8389e00640 1 -- 172.21.15.100:0/4052437383 learned_addr learned my addr 172.21.15.100:0/4052437383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 -- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83840c3460 msgr2=0x7f83841e7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83840c3460 0x7f83841e7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 -- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f838414fdb0 msgr2=0x7f83841ea160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f838414fdb0 0x7f83841ea160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 -- 172.21.15.100:0/4052437383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f836c0094d0 con 0x7f83840c1d90 2024-01-20T08:12:01.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8389e00640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f837400e8a0 tx=0x7f837400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83740094f0 con 0x7f83840c1d90 2024-01-20T08:12:01.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837400c940 con 0x7f83840c1d90 2024-01-20T08:12:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837400ccf0 con 0x7f83840c1d90 2024-01-20T08:12:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.134+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83841520a0 con 0x7f83840c1d90 2024-01-20T08:12:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.135+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83841ede10 con 0x7f83840c1d90 2024-01-20T08:12:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.136+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f838404e970 con 0x7f83840c1d90 2024-01-20T08:12:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.137+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8374013470 con 0x7f83840c1d90 2024-01-20T08:12:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.137+0000 7f8382000640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 0x7f835c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.137+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f83740893b0 con 0x7f83840c1d90 2024-01-20T08:12:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.138+0000 7f8389400640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 0x7f835c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.138+0000 7f8389400640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 0x7f835c06d390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.143+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f83740545c0 con 0x7f83840c1d90 2024-01-20T08:12:01.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.349+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8384149be0 con 0x7f83840c1d90 2024-01-20T08:12:01.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.590+0000 7f8382000640 1 -- 172.21.15.100:0/4052437383 <== mon.2 v2:172.21.15.110:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v46) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8374057be0 con 0x7f83840c1d90 2024-01-20T08:12:01.594 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 msgr2=0x7f835c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 0x7f835c06d390 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f836c036000 tx=0x7f836c008030 comp rx=0 tx=0).stop 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 msgr2=0x7f83840bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f837400e8a0 tx=0x7f837400ed60 comp rx=0 tx=0).stop 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 shutdown_connections 2024-01-20T08:12:01.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f838414fdb0 0x7f83841ea160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83840c3460 0x7f83841e7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f835c06aed0 0x7f835c06d390 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 --2- 172.21.15.100:0/4052437383 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83840c1d90 0x7f83840bf4e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 >> 172.21.15.100:0/4052437383 conn(0x7f83840c2940 msgr2=0x7f8384070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 shutdown_connections 2024-01-20T08:12:01.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.595+0000 7f838c800640 1 -- 172.21.15.100:0/4052437383 wait complete. 2024-01-20T08:12:01.620 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-20T08:12:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.817+0000 7f355ee00640 1 Processor -- start 2024-01-20T08:12:01.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.817+0000 7f355ee00640 1 -- start start 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f355ee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f35581515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f355ee00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558154ba0 con 0x7f35580c1850 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f355ee00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558155a00 con 0x7f35580c1cd0 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f355ee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f355814bb00 con 0x7f355814b720 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f3557400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f35580c1850 0x7f355806c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47094/0 (socket says 172.21.15.100:47094) 2024-01-20T08:12:01.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.818+0000 7f3557400640 1 -- 172.21.15.100:0/3757621630 learned_addr learned my addr 172.21.15.100:0/3757621630 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3557e00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f35581515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152873209 0 0) 0x7f3558154ba0 con 0x7f35580c1850 2024-01-20T08:12:01.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3538005730 con 0x7f35580c1850 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3729772221 0 0) 0x7f3538005730 con 0x7f35580c1850 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 msgr2=0x7f35581515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f35581515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 >> v1:172.21.15.110:6789/0 conn(0x7f35580c1cd0 legacy=0x7f355806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558154df0 con 0x7f35580c1850 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3540001670 con 0x7f35580c1850 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 >> v1:172.21.15.100:6789/0 conn(0x7f35580c1850 legacy=0x7f355806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f3538005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538006130 0x7f35380069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3538006f10 0x7f3538007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355814bb00 con 0x7f3538006130 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353800ddd0 con 0x7f3538006f10 2024-01-20T08:12:01.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.819+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353800df90 con 0x7f355814b720 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538006130 0x7f35380069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f355ce00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3538006f10 0x7f3538007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557e00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f3538005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 -- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 msgr2=0x7f3538005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f355814b720 0x7f3538005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 -- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3538006f10 msgr2=0x7f3538007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3538006f10 0x7f3538007390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.825 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.820+0000 7f3557400640 1 -- 172.21.15.100:0/3757621630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538005730 con 0x7f3538006130 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.821+0000 7f3557400640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538006130 0x7f35380069d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f354000c190 tx=0x7f3538007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ceb8a4363efc14 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.821+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540005ad0 con 0x7f3538006130 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.821+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540005c30 con 0x7f3538006130 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.821+0000 7f3556a00640 1 -- 172.21.15.100:0/3757621630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354002cae0 con 0x7f3538006130 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 -- 172.21.15.100:0/3757621630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538006130 msgr2=0x7f35380069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 --2- 172.21.15.100:0/3757621630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3538006130 0x7f35380069d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f354000c190 tx=0x7f3538007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:01.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ce00640 1 -- 172.21.15.100:0/3757621630 reap_dead start 2024-01-20T08:12:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 -- 172.21.15.100:0/3757621630 shutdown_connections 2024-01-20T08:12:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 -- 172.21.15.100:0/3757621630 >> 172.21.15.100:0/3757621630 conn(0x7f35580c2940 msgr2=0x7f35580c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 -- 172.21.15.100:0/3757621630 shutdown_connections 2024-01-20T08:12:01.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.822+0000 7f355ee00640 1 -- 172.21.15.100:0/3757621630 wait complete. 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.824+0000 7f355ee00640 1 Processor -- start 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.824+0000 7f355ee00640 1 -- start start 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3538006130 0x7f35581ee070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35581ea160 0x7f3558146560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558071580 con 0x7f35580703a0 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558070e60 con 0x7f35581ea160 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35581ee5b0 con 0x7f3538006130 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f3557400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f3557400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54968/0 (socket says 172.21.15.100:54968) 2024-01-20T08:12:01.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f3557400640 1 -- 172.21.15.100:0/2338816079 learned_addr learned my addr 172.21.15.100:0/2338816079 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f3557e00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3538006130 0x7f35581ee070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.825+0000 7f355ce00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35581ea160 0x7f3558146560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 -- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3538006130 msgr2=0x7f35581ee070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3538006130 0x7f35581ee070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 -- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35581ea160 msgr2=0x7f3558146560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35581ea160 0x7f3558146560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 -- 172.21.15.100:0/2338816079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35580708a0 con 0x7f35580703a0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f3557400640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f60 tx=0x7f3558155970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354002caa0 con 0x7f35580703a0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f354002cc00 con 0x7f35580703a0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540007070 con 0x7f35580703a0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3558070b80 con 0x7f35580703a0 2024-01-20T08:12:01.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.826+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35581edb50 con 0x7f35580703a0 2024-01-20T08:12:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.827+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35581ed6d0 con 0x7f35580703a0 2024-01-20T08:12:01.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.828+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3540032070 con 0x7f35580703a0 2024-01-20T08:12:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.830+0000 7f354fe00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 0x7f353006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.830+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f354003c040 con 0x7f35580703a0 2024-01-20T08:12:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.830+0000 7f3557e00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 0x7f353006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:01.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.831+0000 7f3557e00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 0x7f353006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35581461e0 tx=0x7f3548008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:01.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:01.834+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f35581ed6d0 con 0x7f35580703a0 2024-01-20T08:12:02.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.094+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f35581ed6d0 con 0x7f35580703a0 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.095+0000 7f354fe00640 1 -- 172.21.15.100:0/2338816079 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5021 (secure 0 0 0) 0x7f35581ed6d0 con 0x7f35580703a0 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.098 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl1DYBKhAAW3E/HAERBMsGrC4rMf53bQ==", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl3YX/DxAAznFmYWhRluqcjxkZ5aIzOQ==", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.099 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl/QN8OhAAToAKaEXXyxtgsbnP4CK9lg==", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.100 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tlJS3/IBAAyxDTy7tcAxzFhe/cO0LaAQ==", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCqf6tlONOfMxAAUv9z4O2m2+OR+OlKEVTAyQ==", 2024-01-20T08:12:02.101 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCuf6tlpdWGEBAA4XbJMFejMXMzlZtAcFI1rQ==", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.102 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCxf6tlH+NYKRAAp4T2SRL9Hb7JzDT7AbAzzA==", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC1f6tlxVV0BhAAzktBoqojfG876bmIT8vaHg==", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.103 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC6f6tl+4ikCRAA1btg/3+O5ZPGTIUHPT8vgw==", 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-01-20T08:12:02.104 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC9f6tlEsDvIRAAFJKBssqBywoRFRWZFtHraA==", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDAf6tl8W63OhAA/8jrYsmX0b/Jyf/bdIcR2A==", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.105 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDEf6tldmY8FxAA5SaAQB68UYfSJ3zFBwesuQ==", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA==", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-20T08:12:02.106 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw==", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw pool=cephfs2_data" 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCkf6tlP8ACHBAAfGPqDgVbicLXk4WIoRUypQ==", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:12:02.107 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.testuser", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQAzgKtlwCnAGBAA+TDNki3JlshF7rUZcHZgbg==", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow rw fsname=cephfs", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r fsname=cephfs", 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.108 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlWV55HhAAm9X0Xnf67LjDKy4V1A8DvQ==", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlFW6MERAAzJBCQ7yx6sLPN6cv75rbhg==", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:12:02.109 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 msgr2=0x7f353006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 0x7f353006d3c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f35581461e0 tx=0x7f3548008040 comp rx=0 tx=0).stop 2024-01-20T08:12:02.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 msgr2=0x7f35580bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f3540000f60 tx=0x7f3558155970 comp rx=0 tx=0).stop 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 shutdown_connections 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f35581ea160 0x7f3558146560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f35580703a0 0x7f35580bf4e0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f353006af00 0x7f353006d3c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 --2- 172.21.15.100:0/2338816079 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3538006130 0x7f35581ee070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 >> 172.21.15.100:0/2338816079 conn(0x7f35580c2940 msgr2=0x7f3558148f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 shutdown_connections 2024-01-20T08:12:02.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.099+0000 7f355ee00640 1 -- 172.21.15.100:0/2338816079 wait complete. 2024-01-20T08:12:02.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-01-20T08:12:02.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.319+0000 7eff74e00640 1 Processor -- start 2024-01-20T08:12:02.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.320+0000 7eff74e00640 1 -- start start 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff74e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff7006b270 0x7eff700c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff74e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff7006c620 con 0x7eff7006b780 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff74e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff70158a10 con 0x7eff700c4a80 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff74e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff701523e0 con 0x7eff7006b270 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff6e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7eff7006b780 0x7eff7006cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47096/0 (socket says 172.21.15.100:47096) 2024-01-20T08:12:02.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.321+0000 7eff6e800640 1 -- 172.21.15.100:0/2460431406 learned_addr learned my addr 172.21.15.100:0/2460431406 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6d400640 1 --2- 172.21.15.100:0/2460431406 >> v2:172.21.15.110:3300/0 conn(0x7eff7006b270 0x7eff700c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3104071275 0 0) 0x7eff7006c620 con 0x7eff7006b780 2024-01-20T08:12:02.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff50003520 con 0x7eff7006b780 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 533739235 0 0) 0x7eff50003520 con 0x7eff7006b780 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 >> v2:172.21.15.110:3300/0 conn(0x7eff7006b270 msgr2=0x7eff700c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 --2- 172.21.15.100:0/2460431406 >> v2:172.21.15.110:3300/0 conn(0x7eff7006b270 0x7eff700c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 >> v1:172.21.15.110:6789/0 conn(0x7eff700c4a80 legacy=0x7eff700c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70158cb0 con 0x7eff7006b780 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7eff680019f0 con 0x7eff7006b780 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 >> v1:172.21.15.100:6789/0 conn(0x7eff7006b780 legacy=0x7eff7006cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 0x7eff50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff500047c0 0x7eff50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff500052a0 0x7eff5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5000c140 con 0x7eff50003970 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5000c2b0 con 0x7eff500052a0 2024-01-20T08:12:02.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.322+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff5000c470 con 0x7eff500047c0 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 0x7eff50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6d400640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff500047c0 0x7eff50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 -- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff500047c0 msgr2=0x7eff50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6e800640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff500052a0 0x7eff5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff500047c0 0x7eff50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 -- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff500052a0 msgr2=0x7eff5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff500052a0 0x7eff5000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6de00640 1 -- 172.21.15.100:0/2460431406 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50003520 con 0x7eff50003970 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6e800640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff500052a0 0x7eff5000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:02.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.323+0000 7eff6e800640 1 -- 172.21.15.100:0/2460431406 reap_dead start 2024-01-20T08:12:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.324+0000 7eff6de00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 0x7eff50003d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7eff60001720 tx=0x7eff500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b3c4300b5e0123 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.324+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff600052d0 con 0x7eff50003970 2024-01-20T08:12:02.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.324+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6002e050 con 0x7eff50003970 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.324+0000 7eff6ca00640 1 -- 172.21.15.100:0/2460431406 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff60003830 con 0x7eff50003970 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 -- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 msgr2=0x7eff50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 0x7eff50003d90 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7eff60001720 tx=0x7eff500057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 -- 172.21.15.100:0/2460431406 shutdown_connections 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 --2- 172.21.15.100:0/2460431406 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff50003970 0x7eff50003d90 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 -- 172.21.15.100:0/2460431406 >> 172.21.15.100:0/2460431406 conn(0x7eff700ca100 msgr2=0x7eff700ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 -- 172.21.15.100:0/2460431406 shutdown_connections 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.325+0000 7eff74e00640 1 -- 172.21.15.100:0/2460431406 wait complete. 2024-01-20T08:12:02.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.327+0000 7eff74e00640 1 Processor -- start 2024-01-20T08:12:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.327+0000 7eff74e00640 1 -- start start 2024-01-20T08:12:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff50003970 0x7eff700ad160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 0x7eff70154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff700af1b0 con 0x7eff70153940 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70150ee0 con 0x7eff701ea3b0 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff74e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff701528e0 con 0x7eff50003970 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff6e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff6e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:54978/0 (socket says 172.21.15.100:54978) 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.328+0000 7eff6e800640 1 -- 172.21.15.100:0/2008603254 learned_addr learned my addr 172.21.15.100:0/2008603254 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6de00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff50003970 0x7eff700ad160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6d400640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 0x7eff70154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 -- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff50003970 msgr2=0x7eff700ad160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff50003970 0x7eff700ad160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 -- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 msgr2=0x7eff70154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 0x7eff70154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 -- 172.21.15.100:0/2008603254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff70152b80 con 0x7eff70153940 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6d400640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 0x7eff70154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:02.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff6e800640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7eff700c9b50 tx=0x7eff6800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff68004d60 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff6800bb20 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff6800beb0 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.329+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff70152e60 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.330+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff70153420 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.331+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff701ea790 con 0x7eff70153940 2024-01-20T08:12:02.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.332+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7eff68007070 con 0x7eff70153940 2024-01-20T08:12:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.333+0000 7eff66000640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 0x7eff4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.333+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff68089720 con 0x7eff70153940 2024-01-20T08:12:02.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.333+0000 7eff6de00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 0x7eff4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.334+0000 7eff6de00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 0x7eff4806d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff60033000 tx=0x7eff60009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.337+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7eff701ea790 con 0x7eff70153940 2024-01-20T08:12:02.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.596+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7eff70073e90 con 0x7eff70153940 2024-01-20T08:12:02.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.601+0000 7eff66000640 1 -- 172.21.15.100:0/2008603254 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v13) v1 ==== 85+0+0 (secure 0 0 0) 0x7eff70073e90 con 0x7eff70153940 2024-01-20T08:12:02.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.603+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 msgr2=0x7eff4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.603+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 0x7eff4806d3c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7eff60033000 tx=0x7eff60009030 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.603+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 msgr2=0x7eff7014b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.603+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7eff700c9b50 tx=0x7eff6800b4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 shutdown_connections 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff70153940 0x7eff7014b0e0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff701ea3b0 0x7eff70154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff4806af00 0x7eff4806d3c0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 --2- 172.21.15.100:0/2008603254 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff50003970 0x7eff700ad160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 >> 172.21.15.100:0/2008603254 conn(0x7eff700ca100 msgr2=0x7eff700c8800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 shutdown_connections 2024-01-20T08:12:02.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.604+0000 7eff74e00640 1 -- 172.21.15.100:0/2008603254 wait complete. 2024-01-20T08:12:02.624 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.821+0000 7f21c8000640 1 Processor -- start 2024-01-20T08:12:02.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.821+0000 7f21c8000640 1 -- start start 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c8000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f21c00a93c0 0x7f21c0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c8000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c00a9940 con 0x7f21c014fce0 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c8000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21c01500c0 con 0x7f21c00aae00 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c8000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21c0156810 con 0x7f21c00a93c0 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c5600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f21c014fce0 0x7f21c0152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47104/0 (socket says 172.21.15.100:47104) 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c5600640 1 -- 172.21.15.100:0/1274633244 learned_addr learned my addr 172.21.15.100:0/1274633244 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:02.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.823+0000 7f21c4c00640 1 --2- 172.21.15.100:0/1274633244 >> v2:172.21.15.100:3300/0 conn(0x7f21c00a93c0 0x7f21c0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.824+0000 7f21bfe00640 1 -- 172.21.15.100:0/1274633244 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3004857558 0 0) 0x7f21c00a9940 con 0x7f21c014fce0 2024-01-20T08:12:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.824+0000 7f21bfe00640 1 -- 172.21.15.100:0/1274633244 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21a0003520 con 0x7f21c014fce0 2024-01-20T08:12:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.824+0000 7f21c4c00640 1 -- 172.21.15.100:0/1274633244 >> v1:172.21.15.110:6789/0 conn(0x7f21c00aae00 legacy=0x7f21c00ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.824+0000 7f21c4c00640 1 -- 172.21.15.100:0/1274633244 >> v1:172.21.15.100:6789/0 conn(0x7f21c014fce0 legacy=0x7f21c0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.824+0000 7f21c4c00640 1 -- 172.21.15.100:0/1274633244 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0156af0 con 0x7f21c00a93c0 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.825+0000 7f21c4c00640 1 --2- 172.21.15.100:0/1274633244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c0153b80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097a0 tx=0x7f21b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b943e4fd4fa17c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.825+0000 7f21bfe00640 1 -- 172.21.15.100:0/1274633244 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0031830 con 0x7f21c00a93c0 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.825+0000 7f21bfe00640 1 -- 172.21.15.100:0/1274633244 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b0031990 con 0x7f21c00a93c0 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.825+0000 7f21bfe00640 1 -- 172.21.15.100:0/1274633244 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0031d20 con 0x7f21c00a93c0 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 -- 172.21.15.100:0/1274633244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 msgr2=0x7f21c0153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 --2- 172.21.15.100:0/1274633244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c0153b80 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f21b00097a0 tx=0x7f21b002b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 -- 172.21.15.100:0/1274633244 shutdown_connections 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 --2- 172.21.15.100:0/1274633244 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c0153b80 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 -- 172.21.15.100:0/1274633244 >> 172.21.15.100:0/1274633244 conn(0x7f21c006a5e0 msgr2=0x7f21c006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 -- 172.21.15.100:0/1274633244 shutdown_connections 2024-01-20T08:12:02.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.826+0000 7f21c8000640 1 -- 172.21.15.100:0/1274633244 wait complete. 2024-01-20T08:12:02.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.827+0000 7f21c8000640 1 Processor -- start 2024-01-20T08:12:02.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 -- start start 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00aae00 0x7f21c01ed910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c014fce0 0x7f21c014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01dbf00 con 0x7f21c00a93c0 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21c00c2f80 con 0x7f21c014fce0 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.828+0000 7f21c8000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21c01ee390 con 0x7f21c00aae00 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55004/0 (socket says 172.21.15.100:55004) 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 -- 172.21.15.100:0/1029693662 learned_addr learned my addr 172.21.15.100:0/1029693662 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c6000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c014fce0 0x7f21c014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 -- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00aae00 msgr2=0x7f21c01ed910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c4c00640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00aae00 0x7f21c01ed910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00aae00 0x7f21c01ed910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 -- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c014fce0 msgr2=0x7f21c014c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c014fce0 0x7f21c014c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 -- 172.21.15.100:0/1029693662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b0009400 con 0x7f21c00a93c0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.829+0000 7f21c5600640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c390 tx=0x7f21a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.830+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a8005ce0 con 0x7f21c00a93c0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.830+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a8005e40 con 0x7f21c00a93c0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.830+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a80072f0 con 0x7f21c00a93c0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.830+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21c0071e80 con 0x7f21c00a93c0 2024-01-20T08:12:02.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.830+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21c00c0dd0 con 0x7f21c00a93c0 2024-01-20T08:12:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.831+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21c00c1080 con 0x7f21c00a93c0 2024-01-20T08:12:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.832+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f21a8007450 con 0x7f21c00a93c0 2024-01-20T08:12:02.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.833+0000 7f21bd600640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 0x7f219806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:02.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.833+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f21a8088870 con 0x7f21c00a93c0 2024-01-20T08:12:02.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.833+0000 7f21c4c00640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 0x7f219806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:02.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.834+0000 7f21c4c00640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 0x7f219806d390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f21b0036000 tx=0x7f21b0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:02.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:02.838+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f21a8053b20 con 0x7f21c00a93c0 2024-01-20T08:12:03.029 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.026+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21c004e970 con 0x7f21c00a93c0 2024-01-20T08:12:03.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.028+0000 7f21bd600640 1 -- 172.21.15.100:0/1029693662 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+12834 (secure 0 0 0) 0x7f21a8017020 con 0x7f21c00a93c0 2024-01-20T08:12:03.031 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:03.031 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":48,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:01.598278+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 msgr2=0x7f219806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 0x7f219806d390 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f21b0036000 tx=0x7f21b0008030 comp rx=0 tx=0).stop 2024-01-20T08:12:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 msgr2=0x7f21c00c0890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f21a800c390 tx=0x7f21a800c850 comp rx=0 tx=0).stop 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 shutdown_connections 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f21c014fce0 0x7f21c014c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f219806aed0 0x7f219806d390 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f21c00aae00 0x7f21c01ed910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 --2- 172.21.15.100:0/1029693662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f21c00a93c0 0x7f21c00c0890 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 >> 172.21.15.100:0/1029693662 conn(0x7f21c006a5e0 msgr2=0x7f21c0152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 shutdown_connections 2024-01-20T08:12:03.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.030+0000 7f21c8000640 1 -- 172.21.15.100:0/1029693662 wait complete. 2024-01-20T08:12:03.050 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:03.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.255+0000 7f9f5fc00640 1 Processor -- start 2024-01-20T08:12:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.255+0000 7f9f5fc00640 1 -- start start 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.257+0000 7f9f5fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f580c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.257+0000 7f9f5fc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f58150190 con 0x7f9f581532f0 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.257+0000 7f9f5fc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f580a8810 con 0x7f9f580c1d90 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.257+0000 7f9f5fc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f580a9ce0 con 0x7f9f5814fdb0 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.257+0000 7f9f5dc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9f581532f0 0x7f9f5815cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47116/0 (socket says 172.21.15.100:47116) 2024-01-20T08:12:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f5dc00640 1 -- 172.21.15.100:0/681856442 learned_addr learned my addr 172.21.15.100:0/681856442 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f5d200640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f580c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1617604732 0 0) 0x7f9f58150190 con 0x7f9f581532f0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f38003520 con 0x7f9f581532f0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4080181983 0 0) 0x7f9f38003520 con 0x7f9f581532f0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 msgr2=0x7f9f580c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f580c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 >> v1:172.21.15.110:6789/0 conn(0x7f9f580c1d90 legacy=0x7f9f58152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.258+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f580a8df0 con 0x7f9f581532f0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f9f500019f0 con 0x7f9f581532f0 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 >> v1:172.21.15.100:6789/0 conn(0x7f9f581532f0 legacy=0x7f9f5815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f380039a0 0x7f9f38003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f38004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f38005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3800ba30 con 0x7f9f380047c0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3800bb70 con 0x7f9f380039a0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f3800bd30 con 0x7f9f5814fdb0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f38004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f5d200640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f380039a0 0x7f9f38003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 -- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 msgr2=0x7f9f38005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f5dc00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f38005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f38005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 -- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f380039a0 msgr2=0x7f9f38003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f380039a0 0x7f9f38003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f4fe00640 1 -- 172.21.15.100:0/681856442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f38003520 con 0x7f9f380047c0 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f5d200640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f380039a0 0x7f9f38003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:03.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.259+0000 7f9f5dc00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f5814fdb0 0x7f9f38005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:03.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f38004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f40001720 tx=0x7f9f380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533451dcd3051cd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400052d0 con 0x7f9f380047c0 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4002e050 con 0x7f9f380047c0 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f57e00640 1 -- 172.21.15.100:0/681856442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f400035f0 con 0x7f9f380047c0 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f5fc00640 1 -- 172.21.15.100:0/681856442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 msgr2=0x7f9f38004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/681856442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f38004c40 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f9f40001720 tx=0x7f9f380057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f5dc00640 1 -- 172.21.15.100:0/681856442 reap_dead start 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f5fc00640 1 -- 172.21.15.100:0/681856442 shutdown_connections 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.261+0000 7f9f5fc00640 1 -- 172.21.15.100:0/681856442 >> 172.21.15.100:0/681856442 conn(0x7f9f580c2940 msgr2=0x7f9f580c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.262+0000 7f9f5fc00640 1 -- 172.21.15.100:0/681856442 shutdown_connections 2024-01-20T08:12:03.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.262+0000 7f9f5fc00640 1 -- 172.21.15.100:0/681856442 wait complete. 2024-01-20T08:12:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.263+0000 7f9f5fc00640 1 Processor -- start 2024-01-20T08:12:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.263+0000 7f9f5fc00640 1 -- start start 2024-01-20T08:12:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f581472a0 0x7f9f5813e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f58146d50 0x7f9f5813eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f581eac60 con 0x7f9f380047c0 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f581eb190 con 0x7f9f58146d50 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5fc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5814a7d0 con 0x7f9f581472a0 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55012/0 (socket says 172.21.15.100:55012) 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.264+0000 7f9f5d200640 1 -- 172.21.15.100:0/1605718808 learned_addr learned my addr 172.21.15.100:0/1605718808 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 -- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f581472a0 msgr2=0x7f9f5813e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f581472a0 0x7f9f5813e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 -- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f58146d50 msgr2=0x7f9f5813eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f58146d50 0x7f9f5813eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 -- 172.21.15.100:0/1605718808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5813f080 con 0x7f9f380047c0 2024-01-20T08:12:03.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5d200640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f48010910 tx=0x7f9f48010dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800ec20 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4800ed80 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4801c600 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.265+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f581eaeb0 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.266+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f5814a460 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.266+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f5804e970 con 0x7f9f380047c0 2024-01-20T08:12:03.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.267+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9f4801c760 con 0x7f9f380047c0 2024-01-20T08:12:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.268+0000 7f9f55600640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 0x7f9f3006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.268+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9f48089950 con 0x7f9f380047c0 2024-01-20T08:12:03.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.268+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 0x7f9f3006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.269+0000 7f9f4fe00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 0x7f9f3006d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f40033000 tx=0x7f9f4002f000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.272+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9f48054b60 con 0x7f9f380047c0 2024-01-20T08:12:03.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.465+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9f580c2260 con 0x7f9f380047c0 2024-01-20T08:12:03.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.466+0000 7f9f55600640 1 -- 172.21.15.100:0/1605718808 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9f48058180 con 0x7f9f380047c0 2024-01-20T08:12:03.469 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.468+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 msgr2=0x7f9f3006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.468+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 0x7f9f3006d3c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9f40033000 tx=0x7f9f4002f000 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.468+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 msgr2=0x7f9f58151850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.468+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9f48010910 tx=0x7f9f48010dd0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 shutdown_connections 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9f58146d50 0x7f9f5813eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9f3006af00 0x7f9f3006d3c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9f581472a0 0x7f9f5813e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 --2- 172.21.15.100:0/1605718808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f380047c0 0x7f9f58151850 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 >> 172.21.15.100:0/1605718808 conn(0x7f9f580c2940 msgr2=0x7f9f580718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:03.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 shutdown_connections 2024-01-20T08:12:03.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.469+0000 7f9f5fc00640 1 -- 172.21.15.100:0/1605718808 wait complete. 2024-01-20T08:12:03.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:12:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.692+0000 7eff8ea00640 1 Processor -- start 2024-01-20T08:12:03.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.692+0000 7eff8ea00640 1 -- start start 2024-01-20T08:12:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.693+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.693+0000 7eff8ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7eff880c1cd0 0x7eff8806cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.693+0000 7eff8ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff88154ba0 con 0x7eff880c1850 2024-01-20T08:12:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.693+0000 7eff8ea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8814bb00 con 0x7eff880c1cd0 2024-01-20T08:12:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.693+0000 7eff8ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff88155a00 con 0x7eff8814b720 2024-01-20T08:12:03.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.694+0000 7eff87e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.694+0000 7eff87e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:52148/0 (socket says 172.21.15.100:52148) 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.694+0000 7eff87e00640 1 -- 172.21.15.100:0/2468175407 learned_addr learned my addr 172.21.15.100:0/2468175407 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.694+0000 7eff8ca00640 1 --2- 172.21.15.100:0/2468175407 >> v2:172.21.15.110:3300/0 conn(0x7eff880c1cd0 0x7eff8806cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.695+0000 7eff87e00640 1 -- 172.21.15.100:0/2468175407 >> v2:172.21.15.110:3300/0 conn(0x7eff880c1cd0 msgr2=0x7eff8806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.695+0000 7eff87e00640 1 --2- 172.21.15.100:0/2468175407 >> v2:172.21.15.110:3300/0 conn(0x7eff880c1cd0 0x7eff8806cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.695+0000 7eff87e00640 1 -- 172.21.15.100:0/2468175407 >> v1:172.21.15.110:6789/0 conn(0x7eff880c1850 legacy=0x7eff8806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.695+0000 7eff87e00640 1 -- 172.21.15.100:0/2468175407 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff88154df0 con 0x7eff8814b720 2024-01-20T08:12:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.696+0000 7eff87e00640 1 --2- 172.21.15.100:0/2468175407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff80009870 tx=0x7eff8002b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c55c8460647ebeae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.697+0000 7eff86a00640 1 -- 172.21.15.100:0/2468175407 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80031640 con 0x7eff8814b720 2024-01-20T08:12:03.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.697+0000 7eff86a00640 1 -- 172.21.15.100:0/2468175407 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff800317a0 con 0x7eff8814b720 2024-01-20T08:12:03.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.697+0000 7eff86a00640 1 -- 172.21.15.100:0/2468175407 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80031b30 con 0x7eff8814b720 2024-01-20T08:12:03.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.697+0000 7eff8ea00640 1 -- 172.21.15.100:0/2468175407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 msgr2=0x7eff881515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.697+0000 7eff8ea00640 1 --2- 172.21.15.100:0/2468175407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7eff80009870 tx=0x7eff8002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 -- 172.21.15.100:0/2468175407 shutdown_connections 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 --2- 172.21.15.100:0/2468175407 >> v2:172.21.15.110:3300/0 conn(0x7eff880c1cd0 0x7eff8806cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 --2- 172.21.15.100:0/2468175407 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff8814b720 0x7eff881515b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 -- 172.21.15.100:0/2468175407 >> 172.21.15.100:0/2468175407 conn(0x7eff880c2940 msgr2=0x7eff880c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 -- 172.21.15.100:0/2468175407 shutdown_connections 2024-01-20T08:12:03.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.698+0000 7eff8ea00640 1 -- 172.21.15.100:0/2468175407 wait complete. 2024-01-20T08:12:03.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.699+0000 7eff8ea00640 1 Processor -- start 2024-01-20T08:12:03.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.699+0000 7eff8ea00640 1 -- start start 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 0x7eff88146630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff880c1cd0 0x7eff881eddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff88146b70 con 0x7eff8814b720 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff881ee300 con 0x7eff880c1850 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.700+0000 7eff8ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff88145a50 con 0x7eff880c1cd0 2024-01-20T08:12:03.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55020/0 (socket says 172.21.15.100:55020) 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 -- 172.21.15.100:0/132323129 learned_addr learned my addr 172.21.15.100:0/132323129 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff87e00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 0x7eff88146630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff87400640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff880c1cd0 0x7eff881eddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 -- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff880c1cd0 msgr2=0x7eff881eddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff880c1cd0 0x7eff881eddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 -- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 msgr2=0x7eff88146630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 0x7eff88146630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 -- 172.21.15.100:0/132323129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff800094d0 con 0x7eff8814b720 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff87e00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 0x7eff88146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:03.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.701+0000 7eff8ca00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e930 tx=0x7eff7800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.702+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff78009690 con 0x7eff8814b720 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.702+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff7800c980 con 0x7eff8814b720 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.702+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff88145d30 con 0x7eff8814b720 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.702+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff7800cd30 con 0x7eff8814b720 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.702+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff881ed5c0 con 0x7eff8814b720 2024-01-20T08:12:03.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.703+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff88146250 con 0x7eff8814b720 2024-01-20T08:12:03.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.704+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7eff78013470 con 0x7eff8814b720 2024-01-20T08:12:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.705+0000 7eff7fe00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 0x7eff6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.705+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7eff78089500 con 0x7eff8814b720 2024-01-20T08:12:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.705+0000 7eff87e00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 0x7eff6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:03.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.706+0000 7eff87e00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 0x7eff6006d390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff80036000 tx=0x7eff8003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:03.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.709+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7eff88146250 con 0x7eff8814b720 2024-01-20T08:12:03.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.903+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7eff88146250 con 0x7eff8814b720 2024-01-20T08:12:03.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.905+0000 7eff7fe00640 1 -- 172.21.15.100:0/132323129 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v48) v1 ==== 84+0+65 (secure 0 0 0) 0x7eff88146250 con 0x7eff8814b720 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:03.908 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 msgr2=0x7eff6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 0x7eff6006d390 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7eff80036000 tx=0x7eff8003c040 comp rx=0 tx=0).stop 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 msgr2=0x7eff8814a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7eff7800e930 tx=0x7eff7800edf0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 shutdown_connections 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff8814b720 0x7eff8814a2a0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7eff6006aed0 0x7eff6006d390 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7eff880c1cd0 0x7eff881eddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 --2- 172.21.15.100:0/132323129 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7eff880c1850 0x7eff88146630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:03.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 >> 172.21.15.100:0/132323129 conn(0x7eff880c2940 msgr2=0x7eff8806c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:03.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 shutdown_connections 2024-01-20T08:12:03.912 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:03.908+0000 7eff8ea00640 1 -- 172.21.15.100:0/132323129 wait complete. 2024-01-20T08:12:03.927 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T08:12:03.928 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T08:12:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.125+0000 7f7cfe000640 1 Processor -- start 2024-01-20T08:12:04.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.125+0000 7f7cfe000640 1 -- start start 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cfe000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7cf8070c00 0x7f7cf806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cfe000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cf815be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cfe000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf806d1d0 con 0x7f7cf8148080 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cfe000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80a8ce0 con 0x7f7cf8070c00 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cfe000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8148460 con 0x7f7cf80a84a0 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cf7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7cf8148080 0x7f7cf80c1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47132/0 (socket says 172.21.15.100:47132) 2024-01-20T08:12:04.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.127+0000 7f7cf7400640 1 -- 172.21.15.100:0/1641762002 learned_addr learned my addr 172.21.15.100:0/1641762002 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf7e00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cf815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cee800640 1 --2- 172.21.15.100:0/1641762002 >> v2:172.21.15.110:3300/0 conn(0x7f7cf8070c00 0x7f7cf806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3509906852 0 0) 0x7f7cf806d1d0 con 0x7f7cf8148080 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cd8005730 con 0x7f7cf8148080 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2039962042 0 0) 0x7f7cd8005730 con 0x7f7cf8148080 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 msgr2=0x7f7cf815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cf815be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 >> v2:172.21.15.110:3300/0 conn(0x7f7cf8070c00 msgr2=0x7f7cf806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 --2- 172.21.15.100:0/1641762002 >> v2:172.21.15.110:3300/0 conn(0x7f7cf8070c00 0x7f7cf806d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf80c2540 con 0x7f7cf8148080 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7ce8001670 con 0x7f7cf8148080 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 >> v1:172.21.15.100:6789/0 conn(0x7f7cf8148080 legacy=0x7f7cf80c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cd8005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006150 0x7f7cd80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cd8006f10 0x7f7cd8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80a8ce0 con 0x7f7cd8006f10 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8148460 con 0x7f7cd8006150 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.128+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd800dc40 con 0x7f7cf80a84a0 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cd8006f10 0x7f7cd8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7400640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cd8005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 -- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 msgr2=0x7f7cd8005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cee800640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006150 0x7f7cd80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cd8005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 -- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006150 msgr2=0x7f7cd80069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006150 0x7f7cd80069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7e00640 1 -- 172.21.15.100:0/1641762002 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd8005730 con 0x7f7cd8006f10 2024-01-20T08:12:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.129+0000 7f7cf7400640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf80a84a0 0x7f7cd8005b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.130+0000 7f7cf7e00640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cd8006f10 0x7f7cd8007390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ac0 tx=0x7f7cd8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3abb77db6886b77e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.130+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf002c6b0 con 0x7f7cd8006f10 2024-01-20T08:12:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.130+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf002c810 con 0x7f7cd8006f10 2024-01-20T08:12:04.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.130+0000 7f7cf6a00640 1 -- 172.21.15.100:0/1641762002 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf002cba0 con 0x7f7cd8006f10 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 -- 172.21.15.100:0/1641762002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cd8006f10 msgr2=0x7f7cd8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 --2- 172.21.15.100:0/1641762002 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cd8006f10 0x7f7cd8007390 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009ac0 tx=0x7f7cd8007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cf7e00640 1 -- 172.21.15.100:0/1641762002 reap_dead start 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 -- 172.21.15.100:0/1641762002 shutdown_connections 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 -- 172.21.15.100:0/1641762002 >> 172.21.15.100:0/1641762002 conn(0x7f7cf80c2b00 msgr2=0x7f7cf80c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 -- 172.21.15.100:0/1641762002 shutdown_connections 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.131+0000 7f7cfe000640 1 -- 172.21.15.100:0/1641762002 wait complete. 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.133+0000 7f7cfe000640 1 Processor -- start 2024-01-20T08:12:04.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.133+0000 7f7cfe000640 1 -- start start 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006f10 0x7f7cf80ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf814b2a0 0x7f7cf8141ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf81528a0 con 0x7f7cf814ae20 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8153d30 con 0x7f7cd8006f10 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cfe000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8152ab0 con 0x7f7cf814b2a0 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55050/0 (socket says 172.21.15.100:55050) 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 -- 172.21.15.100:0/2099298714 learned_addr learned my addr 172.21.15.100:0/2099298714 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 -- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf814b2a0 msgr2=0x7f7cf8141ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf814b2a0 0x7f7cf8141ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 -- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006f10 msgr2=0x7f7cf80ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006f10 0x7f7cf80ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 -- 172.21.15.100:0/2099298714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf8152d90 con 0x7f7cf814ae20 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.134+0000 7f7cee800640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000f3d0 tx=0x7f7ce000f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.135+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0016620 con 0x7f7cf814ae20 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.135+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce00167a0 con 0x7f7cf814ae20 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.135+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0016b50 con 0x7f7cf814ae20 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.135+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf8153070 con 0x7f7cf814ae20 2024-01-20T08:12:04.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.135+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf8153870 con 0x7f7cf814ae20 2024-01-20T08:12:04.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.136+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf81522d0 con 0x7f7cf814ae20 2024-01-20T08:12:04.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.137+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7ce0016cb0 con 0x7f7cf814ae20 2024-01-20T08:12:04.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.137+0000 7f7cefe00640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 0x7f7cd006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:04.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.138+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7ce008a350 con 0x7f7cf814ae20 2024-01-20T08:12:04.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.138+0000 7f7cf7400640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 0x7f7cd006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:04.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.138+0000 7f7cf7400640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 0x7f7cd006d390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8007a10 tx=0x7f7ce8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:04.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.144+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7cf81522d0 con 0x7f7cf814ae20 2024-01-20T08:12:04.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:04.335+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7cf81522d0 con 0x7f7cf814ae20 2024-01-20T08:12:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.015+0000 7f7cefe00640 1 -- 172.21.15.100:0/2099298714 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v49) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7cf81522d0 con 0x7f7cf814ae20 2024-01-20T08:12:05.019 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 msgr2=0x7f7cd006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 0x7f7cd006d390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8007a10 tx=0x7f7ce8009040 comp rx=0 tx=0).stop 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 msgr2=0x7f7cf8141990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000f3d0 tx=0x7f7ce000f890 comp rx=0 tx=0).stop 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 shutdown_connections 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7cd006aed0 0x7f7cd006d390 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7cf814b2a0 0x7f7cf8141ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7cf814ae20 0x7f7cf8141990 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 --2- 172.21.15.100:0/2099298714 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7cd8006f10 0x7f7cf80ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 >> 172.21.15.100:0/2099298714 conn(0x7f7cf80c2b00 msgr2=0x7f7cf8143760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 shutdown_connections 2024-01-20T08:12:05.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.020+0000 7f7cfe000640 1 -- 172.21.15.100:0/2099298714 wait complete. 2024-01-20T08:12:05.050 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:12:05.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.249+0000 7fbfdd200640 1 Processor -- start 2024-01-20T08:12:05.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.249+0000 7fbfdd200640 1 -- start start 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfdd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 0x7fbfd80a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfdd200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbfd8155cc0 0x7fbfd80aad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfdd200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfd81535a0 con 0x7fbfd80a89e0 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfdd200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfd81526d0 con 0x7fbfd8155cc0 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfdd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c0bb0 con 0x7fbfd814fce0 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfd5400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbfd80a89e0 0x7fbfd80aa660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47142/0 (socket says 172.21.15.100:47142) 2024-01-20T08:12:05.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.251+0000 7fbfd5400640 1 -- 172.21.15.100:0/2460628094 learned_addr learned my addr 172.21.15.100:0/2460628094 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd6800640 1 --2- 172.21.15.100:0/2460628094 >> v2:172.21.15.110:3300/0 conn(0x7fbfd8155cc0 0x7fbfd80aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 0x7fbfd80a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737312801 0 0) 0x7fbfd81535a0 con 0x7fbfd80a89e0 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbfb8003520 con 0x7fbfd80a89e0 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 991438970 0 0) 0x7fbfb8003520 con 0x7fbfd80a89e0 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 msgr2=0x7fbfd80a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 0x7fbfd80a84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 >> v2:172.21.15.110:3300/0 conn(0x7fbfd8155cc0 msgr2=0x7fbfd80aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:05.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 --2- 172.21.15.100:0/2460628094 >> v2:172.21.15.110:3300/0 conn(0x7fbfd8155cc0 0x7fbfd80aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd8152990 con 0x7fbfd80a89e0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fbfc80019f0 con 0x7fbfd80a89e0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 >> v1:172.21.15.100:6789/0 conn(0x7fbfd80a89e0 legacy=0x7fbfd80aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfb8003970 0x7fbfb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb80047c0 0x7fbfb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 0x7fbfb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81526d0 con 0x7fbfb8003970 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c0bb0 con 0x7fbfb80047c0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.252+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb800b9d0 con 0x7fbfd814fce0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfb8003970 0x7fbfb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5400640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb80047c0 0x7fbfb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 -- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 msgr2=0x7fbfb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfd814fce0 0x7fbfb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 -- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb80047c0 msgr2=0x7fbfb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:05.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfb80047c0 0x7fbfb8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.253+0000 7fbfd5e00640 1 -- 172.21.15.100:0/2460628094 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb8003520 con 0x7fbfb8003970 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.254+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfb8003970 0x7fbfb8003d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009af0 tx=0x7fbfb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55def476698cac6f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc002c710 con 0x7fbfb8003970 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc002c870 con 0x7fbfb8003970 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfd4a00640 1 -- 172.21.15.100:0/2460628094 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc002cc00 con 0x7fbfb8003970 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 -- 172.21.15.100:0/2460628094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfb8003970 msgr2=0x7fbfb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2460628094 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfb8003970 0x7fbfb8003d90 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0009af0 tx=0x7fbfb80057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfd6800640 1 -- 172.21.15.100:0/2460628094 reap_dead start 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 -- 172.21.15.100:0/2460628094 shutdown_connections 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 -- 172.21.15.100:0/2460628094 >> 172.21.15.100:0/2460628094 conn(0x7fbfd806a5e0 msgr2=0x7fbfd806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 -- 172.21.15.100:0/2460628094 shutdown_connections 2024-01-20T08:12:05.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.255+0000 7fbfdd200640 1 -- 172.21.15.100:0/2460628094 wait complete. 2024-01-20T08:12:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.257+0000 7fbfdd200640 1 Processor -- start 2024-01-20T08:12:05.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.257+0000 7fbfdd200640 1 -- start start 2024-01-20T08:12:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb8003970 0x7fbfd80c1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd8071a70 0x7fbfd81eddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c68e0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd81ed960 con 0x7fbfd8071a70 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfdd200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfd80c6b30 con 0x7fbfb8003970 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfd5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfd5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55066/0 (socket says 172.21.15.100:55066) 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.258+0000 7fbfd5400640 1 -- 172.21.15.100:0/2701126116 learned_addr learned my addr 172.21.15.100:0/2701126116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb8003970 0x7fbfd80c1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 -- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb8003970 msgr2=0x7fbfd80c1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb8003970 0x7fbfd80c1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 -- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd8071a70 msgr2=0x7fbfd81eddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd6800640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd8071a70 0x7fbfd81eddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd8071a70 0x7fbfd81eddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 -- 172.21.15.100:0/2701126116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfd80c6e10 con 0x7fbfd80c14f0 2024-01-20T08:12:05.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfd5400640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8002040 tx=0x7fbfc800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc8004d60 con 0x7fbfd80c14f0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfc800be80 con 0x7fbfd80c14f0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfc80072f0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.259+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfd81ed5f0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.260+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfd80c11d0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.261+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfd81ed780 con 0x7fbfd80c14f0 2024-01-20T08:12:05.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.262+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbfc8007450 con 0x7fbfd80c14f0 2024-01-20T08:12:05.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.263+0000 7fbfce000640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 0x7fbfb006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:05.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.263+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbfc80899d0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.263+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 0x7fbfb006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:05.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.264+0000 7fbfd5e00640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 0x7fbfb006d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0036000 tx=0x7fbfc0030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:05.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.267+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbfc80549d0 con 0x7fbfd80c14f0 2024-01-20T08:12:05.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:05.460+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbfd8067640 con 0x7fbfd80c14f0 2024-01-20T08:12:06.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.032+0000 7fbfce000640 1 -- 172.21.15.100:0/2701126116 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v50) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbfc8019070 con 0x7fbfd80c14f0 2024-01-20T08:12:06.035 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-20T08:12:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.035+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 msgr2=0x7fbfb006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.035+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 0x7fbfb006d390 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fbfc0036000 tx=0x7fbfc0030000 comp rx=0 tx=0).stop 2024-01-20T08:12:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.035+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 msgr2=0x7fbfd814dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.035+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fbfc8002040 tx=0x7fbfc800b4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 shutdown_connections 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbfd8071a70 0x7fbfd81eddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfd80c14f0 0x7fbfd814dea0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbfb006aed0 0x7fbfb006d390 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 --2- 172.21.15.100:0/2701126116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbfb8003970 0x7fbfd80c1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 >> 172.21.15.100:0/2701126116 conn(0x7fbfd806a5e0 msgr2=0x7fbfd81482f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:06.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.036+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 shutdown_connections 2024-01-20T08:12:06.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.039+0000 7fbfdd200640 1 -- 172.21.15.100:0/2701126116 wait complete. 2024-01-20T08:12:06.075 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T08:12:06.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.255+0000 7f455e400640 1 Processor -- start 2024-01-20T08:12:06.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.256+0000 7f455e400640 1 -- start start 2024-01-20T08:12:06.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f455814fd30 0x7f45580722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455e400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4558072830 0x7f45580c2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455e400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455806a950 con 0x7f4558155b30 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455e400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4558152580 con 0x7f455814fd30 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455e400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f455806ac30 con 0x7f4558072830 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f455814fd30 0x7f45580722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455d000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f455814fd30 0x7f45580722f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55078/0 (socket says 172.21.15.100:55078) 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.257+0000 7f455d000640 1 -- 172.21.15.100:0/283169181 learned_addr learned my addr 172.21.15.100:0/283169181 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.258+0000 7f455da00640 1 --2- 172.21.15.100:0/283169181 >> v2:172.21.15.110:3300/0 conn(0x7f4558072830 0x7f45580c2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.258+0000 7f455d000640 1 -- 172.21.15.100:0/283169181 >> v2:172.21.15.110:3300/0 conn(0x7f4558072830 msgr2=0x7f45580c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.258+0000 7f455d000640 1 --2- 172.21.15.100:0/283169181 >> v2:172.21.15.110:3300/0 conn(0x7f4558072830 0x7f45580c2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.258+0000 7f455d000640 1 -- 172.21.15.100:0/283169181 >> v1:172.21.15.100:6789/0 conn(0x7f4558155b30 legacy=0x7f4558152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.258+0000 7f455d000640 1 -- 172.21.15.100:0/283169181 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455806af10 con 0x7f455814fd30 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.259+0000 7f455d000640 1 --2- 172.21.15.100:0/283169181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f45580722f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f45580ad000 tx=0x7f455002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719ba8f77e773ad2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.259+0000 7f4557400640 1 -- 172.21.15.100:0/283169181 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455002c9f0 con 0x7f455814fd30 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.259+0000 7f4557400640 1 -- 172.21.15.100:0/283169181 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455002cb50 con 0x7f455814fd30 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.259+0000 7f4557400640 1 -- 172.21.15.100:0/283169181 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45500343f0 con 0x7f455814fd30 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 -- 172.21.15.100:0/283169181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 msgr2=0x7f45580722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 --2- 172.21.15.100:0/283169181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f45580722f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f45580ad000 tx=0x7f455002be50 comp rx=0 tx=0).stop 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 -- 172.21.15.100:0/283169181 shutdown_connections 2024-01-20T08:12:06.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 --2- 172.21.15.100:0/283169181 >> v2:172.21.15.110:3300/0 conn(0x7f4558072830 0x7f45580c2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 --2- 172.21.15.100:0/283169181 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f45580722f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 -- 172.21.15.100:0/283169181 >> 172.21.15.100:0/283169181 conn(0x7f45580a8a60 msgr2=0x7f45580a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 -- 172.21.15.100:0/283169181 shutdown_connections 2024-01-20T08:12:06.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.260+0000 7f455e400640 1 -- 172.21.15.100:0/283169181 wait complete. 2024-01-20T08:12:06.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.262+0000 7f455e400640 1 Processor -- start 2024-01-20T08:12:06.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.262+0000 7f455e400640 1 -- start start 2024-01-20T08:12:06.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4558072830 0x7f45580a7c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4558155b30 0x7f455814d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455814dae0 con 0x7f455814fd30 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4558155930 con 0x7f4558155b30 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455e400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45581edfd0 con 0x7f4558072830 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55088/0 (socket says 172.21.15.100:55088) 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 -- 172.21.15.100:0/955116520 learned_addr learned my addr 172.21.15.100:0/955116520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 -- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4558072830 msgr2=0x7f45580a7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4558072830 0x7f45580a7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 -- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4558155b30 msgr2=0x7f455814d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f455da00640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4558155b30 0x7f455814d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4558155b30 0x7f455814d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.263+0000 7f4557e00640 1 -- 172.21.15.100:0/955116520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4550009b30 con 0x7f455814fd30 2024-01-20T08:12:06.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f4557e00640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f454000c470 tx=0x7f454000c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45400052d0 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4540005450 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455814df80 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540007260 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.264+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4558155650 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.265+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455804e970 con 0x7f455814fd30 2024-01-20T08:12:06.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.266+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f45400073c0 con 0x7f455814fd30 2024-01-20T08:12:06.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.268+0000 7f4554c00640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 0x7f453006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:06.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.268+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f45400888b0 con 0x7f455814fd30 2024-01-20T08:12:06.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.268+0000 7f455d000640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 0x7f453006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:06.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.269+0000 7f455d000640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 0x7f453006d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4550035000 tx=0x7f455002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:06.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.273+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4540053870 con 0x7f455814fd30 2024-01-20T08:12:06.290 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:12:06.297 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:12:06.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:06.505+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f45581ee110 con 0x7f455814fd30 2024-01-20T08:12:07.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.065+0000 7f4554c00640 1 -- 172.21.15.100:0/955116520 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) v1 ==== 172+0+0 (secure 0 0 0) 0x7f45581ee110 con 0x7f455814fd30 2024-01-20T08:12:07.074 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 8 and data pool 9 2024-01-20T08:12:07.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 msgr2=0x7f453006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 0x7f453006d3c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f4550035000 tx=0x7f455002e000 comp rx=0 tx=0).stop 2024-01-20T08:12:07.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 msgr2=0x7f455814d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f454000c470 tx=0x7f454000c930 comp rx=0 tx=0).stop 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 shutdown_connections 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4558155b30 0x7f455814d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f455814fd30 0x7f455814d060 secure :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f454000c470 tx=0x7f454000c930 comp rx=0 tx=0).stop 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f453006af00 0x7f453006d3c0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 --2- 172.21.15.100:0/955116520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4558072830 0x7f45580a7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.079+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 >> 172.21.15.100:0/955116520 conn(0x7f45580a8a60 msgr2=0x7f45580a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.080+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 shutdown_connections 2024-01-20T08:12:07.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.080+0000 7f455e400640 1 -- 172.21.15.100:0/955116520 wait complete. 2024-01-20T08:12:07.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.277+0000 7f8be0400640 1 Processor -- start 2024-01-20T08:12:07.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.277+0000 7f8be0400640 1 -- start start 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8be0400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8bd8151f60 0x7f8bd80abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8be0400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd80c1670 con 0x7f8bd8070370 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8be0400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bd8070800 con 0x7f8bd8147f20 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8be0400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bd80c2210 con 0x7f8bd8151f60 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8bdd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8bd8151f60 0x7f8bd80abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8bde400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8bd8070370 0x7f8bd80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47162/0 (socket says 172.21.15.100:47162) 2024-01-20T08:12:07.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.279+0000 7f8bde400640 1 -- 172.21.15.100:0/320528648 learned_addr learned my addr 172.21.15.100:0/320528648 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.280+0000 7f8bdd000640 1 -- 172.21.15.100:0/320528648 >> v1:172.21.15.110:6789/0 conn(0x7f8bd8147f20 legacy=0x7f8bd80c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.280+0000 7f8bdd000640 1 -- 172.21.15.100:0/320528648 >> v1:172.21.15.100:6789/0 conn(0x7f8bd8070370 legacy=0x7f8bd80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.280+0000 7f8bdd000640 1 -- 172.21.15.100:0/320528648 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd80c0d40 con 0x7f8bd8151f60 2024-01-20T08:12:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.281+0000 7f8bdd000640 1 --2- 172.21.15.100:0/320528648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8151f60 0x7f8bd80abfd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097a0 tx=0x7f8bc002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ff3ad784e39bf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.281+0000 7f8bd7e00640 1 -- 172.21.15.100:0/320528648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0031830 con 0x7f8bd8151f60 2024-01-20T08:12:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.281+0000 7f8bd7e00640 1 -- 172.21.15.100:0/320528648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0031990 con 0x7f8bd8151f60 2024-01-20T08:12:07.284 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.281+0000 7f8bd7e00640 1 -- 172.21.15.100:0/320528648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0031d20 con 0x7f8bd8151f60 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 -- 172.21.15.100:0/320528648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8151f60 msgr2=0x7f8bd80abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 --2- 172.21.15.100:0/320528648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8151f60 0x7f8bd80abfd0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f8bc00097a0 tx=0x7f8bc002b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 -- 172.21.15.100:0/320528648 shutdown_connections 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 --2- 172.21.15.100:0/320528648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8151f60 0x7f8bd80abfd0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 -- 172.21.15.100:0/320528648 >> 172.21.15.100:0/320528648 conn(0x7f8bd806a5e0 msgr2=0x7f8bd806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 -- 172.21.15.100:0/320528648 shutdown_connections 2024-01-20T08:12:07.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.282+0000 7f8be0400640 1 -- 172.21.15.100:0/320528648 wait complete. 2024-01-20T08:12:07.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.284+0000 7f8be0400640 1 Processor -- start 2024-01-20T08:12:07.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.284+0000 7f8be0400640 1 -- start start 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 0x7f8bd8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8151f60 0x7f8bd8141e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8154830 con 0x7f8bd8070370 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8152f20 con 0x7f8bd8147f20 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8be0400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd8142380 con 0x7f8bd8151f60 2024-01-20T08:12:07.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8bdda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8bdda00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55100/0 (socket says 172.21.15.100:55100) 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.285+0000 7f8bdda00640 1 -- 172.21.15.100:0/2218607994 learned_addr learned my addr 172.21.15.100:0/2218607994 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdd000640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 0x7f8bd8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bde400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8151f60 0x7f8bd8141e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 -- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8151f60 msgr2=0x7f8bd8141e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8151f60 0x7f8bd8141e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 -- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 msgr2=0x7f8bd8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 0x7f8bd8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 -- 172.21.15.100:0/2218607994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc0009400 con 0x7f8bd8070370 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdd000640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 0x7f8bd8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bdda00640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c490 tx=0x7f8bc800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8012830 con 0x7f8bd8070370 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc8012990 con 0x7f8bd8070370 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bd814ea50 con 0x7f8bd8070370 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc8012d40 con 0x7f8bd8070370 2024-01-20T08:12:07.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.286+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bd81528d0 con 0x7f8bd8070370 2024-01-20T08:12:07.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.288+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bd804e970 con 0x7f8bd8070370 2024-01-20T08:12:07.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.289+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8bc801b400 con 0x7f8bd8070370 2024-01-20T08:12:07.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.290+0000 7f8bd5600640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 0x7f8bb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.290+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bc80895a0 con 0x7f8bd8070370 2024-01-20T08:12:07.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.290+0000 7f8bdd000640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 0x7f8bb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.291+0000 7f8bdd000640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 0x7f8bb006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0036000 tx=0x7f8bc0008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.295+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8bc8054460 con 0x7f8bd8070370 2024-01-20T08:12:07.487 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.484+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bd80c5b70 con 0x7f8bd8070370 2024-01-20T08:12:07.490 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.487+0000 7f8bd5600640 1 -- 172.21.15.100:0/2218607994 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16555 (secure 0 0 0) 0x7f8bc8057a80 con 0x7f8bd8070370 2024-01-20T08:12:07.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:07.491 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:06.507571+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 msgr2=0x7f8bb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 0x7f8bb006d3c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0036000 tx=0x7f8bc0008030 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 msgr2=0x7f8bd81df1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f8bc800c490 tx=0x7f8bc800c950 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 shutdown_connections 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8bb006af00 0x7f8bb006d3c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8bd8151f60 0x7f8bd8141e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8bd8147f20 0x7f8bd8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 --2- 172.21.15.100:0/2218607994 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8bd8070370 0x7f8bd81df1c0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 >> 172.21.15.100:0/2218607994 conn(0x7f8bd806a5e0 msgr2=0x7f8bd8145750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:07.493 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 shutdown_connections 2024-01-20T08:12:07.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.490+0000 7f8be0400640 1 -- 172.21.15.100:0/2218607994 wait complete. 2024-01-20T08:12:07.510 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.712+0000 7fce4c000640 1 Processor -- start 2024-01-20T08:12:07.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.712+0000 7fce4c000640 1 -- start start 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.713+0000 7fce4c000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fce440a93c0 0x7fce44153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce4c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce440a9940 con 0x7fce440aae00 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce4c000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce441500c0 con 0x7fce4414fce0 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce4c000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce44156810 con 0x7fce440a93c0 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce4a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fce440aae00 0x7fce440ab2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47166/0 (socket says 172.21.15.100:47166) 2024-01-20T08:12:07.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce4a000640 1 -- 172.21.15.100:0/2149307026 learned_addr learned my addr 172.21.15.100:0/2149307026 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:07.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 496828775 0 0) 0x7fce440a9940 con 0x7fce440aae00 2024-01-20T08:12:07.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce24003520 con 0x7fce440aae00 2024-01-20T08:12:07.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.714+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> v2:172.21.15.110:3300/0 conn(0x7fce440a93c0 0x7fce44153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2948345598 0 0) 0x7fce24003520 con 0x7fce440aae00 2024-01-20T08:12:07.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 >> v2:172.21.15.110:3300/0 conn(0x7fce440a93c0 msgr2=0x7fce44153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 --2- 172.21.15.100:0/2149307026 >> v2:172.21.15.110:3300/0 conn(0x7fce440a93c0 0x7fce44153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 >> v1:172.21.15.110:6789/0 conn(0x7fce4414fce0 legacy=0x7fce44152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce44156af0 con 0x7fce440aae00 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fce3c0019f0 con 0x7fce440aae00 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> v2:172.21.15.110:3300/0 conn(0x7fce440a93c0 0x7fce44153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 >> v1:172.21.15.100:6789/0 conn(0x7fce440aae00 legacy=0x7fce440ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce24003970 0x7fce24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 0x7fce24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce24005180 0x7fce2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44156810 con 0x7fce240047c0 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2400c0d0 con 0x7fce24003970 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2400c290 con 0x7fce24005180 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.715+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 0x7fce24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce49600640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce24003970 0x7fce24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce48c00640 1 -- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce24005180 msgr2=0x7fce2400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce24005180 0x7fce2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce48c00640 1 -- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce24003970 msgr2=0x7fce24003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce24003970 0x7fce24003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce48c00640 1 -- 172.21.15.100:0/2149307026 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce24003520 con 0x7fce240047c0 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.716+0000 7fce4a000640 1 -- 172.21.15.100:0/2149307026 reap_dead start 2024-01-20T08:12:07.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.717+0000 7fce48c00640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 0x7fce24004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0098a0 tx=0x7fce240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac744297d7b1c606 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.717+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c004230 con 0x7fce240047c0 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.717+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c004390 con 0x7fce240047c0 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.717+0000 7fce43e00640 1 -- 172.21.15.100:0/2149307026 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c003830 con 0x7fce240047c0 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.717+0000 7fce4c000640 1 -- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 msgr2=0x7fce24004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 0x7fce24004c40 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0098a0 tx=0x7fce240057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 -- 172.21.15.100:0/2149307026 shutdown_connections 2024-01-20T08:12:07.722 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 --2- 172.21.15.100:0/2149307026 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce240047c0 0x7fce24004c40 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 -- 172.21.15.100:0/2149307026 >> 172.21.15.100:0/2149307026 conn(0x7fce4406a5e0 msgr2=0x7fce4406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 -- 172.21.15.100:0/2149307026 shutdown_connections 2024-01-20T08:12:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.718+0000 7fce4c000640 1 -- 172.21.15.100:0/2149307026 wait complete. 2024-01-20T08:12:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.719+0000 7fce4c000640 1 Processor -- start 2024-01-20T08:12:07.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.720+0000 7fce4c000640 1 -- start start 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.720+0000 7fce4c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce240047c0 0x7fce4414cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.720+0000 7fce4c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.720+0000 7fce4c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 0x7fce44070db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce4c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce441dd480 con 0x7fce441e0c90 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce4c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce44070920 con 0x7fce441edb70 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce4c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce441ee490 con 0x7fce240047c0 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55124/0 (socket says 172.21.15.100:55124) 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 -- 172.21.15.100:0/3361069861 learned_addr learned my addr 172.21.15.100:0/3361069861 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce4a000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 0x7fce44070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 -- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce240047c0 msgr2=0x7fce4414cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce49600640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce240047c0 0x7fce4414cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce240047c0 0x7fce4414cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 -- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 msgr2=0x7fce44070db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 0x7fce44070db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce48c00640 1 -- 172.21.15.100:0/3361069861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce441dc9b0 con 0x7fce441e0c90 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.721+0000 7fce4a000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 0x7fce44070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce48c00640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0099c0 tx=0x7fce2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c030630 con 0x7fce441e0c90 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce2c030790 con 0x7fce441e0c90 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce441dcc90 con 0x7fce441e0c90 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce2c030b20 con 0x7fce441e0c90 2024-01-20T08:12:07.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.722+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce441e1a20 con 0x7fce441e0c90 2024-01-20T08:12:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.723+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce4404e970 con 0x7fce441e0c90 2024-01-20T08:12:07.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.724+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fce2c030c80 con 0x7fce441e0c90 2024-01-20T08:12:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.725+0000 7fce41600640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 0x7fce1c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.725+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce2c0ab4e0 con 0x7fce441e0c90 2024-01-20T08:12:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.725+0000 7fce49600640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 0x7fce1c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:07.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.726+0000 7fce49600640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 0x7fce1c06d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce34007fd0 tx=0x7fce34009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:07.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.729+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fce2c0763a0 con 0x7fce441e0c90 2024-01-20T08:12:07.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.926+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce44070a60 con 0x7fce441e0c90 2024-01-20T08:12:07.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.928+0000 7fce41600640 1 -- 172.21.15.100:0/3361069861 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+16555 (secure 0 0 0) 0x7fce2c00f040 con 0x7fce441e0c90 2024-01-20T08:12:07.931 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:07.931 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":51,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:06.507571+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 msgr2=0x7fce1c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 0x7fce1c06d390 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fce34007fd0 tx=0x7fce34009040 comp rx=0 tx=0).stop 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 msgr2=0x7fce441ed630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0099c0 tx=0x7fce2c004730 comp rx=0 tx=0).stop 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 shutdown_connections 2024-01-20T08:12:07.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fce441edb70 0x7fce44070db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fce441e0c90 0x7fce441ed630 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fce1c06aed0 0x7fce1c06d390 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 --2- 172.21.15.100:0/3361069861 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fce240047c0 0x7fce4414cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 >> 172.21.15.100:0/3361069861 conn(0x7fce4406a5e0 msgr2=0x7fce44151930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 shutdown_connections 2024-01-20T08:12:07.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:07.931+0000 7fce4c000640 1 -- 172.21.15.100:0/3361069861 wait complete. 2024-01-20T08:12:07.953 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T08:12:08.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.148+0000 7fa527800640 1 Processor -- start 2024-01-20T08:12:08.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.149+0000 7fa527800640 1 -- start start 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.150+0000 7fa527800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa52006cfe0 0x7fa52015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.150+0000 7fa527800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa520154ba0 con 0x7fa52014b720 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.150+0000 7fa527800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa520155a00 con 0x7fa5201515b0 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.150+0000 7fa527800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52014bb00 con 0x7fa52006cfe0 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa524e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa52014b720 0x7fa5200c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47172/0 (socket says 172.21.15.100:47172) 2024-01-20T08:12:08.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa524e00640 1 -- 172.21.15.100:0/3212718413 learned_addr learned my addr 172.21.15.100:0/3212718413 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560839542 0 0) 0x7fa520154ba0 con 0x7fa52014b720 2024-01-20T08:12:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> v2:172.21.15.110:3300/0 conn(0x7fa52006cfe0 0x7fa52015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa500005730 con 0x7fa52014b720 2024-01-20T08:12:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1669440814 0 0) 0x7fa500005730 con 0x7fa52014b720 2024-01-20T08:12:08.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 >> v2:172.21.15.110:3300/0 conn(0x7fa52006cfe0 msgr2=0x7fa52015cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 --2- 172.21.15.100:0/3212718413 >> v2:172.21.15.110:3300/0 conn(0x7fa52006cfe0 0x7fa52015cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 >> v1:172.21.15.110:6789/0 conn(0x7fa5201515b0 legacy=0x7fa52006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520154df0 con 0x7fa52014b720 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fa510001670 con 0x7fa52014b720 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.151+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> v2:172.21.15.110:3300/0 conn(0x7fa52006cfe0 0x7fa52015cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 >> v1:172.21.15.100:6789/0 conn(0x7fa52014b720 legacy=0x7fa5200c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa500005bd0 0x7fa500005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5000069d0 0x7fa500006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa50000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52014bb00 con 0x7fa5000074b0 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000e3d0 con 0x7fa5000069d0 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50000e590 con 0x7fa500005bd0 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa50000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa524e00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa500005bd0 0x7fa500005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa517e00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5000069d0 0x7fa500006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 -- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa500005bd0 msgr2=0x7fa500005ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa500005bd0 0x7fa500005ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 -- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5000069d0 msgr2=0x7fa500006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa5000069d0 0x7fa500006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa525800640 1 -- 172.21.15.100:0/3212718413 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500005730 con 0x7fa5000074b0 2024-01-20T08:12:08.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.152+0000 7fa524e00640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa500005bd0 0x7fa500005ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.153+0000 7fa525800640 1 -- 172.21.15.100:0/3212718413 reap_dead start 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.153+0000 7fa525800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa50000db90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5180073e0 tx=0x7fa500007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ae1b571252c99b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51802cdc0 con 0x7fa5000074b0 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa518034440 con 0x7fa5000074b0 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa51fe00640 1 -- 172.21.15.100:0/3212718413 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5180347f0 con 0x7fa5000074b0 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 -- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 msgr2=0x7fa50000db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa50000db90 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa5180073e0 tx=0x7fa500007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:08.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 -- 172.21.15.100:0/3212718413 shutdown_connections 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 --2- 172.21.15.100:0/3212718413 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa50000db90 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 -- 172.21.15.100:0/3212718413 >> 172.21.15.100:0/3212718413 conn(0x7fa5200c2940 msgr2=0x7fa5200c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 -- 172.21.15.100:0/3212718413 shutdown_connections 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.154+0000 7fa527800640 1 -- 172.21.15.100:0/3212718413 wait complete. 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.156+0000 7fa527800640 1 Processor -- start 2024-01-20T08:12:08.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.156+0000 7fa527800640 1 -- start start 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa520147a90 0x7fa5201482e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520148820 0x7fa5201468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520147540 con 0x7fa5000074b0 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa520149640 con 0x7fa520147a90 2024-01-20T08:12:08.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa527800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa520147790 con 0x7fa520148820 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa524e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa524e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55148/0 (socket says 172.21.15.100:55148) 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.157+0000 7fa524e00640 1 -- 172.21.15.100:0/2143846497 learned_addr learned my addr 172.21.15.100:0/2143846497 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa517e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa520147a90 0x7fa5201482e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa525800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520148820 0x7fa5201468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 -- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520148820 msgr2=0x7fa5201468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520148820 0x7fa5201468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 -- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa520147a90 msgr2=0x7fa5201482e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa520147a90 0x7fa5201482e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 -- 172.21.15.100:0/2143846497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5201eaa90 con 0x7fa5000074b0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa524e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa51000d810 tx=0x7fa51000dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100074e0 con 0x7fa5000074b0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa510007640 con 0x7fa5000074b0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5100049e0 con 0x7fa5000074b0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.158+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5201ead70 con 0x7fa5000074b0 2024-01-20T08:12:08.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.159+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5201540f0 con 0x7fa5000074b0 2024-01-20T08:12:08.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.160+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5201eaf80 con 0x7fa5000074b0 2024-01-20T08:12:08.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.161+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa510004b40 con 0x7fa5000074b0 2024-01-20T08:12:08.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.162+0000 7fa51d600640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 0x7fa4f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.162+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa510089140 con 0x7fa5000074b0 2024-01-20T08:12:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.162+0000 7fa517e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 0x7fa4f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:08.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.163+0000 7fa517e00640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 0x7fa4f806d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa520071190 tx=0x7fa508009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:08.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.166+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa510054130 con 0x7fa5000074b0 2024-01-20T08:12:08.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:08.400+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa52004e970 con 0x7fa5000074b0 2024-01-20T08:12:09.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.080+0000 7fa51d600640 1 -- 172.21.15.100:0/2143846497 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa510057750 con 0x7fa5000074b0 2024-01-20T08:12:09.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 msgr2=0x7fa4f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:09.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 0x7fa4f806d3c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa520071190 tx=0x7fa508009040 comp rx=0 tx=0).stop 2024-01-20T08:12:09.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 msgr2=0x7fa520153bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa51000d810 tx=0x7fa51000dcd0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 shutdown_connections 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa4f806af00 0x7fa4f806d3c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa520148820 0x7fa5201468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa520147a90 0x7fa5201482e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 --2- 172.21.15.100:0/2143846497 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa5000074b0 0x7fa520153bb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.083+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 >> 172.21.15.100:0/2143846497 conn(0x7fa5200c2940 msgr2=0x7fa52006d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:09.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.084+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 shutdown_connections 2024-01-20T08:12:09.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.084+0000 7fa527800640 1 -- 172.21.15.100:0/2143846497 wait complete. 2024-01-20T08:12:09.106 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:12:09.106 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T08:12:09.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.314+0000 7f1ce7800640 1 Processor -- start 2024-01-20T08:12:09.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.314+0000 7f1ce7800640 1 -- start start 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.315+0000 7f1ce7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce0158af0 0x7f1ce0157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.315+0000 7f1ce7800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1ce01550c0 0x7f1ce00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.315+0000 7f1ce7800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce0071d00 con 0x7f1ce00c24f0 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.315+0000 7f1ce7800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce0154ca0 con 0x7f1ce01550c0 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.315+0000 7f1ce7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce0071fa0 con 0x7f1ce0158af0 2024-01-20T08:12:09.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1ce01550c0 0x7f1ce00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1ce01550c0 0x7f1ce00c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47508/0 (socket says 172.21.15.100:47508) 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 -- 172.21.15.100:0/1019220758 learned_addr learned my addr 172.21.15.100:0/1019220758 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce4e00640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce0158af0 0x7f1ce0157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 -- 172.21.15.100:0/1019220758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce0158af0 msgr2=0x7f1ce0157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce0158af0 0x7f1ce0157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 -- 172.21.15.100:0/1019220758 >> v1:172.21.15.110:6789/0 conn(0x7f1ce00c24f0 legacy=0x7f1ce006e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:09.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.316+0000 7f1ce5800640 1 -- 172.21.15.100:0/1019220758 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0072280 con 0x7f1ce01550c0 2024-01-20T08:12:09.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.317+0000 7f1ce5800640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce01550c0 0x7f1ce00c1850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009e50 tx=0x7f1cd802bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9219b26161b7d617 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:09.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1cdf400640 1 -- 172.21.15.100:0/1019220758 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd802c950 con 0x7f1ce01550c0 2024-01-20T08:12:09.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1cdf400640 1 -- 172.21.15.100:0/1019220758 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd802cab0 con 0x7f1ce01550c0 2024-01-20T08:12:09.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1cdf400640 1 -- 172.21.15.100:0/1019220758 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd802ce40 con 0x7f1ce01550c0 2024-01-20T08:12:09.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 -- 172.21.15.100:0/1019220758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce01550c0 msgr2=0x7f1ce00c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce01550c0 0x7f1ce00c1850 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009e50 tx=0x7f1cd802bdb0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 -- 172.21.15.100:0/1019220758 shutdown_connections 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce01550c0 0x7f1ce00c1850 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1019220758 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce0158af0 0x7f1ce0157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 -- 172.21.15.100:0/1019220758 >> 172.21.15.100:0/1019220758 conn(0x7f1ce00c2940 msgr2=0x7f1ce00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 -- 172.21.15.100:0/1019220758 shutdown_connections 2024-01-20T08:12:09.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.318+0000 7f1ce7800640 1 -- 172.21.15.100:0/1019220758 wait complete. 2024-01-20T08:12:09.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.320+0000 7f1ce7800640 1 Processor -- start 2024-01-20T08:12:09.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.320+0000 7f1ce7800640 1 -- start start 2024-01-20T08:12:09.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce00c24f0 0x7f1ce01df350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce01550c0 0x7f1ce0142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce01df890 con 0x7f1ce0158af0 2024-01-20T08:12:09.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00c3c40 con 0x7f1ce01550c0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce01dece0 con 0x7f1ce00c24f0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47520/0 (socket says 172.21.15.100:47520) 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.321+0000 7f1ce5800640 1 -- 172.21.15.100:0/1985987397 learned_addr learned my addr 172.21.15.100:0/1985987397 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1cdfe00640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce01550c0 0x7f1ce0142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce4e00640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce00c24f0 0x7f1ce01df350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 -- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce00c24f0 msgr2=0x7f1ce01df350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce00c24f0 0x7f1ce01df350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 -- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce01550c0 msgr2=0x7f1ce0142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce01550c0 0x7f1ce0142790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 -- 172.21.15.100:0/1985987397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009b30 con 0x7f1ce0158af0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce5800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009e50 tx=0x7f1cd8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8009510 con 0x7f1ce0158af0 2024-01-20T08:12:09.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd803e450 con 0x7f1ce0158af0 2024-01-20T08:12:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd803e800 con 0x7f1ce0158af0 2024-01-20T08:12:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.322+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce01eb5a0 con 0x7f1ce0158af0 2024-01-20T08:12:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.323+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce00c3e90 con 0x7f1ce0158af0 2024-01-20T08:12:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.324+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce006da10 con 0x7f1ce0158af0 2024-01-20T08:12:09.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.325+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1cd803e960 con 0x7f1ce0158af0 2024-01-20T08:12:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.325+0000 7f1cdcc00640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 0x7f1cb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.326+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1cd80ac4d0 con 0x7f1ce0158af0 2024-01-20T08:12:09.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.326+0000 7f1ce4e00640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 0x7f1cb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:09.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.326+0000 7f1ce4e00640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 0x7f1cb806d390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0006fd0 tx=0x7f1cd0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:09.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.330+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1cd8077340 con 0x7f1ce0158af0 2024-01-20T08:12:09.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:09.556+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f1ce00c2d20 con 0x7f1ce0158af0 2024-01-20T08:12:10.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.083+0000 7f1cdcc00640 1 -- 172.21.15.100:0/1985987397 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cd807a960 con 0x7f1ce0158af0 2024-01-20T08:12:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.087+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 msgr2=0x7f1cb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.087+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 0x7f1cb806d390 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0006fd0 tx=0x7f1cd0008040 comp rx=0 tx=0).stop 2024-01-20T08:12:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.087+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 msgr2=0x7f1ce00c4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.087+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f1cd8009e50 tx=0x7f1cd8004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 shutdown_connections 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1ce0158af0 0x7f1ce00c4690 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1ce01550c0 0x7f1ce0142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cb806aed0 0x7f1cb806d390 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 --2- 172.21.15.100:0/1985987397 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1ce00c24f0 0x7f1ce01df350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 >> 172.21.15.100:0/1985987397 conn(0x7f1ce00c2940 msgr2=0x7f1ce0070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 shutdown_connections 2024-01-20T08:12:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.088+0000 7f1ce7800640 1 -- 172.21.15.100:0/1985987397 wait complete. 2024-01-20T08:12:10.111 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T08:12:10.111 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.310+0000 7f55a5400640 1 Processor -- start 2024-01-20T08:12:10.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.310+0000 7f55a5400640 1 -- start start 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.311+0000 7f55a5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55a014fce0 0x7f55a0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f55a5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f55a5400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55a00a9940 con 0x7f55a0153440 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f55a5400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55a01500c0 con 0x7f55a014fce0 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f55a5400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0156810 con 0x7f55a00a93c0 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55a014fce0 0x7f55a0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f55a014fce0 0x7f55a0153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47532/0 (socket says 172.21.15.100:47532) 2024-01-20T08:12:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 -- 172.21.15.100:0/3749509480 learned_addr learned my addr 172.21.15.100:0/3749509480 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 -- 172.21.15.100:0/3749509480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 msgr2=0x7f55a0152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 --2- 172.21.15.100:0/3749509480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 -- 172.21.15.100:0/3749509480 >> v1:172.21.15.110:6789/0 conn(0x7f55a0153440 legacy=0x7f55a00aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:10.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.312+0000 7f559e800640 1 -- 172.21.15.100:0/3749509480 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55a0156af0 con 0x7f55a014fce0 2024-01-20T08:12:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.313+0000 7f559e800640 1 --2- 172.21.15.100:0/3749509480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a014fce0 0x7f55a0153b80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5590009e50 tx=0x7f559002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90c36d1dd98ad6b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f559d400640 1 -- 172.21.15.100:0/3749509480 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559002ca70 con 0x7f55a014fce0 2024-01-20T08:12:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f559d400640 1 -- 172.21.15.100:0/3749509480 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559002cbd0 con 0x7f55a014fce0 2024-01-20T08:12:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f559d400640 1 -- 172.21.15.100:0/3749509480 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55900343f0 con 0x7f55a014fce0 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 -- 172.21.15.100:0/3749509480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a014fce0 msgr2=0x7f55a0153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 --2- 172.21.15.100:0/3749509480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a014fce0 0x7f55a0153b80 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5590009e50 tx=0x7f559002bed0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 -- 172.21.15.100:0/3749509480 shutdown_connections 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 --2- 172.21.15.100:0/3749509480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a0152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 --2- 172.21.15.100:0/3749509480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a014fce0 0x7f55a0153b80 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.314+0000 7f55a5400640 1 -- 172.21.15.100:0/3749509480 >> 172.21.15.100:0/3749509480 conn(0x7f55a006a5e0 msgr2=0x7f55a006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.315+0000 7f55a5400640 1 -- 172.21.15.100:0/3749509480 shutdown_connections 2024-01-20T08:12:10.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.315+0000 7f55a5400640 1 -- 172.21.15.100:0/3749509480 wait complete. 2024-01-20T08:12:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.316+0000 7f55a5400640 1 Processor -- start 2024-01-20T08:12:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.316+0000 7f55a5400640 1 -- start start 2024-01-20T08:12:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a01ee010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55a014fce0 0x7f55a0151630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0071c30 con 0x7f55a0153440 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55a0151e40 con 0x7f55a014fce0 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.317+0000 7f55a5400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55a00c03c0 con 0x7f55a00a93c0 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47544/0 (socket says 172.21.15.100:47544) 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 -- 172.21.15.100:0/900857031 learned_addr learned my addr 172.21.15.100:0/900857031 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559de00640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55a014fce0 0x7f55a0151630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559e800640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a01ee010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 -- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 msgr2=0x7f55a01ee010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a01ee010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 -- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55a014fce0 msgr2=0x7f55a0151630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55a014fce0 0x7f55a0151630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 -- 172.21.15.100:0/900857031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5590009b30 con 0x7f55a0153440 2024-01-20T08:12:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.318+0000 7f559f200640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f559800b490 tx=0x7f559800b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.319+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598011830 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.319+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55980119b0 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.319+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5598011d60 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.319+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55a0071ea0 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.319+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55a00bfea0 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.320+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55a00723c0 con 0x7f55a0153440 2024-01-20T08:12:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.321+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f559801a400 con 0x7f55a0153440 2024-01-20T08:12:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.322+0000 7f5596a00640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 0x7f557806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.322+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5598089650 con 0x7f55a0153440 2024-01-20T08:12:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.322+0000 7f559e800640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 0x7f557806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.323+0000 7f559e800640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 0x7f557806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5590035000 tx=0x7f5590030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.326+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f55980545b0 con 0x7f55a0153440 2024-01-20T08:12:10.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.537+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f55a00bfce0 con 0x7f55a0153440 2024-01-20T08:12:10.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.538+0000 7f5596a00640 1 -- 172.21.15.100:0/900857031 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4947 (secure 0 0 0) 0x7f5598057bd0 con 0x7f55a0153440 2024-01-20T08:12:10.541 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:10.542 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-01-20T08:12:10.542 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 32 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 msgr2=0x7f557806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 0x7f557806d3c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5590035000 tx=0x7f5590030000 comp rx=0 tx=0).stop 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 msgr2=0x7f55a01e7290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f559800b490 tx=0x7f559800b950 comp rx=0 tx=0).stop 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 shutdown_connections 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f55a0153440 0x7f55a01e7290 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f55a014fce0 0x7f55a0151630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557806af00 0x7f557806d3c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 --2- 172.21.15.100:0/900857031 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f55a00a93c0 0x7f55a01ee010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 >> 172.21.15.100:0/900857031 conn(0x7f55a006a5e0 msgr2=0x7f55a00aae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 shutdown_connections 2024-01-20T08:12:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.541+0000 7f55a5400640 1 -- 172.21.15.100:0/900857031 wait complete. 2024-01-20T08:12:10.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:10.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.758+0000 7f5139c00640 1 Processor -- start 2024-01-20T08:12:10.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.758+0000 7f5139c00640 1 -- start start 2024-01-20T08:12:10.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.759+0000 7f5139c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5134071220 0x7f5134071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5139c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f51340bfae0 0x7f5134151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5139c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51340c0fb0 con 0x7f51341521e0 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5139c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340c04a0 con 0x7f5134071220 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5139c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513406def0 con 0x7f51340bfae0 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5134071220 0x7f5134071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5134071220 0x7f5134071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47556/0 (socket says 172.21.15.100:47556) 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 -- 172.21.15.100:0/1424941643 learned_addr learned my addr 172.21.15.100:0/1424941643 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:10.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 -- 172.21.15.100:0/1424941643 >> v2:172.21.15.110:3300/0 conn(0x7f51340bfae0 msgr2=0x7f5134151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 --2- 172.21.15.100:0/1424941643 >> v2:172.21.15.110:3300/0 conn(0x7f51340bfae0 0x7f5134151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 -- 172.21.15.100:0/1424941643 >> v1:172.21.15.110:6789/0 conn(0x7f51341521e0 legacy=0x7f5134157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.760+0000 7f5132a00640 1 -- 172.21.15.100:0/1424941643 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513406e1d0 con 0x7f5134071220 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.761+0000 7f5132a00640 1 --2- 172.21.15.100:0/1424941643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f5134071600 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f513406e620 tx=0x7f512402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b2e90788f79025 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5132000640 1 -- 172.21.15.100:0/1424941643 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124031750 con 0x7f5134071220 2024-01-20T08:12:10.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5132000640 1 -- 172.21.15.100:0/1424941643 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51240318b0 con 0x7f5134071220 2024-01-20T08:12:10.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5132000640 1 -- 172.21.15.100:0/1424941643 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124031c40 con 0x7f5134071220 2024-01-20T08:12:10.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 -- 172.21.15.100:0/1424941643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 msgr2=0x7f5134071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 --2- 172.21.15.100:0/1424941643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f5134071600 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f513406e620 tx=0x7f512402b7f0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 -- 172.21.15.100:0/1424941643 shutdown_connections 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 --2- 172.21.15.100:0/1424941643 >> v2:172.21.15.110:3300/0 conn(0x7f51340bfae0 0x7f5134151ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 --2- 172.21.15.100:0/1424941643 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f5134071600 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 -- 172.21.15.100:0/1424941643 >> 172.21.15.100:0/1424941643 conn(0x7f513406a5e0 msgr2=0x7f513406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 -- 172.21.15.100:0/1424941643 shutdown_connections 2024-01-20T08:12:10.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.762+0000 7f5139c00640 1 -- 172.21.15.100:0/1424941643 wait complete. 2024-01-20T08:12:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.764+0000 7f5139c00640 1 Processor -- start 2024-01-20T08:12:10.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.764+0000 7f5139c00640 1 -- start start 2024-01-20T08:12:10.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51340bfae0 0x7f51341ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51341521e0 0x7f51341ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134155e90 con 0x7f5134071220 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51341578f0 con 0x7f51341521e0 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5139c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5134155350 con 0x7f51340bfae0 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5132a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5132a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47564/0 (socket says 172.21.15.100:47564) 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.765+0000 7f5132a00640 1 -- 172.21.15.100:0/1004350442 learned_addr learned my addr 172.21.15.100:0/1004350442 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f512be00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51340bfae0 0x7f51341ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5133400640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51341521e0 0x7f51341ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 -- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51340bfae0 msgr2=0x7f51341ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51340bfae0 0x7f51341ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 -- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51341521e0 msgr2=0x7f51341ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51341521e0 0x7f51341ea810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 -- 172.21.15.100:0/1004350442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51240094d0 con 0x7f5134071220 2024-01-20T08:12:10.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f5132a00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f512402b830 tx=0x7f51240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5124033c60 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.766+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5124033de0 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.767+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512403d6b0 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.767+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51341ee220 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.767+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51341555a0 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.768+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513404e970 con 0x7f5134071220 2024-01-20T08:12:10.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.768+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f512403a040 con 0x7f5134071220 2024-01-20T08:12:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.769+0000 7f512aa00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 0x7f510c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.769+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f51240ab6f0 con 0x7f5134071220 2024-01-20T08:12:10.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.770+0000 7f512be00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 0x7f510c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:10.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.770+0000 7f512be00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 0x7f510c06d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f513414eb90 tx=0x7f511c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:10.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.773+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f51240765b0 con 0x7f5134071220 2024-01-20T08:12:10.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.952+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5134072190 con 0x7f5134071220 2024-01-20T08:12:10.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.954+0000 7f512aa00640 1 -- 172.21.15.100:0/1004350442 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f5124079bd0 con 0x7f5134071220 2024-01-20T08:12:10.958 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:10.958 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:08.036813+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 msgr2=0x7f510c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 0x7f510c06d3c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f513414eb90 tx=0x7f511c008040 comp rx=0 tx=0).stop 2024-01-20T08:12:10.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 msgr2=0x7f51340c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f512402b830 tx=0x7f51240046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 shutdown_connections 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f51341521e0 0x7f51341ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f510c06af00 0x7f510c06d3c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f51340bfae0 0x7f51341ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 --2- 172.21.15.100:0/1004350442 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5134071220 0x7f51340c5260 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 >> 172.21.15.100:0/1004350442 conn(0x7f513406a5e0 msgr2=0x7f51340c2a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.957+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 shutdown_connections 2024-01-20T08:12:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:10.958+0000 7f5139c00640 1 -- 172.21.15.100:0/1004350442 wait complete. 2024-01-20T08:12:10.978 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:12:10.978 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.174+0000 7f3fba800640 1 Processor -- start 2024-01-20T08:12:11.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.174+0000 7f3fba800640 1 -- start start 2024-01-20T08:12:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fba800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3fb406b3b0 0x7f3fb4155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fba800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fba800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fb4155790 con 0x7f3fb41519a0 2024-01-20T08:12:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fba800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40c8650 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fba800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fb40c8070 con 0x7f3fb406b3b0 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb3e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3fb41519a0 0x7f3fb4157dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35708/0 (socket says 172.21.15.100:35708) 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47574/0 (socket says 172.21.15.100:47574) 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb3e00640 1 -- 172.21.15.100:0/1041935873 learned_addr learned my addr 172.21.15.100:0/1041935873 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb3400640 1 --2- 172.21.15.100:0/1041935873 >> v2:172.21.15.110:3300/0 conn(0x7f3fb406b3b0 0x7f3fb4155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1041935873 >> v2:172.21.15.110:3300/0 conn(0x7f3fb406b3b0 msgr2=0x7f3fb4155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/1041935873 >> v2:172.21.15.110:3300/0 conn(0x7f3fb406b3b0 0x7f3fb4155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1041935873 >> v1:172.21.15.100:6789/0 conn(0x7f3fb41519a0 legacy=0x7f3fb4157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.176+0000 7f3fb2a00640 1 -- 172.21.15.100:0/1041935873 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb40c4dd0 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.177+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/1041935873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40c7880 tx=0x7f3f9c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b586ca7273441e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fb2000640 1 -- 172.21.15.100:0/1041935873 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c02e070 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fb2000640 1 -- 172.21.15.100:0/1041935873 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f9c0315a0 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fb2000640 1 -- 172.21.15.100:0/1041935873 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9c031930 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 -- 172.21.15.100:0/1041935873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb40c8ae0 msgr2=0x7f3fb4155cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 --2- 172.21.15.100:0/1041935873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3fb40c7880 tx=0x7f3f9c02b840 comp rx=0 tx=0).stop 2024-01-20T08:12:11.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 -- 172.21.15.100:0/1041935873 shutdown_connections 2024-01-20T08:12:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 --2- 172.21.15.100:0/1041935873 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb40c8ae0 0x7f3fb4155cc0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 --2- 172.21.15.100:0/1041935873 >> v2:172.21.15.110:3300/0 conn(0x7f3fb406b3b0 0x7f3fb4155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.178+0000 7f3fba800640 1 -- 172.21.15.100:0/1041935873 >> 172.21.15.100:0/1041935873 conn(0x7f3fb40abc00 msgr2=0x7f3fb40ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.179+0000 7f3fba800640 1 -- 172.21.15.100:0/1041935873 shutdown_connections 2024-01-20T08:12:11.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.179+0000 7f3fba800640 1 -- 172.21.15.100:0/1041935873 wait complete. 2024-01-20T08:12:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.180+0000 7f3fba800640 1 Processor -- start 2024-01-20T08:12:11.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.180+0000 7f3fba800640 1 -- start start 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb406b3b0 0x7f3fb4149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 0x7f3fb41476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41ea270 con 0x7f3fb41519a0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb4148160 con 0x7f3fb406b3b0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.181+0000 7f3fba800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fb41586e0 con 0x7f3fb40c8ae0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47580/0 (socket says 172.21.15.100:47580) 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 -- 172.21.15.100:0/529787689 learned_addr learned my addr 172.21.15.100:0/529787689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3400640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb406b3b0 0x7f3fb4149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 0x7f3fb41476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 -- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 msgr2=0x7f3fb41476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 0x7f3fb41476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 -- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb406b3b0 msgr2=0x7f3fb4149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb406b3b0 0x7f3fb4149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 -- 172.21.15.100:0/529787689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f9c009400 con 0x7f3fb41519a0 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb2a00640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 0x7f3fb41476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fb3e00640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00cab0 tx=0x7f3fac00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.182+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac00ac30 con 0x7f3fb41519a0 2024-01-20T08:12:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.183+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac00ad90 con 0x7f3fb41519a0 2024-01-20T08:12:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.183+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac012600 con 0x7f3fb41519a0 2024-01-20T08:12:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.183+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fb4158980 con 0x7f3fb41519a0 2024-01-20T08:12:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.183+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fb41532a0 con 0x7f3fb41519a0 2024-01-20T08:12:11.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.184+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fb41ed7e0 con 0x7f3fb41519a0 2024-01-20T08:12:11.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.185+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3fac012760 con 0x7f3fb41519a0 2024-01-20T08:12:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.186+0000 7f3fab400640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 0x7f3f8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.186+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fac0891a0 con 0x7f3fb41519a0 2024-01-20T08:12:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.186+0000 7f3fb3400640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 0x7f3f8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.187+0000 7f3fb3400640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 0x7f3f8c06d390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006fd0 tx=0x7f3fa4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.191+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3fac0541b0 con 0x7f3fb41519a0 2024-01-20T08:12:11.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.377+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3fb406a8e0 con 0x7f3f8c06aed0 2024-01-20T08:12:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.398+0000 7f3fab400640 1 -- 172.21.15.100:0/529787689 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274309 (secure 0 0 0) 0x7f3fb406a8e0 con 0x7f3f8c06aed0 2024-01-20T08:12:11.405 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 msgr2=0x7f3f8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 0x7f3f8c06d390 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3fa4006fd0 tx=0x7f3fa4008040 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 msgr2=0x7f3fb4147c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00cab0 tx=0x7f3fac00cf70 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 shutdown_connections 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3fb41519a0 0x7f3fb4147c20 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3f8c06aed0 0x7f3f8c06d390 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3fb40c8ae0 0x7f3fb41476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 --2- 172.21.15.100:0/529787689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3fb406b3b0 0x7f3fb4149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 >> 172.21.15.100:0/529787689 conn(0x7f3fb40abc00 msgr2=0x7f3fb414db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 shutdown_connections 2024-01-20T08:12:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.405+0000 7f3fba800640 1 -- 172.21.15.100:0/529787689 wait complete. 2024-01-20T08:12:11.426 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-01-20T08:12:09.922613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238536,"kb_used_data":5736,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736184,"statfs":{"total":773094113280,"available":772849852416,"internally_reserved":0,"allocated":5873664,"data_stored":3123008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.902987"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032845+0000","last_change":"2024-01-20T08:12:05.032845+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032845+0000","last_undegraded":"2024-01-20T08:12:05.032845+0000","last_fullsized":"2024-01-20T08:12:05.032845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023858+0000","last_change":"2024-01-20T08:12:05.023858+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023858+0000","last_undegraded":"2024-01-20T08:12:05.023858+0000","last_fullsized":"2024-01-20T08:12:05.023858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.031724+0000","last_change":"2024-01-20T08:12:05.031724+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.031724+0000","last_undegraded":"2024-01-20T08:12:05.031724+0000","last_fullsized":"2024-01-20T08:12:05.031724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.034243+0000","last_change":"2024-01-20T08:12:05.034243+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.034243+0000","last_undegraded":"2024-01-20T08:12:05.034243+0000","last_fullsized":"2024-01-20T08:12:05.034243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023572+0000","last_change":"2024-01-20T08:12:05.023572+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023572+0000","last_undegraded":"2024-01-20T08:12:05.023572+0000","last_fullsized":"2024-01-20T08:12:05.023572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033116+0000","last_change":"2024-01-20T08:12:05.033116+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033116+0000","last_undegraded":"2024-01-20T08:12:05.033116+0000","last_fullsized":"2024-01-20T08:12:05.033116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032349+0000","last_change":"2024-01-20T08:12:05.032349+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032349+0000","last_undegraded":"2024-01-20T08:12:05.032349+0000","last_fullsized":"2024-01-20T08:12:05.032349+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023420+0000","last_change":"2024-01-20T08:12:05.023420+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023420+0000","last_undegraded":"2024-01-20T08:12:05.023420+0000","last_fullsized":"2024-01-20T08:12:05.023420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029922+0000","last_change":"2024-01-20T08:12:05.029922+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029922+0000","last_undegraded":"2024-01-20T08:12:05.029922+0000","last_fullsized":"2024-01-20T08:12:05.029922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023289+0000","last_change":"2024-01-20T08:12:05.023289+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023289+0000","last_undegraded":"2024-01-20T08:12:05.023289+0000","last_fullsized":"2024-01-20T08:12:05.023289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029857+0000","last_change":"2024-01-20T08:12:05.029857+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029857+0000","last_undegraded":"2024-01-20T08:12:05.029857+0000","last_fullsized":"2024-01-20T08:12:05.029857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023457+0000","last_change":"2024-01-20T08:12:05.023457+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023457+0000","last_undegraded":"2024-01-20T08:12:05.023457+0000","last_fullsized":"2024-01-20T08:12:05.023457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023827+0000","last_change":"2024-01-20T08:12:05.023827+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023827+0000","last_undegraded":"2024-01-20T08:12:05.023827+0000","last_fullsized":"2024-01-20T08:12:05.023827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040516+0000","last_change":"2024-01-20T08:12:05.040516+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040516+0000","last_undegraded":"2024-01-20T08:12:05.040516+0000","last_fullsized":"2024-01-20T08:12:05.040516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.030951+0000","last_change":"2024-01-20T08:12:05.030951+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.030951+0000","last_undegraded":"2024-01-20T08:12:05.030951+0000","last_fullsized":"2024-01-20T08:12:05.030951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029915+0000","last_change":"2024-01-20T08:12:05.029915+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029915+0000","last_undegraded":"2024-01-20T08:12:05.029915+0000","last_fullsized":"2024-01-20T08:12:05.029915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029268+0000","last_change":"2024-01-20T08:12:05.029268+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029268+0000","last_undegraded":"2024-01-20T08:12:05.029268+0000","last_fullsized":"2024-01-20T08:12:05.029268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033344+0000","last_change":"2024-01-20T08:12:05.033344+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033344+0000","last_undegraded":"2024-01-20T08:12:05.033344+0000","last_fullsized":"2024-01-20T08:12:05.033344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033287+0000","last_change":"2024-01-20T08:12:05.033287+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033287+0000","last_undegraded":"2024-01-20T08:12:05.033287+0000","last_fullsized":"2024-01-20T08:12:05.033287+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.031697+0000","last_change":"2024-01-20T08:12:05.031697+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.031697+0000","last_undegraded":"2024-01-20T08:12:05.031697+0000","last_fullsized":"2024-01-20T08:12:05.031697+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023290+0000","last_change":"2024-01-20T08:12:05.023290+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023290+0000","last_undegraded":"2024-01-20T08:12:05.023290+0000","last_fullsized":"2024-01-20T08:12:05.023290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.024301+0000","last_change":"2024-01-20T08:12:05.024301+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.024301+0000","last_undegraded":"2024-01-20T08:12:05.024301+0000","last_fullsized":"2024-01-20T08:12:05.024301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.030795+0000","last_change":"2024-01-20T08:12:05.030795+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.030795+0000","last_undegraded":"2024-01-20T08:12:05.030795+0000","last_fullsized":"2024-01-20T08:12:05.030795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.025232+0000","last_change":"2024-01-20T08:12:05.025232+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.025232+0000","last_undegraded":"2024-01-20T08:12:05.025232+0000","last_fullsized":"2024-01-20T08:12:05.025232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032119+0000","last_change":"2024-01-20T08:12:05.032119+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032119+0000","last_undegraded":"2024-01-20T08:12:05.032119+0000","last_fullsized":"2024-01-20T08:12:05.032119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040479+0000","last_change":"2024-01-20T08:12:05.040479+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040479+0000","last_undegraded":"2024-01-20T08:12:05.040479+0000","last_fullsized":"2024-01-20T08:12:05.040479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033189+0000","last_change":"2024-01-20T08:12:05.033189+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033189+0000","last_undegraded":"2024-01-20T08:12:05.033189+0000","last_fullsized":"2024-01-20T08:12:05.033189+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.025200+0000","last_change":"2024-01-20T08:12:05.025200+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.025200+0000","last_undegraded":"2024-01-20T08:12:05.025200+0000","last_fullsized":"2024-01-20T08:12:05.025200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023466+0000","last_change":"2024-01-20T08:12:05.023466+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023466+0000","last_undegraded":"2024-01-20T08:12:05.023466+0000","last_fullsized":"2024-01-20T08:12:05.023466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023561+0000","last_change":"2024-01-20T08:12:05.023561+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023561+0000","last_undegraded":"2024-01-20T08:12:05.023561+0000","last_fullsized":"2024-01-20T08:12:05.023561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.024861+0000","last_change":"2024-01-20T08:12:05.024861+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.024861+0000","last_undegraded":"2024-01-20T08:12:05.024861+0000","last_fullsized":"2024-01-20T08:12:05.024861+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040582+0000","last_change":"2024-01-20T08:12:05.040582+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040582+0000","last_undegraded":"2024-01-20T08:12:05.040582+0000","last_fullsized":"2024-01-20T08:12:05.040582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":189,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T08:12:05.032023+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:05.032023+0000","last_peered":"2024-01-20T08:12:05.032023+0000","last_clean":"2024-01-20T08:12:05.032023+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:05.032023+0000","last_undegraded":"2024-01-20T08:12:05.032023+0000","last_fullsized":"2024-01-20T08:12:05.032023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1179648,"data_stored":833152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":0.877}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.393},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.48}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3480000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.5720000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.698}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.526},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.248}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.2430000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.121}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.874}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.0409999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.411}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.371},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.476}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.448}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.91500000000000004}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.056},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.218}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.155}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.321}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":0.378},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.874},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.117},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":1.47},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.264}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.504},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.1899999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.339},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4470000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.546},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.4059999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":0.871}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.167}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.425},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3879999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.208},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.252},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.458}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.359}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.155}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.272},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.196}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":833152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.3859999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.4179999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.536},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.3520000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.262}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.508},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.294}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.448},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.472}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:11.432 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:11.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.678+0000 7f34a2000640 1 Processor -- start 2024-01-20T08:12:11.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.678+0000 7f34a2000640 1 -- start start 2024-01-20T08:12:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c14fce0 0x7f349c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f349c0a93c0 0x7f349c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f349c153440 0x7f349c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c0a9940 con 0x7f349c0a93c0 2024-01-20T08:12:11.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f349c1500c0 con 0x7f349c153440 2024-01-20T08:12:11.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.679+0000 7f34a2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c156810 con 0x7f349c14fce0 2024-01-20T08:12:11.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f349c0a93c0 0x7f349c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f349c0a93c0 0x7f349c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47586/0 (socket says 172.21.15.100:47586) 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 -- 172.21.15.100:0/432989944 learned_addr learned my addr 172.21.15.100:0/432989944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349be00640 1 --2- 172.21.15.100:0/432989944 >> v2:172.21.15.110:3300/0 conn(0x7f349c153440 0x7f349c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349b400640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c14fce0 0x7f349c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 -- 172.21.15.100:0/432989944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c14fce0 msgr2=0x7f349c153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c14fce0 0x7f349c153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 -- 172.21.15.100:0/432989944 >> v2:172.21.15.110:3300/0 conn(0x7f349c153440 msgr2=0x7f349c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 --2- 172.21.15.100:0/432989944 >> v2:172.21.15.110:3300/0 conn(0x7f349c153440 0x7f349c0aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.680+0000 7f349aa00640 1 -- 172.21.15.100:0/432989944 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c156af0 con 0x7f349c0a93c0 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.681+0000 7f349aa00640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c0a93c0 0x7f349c152f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f349c0c3ae0 tx=0x7f348402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3249851f28600ed7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.682+0000 7f349a000640 1 -- 172.21.15.100:0/432989944 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484031870 con 0x7f349c0a93c0 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.682+0000 7f349a000640 1 -- 172.21.15.100:0/432989944 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840319d0 con 0x7f349c0a93c0 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.682+0000 7f349a000640 1 -- 172.21.15.100:0/432989944 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3484031d60 con 0x7f349c0a93c0 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.682+0000 7f34a2000640 1 -- 172.21.15.100:0/432989944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c0a93c0 msgr2=0x7f349c152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.682+0000 7f34a2000640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c0a93c0 0x7f349c152f00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f349c0c3ae0 tx=0x7f348402b910 comp rx=0 tx=0).stop 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 -- 172.21.15.100:0/432989944 shutdown_connections 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 --2- 172.21.15.100:0/432989944 >> v2:172.21.15.110:3300/0 conn(0x7f349c153440 0x7f349c0aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c0a93c0 0x7f349c152f00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 --2- 172.21.15.100:0/432989944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c14fce0 0x7f349c153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 -- 172.21.15.100:0/432989944 >> 172.21.15.100:0/432989944 conn(0x7f349c06a5e0 msgr2=0x7f349c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 -- 172.21.15.100:0/432989944 shutdown_connections 2024-01-20T08:12:11.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.683+0000 7f34a2000640 1 -- 172.21.15.100:0/432989944 wait complete. 2024-01-20T08:12:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.684+0000 7f34a2000640 1 Processor -- start 2024-01-20T08:12:11.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 -- start start 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c0a93c0 0x7f349c071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 0x7f349c145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c1270 con 0x7f349c14fce0 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f349c1dead0 con 0x7f349c153440 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.685+0000 7f34a2000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f349c0c0f90 con 0x7f349c0a93c0 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47594/0 (socket says 172.21.15.100:47594) 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 -- 172.21.15.100:0/1261165985 learned_addr learned my addr 172.21.15.100:0/1261165985 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349be00640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 0x7f349c145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349b400640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c0a93c0 0x7f349c071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 -- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c0a93c0 msgr2=0x7f349c071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c0a93c0 0x7f349c071960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 -- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 msgr2=0x7f349c145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 0x7f349c145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349aa00640 1 -- 172.21.15.100:0/1261165985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840094d0 con 0x7f349c14fce0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.686+0000 7f349be00640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 0x7f349c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f349aa00640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f348402b950 tx=0x7f34840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f348403ad30 con 0x7f349c14fce0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34840443f0 con 0x7f349c14fce0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f349c1de7f0 con 0x7f349c14fce0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34840447a0 con 0x7f349c14fce0 2024-01-20T08:12:11.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.687+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f349c072280 con 0x7f349c14fce0 2024-01-20T08:12:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.688+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f349c0c2b50 con 0x7f349c14fce0 2024-01-20T08:12:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.689+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f348404d450 con 0x7f349c14fce0 2024-01-20T08:12:11.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.690+0000 7f3493400640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 0x7f347406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.690+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f348402d040 con 0x7f349c14fce0 2024-01-20T08:12:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.690+0000 7f349b400640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 0x7f347406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:11.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.691+0000 7f349b400640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 0x7f347406d390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:11.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.695+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f349c0c2b50 con 0x7f349c14fce0 2024-01-20T08:12:11.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.888+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f349c152690 con 0x7f347406aed0 2024-01-20T08:12:11.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.899+0000 7f3493400640 1 -- 172.21.15.100:0/1261165985 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274309 (secure 0 0 0) 0x7f348c00e510 con 0x7f347406aed0 2024-01-20T08:12:11.906 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:11.907 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:11.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 msgr2=0x7f347406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 0x7f347406d390 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f348c006fd0 tx=0x7f348c008040 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 msgr2=0x7f349c1e0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f348402b950 tx=0x7f34840046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 shutdown_connections 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f349c153440 0x7f349c145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f349c14fce0 0x7f349c1e0e40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f347406aed0 0x7f347406d390 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 --2- 172.21.15.100:0/1261165985 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f349c0a93c0 0x7f349c071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 >> 172.21.15.100:0/1261165985 conn(0x7f349c06a5e0 msgr2=0x7f349c0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 shutdown_connections 2024-01-20T08:12:11.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:11.906+0000 7f34a2000640 1 -- 172.21.15.100:0/1261165985 wait complete. 2024-01-20T08:12:11.927 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-01-20T08:12:09.922613+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":238536,"kb_used_data":5736,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754736184,"statfs":{"total":773094113280,"available":772849852416,"internally_reserved":0,"allocated":5873664,"data_stored":3123008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.902987"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032845+0000","last_change":"2024-01-20T08:12:05.032845+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032845+0000","last_undegraded":"2024-01-20T08:12:05.032845+0000","last_fullsized":"2024-01-20T08:12:05.032845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023858+0000","last_change":"2024-01-20T08:12:05.023858+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023858+0000","last_undegraded":"2024-01-20T08:12:05.023858+0000","last_fullsized":"2024-01-20T08:12:05.023858+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.031724+0000","last_change":"2024-01-20T08:12:05.031724+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.031724+0000","last_undegraded":"2024-01-20T08:12:05.031724+0000","last_fullsized":"2024-01-20T08:12:05.031724+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.034243+0000","last_change":"2024-01-20T08:12:05.034243+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.034243+0000","last_undegraded":"2024-01-20T08:12:05.034243+0000","last_fullsized":"2024-01-20T08:12:05.034243+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023572+0000","last_change":"2024-01-20T08:12:05.023572+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023572+0000","last_undegraded":"2024-01-20T08:12:05.023572+0000","last_fullsized":"2024-01-20T08:12:05.023572+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033116+0000","last_change":"2024-01-20T08:12:05.033116+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033116+0000","last_undegraded":"2024-01-20T08:12:05.033116+0000","last_fullsized":"2024-01-20T08:12:05.033116+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032349+0000","last_change":"2024-01-20T08:12:05.032349+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032349+0000","last_undegraded":"2024-01-20T08:12:05.032349+0000","last_fullsized":"2024-01-20T08:12:05.032349+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023420+0000","last_change":"2024-01-20T08:12:05.023420+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023420+0000","last_undegraded":"2024-01-20T08:12:05.023420+0000","last_fullsized":"2024-01-20T08:12:05.023420+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029922+0000","last_change":"2024-01-20T08:12:05.029922+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029922+0000","last_undegraded":"2024-01-20T08:12:05.029922+0000","last_fullsized":"2024-01-20T08:12:05.029922+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023289+0000","last_change":"2024-01-20T08:12:05.023289+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023289+0000","last_undegraded":"2024-01-20T08:12:05.023289+0000","last_fullsized":"2024-01-20T08:12:05.023289+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029857+0000","last_change":"2024-01-20T08:12:05.029857+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029857+0000","last_undegraded":"2024-01-20T08:12:05.029857+0000","last_fullsized":"2024-01-20T08:12:05.029857+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023457+0000","last_change":"2024-01-20T08:12:05.023457+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023457+0000","last_undegraded":"2024-01-20T08:12:05.023457+0000","last_fullsized":"2024-01-20T08:12:05.023457+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023827+0000","last_change":"2024-01-20T08:12:05.023827+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023827+0000","last_undegraded":"2024-01-20T08:12:05.023827+0000","last_fullsized":"2024-01-20T08:12:05.023827+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040516+0000","last_change":"2024-01-20T08:12:05.040516+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040516+0000","last_undegraded":"2024-01-20T08:12:05.040516+0000","last_fullsized":"2024-01-20T08:12:05.040516+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.030951+0000","last_change":"2024-01-20T08:12:05.030951+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.030951+0000","last_undegraded":"2024-01-20T08:12:05.030951+0000","last_fullsized":"2024-01-20T08:12:05.030951+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029915+0000","last_change":"2024-01-20T08:12:05.029915+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029915+0000","last_undegraded":"2024-01-20T08:12:05.029915+0000","last_fullsized":"2024-01-20T08:12:05.029915+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.029268+0000","last_change":"2024-01-20T08:12:05.029268+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.029268+0000","last_undegraded":"2024-01-20T08:12:05.029268+0000","last_fullsized":"2024-01-20T08:12:05.029268+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033344+0000","last_change":"2024-01-20T08:12:05.033344+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033344+0000","last_undegraded":"2024-01-20T08:12:05.033344+0000","last_fullsized":"2024-01-20T08:12:05.033344+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033287+0000","last_change":"2024-01-20T08:12:05.033287+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033287+0000","last_undegraded":"2024-01-20T08:12:05.033287+0000","last_fullsized":"2024-01-20T08:12:05.033287+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.031697+0000","last_change":"2024-01-20T08:12:05.031697+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.031697+0000","last_undegraded":"2024-01-20T08:12:05.031697+0000","last_fullsized":"2024-01-20T08:12:05.031697+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023290+0000","last_change":"2024-01-20T08:12:05.023290+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023290+0000","last_undegraded":"2024-01-20T08:12:05.023290+0000","last_fullsized":"2024-01-20T08:12:05.023290+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.024301+0000","last_change":"2024-01-20T08:12:05.024301+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.024301+0000","last_undegraded":"2024-01-20T08:12:05.024301+0000","last_fullsized":"2024-01-20T08:12:05.024301+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.030795+0000","last_change":"2024-01-20T08:12:05.030795+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.030795+0000","last_undegraded":"2024-01-20T08:12:05.030795+0000","last_fullsized":"2024-01-20T08:12:05.030795+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.025232+0000","last_change":"2024-01-20T08:12:05.025232+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.025232+0000","last_undegraded":"2024-01-20T08:12:05.025232+0000","last_fullsized":"2024-01-20T08:12:05.025232+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.032119+0000","last_change":"2024-01-20T08:12:05.032119+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.032119+0000","last_undegraded":"2024-01-20T08:12:05.032119+0000","last_fullsized":"2024-01-20T08:12:05.032119+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040479+0000","last_change":"2024-01-20T08:12:05.040479+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040479+0000","last_undegraded":"2024-01-20T08:12:05.040479+0000","last_fullsized":"2024-01-20T08:12:05.040479+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.033189+0000","last_change":"2024-01-20T08:12:05.033189+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.033189+0000","last_undegraded":"2024-01-20T08:12:05.033189+0000","last_fullsized":"2024-01-20T08:12:05.033189+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.025200+0000","last_change":"2024-01-20T08:12:05.025200+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.025200+0000","last_undegraded":"2024-01-20T08:12:05.025200+0000","last_fullsized":"2024-01-20T08:12:05.025200+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023466+0000","last_change":"2024-01-20T08:12:05.023466+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023466+0000","last_undegraded":"2024-01-20T08:12:05.023466+0000","last_fullsized":"2024-01-20T08:12:05.023466+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.023561+0000","last_change":"2024-01-20T08:12:05.023561+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.023561+0000","last_undegraded":"2024-01-20T08:12:05.023561+0000","last_fullsized":"2024-01-20T08:12:05.023561+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.024861+0000","last_change":"2024-01-20T08:12:05.024861+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.024861+0000","last_undegraded":"2024-01-20T08:12:05.024861+0000","last_fullsized":"2024-01-20T08:12:05.024861+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:06.018180+0000","last_change":"2024-01-20T08:12:06.018180+0000","last_active":"2024-01-20T08:12:06.018180+0000","last_peered":"2024-01-20T08:12:06.018180+0000","last_clean":"2024-01-20T08:12:06.018180+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:06.018180+0000","last_undegraded":"2024-01-20T08:12:06.018180+0000","last_fullsized":"2024-01-20T08:12:06.018180+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":1,"reported_epoch":49,"state":"creating+peering","last_fresh":"2024-01-20T08:12:05.040582+0000","last_change":"2024-01-20T08:12:05.040582+0000","last_active":"2024-01-20T08:12:05.012218+0000","last_peered":"2024-01-20T08:12:05.012218+0000","last_clean":"2024-01-20T08:12:05.012218+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:05.040582+0000","last_undegraded":"2024-01-20T08:12:05.040582+0000","last_fullsized":"2024-01-20T08:12:05.040582+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":189,"reported_epoch":49,"state":"active+clean","last_fresh":"2024-01-20T08:12:05.032023+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:05.032023+0000","last_peered":"2024-01-20T08:12:05.032023+0000","last_clean":"2024-01-20T08:12:05.032023+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:05.032023+0000","last_undegraded":"2024-01-20T08:12:05.032023+0000","last_fullsized":"2024-01-20T08:12:05.032023+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32332,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339508,"statfs":{"total":96636764160,"available":96603656192,"internally_reserved":0,"allocated":1179648,"data_stored":833152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":0.877}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.393},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.98499999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.48}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.3480000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.1679999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.5720000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.0860000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.698}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.526},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.248}]}]},{"osd":6,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.2430000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.008,"5min":2.008,"15min":2.008},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"last":1.121}]},{"osd":2,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":2.6019999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.1799999999999999},{"interface":"front","average":{"1min":1.3460000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":0.874}]},{"osd":3,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":0.94999999999999996},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.0409999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.6220000000000001,"5min":1.6220000000000001,"15min":1.6220000000000001},"min":{"1min":1.141,"5min":1.141,"15min":1.141},"max":{"1min":2.915,"5min":2.915,"15min":2.915},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.704,"5min":1.704,"15min":1.704},"min":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":2.718,"5min":2.718,"15min":2.718},"last":1.411}]},{"osd":5,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8170000000000002,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.371},{"interface":"front","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":1.319,"5min":1.319,"15min":1.319},"max":{"1min":3.0739999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.476}]},{"osd":7,"last update":"Sat Jan 20 08:11:04 2024","interfaces":[{"interface":"back","average":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"min":{"1min":1.323,"5min":1.323,"15min":1.323},"max":{"1min":2.4279999999999999,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.5129999999999999},{"interface":"front","average":{"1min":1.7989999999999999,"5min":1.7989999999999999,"15min":1.7989999999999999},"min":{"1min":1.26,"5min":1.26,"15min":1.26},"max":{"1min":3.5880000000000001,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.448}]}]},{"osd":5,"up_from":13,"seq":55834574875,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31748,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3440000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.91500000000000004}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":1},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.056},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.218}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.155}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.321}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.6220000000000001},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.4890000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31752,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340088,"statfs":{"total":96636764160,"available":96604250112,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":0.378},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":0.66800000000000004}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.48199999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.84599999999999997}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":0.60199999999999998}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.874},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.53400000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":0.78700000000000003},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":0.90500000000000003}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":0.72399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.85099999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":1.117},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.1519999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":1.47},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.3680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.264}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.504},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.1899999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.339},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.4470000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.546},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.4059999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27596,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344244,"statfs":{"total":96636764160,"available":96608505856,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":0.871}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1080000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.58399999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.167}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.425},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3879999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.208},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.3029999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.252},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.458}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0069999999999999},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.359}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27592,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344248,"statfs":{"total":96636764160,"available":96608509952,"internally_reserved":0,"allocated":585728,"data_stored":242784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.72599999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":0.57499999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.99099999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.61799999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.155}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.272},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.2310000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.196}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.0820000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.115}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28172,"kb_used_data":1152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343668,"statfs":{"total":96636764160,"available":96607916032,"internally_reserved":0,"allocated":1179648,"data_stored":833152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.6930000000000001,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.91400000000000003}]},{"osd":2,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.3540000000000001,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":1.3859999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.0680000000000001},{"interface":"front","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.4179999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6479999999999999,"5min":1.6479999999999999,"15min":1.6479999999999999},"last":1.536},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.589,"5min":1.589,"15min":1.589},"last":1.3520000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.865,"5min":1.865,"15min":1.865},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.427,"5min":2.427,"15min":2.427},"last":1.262}]},{"osd":6,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.3639999999999999,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.508},{"interface":"front","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.294}]},{"osd":7,"last update":"Sat Jan 20 08:11:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9870000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.448},{"interface":"front","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.472}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:11.931 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.179+0000 7efc7a200640 1 Processor -- start 2024-01-20T08:12:12.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.179+0000 7efc7a200640 1 -- start start 2024-01-20T08:12:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.180+0000 7efc7a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.180+0000 7efc7a200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 0x7efc740ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.180+0000 7efc7a200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740a9940 con 0x7efc740a93c0 2024-01-20T08:12:12.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.180+0000 7efc7a200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc741500c0 con 0x7efc740aae00 2024-01-20T08:12:12.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc7a200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc74156810 con 0x7efc7414fce0 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc73400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc73400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:56394/0 (socket says 172.21.15.100:56394) 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc73e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 0x7efc740ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc73400640 1 -- 172.21.15.100:0/3344423898 learned_addr learned my addr 172.21.15.100:0/3344423898 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.181+0000 7efc72a00640 1 --1- 172.21.15.100:0/3344423898 >> v1:172.21.15.110:6789/0 conn(0x7efc740a93c0 0x7efc74152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:58244/0 (socket says 172.21.15.100:58244) 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.182+0000 7efc73400640 1 -- 172.21.15.100:0/3344423898 >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 msgr2=0x7efc740ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.182+0000 7efc73400640 1 --2- 172.21.15.100:0/3344423898 >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 0x7efc740ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.182+0000 7efc73400640 1 -- 172.21.15.100:0/3344423898 >> v1:172.21.15.110:6789/0 conn(0x7efc740a93c0 legacy=0x7efc74152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.182+0000 7efc73400640 1 -- 172.21.15.100:0/3344423898 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74156af0 con 0x7efc7414fce0 2024-01-20T08:12:12.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.182+0000 7efc73e00640 1 --2- 172.21.15.100:0/3344423898 >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 0x7efc740ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:12:12.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.184+0000 7efc73400640 1 --2- 172.21.15.100:0/3344423898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc64009870 tx=0x7efc6402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82f780af02671178 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.184+0000 7efc72000640 1 -- 172.21.15.100:0/3344423898 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64030840 con 0x7efc7414fce0 2024-01-20T08:12:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.184+0000 7efc72000640 1 -- 172.21.15.100:0/3344423898 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640309a0 con 0x7efc7414fce0 2024-01-20T08:12:12.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.184+0000 7efc72000640 1 -- 172.21.15.100:0/3344423898 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64030d30 con 0x7efc7414fce0 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 -- 172.21.15.100:0/3344423898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 msgr2=0x7efc74153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 --2- 172.21.15.100:0/3344423898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7efc64009870 tx=0x7efc6402b980 comp rx=0 tx=0).stop 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 -- 172.21.15.100:0/3344423898 shutdown_connections 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 --2- 172.21.15.100:0/3344423898 >> v2:172.21.15.110:3300/0 conn(0x7efc740aae00 0x7efc740ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 --2- 172.21.15.100:0/3344423898 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc7414fce0 0x7efc74153b80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 -- 172.21.15.100:0/3344423898 >> 172.21.15.100:0/3344423898 conn(0x7efc7406a5e0 msgr2=0x7efc7406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 -- 172.21.15.100:0/3344423898 shutdown_connections 2024-01-20T08:12:12.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.185+0000 7efc7a200640 1 -- 172.21.15.100:0/3344423898 wait complete. 2024-01-20T08:12:12.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.187+0000 7efc7a200640 1 Processor -- start 2024-01-20T08:12:12.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.187+0000 7efc7a200640 1 -- start start 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc740aae00 0x7efc741dcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc7414fce0 0x7efc741dd470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7413ef40 con 0x7efc740a93c0 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc741dd9b0 con 0x7efc7414fce0 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc7a200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7413f3f0 con 0x7efc740aae00 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47610/0 (socket says 172.21.15.100:47610) 2024-01-20T08:12:12.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 -- 172.21.15.100:0/1489066021 learned_addr learned my addr 172.21.15.100:0/1489066021 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 -- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc740aae00 msgr2=0x7efc741dcf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc740aae00 0x7efc741dcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 -- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc7414fce0 msgr2=0x7efc741dd470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc7414fce0 0x7efc741dd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.188+0000 7efc73400640 1 -- 172.21.15.100:0/1489066021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c009a70 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc73400640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64039a90 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc64039bf0 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc640094d0 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc64043410 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.189+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc741eaa40 con 0x7efc740a93c0 2024-01-20T08:12:12.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.190+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7414e2f0 con 0x7efc740a93c0 2024-01-20T08:12:12.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.191+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efc6404c3b0 con 0x7efc740a93c0 2024-01-20T08:12:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.192+0000 7efc6b400640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 0x7efc4c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.192+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc640ab9b0 con 0x7efc740a93c0 2024-01-20T08:12:12.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.193+0000 7efc72a00640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 0x7efc4c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.193+0000 7efc72a00640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 0x7efc4c06d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000f60 tx=0x7efc5c007a00 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.197+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efc64076870 con 0x7efc740a93c0 2024-01-20T08:12:12.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.384+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efc74067a40 con 0x7efc4c06af00 2024-01-20T08:12:12.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.396+0000 7efc6b400640 1 -- 172.21.15.100:0/1489066021 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286744 (secure 0 0 0) 0x7efc74067a40 con 0x7efc4c06af00 2024-01-20T08:12:12.399 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:12.404 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 msgr2=0x7efc4c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 0x7efc4c06d3c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7efc5c000f60 tx=0x7efc5c007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 msgr2=0x7efc740c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc64004730 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 shutdown_connections 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efc7414fce0 0x7efc741dd470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efc4c06af00 0x7efc4c06d3c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efc740aae00 0x7efc741dcf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 --2- 172.21.15.100:0/1489066021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efc740a93c0 0x7efc740c5260 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 >> 172.21.15.100:0/1489066021 conn(0x7efc7406a5e0 msgr2=0x7efc7414dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 shutdown_connections 2024-01-20T08:12:12.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.404+0000 7efc7a200640 1 -- 172.21.15.100:0/1489066021 wait complete. 2024-01-20T08:12:12.426 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-01-20T08:12:11.923162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243064,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731656,"statfs":{"total":773094113280,"available":772845215744,"internally_reserved":0,"allocated":6234112,"data_stored":3282564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001449"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313954+0000","last_change":"2024-01-20T08:12:07.068510+0000","last_active":"2024-01-20T08:12:08.313954+0000","last_peered":"2024-01-20T08:12:08.313954+0000","last_clean":"2024-01-20T08:12:08.313954+0000","last_became_active":"2024-01-20T08:12:07.068099+0000","last_became_peered":"2024-01-20T08:12:07.068099+0000","last_unstale":"2024-01-20T08:12:08.313954+0000","last_undegraded":"2024-01-20T08:12:08.313954+0000","last_fullsized":"2024-01-20T08:12:08.313954+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:51.051735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045903+0000","last_change":"2024-01-20T08:12:07.066208+0000","last_active":"2024-01-20T08:12:08.045903+0000","last_peered":"2024-01-20T08:12:08.045903+0000","last_clean":"2024-01-20T08:12:08.045903+0000","last_became_active":"2024-01-20T08:12:07.065935+0000","last_became_peered":"2024-01-20T08:12:07.065935+0000","last_unstale":"2024-01-20T08:12:08.045903+0000","last_undegraded":"2024-01-20T08:12:08.045903+0000","last_fullsized":"2024-01-20T08:12:08.045903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:55:51.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047157+0000","last_change":"2024-01-20T08:12:07.079204+0000","last_active":"2024-01-20T08:12:08.047157+0000","last_peered":"2024-01-20T08:12:08.047157+0000","last_clean":"2024-01-20T08:12:08.047157+0000","last_became_active":"2024-01-20T08:12:07.078933+0000","last_became_peered":"2024-01-20T08:12:07.078933+0000","last_unstale":"2024-01-20T08:12:08.047157+0000","last_undegraded":"2024-01-20T08:12:08.047157+0000","last_fullsized":"2024-01-20T08:12:08.047157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317951+0000","last_change":"2024-01-20T08:12:07.078940+0000","last_active":"2024-01-20T08:12:08.317951+0000","last_peered":"2024-01-20T08:12:08.317951+0000","last_clean":"2024-01-20T08:12:08.317951+0000","last_became_active":"2024-01-20T08:12:07.076282+0000","last_became_peered":"2024-01-20T08:12:07.076282+0000","last_unstale":"2024-01-20T08:12:08.317951+0000","last_undegraded":"2024-01-20T08:12:08.317951+0000","last_fullsized":"2024-01-20T08:12:08.317951+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313988+0000","last_change":"2024-01-20T08:12:07.079405+0000","last_active":"2024-01-20T08:12:08.313988+0000","last_peered":"2024-01-20T08:12:08.313988+0000","last_clean":"2024-01-20T08:12:08.313988+0000","last_became_active":"2024-01-20T08:12:07.079108+0000","last_became_peered":"2024-01-20T08:12:07.079108+0000","last_unstale":"2024-01-20T08:12:08.313988+0000","last_undegraded":"2024-01-20T08:12:08.313988+0000","last_fullsized":"2024-01-20T08:12:08.313988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:18.953566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044239+0000","last_change":"2024-01-20T08:12:07.069601+0000","last_active":"2024-01-20T08:12:08.044239+0000","last_peered":"2024-01-20T08:12:08.044239+0000","last_clean":"2024-01-20T08:12:08.044239+0000","last_became_active":"2024-01-20T08:12:07.069275+0000","last_became_peered":"2024-01-20T08:12:07.069275+0000","last_unstale":"2024-01-20T08:12:08.044239+0000","last_undegraded":"2024-01-20T08:12:08.044239+0000","last_fullsized":"2024-01-20T08:12:08.044239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316141+0000","last_change":"2024-01-20T08:12:07.075671+0000","last_active":"2024-01-20T08:12:08.316141+0000","last_peered":"2024-01-20T08:12:08.316141+0000","last_clean":"2024-01-20T08:12:08.316141+0000","last_became_active":"2024-01-20T08:12:07.074069+0000","last_became_peered":"2024-01-20T08:12:07.074069+0000","last_unstale":"2024-01-20T08:12:08.316141+0000","last_undegraded":"2024-01-20T08:12:08.316141+0000","last_fullsized":"2024-01-20T08:12:08.316141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044603+0000","last_change":"2024-01-20T08:12:07.066879+0000","last_active":"2024-01-20T08:12:08.044603+0000","last_peered":"2024-01-20T08:12:08.044603+0000","last_clean":"2024-01-20T08:12:08.044603+0000","last_became_active":"2024-01-20T08:12:07.066268+0000","last_became_peered":"2024-01-20T08:12:07.066268+0000","last_unstale":"2024-01-20T08:12:08.044603+0000","last_undegraded":"2024-01-20T08:12:08.044603+0000","last_fullsized":"2024-01-20T08:12:08.044603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:22.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317135+0000","last_change":"2024-01-20T08:12:07.071750+0000","last_active":"2024-01-20T08:12:08.317135+0000","last_peered":"2024-01-20T08:12:08.317135+0000","last_clean":"2024-01-20T08:12:08.317135+0000","last_became_active":"2024-01-20T08:12:07.071410+0000","last_became_peered":"2024-01-20T08:12:07.071410+0000","last_unstale":"2024-01-20T08:12:08.317135+0000","last_undegraded":"2024-01-20T08:12:08.317135+0000","last_fullsized":"2024-01-20T08:12:08.317135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:10.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316489+0000","last_change":"2024-01-20T08:12:07.064925+0000","last_active":"2024-01-20T08:12:08.316489+0000","last_peered":"2024-01-20T08:12:08.316489+0000","last_clean":"2024-01-20T08:12:08.316489+0000","last_became_active":"2024-01-20T08:12:07.064314+0000","last_became_peered":"2024-01-20T08:12:07.064314+0000","last_unstale":"2024-01-20T08:12:08.316489+0000","last_undegraded":"2024-01-20T08:12:08.316489+0000","last_fullsized":"2024-01-20T08:12:08.316489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:52.116068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316256+0000","last_change":"2024-01-20T08:12:07.069329+0000","last_active":"2024-01-20T08:12:08.316256+0000","last_peered":"2024-01-20T08:12:08.316256+0000","last_clean":"2024-01-20T08:12:08.316256+0000","last_became_active":"2024-01-20T08:12:07.068957+0000","last_became_peered":"2024-01-20T08:12:07.068957+0000","last_unstale":"2024-01-20T08:12:08.316256+0000","last_undegraded":"2024-01-20T08:12:08.316256+0000","last_fullsized":"2024-01-20T08:12:08.316256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:15.643241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319985+0000","last_change":"2024-01-20T08:12:07.077771+0000","last_active":"2024-01-20T08:12:08.319985+0000","last_peered":"2024-01-20T08:12:08.319985+0000","last_clean":"2024-01-20T08:12:08.319985+0000","last_became_active":"2024-01-20T08:12:07.077498+0000","last_became_peered":"2024-01-20T08:12:07.077498+0000","last_unstale":"2024-01-20T08:12:08.319985+0000","last_undegraded":"2024-01-20T08:12:08.319985+0000","last_fullsized":"2024-01-20T08:12:08.319985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319888+0000","last_change":"2024-01-20T08:12:07.070855+0000","last_active":"2024-01-20T08:12:08.319888+0000","last_peered":"2024-01-20T08:12:08.319888+0000","last_clean":"2024-01-20T08:12:08.319888+0000","last_became_active":"2024-01-20T08:12:07.070467+0000","last_became_peered":"2024-01-20T08:12:07.070467+0000","last_unstale":"2024-01-20T08:12:08.319888+0000","last_undegraded":"2024-01-20T08:12:08.319888+0000","last_fullsized":"2024-01-20T08:12:08.319888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:45.947061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318367+0000","last_change":"2024-01-20T08:12:07.066074+0000","last_active":"2024-01-20T08:12:08.318367+0000","last_peered":"2024-01-20T08:12:08.318367+0000","last_clean":"2024-01-20T08:12:08.318367+0000","last_became_active":"2024-01-20T08:12:07.063801+0000","last_became_peered":"2024-01-20T08:12:07.063801+0000","last_unstale":"2024-01-20T08:12:08.318367+0000","last_undegraded":"2024-01-20T08:12:08.318367+0000","last_fullsized":"2024-01-20T08:12:08.318367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:40.896208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316640+0000","last_change":"2024-01-20T08:12:07.055740+0000","last_active":"2024-01-20T08:12:08.316640+0000","last_peered":"2024-01-20T08:12:08.316640+0000","last_clean":"2024-01-20T08:12:08.316640+0000","last_became_active":"2024-01-20T08:12:07.055037+0000","last_became_peered":"2024-01-20T08:12:07.055037+0000","last_unstale":"2024-01-20T08:12:08.316640+0000","last_undegraded":"2024-01-20T08:12:08.316640+0000","last_fullsized":"2024-01-20T08:12:08.316640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:07.521556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043866+0000","last_change":"2024-01-20T08:12:07.079668+0000","last_active":"2024-01-20T08:12:08.043866+0000","last_peered":"2024-01-20T08:12:08.043866+0000","last_clean":"2024-01-20T08:12:08.043866+0000","last_became_active":"2024-01-20T08:12:07.075321+0000","last_became_peered":"2024-01-20T08:12:07.075321+0000","last_unstale":"2024-01-20T08:12:08.043866+0000","last_undegraded":"2024-01-20T08:12:08.043866+0000","last_fullsized":"2024-01-20T08:12:08.043866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046064+0000","last_change":"2024-01-20T08:12:07.068449+0000","last_active":"2024-01-20T08:12:08.046064+0000","last_peered":"2024-01-20T08:12:08.046064+0000","last_clean":"2024-01-20T08:12:08.046064+0000","last_became_active":"2024-01-20T08:12:07.067404+0000","last_became_peered":"2024-01-20T08:12:07.067404+0000","last_unstale":"2024-01-20T08:12:08.046064+0000","last_undegraded":"2024-01-20T08:12:08.046064+0000","last_fullsized":"2024-01-20T08:12:08.046064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:33:44.143818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047269+0000","last_change":"2024-01-20T08:12:07.081616+0000","last_active":"2024-01-20T08:12:08.047269+0000","last_peered":"2024-01-20T08:12:08.047269+0000","last_clean":"2024-01-20T08:12:08.047269+0000","last_became_active":"2024-01-20T08:12:07.081014+0000","last_became_peered":"2024-01-20T08:12:07.081014+0000","last_unstale":"2024-01-20T08:12:08.047269+0000","last_undegraded":"2024-01-20T08:12:08.047269+0000","last_fullsized":"2024-01-20T08:12:08.047269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313487+0000","last_change":"2024-01-20T08:12:07.077693+0000","last_active":"2024-01-20T08:12:08.313487+0000","last_peered":"2024-01-20T08:12:08.313487+0000","last_clean":"2024-01-20T08:12:08.313487+0000","last_became_active":"2024-01-20T08:12:07.077448+0000","last_became_peered":"2024-01-20T08:12:07.077448+0000","last_unstale":"2024-01-20T08:12:08.313487+0000","last_undegraded":"2024-01-20T08:12:08.313487+0000","last_fullsized":"2024-01-20T08:12:08.313487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:56.215178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045654+0000","last_change":"2024-01-20T08:12:07.079543+0000","last_active":"2024-01-20T08:12:08.045654+0000","last_peered":"2024-01-20T08:12:08.045654+0000","last_clean":"2024-01-20T08:12:08.045654+0000","last_became_active":"2024-01-20T08:12:07.078435+0000","last_became_peered":"2024-01-20T08:12:07.078435+0000","last_unstale":"2024-01-20T08:12:08.045654+0000","last_undegraded":"2024-01-20T08:12:08.045654+0000","last_fullsized":"2024-01-20T08:12:08.045654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:28.706699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046288+0000","last_change":"2024-01-20T08:12:07.080145+0000","last_active":"2024-01-20T08:12:08.046288+0000","last_peered":"2024-01-20T08:12:08.046288+0000","last_clean":"2024-01-20T08:12:08.046288+0000","last_became_active":"2024-01-20T08:12:07.079803+0000","last_became_peered":"2024-01-20T08:12:07.079803+0000","last_unstale":"2024-01-20T08:12:08.046288+0000","last_undegraded":"2024-01-20T08:12:08.046288+0000","last_fullsized":"2024-01-20T08:12:08.046288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:35.347679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044263+0000","last_change":"2024-01-20T08:12:07.072637+0000","last_active":"2024-01-20T08:12:08.044263+0000","last_peered":"2024-01-20T08:12:08.044263+0000","last_clean":"2024-01-20T08:12:08.044263+0000","last_became_active":"2024-01-20T08:12:07.068029+0000","last_became_peered":"2024-01-20T08:12:07.068029+0000","last_unstale":"2024-01-20T08:12:08.044263+0000","last_undegraded":"2024-01-20T08:12:08.044263+0000","last_fullsized":"2024-01-20T08:12:08.044263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:48.804666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046359+0000","last_change":"2024-01-20T08:12:07.087617+0000","last_active":"2024-01-20T08:12:08.046359+0000","last_peered":"2024-01-20T08:12:08.046359+0000","last_clean":"2024-01-20T08:12:08.046359+0000","last_became_active":"2024-01-20T08:12:07.085114+0000","last_became_peered":"2024-01-20T08:12:07.085114+0000","last_unstale":"2024-01-20T08:12:08.046359+0000","last_undegraded":"2024-01-20T08:12:08.046359+0000","last_fullsized":"2024-01-20T08:12:08.046359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318314+0000","last_change":"2024-01-20T08:12:07.072912+0000","last_active":"2024-01-20T08:12:08.318314+0000","last_peered":"2024-01-20T08:12:08.318314+0000","last_clean":"2024-01-20T08:12:08.318314+0000","last_became_active":"2024-01-20T08:12:07.072564+0000","last_became_peered":"2024-01-20T08:12:07.072564+0000","last_unstale":"2024-01-20T08:12:08.318314+0000","last_undegraded":"2024-01-20T08:12:08.318314+0000","last_fullsized":"2024-01-20T08:12:08.318314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:21.868460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.314197+0000","last_change":"2024-01-20T08:12:07.076077+0000","last_active":"2024-01-20T08:12:08.314197+0000","last_peered":"2024-01-20T08:12:08.314197+0000","last_clean":"2024-01-20T08:12:08.314197+0000","last_became_active":"2024-01-20T08:12:07.075830+0000","last_became_peered":"2024-01-20T08:12:07.075830+0000","last_unstale":"2024-01-20T08:12:08.314197+0000","last_undegraded":"2024-01-20T08:12:08.314197+0000","last_fullsized":"2024-01-20T08:12:08.314197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:22.791363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318485+0000","last_change":"2024-01-20T08:12:07.072412+0000","last_active":"2024-01-20T08:12:08.318485+0000","last_peered":"2024-01-20T08:12:08.318485+0000","last_clean":"2024-01-20T08:12:08.318485+0000","last_became_active":"2024-01-20T08:12:07.072119+0000","last_became_peered":"2024-01-20T08:12:07.072119+0000","last_unstale":"2024-01-20T08:12:08.318485+0000","last_undegraded":"2024-01-20T08:12:08.318485+0000","last_fullsized":"2024-01-20T08:12:08.318485+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044694+0000","last_change":"2024-01-20T08:12:07.077399+0000","last_active":"2024-01-20T08:12:08.044694+0000","last_peered":"2024-01-20T08:12:08.044694+0000","last_clean":"2024-01-20T08:12:08.044694+0000","last_became_active":"2024-01-20T08:12:07.077122+0000","last_became_peered":"2024-01-20T08:12:07.077122+0000","last_unstale":"2024-01-20T08:12:08.044694+0000","last_undegraded":"2024-01-20T08:12:08.044694+0000","last_fullsized":"2024-01-20T08:12:08.044694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:25.524024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313809+0000","last_change":"2024-01-20T08:12:07.076949+0000","last_active":"2024-01-20T08:12:08.313809+0000","last_peered":"2024-01-20T08:12:08.313809+0000","last_clean":"2024-01-20T08:12:08.313809+0000","last_became_active":"2024-01-20T08:12:07.076497+0000","last_became_peered":"2024-01-20T08:12:07.076497+0000","last_unstale":"2024-01-20T08:12:08.313809+0000","last_undegraded":"2024-01-20T08:12:08.313809+0000","last_fullsized":"2024-01-20T08:12:08.313809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:04:40.245579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045278+0000","last_change":"2024-01-20T08:12:07.079522+0000","last_active":"2024-01-20T08:12:08.045278+0000","last_peered":"2024-01-20T08:12:08.045278+0000","last_clean":"2024-01-20T08:12:08.045278+0000","last_became_active":"2024-01-20T08:12:07.079268+0000","last_became_peered":"2024-01-20T08:12:07.079268+0000","last_unstale":"2024-01-20T08:12:08.045278+0000","last_undegraded":"2024-01-20T08:12:08.045278+0000","last_fullsized":"2024-01-20T08:12:08.045278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:37.687652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045935+0000","last_change":"2024-01-20T08:12:07.076533+0000","last_active":"2024-01-20T08:12:08.045935+0000","last_peered":"2024-01-20T08:12:08.045935+0000","last_clean":"2024-01-20T08:12:08.045935+0000","last_became_active":"2024-01-20T08:12:07.076184+0000","last_became_peered":"2024-01-20T08:12:07.076184+0000","last_unstale":"2024-01-20T08:12:08.045935+0000","last_undegraded":"2024-01-20T08:12:08.045935+0000","last_fullsized":"2024-01-20T08:12:08.045935+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:49:57.037227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313555+0000","last_change":"2024-01-20T08:12:07.071054+0000","last_active":"2024-01-20T08:12:08.313555+0000","last_peered":"2024-01-20T08:12:08.313555+0000","last_clean":"2024-01-20T08:12:08.313555+0000","last_became_active":"2024-01-20T08:12:07.070741+0000","last_became_peered":"2024-01-20T08:12:07.070741+0000","last_unstale":"2024-01-20T08:12:08.313555+0000","last_undegraded":"2024-01-20T08:12:08.313555+0000","last_fullsized":"2024-01-20T08:12:08.313555+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:03.112854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044231+0000","last_change":"2024-01-20T08:12:07.078867+0000","last_active":"2024-01-20T08:12:08.044231+0000","last_peered":"2024-01-20T08:12:08.044231+0000","last_clean":"2024-01-20T08:12:08.044231+0000","last_became_active":"2024-01-20T08:12:07.078639+0000","last_became_peered":"2024-01-20T08:12:07.078639+0000","last_unstale":"2024-01-20T08:12:08.044231+0000","last_undegraded":"2024-01-20T08:12:08.044231+0000","last_fullsized":"2024-01-20T08:12:08.044231+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044777+0000","last_change":"2024-01-20T08:12:07.080377+0000","last_active":"2024-01-20T08:12:08.044777+0000","last_peered":"2024-01-20T08:12:08.044777+0000","last_clean":"2024-01-20T08:12:08.044777+0000","last_became_active":"2024-01-20T08:12:07.080044+0000","last_became_peered":"2024-01-20T08:12:07.080044+0000","last_unstale":"2024-01-20T08:12:08.044777+0000","last_undegraded":"2024-01-20T08:12:08.044777+0000","last_fullsized":"2024-01-20T08:12:08.044777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:33.328172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100685+0000","last_change":"2024-01-20T08:12:06.069013+0000","last_active":"2024-01-20T08:12:07.100685+0000","last_peered":"2024-01-20T08:12:07.100685+0000","last_clean":"2024-01-20T08:12:07.100685+0000","last_became_active":"2024-01-20T08:12:06.068785+0000","last_became_peered":"2024-01-20T08:12:06.068785+0000","last_unstale":"2024-01-20T08:12:07.100685+0000","last_undegraded":"2024-01-20T08:12:07.100685+0000","last_fullsized":"2024-01-20T08:12:07.100685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:48.916750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316877+0000","last_change":"2024-01-20T08:12:07.074189+0000","last_active":"2024-01-20T08:12:08.316877+0000","last_peered":"2024-01-20T08:12:08.316877+0000","last_clean":"2024-01-20T08:12:08.316877+0000","last_became_active":"2024-01-20T08:12:07.073922+0000","last_became_peered":"2024-01-20T08:12:07.073922+0000","last_unstale":"2024-01-20T08:12:08.316877+0000","last_undegraded":"2024-01-20T08:12:08.316877+0000","last_fullsized":"2024-01-20T08:12:08.316877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099448+0000","last_change":"2024-01-20T08:12:06.067289+0000","last_active":"2024-01-20T08:12:07.099448+0000","last_peered":"2024-01-20T08:12:07.099448+0000","last_clean":"2024-01-20T08:12:07.099448+0000","last_became_active":"2024-01-20T08:12:06.066945+0000","last_became_peered":"2024-01-20T08:12:06.066945+0000","last_unstale":"2024-01-20T08:12:07.099448+0000","last_undegraded":"2024-01-20T08:12:07.099448+0000","last_fullsized":"2024-01-20T08:12:07.099448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:05.035478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044347+0000","last_change":"2024-01-20T08:12:07.082658+0000","last_active":"2024-01-20T08:12:08.044347+0000","last_peered":"2024-01-20T08:12:08.044347+0000","last_clean":"2024-01-20T08:12:08.044347+0000","last_became_active":"2024-01-20T08:12:07.082212+0000","last_became_peered":"2024-01-20T08:12:07.082212+0000","last_unstale":"2024-01-20T08:12:08.044347+0000","last_undegraded":"2024-01-20T08:12:08.044347+0000","last_fullsized":"2024-01-20T08:12:08.044347+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098084+0000","last_change":"2024-01-20T08:12:06.058720+0000","last_active":"2024-01-20T08:12:07.098084+0000","last_peered":"2024-01-20T08:12:07.098084+0000","last_clean":"2024-01-20T08:12:07.098084+0000","last_became_active":"2024-01-20T08:12:06.058352+0000","last_became_peered":"2024-01-20T08:12:06.058352+0000","last_unstale":"2024-01-20T08:12:07.098084+0000","last_undegraded":"2024-01-20T08:12:07.098084+0000","last_fullsized":"2024-01-20T08:12:07.098084+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:09.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044881+0000","last_change":"2024-01-20T08:12:07.080508+0000","last_active":"2024-01-20T08:12:08.044881+0000","last_peered":"2024-01-20T08:12:08.044881+0000","last_clean":"2024-01-20T08:12:08.044881+0000","last_became_active":"2024-01-20T08:12:07.080057+0000","last_became_peered":"2024-01-20T08:12:07.080057+0000","last_unstale":"2024-01-20T08:12:08.044881+0000","last_undegraded":"2024-01-20T08:12:08.044881+0000","last_fullsized":"2024-01-20T08:12:08.044881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.415785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100075+0000","last_change":"2024-01-20T08:12:06.073731+0000","last_active":"2024-01-20T08:12:07.100075+0000","last_peered":"2024-01-20T08:12:07.100075+0000","last_clean":"2024-01-20T08:12:07.100075+0000","last_became_active":"2024-01-20T08:12:06.073398+0000","last_became_peered":"2024-01-20T08:12:06.073398+0000","last_unstale":"2024-01-20T08:12:07.100075+0000","last_undegraded":"2024-01-20T08:12:07.100075+0000","last_fullsized":"2024-01-20T08:12:07.100075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:14.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044406+0000","last_change":"2024-01-20T08:12:07.072285+0000","last_active":"2024-01-20T08:12:08.044406+0000","last_peered":"2024-01-20T08:12:08.044406+0000","last_clean":"2024-01-20T08:12:08.044406+0000","last_became_active":"2024-01-20T08:12:07.068016+0000","last_became_peered":"2024-01-20T08:12:07.068016+0000","last_unstale":"2024-01-20T08:12:08.044406+0000","last_undegraded":"2024-01-20T08:12:08.044406+0000","last_fullsized":"2024-01-20T08:12:08.044406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:17.339298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098992+0000","last_change":"2024-01-20T08:12:06.062959+0000","last_active":"2024-01-20T08:12:07.098992+0000","last_peered":"2024-01-20T08:12:07.098992+0000","last_clean":"2024-01-20T08:12:07.098992+0000","last_became_active":"2024-01-20T08:12:06.062074+0000","last_became_peered":"2024-01-20T08:12:06.062074+0000","last_unstale":"2024-01-20T08:12:07.098992+0000","last_undegraded":"2024-01-20T08:12:07.098992+0000","last_fullsized":"2024-01-20T08:12:07.098992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:20.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044999+0000","last_change":"2024-01-20T08:12:07.073980+0000","last_active":"2024-01-20T08:12:08.044999+0000","last_peered":"2024-01-20T08:12:08.044999+0000","last_clean":"2024-01-20T08:12:08.044999+0000","last_became_active":"2024-01-20T08:12:07.072685+0000","last_became_peered":"2024-01-20T08:12:07.072685+0000","last_unstale":"2024-01-20T08:12:08.044999+0000","last_undegraded":"2024-01-20T08:12:08.044999+0000","last_fullsized":"2024-01-20T08:12:08.044999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:02:57.344542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.097481+0000","last_change":"2024-01-20T08:12:06.063065+0000","last_active":"2024-01-20T08:12:07.097481+0000","last_peered":"2024-01-20T08:12:07.097481+0000","last_clean":"2024-01-20T08:12:07.097481+0000","last_became_active":"2024-01-20T08:12:06.062833+0000","last_became_peered":"2024-01-20T08:12:06.062833+0000","last_unstale":"2024-01-20T08:12:07.097481+0000","last_undegraded":"2024-01-20T08:12:07.097481+0000","last_fullsized":"2024-01-20T08:12:07.097481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318295+0000","last_change":"2024-01-20T08:12:07.081364+0000","last_active":"2024-01-20T08:12:08.318295+0000","last_peered":"2024-01-20T08:12:08.318295+0000","last_clean":"2024-01-20T08:12:08.318295+0000","last_became_active":"2024-01-20T08:12:07.080761+0000","last_became_peered":"2024-01-20T08:12:07.080761+0000","last_unstale":"2024-01-20T08:12:08.318295+0000","last_undegraded":"2024-01-20T08:12:08.318295+0000","last_fullsized":"2024-01-20T08:12:08.318295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:29.139178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063179+0000","last_change":"2024-01-20T08:12:06.071618+0000","last_active":"2024-01-20T08:12:07.063179+0000","last_peered":"2024-01-20T08:12:07.063179+0000","last_clean":"2024-01-20T08:12:07.063179+0000","last_became_active":"2024-01-20T08:12:06.070615+0000","last_became_peered":"2024-01-20T08:12:06.070615+0000","last_unstale":"2024-01-20T08:12:07.063179+0000","last_undegraded":"2024-01-20T08:12:07.063179+0000","last_fullsized":"2024-01-20T08:12:07.063179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:51.110106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045425+0000","last_change":"2024-01-20T08:12:07.078826+0000","last_active":"2024-01-20T08:12:08.045425+0000","last_peered":"2024-01-20T08:12:08.045425+0000","last_clean":"2024-01-20T08:12:08.045425+0000","last_became_active":"2024-01-20T08:12:07.078429+0000","last_became_peered":"2024-01-20T08:12:07.078429+0000","last_unstale":"2024-01-20T08:12:08.045425+0000","last_undegraded":"2024-01-20T08:12:08.045425+0000","last_fullsized":"2024-01-20T08:12:08.045425+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.046631+0000","last_change":"2024-01-20T08:12:06.055455+0000","last_active":"2024-01-20T08:12:07.046631+0000","last_peered":"2024-01-20T08:12:07.046631+0000","last_clean":"2024-01-20T08:12:07.046631+0000","last_became_active":"2024-01-20T08:12:06.053817+0000","last_became_peered":"2024-01-20T08:12:06.053817+0000","last_unstale":"2024-01-20T08:12:07.046631+0000","last_undegraded":"2024-01-20T08:12:07.046631+0000","last_fullsized":"2024-01-20T08:12:07.046631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:32.005693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317353+0000","last_change":"2024-01-20T08:12:07.069110+0000","last_active":"2024-01-20T08:12:08.317353+0000","last_peered":"2024-01-20T08:12:08.317353+0000","last_clean":"2024-01-20T08:12:08.317353+0000","last_became_active":"2024-01-20T08:12:07.068542+0000","last_became_peered":"2024-01-20T08:12:07.068542+0000","last_unstale":"2024-01-20T08:12:08.317353+0000","last_undegraded":"2024-01-20T08:12:08.317353+0000","last_fullsized":"2024-01-20T08:12:08.317353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:33.766825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074228+0000","last_change":"2024-01-20T08:12:06.075567+0000","last_active":"2024-01-20T08:12:07.074228+0000","last_peered":"2024-01-20T08:12:07.074228+0000","last_clean":"2024-01-20T08:12:07.074228+0000","last_became_active":"2024-01-20T08:12:06.075224+0000","last_became_peered":"2024-01-20T08:12:06.075224+0000","last_unstale":"2024-01-20T08:12:07.074228+0000","last_undegraded":"2024-01-20T08:12:07.074228+0000","last_fullsized":"2024-01-20T08:12:07.074228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:37.894928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047771+0000","last_change":"2024-01-20T08:12:07.087383+0000","last_active":"2024-01-20T08:12:08.047771+0000","last_peered":"2024-01-20T08:12:08.047771+0000","last_clean":"2024-01-20T08:12:08.047771+0000","last_became_active":"2024-01-20T08:12:07.080077+0000","last_became_peered":"2024-01-20T08:12:07.080077+0000","last_unstale":"2024-01-20T08:12:08.047771+0000","last_undegraded":"2024-01-20T08:12:08.047771+0000","last_fullsized":"2024-01-20T08:12:08.047771+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.051450+0000","last_change":"2024-01-20T08:12:06.061973+0000","last_active":"2024-01-20T08:12:07.051450+0000","last_peered":"2024-01-20T08:12:07.051450+0000","last_clean":"2024-01-20T08:12:07.051450+0000","last_became_active":"2024-01-20T08:12:06.061556+0000","last_became_peered":"2024-01-20T08:12:06.061556+0000","last_unstale":"2024-01-20T08:12:07.051450+0000","last_undegraded":"2024-01-20T08:12:07.051450+0000","last_fullsized":"2024-01-20T08:12:07.051450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:44.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315706+0000","last_change":"2024-01-20T08:12:07.057739+0000","last_active":"2024-01-20T08:12:08.315706+0000","last_peered":"2024-01-20T08:12:08.315706+0000","last_clean":"2024-01-20T08:12:08.315706+0000","last_became_active":"2024-01-20T08:12:07.055502+0000","last_became_peered":"2024-01-20T08:12:07.055502+0000","last_unstale":"2024-01-20T08:12:08.315706+0000","last_undegraded":"2024-01-20T08:12:08.315706+0000","last_fullsized":"2024-01-20T08:12:08.315706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:13.798575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101367+0000","last_change":"2024-01-20T08:12:06.075821+0000","last_active":"2024-01-20T08:12:07.101367+0000","last_peered":"2024-01-20T08:12:07.101367+0000","last_clean":"2024-01-20T08:12:07.101367+0000","last_became_active":"2024-01-20T08:12:06.075449+0000","last_became_peered":"2024-01-20T08:12:06.075449+0000","last_unstale":"2024-01-20T08:12:07.101367+0000","last_undegraded":"2024-01-20T08:12:07.101367+0000","last_fullsized":"2024-01-20T08:12:07.101367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:44.906399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047518+0000","last_change":"2024-01-20T08:12:07.081343+0000","last_active":"2024-01-20T08:12:08.047518+0000","last_peered":"2024-01-20T08:12:08.047518+0000","last_clean":"2024-01-20T08:12:08.047518+0000","last_became_active":"2024-01-20T08:12:07.079569+0000","last_became_peered":"2024-01-20T08:12:07.079569+0000","last_unstale":"2024-01-20T08:12:08.047518+0000","last_undegraded":"2024-01-20T08:12:08.047518+0000","last_fullsized":"2024-01-20T08:12:08.047518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.103278+0000","last_change":"2024-01-20T08:12:06.066310+0000","last_active":"2024-01-20T08:12:07.103278+0000","last_peered":"2024-01-20T08:12:07.103278+0000","last_clean":"2024-01-20T08:12:07.103278+0000","last_became_active":"2024-01-20T08:12:06.065636+0000","last_became_peered":"2024-01-20T08:12:06.065636+0000","last_unstale":"2024-01-20T08:12:07.103278+0000","last_undegraded":"2024-01-20T08:12:07.103278+0000","last_fullsized":"2024-01-20T08:12:07.103278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317051+0000","last_change":"2024-01-20T08:12:07.078287+0000","last_active":"2024-01-20T08:12:08.317051+0000","last_peered":"2024-01-20T08:12:08.317051+0000","last_clean":"2024-01-20T08:12:08.317051+0000","last_became_active":"2024-01-20T08:12:07.078008+0000","last_became_peered":"2024-01-20T08:12:07.078008+0000","last_unstale":"2024-01-20T08:12:08.317051+0000","last_undegraded":"2024-01-20T08:12:08.317051+0000","last_fullsized":"2024-01-20T08:12:08.317051+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101761+0000","last_change":"2024-01-20T08:12:06.065744+0000","last_active":"2024-01-20T08:12:07.101761+0000","last_peered":"2024-01-20T08:12:07.101761+0000","last_clean":"2024-01-20T08:12:07.101761+0000","last_became_active":"2024-01-20T08:12:06.065473+0000","last_became_peered":"2024-01-20T08:12:06.065473+0000","last_unstale":"2024-01-20T08:12:07.101761+0000","last_undegraded":"2024-01-20T08:12:07.101761+0000","last_fullsized":"2024-01-20T08:12:07.101761+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:28.564397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046124+0000","last_change":"2024-01-20T08:12:07.078220+0000","last_active":"2024-01-20T08:12:08.046124+0000","last_peered":"2024-01-20T08:12:08.046124+0000","last_clean":"2024-01-20T08:12:08.046124+0000","last_became_active":"2024-01-20T08:12:07.077812+0000","last_became_peered":"2024-01-20T08:12:07.077812+0000","last_unstale":"2024-01-20T08:12:08.046124+0000","last_undegraded":"2024-01-20T08:12:08.046124+0000","last_fullsized":"2024-01-20T08:12:08.046124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:54.112972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.066821+0000","last_change":"2024-01-20T08:12:06.071522+0000","last_active":"2024-01-20T08:12:07.066821+0000","last_peered":"2024-01-20T08:12:07.066821+0000","last_clean":"2024-01-20T08:12:07.066821+0000","last_became_active":"2024-01-20T08:12:06.069659+0000","last_became_peered":"2024-01-20T08:12:06.069659+0000","last_unstale":"2024-01-20T08:12:07.066821+0000","last_undegraded":"2024-01-20T08:12:07.066821+0000","last_fullsized":"2024-01-20T08:12:07.066821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316985+0000","last_change":"2024-01-20T08:12:07.078740+0000","last_active":"2024-01-20T08:12:08.316985+0000","last_peered":"2024-01-20T08:12:08.316985+0000","last_clean":"2024-01-20T08:12:08.316985+0000","last_became_active":"2024-01-20T08:12:07.078413+0000","last_became_peered":"2024-01-20T08:12:07.078413+0000","last_unstale":"2024-01-20T08:12:08.316985+0000","last_undegraded":"2024-01-20T08:12:08.316985+0000","last_fullsized":"2024-01-20T08:12:08.316985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.190626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063368+0000","last_change":"2024-01-20T08:12:06.071714+0000","last_active":"2024-01-20T08:12:07.063368+0000","last_peered":"2024-01-20T08:12:07.063368+0000","last_clean":"2024-01-20T08:12:07.063368+0000","last_became_active":"2024-01-20T08:12:06.071263+0000","last_became_peered":"2024-01-20T08:12:06.071263+0000","last_unstale":"2024-01-20T08:12:07.063368+0000","last_undegraded":"2024-01-20T08:12:07.063368+0000","last_fullsized":"2024-01-20T08:12:07.063368+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:05.094918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046535+0000","last_change":"2024-01-20T08:12:07.088126+0000","last_active":"2024-01-20T08:12:08.046535+0000","last_peered":"2024-01-20T08:12:08.046535+0000","last_clean":"2024-01-20T08:12:08.046535+0000","last_became_active":"2024-01-20T08:12:07.087789+0000","last_became_peered":"2024-01-20T08:12:07.087789+0000","last_unstale":"2024-01-20T08:12:08.046535+0000","last_undegraded":"2024-01-20T08:12:08.046535+0000","last_fullsized":"2024-01-20T08:12:08.046535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101182+0000","last_change":"2024-01-20T08:12:06.074824+0000","last_active":"2024-01-20T08:12:07.101182+0000","last_peered":"2024-01-20T08:12:07.101182+0000","last_clean":"2024-01-20T08:12:07.101182+0000","last_became_active":"2024-01-20T08:12:06.074111+0000","last_became_peered":"2024-01-20T08:12:06.074111+0000","last_unstale":"2024-01-20T08:12:07.101182+0000","last_undegraded":"2024-01-20T08:12:07.101182+0000","last_fullsized":"2024-01-20T08:12:07.101182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047194+0000","last_change":"2024-01-20T08:12:07.082593+0000","last_active":"2024-01-20T08:12:08.047194+0000","last_peered":"2024-01-20T08:12:08.047194+0000","last_clean":"2024-01-20T08:12:08.047194+0000","last_became_active":"2024-01-20T08:12:07.082366+0000","last_became_peered":"2024-01-20T08:12:07.082366+0000","last_unstale":"2024-01-20T08:12:08.047194+0000","last_undegraded":"2024-01-20T08:12:08.047194+0000","last_fullsized":"2024-01-20T08:12:08.047194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101568+0000","last_change":"2024-01-20T08:12:06.065566+0000","last_active":"2024-01-20T08:12:07.101568+0000","last_peered":"2024-01-20T08:12:07.101568+0000","last_clean":"2024-01-20T08:12:07.101568+0000","last_became_active":"2024-01-20T08:12:06.065270+0000","last_became_peered":"2024-01-20T08:12:06.065270+0000","last_unstale":"2024-01-20T08:12:07.101568+0000","last_undegraded":"2024-01-20T08:12:07.101568+0000","last_fullsized":"2024-01-20T08:12:07.101568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:45.655205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318970+0000","last_change":"2024-01-20T08:12:07.082690+0000","last_active":"2024-01-20T08:12:08.318970+0000","last_peered":"2024-01-20T08:12:08.318970+0000","last_clean":"2024-01-20T08:12:08.318970+0000","last_became_active":"2024-01-20T08:12:07.082364+0000","last_became_peered":"2024-01-20T08:12:07.082364+0000","last_unstale":"2024-01-20T08:12:08.318970+0000","last_undegraded":"2024-01-20T08:12:08.318970+0000","last_fullsized":"2024-01-20T08:12:08.318970+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099313+0000","last_change":"2024-01-20T08:12:06.061749+0000","last_active":"2024-01-20T08:12:07.099313+0000","last_peered":"2024-01-20T08:12:07.099313+0000","last_clean":"2024-01-20T08:12:07.099313+0000","last_became_active":"2024-01-20T08:12:06.061466+0000","last_became_peered":"2024-01-20T08:12:06.061466+0000","last_unstale":"2024-01-20T08:12:07.099313+0000","last_undegraded":"2024-01-20T08:12:07.099313+0000","last_fullsized":"2024-01-20T08:12:07.099313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:32.760864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045704+0000","last_change":"2024-01-20T08:12:07.065833+0000","last_active":"2024-01-20T08:12:08.045704+0000","last_peered":"2024-01-20T08:12:08.045704+0000","last_clean":"2024-01-20T08:12:08.045704+0000","last_became_active":"2024-01-20T08:12:07.065547+0000","last_became_peered":"2024-01-20T08:12:07.065547+0000","last_unstale":"2024-01-20T08:12:08.045704+0000","last_undegraded":"2024-01-20T08:12:08.045704+0000","last_fullsized":"2024-01-20T08:12:08.045704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:08.237987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100053+0000","last_change":"2024-01-20T08:12:06.073869+0000","last_active":"2024-01-20T08:12:07.100053+0000","last_peered":"2024-01-20T08:12:07.100053+0000","last_clean":"2024-01-20T08:12:07.100053+0000","last_became_active":"2024-01-20T08:12:06.073514+0000","last_became_peered":"2024-01-20T08:12:06.073514+0000","last_unstale":"2024-01-20T08:12:07.100053+0000","last_undegraded":"2024-01-20T08:12:07.100053+0000","last_fullsized":"2024-01-20T08:12:07.100053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047715+0000","last_change":"2024-01-20T08:12:07.084906+0000","last_active":"2024-01-20T08:12:08.047715+0000","last_peered":"2024-01-20T08:12:08.047715+0000","last_clean":"2024-01-20T08:12:08.047715+0000","last_became_active":"2024-01-20T08:12:07.080034+0000","last_became_peered":"2024-01-20T08:12:07.080034+0000","last_unstale":"2024-01-20T08:12:08.047715+0000","last_undegraded":"2024-01-20T08:12:08.047715+0000","last_fullsized":"2024-01-20T08:12:08.047715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.073459+0000","last_change":"2024-01-20T08:12:06.056008+0000","last_active":"2024-01-20T08:12:07.073459+0000","last_peered":"2024-01-20T08:12:07.073459+0000","last_clean":"2024-01-20T08:12:07.073459+0000","last_became_active":"2024-01-20T08:12:06.055317+0000","last_became_peered":"2024-01-20T08:12:06.055317+0000","last_unstale":"2024-01-20T08:12:07.073459+0000","last_undegraded":"2024-01-20T08:12:07.073459+0000","last_fullsized":"2024-01-20T08:12:07.073459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317364+0000","last_change":"2024-01-20T08:12:07.078035+0000","last_active":"2024-01-20T08:12:08.317364+0000","last_peered":"2024-01-20T08:12:08.317364+0000","last_clean":"2024-01-20T08:12:08.317364+0000","last_became_active":"2024-01-20T08:12:07.076150+0000","last_became_peered":"2024-01-20T08:12:07.076150+0000","last_unstale":"2024-01-20T08:12:08.317364+0000","last_undegraded":"2024-01-20T08:12:08.317364+0000","last_fullsized":"2024-01-20T08:12:08.317364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101610+0000","last_change":"2024-01-20T08:12:06.058384+0000","last_active":"2024-01-20T08:12:07.101610+0000","last_peered":"2024-01-20T08:12:07.101610+0000","last_clean":"2024-01-20T08:12:07.101610+0000","last_became_active":"2024-01-20T08:12:06.058097+0000","last_became_peered":"2024-01-20T08:12:06.058097+0000","last_unstale":"2024-01-20T08:12:07.101610+0000","last_undegraded":"2024-01-20T08:12:07.101610+0000","last_fullsized":"2024-01-20T08:12:07.101610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:12.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044363+0000","last_change":"2024-01-20T08:12:07.077060+0000","last_active":"2024-01-20T08:12:08.044363+0000","last_peered":"2024-01-20T08:12:08.044363+0000","last_clean":"2024-01-20T08:12:08.044363+0000","last_became_active":"2024-01-20T08:12:07.074560+0000","last_became_peered":"2024-01-20T08:12:07.074560+0000","last_unstale":"2024-01-20T08:12:08.044363+0000","last_undegraded":"2024-01-20T08:12:08.044363+0000","last_fullsized":"2024-01-20T08:12:08.044363+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:11:42.486924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043187+0000","last_change":"2024-01-20T08:12:06.061716+0000","last_active":"2024-01-20T08:12:07.043187+0000","last_peered":"2024-01-20T08:12:07.043187+0000","last_clean":"2024-01-20T08:12:07.043187+0000","last_became_active":"2024-01-20T08:12:06.061410+0000","last_became_peered":"2024-01-20T08:12:06.061410+0000","last_unstale":"2024-01-20T08:12:07.043187+0000","last_undegraded":"2024-01-20T08:12:07.043187+0000","last_fullsized":"2024-01-20T08:12:07.043187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043900+0000","last_change":"2024-01-20T08:12:07.077678+0000","last_active":"2024-01-20T08:12:08.043900+0000","last_peered":"2024-01-20T08:12:08.043900+0000","last_clean":"2024-01-20T08:12:08.043900+0000","last_became_active":"2024-01-20T08:12:07.077094+0000","last_became_peered":"2024-01-20T08:12:07.077094+0000","last_unstale":"2024-01-20T08:12:08.043900+0000","last_undegraded":"2024-01-20T08:12:08.043900+0000","last_fullsized":"2024-01-20T08:12:08.043900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.059759+0000","last_change":"2024-01-20T08:12:06.063892+0000","last_active":"2024-01-20T08:12:07.059759+0000","last_peered":"2024-01-20T08:12:07.059759+0000","last_clean":"2024-01-20T08:12:07.059759+0000","last_became_active":"2024-01-20T08:12:06.063601+0000","last_became_peered":"2024-01-20T08:12:06.063601+0000","last_unstale":"2024-01-20T08:12:07.059759+0000","last_undegraded":"2024-01-20T08:12:07.059759+0000","last_fullsized":"2024-01-20T08:12:07.059759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:48.315980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318635+0000","last_change":"2024-01-20T08:12:07.073337+0000","last_active":"2024-01-20T08:12:08.318635+0000","last_peered":"2024-01-20T08:12:08.318635+0000","last_clean":"2024-01-20T08:12:08.318635+0000","last_became_active":"2024-01-20T08:12:07.073087+0000","last_became_peered":"2024-01-20T08:12:07.073087+0000","last_unstale":"2024-01-20T08:12:08.318635+0000","last_undegraded":"2024-01-20T08:12:08.318635+0000","last_fullsized":"2024-01-20T08:12:08.318635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101475+0000","last_change":"2024-01-20T08:12:06.049193+0000","last_active":"2024-01-20T08:12:07.101475+0000","last_peered":"2024-01-20T08:12:07.101475+0000","last_clean":"2024-01-20T08:12:07.101475+0000","last_became_active":"2024-01-20T08:12:06.048916+0000","last_became_peered":"2024-01-20T08:12:06.048916+0000","last_unstale":"2024-01-20T08:12:07.101475+0000","last_undegraded":"2024-01-20T08:12:07.101475+0000","last_fullsized":"2024-01-20T08:12:07.101475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:53.905817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319316+0000","last_change":"2024-01-20T08:12:07.082890+0000","last_active":"2024-01-20T08:12:08.319316+0000","last_peered":"2024-01-20T08:12:08.319316+0000","last_clean":"2024-01-20T08:12:08.319316+0000","last_became_active":"2024-01-20T08:12:07.080723+0000","last_became_peered":"2024-01-20T08:12:07.080723+0000","last_unstale":"2024-01-20T08:12:08.319316+0000","last_undegraded":"2024-01-20T08:12:08.319316+0000","last_fullsized":"2024-01-20T08:12:08.319316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074909+0000","last_change":"2024-01-20T08:12:06.062568+0000","last_active":"2024-01-20T08:12:07.074909+0000","last_peered":"2024-01-20T08:12:07.074909+0000","last_clean":"2024-01-20T08:12:07.074909+0000","last_became_active":"2024-01-20T08:12:06.062294+0000","last_became_peered":"2024-01-20T08:12:06.062294+0000","last_unstale":"2024-01-20T08:12:07.074909+0000","last_undegraded":"2024-01-20T08:12:07.074909+0000","last_fullsized":"2024-01-20T08:12:07.074909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:39.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316009+0000","last_change":"2024-01-20T08:12:07.060815+0000","last_active":"2024-01-20T08:12:08.316009+0000","last_peered":"2024-01-20T08:12:08.316009+0000","last_clean":"2024-01-20T08:12:08.316009+0000","last_became_active":"2024-01-20T08:12:07.057155+0000","last_became_peered":"2024-01-20T08:12:07.057155+0000","last_unstale":"2024-01-20T08:12:08.316009+0000","last_undegraded":"2024-01-20T08:12:08.316009+0000","last_fullsized":"2024-01-20T08:12:08.316009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:49.321942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.067445+0000","last_change":"2024-01-20T08:12:06.063244+0000","last_active":"2024-01-20T08:12:07.067445+0000","last_peered":"2024-01-20T08:12:07.067445+0000","last_clean":"2024-01-20T08:12:07.067445+0000","last_became_active":"2024-01-20T08:12:06.062628+0000","last_became_peered":"2024-01-20T08:12:06.062628+0000","last_unstale":"2024-01-20T08:12:07.067445+0000","last_undegraded":"2024-01-20T08:12:07.067445+0000","last_fullsized":"2024-01-20T08:12:07.067445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045067+0000","last_change":"2024-01-20T08:12:07.088893+0000","last_active":"2024-01-20T08:12:08.045067+0000","last_peered":"2024-01-20T08:12:08.045067+0000","last_clean":"2024-01-20T08:12:08.045067+0000","last_became_active":"2024-01-20T08:12:07.088233+0000","last_became_peered":"2024-01-20T08:12:07.088233+0000","last_unstale":"2024-01-20T08:12:08.045067+0000","last_undegraded":"2024-01-20T08:12:08.045067+0000","last_fullsized":"2024-01-20T08:12:08.045067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:39:05.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063539+0000","last_change":"2024-01-20T08:12:06.069603+0000","last_active":"2024-01-20T08:12:07.063539+0000","last_peered":"2024-01-20T08:12:07.063539+0000","last_clean":"2024-01-20T08:12:07.063539+0000","last_became_active":"2024-01-20T08:12:06.069220+0000","last_became_peered":"2024-01-20T08:12:06.069220+0000","last_unstale":"2024-01-20T08:12:07.063539+0000","last_undegraded":"2024-01-20T08:12:07.063539+0000","last_fullsized":"2024-01-20T08:12:07.063539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044828+0000","last_change":"2024-01-20T08:12:07.066751+0000","last_active":"2024-01-20T08:12:08.044828+0000","last_peered":"2024-01-20T08:12:08.044828+0000","last_clean":"2024-01-20T08:12:08.044828+0000","last_became_active":"2024-01-20T08:12:07.063086+0000","last_became_peered":"2024-01-20T08:12:07.063086+0000","last_unstale":"2024-01-20T08:12:08.044828+0000","last_undegraded":"2024-01-20T08:12:08.044828+0000","last_fullsized":"2024-01-20T08:12:08.044828+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:18:45.087923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043166+0000","last_change":"2024-01-20T08:12:06.066906+0000","last_active":"2024-01-20T08:12:07.043166+0000","last_peered":"2024-01-20T08:12:07.043166+0000","last_clean":"2024-01-20T08:12:07.043166+0000","last_became_active":"2024-01-20T08:12:06.066598+0000","last_became_peered":"2024-01-20T08:12:06.066598+0000","last_unstale":"2024-01-20T08:12:07.043166+0000","last_undegraded":"2024-01-20T08:12:07.043166+0000","last_fullsized":"2024-01-20T08:12:07.043166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046873+0000","last_change":"2024-01-20T08:12:07.088972+0000","last_active":"2024-01-20T08:12:08.046873+0000","last_peered":"2024-01-20T08:12:08.046873+0000","last_clean":"2024-01-20T08:12:08.046873+0000","last_became_active":"2024-01-20T08:12:07.088534+0000","last_became_peered":"2024-01-20T08:12:07.088534+0000","last_unstale":"2024-01-20T08:12:08.046873+0000","last_undegraded":"2024-01-20T08:12:08.046873+0000","last_fullsized":"2024-01-20T08:12:08.046873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.047019+0000","last_change":"2024-01-20T08:12:06.061867+0000","last_active":"2024-01-20T08:12:07.047019+0000","last_peered":"2024-01-20T08:12:07.047019+0000","last_clean":"2024-01-20T08:12:07.047019+0000","last_became_active":"2024-01-20T08:12:06.061474+0000","last_became_peered":"2024-01-20T08:12:06.061474+0000","last_unstale":"2024-01-20T08:12:07.047019+0000","last_undegraded":"2024-01-20T08:12:07.047019+0000","last_fullsized":"2024-01-20T08:12:07.047019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:28.133216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315413+0000","last_change":"2024-01-20T08:12:07.075925+0000","last_active":"2024-01-20T08:12:08.315413+0000","last_peered":"2024-01-20T08:12:08.315413+0000","last_clean":"2024-01-20T08:12:08.315413+0000","last_became_active":"2024-01-20T08:12:07.075681+0000","last_became_peered":"2024-01-20T08:12:07.075681+0000","last_unstale":"2024-01-20T08:12:08.315413+0000","last_undegraded":"2024-01-20T08:12:08.315413+0000","last_fullsized":"2024-01-20T08:12:08.315413+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:38.900889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043202+0000","last_change":"2024-01-20T08:12:06.056764+0000","last_active":"2024-01-20T08:12:07.043202+0000","last_peered":"2024-01-20T08:12:07.043202+0000","last_clean":"2024-01-20T08:12:07.043202+0000","last_became_active":"2024-01-20T08:12:06.056438+0000","last_became_peered":"2024-01-20T08:12:06.056438+0000","last_unstale":"2024-01-20T08:12:07.043202+0000","last_undegraded":"2024-01-20T08:12:07.043202+0000","last_fullsized":"2024-01-20T08:12:07.043202+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045482+0000","last_change":"2024-01-20T08:12:07.075968+0000","last_active":"2024-01-20T08:12:08.045482+0000","last_peered":"2024-01-20T08:12:08.045482+0000","last_clean":"2024-01-20T08:12:08.045482+0000","last_became_active":"2024-01-20T08:12:07.071647+0000","last_became_peered":"2024-01-20T08:12:07.071647+0000","last_unstale":"2024-01-20T08:12:08.045482+0000","last_undegraded":"2024-01-20T08:12:08.045482+0000","last_fullsized":"2024-01-20T08:12:08.045482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:52:22.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.045892+0000","last_change":"2024-01-20T08:12:06.060007+0000","last_active":"2024-01-20T08:12:07.045892+0000","last_peered":"2024-01-20T08:12:07.045892+0000","last_clean":"2024-01-20T08:12:07.045892+0000","last_became_active":"2024-01-20T08:12:06.059513+0000","last_became_peered":"2024-01-20T08:12:06.059513+0000","last_unstale":"2024-01-20T08:12:07.045892+0000","last_undegraded":"2024-01-20T08:12:07.045892+0000","last_fullsized":"2024-01-20T08:12:07.045892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:20.449358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044818+0000","last_change":"2024-01-20T08:12:07.073628+0000","last_active":"2024-01-20T08:12:08.044818+0000","last_peered":"2024-01-20T08:12:08.044818+0000","last_clean":"2024-01-20T08:12:08.044818+0000","last_became_active":"2024-01-20T08:12:07.073348+0000","last_became_peered":"2024-01-20T08:12:07.073348+0000","last_unstale":"2024-01-20T08:12:08.044818+0000","last_undegraded":"2024-01-20T08:12:08.044818+0000","last_fullsized":"2024-01-20T08:12:08.044818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:59:53.783140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065626+0000","last_change":"2024-01-20T08:12:06.067638+0000","last_active":"2024-01-20T08:12:07.065626+0000","last_peered":"2024-01-20T08:12:07.065626+0000","last_clean":"2024-01-20T08:12:07.065626+0000","last_became_active":"2024-01-20T08:12:06.067251+0000","last_became_peered":"2024-01-20T08:12:06.067251+0000","last_unstale":"2024-01-20T08:12:07.065626+0000","last_undegraded":"2024-01-20T08:12:07.065626+0000","last_fullsized":"2024-01-20T08:12:07.065626+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":192,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065209+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:07.065209+0000","last_peered":"2024-01-20T08:12:07.065209+0000","last_clean":"2024-01-20T08:12:07.065209+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:07.065209+0000","last_undegraded":"2024-01-20T08:12:07.065209+0000","last_fullsized":"2024-01-20T08:12:07.065209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1224704,"data_stored":852654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":1.1739999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.514},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.478}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.2709999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.5349999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.554},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.6699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":262126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4359999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9119999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5449999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6100000000000001,"5min":2.008,"15min":2.008},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1659999999999999,"15min":1.1699999999999999},"min":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8129999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3080000000000001,"15min":1.333},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.0629999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4239999999999999,"15min":1.444},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0720000000000001,"5min":2.222,"15min":2.222},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.4379999999999999,"15min":1.464},"min":{"1min":0.82199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5980000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.139}]},{"osd":4,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.5529999999999999,"15min":1.599},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.825,"5min":2.915,"15min":2.915},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.659,"15min":1.6890000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2189999999999999,"5min":2.718,"15min":2.718},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5580000000000001,"15min":1.579},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.74,"15min":1.794},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.734,"15min":1.758},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3500000000000001,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.448},{"interface":"front","average":{"1min":1.536,"5min":1.746,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0209999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.492}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":262778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88200000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.589}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.343},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.2749999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.194}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.071},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.2330000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.429}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.464}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":263738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.252},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.92000000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":1.29}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5980000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":1.391},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.524}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.871},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.6399999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.774}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.9239999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.46}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.974}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":1.161}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.373}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.296}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.524},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5049999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.4199999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.232}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.335}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":262216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.7410000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.181},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":1.3720000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.885},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.276}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.8200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.609},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.6879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.913}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":2},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.778}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":854688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.4019999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1859999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85799999999999998,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.256,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0069999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.131,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.492,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.177}]},{"osd":4,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.107,"15min":1.091},"min":{"1min":0.67000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1160000000000001,"15min":1.115},"min":{"1min":0.85299999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.502,"5min":1.589,"15min":1.589},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.74299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.5700000000000001,"5min":1.865,"15min":1.865},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.244,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.02,"5min":2.427,"15min":2.427},"last":1.3959999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.86799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1150000000000002,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.276,"15min":1.282},"min":{"1min":0.81000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.772,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3240000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.371,"15min":1.3819999999999999},"min":{"1min":0.88300000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7889999999999999,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.635},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.853,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:12.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-20T08:12:12.609 INFO:tasks.ceph.mds.b.smithi110.stderr:2024-01-20T08:12:12.607+0000 7f1bf4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:12:12.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.674+0000 7fe08e600640 1 Processor -- start 2024-01-20T08:12:12.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.674+0000 7fe08e600640 1 -- start start 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe08814fdb0 0x7fe0880c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0880c1d90 0x7fe088152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe088153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0880a9ce0 con 0x7fe0880c1d90 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0880a93b0 con 0x7fe08814fdb0 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe08e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe088152790 con 0x7fe0880c3460 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe07e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0880c1d90 0x7fe088152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe07e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe0880c1d90 0x7fe088152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47616/0 (socket says 172.21.15.100:47616) 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.676+0000 7fe07e800640 1 -- 172.21.15.100:0/1689046417 learned_addr learned my addr 172.21.15.100:0/1689046417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe087400640 1 --2- 172.21.15.100:0/1689046417 >> v2:172.21.15.110:3300/0 conn(0x7fe08814fdb0 0x7fe0880c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe087e00640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe088153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe07e800640 1 -- 172.21.15.100:0/1689046417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 msgr2=0x7fe088153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:12.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe07e800640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe088153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe07e800640 1 -- 172.21.15.100:0/1689046417 >> v2:172.21.15.110:3300/0 conn(0x7fe08814fdb0 msgr2=0x7fe0880c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:12.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe07e800640 1 --2- 172.21.15.100:0/1689046417 >> v2:172.21.15.110:3300/0 conn(0x7fe08814fdb0 0x7fe0880c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.677+0000 7fe07e800640 1 -- 172.21.15.100:0/1689046417 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe088150190 con 0x7fe0880c1d90 2024-01-20T08:12:12.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.678+0000 7fe07e800640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe088152be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe08806e580 tx=0x7fe07002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e645ae5a3886680 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.678+0000 7fe086a00640 1 -- 172.21.15.100:0/1689046417 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070031870 con 0x7fe0880c1d90 2024-01-20T08:12:12.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.678+0000 7fe086a00640 1 -- 172.21.15.100:0/1689046417 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700319d0 con 0x7fe0880c1d90 2024-01-20T08:12:12.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.678+0000 7fe086a00640 1 -- 172.21.15.100:0/1689046417 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070031d60 con 0x7fe0880c1d90 2024-01-20T08:12:12.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 -- 172.21.15.100:0/1689046417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 msgr2=0x7fe088152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe088152be0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fe08806e580 tx=0x7fe07002b910 comp rx=0 tx=0).stop 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 -- 172.21.15.100:0/1689046417 shutdown_connections 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe088153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 --2- 172.21.15.100:0/1689046417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe088152be0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 --2- 172.21.15.100:0/1689046417 >> v2:172.21.15.110:3300/0 conn(0x7fe08814fdb0 0x7fe0880c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 -- 172.21.15.100:0/1689046417 >> 172.21.15.100:0/1689046417 conn(0x7fe0880c2940 msgr2=0x7fe0880c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 -- 172.21.15.100:0/1689046417 shutdown_connections 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.679+0000 7fe08e600640 1 -- 172.21.15.100:0/1689046417 wait complete. 2024-01-20T08:12:12.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.681+0000 7fe08e600640 1 Processor -- start 2024-01-20T08:12:12.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.681+0000 7fe08e600640 1 -- start start 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe08806ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe08814fdb0 0x7fe088150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08806d980 con 0x7fe0880c1d90 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881e9240 con 0x7fe08814fdb0 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe08e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0881454e0 con 0x7fe0880c3460 2024-01-20T08:12:12.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47622/0 (socket says 172.21.15.100:47622) 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 -- 172.21.15.100:0/3309652276 learned_addr learned my addr 172.21.15.100:0/3309652276 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe07e800640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe08806ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087e00640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe08814fdb0 0x7fe088150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 -- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 msgr2=0x7fe08806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe08806ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 -- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe08814fdb0 msgr2=0x7fe088150ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.682+0000 7fe087400640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe08814fdb0 0x7fe088150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe087400640 1 -- 172.21.15.100:0/3309652276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0700094d0 con 0x7fe0880c1d90 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe07e800640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe08806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe087400640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe078007e40 tx=0x7fe07800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078014620 con 0x7fe0880c1d90 2024-01-20T08:12:12.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07800ee90 con 0x7fe0880c1d90 2024-01-20T08:12:12.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0881457c0 con 0x7fe0880c1d90 2024-01-20T08:12:12.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780149c0 con 0x7fe0880c1d90 2024-01-20T08:12:12.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.683+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0881e9770 con 0x7fe0880c1d90 2024-01-20T08:12:12.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.684+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe08804e970 con 0x7fe0880c1d90 2024-01-20T08:12:12.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.686+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe078014b20 con 0x7fe0880c1d90 2024-01-20T08:12:12.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.686+0000 7fe07fe00640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 0x7fe06006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:12.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.687+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe07808a020 con 0x7fe0880c1d90 2024-01-20T08:12:12.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.687+0000 7fe07e800640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 0x7fe06006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:12.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.687+0000 7fe07e800640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 0x7fe06006d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe070036000 tx=0x7fe07003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:12.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.691+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe078054e60 con 0x7fe0880c1d90 2024-01-20T08:12:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.954+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe0880c2260 con 0x7fe0880c1d90 2024-01-20T08:12:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.955+0000 7fe07fe00640 1 -- 172.21.15.100:0/3309652276 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1303 (secure 0 0 0) 0x7fe078058480 con 0x7fe0880c1d90 2024-01-20T08:12:12.957 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:12.957 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":52,"num_osds":8,"num_up_osds":8,"osd_up_since":1705738200,"num_in_osds":8,"osd_in_since":1705738192,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592778,"bytes_used":248897536,"bytes_avail":772845215744,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":32,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"b","status":"up:active","gid":5679}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-01-20T08:11:57.920157+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 msgr2=0x7fe06006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 0x7fe06006d390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe070036000 tx=0x7fe07003c040 comp rx=0 tx=0).stop 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 msgr2=0x7fe0881e9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe078007e40 tx=0x7fe07800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 shutdown_connections 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe08814fdb0 0x7fe088150ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe06006aed0 0x7fe06006d390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe0880c3460 0x7fe08806ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 --2- 172.21.15.100:0/3309652276 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0880c1d90 0x7fe0881e9c90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:12.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 >> 172.21.15.100:0/3309652276 conn(0x7fe0880c2940 msgr2=0x7fe0880aaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:12.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 shutdown_connections 2024-01-20T08:12:12.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:12.958+0000 7fe08e600640 1 -- 172.21.15.100:0/3309652276 wait complete. 2024-01-20T08:12:12.979 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-20T08:12:12.979 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.178+0000 7ff1f8a00640 1 Processor -- start 2024-01-20T08:12:13.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.178+0000 7ff1f8a00640 1 -- start start 2024-01-20T08:12:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.179+0000 7ff1f8a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1f0147f20 0x7ff1f00abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.179+0000 7ff1f8a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff1f0151f60 0x7ff1f0070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.179+0000 7ff1f8a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f00c1670 con 0x7ff1f00c1b00 2024-01-20T08:12:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.179+0000 7ff1f8a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f01524b0 con 0x7ff1f0147f20 2024-01-20T08:12:13.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.179+0000 7ff1f8a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f00c0d40 con 0x7ff1f0151f60 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1f0147f20 0x7ff1f00abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff1f0147f20 0x7ff1f00abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47638/0 (socket says 172.21.15.100:47638) 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 -- 172.21.15.100:0/1680536281 learned_addr learned my addr 172.21.15.100:0/1680536281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 -- 172.21.15.100:0/1680536281 >> v2:172.21.15.110:3300/0 conn(0x7ff1f0151f60 msgr2=0x7ff1f0070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 --2- 172.21.15.100:0/1680536281 >> v2:172.21.15.110:3300/0 conn(0x7ff1f0151f60 0x7ff1f0070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 -- 172.21.15.100:0/1680536281 >> v1:172.21.15.110:6789/0 conn(0x7ff1f00c1b00 legacy=0x7ff1f00c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:13.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.180+0000 7ff1f6000640 1 -- 172.21.15.100:0/1680536281 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f00c1020 con 0x7ff1f0147f20 2024-01-20T08:12:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.181+0000 7ff1f6000640 1 --2- 172.21.15.100:0/1680536281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f0147f20 0x7ff1f00abfd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1f006e550 tx=0x7ff1e002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb73a8f3fee713b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f4c00640 1 -- 172.21.15.100:0/1680536281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e002ee90 con 0x7ff1f0147f20 2024-01-20T08:12:13.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f4c00640 1 -- 172.21.15.100:0/1680536281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0036440 con 0x7ff1f0147f20 2024-01-20T08:12:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f4c00640 1 -- 172.21.15.100:0/1680536281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00367d0 con 0x7ff1f0147f20 2024-01-20T08:12:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 -- 172.21.15.100:0/1680536281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f0147f20 msgr2=0x7ff1f00abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/1680536281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f0147f20 0x7ff1f00abfd0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff1f006e550 tx=0x7ff1e002e0e0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 -- 172.21.15.100:0/1680536281 shutdown_connections 2024-01-20T08:12:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/1680536281 >> v2:172.21.15.110:3300/0 conn(0x7ff1f0151f60 0x7ff1f0070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/1680536281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f0147f20 0x7ff1f00abfd0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.182+0000 7ff1f8a00640 1 -- 172.21.15.100:0/1680536281 >> 172.21.15.100:0/1680536281 conn(0x7ff1f006a5e0 msgr2=0x7ff1f006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.183+0000 7ff1f8a00640 1 -- 172.21.15.100:0/1680536281 shutdown_connections 2024-01-20T08:12:13.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.183+0000 7ff1f8a00640 1 -- 172.21.15.100:0/1680536281 wait complete. 2024-01-20T08:12:13.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.184+0000 7ff1f8a00640 1 Processor -- start 2024-01-20T08:12:13.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.184+0000 7ff1f8a00640 1 -- start start 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 0x7ff1f00bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1f0151f60 0x7ff1f00bfd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f00c61b0 con 0x7ff1f00c1b00 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f014f350 con 0x7ff1f0147f20 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f8a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f0150d70 con 0x7ff1f0151f60 2024-01-20T08:12:13.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:13.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47646/0 (socket says 172.21.15.100:47646) 2024-01-20T08:12:13.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.185+0000 7ff1f6000640 1 -- 172.21.15.100:0/2668417461 learned_addr learned my addr 172.21.15.100:0/2668417461 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f5600640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 0x7ff1f00bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 -- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1f0151f60 msgr2=0x7ff1f00bfd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1f0151f60 0x7ff1f00bfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1f0151f60 0x7ff1f00bfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 -- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 msgr2=0x7ff1f00bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 0x7ff1f00bf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 -- 172.21.15.100:0/2668417461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e000b770 con 0x7ff1f00c1b00 2024-01-20T08:12:13.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f5600640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 0x7ff1f00bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.186+0000 7ff1f6000640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff1e002e120 tx=0x7ff1e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.187+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e0034b80 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.187+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e0034ce0 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.187+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e00416c0 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.187+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f0150a90 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.187+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f01eb180 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.188+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f004e970 con 0x7ff1f00c1b00 2024-01-20T08:12:13.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.189+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff1e0041820 con 0x7ff1f00c1b00 2024-01-20T08:12:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.190+0000 7ff1ee000640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.190+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1e00ac9b0 con 0x7ff1f00c1b00 2024-01-20T08:12:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.190+0000 7ff1f5600640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:13.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.191+0000 7ff1f5600640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 0x7ff1c806d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0146e30 tx=0x7ff1d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:13.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.194+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff1e0077870 con 0x7ff1f00c1b00 2024-01-20T08:12:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.383+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff1f006e860 con 0x7ff1c806aed0 2024-01-20T08:12:13.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.396+0000 7ff1ee000640 1 -- 172.21.15.100:0/2668417461 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286744 (secure 0 0 0) 0x7ff1d800ae70 con 0x7ff1c806aed0 2024-01-20T08:12:13.402 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:13.403 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.402+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 msgr2=0x7ff1c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 0x7ff1c806d390 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1f0146e30 tx=0x7ff1d8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 msgr2=0x7ff1f014fac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff1e002e120 tx=0x7ff1e0004730 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 shutdown_connections 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff1c806aed0 0x7ff1c806d390 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff1f0151f60 0x7ff1f00bfd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff1f0147f20 0x7ff1f00bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 --2- 172.21.15.100:0/2668417461 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff1f00c1b00 0x7ff1f014fac0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 >> 172.21.15.100:0/2668417461 conn(0x7ff1f006a5e0 msgr2=0x7ff1f0071580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 shutdown_connections 2024-01-20T08:12:13.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:13.403+0000 7ff1f8a00640 1 -- 172.21.15.100:0/2668417461 wait complete. 2024-01-20T08:12:13.423 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":111,"stamp":"2024-01-20T08:12:11.923162+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243064,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731656,"statfs":{"total":773094113280,"available":772845215744,"internally_reserved":0,"allocated":6234112,"data_stored":3282564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001449"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313954+0000","last_change":"2024-01-20T08:12:07.068510+0000","last_active":"2024-01-20T08:12:08.313954+0000","last_peered":"2024-01-20T08:12:08.313954+0000","last_clean":"2024-01-20T08:12:08.313954+0000","last_became_active":"2024-01-20T08:12:07.068099+0000","last_became_peered":"2024-01-20T08:12:07.068099+0000","last_unstale":"2024-01-20T08:12:08.313954+0000","last_undegraded":"2024-01-20T08:12:08.313954+0000","last_fullsized":"2024-01-20T08:12:08.313954+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:51.051735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045903+0000","last_change":"2024-01-20T08:12:07.066208+0000","last_active":"2024-01-20T08:12:08.045903+0000","last_peered":"2024-01-20T08:12:08.045903+0000","last_clean":"2024-01-20T08:12:08.045903+0000","last_became_active":"2024-01-20T08:12:07.065935+0000","last_became_peered":"2024-01-20T08:12:07.065935+0000","last_unstale":"2024-01-20T08:12:08.045903+0000","last_undegraded":"2024-01-20T08:12:08.045903+0000","last_fullsized":"2024-01-20T08:12:08.045903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:55:51.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047157+0000","last_change":"2024-01-20T08:12:07.079204+0000","last_active":"2024-01-20T08:12:08.047157+0000","last_peered":"2024-01-20T08:12:08.047157+0000","last_clean":"2024-01-20T08:12:08.047157+0000","last_became_active":"2024-01-20T08:12:07.078933+0000","last_became_peered":"2024-01-20T08:12:07.078933+0000","last_unstale":"2024-01-20T08:12:08.047157+0000","last_undegraded":"2024-01-20T08:12:08.047157+0000","last_fullsized":"2024-01-20T08:12:08.047157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317951+0000","last_change":"2024-01-20T08:12:07.078940+0000","last_active":"2024-01-20T08:12:08.317951+0000","last_peered":"2024-01-20T08:12:08.317951+0000","last_clean":"2024-01-20T08:12:08.317951+0000","last_became_active":"2024-01-20T08:12:07.076282+0000","last_became_peered":"2024-01-20T08:12:07.076282+0000","last_unstale":"2024-01-20T08:12:08.317951+0000","last_undegraded":"2024-01-20T08:12:08.317951+0000","last_fullsized":"2024-01-20T08:12:08.317951+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313988+0000","last_change":"2024-01-20T08:12:07.079405+0000","last_active":"2024-01-20T08:12:08.313988+0000","last_peered":"2024-01-20T08:12:08.313988+0000","last_clean":"2024-01-20T08:12:08.313988+0000","last_became_active":"2024-01-20T08:12:07.079108+0000","last_became_peered":"2024-01-20T08:12:07.079108+0000","last_unstale":"2024-01-20T08:12:08.313988+0000","last_undegraded":"2024-01-20T08:12:08.313988+0000","last_fullsized":"2024-01-20T08:12:08.313988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:18.953566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044239+0000","last_change":"2024-01-20T08:12:07.069601+0000","last_active":"2024-01-20T08:12:08.044239+0000","last_peered":"2024-01-20T08:12:08.044239+0000","last_clean":"2024-01-20T08:12:08.044239+0000","last_became_active":"2024-01-20T08:12:07.069275+0000","last_became_peered":"2024-01-20T08:12:07.069275+0000","last_unstale":"2024-01-20T08:12:08.044239+0000","last_undegraded":"2024-01-20T08:12:08.044239+0000","last_fullsized":"2024-01-20T08:12:08.044239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316141+0000","last_change":"2024-01-20T08:12:07.075671+0000","last_active":"2024-01-20T08:12:08.316141+0000","last_peered":"2024-01-20T08:12:08.316141+0000","last_clean":"2024-01-20T08:12:08.316141+0000","last_became_active":"2024-01-20T08:12:07.074069+0000","last_became_peered":"2024-01-20T08:12:07.074069+0000","last_unstale":"2024-01-20T08:12:08.316141+0000","last_undegraded":"2024-01-20T08:12:08.316141+0000","last_fullsized":"2024-01-20T08:12:08.316141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044603+0000","last_change":"2024-01-20T08:12:07.066879+0000","last_active":"2024-01-20T08:12:08.044603+0000","last_peered":"2024-01-20T08:12:08.044603+0000","last_clean":"2024-01-20T08:12:08.044603+0000","last_became_active":"2024-01-20T08:12:07.066268+0000","last_became_peered":"2024-01-20T08:12:07.066268+0000","last_unstale":"2024-01-20T08:12:08.044603+0000","last_undegraded":"2024-01-20T08:12:08.044603+0000","last_fullsized":"2024-01-20T08:12:08.044603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:22.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317135+0000","last_change":"2024-01-20T08:12:07.071750+0000","last_active":"2024-01-20T08:12:08.317135+0000","last_peered":"2024-01-20T08:12:08.317135+0000","last_clean":"2024-01-20T08:12:08.317135+0000","last_became_active":"2024-01-20T08:12:07.071410+0000","last_became_peered":"2024-01-20T08:12:07.071410+0000","last_unstale":"2024-01-20T08:12:08.317135+0000","last_undegraded":"2024-01-20T08:12:08.317135+0000","last_fullsized":"2024-01-20T08:12:08.317135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:10.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316489+0000","last_change":"2024-01-20T08:12:07.064925+0000","last_active":"2024-01-20T08:12:08.316489+0000","last_peered":"2024-01-20T08:12:08.316489+0000","last_clean":"2024-01-20T08:12:08.316489+0000","last_became_active":"2024-01-20T08:12:07.064314+0000","last_became_peered":"2024-01-20T08:12:07.064314+0000","last_unstale":"2024-01-20T08:12:08.316489+0000","last_undegraded":"2024-01-20T08:12:08.316489+0000","last_fullsized":"2024-01-20T08:12:08.316489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:52.116068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316256+0000","last_change":"2024-01-20T08:12:07.069329+0000","last_active":"2024-01-20T08:12:08.316256+0000","last_peered":"2024-01-20T08:12:08.316256+0000","last_clean":"2024-01-20T08:12:08.316256+0000","last_became_active":"2024-01-20T08:12:07.068957+0000","last_became_peered":"2024-01-20T08:12:07.068957+0000","last_unstale":"2024-01-20T08:12:08.316256+0000","last_undegraded":"2024-01-20T08:12:08.316256+0000","last_fullsized":"2024-01-20T08:12:08.316256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:15.643241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319985+0000","last_change":"2024-01-20T08:12:07.077771+0000","last_active":"2024-01-20T08:12:08.319985+0000","last_peered":"2024-01-20T08:12:08.319985+0000","last_clean":"2024-01-20T08:12:08.319985+0000","last_became_active":"2024-01-20T08:12:07.077498+0000","last_became_peered":"2024-01-20T08:12:07.077498+0000","last_unstale":"2024-01-20T08:12:08.319985+0000","last_undegraded":"2024-01-20T08:12:08.319985+0000","last_fullsized":"2024-01-20T08:12:08.319985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319888+0000","last_change":"2024-01-20T08:12:07.070855+0000","last_active":"2024-01-20T08:12:08.319888+0000","last_peered":"2024-01-20T08:12:08.319888+0000","last_clean":"2024-01-20T08:12:08.319888+0000","last_became_active":"2024-01-20T08:12:07.070467+0000","last_became_peered":"2024-01-20T08:12:07.070467+0000","last_unstale":"2024-01-20T08:12:08.319888+0000","last_undegraded":"2024-01-20T08:12:08.319888+0000","last_fullsized":"2024-01-20T08:12:08.319888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:45.947061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318367+0000","last_change":"2024-01-20T08:12:07.066074+0000","last_active":"2024-01-20T08:12:08.318367+0000","last_peered":"2024-01-20T08:12:08.318367+0000","last_clean":"2024-01-20T08:12:08.318367+0000","last_became_active":"2024-01-20T08:12:07.063801+0000","last_became_peered":"2024-01-20T08:12:07.063801+0000","last_unstale":"2024-01-20T08:12:08.318367+0000","last_undegraded":"2024-01-20T08:12:08.318367+0000","last_fullsized":"2024-01-20T08:12:08.318367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:40.896208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316640+0000","last_change":"2024-01-20T08:12:07.055740+0000","last_active":"2024-01-20T08:12:08.316640+0000","last_peered":"2024-01-20T08:12:08.316640+0000","last_clean":"2024-01-20T08:12:08.316640+0000","last_became_active":"2024-01-20T08:12:07.055037+0000","last_became_peered":"2024-01-20T08:12:07.055037+0000","last_unstale":"2024-01-20T08:12:08.316640+0000","last_undegraded":"2024-01-20T08:12:08.316640+0000","last_fullsized":"2024-01-20T08:12:08.316640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:07.521556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043866+0000","last_change":"2024-01-20T08:12:07.079668+0000","last_active":"2024-01-20T08:12:08.043866+0000","last_peered":"2024-01-20T08:12:08.043866+0000","last_clean":"2024-01-20T08:12:08.043866+0000","last_became_active":"2024-01-20T08:12:07.075321+0000","last_became_peered":"2024-01-20T08:12:07.075321+0000","last_unstale":"2024-01-20T08:12:08.043866+0000","last_undegraded":"2024-01-20T08:12:08.043866+0000","last_fullsized":"2024-01-20T08:12:08.043866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046064+0000","last_change":"2024-01-20T08:12:07.068449+0000","last_active":"2024-01-20T08:12:08.046064+0000","last_peered":"2024-01-20T08:12:08.046064+0000","last_clean":"2024-01-20T08:12:08.046064+0000","last_became_active":"2024-01-20T08:12:07.067404+0000","last_became_peered":"2024-01-20T08:12:07.067404+0000","last_unstale":"2024-01-20T08:12:08.046064+0000","last_undegraded":"2024-01-20T08:12:08.046064+0000","last_fullsized":"2024-01-20T08:12:08.046064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:33:44.143818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047269+0000","last_change":"2024-01-20T08:12:07.081616+0000","last_active":"2024-01-20T08:12:08.047269+0000","last_peered":"2024-01-20T08:12:08.047269+0000","last_clean":"2024-01-20T08:12:08.047269+0000","last_became_active":"2024-01-20T08:12:07.081014+0000","last_became_peered":"2024-01-20T08:12:07.081014+0000","last_unstale":"2024-01-20T08:12:08.047269+0000","last_undegraded":"2024-01-20T08:12:08.047269+0000","last_fullsized":"2024-01-20T08:12:08.047269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313487+0000","last_change":"2024-01-20T08:12:07.077693+0000","last_active":"2024-01-20T08:12:08.313487+0000","last_peered":"2024-01-20T08:12:08.313487+0000","last_clean":"2024-01-20T08:12:08.313487+0000","last_became_active":"2024-01-20T08:12:07.077448+0000","last_became_peered":"2024-01-20T08:12:07.077448+0000","last_unstale":"2024-01-20T08:12:08.313487+0000","last_undegraded":"2024-01-20T08:12:08.313487+0000","last_fullsized":"2024-01-20T08:12:08.313487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:56.215178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045654+0000","last_change":"2024-01-20T08:12:07.079543+0000","last_active":"2024-01-20T08:12:08.045654+0000","last_peered":"2024-01-20T08:12:08.045654+0000","last_clean":"2024-01-20T08:12:08.045654+0000","last_became_active":"2024-01-20T08:12:07.078435+0000","last_became_peered":"2024-01-20T08:12:07.078435+0000","last_unstale":"2024-01-20T08:12:08.045654+0000","last_undegraded":"2024-01-20T08:12:08.045654+0000","last_fullsized":"2024-01-20T08:12:08.045654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:28.706699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046288+0000","last_change":"2024-01-20T08:12:07.080145+0000","last_active":"2024-01-20T08:12:08.046288+0000","last_peered":"2024-01-20T08:12:08.046288+0000","last_clean":"2024-01-20T08:12:08.046288+0000","last_became_active":"2024-01-20T08:12:07.079803+0000","last_became_peered":"2024-01-20T08:12:07.079803+0000","last_unstale":"2024-01-20T08:12:08.046288+0000","last_undegraded":"2024-01-20T08:12:08.046288+0000","last_fullsized":"2024-01-20T08:12:08.046288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:35.347679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044263+0000","last_change":"2024-01-20T08:12:07.072637+0000","last_active":"2024-01-20T08:12:08.044263+0000","last_peered":"2024-01-20T08:12:08.044263+0000","last_clean":"2024-01-20T08:12:08.044263+0000","last_became_active":"2024-01-20T08:12:07.068029+0000","last_became_peered":"2024-01-20T08:12:07.068029+0000","last_unstale":"2024-01-20T08:12:08.044263+0000","last_undegraded":"2024-01-20T08:12:08.044263+0000","last_fullsized":"2024-01-20T08:12:08.044263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:48.804666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046359+0000","last_change":"2024-01-20T08:12:07.087617+0000","last_active":"2024-01-20T08:12:08.046359+0000","last_peered":"2024-01-20T08:12:08.046359+0000","last_clean":"2024-01-20T08:12:08.046359+0000","last_became_active":"2024-01-20T08:12:07.085114+0000","last_became_peered":"2024-01-20T08:12:07.085114+0000","last_unstale":"2024-01-20T08:12:08.046359+0000","last_undegraded":"2024-01-20T08:12:08.046359+0000","last_fullsized":"2024-01-20T08:12:08.046359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318314+0000","last_change":"2024-01-20T08:12:07.072912+0000","last_active":"2024-01-20T08:12:08.318314+0000","last_peered":"2024-01-20T08:12:08.318314+0000","last_clean":"2024-01-20T08:12:08.318314+0000","last_became_active":"2024-01-20T08:12:07.072564+0000","last_became_peered":"2024-01-20T08:12:07.072564+0000","last_unstale":"2024-01-20T08:12:08.318314+0000","last_undegraded":"2024-01-20T08:12:08.318314+0000","last_fullsized":"2024-01-20T08:12:08.318314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:21.868460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.314197+0000","last_change":"2024-01-20T08:12:07.076077+0000","last_active":"2024-01-20T08:12:08.314197+0000","last_peered":"2024-01-20T08:12:08.314197+0000","last_clean":"2024-01-20T08:12:08.314197+0000","last_became_active":"2024-01-20T08:12:07.075830+0000","last_became_peered":"2024-01-20T08:12:07.075830+0000","last_unstale":"2024-01-20T08:12:08.314197+0000","last_undegraded":"2024-01-20T08:12:08.314197+0000","last_fullsized":"2024-01-20T08:12:08.314197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:22.791363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318485+0000","last_change":"2024-01-20T08:12:07.072412+0000","last_active":"2024-01-20T08:12:08.318485+0000","last_peered":"2024-01-20T08:12:08.318485+0000","last_clean":"2024-01-20T08:12:08.318485+0000","last_became_active":"2024-01-20T08:12:07.072119+0000","last_became_peered":"2024-01-20T08:12:07.072119+0000","last_unstale":"2024-01-20T08:12:08.318485+0000","last_undegraded":"2024-01-20T08:12:08.318485+0000","last_fullsized":"2024-01-20T08:12:08.318485+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044694+0000","last_change":"2024-01-20T08:12:07.077399+0000","last_active":"2024-01-20T08:12:08.044694+0000","last_peered":"2024-01-20T08:12:08.044694+0000","last_clean":"2024-01-20T08:12:08.044694+0000","last_became_active":"2024-01-20T08:12:07.077122+0000","last_became_peered":"2024-01-20T08:12:07.077122+0000","last_unstale":"2024-01-20T08:12:08.044694+0000","last_undegraded":"2024-01-20T08:12:08.044694+0000","last_fullsized":"2024-01-20T08:12:08.044694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:25.524024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313809+0000","last_change":"2024-01-20T08:12:07.076949+0000","last_active":"2024-01-20T08:12:08.313809+0000","last_peered":"2024-01-20T08:12:08.313809+0000","last_clean":"2024-01-20T08:12:08.313809+0000","last_became_active":"2024-01-20T08:12:07.076497+0000","last_became_peered":"2024-01-20T08:12:07.076497+0000","last_unstale":"2024-01-20T08:12:08.313809+0000","last_undegraded":"2024-01-20T08:12:08.313809+0000","last_fullsized":"2024-01-20T08:12:08.313809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:04:40.245579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045278+0000","last_change":"2024-01-20T08:12:07.079522+0000","last_active":"2024-01-20T08:12:08.045278+0000","last_peered":"2024-01-20T08:12:08.045278+0000","last_clean":"2024-01-20T08:12:08.045278+0000","last_became_active":"2024-01-20T08:12:07.079268+0000","last_became_peered":"2024-01-20T08:12:07.079268+0000","last_unstale":"2024-01-20T08:12:08.045278+0000","last_undegraded":"2024-01-20T08:12:08.045278+0000","last_fullsized":"2024-01-20T08:12:08.045278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:37.687652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045935+0000","last_change":"2024-01-20T08:12:07.076533+0000","last_active":"2024-01-20T08:12:08.045935+0000","last_peered":"2024-01-20T08:12:08.045935+0000","last_clean":"2024-01-20T08:12:08.045935+0000","last_became_active":"2024-01-20T08:12:07.076184+0000","last_became_peered":"2024-01-20T08:12:07.076184+0000","last_unstale":"2024-01-20T08:12:08.045935+0000","last_undegraded":"2024-01-20T08:12:08.045935+0000","last_fullsized":"2024-01-20T08:12:08.045935+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:49:57.037227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313555+0000","last_change":"2024-01-20T08:12:07.071054+0000","last_active":"2024-01-20T08:12:08.313555+0000","last_peered":"2024-01-20T08:12:08.313555+0000","last_clean":"2024-01-20T08:12:08.313555+0000","last_became_active":"2024-01-20T08:12:07.070741+0000","last_became_peered":"2024-01-20T08:12:07.070741+0000","last_unstale":"2024-01-20T08:12:08.313555+0000","last_undegraded":"2024-01-20T08:12:08.313555+0000","last_fullsized":"2024-01-20T08:12:08.313555+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:03.112854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044231+0000","last_change":"2024-01-20T08:12:07.078867+0000","last_active":"2024-01-20T08:12:08.044231+0000","last_peered":"2024-01-20T08:12:08.044231+0000","last_clean":"2024-01-20T08:12:08.044231+0000","last_became_active":"2024-01-20T08:12:07.078639+0000","last_became_peered":"2024-01-20T08:12:07.078639+0000","last_unstale":"2024-01-20T08:12:08.044231+0000","last_undegraded":"2024-01-20T08:12:08.044231+0000","last_fullsized":"2024-01-20T08:12:08.044231+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044777+0000","last_change":"2024-01-20T08:12:07.080377+0000","last_active":"2024-01-20T08:12:08.044777+0000","last_peered":"2024-01-20T08:12:08.044777+0000","last_clean":"2024-01-20T08:12:08.044777+0000","last_became_active":"2024-01-20T08:12:07.080044+0000","last_became_peered":"2024-01-20T08:12:07.080044+0000","last_unstale":"2024-01-20T08:12:08.044777+0000","last_undegraded":"2024-01-20T08:12:08.044777+0000","last_fullsized":"2024-01-20T08:12:08.044777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:33.328172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100685+0000","last_change":"2024-01-20T08:12:06.069013+0000","last_active":"2024-01-20T08:12:07.100685+0000","last_peered":"2024-01-20T08:12:07.100685+0000","last_clean":"2024-01-20T08:12:07.100685+0000","last_became_active":"2024-01-20T08:12:06.068785+0000","last_became_peered":"2024-01-20T08:12:06.068785+0000","last_unstale":"2024-01-20T08:12:07.100685+0000","last_undegraded":"2024-01-20T08:12:07.100685+0000","last_fullsized":"2024-01-20T08:12:07.100685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:48.916750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316877+0000","last_change":"2024-01-20T08:12:07.074189+0000","last_active":"2024-01-20T08:12:08.316877+0000","last_peered":"2024-01-20T08:12:08.316877+0000","last_clean":"2024-01-20T08:12:08.316877+0000","last_became_active":"2024-01-20T08:12:07.073922+0000","last_became_peered":"2024-01-20T08:12:07.073922+0000","last_unstale":"2024-01-20T08:12:08.316877+0000","last_undegraded":"2024-01-20T08:12:08.316877+0000","last_fullsized":"2024-01-20T08:12:08.316877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099448+0000","last_change":"2024-01-20T08:12:06.067289+0000","last_active":"2024-01-20T08:12:07.099448+0000","last_peered":"2024-01-20T08:12:07.099448+0000","last_clean":"2024-01-20T08:12:07.099448+0000","last_became_active":"2024-01-20T08:12:06.066945+0000","last_became_peered":"2024-01-20T08:12:06.066945+0000","last_unstale":"2024-01-20T08:12:07.099448+0000","last_undegraded":"2024-01-20T08:12:07.099448+0000","last_fullsized":"2024-01-20T08:12:07.099448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:05.035478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044347+0000","last_change":"2024-01-20T08:12:07.082658+0000","last_active":"2024-01-20T08:12:08.044347+0000","last_peered":"2024-01-20T08:12:08.044347+0000","last_clean":"2024-01-20T08:12:08.044347+0000","last_became_active":"2024-01-20T08:12:07.082212+0000","last_became_peered":"2024-01-20T08:12:07.082212+0000","last_unstale":"2024-01-20T08:12:08.044347+0000","last_undegraded":"2024-01-20T08:12:08.044347+0000","last_fullsized":"2024-01-20T08:12:08.044347+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098084+0000","last_change":"2024-01-20T08:12:06.058720+0000","last_active":"2024-01-20T08:12:07.098084+0000","last_peered":"2024-01-20T08:12:07.098084+0000","last_clean":"2024-01-20T08:12:07.098084+0000","last_became_active":"2024-01-20T08:12:06.058352+0000","last_became_peered":"2024-01-20T08:12:06.058352+0000","last_unstale":"2024-01-20T08:12:07.098084+0000","last_undegraded":"2024-01-20T08:12:07.098084+0000","last_fullsized":"2024-01-20T08:12:07.098084+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:09.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044881+0000","last_change":"2024-01-20T08:12:07.080508+0000","last_active":"2024-01-20T08:12:08.044881+0000","last_peered":"2024-01-20T08:12:08.044881+0000","last_clean":"2024-01-20T08:12:08.044881+0000","last_became_active":"2024-01-20T08:12:07.080057+0000","last_became_peered":"2024-01-20T08:12:07.080057+0000","last_unstale":"2024-01-20T08:12:08.044881+0000","last_undegraded":"2024-01-20T08:12:08.044881+0000","last_fullsized":"2024-01-20T08:12:08.044881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.415785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100075+0000","last_change":"2024-01-20T08:12:06.073731+0000","last_active":"2024-01-20T08:12:07.100075+0000","last_peered":"2024-01-20T08:12:07.100075+0000","last_clean":"2024-01-20T08:12:07.100075+0000","last_became_active":"2024-01-20T08:12:06.073398+0000","last_became_peered":"2024-01-20T08:12:06.073398+0000","last_unstale":"2024-01-20T08:12:07.100075+0000","last_undegraded":"2024-01-20T08:12:07.100075+0000","last_fullsized":"2024-01-20T08:12:07.100075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:14.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044406+0000","last_change":"2024-01-20T08:12:07.072285+0000","last_active":"2024-01-20T08:12:08.044406+0000","last_peered":"2024-01-20T08:12:08.044406+0000","last_clean":"2024-01-20T08:12:08.044406+0000","last_became_active":"2024-01-20T08:12:07.068016+0000","last_became_peered":"2024-01-20T08:12:07.068016+0000","last_unstale":"2024-01-20T08:12:08.044406+0000","last_undegraded":"2024-01-20T08:12:08.044406+0000","last_fullsized":"2024-01-20T08:12:08.044406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:17.339298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098992+0000","last_change":"2024-01-20T08:12:06.062959+0000","last_active":"2024-01-20T08:12:07.098992+0000","last_peered":"2024-01-20T08:12:07.098992+0000","last_clean":"2024-01-20T08:12:07.098992+0000","last_became_active":"2024-01-20T08:12:06.062074+0000","last_became_peered":"2024-01-20T08:12:06.062074+0000","last_unstale":"2024-01-20T08:12:07.098992+0000","last_undegraded":"2024-01-20T08:12:07.098992+0000","last_fullsized":"2024-01-20T08:12:07.098992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:20.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044999+0000","last_change":"2024-01-20T08:12:07.073980+0000","last_active":"2024-01-20T08:12:08.044999+0000","last_peered":"2024-01-20T08:12:08.044999+0000","last_clean":"2024-01-20T08:12:08.044999+0000","last_became_active":"2024-01-20T08:12:07.072685+0000","last_became_peered":"2024-01-20T08:12:07.072685+0000","last_unstale":"2024-01-20T08:12:08.044999+0000","last_undegraded":"2024-01-20T08:12:08.044999+0000","last_fullsized":"2024-01-20T08:12:08.044999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:02:57.344542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.097481+0000","last_change":"2024-01-20T08:12:06.063065+0000","last_active":"2024-01-20T08:12:07.097481+0000","last_peered":"2024-01-20T08:12:07.097481+0000","last_clean":"2024-01-20T08:12:07.097481+0000","last_became_active":"2024-01-20T08:12:06.062833+0000","last_became_peered":"2024-01-20T08:12:06.062833+0000","last_unstale":"2024-01-20T08:12:07.097481+0000","last_undegraded":"2024-01-20T08:12:07.097481+0000","last_fullsized":"2024-01-20T08:12:07.097481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318295+0000","last_change":"2024-01-20T08:12:07.081364+0000","last_active":"2024-01-20T08:12:08.318295+0000","last_peered":"2024-01-20T08:12:08.318295+0000","last_clean":"2024-01-20T08:12:08.318295+0000","last_became_active":"2024-01-20T08:12:07.080761+0000","last_became_peered":"2024-01-20T08:12:07.080761+0000","last_unstale":"2024-01-20T08:12:08.318295+0000","last_undegraded":"2024-01-20T08:12:08.318295+0000","last_fullsized":"2024-01-20T08:12:08.318295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:29.139178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063179+0000","last_change":"2024-01-20T08:12:06.071618+0000","last_active":"2024-01-20T08:12:07.063179+0000","last_peered":"2024-01-20T08:12:07.063179+0000","last_clean":"2024-01-20T08:12:07.063179+0000","last_became_active":"2024-01-20T08:12:06.070615+0000","last_became_peered":"2024-01-20T08:12:06.070615+0000","last_unstale":"2024-01-20T08:12:07.063179+0000","last_undegraded":"2024-01-20T08:12:07.063179+0000","last_fullsized":"2024-01-20T08:12:07.063179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:51.110106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045425+0000","last_change":"2024-01-20T08:12:07.078826+0000","last_active":"2024-01-20T08:12:08.045425+0000","last_peered":"2024-01-20T08:12:08.045425+0000","last_clean":"2024-01-20T08:12:08.045425+0000","last_became_active":"2024-01-20T08:12:07.078429+0000","last_became_peered":"2024-01-20T08:12:07.078429+0000","last_unstale":"2024-01-20T08:12:08.045425+0000","last_undegraded":"2024-01-20T08:12:08.045425+0000","last_fullsized":"2024-01-20T08:12:08.045425+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.046631+0000","last_change":"2024-01-20T08:12:06.055455+0000","last_active":"2024-01-20T08:12:07.046631+0000","last_peered":"2024-01-20T08:12:07.046631+0000","last_clean":"2024-01-20T08:12:07.046631+0000","last_became_active":"2024-01-20T08:12:06.053817+0000","last_became_peered":"2024-01-20T08:12:06.053817+0000","last_unstale":"2024-01-20T08:12:07.046631+0000","last_undegraded":"2024-01-20T08:12:07.046631+0000","last_fullsized":"2024-01-20T08:12:07.046631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:32.005693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317353+0000","last_change":"2024-01-20T08:12:07.069110+0000","last_active":"2024-01-20T08:12:08.317353+0000","last_peered":"2024-01-20T08:12:08.317353+0000","last_clean":"2024-01-20T08:12:08.317353+0000","last_became_active":"2024-01-20T08:12:07.068542+0000","last_became_peered":"2024-01-20T08:12:07.068542+0000","last_unstale":"2024-01-20T08:12:08.317353+0000","last_undegraded":"2024-01-20T08:12:08.317353+0000","last_fullsized":"2024-01-20T08:12:08.317353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:33.766825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074228+0000","last_change":"2024-01-20T08:12:06.075567+0000","last_active":"2024-01-20T08:12:07.074228+0000","last_peered":"2024-01-20T08:12:07.074228+0000","last_clean":"2024-01-20T08:12:07.074228+0000","last_became_active":"2024-01-20T08:12:06.075224+0000","last_became_peered":"2024-01-20T08:12:06.075224+0000","last_unstale":"2024-01-20T08:12:07.074228+0000","last_undegraded":"2024-01-20T08:12:07.074228+0000","last_fullsized":"2024-01-20T08:12:07.074228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:37.894928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047771+0000","last_change":"2024-01-20T08:12:07.087383+0000","last_active":"2024-01-20T08:12:08.047771+0000","last_peered":"2024-01-20T08:12:08.047771+0000","last_clean":"2024-01-20T08:12:08.047771+0000","last_became_active":"2024-01-20T08:12:07.080077+0000","last_became_peered":"2024-01-20T08:12:07.080077+0000","last_unstale":"2024-01-20T08:12:08.047771+0000","last_undegraded":"2024-01-20T08:12:08.047771+0000","last_fullsized":"2024-01-20T08:12:08.047771+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.051450+0000","last_change":"2024-01-20T08:12:06.061973+0000","last_active":"2024-01-20T08:12:07.051450+0000","last_peered":"2024-01-20T08:12:07.051450+0000","last_clean":"2024-01-20T08:12:07.051450+0000","last_became_active":"2024-01-20T08:12:06.061556+0000","last_became_peered":"2024-01-20T08:12:06.061556+0000","last_unstale":"2024-01-20T08:12:07.051450+0000","last_undegraded":"2024-01-20T08:12:07.051450+0000","last_fullsized":"2024-01-20T08:12:07.051450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:44.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315706+0000","last_change":"2024-01-20T08:12:07.057739+0000","last_active":"2024-01-20T08:12:08.315706+0000","last_peered":"2024-01-20T08:12:08.315706+0000","last_clean":"2024-01-20T08:12:08.315706+0000","last_became_active":"2024-01-20T08:12:07.055502+0000","last_became_peered":"2024-01-20T08:12:07.055502+0000","last_unstale":"2024-01-20T08:12:08.315706+0000","last_undegraded":"2024-01-20T08:12:08.315706+0000","last_fullsized":"2024-01-20T08:12:08.315706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:13.798575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101367+0000","last_change":"2024-01-20T08:12:06.075821+0000","last_active":"2024-01-20T08:12:07.101367+0000","last_peered":"2024-01-20T08:12:07.101367+0000","last_clean":"2024-01-20T08:12:07.101367+0000","last_became_active":"2024-01-20T08:12:06.075449+0000","last_became_peered":"2024-01-20T08:12:06.075449+0000","last_unstale":"2024-01-20T08:12:07.101367+0000","last_undegraded":"2024-01-20T08:12:07.101367+0000","last_fullsized":"2024-01-20T08:12:07.101367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:44.906399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047518+0000","last_change":"2024-01-20T08:12:07.081343+0000","last_active":"2024-01-20T08:12:08.047518+0000","last_peered":"2024-01-20T08:12:08.047518+0000","last_clean":"2024-01-20T08:12:08.047518+0000","last_became_active":"2024-01-20T08:12:07.079569+0000","last_became_peered":"2024-01-20T08:12:07.079569+0000","last_unstale":"2024-01-20T08:12:08.047518+0000","last_undegraded":"2024-01-20T08:12:08.047518+0000","last_fullsized":"2024-01-20T08:12:08.047518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.103278+0000","last_change":"2024-01-20T08:12:06.066310+0000","last_active":"2024-01-20T08:12:07.103278+0000","last_peered":"2024-01-20T08:12:07.103278+0000","last_clean":"2024-01-20T08:12:07.103278+0000","last_became_active":"2024-01-20T08:12:06.065636+0000","last_became_peered":"2024-01-20T08:12:06.065636+0000","last_unstale":"2024-01-20T08:12:07.103278+0000","last_undegraded":"2024-01-20T08:12:07.103278+0000","last_fullsized":"2024-01-20T08:12:07.103278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317051+0000","last_change":"2024-01-20T08:12:07.078287+0000","last_active":"2024-01-20T08:12:08.317051+0000","last_peered":"2024-01-20T08:12:08.317051+0000","last_clean":"2024-01-20T08:12:08.317051+0000","last_became_active":"2024-01-20T08:12:07.078008+0000","last_became_peered":"2024-01-20T08:12:07.078008+0000","last_unstale":"2024-01-20T08:12:08.317051+0000","last_undegraded":"2024-01-20T08:12:08.317051+0000","last_fullsized":"2024-01-20T08:12:08.317051+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101761+0000","last_change":"2024-01-20T08:12:06.065744+0000","last_active":"2024-01-20T08:12:07.101761+0000","last_peered":"2024-01-20T08:12:07.101761+0000","last_clean":"2024-01-20T08:12:07.101761+0000","last_became_active":"2024-01-20T08:12:06.065473+0000","last_became_peered":"2024-01-20T08:12:06.065473+0000","last_unstale":"2024-01-20T08:12:07.101761+0000","last_undegraded":"2024-01-20T08:12:07.101761+0000","last_fullsized":"2024-01-20T08:12:07.101761+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:28.564397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046124+0000","last_change":"2024-01-20T08:12:07.078220+0000","last_active":"2024-01-20T08:12:08.046124+0000","last_peered":"2024-01-20T08:12:08.046124+0000","last_clean":"2024-01-20T08:12:08.046124+0000","last_became_active":"2024-01-20T08:12:07.077812+0000","last_became_peered":"2024-01-20T08:12:07.077812+0000","last_unstale":"2024-01-20T08:12:08.046124+0000","last_undegraded":"2024-01-20T08:12:08.046124+0000","last_fullsized":"2024-01-20T08:12:08.046124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:54.112972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.066821+0000","last_change":"2024-01-20T08:12:06.071522+0000","last_active":"2024-01-20T08:12:07.066821+0000","last_peered":"2024-01-20T08:12:07.066821+0000","last_clean":"2024-01-20T08:12:07.066821+0000","last_became_active":"2024-01-20T08:12:06.069659+0000","last_became_peered":"2024-01-20T08:12:06.069659+0000","last_unstale":"2024-01-20T08:12:07.066821+0000","last_undegraded":"2024-01-20T08:12:07.066821+0000","last_fullsized":"2024-01-20T08:12:07.066821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316985+0000","last_change":"2024-01-20T08:12:07.078740+0000","last_active":"2024-01-20T08:12:08.316985+0000","last_peered":"2024-01-20T08:12:08.316985+0000","last_clean":"2024-01-20T08:12:08.316985+0000","last_became_active":"2024-01-20T08:12:07.078413+0000","last_became_peered":"2024-01-20T08:12:07.078413+0000","last_unstale":"2024-01-20T08:12:08.316985+0000","last_undegraded":"2024-01-20T08:12:08.316985+0000","last_fullsized":"2024-01-20T08:12:08.316985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.190626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063368+0000","last_change":"2024-01-20T08:12:06.071714+0000","last_active":"2024-01-20T08:12:07.063368+0000","last_peered":"2024-01-20T08:12:07.063368+0000","last_clean":"2024-01-20T08:12:07.063368+0000","last_became_active":"2024-01-20T08:12:06.071263+0000","last_became_peered":"2024-01-20T08:12:06.071263+0000","last_unstale":"2024-01-20T08:12:07.063368+0000","last_undegraded":"2024-01-20T08:12:07.063368+0000","last_fullsized":"2024-01-20T08:12:07.063368+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:05.094918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046535+0000","last_change":"2024-01-20T08:12:07.088126+0000","last_active":"2024-01-20T08:12:08.046535+0000","last_peered":"2024-01-20T08:12:08.046535+0000","last_clean":"2024-01-20T08:12:08.046535+0000","last_became_active":"2024-01-20T08:12:07.087789+0000","last_became_peered":"2024-01-20T08:12:07.087789+0000","last_unstale":"2024-01-20T08:12:08.046535+0000","last_undegraded":"2024-01-20T08:12:08.046535+0000","last_fullsized":"2024-01-20T08:12:08.046535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101182+0000","last_change":"2024-01-20T08:12:06.074824+0000","last_active":"2024-01-20T08:12:07.101182+0000","last_peered":"2024-01-20T08:12:07.101182+0000","last_clean":"2024-01-20T08:12:07.101182+0000","last_became_active":"2024-01-20T08:12:06.074111+0000","last_became_peered":"2024-01-20T08:12:06.074111+0000","last_unstale":"2024-01-20T08:12:07.101182+0000","last_undegraded":"2024-01-20T08:12:07.101182+0000","last_fullsized":"2024-01-20T08:12:07.101182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047194+0000","last_change":"2024-01-20T08:12:07.082593+0000","last_active":"2024-01-20T08:12:08.047194+0000","last_peered":"2024-01-20T08:12:08.047194+0000","last_clean":"2024-01-20T08:12:08.047194+0000","last_became_active":"2024-01-20T08:12:07.082366+0000","last_became_peered":"2024-01-20T08:12:07.082366+0000","last_unstale":"2024-01-20T08:12:08.047194+0000","last_undegraded":"2024-01-20T08:12:08.047194+0000","last_fullsized":"2024-01-20T08:12:08.047194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101568+0000","last_change":"2024-01-20T08:12:06.065566+0000","last_active":"2024-01-20T08:12:07.101568+0000","last_peered":"2024-01-20T08:12:07.101568+0000","last_clean":"2024-01-20T08:12:07.101568+0000","last_became_active":"2024-01-20T08:12:06.065270+0000","last_became_peered":"2024-01-20T08:12:06.065270+0000","last_unstale":"2024-01-20T08:12:07.101568+0000","last_undegraded":"2024-01-20T08:12:07.101568+0000","last_fullsized":"2024-01-20T08:12:07.101568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:45.655205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318970+0000","last_change":"2024-01-20T08:12:07.082690+0000","last_active":"2024-01-20T08:12:08.318970+0000","last_peered":"2024-01-20T08:12:08.318970+0000","last_clean":"2024-01-20T08:12:08.318970+0000","last_became_active":"2024-01-20T08:12:07.082364+0000","last_became_peered":"2024-01-20T08:12:07.082364+0000","last_unstale":"2024-01-20T08:12:08.318970+0000","last_undegraded":"2024-01-20T08:12:08.318970+0000","last_fullsized":"2024-01-20T08:12:08.318970+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099313+0000","last_change":"2024-01-20T08:12:06.061749+0000","last_active":"2024-01-20T08:12:07.099313+0000","last_peered":"2024-01-20T08:12:07.099313+0000","last_clean":"2024-01-20T08:12:07.099313+0000","last_became_active":"2024-01-20T08:12:06.061466+0000","last_became_peered":"2024-01-20T08:12:06.061466+0000","last_unstale":"2024-01-20T08:12:07.099313+0000","last_undegraded":"2024-01-20T08:12:07.099313+0000","last_fullsized":"2024-01-20T08:12:07.099313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:32.760864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045704+0000","last_change":"2024-01-20T08:12:07.065833+0000","last_active":"2024-01-20T08:12:08.045704+0000","last_peered":"2024-01-20T08:12:08.045704+0000","last_clean":"2024-01-20T08:12:08.045704+0000","last_became_active":"2024-01-20T08:12:07.065547+0000","last_became_peered":"2024-01-20T08:12:07.065547+0000","last_unstale":"2024-01-20T08:12:08.045704+0000","last_undegraded":"2024-01-20T08:12:08.045704+0000","last_fullsized":"2024-01-20T08:12:08.045704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:08.237987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100053+0000","last_change":"2024-01-20T08:12:06.073869+0000","last_active":"2024-01-20T08:12:07.100053+0000","last_peered":"2024-01-20T08:12:07.100053+0000","last_clean":"2024-01-20T08:12:07.100053+0000","last_became_active":"2024-01-20T08:12:06.073514+0000","last_became_peered":"2024-01-20T08:12:06.073514+0000","last_unstale":"2024-01-20T08:12:07.100053+0000","last_undegraded":"2024-01-20T08:12:07.100053+0000","last_fullsized":"2024-01-20T08:12:07.100053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047715+0000","last_change":"2024-01-20T08:12:07.084906+0000","last_active":"2024-01-20T08:12:08.047715+0000","last_peered":"2024-01-20T08:12:08.047715+0000","last_clean":"2024-01-20T08:12:08.047715+0000","last_became_active":"2024-01-20T08:12:07.080034+0000","last_became_peered":"2024-01-20T08:12:07.080034+0000","last_unstale":"2024-01-20T08:12:08.047715+0000","last_undegraded":"2024-01-20T08:12:08.047715+0000","last_fullsized":"2024-01-20T08:12:08.047715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.073459+0000","last_change":"2024-01-20T08:12:06.056008+0000","last_active":"2024-01-20T08:12:07.073459+0000","last_peered":"2024-01-20T08:12:07.073459+0000","last_clean":"2024-01-20T08:12:07.073459+0000","last_became_active":"2024-01-20T08:12:06.055317+0000","last_became_peered":"2024-01-20T08:12:06.055317+0000","last_unstale":"2024-01-20T08:12:07.073459+0000","last_undegraded":"2024-01-20T08:12:07.073459+0000","last_fullsized":"2024-01-20T08:12:07.073459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317364+0000","last_change":"2024-01-20T08:12:07.078035+0000","last_active":"2024-01-20T08:12:08.317364+0000","last_peered":"2024-01-20T08:12:08.317364+0000","last_clean":"2024-01-20T08:12:08.317364+0000","last_became_active":"2024-01-20T08:12:07.076150+0000","last_became_peered":"2024-01-20T08:12:07.076150+0000","last_unstale":"2024-01-20T08:12:08.317364+0000","last_undegraded":"2024-01-20T08:12:08.317364+0000","last_fullsized":"2024-01-20T08:12:08.317364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101610+0000","last_change":"2024-01-20T08:12:06.058384+0000","last_active":"2024-01-20T08:12:07.101610+0000","last_peered":"2024-01-20T08:12:07.101610+0000","last_clean":"2024-01-20T08:12:07.101610+0000","last_became_active":"2024-01-20T08:12:06.058097+0000","last_became_peered":"2024-01-20T08:12:06.058097+0000","last_unstale":"2024-01-20T08:12:07.101610+0000","last_undegraded":"2024-01-20T08:12:07.101610+0000","last_fullsized":"2024-01-20T08:12:07.101610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:12.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044363+0000","last_change":"2024-01-20T08:12:07.077060+0000","last_active":"2024-01-20T08:12:08.044363+0000","last_peered":"2024-01-20T08:12:08.044363+0000","last_clean":"2024-01-20T08:12:08.044363+0000","last_became_active":"2024-01-20T08:12:07.074560+0000","last_became_peered":"2024-01-20T08:12:07.074560+0000","last_unstale":"2024-01-20T08:12:08.044363+0000","last_undegraded":"2024-01-20T08:12:08.044363+0000","last_fullsized":"2024-01-20T08:12:08.044363+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:11:42.486924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043187+0000","last_change":"2024-01-20T08:12:06.061716+0000","last_active":"2024-01-20T08:12:07.043187+0000","last_peered":"2024-01-20T08:12:07.043187+0000","last_clean":"2024-01-20T08:12:07.043187+0000","last_became_active":"2024-01-20T08:12:06.061410+0000","last_became_peered":"2024-01-20T08:12:06.061410+0000","last_unstale":"2024-01-20T08:12:07.043187+0000","last_undegraded":"2024-01-20T08:12:07.043187+0000","last_fullsized":"2024-01-20T08:12:07.043187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043900+0000","last_change":"2024-01-20T08:12:07.077678+0000","last_active":"2024-01-20T08:12:08.043900+0000","last_peered":"2024-01-20T08:12:08.043900+0000","last_clean":"2024-01-20T08:12:08.043900+0000","last_became_active":"2024-01-20T08:12:07.077094+0000","last_became_peered":"2024-01-20T08:12:07.077094+0000","last_unstale":"2024-01-20T08:12:08.043900+0000","last_undegraded":"2024-01-20T08:12:08.043900+0000","last_fullsized":"2024-01-20T08:12:08.043900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.059759+0000","last_change":"2024-01-20T08:12:06.063892+0000","last_active":"2024-01-20T08:12:07.059759+0000","last_peered":"2024-01-20T08:12:07.059759+0000","last_clean":"2024-01-20T08:12:07.059759+0000","last_became_active":"2024-01-20T08:12:06.063601+0000","last_became_peered":"2024-01-20T08:12:06.063601+0000","last_unstale":"2024-01-20T08:12:07.059759+0000","last_undegraded":"2024-01-20T08:12:07.059759+0000","last_fullsized":"2024-01-20T08:12:07.059759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:48.315980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318635+0000","last_change":"2024-01-20T08:12:07.073337+0000","last_active":"2024-01-20T08:12:08.318635+0000","last_peered":"2024-01-20T08:12:08.318635+0000","last_clean":"2024-01-20T08:12:08.318635+0000","last_became_active":"2024-01-20T08:12:07.073087+0000","last_became_peered":"2024-01-20T08:12:07.073087+0000","last_unstale":"2024-01-20T08:12:08.318635+0000","last_undegraded":"2024-01-20T08:12:08.318635+0000","last_fullsized":"2024-01-20T08:12:08.318635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101475+0000","last_change":"2024-01-20T08:12:06.049193+0000","last_active":"2024-01-20T08:12:07.101475+0000","last_peered":"2024-01-20T08:12:07.101475+0000","last_clean":"2024-01-20T08:12:07.101475+0000","last_became_active":"2024-01-20T08:12:06.048916+0000","last_became_peered":"2024-01-20T08:12:06.048916+0000","last_unstale":"2024-01-20T08:12:07.101475+0000","last_undegraded":"2024-01-20T08:12:07.101475+0000","last_fullsized":"2024-01-20T08:12:07.101475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:53.905817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319316+0000","last_change":"2024-01-20T08:12:07.082890+0000","last_active":"2024-01-20T08:12:08.319316+0000","last_peered":"2024-01-20T08:12:08.319316+0000","last_clean":"2024-01-20T08:12:08.319316+0000","last_became_active":"2024-01-20T08:12:07.080723+0000","last_became_peered":"2024-01-20T08:12:07.080723+0000","last_unstale":"2024-01-20T08:12:08.319316+0000","last_undegraded":"2024-01-20T08:12:08.319316+0000","last_fullsized":"2024-01-20T08:12:08.319316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074909+0000","last_change":"2024-01-20T08:12:06.062568+0000","last_active":"2024-01-20T08:12:07.074909+0000","last_peered":"2024-01-20T08:12:07.074909+0000","last_clean":"2024-01-20T08:12:07.074909+0000","last_became_active":"2024-01-20T08:12:06.062294+0000","last_became_peered":"2024-01-20T08:12:06.062294+0000","last_unstale":"2024-01-20T08:12:07.074909+0000","last_undegraded":"2024-01-20T08:12:07.074909+0000","last_fullsized":"2024-01-20T08:12:07.074909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:39.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316009+0000","last_change":"2024-01-20T08:12:07.060815+0000","last_active":"2024-01-20T08:12:08.316009+0000","last_peered":"2024-01-20T08:12:08.316009+0000","last_clean":"2024-01-20T08:12:08.316009+0000","last_became_active":"2024-01-20T08:12:07.057155+0000","last_became_peered":"2024-01-20T08:12:07.057155+0000","last_unstale":"2024-01-20T08:12:08.316009+0000","last_undegraded":"2024-01-20T08:12:08.316009+0000","last_fullsized":"2024-01-20T08:12:08.316009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:49.321942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.067445+0000","last_change":"2024-01-20T08:12:06.063244+0000","last_active":"2024-01-20T08:12:07.067445+0000","last_peered":"2024-01-20T08:12:07.067445+0000","last_clean":"2024-01-20T08:12:07.067445+0000","last_became_active":"2024-01-20T08:12:06.062628+0000","last_became_peered":"2024-01-20T08:12:06.062628+0000","last_unstale":"2024-01-20T08:12:07.067445+0000","last_undegraded":"2024-01-20T08:12:07.067445+0000","last_fullsized":"2024-01-20T08:12:07.067445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045067+0000","last_change":"2024-01-20T08:12:07.088893+0000","last_active":"2024-01-20T08:12:08.045067+0000","last_peered":"2024-01-20T08:12:08.045067+0000","last_clean":"2024-01-20T08:12:08.045067+0000","last_became_active":"2024-01-20T08:12:07.088233+0000","last_became_peered":"2024-01-20T08:12:07.088233+0000","last_unstale":"2024-01-20T08:12:08.045067+0000","last_undegraded":"2024-01-20T08:12:08.045067+0000","last_fullsized":"2024-01-20T08:12:08.045067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:39:05.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063539+0000","last_change":"2024-01-20T08:12:06.069603+0000","last_active":"2024-01-20T08:12:07.063539+0000","last_peered":"2024-01-20T08:12:07.063539+0000","last_clean":"2024-01-20T08:12:07.063539+0000","last_became_active":"2024-01-20T08:12:06.069220+0000","last_became_peered":"2024-01-20T08:12:06.069220+0000","last_unstale":"2024-01-20T08:12:07.063539+0000","last_undegraded":"2024-01-20T08:12:07.063539+0000","last_fullsized":"2024-01-20T08:12:07.063539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044828+0000","last_change":"2024-01-20T08:12:07.066751+0000","last_active":"2024-01-20T08:12:08.044828+0000","last_peered":"2024-01-20T08:12:08.044828+0000","last_clean":"2024-01-20T08:12:08.044828+0000","last_became_active":"2024-01-20T08:12:07.063086+0000","last_became_peered":"2024-01-20T08:12:07.063086+0000","last_unstale":"2024-01-20T08:12:08.044828+0000","last_undegraded":"2024-01-20T08:12:08.044828+0000","last_fullsized":"2024-01-20T08:12:08.044828+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:18:45.087923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043166+0000","last_change":"2024-01-20T08:12:06.066906+0000","last_active":"2024-01-20T08:12:07.043166+0000","last_peered":"2024-01-20T08:12:07.043166+0000","last_clean":"2024-01-20T08:12:07.043166+0000","last_became_active":"2024-01-20T08:12:06.066598+0000","last_became_peered":"2024-01-20T08:12:06.066598+0000","last_unstale":"2024-01-20T08:12:07.043166+0000","last_undegraded":"2024-01-20T08:12:07.043166+0000","last_fullsized":"2024-01-20T08:12:07.043166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046873+0000","last_change":"2024-01-20T08:12:07.088972+0000","last_active":"2024-01-20T08:12:08.046873+0000","last_peered":"2024-01-20T08:12:08.046873+0000","last_clean":"2024-01-20T08:12:08.046873+0000","last_became_active":"2024-01-20T08:12:07.088534+0000","last_became_peered":"2024-01-20T08:12:07.088534+0000","last_unstale":"2024-01-20T08:12:08.046873+0000","last_undegraded":"2024-01-20T08:12:08.046873+0000","last_fullsized":"2024-01-20T08:12:08.046873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.047019+0000","last_change":"2024-01-20T08:12:06.061867+0000","last_active":"2024-01-20T08:12:07.047019+0000","last_peered":"2024-01-20T08:12:07.047019+0000","last_clean":"2024-01-20T08:12:07.047019+0000","last_became_active":"2024-01-20T08:12:06.061474+0000","last_became_peered":"2024-01-20T08:12:06.061474+0000","last_unstale":"2024-01-20T08:12:07.047019+0000","last_undegraded":"2024-01-20T08:12:07.047019+0000","last_fullsized":"2024-01-20T08:12:07.047019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:28.133216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315413+0000","last_change":"2024-01-20T08:12:07.075925+0000","last_active":"2024-01-20T08:12:08.315413+0000","last_peered":"2024-01-20T08:12:08.315413+0000","last_clean":"2024-01-20T08:12:08.315413+0000","last_became_active":"2024-01-20T08:12:07.075681+0000","last_became_peered":"2024-01-20T08:12:07.075681+0000","last_unstale":"2024-01-20T08:12:08.315413+0000","last_undegraded":"2024-01-20T08:12:08.315413+0000","last_fullsized":"2024-01-20T08:12:08.315413+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:38.900889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043202+0000","last_change":"2024-01-20T08:12:06.056764+0000","last_active":"2024-01-20T08:12:07.043202+0000","last_peered":"2024-01-20T08:12:07.043202+0000","last_clean":"2024-01-20T08:12:07.043202+0000","last_became_active":"2024-01-20T08:12:06.056438+0000","last_became_peered":"2024-01-20T08:12:06.056438+0000","last_unstale":"2024-01-20T08:12:07.043202+0000","last_undegraded":"2024-01-20T08:12:07.043202+0000","last_fullsized":"2024-01-20T08:12:07.043202+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045482+0000","last_change":"2024-01-20T08:12:07.075968+0000","last_active":"2024-01-20T08:12:08.045482+0000","last_peered":"2024-01-20T08:12:08.045482+0000","last_clean":"2024-01-20T08:12:08.045482+0000","last_became_active":"2024-01-20T08:12:07.071647+0000","last_became_peered":"2024-01-20T08:12:07.071647+0000","last_unstale":"2024-01-20T08:12:08.045482+0000","last_undegraded":"2024-01-20T08:12:08.045482+0000","last_fullsized":"2024-01-20T08:12:08.045482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:52:22.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.045892+0000","last_change":"2024-01-20T08:12:06.060007+0000","last_active":"2024-01-20T08:12:07.045892+0000","last_peered":"2024-01-20T08:12:07.045892+0000","last_clean":"2024-01-20T08:12:07.045892+0000","last_became_active":"2024-01-20T08:12:06.059513+0000","last_became_peered":"2024-01-20T08:12:06.059513+0000","last_unstale":"2024-01-20T08:12:07.045892+0000","last_undegraded":"2024-01-20T08:12:07.045892+0000","last_fullsized":"2024-01-20T08:12:07.045892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:20.449358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044818+0000","last_change":"2024-01-20T08:12:07.073628+0000","last_active":"2024-01-20T08:12:08.044818+0000","last_peered":"2024-01-20T08:12:08.044818+0000","last_clean":"2024-01-20T08:12:08.044818+0000","last_became_active":"2024-01-20T08:12:07.073348+0000","last_became_peered":"2024-01-20T08:12:07.073348+0000","last_unstale":"2024-01-20T08:12:08.044818+0000","last_undegraded":"2024-01-20T08:12:08.044818+0000","last_fullsized":"2024-01-20T08:12:08.044818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:59:53.783140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065626+0000","last_change":"2024-01-20T08:12:06.067638+0000","last_active":"2024-01-20T08:12:07.065626+0000","last_peered":"2024-01-20T08:12:07.065626+0000","last_clean":"2024-01-20T08:12:07.065626+0000","last_became_active":"2024-01-20T08:12:06.067251+0000","last_became_peered":"2024-01-20T08:12:06.067251+0000","last_unstale":"2024-01-20T08:12:07.065626+0000","last_undegraded":"2024-01-20T08:12:07.065626+0000","last_fullsized":"2024-01-20T08:12:07.065626+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":192,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065209+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:07.065209+0000","last_peered":"2024-01-20T08:12:07.065209+0000","last_clean":"2024-01-20T08:12:07.065209+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:07.065209+0000","last_undegraded":"2024-01-20T08:12:07.065209+0000","last_fullsized":"2024-01-20T08:12:07.065209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1224704,"data_stored":852654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":1.1739999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.514},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.478}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.2709999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.5349999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.554},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.6699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":262126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4359999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9119999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5449999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6100000000000001,"5min":2.008,"15min":2.008},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1659999999999999,"15min":1.1699999999999999},"min":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8129999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3080000000000001,"15min":1.333},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.0629999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4239999999999999,"15min":1.444},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0720000000000001,"5min":2.222,"15min":2.222},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.4379999999999999,"15min":1.464},"min":{"1min":0.82199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5980000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.139}]},{"osd":4,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.5529999999999999,"15min":1.599},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.825,"5min":2.915,"15min":2.915},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.659,"15min":1.6890000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2189999999999999,"5min":2.718,"15min":2.718},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5580000000000001,"15min":1.579},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.74,"15min":1.794},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.734,"15min":1.758},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3500000000000001,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.448},{"interface":"front","average":{"1min":1.536,"5min":1.746,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0209999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.492}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":262778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88200000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.589}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.343},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.2749999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.194}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.071},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.2330000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.429}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.464}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":263738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.252},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.92000000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":1.29}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5980000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":1.391},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.524}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.871},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.6399999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.774}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.9239999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.46}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.974}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":1.161}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.373}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.296}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.524},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5049999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.4199999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.232}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.335}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":262216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.7410000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.181},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":1.3720000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.885},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.276}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.8200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.609},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.6879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.913}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":2},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.778}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":854688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.4019999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1859999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85799999999999998,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.256,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0069999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.131,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.492,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.177}]},{"osd":4,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.107,"15min":1.091},"min":{"1min":0.67000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1160000000000001,"15min":1.115},"min":{"1min":0.85299999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.502,"5min":1.589,"15min":1.589},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.74299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.5700000000000001,"5min":1.865,"15min":1.865},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.244,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.02,"5min":2.427,"15min":2.427},"last":1.3959999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.86799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1150000000000002,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.276,"15min":1.282},"min":{"1min":0.81000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.772,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3240000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.371,"15min":1.3819999999999999},"min":{"1min":0.88300000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7889999999999999,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.635},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.853,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:16.428 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:16.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.642+0000 7f7f3b200640 1 Processor -- start 2024-01-20T08:12:16.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.643+0000 7f7f3b200640 1 -- start start 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f34151f40 0x7f7f341551d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 0x7f7f3406b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f3406b660 0x7f7f340c60b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f3406bf90 con 0x7f7f34151f40 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f34155710 con 0x7f7f340c7fb0 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f3b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340c5310 con 0x7f7f3406b660 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f33e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f34151f40 0x7f7f341551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f33e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7f34151f40 0x7f7f341551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47656/0 (socket says 172.21.15.100:47656) 2024-01-20T08:12:16.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.644+0000 7f7f33e00640 1 -- 172.21.15.100:0/4265914149 learned_addr learned my addr 172.21.15.100:0/4265914149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:16.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f2b200640 1 --2- 172.21.15.100:0/4265914149 >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 0x7f7f3406b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:16.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f33e00640 1 -- 172.21.15.100:0/4265914149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f3406b660 msgr2=0x7f7f340c60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:16.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f39200640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f3406b660 0x7f7f340c60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f33e00640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f3406b660 0x7f7f340c60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f33e00640 1 -- 172.21.15.100:0/4265914149 >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 msgr2=0x7f7f3406b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f33e00640 1 --2- 172.21.15.100:0/4265914149 >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 0x7f7f3406b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f33e00640 1 -- 172.21.15.100:0/4265914149 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340c4ff0 con 0x7f7f34151f40 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.645+0000 7f7f2b200640 1 --2- 172.21.15.100:0/4265914149 >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 0x7f7f3406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:16.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.646+0000 7f7f33e00640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f341551d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f340acc00 tx=0x7f7f2402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b989739ef7fb8e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.646+0000 7f7f33400640 1 -- 172.21.15.100:0/4265914149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24030850 con 0x7f7f34151f40 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.646+0000 7f7f33400640 1 -- 172.21.15.100:0/4265914149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240309b0 con 0x7f7f34151f40 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.646+0000 7f7f33400640 1 -- 172.21.15.100:0/4265914149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24030d40 con 0x7f7f34151f40 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 -- 172.21.15.100:0/4265914149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 msgr2=0x7f7f341551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f341551d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f7f340acc00 tx=0x7f7f2402b990 comp rx=0 tx=0).stop 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 -- 172.21.15.100:0/4265914149 shutdown_connections 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f3406b660 0x7f7f340c60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 --2- 172.21.15.100:0/4265914149 >> v2:172.21.15.110:3300/0 conn(0x7f7f340c7fb0 0x7f7f3406b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 --2- 172.21.15.100:0/4265914149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f341551d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 -- 172.21.15.100:0/4265914149 >> 172.21.15.100:0/4265914149 conn(0x7f7f340ca0b0 msgr2=0x7f7f340ca490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:16.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 -- 172.21.15.100:0/4265914149 shutdown_connections 2024-01-20T08:12:16.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.647+0000 7f7f3b200640 1 -- 172.21.15.100:0/4265914149 wait complete. 2024-01-20T08:12:16.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.648+0000 7f7f3b200640 1 Processor -- start 2024-01-20T08:12:16.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.649+0000 7f7f3b200640 1 -- start start 2024-01-20T08:12:16.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.649+0000 7f7f3b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3406b660 0x7f7f341ea0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f3b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f340c7fb0 0x7f7f3414ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f3b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f3b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341ea970 con 0x7f7f34151f40 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f3b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341eac50 con 0x7f7f3406b660 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f3b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f341eaf30 con 0x7f7f340c7fb0 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47670/0 (socket says 172.21.15.100:47670) 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 -- 172.21.15.100:0/1454740107 learned_addr learned my addr 172.21.15.100:0/1454740107 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 -- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f340c7fb0 msgr2=0x7f7f3414ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f340c7fb0 0x7f7f3414ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 -- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3406b660 msgr2=0x7f7f341ea0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3406b660 0x7f7f341ea0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.650+0000 7f7f39200640 1 -- 172.21.15.100:0/1454740107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f240094d0 con 0x7f7f34151f40 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f39200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00cc30 tx=0x7f7f2c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c00ce40 con 0x7f7f34151f40 2024-01-20T08:12:16.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f2c003990 con 0x7f7f34151f40 2024-01-20T08:12:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c003d20 con 0x7f7f34151f40 2024-01-20T08:12:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f341525c0 con 0x7f7f34151f40 2024-01-20T08:12:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.651+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f341ea5f0 con 0x7f7f34151f40 2024-01-20T08:12:16.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.652+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f34067b60 con 0x7f7f34151f40 2024-01-20T08:12:16.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.653+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7f2c003e80 con 0x7f7f34151f40 2024-01-20T08:12:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.654+0000 7f7f30c00640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 0x7f7f0c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.654+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c0899d0 con 0x7f7f34151f40 2024-01-20T08:12:16.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.654+0000 7f7f33e00640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 0x7f7f0c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:16.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.655+0000 7f7f33e00640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 0x7f7f0c06d390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f24036000 tx=0x7f7f2403b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:16.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.659+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7f2c054930 con 0x7f7f34151f40 2024-01-20T08:12:16.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.846+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f341eadc0 con 0x7f7f0c06aed0 2024-01-20T08:12:16.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.856+0000 7f7f30c00640 1 -- 172.21.15.100:0/1454740107 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286744 (secure 0 0 0) 0x7f7f341eadc0 con 0x7f7f0c06aed0 2024-01-20T08:12:16.863 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:16.865 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 msgr2=0x7f7f0c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 0x7f7f0c06d390 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7f24036000 tx=0x7f7f2403b040 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 msgr2=0x7f7f340aaa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c00cc30 tx=0x7f7f2c00a5c0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 shutdown_connections 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f34151f40 0x7f7f340aaa80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0c06aed0 0x7f7f0c06d390 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f340c7fb0 0x7f7f3414ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 --2- 172.21.15.100:0/1454740107 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f3406b660 0x7f7f341ea0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 >> 172.21.15.100:0/1454740107 conn(0x7f7f340ca0b0 msgr2=0x7f7f340c8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 shutdown_connections 2024-01-20T08:12:16.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:16.863+0000 7f7f3b200640 1 -- 172.21.15.100:0/1454740107 wait complete. 2024-01-20T08:12:16.884 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":113,"stamp":"2024-01-20T08:12:15.924266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":185,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243064,"kb_used_data":6088,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731656,"statfs":{"total":773094113280,"available":772845215744,"internally_reserved":0,"allocated":6234112,"data_stored":3282564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.885785"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313954+0000","last_change":"2024-01-20T08:12:07.068510+0000","last_active":"2024-01-20T08:12:08.313954+0000","last_peered":"2024-01-20T08:12:08.313954+0000","last_clean":"2024-01-20T08:12:08.313954+0000","last_became_active":"2024-01-20T08:12:07.068099+0000","last_became_peered":"2024-01-20T08:12:07.068099+0000","last_unstale":"2024-01-20T08:12:08.313954+0000","last_undegraded":"2024-01-20T08:12:08.313954+0000","last_fullsized":"2024-01-20T08:12:08.313954+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:51.051735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045903+0000","last_change":"2024-01-20T08:12:07.066208+0000","last_active":"2024-01-20T08:12:08.045903+0000","last_peered":"2024-01-20T08:12:08.045903+0000","last_clean":"2024-01-20T08:12:08.045903+0000","last_became_active":"2024-01-20T08:12:07.065935+0000","last_became_peered":"2024-01-20T08:12:07.065935+0000","last_unstale":"2024-01-20T08:12:08.045903+0000","last_undegraded":"2024-01-20T08:12:08.045903+0000","last_fullsized":"2024-01-20T08:12:08.045903+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:55:51.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047157+0000","last_change":"2024-01-20T08:12:07.079204+0000","last_active":"2024-01-20T08:12:08.047157+0000","last_peered":"2024-01-20T08:12:08.047157+0000","last_clean":"2024-01-20T08:12:08.047157+0000","last_became_active":"2024-01-20T08:12:07.078933+0000","last_became_peered":"2024-01-20T08:12:07.078933+0000","last_unstale":"2024-01-20T08:12:08.047157+0000","last_undegraded":"2024-01-20T08:12:08.047157+0000","last_fullsized":"2024-01-20T08:12:08.047157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317951+0000","last_change":"2024-01-20T08:12:07.078940+0000","last_active":"2024-01-20T08:12:08.317951+0000","last_peered":"2024-01-20T08:12:08.317951+0000","last_clean":"2024-01-20T08:12:08.317951+0000","last_became_active":"2024-01-20T08:12:07.076282+0000","last_became_peered":"2024-01-20T08:12:07.076282+0000","last_unstale":"2024-01-20T08:12:08.317951+0000","last_undegraded":"2024-01-20T08:12:08.317951+0000","last_fullsized":"2024-01-20T08:12:08.317951+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313988+0000","last_change":"2024-01-20T08:12:07.079405+0000","last_active":"2024-01-20T08:12:08.313988+0000","last_peered":"2024-01-20T08:12:08.313988+0000","last_clean":"2024-01-20T08:12:08.313988+0000","last_became_active":"2024-01-20T08:12:07.079108+0000","last_became_peered":"2024-01-20T08:12:07.079108+0000","last_unstale":"2024-01-20T08:12:08.313988+0000","last_undegraded":"2024-01-20T08:12:08.313988+0000","last_fullsized":"2024-01-20T08:12:08.313988+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:18.953566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044239+0000","last_change":"2024-01-20T08:12:07.069601+0000","last_active":"2024-01-20T08:12:08.044239+0000","last_peered":"2024-01-20T08:12:08.044239+0000","last_clean":"2024-01-20T08:12:08.044239+0000","last_became_active":"2024-01-20T08:12:07.069275+0000","last_became_peered":"2024-01-20T08:12:07.069275+0000","last_unstale":"2024-01-20T08:12:08.044239+0000","last_undegraded":"2024-01-20T08:12:08.044239+0000","last_fullsized":"2024-01-20T08:12:08.044239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316141+0000","last_change":"2024-01-20T08:12:07.075671+0000","last_active":"2024-01-20T08:12:08.316141+0000","last_peered":"2024-01-20T08:12:08.316141+0000","last_clean":"2024-01-20T08:12:08.316141+0000","last_became_active":"2024-01-20T08:12:07.074069+0000","last_became_peered":"2024-01-20T08:12:07.074069+0000","last_unstale":"2024-01-20T08:12:08.316141+0000","last_undegraded":"2024-01-20T08:12:08.316141+0000","last_fullsized":"2024-01-20T08:12:08.316141+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044603+0000","last_change":"2024-01-20T08:12:07.066879+0000","last_active":"2024-01-20T08:12:08.044603+0000","last_peered":"2024-01-20T08:12:08.044603+0000","last_clean":"2024-01-20T08:12:08.044603+0000","last_became_active":"2024-01-20T08:12:07.066268+0000","last_became_peered":"2024-01-20T08:12:07.066268+0000","last_unstale":"2024-01-20T08:12:08.044603+0000","last_undegraded":"2024-01-20T08:12:08.044603+0000","last_fullsized":"2024-01-20T08:12:08.044603+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:22.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317135+0000","last_change":"2024-01-20T08:12:07.071750+0000","last_active":"2024-01-20T08:12:08.317135+0000","last_peered":"2024-01-20T08:12:08.317135+0000","last_clean":"2024-01-20T08:12:08.317135+0000","last_became_active":"2024-01-20T08:12:07.071410+0000","last_became_peered":"2024-01-20T08:12:07.071410+0000","last_unstale":"2024-01-20T08:12:08.317135+0000","last_undegraded":"2024-01-20T08:12:08.317135+0000","last_fullsized":"2024-01-20T08:12:08.317135+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:10.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316489+0000","last_change":"2024-01-20T08:12:07.064925+0000","last_active":"2024-01-20T08:12:08.316489+0000","last_peered":"2024-01-20T08:12:08.316489+0000","last_clean":"2024-01-20T08:12:08.316489+0000","last_became_active":"2024-01-20T08:12:07.064314+0000","last_became_peered":"2024-01-20T08:12:07.064314+0000","last_unstale":"2024-01-20T08:12:08.316489+0000","last_undegraded":"2024-01-20T08:12:08.316489+0000","last_fullsized":"2024-01-20T08:12:08.316489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:52.116068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316256+0000","last_change":"2024-01-20T08:12:07.069329+0000","last_active":"2024-01-20T08:12:08.316256+0000","last_peered":"2024-01-20T08:12:08.316256+0000","last_clean":"2024-01-20T08:12:08.316256+0000","last_became_active":"2024-01-20T08:12:07.068957+0000","last_became_peered":"2024-01-20T08:12:07.068957+0000","last_unstale":"2024-01-20T08:12:08.316256+0000","last_undegraded":"2024-01-20T08:12:08.316256+0000","last_fullsized":"2024-01-20T08:12:08.316256+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:15.643241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319985+0000","last_change":"2024-01-20T08:12:07.077771+0000","last_active":"2024-01-20T08:12:08.319985+0000","last_peered":"2024-01-20T08:12:08.319985+0000","last_clean":"2024-01-20T08:12:08.319985+0000","last_became_active":"2024-01-20T08:12:07.077498+0000","last_became_peered":"2024-01-20T08:12:07.077498+0000","last_unstale":"2024-01-20T08:12:08.319985+0000","last_undegraded":"2024-01-20T08:12:08.319985+0000","last_fullsized":"2024-01-20T08:12:08.319985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319888+0000","last_change":"2024-01-20T08:12:07.070855+0000","last_active":"2024-01-20T08:12:08.319888+0000","last_peered":"2024-01-20T08:12:08.319888+0000","last_clean":"2024-01-20T08:12:08.319888+0000","last_became_active":"2024-01-20T08:12:07.070467+0000","last_became_peered":"2024-01-20T08:12:07.070467+0000","last_unstale":"2024-01-20T08:12:08.319888+0000","last_undegraded":"2024-01-20T08:12:08.319888+0000","last_fullsized":"2024-01-20T08:12:08.319888+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:45.947061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318367+0000","last_change":"2024-01-20T08:12:07.066074+0000","last_active":"2024-01-20T08:12:08.318367+0000","last_peered":"2024-01-20T08:12:08.318367+0000","last_clean":"2024-01-20T08:12:08.318367+0000","last_became_active":"2024-01-20T08:12:07.063801+0000","last_became_peered":"2024-01-20T08:12:07.063801+0000","last_unstale":"2024-01-20T08:12:08.318367+0000","last_undegraded":"2024-01-20T08:12:08.318367+0000","last_fullsized":"2024-01-20T08:12:08.318367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:40.896208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316640+0000","last_change":"2024-01-20T08:12:07.055740+0000","last_active":"2024-01-20T08:12:08.316640+0000","last_peered":"2024-01-20T08:12:08.316640+0000","last_clean":"2024-01-20T08:12:08.316640+0000","last_became_active":"2024-01-20T08:12:07.055037+0000","last_became_peered":"2024-01-20T08:12:07.055037+0000","last_unstale":"2024-01-20T08:12:08.316640+0000","last_undegraded":"2024-01-20T08:12:08.316640+0000","last_fullsized":"2024-01-20T08:12:08.316640+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:07.521556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043866+0000","last_change":"2024-01-20T08:12:07.079668+0000","last_active":"2024-01-20T08:12:08.043866+0000","last_peered":"2024-01-20T08:12:08.043866+0000","last_clean":"2024-01-20T08:12:08.043866+0000","last_became_active":"2024-01-20T08:12:07.075321+0000","last_became_peered":"2024-01-20T08:12:07.075321+0000","last_unstale":"2024-01-20T08:12:08.043866+0000","last_undegraded":"2024-01-20T08:12:08.043866+0000","last_fullsized":"2024-01-20T08:12:08.043866+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046064+0000","last_change":"2024-01-20T08:12:07.068449+0000","last_active":"2024-01-20T08:12:08.046064+0000","last_peered":"2024-01-20T08:12:08.046064+0000","last_clean":"2024-01-20T08:12:08.046064+0000","last_became_active":"2024-01-20T08:12:07.067404+0000","last_became_peered":"2024-01-20T08:12:07.067404+0000","last_unstale":"2024-01-20T08:12:08.046064+0000","last_undegraded":"2024-01-20T08:12:08.046064+0000","last_fullsized":"2024-01-20T08:12:08.046064+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:33:44.143818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047269+0000","last_change":"2024-01-20T08:12:07.081616+0000","last_active":"2024-01-20T08:12:08.047269+0000","last_peered":"2024-01-20T08:12:08.047269+0000","last_clean":"2024-01-20T08:12:08.047269+0000","last_became_active":"2024-01-20T08:12:07.081014+0000","last_became_peered":"2024-01-20T08:12:07.081014+0000","last_unstale":"2024-01-20T08:12:08.047269+0000","last_undegraded":"2024-01-20T08:12:08.047269+0000","last_fullsized":"2024-01-20T08:12:08.047269+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313487+0000","last_change":"2024-01-20T08:12:07.077693+0000","last_active":"2024-01-20T08:12:08.313487+0000","last_peered":"2024-01-20T08:12:08.313487+0000","last_clean":"2024-01-20T08:12:08.313487+0000","last_became_active":"2024-01-20T08:12:07.077448+0000","last_became_peered":"2024-01-20T08:12:07.077448+0000","last_unstale":"2024-01-20T08:12:08.313487+0000","last_undegraded":"2024-01-20T08:12:08.313487+0000","last_fullsized":"2024-01-20T08:12:08.313487+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:56.215178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045654+0000","last_change":"2024-01-20T08:12:07.079543+0000","last_active":"2024-01-20T08:12:08.045654+0000","last_peered":"2024-01-20T08:12:08.045654+0000","last_clean":"2024-01-20T08:12:08.045654+0000","last_became_active":"2024-01-20T08:12:07.078435+0000","last_became_peered":"2024-01-20T08:12:07.078435+0000","last_unstale":"2024-01-20T08:12:08.045654+0000","last_undegraded":"2024-01-20T08:12:08.045654+0000","last_fullsized":"2024-01-20T08:12:08.045654+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:28.706699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046288+0000","last_change":"2024-01-20T08:12:07.080145+0000","last_active":"2024-01-20T08:12:08.046288+0000","last_peered":"2024-01-20T08:12:08.046288+0000","last_clean":"2024-01-20T08:12:08.046288+0000","last_became_active":"2024-01-20T08:12:07.079803+0000","last_became_peered":"2024-01-20T08:12:07.079803+0000","last_unstale":"2024-01-20T08:12:08.046288+0000","last_undegraded":"2024-01-20T08:12:08.046288+0000","last_fullsized":"2024-01-20T08:12:08.046288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:35.347679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044263+0000","last_change":"2024-01-20T08:12:07.072637+0000","last_active":"2024-01-20T08:12:08.044263+0000","last_peered":"2024-01-20T08:12:08.044263+0000","last_clean":"2024-01-20T08:12:08.044263+0000","last_became_active":"2024-01-20T08:12:07.068029+0000","last_became_peered":"2024-01-20T08:12:07.068029+0000","last_unstale":"2024-01-20T08:12:08.044263+0000","last_undegraded":"2024-01-20T08:12:08.044263+0000","last_fullsized":"2024-01-20T08:12:08.044263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:48.804666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046359+0000","last_change":"2024-01-20T08:12:07.087617+0000","last_active":"2024-01-20T08:12:08.046359+0000","last_peered":"2024-01-20T08:12:08.046359+0000","last_clean":"2024-01-20T08:12:08.046359+0000","last_became_active":"2024-01-20T08:12:07.085114+0000","last_became_peered":"2024-01-20T08:12:07.085114+0000","last_unstale":"2024-01-20T08:12:08.046359+0000","last_undegraded":"2024-01-20T08:12:08.046359+0000","last_fullsized":"2024-01-20T08:12:08.046359+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318314+0000","last_change":"2024-01-20T08:12:07.072912+0000","last_active":"2024-01-20T08:12:08.318314+0000","last_peered":"2024-01-20T08:12:08.318314+0000","last_clean":"2024-01-20T08:12:08.318314+0000","last_became_active":"2024-01-20T08:12:07.072564+0000","last_became_peered":"2024-01-20T08:12:07.072564+0000","last_unstale":"2024-01-20T08:12:08.318314+0000","last_undegraded":"2024-01-20T08:12:08.318314+0000","last_fullsized":"2024-01-20T08:12:08.318314+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:21.868460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.314197+0000","last_change":"2024-01-20T08:12:07.076077+0000","last_active":"2024-01-20T08:12:08.314197+0000","last_peered":"2024-01-20T08:12:08.314197+0000","last_clean":"2024-01-20T08:12:08.314197+0000","last_became_active":"2024-01-20T08:12:07.075830+0000","last_became_peered":"2024-01-20T08:12:07.075830+0000","last_unstale":"2024-01-20T08:12:08.314197+0000","last_undegraded":"2024-01-20T08:12:08.314197+0000","last_fullsized":"2024-01-20T08:12:08.314197+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:22.791363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318485+0000","last_change":"2024-01-20T08:12:07.072412+0000","last_active":"2024-01-20T08:12:08.318485+0000","last_peered":"2024-01-20T08:12:08.318485+0000","last_clean":"2024-01-20T08:12:08.318485+0000","last_became_active":"2024-01-20T08:12:07.072119+0000","last_became_peered":"2024-01-20T08:12:07.072119+0000","last_unstale":"2024-01-20T08:12:08.318485+0000","last_undegraded":"2024-01-20T08:12:08.318485+0000","last_fullsized":"2024-01-20T08:12:08.318485+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044694+0000","last_change":"2024-01-20T08:12:07.077399+0000","last_active":"2024-01-20T08:12:08.044694+0000","last_peered":"2024-01-20T08:12:08.044694+0000","last_clean":"2024-01-20T08:12:08.044694+0000","last_became_active":"2024-01-20T08:12:07.077122+0000","last_became_peered":"2024-01-20T08:12:07.077122+0000","last_unstale":"2024-01-20T08:12:08.044694+0000","last_undegraded":"2024-01-20T08:12:08.044694+0000","last_fullsized":"2024-01-20T08:12:08.044694+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:25.524024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313809+0000","last_change":"2024-01-20T08:12:07.076949+0000","last_active":"2024-01-20T08:12:08.313809+0000","last_peered":"2024-01-20T08:12:08.313809+0000","last_clean":"2024-01-20T08:12:08.313809+0000","last_became_active":"2024-01-20T08:12:07.076497+0000","last_became_peered":"2024-01-20T08:12:07.076497+0000","last_unstale":"2024-01-20T08:12:08.313809+0000","last_undegraded":"2024-01-20T08:12:08.313809+0000","last_fullsized":"2024-01-20T08:12:08.313809+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:04:40.245579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045278+0000","last_change":"2024-01-20T08:12:07.079522+0000","last_active":"2024-01-20T08:12:08.045278+0000","last_peered":"2024-01-20T08:12:08.045278+0000","last_clean":"2024-01-20T08:12:08.045278+0000","last_became_active":"2024-01-20T08:12:07.079268+0000","last_became_peered":"2024-01-20T08:12:07.079268+0000","last_unstale":"2024-01-20T08:12:08.045278+0000","last_undegraded":"2024-01-20T08:12:08.045278+0000","last_fullsized":"2024-01-20T08:12:08.045278+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:37.687652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045935+0000","last_change":"2024-01-20T08:12:07.076533+0000","last_active":"2024-01-20T08:12:08.045935+0000","last_peered":"2024-01-20T08:12:08.045935+0000","last_clean":"2024-01-20T08:12:08.045935+0000","last_became_active":"2024-01-20T08:12:07.076184+0000","last_became_peered":"2024-01-20T08:12:07.076184+0000","last_unstale":"2024-01-20T08:12:08.045935+0000","last_undegraded":"2024-01-20T08:12:08.045935+0000","last_fullsized":"2024-01-20T08:12:08.045935+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:49:57.037227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.313555+0000","last_change":"2024-01-20T08:12:07.071054+0000","last_active":"2024-01-20T08:12:08.313555+0000","last_peered":"2024-01-20T08:12:08.313555+0000","last_clean":"2024-01-20T08:12:08.313555+0000","last_became_active":"2024-01-20T08:12:07.070741+0000","last_became_peered":"2024-01-20T08:12:07.070741+0000","last_unstale":"2024-01-20T08:12:08.313555+0000","last_undegraded":"2024-01-20T08:12:08.313555+0000","last_fullsized":"2024-01-20T08:12:08.313555+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:03.112854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044231+0000","last_change":"2024-01-20T08:12:07.078867+0000","last_active":"2024-01-20T08:12:08.044231+0000","last_peered":"2024-01-20T08:12:08.044231+0000","last_clean":"2024-01-20T08:12:08.044231+0000","last_became_active":"2024-01-20T08:12:07.078639+0000","last_became_peered":"2024-01-20T08:12:07.078639+0000","last_unstale":"2024-01-20T08:12:08.044231+0000","last_undegraded":"2024-01-20T08:12:08.044231+0000","last_fullsized":"2024-01-20T08:12:08.044231+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044777+0000","last_change":"2024-01-20T08:12:07.080377+0000","last_active":"2024-01-20T08:12:08.044777+0000","last_peered":"2024-01-20T08:12:08.044777+0000","last_clean":"2024-01-20T08:12:08.044777+0000","last_became_active":"2024-01-20T08:12:07.080044+0000","last_became_peered":"2024-01-20T08:12:07.080044+0000","last_unstale":"2024-01-20T08:12:08.044777+0000","last_undegraded":"2024-01-20T08:12:08.044777+0000","last_fullsized":"2024-01-20T08:12:08.044777+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:33.328172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":16,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100685+0000","last_change":"2024-01-20T08:12:06.069013+0000","last_active":"2024-01-20T08:12:07.100685+0000","last_peered":"2024-01-20T08:12:07.100685+0000","last_clean":"2024-01-20T08:12:07.100685+0000","last_became_active":"2024-01-20T08:12:06.068785+0000","last_became_peered":"2024-01-20T08:12:06.068785+0000","last_unstale":"2024-01-20T08:12:07.100685+0000","last_undegraded":"2024-01-20T08:12:07.100685+0000","last_fullsized":"2024-01-20T08:12:07.100685+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:48.916750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316877+0000","last_change":"2024-01-20T08:12:07.074189+0000","last_active":"2024-01-20T08:12:08.316877+0000","last_peered":"2024-01-20T08:12:08.316877+0000","last_clean":"2024-01-20T08:12:08.316877+0000","last_became_active":"2024-01-20T08:12:07.073922+0000","last_became_peered":"2024-01-20T08:12:07.073922+0000","last_unstale":"2024-01-20T08:12:08.316877+0000","last_undegraded":"2024-01-20T08:12:08.316877+0000","last_fullsized":"2024-01-20T08:12:08.316877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099448+0000","last_change":"2024-01-20T08:12:06.067289+0000","last_active":"2024-01-20T08:12:07.099448+0000","last_peered":"2024-01-20T08:12:07.099448+0000","last_clean":"2024-01-20T08:12:07.099448+0000","last_became_active":"2024-01-20T08:12:06.066945+0000","last_became_peered":"2024-01-20T08:12:06.066945+0000","last_unstale":"2024-01-20T08:12:07.099448+0000","last_undegraded":"2024-01-20T08:12:07.099448+0000","last_fullsized":"2024-01-20T08:12:07.099448+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:05.035478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044347+0000","last_change":"2024-01-20T08:12:07.082658+0000","last_active":"2024-01-20T08:12:08.044347+0000","last_peered":"2024-01-20T08:12:08.044347+0000","last_clean":"2024-01-20T08:12:08.044347+0000","last_became_active":"2024-01-20T08:12:07.082212+0000","last_became_peered":"2024-01-20T08:12:07.082212+0000","last_unstale":"2024-01-20T08:12:08.044347+0000","last_undegraded":"2024-01-20T08:12:08.044347+0000","last_fullsized":"2024-01-20T08:12:08.044347+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098084+0000","last_change":"2024-01-20T08:12:06.058720+0000","last_active":"2024-01-20T08:12:07.098084+0000","last_peered":"2024-01-20T08:12:07.098084+0000","last_clean":"2024-01-20T08:12:07.098084+0000","last_became_active":"2024-01-20T08:12:06.058352+0000","last_became_peered":"2024-01-20T08:12:06.058352+0000","last_unstale":"2024-01-20T08:12:07.098084+0000","last_undegraded":"2024-01-20T08:12:07.098084+0000","last_fullsized":"2024-01-20T08:12:07.098084+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:09.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044881+0000","last_change":"2024-01-20T08:12:07.080508+0000","last_active":"2024-01-20T08:12:08.044881+0000","last_peered":"2024-01-20T08:12:08.044881+0000","last_clean":"2024-01-20T08:12:08.044881+0000","last_became_active":"2024-01-20T08:12:07.080057+0000","last_became_peered":"2024-01-20T08:12:07.080057+0000","last_unstale":"2024-01-20T08:12:08.044881+0000","last_undegraded":"2024-01-20T08:12:08.044881+0000","last_fullsized":"2024-01-20T08:12:08.044881+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.415785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100075+0000","last_change":"2024-01-20T08:12:06.073731+0000","last_active":"2024-01-20T08:12:07.100075+0000","last_peered":"2024-01-20T08:12:07.100075+0000","last_clean":"2024-01-20T08:12:07.100075+0000","last_became_active":"2024-01-20T08:12:06.073398+0000","last_became_peered":"2024-01-20T08:12:06.073398+0000","last_unstale":"2024-01-20T08:12:07.100075+0000","last_undegraded":"2024-01-20T08:12:07.100075+0000","last_fullsized":"2024-01-20T08:12:07.100075+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:14.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044406+0000","last_change":"2024-01-20T08:12:07.072285+0000","last_active":"2024-01-20T08:12:08.044406+0000","last_peered":"2024-01-20T08:12:08.044406+0000","last_clean":"2024-01-20T08:12:08.044406+0000","last_became_active":"2024-01-20T08:12:07.068016+0000","last_became_peered":"2024-01-20T08:12:07.068016+0000","last_unstale":"2024-01-20T08:12:08.044406+0000","last_undegraded":"2024-01-20T08:12:08.044406+0000","last_fullsized":"2024-01-20T08:12:08.044406+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:17.339298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.098992+0000","last_change":"2024-01-20T08:12:06.062959+0000","last_active":"2024-01-20T08:12:07.098992+0000","last_peered":"2024-01-20T08:12:07.098992+0000","last_clean":"2024-01-20T08:12:07.098992+0000","last_became_active":"2024-01-20T08:12:06.062074+0000","last_became_peered":"2024-01-20T08:12:06.062074+0000","last_unstale":"2024-01-20T08:12:07.098992+0000","last_undegraded":"2024-01-20T08:12:07.098992+0000","last_fullsized":"2024-01-20T08:12:07.098992+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:20.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044999+0000","last_change":"2024-01-20T08:12:07.073980+0000","last_active":"2024-01-20T08:12:08.044999+0000","last_peered":"2024-01-20T08:12:08.044999+0000","last_clean":"2024-01-20T08:12:08.044999+0000","last_became_active":"2024-01-20T08:12:07.072685+0000","last_became_peered":"2024-01-20T08:12:07.072685+0000","last_unstale":"2024-01-20T08:12:08.044999+0000","last_undegraded":"2024-01-20T08:12:08.044999+0000","last_fullsized":"2024-01-20T08:12:08.044999+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:02:57.344542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.097481+0000","last_change":"2024-01-20T08:12:06.063065+0000","last_active":"2024-01-20T08:12:07.097481+0000","last_peered":"2024-01-20T08:12:07.097481+0000","last_clean":"2024-01-20T08:12:07.097481+0000","last_became_active":"2024-01-20T08:12:06.062833+0000","last_became_peered":"2024-01-20T08:12:06.062833+0000","last_unstale":"2024-01-20T08:12:07.097481+0000","last_undegraded":"2024-01-20T08:12:07.097481+0000","last_fullsized":"2024-01-20T08:12:07.097481+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318295+0000","last_change":"2024-01-20T08:12:07.081364+0000","last_active":"2024-01-20T08:12:08.318295+0000","last_peered":"2024-01-20T08:12:08.318295+0000","last_clean":"2024-01-20T08:12:08.318295+0000","last_became_active":"2024-01-20T08:12:07.080761+0000","last_became_peered":"2024-01-20T08:12:07.080761+0000","last_unstale":"2024-01-20T08:12:08.318295+0000","last_undegraded":"2024-01-20T08:12:08.318295+0000","last_fullsized":"2024-01-20T08:12:08.318295+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:29.139178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063179+0000","last_change":"2024-01-20T08:12:06.071618+0000","last_active":"2024-01-20T08:12:07.063179+0000","last_peered":"2024-01-20T08:12:07.063179+0000","last_clean":"2024-01-20T08:12:07.063179+0000","last_became_active":"2024-01-20T08:12:06.070615+0000","last_became_peered":"2024-01-20T08:12:06.070615+0000","last_unstale":"2024-01-20T08:12:07.063179+0000","last_undegraded":"2024-01-20T08:12:07.063179+0000","last_fullsized":"2024-01-20T08:12:07.063179+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:51.110106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045425+0000","last_change":"2024-01-20T08:12:07.078826+0000","last_active":"2024-01-20T08:12:08.045425+0000","last_peered":"2024-01-20T08:12:08.045425+0000","last_clean":"2024-01-20T08:12:08.045425+0000","last_became_active":"2024-01-20T08:12:07.078429+0000","last_became_peered":"2024-01-20T08:12:07.078429+0000","last_unstale":"2024-01-20T08:12:08.045425+0000","last_undegraded":"2024-01-20T08:12:08.045425+0000","last_fullsized":"2024-01-20T08:12:08.045425+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.046631+0000","last_change":"2024-01-20T08:12:06.055455+0000","last_active":"2024-01-20T08:12:07.046631+0000","last_peered":"2024-01-20T08:12:07.046631+0000","last_clean":"2024-01-20T08:12:07.046631+0000","last_became_active":"2024-01-20T08:12:06.053817+0000","last_became_peered":"2024-01-20T08:12:06.053817+0000","last_unstale":"2024-01-20T08:12:07.046631+0000","last_undegraded":"2024-01-20T08:12:07.046631+0000","last_fullsized":"2024-01-20T08:12:07.046631+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:32.005693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317353+0000","last_change":"2024-01-20T08:12:07.069110+0000","last_active":"2024-01-20T08:12:08.317353+0000","last_peered":"2024-01-20T08:12:08.317353+0000","last_clean":"2024-01-20T08:12:08.317353+0000","last_became_active":"2024-01-20T08:12:07.068542+0000","last_became_peered":"2024-01-20T08:12:07.068542+0000","last_unstale":"2024-01-20T08:12:08.317353+0000","last_undegraded":"2024-01-20T08:12:08.317353+0000","last_fullsized":"2024-01-20T08:12:08.317353+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:33.766825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074228+0000","last_change":"2024-01-20T08:12:06.075567+0000","last_active":"2024-01-20T08:12:07.074228+0000","last_peered":"2024-01-20T08:12:07.074228+0000","last_clean":"2024-01-20T08:12:07.074228+0000","last_became_active":"2024-01-20T08:12:06.075224+0000","last_became_peered":"2024-01-20T08:12:06.075224+0000","last_unstale":"2024-01-20T08:12:07.074228+0000","last_undegraded":"2024-01-20T08:12:07.074228+0000","last_fullsized":"2024-01-20T08:12:07.074228+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:37.894928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047771+0000","last_change":"2024-01-20T08:12:07.087383+0000","last_active":"2024-01-20T08:12:08.047771+0000","last_peered":"2024-01-20T08:12:08.047771+0000","last_clean":"2024-01-20T08:12:08.047771+0000","last_became_active":"2024-01-20T08:12:07.080077+0000","last_became_peered":"2024-01-20T08:12:07.080077+0000","last_unstale":"2024-01-20T08:12:08.047771+0000","last_undegraded":"2024-01-20T08:12:08.047771+0000","last_fullsized":"2024-01-20T08:12:08.047771+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.051450+0000","last_change":"2024-01-20T08:12:06.061973+0000","last_active":"2024-01-20T08:12:07.051450+0000","last_peered":"2024-01-20T08:12:07.051450+0000","last_clean":"2024-01-20T08:12:07.051450+0000","last_became_active":"2024-01-20T08:12:06.061556+0000","last_became_peered":"2024-01-20T08:12:06.061556+0000","last_unstale":"2024-01-20T08:12:07.051450+0000","last_undegraded":"2024-01-20T08:12:07.051450+0000","last_fullsized":"2024-01-20T08:12:07.051450+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:44.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315706+0000","last_change":"2024-01-20T08:12:07.057739+0000","last_active":"2024-01-20T08:12:08.315706+0000","last_peered":"2024-01-20T08:12:08.315706+0000","last_clean":"2024-01-20T08:12:08.315706+0000","last_became_active":"2024-01-20T08:12:07.055502+0000","last_became_peered":"2024-01-20T08:12:07.055502+0000","last_unstale":"2024-01-20T08:12:08.315706+0000","last_undegraded":"2024-01-20T08:12:08.315706+0000","last_fullsized":"2024-01-20T08:12:08.315706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:13.798575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":15,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101367+0000","last_change":"2024-01-20T08:12:06.075821+0000","last_active":"2024-01-20T08:12:07.101367+0000","last_peered":"2024-01-20T08:12:07.101367+0000","last_clean":"2024-01-20T08:12:07.101367+0000","last_became_active":"2024-01-20T08:12:06.075449+0000","last_became_peered":"2024-01-20T08:12:06.075449+0000","last_unstale":"2024-01-20T08:12:07.101367+0000","last_undegraded":"2024-01-20T08:12:07.101367+0000","last_fullsized":"2024-01-20T08:12:07.101367+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:44.906399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047518+0000","last_change":"2024-01-20T08:12:07.081343+0000","last_active":"2024-01-20T08:12:08.047518+0000","last_peered":"2024-01-20T08:12:08.047518+0000","last_clean":"2024-01-20T08:12:08.047518+0000","last_became_active":"2024-01-20T08:12:07.079569+0000","last_became_peered":"2024-01-20T08:12:07.079569+0000","last_unstale":"2024-01-20T08:12:08.047518+0000","last_undegraded":"2024-01-20T08:12:08.047518+0000","last_fullsized":"2024-01-20T08:12:08.047518+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"51'6","reported_seq":18,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.103278+0000","last_change":"2024-01-20T08:12:06.066310+0000","last_active":"2024-01-20T08:12:07.103278+0000","last_peered":"2024-01-20T08:12:07.103278+0000","last_clean":"2024-01-20T08:12:07.103278+0000","last_became_active":"2024-01-20T08:12:06.065636+0000","last_became_peered":"2024-01-20T08:12:06.065636+0000","last_unstale":"2024-01-20T08:12:07.103278+0000","last_undegraded":"2024-01-20T08:12:07.103278+0000","last_fullsized":"2024-01-20T08:12:07.103278+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317051+0000","last_change":"2024-01-20T08:12:07.078287+0000","last_active":"2024-01-20T08:12:08.317051+0000","last_peered":"2024-01-20T08:12:08.317051+0000","last_clean":"2024-01-20T08:12:08.317051+0000","last_became_active":"2024-01-20T08:12:07.078008+0000","last_became_peered":"2024-01-20T08:12:07.078008+0000","last_unstale":"2024-01-20T08:12:08.317051+0000","last_undegraded":"2024-01-20T08:12:08.317051+0000","last_fullsized":"2024-01-20T08:12:08.317051+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101761+0000","last_change":"2024-01-20T08:12:06.065744+0000","last_active":"2024-01-20T08:12:07.101761+0000","last_peered":"2024-01-20T08:12:07.101761+0000","last_clean":"2024-01-20T08:12:07.101761+0000","last_became_active":"2024-01-20T08:12:06.065473+0000","last_became_peered":"2024-01-20T08:12:06.065473+0000","last_unstale":"2024-01-20T08:12:07.101761+0000","last_undegraded":"2024-01-20T08:12:07.101761+0000","last_fullsized":"2024-01-20T08:12:07.101761+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:28.564397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046124+0000","last_change":"2024-01-20T08:12:07.078220+0000","last_active":"2024-01-20T08:12:08.046124+0000","last_peered":"2024-01-20T08:12:08.046124+0000","last_clean":"2024-01-20T08:12:08.046124+0000","last_became_active":"2024-01-20T08:12:07.077812+0000","last_became_peered":"2024-01-20T08:12:07.077812+0000","last_unstale":"2024-01-20T08:12:08.046124+0000","last_undegraded":"2024-01-20T08:12:08.046124+0000","last_fullsized":"2024-01-20T08:12:08.046124+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:54.112972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.066821+0000","last_change":"2024-01-20T08:12:06.071522+0000","last_active":"2024-01-20T08:12:07.066821+0000","last_peered":"2024-01-20T08:12:07.066821+0000","last_clean":"2024-01-20T08:12:07.066821+0000","last_became_active":"2024-01-20T08:12:06.069659+0000","last_became_peered":"2024-01-20T08:12:06.069659+0000","last_unstale":"2024-01-20T08:12:07.066821+0000","last_undegraded":"2024-01-20T08:12:07.066821+0000","last_fullsized":"2024-01-20T08:12:07.066821+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316985+0000","last_change":"2024-01-20T08:12:07.078740+0000","last_active":"2024-01-20T08:12:08.316985+0000","last_peered":"2024-01-20T08:12:08.316985+0000","last_clean":"2024-01-20T08:12:08.316985+0000","last_became_active":"2024-01-20T08:12:07.078413+0000","last_became_peered":"2024-01-20T08:12:07.078413+0000","last_unstale":"2024-01-20T08:12:08.316985+0000","last_undegraded":"2024-01-20T08:12:08.316985+0000","last_fullsized":"2024-01-20T08:12:08.316985+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.190626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063368+0000","last_change":"2024-01-20T08:12:06.071714+0000","last_active":"2024-01-20T08:12:07.063368+0000","last_peered":"2024-01-20T08:12:07.063368+0000","last_clean":"2024-01-20T08:12:07.063368+0000","last_became_active":"2024-01-20T08:12:06.071263+0000","last_became_peered":"2024-01-20T08:12:06.071263+0000","last_unstale":"2024-01-20T08:12:07.063368+0000","last_undegraded":"2024-01-20T08:12:07.063368+0000","last_fullsized":"2024-01-20T08:12:07.063368+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:05.094918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046535+0000","last_change":"2024-01-20T08:12:07.088126+0000","last_active":"2024-01-20T08:12:08.046535+0000","last_peered":"2024-01-20T08:12:08.046535+0000","last_clean":"2024-01-20T08:12:08.046535+0000","last_became_active":"2024-01-20T08:12:07.087789+0000","last_became_peered":"2024-01-20T08:12:07.087789+0000","last_unstale":"2024-01-20T08:12:08.046535+0000","last_undegraded":"2024-01-20T08:12:08.046535+0000","last_fullsized":"2024-01-20T08:12:08.046535+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":20,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101182+0000","last_change":"2024-01-20T08:12:06.074824+0000","last_active":"2024-01-20T08:12:07.101182+0000","last_peered":"2024-01-20T08:12:07.101182+0000","last_clean":"2024-01-20T08:12:07.101182+0000","last_became_active":"2024-01-20T08:12:06.074111+0000","last_became_peered":"2024-01-20T08:12:06.074111+0000","last_unstale":"2024-01-20T08:12:07.101182+0000","last_undegraded":"2024-01-20T08:12:07.101182+0000","last_fullsized":"2024-01-20T08:12:07.101182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047194+0000","last_change":"2024-01-20T08:12:07.082593+0000","last_active":"2024-01-20T08:12:08.047194+0000","last_peered":"2024-01-20T08:12:08.047194+0000","last_clean":"2024-01-20T08:12:08.047194+0000","last_became_active":"2024-01-20T08:12:07.082366+0000","last_became_peered":"2024-01-20T08:12:07.082366+0000","last_unstale":"2024-01-20T08:12:08.047194+0000","last_undegraded":"2024-01-20T08:12:08.047194+0000","last_fullsized":"2024-01-20T08:12:08.047194+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101568+0000","last_change":"2024-01-20T08:12:06.065566+0000","last_active":"2024-01-20T08:12:07.101568+0000","last_peered":"2024-01-20T08:12:07.101568+0000","last_clean":"2024-01-20T08:12:07.101568+0000","last_became_active":"2024-01-20T08:12:06.065270+0000","last_became_peered":"2024-01-20T08:12:06.065270+0000","last_unstale":"2024-01-20T08:12:07.101568+0000","last_undegraded":"2024-01-20T08:12:07.101568+0000","last_fullsized":"2024-01-20T08:12:07.101568+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:45.655205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318970+0000","last_change":"2024-01-20T08:12:07.082690+0000","last_active":"2024-01-20T08:12:08.318970+0000","last_peered":"2024-01-20T08:12:08.318970+0000","last_clean":"2024-01-20T08:12:08.318970+0000","last_became_active":"2024-01-20T08:12:07.082364+0000","last_became_peered":"2024-01-20T08:12:07.082364+0000","last_unstale":"2024-01-20T08:12:08.318970+0000","last_undegraded":"2024-01-20T08:12:08.318970+0000","last_fullsized":"2024-01-20T08:12:08.318970+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.099313+0000","last_change":"2024-01-20T08:12:06.061749+0000","last_active":"2024-01-20T08:12:07.099313+0000","last_peered":"2024-01-20T08:12:07.099313+0000","last_clean":"2024-01-20T08:12:07.099313+0000","last_became_active":"2024-01-20T08:12:06.061466+0000","last_became_peered":"2024-01-20T08:12:06.061466+0000","last_unstale":"2024-01-20T08:12:07.099313+0000","last_undegraded":"2024-01-20T08:12:07.099313+0000","last_fullsized":"2024-01-20T08:12:07.099313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:32.760864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045704+0000","last_change":"2024-01-20T08:12:07.065833+0000","last_active":"2024-01-20T08:12:08.045704+0000","last_peered":"2024-01-20T08:12:08.045704+0000","last_clean":"2024-01-20T08:12:08.045704+0000","last_became_active":"2024-01-20T08:12:07.065547+0000","last_became_peered":"2024-01-20T08:12:07.065547+0000","last_unstale":"2024-01-20T08:12:08.045704+0000","last_undegraded":"2024-01-20T08:12:08.045704+0000","last_fullsized":"2024-01-20T08:12:08.045704+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:08.237987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":13,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.100053+0000","last_change":"2024-01-20T08:12:06.073869+0000","last_active":"2024-01-20T08:12:07.100053+0000","last_peered":"2024-01-20T08:12:07.100053+0000","last_clean":"2024-01-20T08:12:07.100053+0000","last_became_active":"2024-01-20T08:12:06.073514+0000","last_became_peered":"2024-01-20T08:12:06.073514+0000","last_unstale":"2024-01-20T08:12:07.100053+0000","last_undegraded":"2024-01-20T08:12:07.100053+0000","last_fullsized":"2024-01-20T08:12:07.100053+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047715+0000","last_change":"2024-01-20T08:12:07.084906+0000","last_active":"2024-01-20T08:12:08.047715+0000","last_peered":"2024-01-20T08:12:08.047715+0000","last_clean":"2024-01-20T08:12:08.047715+0000","last_became_active":"2024-01-20T08:12:07.080034+0000","last_became_peered":"2024-01-20T08:12:07.080034+0000","last_unstale":"2024-01-20T08:12:08.047715+0000","last_undegraded":"2024-01-20T08:12:08.047715+0000","last_fullsized":"2024-01-20T08:12:08.047715+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.073459+0000","last_change":"2024-01-20T08:12:06.056008+0000","last_active":"2024-01-20T08:12:07.073459+0000","last_peered":"2024-01-20T08:12:07.073459+0000","last_clean":"2024-01-20T08:12:07.073459+0000","last_became_active":"2024-01-20T08:12:06.055317+0000","last_became_peered":"2024-01-20T08:12:06.055317+0000","last_unstale":"2024-01-20T08:12:07.073459+0000","last_undegraded":"2024-01-20T08:12:07.073459+0000","last_fullsized":"2024-01-20T08:12:07.073459+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317364+0000","last_change":"2024-01-20T08:12:07.078035+0000","last_active":"2024-01-20T08:12:08.317364+0000","last_peered":"2024-01-20T08:12:08.317364+0000","last_clean":"2024-01-20T08:12:08.317364+0000","last_became_active":"2024-01-20T08:12:07.076150+0000","last_became_peered":"2024-01-20T08:12:07.076150+0000","last_unstale":"2024-01-20T08:12:08.317364+0000","last_undegraded":"2024-01-20T08:12:08.317364+0000","last_fullsized":"2024-01-20T08:12:08.317364+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101610+0000","last_change":"2024-01-20T08:12:06.058384+0000","last_active":"2024-01-20T08:12:07.101610+0000","last_peered":"2024-01-20T08:12:07.101610+0000","last_clean":"2024-01-20T08:12:07.101610+0000","last_became_active":"2024-01-20T08:12:06.058097+0000","last_became_peered":"2024-01-20T08:12:06.058097+0000","last_unstale":"2024-01-20T08:12:07.101610+0000","last_undegraded":"2024-01-20T08:12:07.101610+0000","last_fullsized":"2024-01-20T08:12:07.101610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:12.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044363+0000","last_change":"2024-01-20T08:12:07.077060+0000","last_active":"2024-01-20T08:12:08.044363+0000","last_peered":"2024-01-20T08:12:08.044363+0000","last_clean":"2024-01-20T08:12:08.044363+0000","last_became_active":"2024-01-20T08:12:07.074560+0000","last_became_peered":"2024-01-20T08:12:07.074560+0000","last_unstale":"2024-01-20T08:12:08.044363+0000","last_undegraded":"2024-01-20T08:12:08.044363+0000","last_fullsized":"2024-01-20T08:12:08.044363+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:11:42.486924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043187+0000","last_change":"2024-01-20T08:12:06.061716+0000","last_active":"2024-01-20T08:12:07.043187+0000","last_peered":"2024-01-20T08:12:07.043187+0000","last_clean":"2024-01-20T08:12:07.043187+0000","last_became_active":"2024-01-20T08:12:06.061410+0000","last_became_peered":"2024-01-20T08:12:06.061410+0000","last_unstale":"2024-01-20T08:12:07.043187+0000","last_undegraded":"2024-01-20T08:12:07.043187+0000","last_fullsized":"2024-01-20T08:12:07.043187+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.043900+0000","last_change":"2024-01-20T08:12:07.077678+0000","last_active":"2024-01-20T08:12:08.043900+0000","last_peered":"2024-01-20T08:12:08.043900+0000","last_clean":"2024-01-20T08:12:08.043900+0000","last_became_active":"2024-01-20T08:12:07.077094+0000","last_became_peered":"2024-01-20T08:12:07.077094+0000","last_unstale":"2024-01-20T08:12:08.043900+0000","last_undegraded":"2024-01-20T08:12:08.043900+0000","last_fullsized":"2024-01-20T08:12:08.043900+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.059759+0000","last_change":"2024-01-20T08:12:06.063892+0000","last_active":"2024-01-20T08:12:07.059759+0000","last_peered":"2024-01-20T08:12:07.059759+0000","last_clean":"2024-01-20T08:12:07.059759+0000","last_became_active":"2024-01-20T08:12:06.063601+0000","last_became_peered":"2024-01-20T08:12:06.063601+0000","last_unstale":"2024-01-20T08:12:07.059759+0000","last_undegraded":"2024-01-20T08:12:07.059759+0000","last_fullsized":"2024-01-20T08:12:07.059759+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:48.315980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318635+0000","last_change":"2024-01-20T08:12:07.073337+0000","last_active":"2024-01-20T08:12:08.318635+0000","last_peered":"2024-01-20T08:12:08.318635+0000","last_clean":"2024-01-20T08:12:08.318635+0000","last_became_active":"2024-01-20T08:12:07.073087+0000","last_became_peered":"2024-01-20T08:12:07.073087+0000","last_unstale":"2024-01-20T08:12:08.318635+0000","last_undegraded":"2024-01-20T08:12:08.318635+0000","last_fullsized":"2024-01-20T08:12:08.318635+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":14,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.101475+0000","last_change":"2024-01-20T08:12:06.049193+0000","last_active":"2024-01-20T08:12:07.101475+0000","last_peered":"2024-01-20T08:12:07.101475+0000","last_clean":"2024-01-20T08:12:07.101475+0000","last_became_active":"2024-01-20T08:12:06.048916+0000","last_became_peered":"2024-01-20T08:12:06.048916+0000","last_unstale":"2024-01-20T08:12:07.101475+0000","last_undegraded":"2024-01-20T08:12:07.101475+0000","last_fullsized":"2024-01-20T08:12:07.101475+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:53.905817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319316+0000","last_change":"2024-01-20T08:12:07.082890+0000","last_active":"2024-01-20T08:12:08.319316+0000","last_peered":"2024-01-20T08:12:08.319316+0000","last_clean":"2024-01-20T08:12:08.319316+0000","last_became_active":"2024-01-20T08:12:07.080723+0000","last_became_peered":"2024-01-20T08:12:07.080723+0000","last_unstale":"2024-01-20T08:12:08.319316+0000","last_undegraded":"2024-01-20T08:12:08.319316+0000","last_fullsized":"2024-01-20T08:12:08.319316+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.074909+0000","last_change":"2024-01-20T08:12:06.062568+0000","last_active":"2024-01-20T08:12:07.074909+0000","last_peered":"2024-01-20T08:12:07.074909+0000","last_clean":"2024-01-20T08:12:07.074909+0000","last_became_active":"2024-01-20T08:12:06.062294+0000","last_became_peered":"2024-01-20T08:12:06.062294+0000","last_unstale":"2024-01-20T08:12:07.074909+0000","last_undegraded":"2024-01-20T08:12:07.074909+0000","last_fullsized":"2024-01-20T08:12:07.074909+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:39.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316009+0000","last_change":"2024-01-20T08:12:07.060815+0000","last_active":"2024-01-20T08:12:08.316009+0000","last_peered":"2024-01-20T08:12:08.316009+0000","last_clean":"2024-01-20T08:12:08.316009+0000","last_became_active":"2024-01-20T08:12:07.057155+0000","last_became_peered":"2024-01-20T08:12:07.057155+0000","last_unstale":"2024-01-20T08:12:08.316009+0000","last_undegraded":"2024-01-20T08:12:08.316009+0000","last_fullsized":"2024-01-20T08:12:08.316009+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:49.321942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.067445+0000","last_change":"2024-01-20T08:12:06.063244+0000","last_active":"2024-01-20T08:12:07.067445+0000","last_peered":"2024-01-20T08:12:07.067445+0000","last_clean":"2024-01-20T08:12:07.067445+0000","last_became_active":"2024-01-20T08:12:06.062628+0000","last_became_peered":"2024-01-20T08:12:06.062628+0000","last_unstale":"2024-01-20T08:12:07.067445+0000","last_undegraded":"2024-01-20T08:12:07.067445+0000","last_fullsized":"2024-01-20T08:12:07.067445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045067+0000","last_change":"2024-01-20T08:12:07.088893+0000","last_active":"2024-01-20T08:12:08.045067+0000","last_peered":"2024-01-20T08:12:08.045067+0000","last_clean":"2024-01-20T08:12:08.045067+0000","last_became_active":"2024-01-20T08:12:07.088233+0000","last_became_peered":"2024-01-20T08:12:07.088233+0000","last_unstale":"2024-01-20T08:12:08.045067+0000","last_undegraded":"2024-01-20T08:12:08.045067+0000","last_fullsized":"2024-01-20T08:12:08.045067+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:39:05.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.063539+0000","last_change":"2024-01-20T08:12:06.069603+0000","last_active":"2024-01-20T08:12:07.063539+0000","last_peered":"2024-01-20T08:12:07.063539+0000","last_clean":"2024-01-20T08:12:07.063539+0000","last_became_active":"2024-01-20T08:12:06.069220+0000","last_became_peered":"2024-01-20T08:12:06.069220+0000","last_unstale":"2024-01-20T08:12:07.063539+0000","last_undegraded":"2024-01-20T08:12:07.063539+0000","last_fullsized":"2024-01-20T08:12:07.063539+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044828+0000","last_change":"2024-01-20T08:12:07.066751+0000","last_active":"2024-01-20T08:12:08.044828+0000","last_peered":"2024-01-20T08:12:08.044828+0000","last_clean":"2024-01-20T08:12:08.044828+0000","last_became_active":"2024-01-20T08:12:07.063086+0000","last_became_peered":"2024-01-20T08:12:07.063086+0000","last_unstale":"2024-01-20T08:12:08.044828+0000","last_undegraded":"2024-01-20T08:12:08.044828+0000","last_fullsized":"2024-01-20T08:12:08.044828+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:18:45.087923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043166+0000","last_change":"2024-01-20T08:12:06.066906+0000","last_active":"2024-01-20T08:12:07.043166+0000","last_peered":"2024-01-20T08:12:07.043166+0000","last_clean":"2024-01-20T08:12:07.043166+0000","last_became_active":"2024-01-20T08:12:06.066598+0000","last_became_peered":"2024-01-20T08:12:06.066598+0000","last_unstale":"2024-01-20T08:12:07.043166+0000","last_undegraded":"2024-01-20T08:12:07.043166+0000","last_fullsized":"2024-01-20T08:12:07.043166+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046873+0000","last_change":"2024-01-20T08:12:07.088972+0000","last_active":"2024-01-20T08:12:08.046873+0000","last_peered":"2024-01-20T08:12:08.046873+0000","last_clean":"2024-01-20T08:12:08.046873+0000","last_became_active":"2024-01-20T08:12:07.088534+0000","last_became_peered":"2024-01-20T08:12:07.088534+0000","last_unstale":"2024-01-20T08:12:08.046873+0000","last_undegraded":"2024-01-20T08:12:08.046873+0000","last_fullsized":"2024-01-20T08:12:08.046873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.047019+0000","last_change":"2024-01-20T08:12:06.061867+0000","last_active":"2024-01-20T08:12:07.047019+0000","last_peered":"2024-01-20T08:12:07.047019+0000","last_clean":"2024-01-20T08:12:07.047019+0000","last_became_active":"2024-01-20T08:12:06.061474+0000","last_became_peered":"2024-01-20T08:12:06.061474+0000","last_unstale":"2024-01-20T08:12:07.047019+0000","last_undegraded":"2024-01-20T08:12:07.047019+0000","last_fullsized":"2024-01-20T08:12:07.047019+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:28.133216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315413+0000","last_change":"2024-01-20T08:12:07.075925+0000","last_active":"2024-01-20T08:12:08.315413+0000","last_peered":"2024-01-20T08:12:08.315413+0000","last_clean":"2024-01-20T08:12:08.315413+0000","last_became_active":"2024-01-20T08:12:07.075681+0000","last_became_peered":"2024-01-20T08:12:07.075681+0000","last_unstale":"2024-01-20T08:12:08.315413+0000","last_undegraded":"2024-01-20T08:12:08.315413+0000","last_fullsized":"2024-01-20T08:12:08.315413+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:38.900889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.043202+0000","last_change":"2024-01-20T08:12:06.056764+0000","last_active":"2024-01-20T08:12:07.043202+0000","last_peered":"2024-01-20T08:12:07.043202+0000","last_clean":"2024-01-20T08:12:07.043202+0000","last_became_active":"2024-01-20T08:12:06.056438+0000","last_became_peered":"2024-01-20T08:12:06.056438+0000","last_unstale":"2024-01-20T08:12:07.043202+0000","last_undegraded":"2024-01-20T08:12:07.043202+0000","last_fullsized":"2024-01-20T08:12:07.043202+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045482+0000","last_change":"2024-01-20T08:12:07.075968+0000","last_active":"2024-01-20T08:12:08.045482+0000","last_peered":"2024-01-20T08:12:08.045482+0000","last_clean":"2024-01-20T08:12:08.045482+0000","last_became_active":"2024-01-20T08:12:07.071647+0000","last_became_peered":"2024-01-20T08:12:07.071647+0000","last_unstale":"2024-01-20T08:12:08.045482+0000","last_undegraded":"2024-01-20T08:12:08.045482+0000","last_fullsized":"2024-01-20T08:12:08.045482+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:52:22.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.045892+0000","last_change":"2024-01-20T08:12:06.060007+0000","last_active":"2024-01-20T08:12:07.045892+0000","last_peered":"2024-01-20T08:12:07.045892+0000","last_clean":"2024-01-20T08:12:07.045892+0000","last_became_active":"2024-01-20T08:12:06.059513+0000","last_became_peered":"2024-01-20T08:12:06.059513+0000","last_unstale":"2024-01-20T08:12:07.045892+0000","last_undegraded":"2024-01-20T08:12:07.045892+0000","last_fullsized":"2024-01-20T08:12:07.045892+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:20.449358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":11,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044818+0000","last_change":"2024-01-20T08:12:07.073628+0000","last_active":"2024-01-20T08:12:08.044818+0000","last_peered":"2024-01-20T08:12:08.044818+0000","last_clean":"2024-01-20T08:12:08.044818+0000","last_became_active":"2024-01-20T08:12:07.073348+0000","last_became_peered":"2024-01-20T08:12:07.073348+0000","last_unstale":"2024-01-20T08:12:08.044818+0000","last_undegraded":"2024-01-20T08:12:08.044818+0000","last_fullsized":"2024-01-20T08:12:08.044818+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:59:53.783140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065626+0000","last_change":"2024-01-20T08:12:06.067638+0000","last_active":"2024-01-20T08:12:07.065626+0000","last_peered":"2024-01-20T08:12:07.065626+0000","last_clean":"2024-01-20T08:12:07.065626+0000","last_became_active":"2024-01-20T08:12:06.067251+0000","last_became_peered":"2024-01-20T08:12:06.067251+0000","last_unstale":"2024-01-20T08:12:07.065626+0000","last_undegraded":"2024-01-20T08:12:07.065626+0000","last_fullsized":"2024-01-20T08:12:07.065626+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":192,"reported_epoch":51,"state":"active+clean","last_fresh":"2024-01-20T08:12:07.065209+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:07.065209+0000","last_peered":"2024-01-20T08:12:07.065209+0000","last_clean":"2024-01-20T08:12:07.065209+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:07.065209+0000","last_undegraded":"2024-01-20T08:12:07.065209+0000","last_fullsized":"2024-01-20T08:12:07.065209+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1196,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1224704,"data_stored":852654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":1.1739999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.3089999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.89000000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.514},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.478}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.2709999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4159999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.5349999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.554},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":1.3440000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.4550000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.6699999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31788,"kb_used_data":608,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340052,"statfs":{"total":96636764160,"available":96604213248,"internally_reserved":0,"allocated":622592,"data_stored":262126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4359999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9119999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5449999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6100000000000001,"5min":2.008,"15min":2.008},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1659999999999999,"15min":1.1699999999999999},"min":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8129999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.244},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3080000000000001,"15min":1.333},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.0629999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4239999999999999,"15min":1.444},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0720000000000001,"5min":2.222,"15min":2.222},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.4379999999999999,"15min":1.464},"min":{"1min":0.82199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5980000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.139}]},{"osd":4,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.5529999999999999,"15min":1.599},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.825,"5min":2.915,"15min":2.915},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.659,"15min":1.6890000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2189999999999999,"5min":2.718,"15min":2.718},"last":0.88100000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5580000000000001,"15min":1.579},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.74,"15min":1.794},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2809999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.734,"15min":1.758},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3500000000000001,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.448},{"interface":"front","average":{"1min":1.536,"5min":1.746,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0209999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.492}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31796,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340044,"statfs":{"total":96636764160,"available":96604205056,"internally_reserved":0,"allocated":630784,"data_stored":262778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.4910000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.88200000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.589}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.343},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.2749999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.194}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.071},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.2330000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.429}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.464}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":263738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":1.1859999999999999},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.252},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.0800000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.92000000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.3340000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":1.29}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.4179999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.5980000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":1.391},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.524}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.871},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.5549999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27644,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344196,"statfs":{"total":96636764160,"available":96608456704,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.60899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.6399999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.1459999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.0149999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.774}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.9239999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":2.0699999999999998},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.46}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.7010000000000001},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.974}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27636,"kb_used_data":616,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344204,"statfs":{"total":96636764160,"available":96608464896,"internally_reserved":0,"allocated":630784,"data_stored":262182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":1.161}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.373}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.296}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.524},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.5049999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.4199999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.5580000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.232}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.6040000000000001},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.335}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":262216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.93899999999999995},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":1.7410000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.181},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":1.3720000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.885},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.276}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.8200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.609},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.6879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.9510000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.913}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":2},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.778}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1232896,"data_stored":854688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.4019999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1859999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.76100000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85799999999999998,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.256,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":1.0069999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.131,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.492,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.177}]},{"osd":4,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.107,"15min":1.091},"min":{"1min":0.67000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.286},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1160000000000001,"15min":1.115},"min":{"1min":0.85299999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.502,"5min":1.589,"15min":1.589},"last":1.1140000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.74299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.5700000000000001,"5min":1.865,"15min":1.865},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.244,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.02,"5min":2.427,"15min":2.427},"last":1.3959999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.86799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1150000000000002,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.236,"5min":1.276,"15min":1.282},"min":{"1min":0.81000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.772,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3240000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.371,"15min":1.3819999999999999},"min":{"1min":0.88300000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7889999999999999,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.635},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.853,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.7030000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:16.889 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:12:16.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-20T08:12:17.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.138+0000 7f1952c00640 1 Processor -- start 2024-01-20T08:12:17.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.139+0000 7f1952c00640 1 -- start start 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.140+0000 7f1952c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f194c155cc0 0x7f194c0aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.140+0000 7f1952c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f194c0aaba0 0x7f194c0aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.140+0000 7f1952c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c1535a0 con 0x7f194c14fce0 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.140+0000 7f1952c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c1526d0 con 0x7f194c155cc0 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.140+0000 7f1952c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c0c0bb0 con 0x7f194c0aaba0 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f194c155cc0 0x7f194c0aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f194c155cc0 0x7f194c0aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47682/0 (socket says 172.21.15.100:47682) 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 -- 172.21.15.100:0/131524961 learned_addr learned my addr 172.21.15.100:0/131524961 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1950c00640 1 --2- 172.21.15.100:0/131524961 >> v2:172.21.15.110:3300/0 conn(0x7f194c0aaba0 0x7f194c0aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 -- 172.21.15.100:0/131524961 >> v2:172.21.15.110:3300/0 conn(0x7f194c0aaba0 msgr2=0x7f194c0aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 --2- 172.21.15.100:0/131524961 >> v2:172.21.15.110:3300/0 conn(0x7f194c0aaba0 0x7f194c0aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 -- 172.21.15.100:0/131524961 >> v1:172.21.15.110:6789/0 conn(0x7f194c14fce0 legacy=0x7f194c0a84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:17.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.141+0000 7f1943e00640 1 -- 172.21.15.100:0/131524961 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c152990 con 0x7f194c155cc0 2024-01-20T08:12:17.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.142+0000 7f1943e00640 1 --2- 172.21.15.100:0/131524961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c155cc0 0x7f194c0aa660 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f194c06b930 tx=0x7f193402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3813c99355df7bf5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.142+0000 7f194b400640 1 -- 172.21.15.100:0/131524961 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340317e0 con 0x7f194c155cc0 2024-01-20T08:12:17.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f194b400640 1 -- 172.21.15.100:0/131524961 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1934031940 con 0x7f194c155cc0 2024-01-20T08:12:17.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f194b400640 1 -- 172.21.15.100:0/131524961 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1934031cd0 con 0x7f194c155cc0 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 -- 172.21.15.100:0/131524961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c155cc0 msgr2=0x7f194c0aa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 --2- 172.21.15.100:0/131524961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c155cc0 0x7f194c0aa660 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f194c06b930 tx=0x7f193402b880 comp rx=0 tx=0).stop 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 -- 172.21.15.100:0/131524961 shutdown_connections 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 --2- 172.21.15.100:0/131524961 >> v2:172.21.15.110:3300/0 conn(0x7f194c0aaba0 0x7f194c0aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 --2- 172.21.15.100:0/131524961 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c155cc0 0x7f194c0aa660 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 -- 172.21.15.100:0/131524961 >> 172.21.15.100:0/131524961 conn(0x7f194c06a5e0 msgr2=0x7f194c06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:17.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.143+0000 7f1952c00640 1 -- 172.21.15.100:0/131524961 shutdown_connections 2024-01-20T08:12:17.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.144+0000 7f1952c00640 1 -- 172.21.15.100:0/131524961 wait complete. 2024-01-20T08:12:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.145+0000 7f1952c00640 1 Processor -- start 2024-01-20T08:12:17.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.145+0000 7f1952c00640 1 -- start start 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194c14fce0 0x7f194c1ea170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194c155cc0 0x7f194c1ea6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c070170 con 0x7f194c0aaba0 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14bf70 con 0x7f194c155cc0 2024-01-20T08:12:17.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f1952c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14b130 con 0x7f194c14fce0 2024-01-20T08:12:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f194be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f194be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47692/0 (socket says 172.21.15.100:47692) 2024-01-20T08:12:17.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.146+0000 7f194be00640 1 -- 172.21.15.100:0/2194478188 learned_addr learned my addr 172.21.15.100:0/2194478188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 -- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194c14fce0 msgr2=0x7f194c1ea170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194c14fce0 0x7f194c1ea170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 -- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194c155cc0 msgr2=0x7f194c1ea6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f1950c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194c155cc0 0x7f194c1ea6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194c155cc0 0x7f194c1ea6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 -- 172.21.15.100:0/2194478188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19340094d0 con 0x7f194c0aaba0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f194be00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c430 tx=0x7f193c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011790 con 0x7f194c0aaba0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193c0118f0 con 0x7f194c0aaba0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193c011ce0 con 0x7f194c0aaba0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.147+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c14b3f0 con 0x7f194c0aaba0 2024-01-20T08:12:17.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.148+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c14b9b0 con 0x7f194c0aaba0 2024-01-20T08:12:17.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.149+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c067640 con 0x7f194c0aaba0 2024-01-20T08:12:17.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.150+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f193c01c460 con 0x7f194c0aaba0 2024-01-20T08:12:17.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.150+0000 7f1948c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 0x7f192406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.150+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f193c089630 con 0x7f194c0aaba0 2024-01-20T08:12:17.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.151+0000 7f1943e00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 0x7f192406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.151+0000 7f1943e00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 0x7f192406d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1934036000 tx=0x7f1934030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.155+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f193c0544f0 con 0x7f194c0aaba0 2024-01-20T08:12:17.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.419+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f194c0c0990 con 0x7f194c0aaba0 2024-01-20T08:12:17.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.424+0000 7f1948c00640 1 -- 172.21.15.100:0/2194478188 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+147 (secure 0 0 0) 0x7f193c057b10 con 0x7f194c0aaba0 2024-01-20T08:12:17.427 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-01-20T08:12:17.427 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA== 2024-01-20T08:12:17.428 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:12:17.428 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:12:17.428 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T08:12:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 msgr2=0x7f192406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 0x7f192406d390 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1934036000 tx=0x7f1934030000 comp rx=0 tx=0).stop 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 msgr2=0x7f194c0bf630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f193c00c430 tx=0x7f193c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 shutdown_connections 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f194c155cc0 0x7f194c1ea6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192406aed0 0x7f192406d390 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f194c14fce0 0x7f194c1ea170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 --2- 172.21.15.100:0/2194478188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f194c0aaba0 0x7f194c0bf630 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 >> 172.21.15.100:0/2194478188 conn(0x7f194c06a5e0 msgr2=0x7f194c14d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 shutdown_connections 2024-01-20T08:12:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.427+0000 7f1952c00640 1 -- 172.21.15.100:0/2194478188 wait complete. 2024-01-20T08:12:17.448 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.646+0000 7fb26ae00640 1 Processor -- start 2024-01-20T08:12:17.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.647+0000 7fb26ae00640 1 -- start start 2024-01-20T08:12:17.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb26ae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb264153b80 0x7fb2640ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb26ae00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2640a9940 con 0x7fb26414fce0 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb26ae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2641500c0 con 0x7fb2640a93c0 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb26ae00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb264156810 con 0x7fb264153b80 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb263e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb26414fce0 0x7fb264152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35710/0 (socket says 172.21.15.100:35710) 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb263e00640 1 -- 172.21.15.100:0/3297046797 learned_addr learned my addr 172.21.15.100:0/3297046797 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.648+0000 7fb268e00640 1 --2- 172.21.15.100:0/3297046797 >> v2:172.21.15.100:3300/0 conn(0x7fb264153b80 0x7fb2640ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.649+0000 7fb262a00640 1 -- 172.21.15.100:0/3297046797 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550214946 0 0) 0x7fb2640a9940 con 0x7fb26414fce0 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.649+0000 7fb262a00640 1 -- 172.21.15.100:0/3297046797 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb244003520 con 0x7fb26414fce0 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.649+0000 7fb268e00640 1 -- 172.21.15.100:0/3297046797 >> v1:172.21.15.110:6789/0 conn(0x7fb2640a93c0 legacy=0x7fb2640aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.649+0000 7fb268e00640 1 -- 172.21.15.100:0/3297046797 >> v1:172.21.15.100:6789/0 conn(0x7fb26414fce0 legacy=0x7fb264152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.649+0000 7fb268e00640 1 -- 172.21.15.100:0/3297046797 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb264156af0 con 0x7fb264153b80 2024-01-20T08:12:17.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.650+0000 7fb268e00640 1 --2- 172.21.15.100:0/3297046797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb2640ab510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e4da5c33e45b838 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.650+0000 7fb262a00640 1 -- 172.21.15.100:0/3297046797 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c02cc60 con 0x7fb264153b80 2024-01-20T08:12:17.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.650+0000 7fb262a00640 1 -- 172.21.15.100:0/3297046797 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c02cdc0 con 0x7fb264153b80 2024-01-20T08:12:17.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.650+0000 7fb262a00640 1 -- 172.21.15.100:0/3297046797 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c034660 con 0x7fb264153b80 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 -- 172.21.15.100:0/3297046797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 msgr2=0x7fb2640ab510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 --2- 172.21.15.100:0/3297046797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb2640ab510 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c02beb0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 -- 172.21.15.100:0/3297046797 shutdown_connections 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 --2- 172.21.15.100:0/3297046797 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb2640ab510 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 -- 172.21.15.100:0/3297046797 >> 172.21.15.100:0/3297046797 conn(0x7fb26406a5e0 msgr2=0x7fb26406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 -- 172.21.15.100:0/3297046797 shutdown_connections 2024-01-20T08:12:17.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.651+0000 7fb26ae00640 1 -- 172.21.15.100:0/3297046797 wait complete. 2024-01-20T08:12:17.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.653+0000 7fb26ae00640 1 Processor -- start 2024-01-20T08:12:17.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.653+0000 7fb26ae00640 1 -- start start 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2640a93c0 0x7fb2641e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26414fce0 0x7fb2640c57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640c3110 con 0x7fb264153b80 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640c2c80 con 0x7fb2640a93c0 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb26ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2640c2610 con 0x7fb26414fce0 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.654+0000 7fb268e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47718/0 (socket says 172.21.15.100:47718) 2024-01-20T08:12:17.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 -- 172.21.15.100:0/2206815978 learned_addr learned my addr 172.21.15.100:0/2206815978 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb263400640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26414fce0 0x7fb2640c57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb263e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2640a93c0 0x7fb2641e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 -- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26414fce0 msgr2=0x7fb2640c57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26414fce0 0x7fb2640c57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 -- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2640a93c0 msgr2=0x7fb2641e0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2640a93c0 0x7fb2641e0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 -- 172.21.15.100:0/2206815978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb25c009a70 con 0x7fb264153b80 2024-01-20T08:12:17.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.655+0000 7fb268e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.656+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c040650 con 0x7fb264153b80 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.656+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c0407b0 con 0x7fb264153b80 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.656+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2641eeb00 con 0x7fb264153b80 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.656+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c040b60 con 0x7fb264153b80 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.656+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2640c11b0 con 0x7fb264153b80 2024-01-20T08:12:17.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.657+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26404e970 con 0x7fb264153b80 2024-01-20T08:12:17.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.658+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb25c040cc0 con 0x7fb264153b80 2024-01-20T08:12:17.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.659+0000 7fb25be00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 0x7fb23c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:17.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.659+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb25c0ac3e0 con 0x7fb264153b80 2024-01-20T08:12:17.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.659+0000 7fb263e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 0x7fb23c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:17.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.660+0000 7fb263e00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 0x7fb23c06d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb26414ced0 tx=0x7fb24c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:17.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.663+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb25c077360 con 0x7fb264153b80 2024-01-20T08:12:17.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.874+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb2640c2dc0 con 0x7fb264153b80 2024-01-20T08:12:17.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.875+0000 7fb25be00640 1 -- 172.21.15.100:0/2206815978 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4947 (secure 0 0 0) 0x7fb25c009450 con 0x7fb264153b80 2024-01-20T08:12:17.878 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:17.878 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":32,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27},{"gid":5676,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-01-20T08:12:17.879 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 32 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 msgr2=0x7fb23c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 0x7fb23c06d390 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fb26414ced0 tx=0x7fb24c009040 comp rx=0 tx=0).stop 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 msgr2=0x7fb264148d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb25c009d90 tx=0x7fb25c004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 shutdown_connections 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb264153b80 0x7fb264148d30 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb23c06aed0 0x7fb23c06d390 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb26414fce0 0x7fb2640c57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 --2- 172.21.15.100:0/2206815978 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb2640a93c0 0x7fb2641e0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:17.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 >> 172.21.15.100:0/2206815978 conn(0x7fb26406a5e0 msgr2=0x7fb264152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:17.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 shutdown_connections 2024-01-20T08:12:17.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:17.878+0000 7fb26ae00640 1 -- 172.21.15.100:0/2206815978 wait complete. 2024-01-20T08:12:18.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T08:12:06.508402+0000', 'modified': '2024-01-20T08:12:09.558331+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5679}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5679': {'gid': 5679, 'name': 'b', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.110:6835/1123618406', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.110:6833', 'nonce': 1123618406}, {'type': 'v1', 'addr': '172.21.15.110:6835', 'nonce': 1123618406}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T08:12:18.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T08:12:18.301 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-01-20T08:12:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.517+0000 7f776ac00640 1 Processor -- start 2024-01-20T08:12:18.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.517+0000 7f776ac00640 1 -- start start 2024-01-20T08:12:18.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.518+0000 7f776ac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77640c0ed0 0x7f7764155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.518+0000 7f776ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f776406d750 con 0x7f776406cbb0 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.518+0000 7f776ac00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77641559b0 con 0x7f77640c4e20 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.518+0000 7f776ac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77640c1930 con 0x7f77640c0ed0 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f7768e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f77640c0ed0 0x7f7764155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f776a200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f776406cbb0 0x7f776406d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35714/0 (socket says 172.21.15.100:35714) 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f776a200640 1 -- 172.21.15.100:0/496678045 learned_addr learned my addr 172.21.15.100:0/496678045 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:18.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f7768e00640 1 -- 172.21.15.100:0/496678045 >> v1:172.21.15.110:6789/0 conn(0x7f77640c4e20 legacy=0x7f77640aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f7768e00640 1 -- 172.21.15.100:0/496678045 >> v1:172.21.15.100:6789/0 conn(0x7f776406cbb0 legacy=0x7f776406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.519+0000 7f7768e00640 1 -- 172.21.15.100:0/496678045 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776406c160 con 0x7f77640c0ed0 2024-01-20T08:12:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.520+0000 7f7768e00640 1 --2- 172.21.15.100:0/496678045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77640c0ed0 0x7f7764155470 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f774c0097a0 tx=0x7f774c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1945aca8757e7dc8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.520+0000 7f7763e00640 1 -- 172.21.15.100:0/496678045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c031830 con 0x7f77640c0ed0 2024-01-20T08:12:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f7763e00640 1 -- 172.21.15.100:0/496678045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c031990 con 0x7f77640c0ed0 2024-01-20T08:12:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f7763e00640 1 -- 172.21.15.100:0/496678045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c031d20 con 0x7f77640c0ed0 2024-01-20T08:12:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 -- 172.21.15.100:0/496678045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77640c0ed0 msgr2=0x7f7764155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 --2- 172.21.15.100:0/496678045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77640c0ed0 0x7f7764155470 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f774c0097a0 tx=0x7f774c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 -- 172.21.15.100:0/496678045 shutdown_connections 2024-01-20T08:12:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 --2- 172.21.15.100:0/496678045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f77640c0ed0 0x7f7764155470 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 -- 172.21.15.100:0/496678045 >> 172.21.15.100:0/496678045 conn(0x7f77640c5ba0 msgr2=0x7f77640c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 -- 172.21.15.100:0/496678045 shutdown_connections 2024-01-20T08:12:18.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.521+0000 7f776ac00640 1 -- 172.21.15.100:0/496678045 wait complete. 2024-01-20T08:12:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.523+0000 7f776ac00640 1 Processor -- start 2024-01-20T08:12:18.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.523+0000 7f776ac00640 1 -- start start 2024-01-20T08:12:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.528 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77640c0ed0 0x7f7764153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77640c4e20 0x7f7764153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77641eab70 con 0x7f776406cbb0 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77641eae30 con 0x7f77640c4e20 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f776ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77641eb110 con 0x7f77640c0ed0 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f7769800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f7769800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47734/0 (socket says 172.21.15.100:47734) 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.524+0000 7f7769800640 1 -- 172.21.15.100:0/1472727707 learned_addr learned my addr 172.21.15.100:0/1472727707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 -- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77640c0ed0 msgr2=0x7f7764153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77640c0ed0 0x7f7764153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 -- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77640c4e20 msgr2=0x7f7764153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77640c4e20 0x7f7764153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 -- 172.21.15.100:0/1472727707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f774c009400 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7769800640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f775400b3f0 tx=0x7f775400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7761600640 1 -- 172.21.15.100:0/1472727707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011830 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7761600640 1 -- 172.21.15.100:0/1472727707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754011990 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f7761600640 1 -- 172.21.15.100:0/1472727707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011d40 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.525+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77641eb3f0 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.526+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77641eb9b0 con 0x7f776406cbb0 2024-01-20T08:12:18.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.528+0000 7f7761600640 1 -- 172.21.15.100:0/1472727707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f775401a400 con 0x7f776406cbb0 2024-01-20T08:12:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.529+0000 7f7761600640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 0x7f773c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.529+0000 7f7761600640 1 -- 172.21.15.100:0/1472727707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7754089460 con 0x7f776406cbb0 2024-01-20T08:12:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.529+0000 7f7768e00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 0x7f773c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.529+0000 7f776efb3740 1 Processor -- start 2024-01-20T08:12:18.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.529+0000 7f776efb3740 1 -- start start 2024-01-20T08:12:18.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f7768e00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 0x7f773c06d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28af40 0x560d3d28b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d1f7d80 con 0x560d3d2c75d0 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d1f5470 con 0x560d3d28af40 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.530+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d3d1f0d60 con 0x560d3d28c250 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47744/0 (socket says 172.21.15.100:47744) 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 -- 172.21.15.100:0/2057357261 learned_addr learned my addr 172.21.15.100:0/2057357261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f7768e00640 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 -- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 msgr2=0x560d3d2c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2c7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 -- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28af40 msgr2=0x560d3d28b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28af40 0x560d3d28b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 -- 172.21.15.100:0/2057357261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d3d1a6280 con 0x560d3d2c75d0 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.531+0000 7f776a200640 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f775c001fc0 tx=0x7f775c00c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6949c2912e18b72 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f775a000640 1 -- 172.21.15.100:0/2057357261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c0070d0 con 0x560d3d2c75d0 2024-01-20T08:12:18.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f775a000640 1 -- 172.21.15.100:0/2057357261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c007230 con 0x560d3d2c75d0 2024-01-20T08:12:18.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f775a000640 1 -- 172.21.15.100:0/2057357261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c0075a0 con 0x560d3d2c75d0 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 -- 172.21.15.100:0/2057357261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 msgr2=0x560d3d2c5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f775c001fc0 tx=0x7f775c00c4b0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 -- 172.21.15.100:0/2057357261 shutdown_connections 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2c5640 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 --2- 172.21.15.100:0/2057357261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28af40 0x560d3d28b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 -- 172.21.15.100:0/2057357261 >> 172.21.15.100:0/2057357261 conn(0x560d3d287b20 msgr2=0x560d3d2ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 -- 172.21.15.100:0/2057357261 shutdown_connections 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.532+0000 7f776efb3740 1 -- 172.21.15.100:0/2057357261 wait complete. 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.533+0000 7f776efb3740 1 -- start start 2024-01-20T08:12:18.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.533+0000 7f776efb3740 1 Processor -- start 2024-01-20T08:12:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28c250 0x560d3d2cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d2c40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d18c740 con 0x560d3d2c75d0 2024-01-20T08:12:18.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d1aa0c0 con 0x560d3d28c250 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.534+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d3cf52f20 con 0x560d3d2ab5b0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f776efb3740 10 client.0 _ll_register_callbacks cb 0x560d3d1e7200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47758/0 (socket says 172.21.15.100:47758) 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 -- 172.21.15.100:0/3772135616 learned_addr learned my addr 172.21.15.100:0/3772135616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 -- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 msgr2=0x560d3d2c40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d2c40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 -- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28c250 msgr2=0x560d3d2cbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28c250 0x560d3d2cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 -- 172.21.15.100:0/3772135616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f776406d750 con 0x560d3d2c75d0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7768e00640 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f774c02bee0 tx=0x7f774c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5088494d04e8f076 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.535+0000 7f7752a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774c03bdc0 con 0x560d3d2c75d0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f774c051ae0 con 0x560d3d2c75d0 2024-01-20T08:12:18.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d3d1e9bf0 con 0x560d3d2c75d0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f774c051ca0 con 0x560d3d2c75d0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 10 client.5841 fetch_fsmap learned FSMap version 32 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x560d3d1ef3e0 con 0x560d3d2c75d0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d3d1e9bf0 con 0x560d3d2c75d0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f774c051020 con 0x560d3d2c75d0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 10 client.5841 fetch_fsmap finished waiting for FSMap version 32 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 10 client.5841 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.536+0000 7f776efb3740 20 client.5841 populate_metadata read hostname 'smithi100' 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.537+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d298ad0 0x560d3d298eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.537+0000 7f776efb3740 4 client.5841 mds_command: new command op to 5679 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.537+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 --> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d3d1e9910 con 0x560d3d298ad0 2024-01-20T08:12:18.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.537+0000 7f7769800640 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d298ad0 0x560d3d298eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.538+0000 7f7769800640 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d298ad0 0x560d3d298eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e704e2c8c779e68f server_cookie=3e2ece5aed20fa63 in_seq=0 out_seq=0 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.538+0000 7f7752a00640 10 client.5841 ms_handle_connect on v2:172.21.15.110:6833/1123618406 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.540+0000 7f7752a00640 1 -- 172.21.15.100:0/3772135616 <== mds.0 v2:172.21.15.110:6833/1123618406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560d3d1e9910 con 0x560d3d298ad0 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.540+0000 7f7752a00640 10 client.5841 handle_command_reply: tid=0 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.540+0000 7f776efb3740 1 client.5841 shutdown 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 msgr2=0x560d3d2ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f774c02bee0 tx=0x7f774c004730 comp rx=0 tx=0).stop 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 shutdown_connections 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d298ad0 0x560d3d298eb0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d2c40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2ab070 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 --2- 172.21.15.100:0/3772135616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d28c250 0x560d3d2cbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f7752a00640 0 client.5841 ms_handle_reset on v2:172.21.15.110:6833/1123618406 2024-01-20T08:12:18.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 >> 172.21.15.100:0/3772135616 conn(0x560d3d28af40 msgr2=0x560d3d2c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 shutdown_connections 2024-01-20T08:12:18.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 1 -- 172.21.15.100:0/3772135616 wait complete. 2024-01-20T08:12:18.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.541+0000 7f776efb3740 20 client.5841 trim_cache size 0 max 16384 2024-01-20T08:12:18.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.558+0000 7f776efb3740 1 Processor -- start 2024-01-20T08:12:18.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.558+0000 7f776efb3740 1 -- start start 2024-01-20T08:12:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2ac430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2ab5b0 0x560d3d2c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d2c4ba0 con 0x560d3d2c75d0 2024-01-20T08:12:18.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d2c6370 con 0x560d3d2ab5b0 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d3d2cb500 con 0x560d3d28c250 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47760/0 (socket says 172.21.15.100:47760) 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 -- 172.21.15.100:0/3105685615 learned_addr learned my addr 172.21.15.100:0/3105685615 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 -- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 msgr2=0x560d3d2ac430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2ac430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 -- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2ab5b0 msgr2=0x560d3d2c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2ab5b0 0x560d3d2c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.559+0000 7f776a200640 1 -- 172.21.15.100:0/3105685615 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d3d18bfd0 con 0x560d3d2c75d0 2024-01-20T08:12:18.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776a200640 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f775c015040 tx=0x7f775c009050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbc2632cfef423ea server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f7759600640 1 -- 172.21.15.100:0/3105685615 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c001a20 con 0x560d3d2c75d0 2024-01-20T08:12:18.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f7759600640 1 -- 172.21.15.100:0/3105685615 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c0073a0 con 0x560d3d2c75d0 2024-01-20T08:12:18.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f7759600640 1 -- 172.21.15.100:0/3105685615 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775c007750 con 0x560d3d2c75d0 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776efb3740 1 -- 172.21.15.100:0/3105685615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 msgr2=0x560d3d2857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776efb3740 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f775c015040 tx=0x7f775c009050 comp rx=0 tx=0).stop 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776efb3740 1 -- 172.21.15.100:0/3105685615 shutdown_connections 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776efb3740 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d2c75d0 0x560d3d2857b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.560+0000 7f776efb3740 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2ab5b0 0x560d3d2c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 --2- 172.21.15.100:0/3105685615 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d28c250 0x560d3d2ac430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 -- 172.21.15.100:0/3105685615 >> 172.21.15.100:0/3105685615 conn(0x560d3d28af40 msgr2=0x560d3d2aae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 -- 172.21.15.100:0/3105685615 shutdown_connections 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 -- 172.21.15.100:0/3105685615 wait complete. 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 -- start start 2024-01-20T08:12:18.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.561+0000 7f776efb3740 1 Processor -- start 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d285bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2c75d0 0x560d3d337eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d2d4950 con 0x560d3d28c250 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d3d281780 con 0x560d3d2c75d0 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d3d33bc40 con 0x560d3d2ab5b0 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.562+0000 7f776efb3740 10 client.0 _ll_register_callbacks cb 0x7f775c001940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47766/0 (socket says 172.21.15.100:47766) 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 -- 172.21.15.100:0/3250912646 learned_addr learned my addr 172.21.15.100:0/3250912646 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7768e00640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d285bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 -- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 msgr2=0x560d3d285bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d285bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f776a200640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2c75d0 0x560d3d337eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 -- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2c75d0 msgr2=0x560d3d337eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2c75d0 0x560d3d337eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 -- 172.21.15.100:0/3250912646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d3d1a6280 con 0x560d3d28c250 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7769800640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7754057ce0 tx=0x7f7754011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05e0d9e1c2b925d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.563+0000 7f7752a00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754056440 con 0x560d3d28c250 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77540546f0 con 0x560d3d28c250 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f775c007230 con 0x560d3d28c250 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f77540548b0 con 0x560d3d28c250 2024-01-20T08:12:18.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 10 client.5847 fetch_fsmap learned FSMap version 32 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x560d3d1b15c0 con 0x560d3d28c250 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775c007230 con 0x560d3d28c250 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 32) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f7754021020 con 0x560d3d28c250 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 10 client.5847 fetch_fsmap finished waiting for FSMap version 32 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 10 client.5847 resolve_mds: resolved name 'b' to daemon mds.b 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 20 client.5847 populate_metadata read hostname 'smithi100' 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d33e210 0x560d3d33e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 4 client.5847 mds_command: new command op to 5679 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.564+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 --> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d3cef06c0 con 0x560d3d33e210 2024-01-20T08:12:18.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.565+0000 7f7768e00640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d33e210 0x560d3d33e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.566+0000 7f7752a00640 10 client.5847 ms_handle_connect on v2:172.21.15.110:6833/1123618406 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.566+0000 7f7768e00640 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d33e210 0x560d3d33e5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97fc8f44ac542064 server_cookie=db13119d958a62e1 in_seq=0 out_seq=0 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.566+0000 7f7752a00640 1 -- 172.21.15.100:0/3250912646 <== mds.0 v2:172.21.15.110:6833/1123618406 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x560d3cef06c0 con 0x560d3d33e210 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.566+0000 7f7752a00640 10 client.5847 handle_command_reply: tid=0 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.566+0000 7f776efb3740 1 client.5847 shutdown 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 msgr2=0x560d3d33b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f7754057ce0 tx=0x7f7754011f50 comp rx=0 tx=0).stop 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 shutdown_connections 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:6833/1123618406,v1:172.21.15.110:6835/1123618406] conn(0x560d3d33e210 0x560d3d33e5f0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x560d3d2c75d0 0x560d3d337eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x560d3d2ab5b0 0x560d3d285bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f7752a00640 0 client.5847 ms_handle_reset on v2:172.21.15.110:6833/1123618406 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 --2- 172.21.15.100:0/3250912646 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x560d3d28c250 0x560d3d33b6d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 >> 172.21.15.100:0/3250912646 conn(0x560d3d28af40 msgr2=0x560d3d2c8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 shutdown_connections 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 1 -- 172.21.15.100:0/3250912646 wait complete. 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.567+0000 7f776efb3740 20 client.5847 trim_cache size 0 max 16384 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "10ce7bd0-b73e-4b66-b126-32ffded4722e", 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 5679, 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 11.497769072000001, 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 32, 2024-01-20T08:12:18.573 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 52, 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 52, 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 17.460723984000001 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 msgr2=0x7f773c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 0x7f773c06d390 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f774c036000 tx=0x7f774c030000 comp rx=0 tx=0).stop 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 msgr2=0x7f77641ddba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f775400b3f0 tx=0x7f775400b8b0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 shutdown_connections 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f77640c4e20 0x7f7764153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f773c06aed0 0x7f773c06d390 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f77640c0ed0 0x7f7764153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 --2- 172.21.15.100:0/1472727707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f776406cbb0 0x7f77641ddba0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 >> 172.21.15.100:0/1472727707 conn(0x7f77640c5ba0 msgr2=0x7f77640c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 shutdown_connections 2024-01-20T08:12:18.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.568+0000 7f776ac00640 1 -- 172.21.15.100:0/1472727707 wait complete. 2024-01-20T08:12:18.587 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:12:18.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.789+0000 7f27d3e00640 1 Processor -- start 2024-01-20T08:12:18.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.789+0000 7f27d3e00640 1 -- start start 2024-01-20T08:12:18.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.790+0000 7f27d3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27d40c4e20 0x7f27d4155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.790+0000 7f27d3e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f27d406cbb0 0x7f27d406d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.790+0000 7f27d3e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d41559b0 con 0x7f27d40c0ed0 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.790+0000 7f27d3e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d40c1930 con 0x7f27d40c4e20 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.790+0000 7f27d3e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d406c160 con 0x7f27d406cbb0 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27d40c4e20 0x7f27d4155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f27d40c4e20 0x7f27d4155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47772/0 (socket says 172.21.15.100:47772) 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f27d40c0ed0 0x7f27d40aa8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35728/0 (socket says 172.21.15.100:35728) 2024-01-20T08:12:18.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 -- 172.21.15.100:0/2366696809 learned_addr learned my addr 172.21.15.100:0/2366696809 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d3400640 1 --2- 172.21.15.100:0/2366696809 >> v2:172.21.15.110:3300/0 conn(0x7f27d406cbb0 0x7f27d406d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 -- 172.21.15.100:0/2366696809 >> v2:172.21.15.110:3300/0 conn(0x7f27d406cbb0 msgr2=0x7f27d406d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 --2- 172.21.15.100:0/2366696809 >> v2:172.21.15.110:3300/0 conn(0x7f27d406cbb0 0x7f27d406d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 -- 172.21.15.100:0/2366696809 >> v1:172.21.15.100:6789/0 conn(0x7f27d40c0ed0 legacy=0x7f27d40aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d2a00640 1 -- 172.21.15.100:0/2366696809 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d40c1b80 con 0x7f27d40c4e20 2024-01-20T08:12:18.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.791+0000 7f27d1600640 1 -- 172.21.15.100:0/2366696809 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12738716 0 0) 0x7f27bc001110 con 0x7f27d40c0ed0 2024-01-20T08:12:18.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.792+0000 7f27d2a00640 1 --2- 172.21.15.100:0/2366696809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4155470 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f27d40a9030 tx=0x7f27c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc4309ac795783c9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d1600640 1 -- 172.21.15.100:0/2366696809 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4030860 con 0x7f27d40c4e20 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d1600640 1 -- 172.21.15.100:0/2366696809 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40309c0 con 0x7f27d40c4e20 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d1600640 1 -- 172.21.15.100:0/2366696809 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4030d50 con 0x7f27d40c4e20 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 -- 172.21.15.100:0/2366696809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 msgr2=0x7f27d4155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 --2- 172.21.15.100:0/2366696809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4155470 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f27d40a9030 tx=0x7f27c402b9a0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 -- 172.21.15.100:0/2366696809 shutdown_connections 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 --2- 172.21.15.100:0/2366696809 >> v2:172.21.15.110:3300/0 conn(0x7f27d406cbb0 0x7f27d406d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 --2- 172.21.15.100:0/2366696809 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4155470 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.793+0000 7f27d3e00640 1 -- 172.21.15.100:0/2366696809 >> 172.21.15.100:0/2366696809 conn(0x7f27d40c5ba0 msgr2=0x7f27d40c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.794+0000 7f27d3e00640 1 -- 172.21.15.100:0/2366696809 shutdown_connections 2024-01-20T08:12:18.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.794+0000 7f27d3e00640 1 -- 172.21.15.100:0/2366696809 wait complete. 2024-01-20T08:12:18.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.795+0000 7f27d3e00640 1 Processor -- start 2024-01-20T08:12:18.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.795+0000 7f27d3e00640 1 -- start start 2024-01-20T08:12:18.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27d406cbb0 0x7f27d4151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27d40c0ed0 0x7f27d414ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d414cad0 con 0x7f27d40c4e20 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4151ec0 con 0x7f27d40c0ed0 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4149c90 con 0x7f27d406cbb0 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:47780/0 (socket says 172.21.15.100:47780) 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.796+0000 7f27d3400640 1 -- 172.21.15.100:0/695629022 learned_addr learned my addr 172.21.15.100:0/695629022 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d2000640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27d40c0ed0 0x7f27d414ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d2a00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27d406cbb0 0x7f27d4151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 -- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27d406cbb0 msgr2=0x7f27d4151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27d406cbb0 0x7f27d4151980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 -- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27d40c0ed0 msgr2=0x7f27d414ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27d40c0ed0 0x7f27d414ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 -- 172.21.15.100:0/695629022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c40094d0 con 0x7f27d40c4e20 2024-01-20T08:12:18.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.797+0000 7f27d3400640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f27cc007e40 tx=0x7f27cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.798+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc014620 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.798+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27cc00ee90 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.798+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0149e0 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.798+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d4149f70 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.798+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d414a530 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.799+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d414cc40 con 0x7f27d40c4e20 2024-01-20T08:12:18.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.800+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f27cc014b40 con 0x7f27d40c4e20 2024-01-20T08:12:18.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.801+0000 7f27caa00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:18.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.801+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f27cc08a060 con 0x7f27d40c4e20 2024-01-20T08:12:18.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.802+0000 7f27d2a00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:18.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.802+0000 7f27d2a00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 0x7f27ac06d390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27c4036000 tx=0x7f27c403b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:18.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:18.806+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f27cc0bd0d0 con 0x7f27d40c4e20 2024-01-20T08:12:19.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.038+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f27d404e970 con 0x7f27d40c4e20 2024-01-20T08:12:19.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.039+0000 7f27caa00640 1 -- 172.21.15.100:0/695629022 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f27cc054f20 con 0x7f27d40c4e20 2024-01-20T08:12:19.042 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.041+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 msgr2=0x7f27ac06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.041+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 0x7f27ac06d390 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f27c4036000 tx=0x7f27c403b040 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.041+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 msgr2=0x7f27d4148580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.041+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f27cc007e40 tx=0x7f27cc00e4b0 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 shutdown_connections 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27d40c4e20 0x7f27d4148580 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27d40c0ed0 0x7f27d414ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27ac06aed0 0x7f27ac06d390 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 --2- 172.21.15.100:0/695629022 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f27d406cbb0 0x7f27d4151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 >> 172.21.15.100:0/695629022 conn(0x7f27d40c5ba0 msgr2=0x7f27d415c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 shutdown_connections 2024-01-20T08:12:19.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:19.042+0000 7f27d3e00640 1 -- 172.21.15.100:0/695629022 wait complete. 2024-01-20T08:12:19.064 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:12:19.064 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:12:19.064 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:12:19.064 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T08:12:19.064 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:19.065 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:12:19.065 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:12:19.065 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:12:19.065 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:12:19.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.065 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:12:19.119 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:12:19.119 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:12:19.119 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:19.120 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42534sec preferred_lft 42534sec 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:12:19.121 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:19.122 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.122 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:12:19.203 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:12:19.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.207 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:12:19.260 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:12:19.260 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:12:19.260 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:12:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:12:19.261 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:12:19.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:12:19.262 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:12:19.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.436 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:12:19.485 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:12:19.486 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:12:19.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:12:19.576 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:19.576 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:19.628 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:19.629 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:19.682 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-20T08:12:19.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.682 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:19.817 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:19.817 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:19.852 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:19.852 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:19.852 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:12:19.852 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:12:19.852 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:12:19.855 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T08:12:19.855 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:12:19.855 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:12:19.856 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:12:19.856 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:12:19.859 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:12:19.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:19.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:19.942 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:12:20.019 INFO:teuthology.orchestra.run.smithi100.stdout:client5859 2024-01-20T08:12:20.020 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:20.020 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:20.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:12:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.319+0000 7f95b9600640 1 Processor -- start 2024-01-20T08:12:20.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.319+0000 7f95b9600640 1 -- start start 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95b4151e80 0x7f95b41588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 0x7f95b406c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b4158df0 con 0x7f95b4151e80 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b40c6c10 con 0x7f95b40c4fb0 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c6ef0 con 0x7f95b40c7ff0 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95b4151e80 0x7f95b41588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f95b4151e80 0x7f95b41588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50224/0 (socket says 172.21.15.100:50224) 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.321+0000 7f95b2a00640 1 -- 172.21.15.100:0/2358529867 learned_addr learned my addr 172.21.15.100:0/2358529867 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2000640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b3400640 1 --2- 172.21.15.100:0/2358529867 >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 0x7f95b406c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2a00640 1 -- 172.21.15.100:0/2358529867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 msgr2=0x7f95b40c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2a00640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b40c4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2a00640 1 -- 172.21.15.100:0/2358529867 >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 msgr2=0x7f95b406c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2a00640 1 --2- 172.21.15.100:0/2358529867 >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 0x7f95b406c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b2a00640 1 -- 172.21.15.100:0/2358529867 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b40c71d0 con 0x7f95b4151e80 2024-01-20T08:12:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.322+0000 7f95b3400640 1 --2- 172.21.15.100:0/2358529867 >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 0x7f95b406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.323+0000 7f95b2a00640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b4151e80 0x7f95b41588b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95b406ade0 tx=0x7f95a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae5090b11d572628 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.323+0000 7f95b1600640 1 -- 172.21.15.100:0/2358529867 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a40317e0 con 0x7f95b4151e80 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.323+0000 7f95b1600640 1 -- 172.21.15.100:0/2358529867 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4031940 con 0x7f95b4151e80 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.323+0000 7f95b1600640 1 -- 172.21.15.100:0/2358529867 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4031cd0 con 0x7f95b4151e80 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 -- 172.21.15.100:0/2358529867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b4151e80 msgr2=0x7f95b41588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b4151e80 0x7f95b41588b0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f95b406ade0 tx=0x7f95a402b880 comp rx=0 tx=0).stop 2024-01-20T08:12:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 -- 172.21.15.100:0/2358529867 shutdown_connections 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 --2- 172.21.15.100:0/2358529867 >> v2:172.21.15.110:3300/0 conn(0x7f95b40c4fb0 0x7f95b406c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b40c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 --2- 172.21.15.100:0/2358529867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b4151e80 0x7f95b41588b0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 -- 172.21.15.100:0/2358529867 >> 172.21.15.100:0/2358529867 conn(0x7f95b40abd20 msgr2=0x7f95b40ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 -- 172.21.15.100:0/2358529867 shutdown_connections 2024-01-20T08:12:20.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.324+0000 7f95b9600640 1 -- 172.21.15.100:0/2358529867 wait complete. 2024-01-20T08:12:20.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.326+0000 7f95b9600640 1 Processor -- start 2024-01-20T08:12:20.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.326+0000 7f95b9600640 1 -- start start 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b41edbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b4151e80 0x7f95b4156dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c3320 con 0x7f95b40c4fb0 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c2710 con 0x7f95b4151e80 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b40c29f0 con 0x7f95b40c7ff0 2024-01-20T08:12:20.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b2a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50238/0 (socket says 172.21.15.100:50238) 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.327+0000 7f95b2a00640 1 -- 172.21.15.100:0/1132823257 learned_addr learned my addr 172.21.15.100:0/1132823257 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2000640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b41edbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 -- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 msgr2=0x7f95b41edbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b41edbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 -- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b4151e80 msgr2=0x7f95b4156dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b4151e80 0x7f95b4156dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 -- 172.21.15.100:0/1132823257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a40094d0 con 0x7f95b40c4fb0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2000640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b41edbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b2a00640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032880 con 0x7f95b40c4fb0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a4032a20 con 0x7f95b40c4fb0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032dd0 con 0x7f95b40c4fb0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.328+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b40c2cd0 con 0x7f95b40c4fb0 2024-01-20T08:12:20.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.329+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b41ee0f0 con 0x7f95b40c4fb0 2024-01-20T08:12:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.330+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b40c2b30 con 0x7f95b40c4fb0 2024-01-20T08:12:20.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.331+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f95a404e450 con 0x7f95b40c4fb0 2024-01-20T08:12:20.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.331+0000 7f95aaa00640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 0x7f958c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:20.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.331+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f95a40ab790 con 0x7f95b40c4fb0 2024-01-20T08:12:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.332+0000 7f95b2000640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 0x7f958c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:20.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.332+0000 7f95b2000640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 0x7f958c06d390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f959c006fd0 tx=0x7f959c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:20.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.336+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f95b40c2b30 con 0x7f95b40c4fb0 2024-01-20T08:12:20.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.567+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f95b40c2b30 con 0x7f95b40c4fb0 2024-01-20T08:12:20.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.568+0000 7f95aaa00640 1 -- 172.21.15.100:0/1132823257 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f95b40c2b30 con 0x7f95b40c4fb0 2024-01-20T08:12:20.571 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:12:20.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.570+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 msgr2=0x7f958c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.570+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 0x7f958c06d390 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f959c006fd0 tx=0x7f959c008040 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.570+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 msgr2=0x7f95b40c37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.570+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a40046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 shutdown_connections 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f95b4151e80 0x7f95b4156dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f958c06aed0 0x7f958c06d390 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f95b40c7ff0 0x7f95b41edbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 --2- 172.21.15.100:0/1132823257 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f95b40c4fb0 0x7f95b40c37b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 >> 172.21.15.100:0/1132823257 conn(0x7f95b40abd20 msgr2=0x7f95b406cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 shutdown_connections 2024-01-20T08:12:20.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:20.571+0000 7f95b9600640 1 -- 172.21.15.100:0/1132823257 wait complete. 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:12:20.593 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:20.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:20.594 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:12:20.652 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:12:20.652 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:12:20.652 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:12:20.652 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.652 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42507sec preferred_lft 42507sec 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.653 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:12:20.654 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:20.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:20.655 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:12:20.742 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:12:20.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:20.747 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:12:20.796 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:12:20.797 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:12:20.797 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:12:20.797 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:12:20.797 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:12:20.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:12:20.797 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:12:20.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:20.977 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:12:21.028 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:12:21.029 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:21.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:21.029 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:12:21.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:21.120 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:21.171 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:21.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:21.171 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:21.225 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-20T08:12:21.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:21.225 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:21.356 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:21.356 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:21.395 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:21.395 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:21.395 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:12:21.395 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:12:21.395 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:12:21.398 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:12:21.398 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:12:21.398 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:12:21.398 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:12:21.398 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:12:21.402 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:12:21.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:21.402 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:21.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:21.480 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:12:21.530 INFO:teuthology.orchestra.run.smithi110.stdout:client5868 2024-01-20T08:12:21.530 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:21.530 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:21.574 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-20T08:12:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.788+0000 7f8f03e00640 1 Processor -- start 2024-01-20T08:12:21.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.788+0000 7f8f03e00640 1 -- start start 2024-01-20T08:12:21.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.789+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8efc15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.789+0000 7f8f03e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc154ba0 con 0x7f8efc1515b0 2024-01-20T08:12:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8f03e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8efc155a00 con 0x7f8efc14b720 2024-01-20T08:12:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8f03e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14bb00 con 0x7f8efc06cfe0 2024-01-20T08:12:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8f00a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f8efc1515b0 0x7f8efc06c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59458/0 (socket says 172.21.15.100:59458) 2024-01-20T08:12:21.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8f00a00640 1 -- 172.21.15.100:0/3114568391 learned_addr learned my addr 172.21.15.100:0/3114568391 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 455367290 0 0) 0x7f8efc154ba0 con 0x7f8efc1515b0 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8edc003520 con 0x7f8efc1515b0 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.790+0000 7f8f01e00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8efc15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238081612 0 0) 0x7f8edc003520 con 0x7f8efc1515b0 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 msgr2=0x7f8efc15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8efc15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 >> v1:172.21.15.110:6789/0 conn(0x7f8efc14b720 legacy=0x7f8efc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc154df0 con 0x7f8efc1515b0 2024-01-20T08:12:21.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f8ee4001670 con 0x7f8efc1515b0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 >> v1:172.21.15.100:6789/0 conn(0x7f8efc1515b0 legacy=0x7f8efc06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8edc0039a0 0x7f8edc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8edc0047c0 0x7f8edc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8edc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14bb00 con 0x7f8edc0047c0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc0054b0 con 0x7f8edc0039a0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8edc005670 con 0x7f8efc06cfe0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8f00a00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8edc0047c0 0x7f8edc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.791+0000 7f8f01400640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8edc0039a0 0x7f8edc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f01e00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8edc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f00a00640 1 -- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 msgr2=0x7f8edc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f00a00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8efc06cfe0 0x7f8edc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f00a00640 1 -- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8edc0039a0 msgr2=0x7f8edc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:21.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f00a00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8edc0039a0 0x7f8edc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.792+0000 7f8f00a00640 1 -- 172.21.15.100:0/3114568391 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8edc003520 con 0x7f8edc0047c0 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.793+0000 7f8f00a00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8edc0047c0 0x7f8edc004c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c0e0 tx=0x7f8edc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8774089b882c4d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.793+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee4005ad0 con 0x7f8edc0047c0 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.793+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ee4005c30 con 0x7f8edc0047c0 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.793+0000 7f8efbe00640 1 -- 172.21.15.100:0/3114568391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ee402c810 con 0x7f8edc0047c0 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 -- 172.21.15.100:0/3114568391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8edc0047c0 msgr2=0x7f8edc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 --2- 172.21.15.100:0/3114568391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8edc0047c0 0x7f8edc004c40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f8ee400c0e0 tx=0x7f8edc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f01e00640 1 -- 172.21.15.100:0/3114568391 reap_dead start 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 -- 172.21.15.100:0/3114568391 shutdown_connections 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 -- 172.21.15.100:0/3114568391 >> 172.21.15.100:0/3114568391 conn(0x7f8efc0c2940 msgr2=0x7f8efc0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 -- 172.21.15.100:0/3114568391 shutdown_connections 2024-01-20T08:12:21.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.794+0000 7f8f03e00640 1 -- 172.21.15.100:0/3114568391 wait complete. 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.795+0000 7f8f03e00640 1 Processor -- start 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 -- start start 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8edc0047c0 0x7f8efc154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc14fb00 0x7f8efc142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14db70 con 0x7f8efc143010 2024-01-20T08:12:21.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14cff0 con 0x7f8efc14fb00 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.796+0000 7f8f03e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8efc14d2d0 con 0x7f8edc0047c0 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50254/0 (socket says 172.21.15.100:50254) 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 -- 172.21.15.100:0/2820086835 learned_addr learned my addr 172.21.15.100:0/2820086835 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f00a00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc14fb00 0x7f8efc142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01400640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8edc0047c0 0x7f8efc154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 -- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8edc0047c0 msgr2=0x7f8efc154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8edc0047c0 0x7f8efc154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 -- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc14fb00 msgr2=0x7f8efc142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc14fb00 0x7f8efc142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.797+0000 7f8f01e00640 1 -- 172.21.15.100:0/2820086835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc14d5b0 con 0x7f8efc143010 2024-01-20T08:12:21.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8f01e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0c0090 tx=0x7f8ef4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4007db0 con 0x7f8efc143010 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef400f050 con 0x7f8efc143010 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef4014650 con 0x7f8efc143010 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8efc14d890 con 0x7f8efc143010 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.798+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8efc1547b0 con 0x7f8efc143010 2024-01-20T08:12:21.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.799+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8efc04e970 con 0x7f8efc143010 2024-01-20T08:12:21.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.800+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8ef40147b0 con 0x7f8efc143010 2024-01-20T08:12:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.801+0000 7f8ef9600640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 0x7f8ed406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.801+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ef4089c50 con 0x7f8efc143010 2024-01-20T08:12:21.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.801+0000 7f8f01400640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 0x7f8ed406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:21.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.802+0000 7f8f01400640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 0x7f8ed406d3c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:21.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:21.806+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8ef4054b10 con 0x7f8efc143010 2024-01-20T08:12:22.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.072+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f8efc0c37e0 con 0x7f8efc143010 2024-01-20T08:12:22.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.073+0000 7f8ef9600640 1 -- 172.21.15.100:0/2820086835 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v14) v1 ==== 84+0+0 (secure 0 0 0) 0x7f8ef4058130 con 0x7f8efc143010 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.075+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 msgr2=0x7f8ed406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.075+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 0x7f8ed406d3c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8eec000c00 tx=0x7f8eec009040 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.075+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 msgr2=0x7f8efc1419f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.075+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0c0090 tx=0x7f8ef4009da0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 shutdown_connections 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8efc143010 0x7f8efc1419f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8efc14fb00 0x7f8efc142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ed406af00 0x7f8ed406d3c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 --2- 172.21.15.100:0/2820086835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8edc0047c0 0x7f8efc154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 >> 172.21.15.100:0/2820086835 conn(0x7f8efc0c2940 msgr2=0x7f8efc06d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 shutdown_connections 2024-01-20T08:12:22.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.076+0000 7f8f03e00640 1 -- 172.21.15.100:0/2820086835 wait complete. 2024-01-20T08:12:22.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.290+0000 7f5cace00640 1 Processor -- start 2024-01-20T08:12:22.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.290+0000 7f5cace00640 1 -- start start 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80709e0 0x7f5ca80c17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ca80c2e00 0x7f5ca80c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5ca80c37a0 0x7f5ca8157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca80c1fc0 con 0x7f5ca80c2e00 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca80c2970 con 0x7f5ca80c37a0 2024-01-20T08:12:22.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5cace00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca80c5f70 con 0x7f5ca80709e0 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5c9d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ca80c2e00 0x7f5ca80c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5c9d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5ca80c2e00 0x7f5ca80c3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50268/0 (socket says 172.21.15.100:50268) 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.292+0000 7f5c9d200640 1 -- 172.21.15.100:0/2827345161 learned_addr learned my addr 172.21.15.100:0/2827345161 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.293+0000 7f5c9d200640 1 -- 172.21.15.100:0/2827345161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80709e0 msgr2=0x7f5ca80c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.293+0000 7f5c9d200640 1 --2- 172.21.15.100:0/2827345161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80709e0 0x7f5ca80c17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.293+0000 7f5c9d200640 1 -- 172.21.15.100:0/2827345161 >> v2:172.21.15.110:3300/0 conn(0x7f5ca80c37a0 msgr2=0x7f5ca8157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.293+0000 7f5c9d200640 1 --2- 172.21.15.100:0/2827345161 >> v2:172.21.15.110:3300/0 conn(0x7f5ca80c37a0 0x7f5ca8157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.293+0000 7f5c9d200640 1 -- 172.21.15.100:0/2827345161 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca80c1d20 con 0x7f5ca80c2e00 2024-01-20T08:12:22.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.294+0000 7f5c9d200640 1 --2- 172.21.15.100:0/2827345161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80c2e00 0x7f5ca80c3260 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80a7c40 tx=0x7f5c9002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754577d172669798 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.294+0000 7f5ca5400640 1 -- 172.21.15.100:0/2827345161 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90031870 con 0x7f5ca80c2e00 2024-01-20T08:12:22.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.294+0000 7f5ca5400640 1 -- 172.21.15.100:0/2827345161 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c900319d0 con 0x7f5ca80c2e00 2024-01-20T08:12:22.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.294+0000 7f5ca5400640 1 -- 172.21.15.100:0/2827345161 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c90031d60 con 0x7f5ca80c2e00 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 -- 172.21.15.100:0/2827345161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80c2e00 msgr2=0x7f5ca80c3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 --2- 172.21.15.100:0/2827345161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80c2e00 0x7f5ca80c3260 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80a7c40 tx=0x7f5c9002b910 comp rx=0 tx=0).stop 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 -- 172.21.15.100:0/2827345161 shutdown_connections 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 --2- 172.21.15.100:0/2827345161 >> v2:172.21.15.110:3300/0 conn(0x7f5ca80c37a0 0x7f5ca8157df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 --2- 172.21.15.100:0/2827345161 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80c2e00 0x7f5ca80c3260 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 --2- 172.21.15.100:0/2827345161 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80709e0 0x7f5ca80c17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 -- 172.21.15.100:0/2827345161 >> 172.21.15.100:0/2827345161 conn(0x7f5ca806e770 msgr2=0x7f5ca8066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 -- 172.21.15.100:0/2827345161 shutdown_connections 2024-01-20T08:12:22.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.295+0000 7f5cace00640 1 -- 172.21.15.100:0/2827345161 wait complete. 2024-01-20T08:12:22.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.296+0000 7f5cace00640 1 Processor -- start 2024-01-20T08:12:22.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 -- start start 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca80c2e00 0x7f5ca8143740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80c37a0 0x7f5ca80a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8156250 con 0x7f5ca80709e0 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8157170 con 0x7f5ca80c2e00 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.297+0000 7f5cace00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca8155c90 con 0x7f5ca80c37a0 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50278/0 (socket says 172.21.15.100:50278) 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 -- 172.21.15.100:0/4095818573 learned_addr learned my addr 172.21.15.100:0/4095818573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 -- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80c37a0 msgr2=0x7f5ca80a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80c37a0 0x7f5ca80a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 -- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca80c2e00 msgr2=0x7f5ca8143740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca80c2e00 0x7f5ca8143740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 -- 172.21.15.100:0/4095818573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c900094d0 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.298+0000 7f5ca5e00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ba50 tx=0x7f5c9800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.299+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9800cbe0 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.299+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9800cd60 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.299+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98014680 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.299+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca8155f70 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.299+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca8158670 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.300+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca81581f0 con 0x7f5ca80709e0 2024-01-20T08:12:22.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.301+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5c9801d3b0 con 0x7f5ca80709e0 2024-01-20T08:12:22.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.302+0000 7f5c9ea00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 0x7f5c8006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.302+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c98089630 con 0x7f5ca80709e0 2024-01-20T08:12:22.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.302+0000 7f5c9d200640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 0x7f5c8006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.303+0000 7f5c9d200640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 0x7f5c8006d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c90036000 tx=0x7f5c90030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.306+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5ca81581f0 con 0x7f5ca80709e0 2024-01-20T08:12:22.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.498+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ca81581f0 con 0x7f5ca80709e0 2024-01-20T08:12:22.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.500+0000 7f5c9ea00640 1 -- 172.21.15.100:0/4095818573 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v52) v1 ==== 74+0+16542 (secure 0 0 0) 0x7f5ca81581f0 con 0x7f5ca80709e0 2024-01-20T08:12:22.503 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:22.503 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":52,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:08.036813+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 msgr2=0x7f5c8006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 0x7f5c8006d390 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5c90036000 tx=0x7f5c90030000 comp rx=0 tx=0).stop 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 msgr2=0x7f5ca8143200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5c9800ba50 tx=0x7f5c9800bf10 comp rx=0 tx=0).stop 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 shutdown_connections 2024-01-20T08:12:22.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c8006aed0 0x7f5c8006d390 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5ca80c37a0 0x7f5ca80a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5ca80c2e00 0x7f5ca8143740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 --2- 172.21.15.100:0/4095818573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ca80709e0 0x7f5ca8143200 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 >> 172.21.15.100:0/4095818573 conn(0x7f5ca806e770 msgr2=0x7f5ca806c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 shutdown_connections 2024-01-20T08:12:22.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.502+0000 7f5cace00640 1 -- 172.21.15.100:0/4095818573 wait complete. 2024-01-20T08:12:22.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:12:04.385777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:12:05.510105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:22.523 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.720+0000 7fdcac800640 1 Processor -- start 2024-01-20T08:12:22.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.720+0000 7fdcac800640 1 -- start start 2024-01-20T08:12:22.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.721+0000 7fdcac800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca414b720 0x7fdca41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdcac800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca4154ba0 con 0x7fdca40c1850 2024-01-20T08:12:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdcac800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdca4155a00 con 0x7fdca40c1d00 2024-01-20T08:12:22.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdcac800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdca414bb00 con 0x7fdca414b720 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdca9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca414b720 0x7fdca41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdca9400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdca40c1850 0x7fdca406c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59460/0 (socket says 172.21.15.100:59460) 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdca9e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdca414b720 0x7fdca41515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50284/0 (socket says 172.21.15.100:50284) 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.722+0000 7fdca9400640 1 -- 172.21.15.100:0/2191483750 learned_addr learned my addr 172.21.15.100:0/2191483750 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.723+0000 7fdca9e00640 1 -- 172.21.15.100:0/2191483750 >> v1:172.21.15.110:6789/0 conn(0x7fdca40c1d00 legacy=0x7fdca406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.723+0000 7fdca9e00640 1 -- 172.21.15.100:0/2191483750 >> v1:172.21.15.100:6789/0 conn(0x7fdca40c1850 legacy=0x7fdca406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.723+0000 7fdca9e00640 1 -- 172.21.15.100:0/2191483750 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca4154df0 con 0x7fdca414b720 2024-01-20T08:12:22.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.723+0000 7fdca8a00640 1 -- 172.21.15.100:0/2191483750 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424290338 0 0) 0x7fdca4154ba0 con 0x7fdca40c1850 2024-01-20T08:12:22.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.724+0000 7fdca9e00640 1 --2- 172.21.15.100:0/2191483750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca41515b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097a0 tx=0x7fdc9402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c722caa45dc3dc28 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.724+0000 7fdca8a00640 1 -- 172.21.15.100:0/2191483750 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9402e070 con 0x7fdca414b720 2024-01-20T08:12:22.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.724+0000 7fdca8a00640 1 -- 172.21.15.100:0/2191483750 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc940315a0 con 0x7fdca414b720 2024-01-20T08:12:22.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.724+0000 7fdca8a00640 1 -- 172.21.15.100:0/2191483750 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc94031930 con 0x7fdca414b720 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 -- 172.21.15.100:0/2191483750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 msgr2=0x7fdca41515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 --2- 172.21.15.100:0/2191483750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca41515b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fdc940097a0 tx=0x7fdc9402b840 comp rx=0 tx=0).stop 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 -- 172.21.15.100:0/2191483750 shutdown_connections 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 --2- 172.21.15.100:0/2191483750 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca41515b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 -- 172.21.15.100:0/2191483750 >> 172.21.15.100:0/2191483750 conn(0x7fdca40c2940 msgr2=0x7fdca40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 -- 172.21.15.100:0/2191483750 shutdown_connections 2024-01-20T08:12:22.728 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.725+0000 7fdcac800640 1 -- 172.21.15.100:0/2191483750 wait complete. 2024-01-20T08:12:22.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.726+0000 7fdcac800640 1 Processor -- start 2024-01-20T08:12:22.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.726+0000 7fdcac800640 1 -- start start 2024-01-20T08:12:22.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 0x7fdca41ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca40c1d00 0x7fdca413d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca40ab5b0 con 0x7fdca414b720 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdca4153430 con 0x7fdca40c1850 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcac800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdca413e2a0 con 0x7fdca40c1d00 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.727+0000 7fdcaa800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50296/0 (socket says 172.21.15.100:50296) 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 -- 172.21.15.100:0/3634124536 learned_addr learned my addr 172.21.15.100:0/3634124536 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdca9400640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca40c1d00 0x7fdca413d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 -- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca40c1d00 msgr2=0x7fdca413d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdca9e00640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 0x7fdca41ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca40c1d00 0x7fdca413d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 -- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 msgr2=0x7fdca41ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 0x7fdca41ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 -- 172.21.15.100:0/3634124536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc94009400 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdca9e00640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 0x7fdca41ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.728+0000 7fdcaa800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c7a0 tx=0x7fdc9c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.729+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c003b70 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.729+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c003cf0 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.729+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc9c003ea0 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.729+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca4153bf0 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.729+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdca41edde0 con 0x7fdca414b720 2024-01-20T08:12:22.733 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.730+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdca404e970 con 0x7fdca414b720 2024-01-20T08:12:22.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.731+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdc9c00aa90 con 0x7fdca414b720 2024-01-20T08:12:22.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.732+0000 7fdca2000640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:22.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.732+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc9c089480 con 0x7fdca414b720 2024-01-20T08:12:22.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.732+0000 7fdca9e00640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:22.735 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.732+0000 7fdca9e00640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 0x7fdc7c06d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc94036000 tx=0x7fdc9403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:22.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.736+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdc9c054340 con 0x7fdca414b720 2024-01-20T08:12:22.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.914+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdca40c37e0 con 0x7fdca414b720 2024-01-20T08:12:22.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.915+0000 7fdca2000640 1 -- 172.21.15.100:0/3634124536 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v52) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc9c057960 con 0x7fdca414b720 2024-01-20T08:12:22.918 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 msgr2=0x7fdc7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 0x7fdc7c06d390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fdc94036000 tx=0x7fdc9403d040 comp rx=0 tx=0).stop 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 msgr2=0x7fdca413dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c00c7a0 tx=0x7fdc9c00cc60 comp rx=0 tx=0).stop 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 shutdown_connections 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdca414b720 0x7fdca413dd60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdc7c06aed0 0x7fdc7c06d390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdca40c1d00 0x7fdca413d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 --2- 172.21.15.100:0/3634124536 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdca40c1850 0x7fdca41ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:22.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 >> 172.21.15.100:0/3634124536 conn(0x7fdca40c2940 msgr2=0x7fdca40708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:22.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 shutdown_connections 2024-01-20T08:12:22.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:22.918+0000 7fdcac800640 1 -- 172.21.15.100:0/3634124536 wait complete. 2024-01-20T08:12:22.939 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:12:23.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.147+0000 7f233e200640 1 Processor -- start 2024-01-20T08:12:23.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.147+0000 7f233e200640 1 -- start start 2024-01-20T08:12:23.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f233e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f233813dcc0 0x7f2338071020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f233e200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2338071560 0x7f23380bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f233e200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2338071a30 con 0x7f23380bfa00 2024-01-20T08:12:23.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f233e200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380707d0 con 0x7f233813dcc0 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f233e200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23380c0b30 con 0x7f2338071560 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f2337400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f233813dcc0 0x7f2338071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f2337e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f23380bfa00 0x7f23380c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59462/0 (socket says 172.21.15.100:59462) 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f2337e00640 1 -- 172.21.15.100:0/3803525970 learned_addr learned my addr 172.21.15.100:0/3803525970 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f2336a00640 1 --2- 172.21.15.100:0/3803525970 >> v2:172.21.15.110:3300/0 conn(0x7f2338071560 0x7f23380bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.149+0000 7f2336000640 1 -- 172.21.15.100:0/3803525970 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770113809 0 0) 0x7f2338071a30 con 0x7f23380bfa00 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.150+0000 7f2336000640 1 -- 172.21.15.100:0/3803525970 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2318003520 con 0x7f23380bfa00 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.150+0000 7f2337400640 1 -- 172.21.15.100:0/3803525970 >> v2:172.21.15.110:3300/0 conn(0x7f2338071560 msgr2=0x7f23380bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.150+0000 7f2337400640 1 --2- 172.21.15.100:0/3803525970 >> v2:172.21.15.110:3300/0 conn(0x7f2338071560 0x7f23380bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.150+0000 7f2337400640 1 -- 172.21.15.100:0/3803525970 >> v1:172.21.15.100:6789/0 conn(0x7f23380bfa00 legacy=0x7f23380c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.150+0000 7f2337400640 1 -- 172.21.15.100:0/3803525970 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23380c0e10 con 0x7f233813dcc0 2024-01-20T08:12:23.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.151+0000 7f2337400640 1 --2- 172.21.15.100:0/3803525970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233813dcc0 0x7f2338071020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f233806e600 tx=0x7f232802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fcb1b7560011f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.151+0000 7f2336000640 1 -- 172.21.15.100:0/3803525970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328031830 con 0x7f233813dcc0 2024-01-20T08:12:23.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.151+0000 7f2336000640 1 -- 172.21.15.100:0/3803525970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2328031990 con 0x7f233813dcc0 2024-01-20T08:12:23.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.151+0000 7f2336000640 1 -- 172.21.15.100:0/3803525970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328031d20 con 0x7f233813dcc0 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 -- 172.21.15.100:0/3803525970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233813dcc0 msgr2=0x7f2338071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 --2- 172.21.15.100:0/3803525970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233813dcc0 0x7f2338071020 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f233806e600 tx=0x7f232802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 -- 172.21.15.100:0/3803525970 shutdown_connections 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 --2- 172.21.15.100:0/3803525970 >> v2:172.21.15.110:3300/0 conn(0x7f2338071560 0x7f23380bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 --2- 172.21.15.100:0/3803525970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f233813dcc0 0x7f2338071020 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 -- 172.21.15.100:0/3803525970 >> 172.21.15.100:0/3803525970 conn(0x7f23380c6090 msgr2=0x7f23380c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:23.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 -- 172.21.15.100:0/3803525970 shutdown_connections 2024-01-20T08:12:23.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.152+0000 7f233e200640 1 -- 172.21.15.100:0/3803525970 wait complete. 2024-01-20T08:12:23.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.154+0000 7f233e200640 1 Processor -- start 2024-01-20T08:12:23.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.154+0000 7f233e200640 1 -- start start 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380bfa00 0x7f23381e6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233813dcc0 0x7f23381ed600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23381ed120 con 0x7f2338071560 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23381eaaa0 con 0x7f23380bfa00 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f233e200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23380c52b0 con 0x7f233813dcc0 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50322/0 (socket says 172.21.15.100:50322) 2024-01-20T08:12:23.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 -- 172.21.15.100:0/2086843908 learned_addr learned my addr 172.21.15.100:0/2086843908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:23.159 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 -- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233813dcc0 msgr2=0x7f23381ed600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233813dcc0 0x7f23381ed600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 -- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380bfa00 msgr2=0x7f23381e6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380bfa00 0x7f23381e6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.155+0000 7f2337400640 1 -- 172.21.15.100:0/2086843908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009400 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f2337400640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232803a8f0 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232803aa70 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233813e220 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232803ae20 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.156+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23380c5870 con 0x7f2338071560 2024-01-20T08:12:23.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.157+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23381ed2e0 con 0x7f2338071560 2024-01-20T08:12:23.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.158+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f232804d450 con 0x7f2338071560 2024-01-20T08:12:23.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.159+0000 7f232f400640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 0x7f231006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.159+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23280ab5f0 con 0x7f2338071560 2024-01-20T08:12:23.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.159+0000 7f2336a00640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 0x7f231006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.160+0000 7f2336a00640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 0x7f231006d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f233806dec0 tx=0x7f2320008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.163+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2328076670 con 0x7f2338071560 2024-01-20T08:12:23.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.354+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f233804ea50 con 0x7f2338071560 2024-01-20T08:12:23.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.355+0000 7f232f400640 1 -- 172.21.15.100:0/2086843908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v52) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2328035020 con 0x7f2338071560 2024-01-20T08:12:23.358 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.357+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 msgr2=0x7f231006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.357+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 0x7f231006d3c0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f233806dec0 tx=0x7f2320008040 comp rx=0 tx=0).stop 2024-01-20T08:12:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.357+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 msgr2=0x7f233806ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.357+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f2328000c00 tx=0x7f23280046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 shutdown_connections 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f231006af00 0x7f231006d3c0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f233813dcc0 0x7f23381ed600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23380bfa00 0x7f23381e6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 --2- 172.21.15.100:0/2086843908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2338071560 0x7f233806ce90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 >> 172.21.15.100:0/2086843908 conn(0x7f23380c6090 msgr2=0x7f23380c3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 shutdown_connections 2024-01-20T08:12:23.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.358+0000 7f233e200640 1 -- 172.21.15.100:0/2086843908 wait complete. 2024-01-20T08:12:23.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:12:23.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.573+0000 7f0aa1400640 1 Processor -- start 2024-01-20T08:12:23.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.573+0000 7f0aa1400640 1 -- start start 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0aa1400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a9c14b720 0x7f0a9c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0aa1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c0c1d00 0x7f0a9c06cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0aa1400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a9c154ba0 con 0x7f0a9c0c1850 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0aa1400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a9c14bb00 con 0x7f0a9c14b720 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0aa1400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c155a00 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0a9a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a9c14b720 0x7f0a9c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0a9a800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0a9c14b720 0x7f0a9c1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50326/0 (socket says 172.21.15.100:50326) 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.574+0000 7f0a9a800640 1 -- 172.21.15.100:0/3770957087 learned_addr learned my addr 172.21.15.100:0/3770957087 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.575+0000 7f0a9b200640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c0c1d00 0x7f0a9c06cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.575+0000 7f0a9a800640 1 -- 172.21.15.100:0/3770957087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c0c1d00 msgr2=0x7f0a9c06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.575+0000 7f0a9a800640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c0c1d00 0x7f0a9c06cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.575+0000 7f0a9a800640 1 -- 172.21.15.100:0/3770957087 >> v1:172.21.15.110:6789/0 conn(0x7f0a9c0c1850 legacy=0x7f0a9c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:23.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.575+0000 7f0a9a800640 1 -- 172.21.15.100:0/3770957087 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a9c154df0 con 0x7f0a9c14b720 2024-01-20T08:12:23.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.576+0000 7f0a9a800640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c14b720 0x7f0a9c1515b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009870 tx=0x7f0a8c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ba25cf6b28d3d0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.576+0000 7f0a99e00640 1 -- 172.21.15.100:0/3770957087 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c0317c0 con 0x7f0a9c14b720 2024-01-20T08:12:23.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.576+0000 7f0a99e00640 1 -- 172.21.15.100:0/3770957087 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a8c031920 con 0x7f0a9c14b720 2024-01-20T08:12:23.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.576+0000 7f0a99e00640 1 -- 172.21.15.100:0/3770957087 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a8c031cb0 con 0x7f0a9c14b720 2024-01-20T08:12:23.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 -- 172.21.15.100:0/3770957087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c14b720 msgr2=0x7f0a9c1515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c14b720 0x7f0a9c1515b0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009870 tx=0x7f0a8c02b860 comp rx=0 tx=0).stop 2024-01-20T08:12:23.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 -- 172.21.15.100:0/3770957087 shutdown_connections 2024-01-20T08:12:23.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c0c1d00 0x7f0a9c06cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 --2- 172.21.15.100:0/3770957087 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c14b720 0x7f0a9c1515b0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 -- 172.21.15.100:0/3770957087 >> 172.21.15.100:0/3770957087 conn(0x7f0a9c0c2940 msgr2=0x7f0a9c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:23.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 -- 172.21.15.100:0/3770957087 shutdown_connections 2024-01-20T08:12:23.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.577+0000 7f0aa1400640 1 -- 172.21.15.100:0/3770957087 wait complete. 2024-01-20T08:12:23.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.579+0000 7f0aa1400640 1 Processor -- start 2024-01-20T08:12:23.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.579+0000 7f0aa1400640 1 -- start start 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9c0c1850 0x7f0a9c15d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c14b720 0x7f0a9c0aa260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c070ef0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c15dbe0 con 0x7f0a9c0c1850 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0aa1400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a9c15de10 con 0x7f0a9c14b720 2024-01-20T08:12:23.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0a91c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0a91c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50336/0 (socket says 172.21.15.100:50336) 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0a91c00640 1 -- 172.21.15.100:0/943739560 learned_addr learned my addr 172.21.15.100:0/943739560 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.580+0000 7f0a9a800640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9c0c1850 0x7f0a9c15d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a9b200640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c14b720 0x7f0a9c0aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 -- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c14b720 msgr2=0x7f0a9c0aa260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c14b720 0x7f0a9c0aa260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 -- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9c0c1850 msgr2=0x7f0a9c15d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9c0c1850 0x7f0a9c15d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 -- 172.21.15.100:0/943739560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a8c0094d0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a91c00640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c430 tx=0x7f0a8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011790 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a840118f0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a9c15e0f0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a84011ce0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.581+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a9c15e6b0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.583+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a9c04e970 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.583+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0a8401c460 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.584+0000 7f0a93400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 0x7f0a7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:23.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.584+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a840895d0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.584+0000 7f0a9a800640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 0x7f0a7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:23.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.585+0000 7f0a9a800640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 0x7f0a7406d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c036000 tx=0x7f0a8c03d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:23.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.589+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0a84054490 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.781+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0a9c0c37e0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.782+0000 7f0a93400640 1 -- 172.21.15.100:0/943739560 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v52) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0a84057ab0 con 0x7f0a9c0c1d00 2024-01-20T08:12:23.784 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 msgr2=0x7f0a7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 0x7f0a7406d3c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c036000 tx=0x7f0a8c03d040 comp rx=0 tx=0).stop 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 msgr2=0x7f0a9c0bf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f0a8400c430 tx=0x7f0a8400c8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 shutdown_connections 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0a7406af00 0x7f0a7406d3c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0a9c14b720 0x7f0a9c0aa260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0a9c0c1d00 0x7f0a9c0bf270 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 --2- 172.21.15.100:0/943739560 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0a9c0c1850 0x7f0a9c15d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 >> 172.21.15.100:0/943739560 conn(0x7f0a9c0c2940 msgr2=0x7f0a9c0c4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.784+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 shutdown_connections 2024-01-20T08:12:23.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:23.785+0000 7f0aa1400640 1 -- 172.21.15.100:0/943739560 wait complete. 2024-01-20T08:12:23.804 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:12:24.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.003+0000 7f732b000640 1 Processor -- start 2024-01-20T08:12:24.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.003+0000 7f732b000640 1 -- start start 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.004+0000 7f732b000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 0x7f732406c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.004+0000 7f732b000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f732406ce10 0x7f732406d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.004+0000 7f732b000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7324154ba0 con 0x7f732414b720 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f732b000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732414bb00 con 0x7f732406ce10 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f732b000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7324155a00 con 0x7f73241515b0 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f732406ce10 0x7f732406d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f732406ce10 0x7f732406d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50352/0 (socket says 172.21.15.100:50352) 2024-01-20T08:12:24.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 -- 172.21.15.100:0/3456441132 learned_addr learned my addr 172.21.15.100:0/3456441132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7323400640 1 --2- 172.21.15.100:0/3456441132 >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 0x7f732406c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 -- 172.21.15.100:0/3456441132 >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 msgr2=0x7f732406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 --2- 172.21.15.100:0/3456441132 >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 0x7f732406c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.005+0000 7f7329000640 1 -- 172.21.15.100:0/3456441132 >> v1:172.21.15.110:6789/0 conn(0x7f732414b720 legacy=0x7f73240c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.006+0000 7f7329000640 1 -- 172.21.15.100:0/3456441132 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324154df0 con 0x7f732406ce10 2024-01-20T08:12:24.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.006+0000 7f7323400640 1 --2- 172.21.15.100:0/3456441132 >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 0x7f732406c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:24.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.007+0000 7f7329000640 1 --2- 172.21.15.100:0/3456441132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f732406d210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f73240ac030 tx=0x7f731c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a83ac72ab4f1f81 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.007+0000 7f7322a00640 1 -- 172.21.15.100:0/3456441132 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c02c9f0 con 0x7f732406ce10 2024-01-20T08:12:24.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.007+0000 7f7322a00640 1 -- 172.21.15.100:0/3456441132 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731c02cb50 con 0x7f732406ce10 2024-01-20T08:12:24.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.007+0000 7f7322a00640 1 -- 172.21.15.100:0/3456441132 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731c0343f0 con 0x7f732406ce10 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 -- 172.21.15.100:0/3456441132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 msgr2=0x7f732406d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 --2- 172.21.15.100:0/3456441132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f732406d210 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f73240ac030 tx=0x7f731c02be50 comp rx=0 tx=0).stop 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 -- 172.21.15.100:0/3456441132 shutdown_connections 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 --2- 172.21.15.100:0/3456441132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f732406d210 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 --2- 172.21.15.100:0/3456441132 >> v2:172.21.15.110:3300/0 conn(0x7f73241515b0 0x7f732406c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 -- 172.21.15.100:0/3456441132 >> 172.21.15.100:0/3456441132 conn(0x7f73240c2940 msgr2=0x7f73240c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 -- 172.21.15.100:0/3456441132 shutdown_connections 2024-01-20T08:12:24.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.008+0000 7f732b000640 1 -- 172.21.15.100:0/3456441132 wait complete. 2024-01-20T08:12:24.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.010+0000 7f732b000640 1 Processor -- start 2024-01-20T08:12:24.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.010+0000 7f732b000640 1 -- start start 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732414b720 0x7f73240c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73241515b0 0x7f73241418d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73240711c0 con 0x7f732406ce10 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7324147c80 con 0x7f732414b720 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f732b000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73241e5880 con 0x7f73241515b0 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f7323e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f7323e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50360/0 (socket says 172.21.15.100:50360) 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.011+0000 7f7323e00640 1 -- 172.21.15.100:0/2238455317 learned_addr learned my addr 172.21.15.100:0/2238455317 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7329000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73241515b0 0x7f73241418d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323400640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732414b720 0x7f73240c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 -- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73241515b0 msgr2=0x7f73241418d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73241515b0 0x7f73241418d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 -- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732414b720 msgr2=0x7f73240c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732414b720 0x7f73240c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 -- 172.21.15.100:0/2238455317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f731c009b30 con 0x7f732406ce10 2024-01-20T08:12:24.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f7323e00640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f731400c460 tx=0x7f731400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314012830 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73140129d0 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.012+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7314012d80 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.013+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7324147ed0 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.013+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73241e5de0 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.014+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f732404e970 con 0x7f732406ce10 2024-01-20T08:12:24.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.014+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f731401b400 con 0x7f732406ce10 2024-01-20T08:12:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.015+0000 7f731be00640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 0x7f72fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.015+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7314089560 con 0x7f732406ce10 2024-01-20T08:12:24.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.016+0000 7f7323400640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 0x7f72fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.016+0000 7f7323400640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 0x7f72fc06d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f73240c0060 tx=0x7f730c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.021+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7314054420 con 0x7f732406ce10 2024-01-20T08:12:24.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.216+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f73240c37e0 con 0x7f732406ce10 2024-01-20T08:12:24.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.217+0000 7f731be00640 1 -- 172.21.15.100:0/2238455317 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v52) v1 ==== 84+0+207 (secure 0 0 0) 0x7f7314057a40 con 0x7f732406ce10 2024-01-20T08:12:24.220 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 8, 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_metadata" 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 9, 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_data" 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:12:24.221 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 msgr2=0x7f72fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 0x7f72fc06d390 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f73240c0060 tx=0x7f730c008040 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 msgr2=0x7f73240c55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f731400c460 tx=0x7f731400c920 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 shutdown_connections 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72fc06aed0 0x7f72fc06d390 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f73241515b0 0x7f73241418d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f732414b720 0x7f73240c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 --2- 172.21.15.100:0/2238455317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f732406ce10 0x7f73240c55a0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 >> 172.21.15.100:0/2238455317 conn(0x7f73240c2940 msgr2=0x7f7324148e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 shutdown_connections 2024-01-20T08:12:24.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.220+0000 7f732b000640 1 -- 172.21.15.100:0/2238455317 wait complete. 2024-01-20T08:12:24.242 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-20T08:12:24.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-20T08:12:24.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.453+0000 7f3374000640 1 Processor -- start 2024-01-20T08:12:24.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.453+0000 7f3374000640 1 -- start start 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.454+0000 7f3374000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f336c14c5a0 0x7f336c153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3374000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f336c06d570 0x7f336c06d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3374000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f336c06d0e0 con 0x7f336c06bdb0 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3374000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c153560 con 0x7f336c14c5a0 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3374000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f336c0aaf10 con 0x7f336c06d570 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3371600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f336c14c5a0 0x7f336c153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3370c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f336c06bdb0 0x7f336c0c1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59474/0 (socket says 172.21.15.100:59474) 2024-01-20T08:12:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3370c00640 1 -- 172.21.15.100:0/2534317857 learned_addr learned my addr 172.21.15.100:0/2534317857 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:24.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f3372000640 1 --2- 172.21.15.100:0/2534317857 >> v2:172.21.15.110:3300/0 conn(0x7f336c06d570 0x7f336c06d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f336be00640 1 -- 172.21.15.100:0/2534317857 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111649241 0 0) 0x7f336c06d0e0 con 0x7f336c06bdb0 2024-01-20T08:12:24.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.455+0000 7f336be00640 1 -- 172.21.15.100:0/2534317857 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f334c003520 con 0x7f336c06bdb0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.456+0000 7f3371600640 1 -- 172.21.15.100:0/2534317857 >> v2:172.21.15.110:3300/0 conn(0x7f336c06d570 msgr2=0x7f336c06d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.456+0000 7f3371600640 1 --2- 172.21.15.100:0/2534317857 >> v2:172.21.15.110:3300/0 conn(0x7f336c06d570 0x7f336c06d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.456+0000 7f3371600640 1 -- 172.21.15.100:0/2534317857 >> v1:172.21.15.100:6789/0 conn(0x7f336c06bdb0 legacy=0x7f336c0c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.456+0000 7f3371600640 1 -- 172.21.15.100:0/2534317857 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c14c980 con 0x7f336c14c5a0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f3371600640 1 --2- 172.21.15.100:0/2534317857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c14c5a0 0x7f336c153020 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f336c0729f0 tx=0x7f335c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8b540c164c8753 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f336be00640 1 -- 172.21.15.100:0/2534317857 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c031710 con 0x7f336c14c5a0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f336be00640 1 -- 172.21.15.100:0/2534317857 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c02f050 con 0x7f336c14c5a0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f336be00640 1 -- 172.21.15.100:0/2534317857 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c031a90 con 0x7f336c14c5a0 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f3374000640 1 -- 172.21.15.100:0/2534317857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c14c5a0 msgr2=0x7f336c153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f3374000640 1 --2- 172.21.15.100:0/2534317857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c14c5a0 0x7f336c153020 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f336c0729f0 tx=0x7f335c02b7b0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.457+0000 7f3374000640 1 -- 172.21.15.100:0/2534317857 shutdown_connections 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.458+0000 7f3374000640 1 --2- 172.21.15.100:0/2534317857 >> v2:172.21.15.110:3300/0 conn(0x7f336c06d570 0x7f336c06d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.458+0000 7f3374000640 1 --2- 172.21.15.100:0/2534317857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c14c5a0 0x7f336c153020 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.458+0000 7f3374000640 1 -- 172.21.15.100:0/2534317857 >> 172.21.15.100:0/2534317857 conn(0x7f336c0c2b00 msgr2=0x7f336c0c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.458+0000 7f3374000640 1 -- 172.21.15.100:0/2534317857 shutdown_connections 2024-01-20T08:12:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.458+0000 7f3374000640 1 -- 172.21.15.100:0/2534317857 wait complete. 2024-01-20T08:12:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.459+0000 7f3374000640 1 Processor -- start 2024-01-20T08:12:24.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.459+0000 7f3374000640 1 -- start start 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 0x7f336c0bf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336c14c5a0 0x7f336c142cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c070c90 con 0x7f336c06bdb0 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c0709b0 con 0x7f336c06d570 2024-01-20T08:12:24.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3374000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336c149180 con 0x7f336c14c5a0 2024-01-20T08:12:24.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3371600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3371600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50386/0 (socket says 172.21.15.100:50386) 2024-01-20T08:12:24.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.460+0000 7f3371600640 1 -- 172.21.15.100:0/1323483827 learned_addr learned my addr 172.21.15.100:0/1323483827 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3370c00640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 0x7f336c0bf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 -- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336c14c5a0 msgr2=0x7f336c142cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336c14c5a0 0x7f336c142cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 -- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 msgr2=0x7f336c0bf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 0x7f336c0bf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 -- 172.21.15.100:0/1323483827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f335c009400 con 0x7f336c06bdb0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3370c00640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 0x7f336c0bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.461+0000 7f3371600640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f335c000c00 tx=0x7f335c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.462+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c033890 con 0x7f336c06bdb0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.462+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f335c0339f0 con 0x7f336c06bdb0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.462+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f335c033da0 con 0x7f336c06bdb0 2024-01-20T08:12:24.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.462+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c149460 con 0x7f336c06bdb0 2024-01-20T08:12:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.462+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c0bfbe0 con 0x7f336c06bdb0 2024-01-20T08:12:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.463+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c148fc0 con 0x7f336c06bdb0 2024-01-20T08:12:24.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.464+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f335c03a040 con 0x7f336c06bdb0 2024-01-20T08:12:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.465+0000 7f3369600640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 0x7f334406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.465+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f335c0aaff0 con 0x7f336c06bdb0 2024-01-20T08:12:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.465+0000 7f3370c00640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 0x7f334406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:24.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.466+0000 7f3370c00640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 0x7f334406d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f336c0a9190 tx=0x7f3354009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:24.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.470+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f335c0de0d0 con 0x7f336c06bdb0 2024-01-20T08:12:24.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:24.662+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f336c074450 con 0x7f336c06bdb0 2024-01-20T08:12:25.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.062+0000 7f3369600640 1 -- 172.21.15.100:0/1323483827 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v53) v1 ==== 140+0+0 (secure 0 0 0) 0x7f335c075f80 con 0x7f336c06bdb0 2024-01-20T08:12:25.065 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' created 2024-01-20T08:12:25.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 msgr2=0x7f334406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 0x7f334406d390 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f336c0a9190 tx=0x7f3354009040 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 msgr2=0x7f336c1564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f335c000c00 tx=0x7f335c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 shutdown_connections 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f334406aed0 0x7f334406d390 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f336c14c5a0 0x7f336c142cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f336c06d570 0x7f336c0bf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 --2- 172.21.15.100:0/1323483827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f336c06bdb0 0x7f336c1564c0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.065+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 >> 172.21.15.100:0/1323483827 conn(0x7f336c0c2b00 msgr2=0x7f336c0a9320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.066+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 shutdown_connections 2024-01-20T08:12:25.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.066+0000 7f3374000640 1 -- 172.21.15.100:0/1323483827 wait complete. 2024-01-20T08:12:25.096 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:12:25.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.296+0000 7f07c5200640 1 Processor -- start 2024-01-20T08:12:25.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.297+0000 7f07c5200640 1 -- start start 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.298+0000 7f07c5200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c2a90 0x7f07c0155db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.298+0000 7f07c5200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07c00c3060 0x7f07c01562f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.298+0000 7f07c5200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07c0153440 con 0x7f07c014fc00 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.298+0000 7f07c5200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07c00aa650 con 0x7f07c00c3060 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.298+0000 7f07c5200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01528c0 con 0x7f07c00c2a90 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07c00c3060 0x7f07c01562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07c00c3060 0x7f07c01562f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50388/0 (socket says 172.21.15.100:50388) 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 -- 172.21.15.100:0/1397871075 learned_addr learned my addr 172.21.15.100:0/1397871075 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:25.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bea00640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c2a90 0x7f07c0155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 -- 172.21.15.100:0/1397871075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c2a90 msgr2=0x7f07c0155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c2a90 0x7f07c0155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 -- 172.21.15.100:0/1397871075 >> v1:172.21.15.110:6789/0 conn(0x7f07c014fc00 legacy=0x7f07c006f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.299+0000 7f07bfe00640 1 -- 172.21.15.100:0/1397871075 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07c0152ba0 con 0x7f07c00c3060 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.300+0000 7f07bfe00640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c3060 0x7f07c01562f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009e50 tx=0x7f07b802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f57efe1bf2c1960c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.300+0000 7f07be000640 1 -- 172.21.15.100:0/1397871075 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b802c9e0 con 0x7f07c00c3060 2024-01-20T08:12:25.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07be000640 1 -- 172.21.15.100:0/1397871075 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b802cb40 con 0x7f07c00c3060 2024-01-20T08:12:25.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07be000640 1 -- 172.21.15.100:0/1397871075 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b80343f0 con 0x7f07c00c3060 2024-01-20T08:12:25.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 -- 172.21.15.100:0/1397871075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c3060 msgr2=0x7f07c01562f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:25.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c3060 0x7f07c01562f0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f07b8009e50 tx=0x7f07b802be40 comp rx=0 tx=0).stop 2024-01-20T08:12:25.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 -- 172.21.15.100:0/1397871075 shutdown_connections 2024-01-20T08:12:25.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c3060 0x7f07c01562f0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 --2- 172.21.15.100:0/1397871075 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c2a90 0x7f07c0155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 -- 172.21.15.100:0/1397871075 >> 172.21.15.100:0/1397871075 conn(0x7f07c00c39c0 msgr2=0x7f07c00c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:25.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 -- 172.21.15.100:0/1397871075 shutdown_connections 2024-01-20T08:12:25.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.301+0000 7f07c5200640 1 -- 172.21.15.100:0/1397871075 wait complete. 2024-01-20T08:12:25.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.303+0000 7f07c5200640 1 Processor -- start 2024-01-20T08:12:25.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.303+0000 7f07c5200640 1 -- start start 2024-01-20T08:12:25.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c3060 0x7f07c00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 0x7f07c01eacb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c006e920 con 0x7f07c00c2a90 2024-01-20T08:12:25.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07c01eeb40 con 0x7f07c014fc00 2024-01-20T08:12:25.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07c5200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07c0154f30 con 0x7f07c00c3060 2024-01-20T08:12:25.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07bf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07bf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50402/0 (socket says 172.21.15.100:50402) 2024-01-20T08:12:25.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.304+0000 7f07bf400640 1 -- 172.21.15.100:0/3127679447 learned_addr learned my addr 172.21.15.100:0/3127679447 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bea00640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c3060 0x7f07c00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 -- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c3060 msgr2=0x7f07c00c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c3060 0x7f07c00c5ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bfe00640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 0x7f07c01eacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 -- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 msgr2=0x7f07c01eacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:25.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 0x7f07c01eacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 -- 172.21.15.100:0/3127679447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b8009b30 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bfe00640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 0x7f07c01eacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.305+0000 7f07bf400640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b3f0 tx=0x7f07b000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.306+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011830 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.306+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07b0011990 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.306+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07c0154690 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.306+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011d40 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.306+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07c0154c50 con 0x7f07c00c2a90 2024-01-20T08:12:25.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.307+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07c00a8920 con 0x7f07c00c2a90 2024-01-20T08:12:25.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.308+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f07b0004020 con 0x7f07c00c2a90 2024-01-20T08:12:25.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.310+0000 7f07b7400640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 0x7f079806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:25.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.310+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f07b0089970 con 0x7f07c00c2a90 2024-01-20T08:12:25.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.310+0000 7f07bea00640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 0x7f079806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:25.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.311+0000 7f07bea00640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 0x7f079806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f07a8006fd0 tx=0x7f07a8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:25.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.314+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f07b0054860 con 0x7f07c00c2a90 2024-01-20T08:12:25.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:25.509+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f07c004e970 con 0x7f07c00c2a90 2024-01-20T08:12:26.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.068+0000 7f07b7400640 1 -- 172.21.15.100:0/3127679447 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v54) v1 ==== 172+0+0 (secure 0 0 0) 0x7f07b0057e80 con 0x7f07c00c2a90 2024-01-20T08:12:26.071 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' created 2024-01-20T08:12:26.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.071+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 msgr2=0x7f079806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.071+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 0x7f079806d390 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f07a8006fd0 tx=0x7f07a8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.071+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 msgr2=0x7f07c01ee600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.071+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f07b000b3f0 tx=0x7f07b000b8b0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 shutdown_connections 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07c014fc00 0x7f07c01eacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f079806aed0 0x7f079806d390 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07c00c3060 0x7f07c00c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 --2- 172.21.15.100:0/3127679447 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07c00c2a90 0x7f07c01ee600 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 >> 172.21.15.100:0/3127679447 conn(0x7f07c00c39c0 msgr2=0x7f07c00c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:26.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 shutdown_connections 2024-01-20T08:12:26.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.072+0000 7f07c5200640 1 -- 172.21.15.100:0/3127679447 wait complete. 2024-01-20T08:12:26.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-20T08:12:26.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.287+0000 7fcb9b800640 1 Processor -- start 2024-01-20T08:12:26.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.287+0000 7fcb9b800640 1 -- start start 2024-01-20T08:12:26.291 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.288+0000 7fcb9b800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcb9414fdb0 0x7fcb940c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.288+0000 7fcb9b800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcb940c1d90 0x7fcb94152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.288+0000 7fcb9b800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb94150190 con 0x7fcb940c3460 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.288+0000 7fcb9b800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940a9ce0 con 0x7fcb9414fdb0 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.288+0000 7fcb9b800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb940a93b0 con 0x7fcb940c1d90 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb98e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcb9414fdb0 0x7fcb940c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb99800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcb940c3460 0x7fcb94155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59488/0 (socket says 172.21.15.100:59488) 2024-01-20T08:12:26.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb99800640 1 -- 172.21.15.100:0/2460759216 learned_addr learned my addr 172.21.15.100:0/2460759216 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb8be00640 1 --2- 172.21.15.100:0/2460759216 >> v2:172.21.15.110:3300/0 conn(0x7fcb940c1d90 0x7fcb94152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb93e00640 1 -- 172.21.15.100:0/2460759216 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320861011 0 0) 0x7fcb94150190 con 0x7fcb940c3460 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb93e00640 1 -- 172.21.15.100:0/2460759216 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb74003520 con 0x7fcb940c3460 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb98e00640 1 -- 172.21.15.100:0/2460759216 >> v2:172.21.15.110:3300/0 conn(0x7fcb940c1d90 msgr2=0x7fcb94152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb98e00640 1 --2- 172.21.15.100:0/2460759216 >> v2:172.21.15.110:3300/0 conn(0x7fcb940c1d90 0x7fcb94152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb98e00640 1 -- 172.21.15.100:0/2460759216 >> v1:172.21.15.100:6789/0 conn(0x7fcb940c3460 legacy=0x7fcb94155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.289+0000 7fcb98e00640 1 -- 172.21.15.100:0/2460759216 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb940a8810 con 0x7fcb9414fdb0 2024-01-20T08:12:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.291+0000 7fcb98e00640 1 --2- 172.21.15.100:0/2460759216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9414fdb0 0x7fcb940c1850 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406be40 tx=0x7fcb8402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=949607eb396e3088 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.291+0000 7fcb93e00640 1 -- 172.21.15.100:0/2460759216 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84031830 con 0x7fcb9414fdb0 2024-01-20T08:12:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.291+0000 7fcb93e00640 1 -- 172.21.15.100:0/2460759216 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84031990 con 0x7fcb9414fdb0 2024-01-20T08:12:26.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.291+0000 7fcb93e00640 1 -- 172.21.15.100:0/2460759216 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84031d20 con 0x7fcb9414fdb0 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 -- 172.21.15.100:0/2460759216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9414fdb0 msgr2=0x7fcb940c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 --2- 172.21.15.100:0/2460759216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9414fdb0 0x7fcb940c1850 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fcb9406be40 tx=0x7fcb8402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 -- 172.21.15.100:0/2460759216 shutdown_connections 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 --2- 172.21.15.100:0/2460759216 >> v2:172.21.15.110:3300/0 conn(0x7fcb940c1d90 0x7fcb94152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 --2- 172.21.15.100:0/2460759216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb9414fdb0 0x7fcb940c1850 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 -- 172.21.15.100:0/2460759216 >> 172.21.15.100:0/2460759216 conn(0x7fcb940c2940 msgr2=0x7fcb940c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 -- 172.21.15.100:0/2460759216 shutdown_connections 2024-01-20T08:12:26.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.292+0000 7fcb9b800640 1 -- 172.21.15.100:0/2460759216 wait complete. 2024-01-20T08:12:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.294+0000 7fcb9b800640 1 Processor -- start 2024-01-20T08:12:26.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.294+0000 7fcb9b800640 1 -- start start 2024-01-20T08:12:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb940c1d90 0x7fcb941e9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb9414fdb0 0x7fcb940bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9406df80 con 0x7fcb940c3460 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9406c4f0 con 0x7fcb9414fdb0 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb9b800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb94151800 con 0x7fcb940c1d90 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50410/0 (socket says 172.21.15.100:50410) 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 -- 172.21.15.100:0/1490405501 learned_addr learned my addr 172.21.15.100:0/1490405501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb98e00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb940c1d90 0x7fcb941e9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb99800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb9414fdb0 0x7fcb940bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 -- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb940c1d90 msgr2=0x7fcb941e9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb940c1d90 0x7fcb941e9b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 -- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb9414fdb0 msgr2=0x7fcb940bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.295+0000 7fcb8be00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb9414fdb0 0x7fcb940bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb8be00640 1 -- 172.21.15.100:0/1490405501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009400 con 0x7fcb940c3460 2024-01-20T08:12:26.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb8be00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d800 tx=0x7fcb7c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00b6c0 con 0x7fcb940c3460 2024-01-20T08:12:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7c00b820 con 0x7fcb940c3460 2024-01-20T08:12:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7c00bbb0 con 0x7fcb940c3460 2024-01-20T08:12:26.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb94151ac0 con 0x7fcb940c3460 2024-01-20T08:12:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.296+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb94152080 con 0x7fcb940c3460 2024-01-20T08:12:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.297+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb9404e970 con 0x7fcb940c3460 2024-01-20T08:12:26.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.298+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcb7c00bd10 con 0x7fcb940c3460 2024-01-20T08:12:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.299+0000 7fcb91600640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 0x7fcb6c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.299+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fcb7c089f10 con 0x7fcb940c3460 2024-01-20T08:12:26.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.300+0000 7fcb98e00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 0x7fcb6c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:26.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.300+0000 7fcb98e00640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 0x7fcb6c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb84036000 tx=0x7fcb8403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:26.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.304+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcb7c054a50 con 0x7fcb940c3460 2024-01-20T08:12:26.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:26.533+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fcb940c2260 con 0x7fcb940c3460 2024-01-20T08:12:27.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.112+0000 7fcb91600640 1 -- 172.21.15.100:0/1490405501 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 10 and data pool 11 v33) v1 ==== 177+0+0 (secure 0 0 0) 0x7fcb7c058070 con 0x7fcb940c3460 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 10 and data pool 11 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 msgr2=0x7fcb6c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 0x7fcb6c06d390 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb84036000 tx=0x7fcb8403c040 comp rx=0 tx=0).stop 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 msgr2=0x7fcb941512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d800 tx=0x7fcb7c00dcc0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 shutdown_connections 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcb9414fdb0 0x7fcb940bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcb940c3460 0x7fcb941512c0 secure :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c00d800 tx=0x7fcb7c00dcc0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcb6c06aed0 0x7fcb6c06d390 secure :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcb84036000 tx=0x7fcb8403c040 comp rx=0 tx=0).stop 2024-01-20T08:12:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 --2- 172.21.15.100:0/1490405501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcb940c1d90 0x7fcb941e9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.120+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 >> 172.21.15.100:0/1490405501 conn(0x7fcb940c2940 msgr2=0x7fcb941460f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.123+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 shutdown_connections 2024-01-20T08:12:27.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.125+0000 7fcb9b800640 1 -- 172.21.15.100:0/1490405501 wait complete. 2024-01-20T08:12:27.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.332+0000 7facd7000640 1 Processor -- start 2024-01-20T08:12:27.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.332+0000 7facd7000640 1 -- start start 2024-01-20T08:12:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7facd006d2b0 0x7facd006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd7000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7facd00c5570 0x7facd006cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd7000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd01523a0 con 0x7facd00c3e00 2024-01-20T08:12:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd00706a0 con 0x7facd006d2b0 2024-01-20T08:12:27.336 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd7000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd0151ee0 con 0x7facd00c5570 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7facd006d2b0 0x7facd006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd5c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7facd006d2b0 0x7facd006d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50420/0 (socket says 172.21.15.100:50420) 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.333+0000 7facd5c00640 1 -- 172.21.15.100:0/2959035349 learned_addr learned my addr 172.21.15.100:0/2959035349 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.334+0000 7facd5c00640 1 -- 172.21.15.100:0/2959035349 >> v2:172.21.15.110:3300/0 conn(0x7facd00c5570 msgr2=0x7facd006cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.334+0000 7facd5c00640 1 --2- 172.21.15.100:0/2959035349 >> v2:172.21.15.110:3300/0 conn(0x7facd00c5570 0x7facd006cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.334+0000 7facd5c00640 1 -- 172.21.15.100:0/2959035349 >> v1:172.21.15.110:6789/0 conn(0x7facd00c3e00 legacy=0x7facd006c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:27.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.334+0000 7facd5c00640 1 -- 172.21.15.100:0/2959035349 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd00a53f0 con 0x7facd006d2b0 2024-01-20T08:12:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.335+0000 7facd5c00640 1 --2- 172.21.15.100:0/2959035349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd006d2b0 0x7facd006d690 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7facd0074550 tx=0x7facc002dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97b9e3a3fb72c65 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.335+0000 7faccfe00640 1 -- 172.21.15.100:0/2959035349 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc002e970 con 0x7facd006d2b0 2024-01-20T08:12:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.335+0000 7faccfe00640 1 -- 172.21.15.100:0/2959035349 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc002ead0 con 0x7facd006d2b0 2024-01-20T08:12:27.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.335+0000 7faccfe00640 1 -- 172.21.15.100:0/2959035349 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc002ee60 con 0x7facd006d2b0 2024-01-20T08:12:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 -- 172.21.15.100:0/2959035349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd006d2b0 msgr2=0x7facd006d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 --2- 172.21.15.100:0/2959035349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd006d2b0 0x7facd006d690 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7facd0074550 tx=0x7facc002dfd0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 -- 172.21.15.100:0/2959035349 shutdown_connections 2024-01-20T08:12:27.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 --2- 172.21.15.100:0/2959035349 >> v2:172.21.15.110:3300/0 conn(0x7facd00c5570 0x7facd006cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 --2- 172.21.15.100:0/2959035349 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd006d2b0 0x7facd006d690 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 -- 172.21.15.100:0/2959035349 >> 172.21.15.100:0/2959035349 conn(0x7facd00c2590 msgr2=0x7facd00c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 -- 172.21.15.100:0/2959035349 shutdown_connections 2024-01-20T08:12:27.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.336+0000 7facd7000640 1 -- 172.21.15.100:0/2959035349 wait complete. 2024-01-20T08:12:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.338+0000 7facd7000640 1 Processor -- start 2024-01-20T08:12:27.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.338+0000 7facd7000640 1 -- start start 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd006d2b0 0x7facd01527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd00c3e00 0x7facd0150060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01dba00 con 0x7facd00c5570 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd01db1f0 con 0x7facd00c3e00 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facd01db440 con 0x7facd006d2b0 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50428/0 (socket says 172.21.15.100:50428) 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.339+0000 7facd6600640 1 -- 172.21.15.100:0/1503621640 learned_addr learned my addr 172.21.15.100:0/1503621640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd5c00640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd006d2b0 0x7facd01527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd5200640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd00c3e00 0x7facd0150060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 -- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd006d2b0 msgr2=0x7facd01527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd006d2b0 0x7facd01527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 -- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd00c3e00 msgr2=0x7facd0150060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd00c3e00 0x7facd0150060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 -- 172.21.15.100:0/1503621640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc000bd40 con 0x7facd00c5570 2024-01-20T08:12:27.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd6600640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7facc800b410 tx=0x7facc800b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8011830 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc8011990 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc8011d40 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.340+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd01db720 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.341+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd01549d0 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.342+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd00749e0 con 0x7facd00c5570 2024-01-20T08:12:27.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.343+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7facc801a400 con 0x7facd00c5570 2024-01-20T08:12:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.344+0000 7faccd600640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 0x7faca806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.344+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6565+0+0 (secure 0 0 0) 0x7facc8089a70 con 0x7facd00c5570 2024-01-20T08:12:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.344+0000 7facd5c00640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 0x7faca806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.345+0000 7facd5c00640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 0x7faca806d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facc0037000 tx=0x7facc0032000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.349+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7facc80545d0 con 0x7facd00c5570 2024-01-20T08:12:27.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.535+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facd00c5350 con 0x7facd00c5570 2024-01-20T08:12:27.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.539+0000 7faccd600640 1 -- 172.21.15.100:0/1503621640 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+20270 (secure 0 0 0) 0x7facc8015090 con 0x7facd00c5570 2024-01-20T08:12:27.543 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:27.543 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:26.534993+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 msgr2=0x7faca806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 0x7faca806d390 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7facc0037000 tx=0x7facc0032000 comp rx=0 tx=0).stop 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 msgr2=0x7facd01551d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7facc800b410 tx=0x7facc800b810 comp rx=0 tx=0).stop 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 shutdown_connections 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facd00c5570 0x7facd01551d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7facd00c3e00 0x7facd0150060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faca806aed0 0x7faca806d390 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 --2- 172.21.15.100:0/1503621640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7facd006d2b0 0x7facd01527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 >> 172.21.15.100:0/1503621640 conn(0x7facd00c2590 msgr2=0x7facd0071330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 shutdown_connections 2024-01-20T08:12:27.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.542+0000 7facd7000640 1 -- 172.21.15.100:0/1503621640 wait complete. 2024-01-20T08:12:27.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.760+0000 7fa84ae00640 1 Processor -- start 2024-01-20T08:12:27.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.760+0000 7fa84ae00640 1 -- start start 2024-01-20T08:12:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.761+0000 7fa84ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.761+0000 7fa84ae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8440c5570 0x7fa84406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.761+0000 7fa84ae00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8441523a0 con 0x7fa84406d2b0 2024-01-20T08:12:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.761+0000 7fa84ae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8440706a0 con 0x7fa8440c5570 2024-01-20T08:12:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.761+0000 7fa84ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa844151ee0 con 0x7fa8440c3e00 2024-01-20T08:12:27.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.762+0000 7fa849000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.762+0000 7fa84a400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8440c5570 0x7fa84406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.762+0000 7fa849000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:51940/0 (socket says 172.21.15.100:51940) 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.762+0000 7fa849a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fa84406d2b0 0x7fa84406c460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:46886/0 (socket says 172.21.15.100:46886) 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.762+0000 7fa849000640 1 -- 172.21.15.100:0/3078867370 learned_addr learned my addr 172.21.15.100:0/3078867370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.763+0000 7fa849000640 1 -- 172.21.15.100:0/3078867370 >> v2:172.21.15.110:3300/0 conn(0x7fa8440c5570 msgr2=0x7fa84406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.763+0000 7fa849000640 1 --2- 172.21.15.100:0/3078867370 >> v2:172.21.15.110:3300/0 conn(0x7fa8440c5570 0x7fa84406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.763+0000 7fa849000640 1 -- 172.21.15.100:0/3078867370 >> v1:172.21.15.110:6789/0 conn(0x7fa84406d2b0 legacy=0x7fa84406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.763+0000 7fa849000640 1 -- 172.21.15.100:0/3078867370 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8440a53f0 con 0x7fa8440c3e00 2024-01-20T08:12:27.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.764+0000 7fa849000640 1 --2- 172.21.15.100:0/3078867370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00bb10 tx=0x7fa82c02e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa49d303005443bb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa843e00640 1 -- 172.21.15.100:0/3078867370 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c02ede0 con 0x7fa8440c3e00 2024-01-20T08:12:27.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa843e00640 1 -- 172.21.15.100:0/3078867370 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82c036440 con 0x7fa8440c3e00 2024-01-20T08:12:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa843e00640 1 -- 172.21.15.100:0/3078867370 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c0367d0 con 0x7fa8440c3e00 2024-01-20T08:12:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 -- 172.21.15.100:0/3078867370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 msgr2=0x7fa84406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 --2- 172.21.15.100:0/3078867370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00bb10 tx=0x7fa82c02e030 comp rx=0 tx=0).stop 2024-01-20T08:12:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 -- 172.21.15.100:0/3078867370 shutdown_connections 2024-01-20T08:12:27.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 --2- 172.21.15.100:0/3078867370 >> v2:172.21.15.110:3300/0 conn(0x7fa8440c5570 0x7fa84406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 --2- 172.21.15.100:0/3078867370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa84406d690 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 -- 172.21.15.100:0/3078867370 >> 172.21.15.100:0/3078867370 conn(0x7fa8440c2590 msgr2=0x7fa8440c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 -- 172.21.15.100:0/3078867370 shutdown_connections 2024-01-20T08:12:27.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.765+0000 7fa84ae00640 1 -- 172.21.15.100:0/3078867370 wait complete. 2024-01-20T08:12:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.767+0000 7fa84ae00640 1 Processor -- start 2024-01-20T08:12:27.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.767+0000 7fa84ae00640 1 -- start start 2024-01-20T08:12:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 0x7fa8440aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa8441ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440aa580 con 0x7fa8440c5570 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8441dd7d0 con 0x7fa84406d2b0 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8440c0490 con 0x7fa8440c3e00 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50432/0 (socket says 172.21.15.100:50432) 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.768+0000 7fa84a400640 1 -- 172.21.15.100:0/2227715169 learned_addr learned my addr 172.21.15.100:0/2227715169 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa849000640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa8441ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa849a00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 0x7fa8440aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 -- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 msgr2=0x7fa8441ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa8441ed930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 -- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 msgr2=0x7fa8440aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 0x7fa8440aad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 -- 172.21.15.100:0/2227715169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa82c00b770 con 0x7fa8440c5570 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa849a00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 0x7fa8440aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84a400640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00efc0 tx=0x7fa83c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c009ca0 con 0x7fa8440c5570 2024-01-20T08:12:27.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa83c00f040 con 0x7fa8440c5570 2024-01-20T08:12:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0146c0 con 0x7fa8440c5570 2024-01-20T08:12:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8441db350 con 0x7fa8440c5570 2024-01-20T08:12:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.769+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8440aa7f0 con 0x7fa8440c5570 2024-01-20T08:12:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.770+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8440749e0 con 0x7fa8440c5570 2024-01-20T08:12:27.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.771+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa83c014820 con 0x7fa8440c5570 2024-01-20T08:12:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.772+0000 7fa841600640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 0x7fa81c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.772+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa83c08a910 con 0x7fa8440c5570 2024-01-20T08:12:27.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.772+0000 7fa849a00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 0x7fa81c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:27.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.773+0000 7fa849a00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 0x7fa81c06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa834000f60 tx=0x7fa834009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:27.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.776+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa83c055470 con 0x7fa8440c5570 2024-01-20T08:12:27.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.970+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8440aa9e0 con 0x7fa8440c5570 2024-01-20T08:12:27.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.973+0000 7fa841600640 1 -- 172.21.15.100:0/2227715169 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v55) v1 ==== 74+0+20270 (secure 0 0 0) 0x7fa83c088e60 con 0x7fa8440c5570 2024-01-20T08:12:27.976 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:27.976 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:26.534993+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:27.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 msgr2=0x7fa81c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 0x7fa81c06d390 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fa834000f60 tx=0x7fa834009040 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 msgr2=0x7fa8440a88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00efc0 tx=0x7fa83c00c490 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 shutdown_connections 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8440c5570 0x7fa8440a88f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa81c06aed0 0x7fa81c06d390 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8440c3e00 0x7fa8441ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 --2- 172.21.15.100:0/2227715169 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa84406d2b0 0x7fa8440aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:27.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.975+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 >> 172.21.15.100:0/2227715169 conn(0x7fa8440c2590 msgr2=0x7fa8440c0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.976+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 shutdown_connections 2024-01-20T08:12:27.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:27.976+0000 7fa84ae00640 1 -- 172.21.15.100:0/2227715169 wait complete. 2024-01-20T08:12:27.995 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-20T08:12:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.205+0000 7f4c08600640 1 Processor -- start 2024-01-20T08:12:28.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.205+0000 7f4c08600640 1 -- start start 2024-01-20T08:12:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.206+0000 7f4c08600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4c0006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.206+0000 7f4c08600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c00154ba0 con 0x7f4c0014b720 2024-01-20T08:12:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.206+0000 7f4c08600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c00155a00 con 0x7f4c0006ce10 2024-01-20T08:12:28.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.206+0000 7f4c08600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014bb00 con 0x7f4c001515b0 2024-01-20T08:12:28.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4c05c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4c0014b720 0x7f4c000c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:59494/0 (socket says 172.21.15.100:59494) 2024-01-20T08:12:28.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4c05c00640 1 -- 172.21.15.100:0/2882358175 learned_addr learned my addr 172.21.15.100:0/2882358175 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2719197197 0 0) 0x7f4c00154ba0 con 0x7f4c0014b720 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4be0003520 con 0x7f4c0014b720 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4c05200640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4c0006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005950185 0 0) 0x7f4be0003520 con 0x7f4c0014b720 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 msgr2=0x7f4c0006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4c0006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 >> v1:172.21.15.110:6789/0 conn(0x7f4c0006ce10 legacy=0x7f4c0015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00154df0 con 0x7f4c0014b720 2024-01-20T08:12:28.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.207+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f4bf00019f0 con 0x7f4c0014b720 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 >> v1:172.21.15.100:6789/0 conn(0x7f4c0014b720 legacy=0x7f4c000c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be00039a0 0x7f4be0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4be00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4be0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0014bb00 con 0x7f4be0004d00 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4be000bb40 con 0x7f4be00039a0 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4be000bd00 con 0x7f4c001515b0 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4be0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c05200640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4be00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 -- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 msgr2=0x7f4be00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4be00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c05c00640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be00039a0 0x7f4be0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 -- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be00039a0 msgr2=0x7f4be0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:28.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4be00039a0 0x7f4be0003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c06600640 1 -- 172.21.15.100:0/2882358175 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be0003520 con 0x7f4be0004d00 2024-01-20T08:12:28.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.208+0000 7f4c05200640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c001515b0 0x7f4be00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:28.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.209+0000 7f4c06600640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4be0005180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8003d80 tx=0x7f4be00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31f82cf470f77f1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf8032600 con 0x7f4be0004d00 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf802e050 con 0x7f4be0004d00 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4bffe00640 1 -- 172.21.15.100:0/2882358175 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf80329a0 con 0x7f4be0004d00 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 -- 172.21.15.100:0/2882358175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 msgr2=0x7f4be0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 --2- 172.21.15.100:0/2882358175 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4be0005180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f4bf8003d80 tx=0x7f4be00057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c06600640 1 -- 172.21.15.100:0/2882358175 reap_dead start 2024-01-20T08:12:28.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 -- 172.21.15.100:0/2882358175 shutdown_connections 2024-01-20T08:12:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 -- 172.21.15.100:0/2882358175 >> 172.21.15.100:0/2882358175 conn(0x7f4c000c2940 msgr2=0x7f4c000c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 -- 172.21.15.100:0/2882358175 shutdown_connections 2024-01-20T08:12:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.210+0000 7f4c08600640 1 -- 172.21.15.100:0/2882358175 wait complete. 2024-01-20T08:12:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.212+0000 7f4c08600640 1 Processor -- start 2024-01-20T08:12:28.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.212+0000 7f4c08600640 1 -- start start 2024-01-20T08:12:28.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 0x7f4c000c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0013ebe0 0x7f4c0013f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c00161700 con 0x7f4be0004d00 2024-01-20T08:12:28.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c001ee6c0 con 0x7f4c0014e9f0 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c08600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c0013e420 con 0x7f4c0013ebe0 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:50446/0 (socket says 172.21.15.100:50446) 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 -- 172.21.15.100:0/4179668353 learned_addr learned my addr 172.21.15.100:0/4179668353 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05200640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 0x7f4c000c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 -- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0013ebe0 msgr2=0x7f4c0013f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c06600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0013ebe0 0x7f4c0013f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0013ebe0 0x7f4c0013f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 -- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 msgr2=0x7f4c000c1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 0x7f4c000c1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.213+0000 7f4c05c00640 1 -- 172.21.15.100:0/4179668353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c00154450 con 0x7f4be0004d00 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4c05200640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 0x7f4c000c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:28.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4c05c00640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00021f0 tx=0x7f4bf000b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0004d60 con 0x7f4be0004d00 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bf00070d0 con 0x7f4be0004d00 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bf0007480 con 0x7f4be0004d00 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c00154730 con 0x7f4be0004d00 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.214+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c0013e6c0 con 0x7f4be0004d00 2024-01-20T08:12:28.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.215+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c0004e970 con 0x7f4be0004d00 2024-01-20T08:12:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.216+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4bf00075e0 con 0x7f4be0004d00 2024-01-20T08:12:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.217+0000 7f4bfd600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 0x7f4bd806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.217+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4bf0089a80 con 0x7f4be0004d00 2024-01-20T08:12:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.217+0000 7f4c05200640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 0x7f4bd806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:28.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.218+0000 7f4c05200640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 0x7f4bd806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4c00150ac0 tx=0x7f4be8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:28.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.221+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4bf00545e0 con 0x7f4be0004d00 2024-01-20T08:12:28.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:28.452+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4c000c37e0 con 0x7f4be0004d00 2024-01-20T08:12:29.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.127+0000 7f4bfd600640 1 -- 172.21.15.100:0/4179668353 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v36) v1 ==== 119+0+0 (secure 0 0 0) 0x7f4bf00190b0 con 0x7f4be0004d00 2024-01-20T08:12:29.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 msgr2=0x7f4bd806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 0x7f4bd806d3c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4c00150ac0 tx=0x7f4be8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 msgr2=0x7f4c001ee180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f4bf00021f0 tx=0x7f4bf000b560 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 shutdown_connections 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bd806af00 0x7f4bd806d3c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4c0013ebe0 0x7f4c0013f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4c0014e9f0 0x7f4c000c1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 --2- 172.21.15.100:0/4179668353 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4be0004d00 0x7f4c001ee180 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.130+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 >> 172.21.15.100:0/4179668353 conn(0x7f4c000c2940 msgr2=0x7f4c000c4c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.131+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 shutdown_connections 2024-01-20T08:12:29.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.131+0000 7f4c08600640 1 -- 172.21.15.100:0/4179668353 wait complete. 2024-01-20T08:12:29.154 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:12:29.154 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-20T08:12:29.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.366+0000 7f7849e00640 1 Processor -- start 2024-01-20T08:12:29.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.366+0000 7f7849e00640 1 -- start start 2024-01-20T08:12:29.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.367+0000 7f7849e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f78440c4e20 0x7f7844155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.367+0000 7f7849e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.367+0000 7f7849e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78441559b0 con 0x7f78440aae30 2024-01-20T08:12:29.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.367+0000 7f7849e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78440c1930 con 0x7f78440c4e20 2024-01-20T08:12:29.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.367+0000 7f7849e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784406c160 con 0x7f78440c0ed0 2024-01-20T08:12:29.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.368+0000 7f783bc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.368+0000 7f783bc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:40714/0 (socket says 172.21.15.100:40714) 2024-01-20T08:12:29.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.368+0000 7f783bc00640 1 -- 172.21.15.100:0/2794161070 learned_addr learned my addr 172.21.15.100:0/2794161070 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:29.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.369+0000 7f7848a00640 1 --2- 172.21.15.100:0/2794161070 >> v2:172.21.15.110:3300/0 conn(0x7f78440c4e20 0x7f7844155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.369+0000 7f783bc00640 1 -- 172.21.15.100:0/2794161070 >> v2:172.21.15.110:3300/0 conn(0x7f78440c4e20 msgr2=0x7f7844155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:29.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.369+0000 7f783bc00640 1 --2- 172.21.15.100:0/2794161070 >> v2:172.21.15.110:3300/0 conn(0x7f78440c4e20 0x7f7844155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.369+0000 7f783bc00640 1 -- 172.21.15.100:0/2794161070 >> v1:172.21.15.110:6789/0 conn(0x7f78440aae30 legacy=0x7f784406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.369+0000 7f783bc00640 1 -- 172.21.15.100:0/2794161070 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78440c1b80 con 0x7f78440c0ed0 2024-01-20T08:12:29.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.370+0000 7f783bc00640 1 --2- 172.21.15.100:0/2794161070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f782c009870 tx=0x7f782c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1cf69e02925920a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:29.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.371+0000 7f7843e00640 1 -- 172.21.15.100:0/2794161070 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c031640 con 0x7f78440c0ed0 2024-01-20T08:12:29.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.371+0000 7f7843e00640 1 -- 172.21.15.100:0/2794161070 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f782c0317a0 con 0x7f78440c0ed0 2024-01-20T08:12:29.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.371+0000 7f7843e00640 1 -- 172.21.15.100:0/2794161070 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f782c031b30 con 0x7f78440c0ed0 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 -- 172.21.15.100:0/2794161070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 msgr2=0x7f78440aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 --2- 172.21.15.100:0/2794161070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f782c009870 tx=0x7f782c02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 -- 172.21.15.100:0/2794161070 shutdown_connections 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 --2- 172.21.15.100:0/2794161070 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440c0ed0 0x7f78440aa8f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 --2- 172.21.15.100:0/2794161070 >> v2:172.21.15.110:3300/0 conn(0x7f78440c4e20 0x7f7844155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 -- 172.21.15.100:0/2794161070 >> 172.21.15.100:0/2794161070 conn(0x7f78440c5ba0 msgr2=0x7f78440c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 -- 172.21.15.100:0/2794161070 shutdown_connections 2024-01-20T08:12:29.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.372+0000 7f7849e00640 1 -- 172.21.15.100:0/2794161070 wait complete. 2024-01-20T08:12:29.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.374+0000 7f7849e00640 1 Processor -- start 2024-01-20T08:12:29.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.374+0000 7f7849e00640 1 -- start start 2024-01-20T08:12:29.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440aae30 0x7f78441db1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78440c0ed0 0x7f78441eb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440a8430 con 0x7f78440c4e20 2024-01-20T08:12:29.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78440a7b90 con 0x7f78440c0ed0 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78440a7e70 con 0x7f78440aae30 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35362/0 (socket says 172.21.15.100:35362) 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7849400640 1 -- 172.21.15.100:0/1159098939 learned_addr learned my addr 172.21.15.100:0/1159098939 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f783bc00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78440c0ed0 0x7f78441eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.375+0000 7f7848a00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440aae30 0x7f78441db1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 -- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440aae30 msgr2=0x7f78441db1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440aae30 0x7f78441db1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 -- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78440c0ed0 msgr2=0x7f78441eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78440c0ed0 0x7f78441eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:29.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 -- 172.21.15.100:0/1159098939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0094d0 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849400640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c7a0 tx=0x7f783c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c003b70 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f783c003cf0 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f783c003ea0 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78440a8150 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.376+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78441db730 con 0x7f78440c4e20 2024-01-20T08:12:29.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.377+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78441eb550 con 0x7f78440c4e20 2024-01-20T08:12:29.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.378+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f783c00aa90 con 0x7f78440c4e20 2024-01-20T08:12:29.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.379+0000 7f7841600640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 0x7f781c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:29.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.379+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f783c089610 con 0x7f78440c4e20 2024-01-20T08:12:29.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.379+0000 7f7848a00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 0x7f781c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:29.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.380+0000 7f7848a00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 0x7f781c06d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7834006fd0 tx=0x7f7834008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:29.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.384+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f78441eb550 con 0x7f78440c4e20 2024-01-20T08:12:29.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:29.616+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f78441559b0 con 0x7f78440c4e20 2024-01-20T08:12:30.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.137+0000 7f7841600640 1 -- 172.21.15.100:0/1159098939 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v37) v1 ==== 123+0+0 (secure 0 0 0) 0x7f78441559b0 con 0x7f78440c4e20 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.140+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 msgr2=0x7f781c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.140+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 0x7f781c06d3c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7834006fd0 tx=0x7f7834008040 comp rx=0 tx=0).stop 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.140+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 msgr2=0x7f78441ebd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.140+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f783c00c7a0 tx=0x7f783c00cc60 comp rx=0 tx=0).stop 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 shutdown_connections 2024-01-20T08:12:30.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78440c4e20 0x7f78441ebd70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f78440c0ed0 0x7f78441eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f781c06af00 0x7f781c06d3c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 --2- 172.21.15.100:0/1159098939 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f78440aae30 0x7f78441db1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 >> 172.21.15.100:0/1159098939 conn(0x7f78440c5ba0 msgr2=0x7f78440befd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 shutdown_connections 2024-01-20T08:12:30.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.141+0000 7f7849e00640 1 -- 172.21.15.100:0/1159098939 wait complete. 2024-01-20T08:12:30.166 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-20T08:12:30.166 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:30.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.371+0000 7f7f31400640 1 Processor -- start 2024-01-20T08:12:30.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.371+0000 7f7f31400640 1 -- start start 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f31400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7f2c151f60 0x7f7f2c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f31400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c0c1670 con 0x7f7f2c147f20 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f31400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f2c070800 con 0x7f7f2c070370 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f31400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f2c0c2210 con 0x7f7f2c151f60 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f2a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7f2c147f20 0x7f7f2c0c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39120/0 (socket says 172.21.15.100:39120) 2024-01-20T08:12:30.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.372+0000 7f7f2a800640 1 -- 172.21.15.100:0/1755636633 learned_addr learned my addr 172.21.15.100:0/1755636633 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303743752 0 0) 0x7f7f2c0c1670 con 0x7f7f2c147f20 2024-01-20T08:12:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f0c003520 con 0x7f7f2c147f20 2024-01-20T08:12:30.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29e00640 1 --2- 172.21.15.100:0/1755636633 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c151f60 0x7f7f2c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2773066261 0 0) 0x7f7f0c003520 con 0x7f7f2c147f20 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c151f60 msgr2=0x7f7f2c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 --2- 172.21.15.100:0/1755636633 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c151f60 0x7f7f2c0abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 >> v1:172.21.15.110:6789/0 conn(0x7f7f2c070370 legacy=0x7f7f2c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c0c0d40 con 0x7f7f2c147f20 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7f1c001670 con 0x7f7f2c147f20 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 >> v1:172.21.15.100:6789/0 conn(0x7f7f2c147f20 legacy=0x7f7f2c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 0x7f7f0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.373+0000 7f7f29400640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0047c0 0x7f7f0c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f29400640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c005380 0x7f7f0c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c0c2210 con 0x7f7f0c0039c0 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c00c1f0 con 0x7f7f0c0047c0 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f0c00c3b0 con 0x7f7f0c005380 2024-01-20T08:12:30.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f29e00640 1 --2- 172.21.15.100:0/1755636633 >> v2:172.21.15.110:3300/0 conn(0x7f7f2c151f60 0x7f7f2c0abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 0x7f7f0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 -- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c005380 msgr2=0x7f7f0c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c005380 0x7f7f0c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 -- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0047c0 msgr2=0x7f7f0c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f0c0047c0 0x7f7f0c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2a800640 1 -- 172.21.15.100:0/1755636633 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c003520 con 0x7f7f0c0039c0 2024-01-20T08:12:30.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.374+0000 7f7f2b200640 1 -- 172.21.15.100:0/1755636633 reap_dead start 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.375+0000 7f7f2a800640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 0x7f7f0c003de0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c0e0 tx=0x7f7f0c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad710819f9d4649d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c005ad0 con 0x7f7f0c0039c0 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c005c30 con 0x7f7f0c0039c0 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f29400640 1 -- 172.21.15.100:0/1755636633 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c02ca50 con 0x7f7f0c0039c0 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 -- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 msgr2=0x7f7f0c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 0x7f7f0c003de0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c00c0e0 tx=0x7f7f0c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 -- 172.21.15.100:0/1755636633 shutdown_connections 2024-01-20T08:12:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 --2- 172.21.15.100:0/1755636633 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f0c0039c0 0x7f7f0c003de0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 -- 172.21.15.100:0/1755636633 >> 172.21.15.100:0/1755636633 conn(0x7f7f2c06a5e0 msgr2=0x7f7f2c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 -- 172.21.15.100:0/1755636633 shutdown_connections 2024-01-20T08:12:30.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.376+0000 7f7f31400640 1 -- 172.21.15.100:0/1755636633 wait complete. 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.378+0000 7f7f31400640 1 Processor -- start 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.378+0000 7f7f31400640 1 -- start start 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c0039c0 0x7f7f2c1503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c148f50 0x7f7f2c0aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c14e330 con 0x7f7f2c1533c0 2024-01-20T08:12:30.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c14dd70 con 0x7f7f2c148f50 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f31400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f2c14e050 con 0x7f7f0c0039c0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f2b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f2b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35376/0 (socket says 172.21.15.100:35376) 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.379+0000 7f7f2b200640 1 -- 172.21.15.100:0/3057393443 learned_addr learned my addr 172.21.15.100:0/3057393443 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2a800640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c0039c0 0x7f7f2c1503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f29e00640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c148f50 0x7f7f2c0aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 -- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c0039c0 msgr2=0x7f7f2c1503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c0039c0 0x7f7f2c1503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 -- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c148f50 msgr2=0x7f7f2c0aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c148f50 0x7f7f2c0aaff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 -- 172.21.15.100:0/3057393443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f2c1ea590 con 0x7f7f2c1533c0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f2b200640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c072210 tx=0x7f7f2400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24007070 con 0x7f7f2c1533c0 2024-01-20T08:12:30.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240071d0 con 0x7f7f2c1533c0 2024-01-20T08:12:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240075c0 con 0x7f7f2c1533c0 2024-01-20T08:12:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f2c1ea870 con 0x7f7f2c1533c0 2024-01-20T08:12:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.380+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f2c1eb2d0 con 0x7f7f2c1533c0 2024-01-20T08:12:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.381+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2c1eaa60 con 0x7f7f2c1533c0 2024-01-20T08:12:30.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.382+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7f24007720 con 0x7f7f2c1533c0 2024-01-20T08:12:30.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.383+0000 7f7f22a00640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 0x7f7f0406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.383+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7f24088d30 con 0x7f7f2c1533c0 2024-01-20T08:12:30.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.383+0000 7f7f2a800640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 0x7f7f0406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.384+0000 7f7f2a800640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 0x7f7f0406d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c034000 tx=0x7f7f1c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.387+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7f24053890 con 0x7f7f2c1533c0 2024-01-20T08:12:30.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.616+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f2c04e970 con 0x7f7f2c1533c0 2024-01-20T08:12:30.620 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.617+0000 7f7f22a00640 1 -- 172.21.15.100:0/3057393443 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6191 (secure 0 0 0) 0x7f7f24017070 con 0x7f7f2c1533c0 2024-01-20T08:12:30.620 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:30.620 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:30.621 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-01-20T08:12:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 msgr2=0x7f7f0406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 0x7f7f0406d3c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c034000 tx=0x7f7f1c009030 comp rx=0 tx=0).stop 2024-01-20T08:12:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 msgr2=0x7f7f2c1ead90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c072210 tx=0x7f7f2400c960 comp rx=0 tx=0).stop 2024-01-20T08:12:30.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 shutdown_connections 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7f2c1533c0 0x7f7f2c1ead90 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7f2c148f50 0x7f7f2c0aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7f0406af00 0x7f7f0406d3c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 --2- 172.21.15.100:0/3057393443 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7f0c0039c0 0x7f7f2c1503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 >> 172.21.15.100:0/3057393443 conn(0x7f7f2c06a5e0 msgr2=0x7f7f2c0c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 shutdown_connections 2024-01-20T08:12:30.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.620+0000 7f7f31400640 1 -- 172.21.15.100:0/3057393443 wait complete. 2024-01-20T08:12:30.642 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.839+0000 7f6ba7e00640 1 Processor -- start 2024-01-20T08:12:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.839+0000 7f6ba7e00640 1 -- start start 2024-01-20T08:12:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.840+0000 7f6ba7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6ba0151f60 0x7f6ba00abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.840+0000 7f6ba7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.840+0000 7f6ba7e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ba00c1670 con 0x7f6ba0147f20 2024-01-20T08:12:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba7e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ba00c2210 con 0x7f6ba0151f60 2024-01-20T08:12:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba01524b0 con 0x7f6ba0070370 2024-01-20T08:12:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba5e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:40770/0 (socket says 172.21.15.100:40770) 2024-01-20T08:12:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba5e00640 1 -- 172.21.15.100:0/4227441341 learned_addr learned my addr 172.21.15.100:0/4227441341 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.841+0000 7f6ba4a00640 1 --2- 172.21.15.100:0/4227441341 >> v2:172.21.15.110:3300/0 conn(0x7f6ba0151f60 0x7f6ba00abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.842+0000 7f6b9fe00640 1 -- 172.21.15.100:0/4227441341 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 484431786 0 0) 0x7f6ba00c1670 con 0x7f6ba0147f20 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.842+0000 7f6ba5e00640 1 -- 172.21.15.100:0/4227441341 >> v2:172.21.15.110:3300/0 conn(0x7f6ba0151f60 msgr2=0x7f6ba00abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.842+0000 7f6ba5e00640 1 --2- 172.21.15.100:0/4227441341 >> v2:172.21.15.110:3300/0 conn(0x7f6ba0151f60 0x7f6ba00abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.842+0000 7f6ba5e00640 1 -- 172.21.15.100:0/4227441341 >> v1:172.21.15.110:6789/0 conn(0x7f6ba0147f20 legacy=0x7f6ba00c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.842+0000 7f6ba5e00640 1 -- 172.21.15.100:0/4227441341 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ba0070820 con 0x7f6ba0070370 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.843+0000 7f6ba5e00640 1 --2- 172.21.15.100:0/4227441341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009e50 tx=0x7f6b9802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=445c8a059d6202cf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6b9fe00640 1 -- 172.21.15.100:0/4227441341 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9802cb00 con 0x7f6ba0070370 2024-01-20T08:12:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6b9fe00640 1 -- 172.21.15.100:0/4227441341 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9802cc60 con 0x7f6ba0070370 2024-01-20T08:12:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6b9fe00640 1 -- 172.21.15.100:0/4227441341 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b980343f0 con 0x7f6ba0070370 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 -- 172.21.15.100:0/4227441341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 msgr2=0x7f6ba00c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/4227441341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6b98009e50 tx=0x7f6b9802bf60 comp rx=0 tx=0).stop 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 -- 172.21.15.100:0/4227441341 shutdown_connections 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/4227441341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0070370 0x7f6ba00c2c30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/4227441341 >> v2:172.21.15.110:3300/0 conn(0x7f6ba0151f60 0x7f6ba00abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.844+0000 7f6ba7e00640 1 -- 172.21.15.100:0/4227441341 >> 172.21.15.100:0/4227441341 conn(0x7f6ba006a5e0 msgr2=0x7f6ba006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.845+0000 7f6ba7e00640 1 -- 172.21.15.100:0/4227441341 shutdown_connections 2024-01-20T08:12:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.845+0000 7f6ba7e00640 1 -- 172.21.15.100:0/4227441341 wait complete. 2024-01-20T08:12:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.846+0000 7f6ba7e00640 1 Processor -- start 2024-01-20T08:12:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.846+0000 7f6ba7e00640 1 -- start start 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba0147f20 0x7f6ba0155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0151f60 0x7f6ba01555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba014c6c0 con 0x7f6ba0070370 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba014ed30 con 0x7f6ba0147f20 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.847+0000 7f6ba7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ba014e770 con 0x7f6ba0151f60 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35382/0 (socket says 172.21.15.100:35382) 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 -- 172.21.15.100:0/987078969 learned_addr learned my addr 172.21.15.100:0/987078969 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0151f60 0x7f6ba01555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 -- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0151f60 msgr2=0x7f6ba01555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0151f60 0x7f6ba01555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 -- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba0147f20 msgr2=0x7f6ba0155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba0147f20 0x7f6ba0155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 -- 172.21.15.100:0/987078969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98009b30 con 0x7f6ba0070370 2024-01-20T08:12:30.852 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.848+0000 7f6ba5400640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c460 tx=0x7f6b9000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.849+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b90005480 con 0x7f6ba0070370 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.849+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b900035f0 con 0x7f6ba0070370 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.849+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b900039a0 con 0x7f6ba0070370 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.849+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ba014ea50 con 0x7f6ba0070370 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.849+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ba014d090 con 0x7f6ba0070370 2024-01-20T08:12:30.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.850+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ba014b800 con 0x7f6ba0070370 2024-01-20T08:12:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.851+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6b90003b00 con 0x7f6ba0070370 2024-01-20T08:12:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.852+0000 7f6b9d600640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 0x7f6b7806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.852+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6b90089460 con 0x7f6ba0070370 2024-01-20T08:12:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.852+0000 7f6ba4a00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 0x7f6b7806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:30.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.853+0000 7f6ba4a00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 0x7f6b7806d390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba01e59d0 tx=0x7f6b88009500 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:30.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:30.856+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6ba014b800 con 0x7f6ba0070370 2024-01-20T08:12:31.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.050+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ba014b800 con 0x7f6ba0070370 2024-01-20T08:12:31.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.054+0000 7f6b9d600640 1 -- 172.21.15.100:0/987078969 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7f6ba014b800 con 0x7f6ba0070370 2024-01-20T08:12:31.058 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:31.058 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:31.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 msgr2=0x7f6b7806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 0x7f6b7806d390 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6ba01e59d0 tx=0x7f6b88009500 comp rx=0 tx=0).stop 2024-01-20T08:12:31.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 msgr2=0x7f6ba014cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000c460 tx=0x7f6b9000c920 comp rx=0 tx=0).stop 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 shutdown_connections 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6b7806aed0 0x7f6b7806d390 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ba0151f60 0x7f6ba01555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ba0147f20 0x7f6ba0155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 --2- 172.21.15.100:0/987078969 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6ba0070370 0x7f6ba014cb50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 >> 172.21.15.100:0/987078969 conn(0x7f6ba006a5e0 msgr2=0x7f6ba006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 shutdown_connections 2024-01-20T08:12:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.057+0000 7f6ba7e00640 1 -- 172.21.15.100:0/987078969 wait complete. 2024-01-20T08:12:31.078 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:12:31.078 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:31.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.268+0000 7f67ae600640 1 Processor -- start 2024-01-20T08:12:31.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.269+0000 7f67ae600640 1 -- start start 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67ae600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f67a8152030 0x7f67a81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67ae600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67a8154d70 0x7f67a8155220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67ae600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a81548e0 con 0x7f67a80707a0 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67ae600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a8158cf0 con 0x7f67a8154d70 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67ae600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a80c2900 con 0x7f67a8152030 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67a8154d70 0x7f67a8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f67a8154d70 0x7f67a8155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35392/0 (socket says 172.21.15.100:35392) 2024-01-20T08:12:31.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 -- 172.21.15.100:0/3958386168 learned_addr learned my addr 172.21.15.100:0/3958386168 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 -- 172.21.15.100:0/3958386168 >> v2:172.21.15.110:3300/0 conn(0x7f67a8152030 msgr2=0x7f67a81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 --2- 172.21.15.100:0/3958386168 >> v2:172.21.15.110:3300/0 conn(0x7f67a8152030 0x7f67a81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 -- 172.21.15.100:0/3958386168 >> v1:172.21.15.110:6789/0 conn(0x7f67a80707a0 legacy=0x7f67a80c8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:31.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.270+0000 7f67a7e00640 1 -- 172.21.15.100:0/3958386168 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a80c2ba0 con 0x7f67a8154d70 2024-01-20T08:12:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67a7e00640 1 --2- 172.21.15.100:0/3958386168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a8154d70 0x7f67a8155220 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009870 tx=0x7f67a002b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de2bf5a8b78fcbe server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67a6000640 1 -- 172.21.15.100:0/3958386168 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a00317d0 con 0x7f67a8154d70 2024-01-20T08:12:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67a6000640 1 -- 172.21.15.100:0/3958386168 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a0031930 con 0x7f67a8154d70 2024-01-20T08:12:31.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67a6000640 1 -- 172.21.15.100:0/3958386168 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0031cc0 con 0x7f67a8154d70 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67ae600640 1 -- 172.21.15.100:0/3958386168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a8154d70 msgr2=0x7f67a8155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.272+0000 7f67ae600640 1 --2- 172.21.15.100:0/3958386168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a8154d70 0x7f67a8155220 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f67a0009870 tx=0x7f67a002b870 comp rx=0 tx=0).stop 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 -- 172.21.15.100:0/3958386168 shutdown_connections 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 --2- 172.21.15.100:0/3958386168 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a8154d70 0x7f67a8155220 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 --2- 172.21.15.100:0/3958386168 >> v2:172.21.15.110:3300/0 conn(0x7f67a8152030 0x7f67a81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 -- 172.21.15.100:0/3958386168 >> 172.21.15.100:0/3958386168 conn(0x7f67a8066760 msgr2=0x7f67a8066b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 -- 172.21.15.100:0/3958386168 shutdown_connections 2024-01-20T08:12:31.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.273+0000 7f67ae600640 1 -- 172.21.15.100:0/3958386168 wait complete. 2024-01-20T08:12:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.274+0000 7f67ae600640 1 Processor -- start 2024-01-20T08:12:31.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.274+0000 7f67ae600640 1 -- start start 2024-01-20T08:12:31.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 0x7f67a8153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67a806c830 0x7f67a806cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a80ac2f0 con 0x7f67a80707a0 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8152cc0 con 0x7f67a8154d70 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.275+0000 7f67ae600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a8153240 con 0x7f67a806c830 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35394/0 (socket says 172.21.15.100:35394) 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 -- 172.21.15.100:0/3242535156 learned_addr learned my addr 172.21.15.100:0/3242535156 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a6a00640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 0x7f67a8153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7e00640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67a806c830 0x7f67a806cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 -- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67a806c830 msgr2=0x7f67a806cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67a806c830 0x7f67a806cce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 -- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 msgr2=0x7f67a8153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 0x7f67a8153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 -- 172.21.15.100:0/3242535156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a00094d0 con 0x7f67a80707a0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a6a00640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 0x7f67a8153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.276+0000 7f67a7400640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f679000b410 tx=0x7f679000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.277+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011830 con 0x7f67a80707a0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.277+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67900119b0 con 0x7f67a80707a0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.277+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6790011d60 con 0x7f67a80707a0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.277+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a80abd30 con 0x7f67a80707a0 2024-01-20T08:12:31.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.277+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a8152ed0 con 0x7f67a80707a0 2024-01-20T08:12:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.278+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a8067b60 con 0x7f67a80707a0 2024-01-20T08:12:31.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.279+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f679001a400 con 0x7f67a80707a0 2024-01-20T08:12:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.280+0000 7f679f400640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 0x7f678006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.280+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6790089a60 con 0x7f67a80707a0 2024-01-20T08:12:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.280+0000 7f67a6a00640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 0x7f678006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.283 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.281+0000 7f67a6a00640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 0x7f678006d3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f67a8158b30 tx=0x7f67980073a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.284+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f67900545d0 con 0x7f67a80707a0 2024-01-20T08:12:31.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.473+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f67a8153520 con 0x7f678006af00 2024-01-20T08:12:31.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.510+0000 7f679f400640 1 -- 172.21.15.100:0/3242535156 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+513584 (secure 0 0 0) 0x7f67a8153520 con 0x7f678006af00 2024-01-20T08:12:31.520 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:31.524 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 msgr2=0x7f678006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 0x7f678006d3c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f67a8158b30 tx=0x7f67980073a0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 msgr2=0x7f67a8148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f679000b410 tx=0x7f679000b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 shutdown_connections 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f678006af00 0x7f678006d3c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f67a806c830 0x7f67a806cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f67a8154d70 0x7f67a8153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 --2- 172.21.15.100:0/3242535156 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f67a80707a0 0x7f67a8148c50 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 >> 172.21.15.100:0/3242535156 conn(0x7f67a8066760 msgr2=0x7f67a80c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:31.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 shutdown_connections 2024-01-20T08:12:31.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.518+0000 7f67ae600640 1 -- 172.21.15.100:0/3242535156 wait complete. 2024-01-20T08:12:31.541 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2024-01-20T08:12:29.928893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":258,"acting":258,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":197,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":243132,"kb_used_data":6172,"kb_used_omap":12,"kb_used_meta":236851,"kb_avail":754731588,"statfs":{"total":773094113280,"available":772845146112,"internally_reserved":0,"allocated":6320128,"data_stored":3332251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":242535985},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1241,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.864592"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988251+0000","last_change":"2024-01-20T08:12:07.068510+0000","last_active":"2024-01-20T08:12:10.988251+0000","last_peered":"2024-01-20T08:12:10.988251+0000","last_clean":"2024-01-20T08:12:10.988251+0000","last_became_active":"2024-01-20T08:12:07.068099+0000","last_became_peered":"2024-01-20T08:12:07.068099+0000","last_unstale":"2024-01-20T08:12:10.988251+0000","last_undegraded":"2024-01-20T08:12:10.988251+0000","last_fullsized":"2024-01-20T08:12:10.988251+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:51.051735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990971+0000","last_change":"2024-01-20T08:12:07.066208+0000","last_active":"2024-01-20T08:12:10.990971+0000","last_peered":"2024-01-20T08:12:10.990971+0000","last_clean":"2024-01-20T08:12:10.990971+0000","last_became_active":"2024-01-20T08:12:07.065935+0000","last_became_peered":"2024-01-20T08:12:07.065935+0000","last_unstale":"2024-01-20T08:12:10.990971+0000","last_undegraded":"2024-01-20T08:12:10.990971+0000","last_fullsized":"2024-01-20T08:12:10.990971+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:55:51.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992287+0000","last_change":"2024-01-20T08:12:07.079204+0000","last_active":"2024-01-20T08:12:10.992287+0000","last_peered":"2024-01-20T08:12:10.992287+0000","last_clean":"2024-01-20T08:12:10.992287+0000","last_became_active":"2024-01-20T08:12:07.078933+0000","last_became_peered":"2024-01-20T08:12:07.078933+0000","last_unstale":"2024-01-20T08:12:10.992287+0000","last_undegraded":"2024-01-20T08:12:10.992287+0000","last_fullsized":"2024-01-20T08:12:10.992287+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987874+0000","last_change":"2024-01-20T08:12:07.078940+0000","last_active":"2024-01-20T08:12:10.987874+0000","last_peered":"2024-01-20T08:12:10.987874+0000","last_clean":"2024-01-20T08:12:10.987874+0000","last_became_active":"2024-01-20T08:12:07.076282+0000","last_became_peered":"2024-01-20T08:12:07.076282+0000","last_unstale":"2024-01-20T08:12:10.987874+0000","last_undegraded":"2024-01-20T08:12:10.987874+0000","last_fullsized":"2024-01-20T08:12:10.987874+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988218+0000","last_change":"2024-01-20T08:12:07.079405+0000","last_active":"2024-01-20T08:12:10.988218+0000","last_peered":"2024-01-20T08:12:10.988218+0000","last_clean":"2024-01-20T08:12:10.988218+0000","last_became_active":"2024-01-20T08:12:07.079108+0000","last_became_peered":"2024-01-20T08:12:07.079108+0000","last_unstale":"2024-01-20T08:12:10.988218+0000","last_undegraded":"2024-01-20T08:12:10.988218+0000","last_fullsized":"2024-01-20T08:12:10.988218+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:18.953566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992874+0000","last_change":"2024-01-20T08:12:07.069601+0000","last_active":"2024-01-20T08:12:10.992874+0000","last_peered":"2024-01-20T08:12:10.992874+0000","last_clean":"2024-01-20T08:12:10.992874+0000","last_became_active":"2024-01-20T08:12:07.069275+0000","last_became_peered":"2024-01-20T08:12:07.069275+0000","last_unstale":"2024-01-20T08:12:10.992874+0000","last_undegraded":"2024-01-20T08:12:10.992874+0000","last_fullsized":"2024-01-20T08:12:10.992874+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987133+0000","last_change":"2024-01-20T08:12:07.075671+0000","last_active":"2024-01-20T08:12:10.987133+0000","last_peered":"2024-01-20T08:12:10.987133+0000","last_clean":"2024-01-20T08:12:10.987133+0000","last_became_active":"2024-01-20T08:12:07.074069+0000","last_became_peered":"2024-01-20T08:12:07.074069+0000","last_unstale":"2024-01-20T08:12:10.987133+0000","last_undegraded":"2024-01-20T08:12:10.987133+0000","last_fullsized":"2024-01-20T08:12:10.987133+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990845+0000","last_change":"2024-01-20T08:12:07.066879+0000","last_active":"2024-01-20T08:12:10.990845+0000","last_peered":"2024-01-20T08:12:10.990845+0000","last_clean":"2024-01-20T08:12:10.990845+0000","last_became_active":"2024-01-20T08:12:07.066268+0000","last_became_peered":"2024-01-20T08:12:07.066268+0000","last_unstale":"2024-01-20T08:12:10.990845+0000","last_undegraded":"2024-01-20T08:12:10.990845+0000","last_fullsized":"2024-01-20T08:12:10.990845+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:22.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987275+0000","last_change":"2024-01-20T08:12:07.071750+0000","last_active":"2024-01-20T08:12:10.987275+0000","last_peered":"2024-01-20T08:12:10.987275+0000","last_clean":"2024-01-20T08:12:10.987275+0000","last_became_active":"2024-01-20T08:12:07.071410+0000","last_became_peered":"2024-01-20T08:12:07.071410+0000","last_unstale":"2024-01-20T08:12:10.987275+0000","last_undegraded":"2024-01-20T08:12:10.987275+0000","last_fullsized":"2024-01-20T08:12:10.987275+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:10.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.985008+0000","last_change":"2024-01-20T08:12:07.064925+0000","last_active":"2024-01-20T08:12:10.985008+0000","last_peered":"2024-01-20T08:12:10.985008+0000","last_clean":"2024-01-20T08:12:10.985008+0000","last_became_active":"2024-01-20T08:12:07.064314+0000","last_became_peered":"2024-01-20T08:12:07.064314+0000","last_unstale":"2024-01-20T08:12:10.985008+0000","last_undegraded":"2024-01-20T08:12:10.985008+0000","last_fullsized":"2024-01-20T08:12:10.985008+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:52.116068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984995+0000","last_change":"2024-01-20T08:12:07.069329+0000","last_active":"2024-01-20T08:12:10.984995+0000","last_peered":"2024-01-20T08:12:10.984995+0000","last_clean":"2024-01-20T08:12:10.984995+0000","last_became_active":"2024-01-20T08:12:07.068957+0000","last_became_peered":"2024-01-20T08:12:07.068957+0000","last_unstale":"2024-01-20T08:12:10.984995+0000","last_undegraded":"2024-01-20T08:12:10.984995+0000","last_fullsized":"2024-01-20T08:12:10.984995+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:15.643241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987889+0000","last_change":"2024-01-20T08:12:07.077771+0000","last_active":"2024-01-20T08:12:10.987889+0000","last_peered":"2024-01-20T08:12:10.987889+0000","last_clean":"2024-01-20T08:12:10.987889+0000","last_became_active":"2024-01-20T08:12:07.077498+0000","last_became_peered":"2024-01-20T08:12:07.077498+0000","last_unstale":"2024-01-20T08:12:10.987889+0000","last_undegraded":"2024-01-20T08:12:10.987889+0000","last_fullsized":"2024-01-20T08:12:10.987889+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984260+0000","last_change":"2024-01-20T08:12:07.070855+0000","last_active":"2024-01-20T08:12:10.984260+0000","last_peered":"2024-01-20T08:12:10.984260+0000","last_clean":"2024-01-20T08:12:10.984260+0000","last_became_active":"2024-01-20T08:12:07.070467+0000","last_became_peered":"2024-01-20T08:12:07.070467+0000","last_unstale":"2024-01-20T08:12:10.984260+0000","last_undegraded":"2024-01-20T08:12:10.984260+0000","last_fullsized":"2024-01-20T08:12:10.984260+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:45.947061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987187+0000","last_change":"2024-01-20T08:12:07.066074+0000","last_active":"2024-01-20T08:12:10.987187+0000","last_peered":"2024-01-20T08:12:10.987187+0000","last_clean":"2024-01-20T08:12:10.987187+0000","last_became_active":"2024-01-20T08:12:07.063801+0000","last_became_peered":"2024-01-20T08:12:07.063801+0000","last_unstale":"2024-01-20T08:12:10.987187+0000","last_undegraded":"2024-01-20T08:12:10.987187+0000","last_fullsized":"2024-01-20T08:12:10.987187+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:40.896208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987160+0000","last_change":"2024-01-20T08:12:07.055740+0000","last_active":"2024-01-20T08:12:10.987160+0000","last_peered":"2024-01-20T08:12:10.987160+0000","last_clean":"2024-01-20T08:12:10.987160+0000","last_became_active":"2024-01-20T08:12:07.055037+0000","last_became_peered":"2024-01-20T08:12:07.055037+0000","last_unstale":"2024-01-20T08:12:10.987160+0000","last_undegraded":"2024-01-20T08:12:10.987160+0000","last_fullsized":"2024-01-20T08:12:10.987160+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:07.521556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992832+0000","last_change":"2024-01-20T08:12:07.079668+0000","last_active":"2024-01-20T08:12:10.992832+0000","last_peered":"2024-01-20T08:12:10.992832+0000","last_clean":"2024-01-20T08:12:10.992832+0000","last_became_active":"2024-01-20T08:12:07.075321+0000","last_became_peered":"2024-01-20T08:12:07.075321+0000","last_unstale":"2024-01-20T08:12:10.992832+0000","last_undegraded":"2024-01-20T08:12:10.992832+0000","last_fullsized":"2024-01-20T08:12:10.992832+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990989+0000","last_change":"2024-01-20T08:12:07.068449+0000","last_active":"2024-01-20T08:12:10.990989+0000","last_peered":"2024-01-20T08:12:10.990989+0000","last_clean":"2024-01-20T08:12:10.990989+0000","last_became_active":"2024-01-20T08:12:07.067404+0000","last_became_peered":"2024-01-20T08:12:07.067404+0000","last_unstale":"2024-01-20T08:12:10.990989+0000","last_undegraded":"2024-01-20T08:12:10.990989+0000","last_fullsized":"2024-01-20T08:12:10.990989+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:33:44.143818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992352+0000","last_change":"2024-01-20T08:12:07.081616+0000","last_active":"2024-01-20T08:12:10.992352+0000","last_peered":"2024-01-20T08:12:10.992352+0000","last_clean":"2024-01-20T08:12:10.992352+0000","last_became_active":"2024-01-20T08:12:07.081014+0000","last_became_peered":"2024-01-20T08:12:07.081014+0000","last_unstale":"2024-01-20T08:12:10.992352+0000","last_undegraded":"2024-01-20T08:12:10.992352+0000","last_fullsized":"2024-01-20T08:12:10.992352+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988241+0000","last_change":"2024-01-20T08:12:07.077693+0000","last_active":"2024-01-20T08:12:10.988241+0000","last_peered":"2024-01-20T08:12:10.988241+0000","last_clean":"2024-01-20T08:12:10.988241+0000","last_became_active":"2024-01-20T08:12:07.077448+0000","last_became_peered":"2024-01-20T08:12:07.077448+0000","last_unstale":"2024-01-20T08:12:10.988241+0000","last_undegraded":"2024-01-20T08:12:10.988241+0000","last_fullsized":"2024-01-20T08:12:10.988241+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:56.215178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990939+0000","last_change":"2024-01-20T08:12:07.079543+0000","last_active":"2024-01-20T08:12:10.990939+0000","last_peered":"2024-01-20T08:12:10.990939+0000","last_clean":"2024-01-20T08:12:10.990939+0000","last_became_active":"2024-01-20T08:12:07.078435+0000","last_became_peered":"2024-01-20T08:12:07.078435+0000","last_unstale":"2024-01-20T08:12:10.990939+0000","last_undegraded":"2024-01-20T08:12:10.990939+0000","last_fullsized":"2024-01-20T08:12:10.990939+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:28.706699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992239+0000","last_change":"2024-01-20T08:12:07.080145+0000","last_active":"2024-01-20T08:12:10.992239+0000","last_peered":"2024-01-20T08:12:10.992239+0000","last_clean":"2024-01-20T08:12:10.992239+0000","last_became_active":"2024-01-20T08:12:07.079803+0000","last_became_peered":"2024-01-20T08:12:07.079803+0000","last_unstale":"2024-01-20T08:12:10.992239+0000","last_undegraded":"2024-01-20T08:12:10.992239+0000","last_fullsized":"2024-01-20T08:12:10.992239+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:35.347679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990891+0000","last_change":"2024-01-20T08:12:07.072637+0000","last_active":"2024-01-20T08:12:10.990891+0000","last_peered":"2024-01-20T08:12:10.990891+0000","last_clean":"2024-01-20T08:12:10.990891+0000","last_became_active":"2024-01-20T08:12:07.068029+0000","last_became_peered":"2024-01-20T08:12:07.068029+0000","last_unstale":"2024-01-20T08:12:10.990891+0000","last_undegraded":"2024-01-20T08:12:10.990891+0000","last_fullsized":"2024-01-20T08:12:10.990891+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:48.804666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992181+0000","last_change":"2024-01-20T08:12:07.087617+0000","last_active":"2024-01-20T08:12:10.992181+0000","last_peered":"2024-01-20T08:12:10.992181+0000","last_clean":"2024-01-20T08:12:10.992181+0000","last_became_active":"2024-01-20T08:12:07.085114+0000","last_became_peered":"2024-01-20T08:12:07.085114+0000","last_unstale":"2024-01-20T08:12:10.992181+0000","last_undegraded":"2024-01-20T08:12:10.992181+0000","last_fullsized":"2024-01-20T08:12:10.992181+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984149+0000","last_change":"2024-01-20T08:12:07.072912+0000","last_active":"2024-01-20T08:12:10.984149+0000","last_peered":"2024-01-20T08:12:10.984149+0000","last_clean":"2024-01-20T08:12:10.984149+0000","last_became_active":"2024-01-20T08:12:07.072564+0000","last_became_peered":"2024-01-20T08:12:07.072564+0000","last_unstale":"2024-01-20T08:12:10.984149+0000","last_undegraded":"2024-01-20T08:12:10.984149+0000","last_fullsized":"2024-01-20T08:12:10.984149+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:21.868460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988263+0000","last_change":"2024-01-20T08:12:07.076077+0000","last_active":"2024-01-20T08:12:10.988263+0000","last_peered":"2024-01-20T08:12:10.988263+0000","last_clean":"2024-01-20T08:12:10.988263+0000","last_became_active":"2024-01-20T08:12:07.075830+0000","last_became_peered":"2024-01-20T08:12:07.075830+0000","last_unstale":"2024-01-20T08:12:10.988263+0000","last_undegraded":"2024-01-20T08:12:10.988263+0000","last_fullsized":"2024-01-20T08:12:10.988263+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:22.791363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987917+0000","last_change":"2024-01-20T08:12:07.072412+0000","last_active":"2024-01-20T08:12:10.987917+0000","last_peered":"2024-01-20T08:12:10.987917+0000","last_clean":"2024-01-20T08:12:10.987917+0000","last_became_active":"2024-01-20T08:12:07.072119+0000","last_became_peered":"2024-01-20T08:12:07.072119+0000","last_unstale":"2024-01-20T08:12:10.987917+0000","last_undegraded":"2024-01-20T08:12:10.987917+0000","last_fullsized":"2024-01-20T08:12:10.987917+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992920+0000","last_change":"2024-01-20T08:12:07.077399+0000","last_active":"2024-01-20T08:12:10.992920+0000","last_peered":"2024-01-20T08:12:10.992920+0000","last_clean":"2024-01-20T08:12:10.992920+0000","last_became_active":"2024-01-20T08:12:07.077122+0000","last_became_peered":"2024-01-20T08:12:07.077122+0000","last_unstale":"2024-01-20T08:12:10.992920+0000","last_undegraded":"2024-01-20T08:12:10.992920+0000","last_fullsized":"2024-01-20T08:12:10.992920+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:25.524024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988230+0000","last_change":"2024-01-20T08:12:07.076949+0000","last_active":"2024-01-20T08:12:10.988230+0000","last_peered":"2024-01-20T08:12:10.988230+0000","last_clean":"2024-01-20T08:12:10.988230+0000","last_became_active":"2024-01-20T08:12:07.076497+0000","last_became_peered":"2024-01-20T08:12:07.076497+0000","last_unstale":"2024-01-20T08:12:10.988230+0000","last_undegraded":"2024-01-20T08:12:10.988230+0000","last_fullsized":"2024-01-20T08:12:10.988230+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:04:40.245579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990923+0000","last_change":"2024-01-20T08:12:07.079522+0000","last_active":"2024-01-20T08:12:10.990923+0000","last_peered":"2024-01-20T08:12:10.990923+0000","last_clean":"2024-01-20T08:12:10.990923+0000","last_became_active":"2024-01-20T08:12:07.079268+0000","last_became_peered":"2024-01-20T08:12:07.079268+0000","last_unstale":"2024-01-20T08:12:10.990923+0000","last_undegraded":"2024-01-20T08:12:10.990923+0000","last_fullsized":"2024-01-20T08:12:10.990923+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:37.687652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992223+0000","last_change":"2024-01-20T08:12:07.076533+0000","last_active":"2024-01-20T08:12:10.992223+0000","last_peered":"2024-01-20T08:12:10.992223+0000","last_clean":"2024-01-20T08:12:10.992223+0000","last_became_active":"2024-01-20T08:12:07.076184+0000","last_became_peered":"2024-01-20T08:12:07.076184+0000","last_unstale":"2024-01-20T08:12:10.992223+0000","last_undegraded":"2024-01-20T08:12:10.992223+0000","last_fullsized":"2024-01-20T08:12:10.992223+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:49:57.037227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.988199+0000","last_change":"2024-01-20T08:12:07.071054+0000","last_active":"2024-01-20T08:12:10.988199+0000","last_peered":"2024-01-20T08:12:10.988199+0000","last_clean":"2024-01-20T08:12:10.988199+0000","last_became_active":"2024-01-20T08:12:07.070741+0000","last_became_peered":"2024-01-20T08:12:07.070741+0000","last_unstale":"2024-01-20T08:12:10.988199+0000","last_undegraded":"2024-01-20T08:12:10.988199+0000","last_fullsized":"2024-01-20T08:12:10.988199+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:03.112854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992850+0000","last_change":"2024-01-20T08:12:07.078867+0000","last_active":"2024-01-20T08:12:10.992850+0000","last_peered":"2024-01-20T08:12:10.992850+0000","last_clean":"2024-01-20T08:12:10.992850+0000","last_became_active":"2024-01-20T08:12:07.078639+0000","last_became_peered":"2024-01-20T08:12:07.078639+0000","last_unstale":"2024-01-20T08:12:10.992850+0000","last_undegraded":"2024-01-20T08:12:10.992850+0000","last_fullsized":"2024-01-20T08:12:10.992850+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.079080+0000","last_change":"2024-01-20T08:12:25.079080+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.079080+0000","last_undegraded":"2024-01-20T08:12:25.079080+0000","last_fullsized":"2024-01-20T08:12:25.079080+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992953+0000","last_change":"2024-01-20T08:12:07.080377+0000","last_active":"2024-01-20T08:12:10.992953+0000","last_peered":"2024-01-20T08:12:10.992953+0000","last_clean":"2024-01-20T08:12:10.992953+0000","last_became_active":"2024-01-20T08:12:07.080044+0000","last_became_peered":"2024-01-20T08:12:07.080044+0000","last_unstale":"2024-01-20T08:12:10.992953+0000","last_undegraded":"2024-01-20T08:12:10.992953+0000","last_fullsized":"2024-01-20T08:12:10.992953+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:33.328172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":17,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045888+0000","last_change":"2024-01-20T08:12:06.069013+0000","last_active":"2024-01-20T08:12:08.045888+0000","last_peered":"2024-01-20T08:12:08.045888+0000","last_clean":"2024-01-20T08:12:08.045888+0000","last_became_active":"2024-01-20T08:12:06.068785+0000","last_became_peered":"2024-01-20T08:12:06.068785+0000","last_unstale":"2024-01-20T08:12:08.045888+0000","last_undegraded":"2024-01-20T08:12:08.045888+0000","last_fullsized":"2024-01-20T08:12:08.045888+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:48.916750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.086870+0000","last_change":"2024-01-20T08:12:25.086870+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.086870+0000","last_undegraded":"2024-01-20T08:12:25.086870+0000","last_fullsized":"2024-01-20T08:12:25.086870+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.985021+0000","last_change":"2024-01-20T08:12:07.074189+0000","last_active":"2024-01-20T08:12:10.985021+0000","last_peered":"2024-01-20T08:12:10.985021+0000","last_clean":"2024-01-20T08:12:10.985021+0000","last_became_active":"2024-01-20T08:12:07.073922+0000","last_became_peered":"2024-01-20T08:12:07.073922+0000","last_unstale":"2024-01-20T08:12:10.985021+0000","last_undegraded":"2024-01-20T08:12:10.985021+0000","last_fullsized":"2024-01-20T08:12:10.985021+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045690+0000","last_change":"2024-01-20T08:12:06.067289+0000","last_active":"2024-01-20T08:12:08.045690+0000","last_peered":"2024-01-20T08:12:08.045690+0000","last_clean":"2024-01-20T08:12:08.045690+0000","last_became_active":"2024-01-20T08:12:06.066945+0000","last_became_peered":"2024-01-20T08:12:06.066945+0000","last_unstale":"2024-01-20T08:12:08.045690+0000","last_undegraded":"2024-01-20T08:12:08.045690+0000","last_fullsized":"2024-01-20T08:12:08.045690+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:05.035478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070191+0000","last_change":"2024-01-20T08:12:25.070191+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070191+0000","last_undegraded":"2024-01-20T08:12:25.070191+0000","last_fullsized":"2024-01-20T08:12:25.070191+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992907+0000","last_change":"2024-01-20T08:12:07.082658+0000","last_active":"2024-01-20T08:12:10.992907+0000","last_peered":"2024-01-20T08:12:10.992907+0000","last_clean":"2024-01-20T08:12:10.992907+0000","last_became_active":"2024-01-20T08:12:07.082212+0000","last_became_peered":"2024-01-20T08:12:07.082212+0000","last_unstale":"2024-01-20T08:12:10.992907+0000","last_undegraded":"2024-01-20T08:12:10.992907+0000","last_fullsized":"2024-01-20T08:12:10.992907+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045223+0000","last_change":"2024-01-20T08:12:06.058720+0000","last_active":"2024-01-20T08:12:08.045223+0000","last_peered":"2024-01-20T08:12:08.045223+0000","last_clean":"2024-01-20T08:12:08.045223+0000","last_became_active":"2024-01-20T08:12:06.058352+0000","last_became_peered":"2024-01-20T08:12:06.058352+0000","last_unstale":"2024-01-20T08:12:08.045223+0000","last_undegraded":"2024-01-20T08:12:08.045223+0000","last_fullsized":"2024-01-20T08:12:08.045223+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:09.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070358+0000","last_change":"2024-01-20T08:12:25.070358+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070358+0000","last_undegraded":"2024-01-20T08:12:25.070358+0000","last_fullsized":"2024-01-20T08:12:25.070358+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992931+0000","last_change":"2024-01-20T08:12:07.080508+0000","last_active":"2024-01-20T08:12:10.992931+0000","last_peered":"2024-01-20T08:12:10.992931+0000","last_clean":"2024-01-20T08:12:10.992931+0000","last_became_active":"2024-01-20T08:12:07.080057+0000","last_became_peered":"2024-01-20T08:12:07.080057+0000","last_unstale":"2024-01-20T08:12:10.992931+0000","last_undegraded":"2024-01-20T08:12:10.992931+0000","last_fullsized":"2024-01-20T08:12:10.992931+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.415785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319081+0000","last_change":"2024-01-20T08:12:06.073731+0000","last_active":"2024-01-20T08:12:08.319081+0000","last_peered":"2024-01-20T08:12:08.319081+0000","last_clean":"2024-01-20T08:12:08.319081+0000","last_became_active":"2024-01-20T08:12:06.073398+0000","last_became_peered":"2024-01-20T08:12:06.073398+0000","last_unstale":"2024-01-20T08:12:08.319081+0000","last_undegraded":"2024-01-20T08:12:08.319081+0000","last_fullsized":"2024-01-20T08:12:08.319081+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:14.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.074660+0000","last_change":"2024-01-20T08:12:25.074660+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.074660+0000","last_undegraded":"2024-01-20T08:12:25.074660+0000","last_fullsized":"2024-01-20T08:12:25.074660+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990899+0000","last_change":"2024-01-20T08:12:07.072285+0000","last_active":"2024-01-20T08:12:10.990899+0000","last_peered":"2024-01-20T08:12:10.990899+0000","last_clean":"2024-01-20T08:12:10.990899+0000","last_became_active":"2024-01-20T08:12:07.068016+0000","last_became_peered":"2024-01-20T08:12:07.068016+0000","last_unstale":"2024-01-20T08:12:10.990899+0000","last_undegraded":"2024-01-20T08:12:10.990899+0000","last_fullsized":"2024-01-20T08:12:10.990899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:17.339298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316485+0000","last_change":"2024-01-20T08:12:06.062959+0000","last_active":"2024-01-20T08:12:08.316485+0000","last_peered":"2024-01-20T08:12:08.316485+0000","last_clean":"2024-01-20T08:12:08.316485+0000","last_became_active":"2024-01-20T08:12:06.062074+0000","last_became_peered":"2024-01-20T08:12:06.062074+0000","last_unstale":"2024-01-20T08:12:08.316485+0000","last_undegraded":"2024-01-20T08:12:08.316485+0000","last_fullsized":"2024-01-20T08:12:08.316485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:20.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.074781+0000","last_change":"2024-01-20T08:12:25.074781+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.074781+0000","last_undegraded":"2024-01-20T08:12:25.074781+0000","last_fullsized":"2024-01-20T08:12:25.074781+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990914+0000","last_change":"2024-01-20T08:12:07.073980+0000","last_active":"2024-01-20T08:12:10.990914+0000","last_peered":"2024-01-20T08:12:10.990914+0000","last_clean":"2024-01-20T08:12:10.990914+0000","last_became_active":"2024-01-20T08:12:07.072685+0000","last_became_peered":"2024-01-20T08:12:07.072685+0000","last_unstale":"2024-01-20T08:12:10.990914+0000","last_undegraded":"2024-01-20T08:12:10.990914+0000","last_fullsized":"2024-01-20T08:12:10.990914+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:02:57.344542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044485+0000","last_change":"2024-01-20T08:12:06.063065+0000","last_active":"2024-01-20T08:12:08.044485+0000","last_peered":"2024-01-20T08:12:08.044485+0000","last_clean":"2024-01-20T08:12:08.044485+0000","last_became_active":"2024-01-20T08:12:06.062833+0000","last_became_peered":"2024-01-20T08:12:06.062833+0000","last_unstale":"2024-01-20T08:12:08.044485+0000","last_undegraded":"2024-01-20T08:12:08.044485+0000","last_fullsized":"2024-01-20T08:12:08.044485+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.083255+0000","last_change":"2024-01-20T08:12:25.083255+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.083255+0000","last_undegraded":"2024-01-20T08:12:25.083255+0000","last_fullsized":"2024-01-20T08:12:25.083255+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984211+0000","last_change":"2024-01-20T08:12:07.081364+0000","last_active":"2024-01-20T08:12:10.984211+0000","last_peered":"2024-01-20T08:12:10.984211+0000","last_clean":"2024-01-20T08:12:10.984211+0000","last_became_active":"2024-01-20T08:12:07.080761+0000","last_became_peered":"2024-01-20T08:12:07.080761+0000","last_unstale":"2024-01-20T08:12:10.984211+0000","last_undegraded":"2024-01-20T08:12:10.984211+0000","last_fullsized":"2024-01-20T08:12:10.984211+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:29.139178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316694+0000","last_change":"2024-01-20T08:12:06.071618+0000","last_active":"2024-01-20T08:12:08.316694+0000","last_peered":"2024-01-20T08:12:08.316694+0000","last_clean":"2024-01-20T08:12:08.316694+0000","last_became_active":"2024-01-20T08:12:06.070615+0000","last_became_peered":"2024-01-20T08:12:06.070615+0000","last_unstale":"2024-01-20T08:12:08.316694+0000","last_undegraded":"2024-01-20T08:12:08.316694+0000","last_fullsized":"2024-01-20T08:12:08.316694+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:51.110106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.087936+0000","last_change":"2024-01-20T08:12:25.087936+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.087936+0000","last_undegraded":"2024-01-20T08:12:25.087936+0000","last_fullsized":"2024-01-20T08:12:25.087936+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990873+0000","last_change":"2024-01-20T08:12:07.078826+0000","last_active":"2024-01-20T08:12:10.990873+0000","last_peered":"2024-01-20T08:12:10.990873+0000","last_clean":"2024-01-20T08:12:10.990873+0000","last_became_active":"2024-01-20T08:12:07.078429+0000","last_became_peered":"2024-01-20T08:12:07.078429+0000","last_unstale":"2024-01-20T08:12:10.990873+0000","last_undegraded":"2024-01-20T08:12:10.990873+0000","last_fullsized":"2024-01-20T08:12:10.990873+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.317217+0000","last_change":"2024-01-20T08:12:06.055455+0000","last_active":"2024-01-20T08:12:08.317217+0000","last_peered":"2024-01-20T08:12:08.317217+0000","last_clean":"2024-01-20T08:12:08.317217+0000","last_became_active":"2024-01-20T08:12:06.053817+0000","last_became_peered":"2024-01-20T08:12:06.053817+0000","last_unstale":"2024-01-20T08:12:08.317217+0000","last_undegraded":"2024-01-20T08:12:08.317217+0000","last_fullsized":"2024-01-20T08:12:08.317217+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:32.005693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.083577+0000","last_change":"2024-01-20T08:12:25.083577+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.083577+0000","last_undegraded":"2024-01-20T08:12:25.083577+0000","last_fullsized":"2024-01-20T08:12:25.083577+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987248+0000","last_change":"2024-01-20T08:12:07.069110+0000","last_active":"2024-01-20T08:12:10.987248+0000","last_peered":"2024-01-20T08:12:10.987248+0000","last_clean":"2024-01-20T08:12:10.987248+0000","last_became_active":"2024-01-20T08:12:07.068542+0000","last_became_peered":"2024-01-20T08:12:07.068542+0000","last_unstale":"2024-01-20T08:12:10.987248+0000","last_undegraded":"2024-01-20T08:12:10.987248+0000","last_fullsized":"2024-01-20T08:12:10.987248+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:33.766825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047872+0000","last_change":"2024-01-20T08:12:06.075567+0000","last_active":"2024-01-20T08:12:08.047872+0000","last_peered":"2024-01-20T08:12:08.047872+0000","last_clean":"2024-01-20T08:12:08.047872+0000","last_became_active":"2024-01-20T08:12:06.075224+0000","last_became_peered":"2024-01-20T08:12:06.075224+0000","last_unstale":"2024-01-20T08:12:08.047872+0000","last_undegraded":"2024-01-20T08:12:08.047872+0000","last_fullsized":"2024-01-20T08:12:08.047872+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:37.894928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.074917+0000","last_change":"2024-01-20T08:12:25.074917+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.074917+0000","last_undegraded":"2024-01-20T08:12:25.074917+0000","last_fullsized":"2024-01-20T08:12:25.074917+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992382+0000","last_change":"2024-01-20T08:12:07.087383+0000","last_active":"2024-01-20T08:12:10.992382+0000","last_peered":"2024-01-20T08:12:10.992382+0000","last_clean":"2024-01-20T08:12:10.992382+0000","last_became_active":"2024-01-20T08:12:07.080077+0000","last_became_peered":"2024-01-20T08:12:07.080077+0000","last_unstale":"2024-01-20T08:12:10.992382+0000","last_undegraded":"2024-01-20T08:12:10.992382+0000","last_fullsized":"2024-01-20T08:12:10.992382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045934+0000","last_change":"2024-01-20T08:12:06.061973+0000","last_active":"2024-01-20T08:12:08.045934+0000","last_peered":"2024-01-20T08:12:08.045934+0000","last_clean":"2024-01-20T08:12:08.045934+0000","last_became_active":"2024-01-20T08:12:06.061556+0000","last_became_peered":"2024-01-20T08:12:06.061556+0000","last_unstale":"2024-01-20T08:12:08.045934+0000","last_undegraded":"2024-01-20T08:12:08.045934+0000","last_fullsized":"2024-01-20T08:12:08.045934+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:44.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.078865+0000","last_change":"2024-01-20T08:12:25.078865+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.078865+0000","last_undegraded":"2024-01-20T08:12:25.078865+0000","last_fullsized":"2024-01-20T08:12:25.078865+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984962+0000","last_change":"2024-01-20T08:12:07.057739+0000","last_active":"2024-01-20T08:12:10.984962+0000","last_peered":"2024-01-20T08:12:10.984962+0000","last_clean":"2024-01-20T08:12:10.984962+0000","last_became_active":"2024-01-20T08:12:07.055502+0000","last_became_peered":"2024-01-20T08:12:07.055502+0000","last_unstale":"2024-01-20T08:12:10.984962+0000","last_undegraded":"2024-01-20T08:12:10.984962+0000","last_fullsized":"2024-01-20T08:12:10.984962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:13.798575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":16,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.047775+0000","last_change":"2024-01-20T08:12:06.075821+0000","last_active":"2024-01-20T08:12:08.047775+0000","last_peered":"2024-01-20T08:12:08.047775+0000","last_clean":"2024-01-20T08:12:08.047775+0000","last_became_active":"2024-01-20T08:12:06.075449+0000","last_became_peered":"2024-01-20T08:12:06.075449+0000","last_unstale":"2024-01-20T08:12:08.047775+0000","last_undegraded":"2024-01-20T08:12:08.047775+0000","last_fullsized":"2024-01-20T08:12:08.047775+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:44.906399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.085436+0000","last_change":"2024-01-20T08:12:25.085436+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.085436+0000","last_undegraded":"2024-01-20T08:12:25.085436+0000","last_fullsized":"2024-01-20T08:12:25.085436+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992303+0000","last_change":"2024-01-20T08:12:07.081343+0000","last_active":"2024-01-20T08:12:10.992303+0000","last_peered":"2024-01-20T08:12:10.992303+0000","last_clean":"2024-01-20T08:12:10.992303+0000","last_became_active":"2024-01-20T08:12:07.079569+0000","last_became_peered":"2024-01-20T08:12:07.079569+0000","last_unstale":"2024-01-20T08:12:10.992303+0000","last_undegraded":"2024-01-20T08:12:10.992303+0000","last_fullsized":"2024-01-20T08:12:10.992303+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"52'9","reported_seq":22,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:21.391559+0000","last_change":"2024-01-20T08:12:06.066310+0000","last_active":"2024-01-20T08:12:21.391559+0000","last_peered":"2024-01-20T08:12:21.391559+0000","last_clean":"2024-01-20T08:12:21.391559+0000","last_became_active":"2024-01-20T08:12:06.065636+0000","last_became_peered":"2024-01-20T08:12:06.065636+0000","last_unstale":"2024-01-20T08:12:21.391559+0000","last_undegraded":"2024-01-20T08:12:21.391559+0000","last_fullsized":"2024-01-20T08:12:21.391559+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070857+0000","last_change":"2024-01-20T08:12:25.070857+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070857+0000","last_undegraded":"2024-01-20T08:12:25.070857+0000","last_fullsized":"2024-01-20T08:12:25.070857+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987825+0000","last_change":"2024-01-20T08:12:07.078287+0000","last_active":"2024-01-20T08:12:10.987825+0000","last_peered":"2024-01-20T08:12:10.987825+0000","last_clean":"2024-01-20T08:12:10.987825+0000","last_became_active":"2024-01-20T08:12:07.078008+0000","last_became_peered":"2024-01-20T08:12:07.078008+0000","last_unstale":"2024-01-20T08:12:10.987825+0000","last_undegraded":"2024-01-20T08:12:10.987825+0000","last_fullsized":"2024-01-20T08:12:10.987825+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045109+0000","last_change":"2024-01-20T08:12:06.065744+0000","last_active":"2024-01-20T08:12:08.045109+0000","last_peered":"2024-01-20T08:12:08.045109+0000","last_clean":"2024-01-20T08:12:08.045109+0000","last_became_active":"2024-01-20T08:12:06.065473+0000","last_became_peered":"2024-01-20T08:12:06.065473+0000","last_unstale":"2024-01-20T08:12:08.045109+0000","last_undegraded":"2024-01-20T08:12:08.045109+0000","last_fullsized":"2024-01-20T08:12:08.045109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:28.564397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.077874+0000","last_change":"2024-01-20T08:12:25.077874+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.077874+0000","last_undegraded":"2024-01-20T08:12:25.077874+0000","last_fullsized":"2024-01-20T08:12:25.077874+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992257+0000","last_change":"2024-01-20T08:12:07.078220+0000","last_active":"2024-01-20T08:12:10.992257+0000","last_peered":"2024-01-20T08:12:10.992257+0000","last_clean":"2024-01-20T08:12:10.992257+0000","last_became_active":"2024-01-20T08:12:07.077812+0000","last_became_peered":"2024-01-20T08:12:07.077812+0000","last_unstale":"2024-01-20T08:12:10.992257+0000","last_undegraded":"2024-01-20T08:12:10.992257+0000","last_fullsized":"2024-01-20T08:12:10.992257+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:54.112972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319316+0000","last_change":"2024-01-20T08:12:06.071522+0000","last_active":"2024-01-20T08:12:08.319316+0000","last_peered":"2024-01-20T08:12:08.319316+0000","last_clean":"2024-01-20T08:12:08.319316+0000","last_became_active":"2024-01-20T08:12:06.069659+0000","last_became_peered":"2024-01-20T08:12:06.069659+0000","last_unstale":"2024-01-20T08:12:08.319316+0000","last_undegraded":"2024-01-20T08:12:08.319316+0000","last_fullsized":"2024-01-20T08:12:08.319316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.076333+0000","last_change":"2024-01-20T08:12:25.076333+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.076333+0000","last_undegraded":"2024-01-20T08:12:25.076333+0000","last_fullsized":"2024-01-20T08:12:25.076333+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987086+0000","last_change":"2024-01-20T08:12:07.078740+0000","last_active":"2024-01-20T08:12:10.987086+0000","last_peered":"2024-01-20T08:12:10.987086+0000","last_clean":"2024-01-20T08:12:10.987086+0000","last_became_active":"2024-01-20T08:12:07.078413+0000","last_became_peered":"2024-01-20T08:12:07.078413+0000","last_unstale":"2024-01-20T08:12:10.987086+0000","last_undegraded":"2024-01-20T08:12:10.987086+0000","last_fullsized":"2024-01-20T08:12:10.987086+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.190626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316790+0000","last_change":"2024-01-20T08:12:06.071714+0000","last_active":"2024-01-20T08:12:08.316790+0000","last_peered":"2024-01-20T08:12:08.316790+0000","last_clean":"2024-01-20T08:12:08.316790+0000","last_became_active":"2024-01-20T08:12:06.071263+0000","last_became_peered":"2024-01-20T08:12:06.071263+0000","last_unstale":"2024-01-20T08:12:08.316790+0000","last_undegraded":"2024-01-20T08:12:08.316790+0000","last_fullsized":"2024-01-20T08:12:08.316790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:05.094918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.086871+0000","last_change":"2024-01-20T08:12:25.086871+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.086871+0000","last_undegraded":"2024-01-20T08:12:25.086871+0000","last_fullsized":"2024-01-20T08:12:25.086871+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992208+0000","last_change":"2024-01-20T08:12:07.088126+0000","last_active":"2024-01-20T08:12:10.992208+0000","last_peered":"2024-01-20T08:12:10.992208+0000","last_clean":"2024-01-20T08:12:10.992208+0000","last_became_active":"2024-01-20T08:12:07.087789+0000","last_became_peered":"2024-01-20T08:12:07.087789+0000","last_unstale":"2024-01-20T08:12:10.992208+0000","last_undegraded":"2024-01-20T08:12:10.992208+0000","last_fullsized":"2024-01-20T08:12:10.992208+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":21,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046413+0000","last_change":"2024-01-20T08:12:06.074824+0000","last_active":"2024-01-20T08:12:08.046413+0000","last_peered":"2024-01-20T08:12:08.046413+0000","last_clean":"2024-01-20T08:12:08.046413+0000","last_became_active":"2024-01-20T08:12:06.074111+0000","last_became_peered":"2024-01-20T08:12:06.074111+0000","last_unstale":"2024-01-20T08:12:08.046413+0000","last_undegraded":"2024-01-20T08:12:08.046413+0000","last_fullsized":"2024-01-20T08:12:08.046413+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.086170+0000","last_change":"2024-01-20T08:12:25.086170+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.086170+0000","last_undegraded":"2024-01-20T08:12:25.086170+0000","last_fullsized":"2024-01-20T08:12:25.086170+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992367+0000","last_change":"2024-01-20T08:12:07.082593+0000","last_active":"2024-01-20T08:12:10.992367+0000","last_peered":"2024-01-20T08:12:10.992367+0000","last_clean":"2024-01-20T08:12:10.992367+0000","last_became_active":"2024-01-20T08:12:07.082366+0000","last_became_peered":"2024-01-20T08:12:07.082366+0000","last_unstale":"2024-01-20T08:12:10.992367+0000","last_undegraded":"2024-01-20T08:12:10.992367+0000","last_fullsized":"2024-01-20T08:12:10.992367+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046182+0000","last_change":"2024-01-20T08:12:06.065566+0000","last_active":"2024-01-20T08:12:08.046182+0000","last_peered":"2024-01-20T08:12:08.046182+0000","last_clean":"2024-01-20T08:12:08.046182+0000","last_became_active":"2024-01-20T08:12:06.065270+0000","last_became_peered":"2024-01-20T08:12:06.065270+0000","last_unstale":"2024-01-20T08:12:08.046182+0000","last_undegraded":"2024-01-20T08:12:08.046182+0000","last_fullsized":"2024-01-20T08:12:08.046182+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:45.655205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070310+0000","last_change":"2024-01-20T08:12:25.070310+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070310+0000","last_undegraded":"2024-01-20T08:12:25.070310+0000","last_fullsized":"2024-01-20T08:12:25.070310+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987947+0000","last_change":"2024-01-20T08:12:07.082690+0000","last_active":"2024-01-20T08:12:10.987947+0000","last_peered":"2024-01-20T08:12:10.987947+0000","last_clean":"2024-01-20T08:12:10.987947+0000","last_became_active":"2024-01-20T08:12:07.082364+0000","last_became_peered":"2024-01-20T08:12:07.082364+0000","last_unstale":"2024-01-20T08:12:10.987947+0000","last_undegraded":"2024-01-20T08:12:10.987947+0000","last_fullsized":"2024-01-20T08:12:10.987947+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045000+0000","last_change":"2024-01-20T08:12:06.061749+0000","last_active":"2024-01-20T08:12:08.045000+0000","last_peered":"2024-01-20T08:12:08.045000+0000","last_clean":"2024-01-20T08:12:08.045000+0000","last_became_active":"2024-01-20T08:12:06.061466+0000","last_became_peered":"2024-01-20T08:12:06.061466+0000","last_unstale":"2024-01-20T08:12:08.045000+0000","last_undegraded":"2024-01-20T08:12:08.045000+0000","last_fullsized":"2024-01-20T08:12:08.045000+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:32.760864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.087092+0000","last_change":"2024-01-20T08:12:25.087092+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.087092+0000","last_undegraded":"2024-01-20T08:12:25.087092+0000","last_fullsized":"2024-01-20T08:12:25.087092+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990955+0000","last_change":"2024-01-20T08:12:07.065833+0000","last_active":"2024-01-20T08:12:10.990955+0000","last_peered":"2024-01-20T08:12:10.990955+0000","last_clean":"2024-01-20T08:12:10.990955+0000","last_became_active":"2024-01-20T08:12:07.065547+0000","last_became_peered":"2024-01-20T08:12:07.065547+0000","last_unstale":"2024-01-20T08:12:10.990955+0000","last_undegraded":"2024-01-20T08:12:10.990955+0000","last_fullsized":"2024-01-20T08:12:10.990955+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:08.237987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318238+0000","last_change":"2024-01-20T08:12:06.073869+0000","last_active":"2024-01-20T08:12:08.318238+0000","last_peered":"2024-01-20T08:12:08.318238+0000","last_clean":"2024-01-20T08:12:08.318238+0000","last_became_active":"2024-01-20T08:12:06.073514+0000","last_became_peered":"2024-01-20T08:12:06.073514+0000","last_unstale":"2024-01-20T08:12:08.318238+0000","last_undegraded":"2024-01-20T08:12:08.318238+0000","last_fullsized":"2024-01-20T08:12:08.318238+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.078983+0000","last_change":"2024-01-20T08:12:25.078983+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.078983+0000","last_undegraded":"2024-01-20T08:12:25.078983+0000","last_fullsized":"2024-01-20T08:12:25.078983+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992328+0000","last_change":"2024-01-20T08:12:07.084906+0000","last_active":"2024-01-20T08:12:10.992328+0000","last_peered":"2024-01-20T08:12:10.992328+0000","last_clean":"2024-01-20T08:12:10.992328+0000","last_became_active":"2024-01-20T08:12:07.080034+0000","last_became_peered":"2024-01-20T08:12:07.080034+0000","last_unstale":"2024-01-20T08:12:10.992328+0000","last_undegraded":"2024-01-20T08:12:10.992328+0000","last_fullsized":"2024-01-20T08:12:10.992328+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044596+0000","last_change":"2024-01-20T08:12:06.056008+0000","last_active":"2024-01-20T08:12:08.044596+0000","last_peered":"2024-01-20T08:12:08.044596+0000","last_clean":"2024-01-20T08:12:08.044596+0000","last_became_active":"2024-01-20T08:12:06.055317+0000","last_became_peered":"2024-01-20T08:12:06.055317+0000","last_unstale":"2024-01-20T08:12:08.044596+0000","last_undegraded":"2024-01-20T08:12:08.044596+0000","last_fullsized":"2024-01-20T08:12:08.044596+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.072124+0000","last_change":"2024-01-20T08:12:25.072124+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.072124+0000","last_undegraded":"2024-01-20T08:12:25.072124+0000","last_fullsized":"2024-01-20T08:12:25.072124+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987858+0000","last_change":"2024-01-20T08:12:07.078035+0000","last_active":"2024-01-20T08:12:10.987858+0000","last_peered":"2024-01-20T08:12:10.987858+0000","last_clean":"2024-01-20T08:12:10.987858+0000","last_became_active":"2024-01-20T08:12:07.076150+0000","last_became_peered":"2024-01-20T08:12:07.076150+0000","last_unstale":"2024-01-20T08:12:10.987858+0000","last_undegraded":"2024-01-20T08:12:10.987858+0000","last_fullsized":"2024-01-20T08:12:10.987858+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.045383+0000","last_change":"2024-01-20T08:12:06.058384+0000","last_active":"2024-01-20T08:12:08.045383+0000","last_peered":"2024-01-20T08:12:08.045383+0000","last_clean":"2024-01-20T08:12:08.045383+0000","last_became_active":"2024-01-20T08:12:06.058097+0000","last_became_peered":"2024-01-20T08:12:06.058097+0000","last_unstale":"2024-01-20T08:12:08.045383+0000","last_undegraded":"2024-01-20T08:12:08.045383+0000","last_fullsized":"2024-01-20T08:12:08.045383+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:12.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070841+0000","last_change":"2024-01-20T08:12:25.070841+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070841+0000","last_undegraded":"2024-01-20T08:12:25.070841+0000","last_fullsized":"2024-01-20T08:12:25.070841+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992889+0000","last_change":"2024-01-20T08:12:07.077060+0000","last_active":"2024-01-20T08:12:10.992889+0000","last_peered":"2024-01-20T08:12:10.992889+0000","last_clean":"2024-01-20T08:12:10.992889+0000","last_became_active":"2024-01-20T08:12:07.074560+0000","last_became_peered":"2024-01-20T08:12:07.074560+0000","last_unstale":"2024-01-20T08:12:10.992889+0000","last_undegraded":"2024-01-20T08:12:10.992889+0000","last_fullsized":"2024-01-20T08:12:10.992889+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:11:42.486924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315741+0000","last_change":"2024-01-20T08:12:06.061716+0000","last_active":"2024-01-20T08:12:08.315741+0000","last_peered":"2024-01-20T08:12:08.315741+0000","last_clean":"2024-01-20T08:12:08.315741+0000","last_became_active":"2024-01-20T08:12:06.061410+0000","last_became_peered":"2024-01-20T08:12:06.061410+0000","last_unstale":"2024-01-20T08:12:08.315741+0000","last_undegraded":"2024-01-20T08:12:08.315741+0000","last_fullsized":"2024-01-20T08:12:08.315741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.085326+0000","last_change":"2024-01-20T08:12:25.085326+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.085326+0000","last_undegraded":"2024-01-20T08:12:25.085326+0000","last_fullsized":"2024-01-20T08:12:25.085326+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992862+0000","last_change":"2024-01-20T08:12:07.077678+0000","last_active":"2024-01-20T08:12:10.992862+0000","last_peered":"2024-01-20T08:12:10.992862+0000","last_clean":"2024-01-20T08:12:10.992862+0000","last_became_active":"2024-01-20T08:12:07.077094+0000","last_became_peered":"2024-01-20T08:12:07.077094+0000","last_unstale":"2024-01-20T08:12:10.992862+0000","last_undegraded":"2024-01-20T08:12:10.992862+0000","last_fullsized":"2024-01-20T08:12:10.992862+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316445+0000","last_change":"2024-01-20T08:12:06.063892+0000","last_active":"2024-01-20T08:12:08.316445+0000","last_peered":"2024-01-20T08:12:08.316445+0000","last_clean":"2024-01-20T08:12:08.316445+0000","last_became_active":"2024-01-20T08:12:06.063601+0000","last_became_peered":"2024-01-20T08:12:06.063601+0000","last_unstale":"2024-01-20T08:12:08.316445+0000","last_undegraded":"2024-01-20T08:12:08.316445+0000","last_fullsized":"2024-01-20T08:12:08.316445+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:48.315980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.075492+0000","last_change":"2024-01-20T08:12:25.075492+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.075492+0000","last_undegraded":"2024-01-20T08:12:25.075492+0000","last_fullsized":"2024-01-20T08:12:25.075492+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987932+0000","last_change":"2024-01-20T08:12:07.073337+0000","last_active":"2024-01-20T08:12:10.987932+0000","last_peered":"2024-01-20T08:12:10.987932+0000","last_clean":"2024-01-20T08:12:10.987932+0000","last_became_active":"2024-01-20T08:12:07.073087+0000","last_became_peered":"2024-01-20T08:12:07.073087+0000","last_unstale":"2024-01-20T08:12:10.987932+0000","last_undegraded":"2024-01-20T08:12:10.987932+0000","last_fullsized":"2024-01-20T08:12:10.987932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":15,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316733+0000","last_change":"2024-01-20T08:12:06.049193+0000","last_active":"2024-01-20T08:12:08.316733+0000","last_peered":"2024-01-20T08:12:08.316733+0000","last_clean":"2024-01-20T08:12:08.316733+0000","last_became_active":"2024-01-20T08:12:06.048916+0000","last_became_peered":"2024-01-20T08:12:06.048916+0000","last_unstale":"2024-01-20T08:12:08.316733+0000","last_undegraded":"2024-01-20T08:12:08.316733+0000","last_fullsized":"2024-01-20T08:12:08.316733+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:53.905817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070340+0000","last_change":"2024-01-20T08:12:25.070340+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070340+0000","last_undegraded":"2024-01-20T08:12:25.070340+0000","last_fullsized":"2024-01-20T08:12:25.070340+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.987962+0000","last_change":"2024-01-20T08:12:07.082890+0000","last_active":"2024-01-20T08:12:10.987962+0000","last_peered":"2024-01-20T08:12:10.987962+0000","last_clean":"2024-01-20T08:12:10.987962+0000","last_became_active":"2024-01-20T08:12:07.080723+0000","last_became_peered":"2024-01-20T08:12:07.080723+0000","last_unstale":"2024-01-20T08:12:10.987962+0000","last_undegraded":"2024-01-20T08:12:10.987962+0000","last_fullsized":"2024-01-20T08:12:10.987962+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"52'1","reported_seq":14,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:11.114348+0000","last_change":"2024-01-20T08:12:06.062568+0000","last_active":"2024-01-20T08:12:11.114348+0000","last_peered":"2024-01-20T08:12:11.114348+0000","last_clean":"2024-01-20T08:12:11.114348+0000","last_became_active":"2024-01-20T08:12:06.062294+0000","last_became_peered":"2024-01-20T08:12:06.062294+0000","last_unstale":"2024-01-20T08:12:11.114348+0000","last_undegraded":"2024-01-20T08:12:11.114348+0000","last_fullsized":"2024-01-20T08:12:11.114348+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:39.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.085883+0000","last_change":"2024-01-20T08:12:25.085883+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.085883+0000","last_undegraded":"2024-01-20T08:12:25.085883+0000","last_fullsized":"2024-01-20T08:12:25.085883+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984980+0000","last_change":"2024-01-20T08:12:07.060815+0000","last_active":"2024-01-20T08:12:10.984980+0000","last_peered":"2024-01-20T08:12:10.984980+0000","last_clean":"2024-01-20T08:12:10.984980+0000","last_became_active":"2024-01-20T08:12:07.057155+0000","last_became_peered":"2024-01-20T08:12:07.057155+0000","last_unstale":"2024-01-20T08:12:10.984980+0000","last_undegraded":"2024-01-20T08:12:10.984980+0000","last_fullsized":"2024-01-20T08:12:10.984980+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:49.321942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319712+0000","last_change":"2024-01-20T08:12:06.063244+0000","last_active":"2024-01-20T08:12:08.319712+0000","last_peered":"2024-01-20T08:12:08.319712+0000","last_clean":"2024-01-20T08:12:08.319712+0000","last_became_active":"2024-01-20T08:12:06.062628+0000","last_became_peered":"2024-01-20T08:12:06.062628+0000","last_unstale":"2024-01-20T08:12:08.319712+0000","last_undegraded":"2024-01-20T08:12:08.319712+0000","last_fullsized":"2024-01-20T08:12:08.319712+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.070832+0000","last_change":"2024-01-20T08:12:25.070832+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.070832+0000","last_undegraded":"2024-01-20T08:12:25.070832+0000","last_fullsized":"2024-01-20T08:12:25.070832+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992941+0000","last_change":"2024-01-20T08:12:07.088893+0000","last_active":"2024-01-20T08:12:10.992941+0000","last_peered":"2024-01-20T08:12:10.992941+0000","last_clean":"2024-01-20T08:12:10.992941+0000","last_became_active":"2024-01-20T08:12:07.088233+0000","last_became_peered":"2024-01-20T08:12:07.088233+0000","last_unstale":"2024-01-20T08:12:10.992941+0000","last_undegraded":"2024-01-20T08:12:10.992941+0000","last_fullsized":"2024-01-20T08:12:10.992941+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:39:05.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.319313+0000","last_change":"2024-01-20T08:12:06.069603+0000","last_active":"2024-01-20T08:12:08.319313+0000","last_peered":"2024-01-20T08:12:08.319313+0000","last_clean":"2024-01-20T08:12:08.319313+0000","last_became_active":"2024-01-20T08:12:06.069220+0000","last_became_peered":"2024-01-20T08:12:06.069220+0000","last_unstale":"2024-01-20T08:12:08.319313+0000","last_undegraded":"2024-01-20T08:12:08.319313+0000","last_fullsized":"2024-01-20T08:12:08.319313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.078046+0000","last_change":"2024-01-20T08:12:25.078046+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.078046+0000","last_undegraded":"2024-01-20T08:12:25.078046+0000","last_fullsized":"2024-01-20T08:12:25.078046+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990906+0000","last_change":"2024-01-20T08:12:07.066751+0000","last_active":"2024-01-20T08:12:10.990906+0000","last_peered":"2024-01-20T08:12:10.990906+0000","last_clean":"2024-01-20T08:12:10.990906+0000","last_became_active":"2024-01-20T08:12:07.063086+0000","last_became_peered":"2024-01-20T08:12:07.063086+0000","last_unstale":"2024-01-20T08:12:10.990906+0000","last_undegraded":"2024-01-20T08:12:10.990906+0000","last_fullsized":"2024-01-20T08:12:10.990906+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:18:45.087923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315403+0000","last_change":"2024-01-20T08:12:06.066906+0000","last_active":"2024-01-20T08:12:08.315403+0000","last_peered":"2024-01-20T08:12:08.315403+0000","last_clean":"2024-01-20T08:12:08.315403+0000","last_became_active":"2024-01-20T08:12:06.066598+0000","last_became_peered":"2024-01-20T08:12:06.066598+0000","last_unstale":"2024-01-20T08:12:08.315403+0000","last_undegraded":"2024-01-20T08:12:08.315403+0000","last_fullsized":"2024-01-20T08:12:08.315403+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.085292+0000","last_change":"2024-01-20T08:12:25.085292+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.085292+0000","last_undegraded":"2024-01-20T08:12:25.085292+0000","last_fullsized":"2024-01-20T08:12:25.085292+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.992271+0000","last_change":"2024-01-20T08:12:07.088972+0000","last_active":"2024-01-20T08:12:10.992271+0000","last_peered":"2024-01-20T08:12:10.992271+0000","last_clean":"2024-01-20T08:12:10.992271+0000","last_became_active":"2024-01-20T08:12:07.088534+0000","last_became_peered":"2024-01-20T08:12:07.088534+0000","last_unstale":"2024-01-20T08:12:10.992271+0000","last_undegraded":"2024-01-20T08:12:10.992271+0000","last_fullsized":"2024-01-20T08:12:10.992271+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.316281+0000","last_change":"2024-01-20T08:12:06.061867+0000","last_active":"2024-01-20T08:12:08.316281+0000","last_peered":"2024-01-20T08:12:08.316281+0000","last_clean":"2024-01-20T08:12:08.316281+0000","last_became_active":"2024-01-20T08:12:06.061474+0000","last_became_peered":"2024-01-20T08:12:06.061474+0000","last_unstale":"2024-01-20T08:12:08.316281+0000","last_undegraded":"2024-01-20T08:12:08.316281+0000","last_fullsized":"2024-01-20T08:12:08.316281+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:28.133216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.075222+0000","last_change":"2024-01-20T08:12:25.075222+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.075222+0000","last_undegraded":"2024-01-20T08:12:25.075222+0000","last_fullsized":"2024-01-20T08:12:25.075222+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.984923+0000","last_change":"2024-01-20T08:12:07.075925+0000","last_active":"2024-01-20T08:12:10.984923+0000","last_peered":"2024-01-20T08:12:10.984923+0000","last_clean":"2024-01-20T08:12:10.984923+0000","last_became_active":"2024-01-20T08:12:07.075681+0000","last_became_peered":"2024-01-20T08:12:07.075681+0000","last_unstale":"2024-01-20T08:12:10.984923+0000","last_undegraded":"2024-01-20T08:12:10.984923+0000","last_fullsized":"2024-01-20T08:12:10.984923+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:38.900889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.315286+0000","last_change":"2024-01-20T08:12:06.056764+0000","last_active":"2024-01-20T08:12:08.315286+0000","last_peered":"2024-01-20T08:12:08.315286+0000","last_clean":"2024-01-20T08:12:08.315286+0000","last_became_active":"2024-01-20T08:12:06.056438+0000","last_became_peered":"2024-01-20T08:12:06.056438+0000","last_unstale":"2024-01-20T08:12:08.315286+0000","last_undegraded":"2024-01-20T08:12:08.315286+0000","last_fullsized":"2024-01-20T08:12:08.315286+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.075281+0000","last_change":"2024-01-20T08:12:25.075281+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.075281+0000","last_undegraded":"2024-01-20T08:12:25.075281+0000","last_fullsized":"2024-01-20T08:12:25.075281+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990883+0000","last_change":"2024-01-20T08:12:07.075968+0000","last_active":"2024-01-20T08:12:10.990883+0000","last_peered":"2024-01-20T08:12:10.990883+0000","last_clean":"2024-01-20T08:12:10.990883+0000","last_became_active":"2024-01-20T08:12:07.071647+0000","last_became_peered":"2024-01-20T08:12:07.071647+0000","last_unstale":"2024-01-20T08:12:10.990883+0000","last_undegraded":"2024-01-20T08:12:10.990883+0000","last_fullsized":"2024-01-20T08:12:10.990883+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:52:22.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.044953+0000","last_change":"2024-01-20T08:12:06.060007+0000","last_active":"2024-01-20T08:12:08.044953+0000","last_peered":"2024-01-20T08:12:08.044953+0000","last_clean":"2024-01-20T08:12:08.044953+0000","last_became_active":"2024-01-20T08:12:06.059513+0000","last_became_peered":"2024-01-20T08:12:06.059513+0000","last_unstale":"2024-01-20T08:12:08.044953+0000","last_undegraded":"2024-01-20T08:12:08.044953+0000","last_fullsized":"2024-01-20T08:12:08.044953+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:20.449358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-01-20T08:12:26.062497+0000","last_change":"2024-01-20T08:12:26.062497+0000","last_active":"2024-01-20T08:12:26.062497+0000","last_peered":"2024-01-20T08:12:26.062497+0000","last_clean":"2024-01-20T08:12:26.062497+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:26.062497+0000","last_undegraded":"2024-01-20T08:12:26.062497+0000","last_fullsized":"2024-01-20T08:12:26.062497+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":53,"state":"creating+peering","last_fresh":"2024-01-20T08:12:25.085284+0000","last_change":"2024-01-20T08:12:25.085284+0000","last_active":"2024-01-20T08:12:25.046854+0000","last_peered":"2024-01-20T08:12:25.046854+0000","last_clean":"2024-01-20T08:12:25.046854+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:12:25.085284+0000","last_undegraded":"2024-01-20T08:12:25.085284+0000","last_fullsized":"2024-01-20T08:12:25.085284+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":12,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:10.990859+0000","last_change":"2024-01-20T08:12:07.073628+0000","last_active":"2024-01-20T08:12:10.990859+0000","last_peered":"2024-01-20T08:12:10.990859+0000","last_clean":"2024-01-20T08:12:10.990859+0000","last_became_active":"2024-01-20T08:12:07.073348+0000","last_became_peered":"2024-01-20T08:12:07.073348+0000","last_unstale":"2024-01-20T08:12:10.990859+0000","last_undegraded":"2024-01-20T08:12:10.990859+0000","last_fullsized":"2024-01-20T08:12:10.990859+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:59:53.783140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.318750+0000","last_change":"2024-01-20T08:12:06.067638+0000","last_active":"2024-01-20T08:12:08.318750+0000","last_peered":"2024-01-20T08:12:08.318750+0000","last_clean":"2024-01-20T08:12:08.318750+0000","last_became_active":"2024-01-20T08:12:06.067251+0000","last_became_peered":"2024-01-20T08:12:06.067251+0000","last_unstale":"2024-01-20T08:12:08.318750+0000","last_undegraded":"2024-01-20T08:12:08.318750+0000","last_fullsized":"2024-01-20T08:12:08.318750+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":193,"reported_epoch":52,"state":"active+clean","last_fresh":"2024-01-20T08:12:08.046412+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:08.046412+0000","last_peered":"2024-01-20T08:12:08.046412+0000","last_clean":"2024-01-20T08:12:08.046412+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:08.046412+0000","last_undegraded":"2024-01-20T08:12:08.046412+0000","last_fullsized":"2024-01-20T08:12:08.046412+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574880,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32388,"kb_used_data":1208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339452,"statfs":{"total":96636764160,"available":96603598848,"internally_reserved":0,"allocated":1236992,"data_stored":859325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":0.66600000000000004},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":1.0169999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.391},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":1.2270000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.272},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.4510000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.48},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.0920000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.1359999999999999},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.304}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.331},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":0.91300000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.1870000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.4239999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31800,"kb_used_data":620,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340040,"statfs":{"total":96636764160,"available":96604200960,"internally_reserved":0,"allocated":634880,"data_stored":268797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4359999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9119999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.153}]},{"osd":1,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6100000000000001,"5min":2.008,"15min":2.008},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":0.91600000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1659999999999999,"15min":1.1699999999999999},"min":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8129999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.585},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3080000000000001,"15min":1.333},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.22}]},{"osd":3,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4239999999999999,"15min":1.444},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0720000000000001,"5min":2.222,"15min":2.222},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.4379999999999999,"15min":1.464},"min":{"1min":0.82199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5980000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.413}]},{"osd":4,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.5529999999999999,"15min":1.599},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.825,"5min":2.915,"15min":2.915},"last":1.3260000000000001},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.659,"15min":1.6890000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2189999999999999,"5min":2.718,"15min":2.718},"last":1.3680000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5580000000000001,"15min":1.579},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.7909999999999999},{"interface":"front","average":{"1min":1.419,"5min":1.74,"15min":1.794},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.502}]},{"osd":7,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.734,"15min":1.758},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3500000000000001,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6830000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.746,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0209999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.72}]}]},{"osd":5,"up_from":13,"seq":55834574879,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31808,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340032,"statfs":{"total":96636764160,"available":96604192768,"internally_reserved":0,"allocated":643072,"data_stored":269449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.0760000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":0.98299999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":1.363},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.88700000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.1879999999999999},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.4910000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.3080000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.264}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4390000000000001},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.6120000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31812,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340028,"statfs":{"total":96636764160,"available":96604188672,"internally_reserved":0,"allocated":647168,"data_stored":271904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":1.3700000000000001},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":1.0640000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.1140000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.1739999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.456},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":0.93600000000000005}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.556},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.3420000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.2749999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.524},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.4970000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":268853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.38200000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.5},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.96899999999999997}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":0.82699999999999996}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.76400000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":0.80400000000000005},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.01}]}]},{"osd":2,"up_from":13,"seq":55834574879,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27648,"kb_used_data":628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344192,"statfs":{"total":96636764160,"available":96608452608,"internally_reserved":0,"allocated":643072,"data_stored":268853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":0.64100000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.1100000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":0.95399999999999996}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.171}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.046}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.278},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.88900000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.224},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27632,"kb_used_data":612,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344208,"statfs":{"total":96636764160,"available":96608468992,"internally_reserved":0,"allocated":626688,"data_stored":262216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.47199999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.121},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":0.84999999999999998}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":1.1899999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":0.68999999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.377}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.3340000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.524},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":0.92200000000000004}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4370000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32396,"kb_used_data":1216,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339444,"statfs":{"total":96636764160,"available":96603590656,"internally_reserved":0,"allocated":1245184,"data_stored":862854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.4019999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1859999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.57099999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85799999999999998,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.256,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":0.746}]},{"osd":3,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.131,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.492,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.59099999999999997}]},{"osd":4,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.107,"15min":1.091},"min":{"1min":0.67000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1160000000000001,"15min":1.115},"min":{"1min":0.85299999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.502,"5min":1.589,"15min":1.589},"last":0.71399999999999997}]},{"osd":5,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.74299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.5700000000000001,"5min":1.865,"15min":1.865},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.244,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.02,"5min":2.427,"15min":2.427},"last":0.88900000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.86799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1150000000000002,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.236,"5min":1.276,"15min":1.282},"min":{"1min":0.81000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.772,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.135}]},{"osd":7,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.371,"15min":1.3819999999999999},"min":{"1min":0.88300000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7889999999999999,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.1759999999999999},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.853,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.99099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:31.549 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:12:31.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.793+0000 7f6eab400640 1 Processor -- start 2024-01-20T08:12:31.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.793+0000 7f6eab400640 1 -- start start 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6eab400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6ea4155210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6eab400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea40c7fc0 con 0x7f6ea40c8730 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6eab400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ea40c82a0 con 0x7f6ea40c4a40 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6eab400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea406bb80 con 0x7f6ea40af910 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6ea9400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6ea40c8730 0x7f6ea415f140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39126/0 (socket says 172.21.15.100:39126) 2024-01-20T08:12:31.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6ea9400640 1 -- 172.21.15.100:0/855074826 learned_addr learned my addr 172.21.15.100:0/855074826 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6ea4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.795+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083193262 0 0) 0x7f6ea40c7fc0 con 0x7f6ea40c8730 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e84003520 con 0x7f6ea40c8730 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2791716740 0 0) 0x7f6e84003520 con 0x7f6ea40c8730 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 msgr2=0x7f6ea4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6ea4155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 >> v1:172.21.15.110:6789/0 conn(0x7f6ea40c4a40 legacy=0x7f6ea40c6ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.800 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea4155750 con 0x7f6ea40c8730 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6e9c001670 con 0x7f6ea40c8730 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 >> v1:172.21.15.100:6789/0 conn(0x7f6ea40c8730 legacy=0x7f6ea415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6e84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e840047c0 0x7f6e84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6e840051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea406bb80 con 0x7f6e840039a0 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400bab0 con 0x7f6e840047c0 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8400bc70 con 0x7f6ea40af910 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.796+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6e84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea9400640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6e840051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6e9bc00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e840047c0 0x7f6e84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea8a00640 1 -- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 msgr2=0x7f6e840051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea40af910 0x7f6e840051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.801 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea8a00640 1 -- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e840047c0 msgr2=0x7f6e84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e840047c0 0x7f6e84004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.797+0000 7f6ea8a00640 1 -- 172.21.15.100:0/855074826 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e84003520 con 0x7f6e840039a0 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.798+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6e84003dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009ac0 tx=0x7f6e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc7929c11b6e653 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.798+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9402c6b0 con 0x7f6e840039a0 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.798+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e9402c810 con 0x7f6e840039a0 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.798+0000 7f6ea3e00640 1 -- 172.21.15.100:0/855074826 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e9402cba0 con 0x7f6e840039a0 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 -- 172.21.15.100:0/855074826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 msgr2=0x7f6e84003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 --2- 172.21.15.100:0/855074826 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6e84003dc0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009ac0 tx=0x7f6e840057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6ea9400640 1 -- 172.21.15.100:0/855074826 reap_dead start 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 -- 172.21.15.100:0/855074826 shutdown_connections 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 -- 172.21.15.100:0/855074826 >> 172.21.15.100:0/855074826 conn(0x7f6ea40abc70 msgr2=0x7f6ea40ac080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:31.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 -- 172.21.15.100:0/855074826 shutdown_connections 2024-01-20T08:12:31.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.799+0000 7f6eab400640 1 -- 172.21.15.100:0/855074826 wait complete. 2024-01-20T08:12:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.801+0000 7f6eab400640 1 Processor -- start 2024-01-20T08:12:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.801+0000 7f6eab400640 1 -- start start 2024-01-20T08:12:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea41562a0 0x7f6ea41e7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea4156720 0x7f6ea41e7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40c0610 con 0x7f6e840039a0 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40c08f0 con 0x7f6ea4156720 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6eab400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea40be7a0 con 0x7f6ea41562a0 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35414/0 (socket says 172.21.15.100:35414) 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 -- 172.21.15.100:0/3532581944 learned_addr learned my addr 172.21.15.100:0/3532581944 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6e9bc00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea41562a0 0x7f6ea41e7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 -- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea41562a0 msgr2=0x7f6ea41e7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea41562a0 0x7f6ea41e7310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 -- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea4156720 msgr2=0x7f6ea41e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea9400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea4156720 0x7f6ea41e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea4156720 0x7f6ea41e7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:31.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.802+0000 7f6ea8a00640 1 -- 172.21.15.100:0/3532581944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea40bea80 con 0x7f6e840039a0 2024-01-20T08:12:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6ea8a00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009ac0 tx=0x7f6e94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94003810 con 0x7f6e840039a0 2024-01-20T08:12:31.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e94003970 con 0x7f6e840039a0 2024-01-20T08:12:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e94003d20 con 0x7f6e840039a0 2024-01-20T08:12:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ea41553a0 con 0x7f6e840039a0 2024-01-20T08:12:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.803+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ea41ed7b0 con 0x7f6e840039a0 2024-01-20T08:12:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.804+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ea40be600 con 0x7f6e840039a0 2024-01-20T08:12:31.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.805+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6e94040450 con 0x7f6e840039a0 2024-01-20T08:12:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.806+0000 7f6ea1600640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 0x7f6e7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.807+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6e940ab7f0 con 0x7f6e840039a0 2024-01-20T08:12:31.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.807+0000 7f6e9bc00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 0x7f6e7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:31.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.807+0000 7f6e9bc00640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 0x7f6e7c06d390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ab160 tx=0x7f6e8c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:31.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.811+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6ea40be600 con 0x7f6e840039a0 2024-01-20T08:12:32.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:31.999+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6ea40bf880 con 0x7f6e7c06aed0 2024-01-20T08:12:32.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.015+0000 7f6ea1600640 1 -- 172.21.15.100:0/3532581944 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525326 (secure 0 0 0) 0x7f6ea40bf880 con 0x7f6e7c06aed0 2024-01-20T08:12:32.026 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:32.030 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.025+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 msgr2=0x7f6e7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.025+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 0x7f6e7c06d390 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40ab160 tx=0x7f6e8c009040 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.025+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 msgr2=0x7f6ea40befa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.025+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f6e94009ac0 tx=0x7f6e94004730 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 shutdown_connections 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6ea4156720 0x7f6ea41e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e7c06aed0 0x7f6e7c06d390 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6ea41562a0 0x7f6ea41e7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 --2- 172.21.15.100:0/3532581944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e840039a0 0x7f6ea40befa0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 >> 172.21.15.100:0/3532581944 conn(0x7f6ea40abc70 msgr2=0x7f6ea40c6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 shutdown_connections 2024-01-20T08:12:32.032 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.026+0000 7f6eab400640 1 -- 172.21.15.100:0/3532581944 wait complete. 2024-01-20T08:12:32.047 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":125,"stamp":"2024-01-20T08:12:31.929596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":251,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":197,"ondisk_log_size":197,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":380,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":247680,"kb_used_data":6536,"kb_used_omap":12,"kb_used_meta":241011,"kb_avail":754727040,"statfs":{"total":773094113280,"available":772840488960,"internally_reserved":0,"allocated":6692864,"data_stored":3519102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":246795825},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3651,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001932"},"pg_stats":[{"pgid":"11.3d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.521747+0000","last_change":"2024-01-20T08:12:27.130972+0000","last_active":"2024-01-20T08:12:28.521747+0000","last_peered":"2024-01-20T08:12:28.521747+0000","last_clean":"2024-01-20T08:12:28.521747+0000","last_became_active":"2024-01-20T08:12:27.130560+0000","last_became_peered":"2024-01-20T08:12:27.130560+0000","last_unstale":"2024-01-20T08:12:28.521747+0000","last_undegraded":"2024-01-20T08:12:28.521747+0000","last_fullsized":"2024-01-20T08:12:28.521747+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:03:45.609881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3f","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.101058+0000","last_change":"2024-01-20T08:12:07.068510+0000","last_active":"2024-01-20T08:12:27.101058+0000","last_peered":"2024-01-20T08:12:27.101058+0000","last_clean":"2024-01-20T08:12:27.101058+0000","last_became_active":"2024-01-20T08:12:07.068099+0000","last_became_peered":"2024-01-20T08:12:07.068099+0000","last_unstale":"2024-01-20T08:12:27.101058+0000","last_undegraded":"2024-01-20T08:12:27.101058+0000","last_fullsized":"2024-01-20T08:12:27.101058+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:51.051735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:30.035601+0000","last_change":"2024-01-20T08:12:27.143909+0000","last_active":"2024-01-20T08:12:30.035601+0000","last_peered":"2024-01-20T08:12:30.035601+0000","last_clean":"2024-01-20T08:12:30.035601+0000","last_became_active":"2024-01-20T08:12:27.143623+0000","last_became_peered":"2024-01-20T08:12:27.143623+0000","last_unstale":"2024-01-20T08:12:30.035601+0000","last_undegraded":"2024-01-20T08:12:30.035601+0000","last_fullsized":"2024-01-20T08:12:30.035601+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:53.372489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115909+0000","last_change":"2024-01-20T08:12:07.066208+0000","last_active":"2024-01-20T08:12:27.115909+0000","last_peered":"2024-01-20T08:12:27.115909+0000","last_clean":"2024-01-20T08:12:27.115909+0000","last_became_active":"2024-01-20T08:12:07.065935+0000","last_became_peered":"2024-01-20T08:12:07.065935+0000","last_unstale":"2024-01-20T08:12:27.115909+0000","last_undegraded":"2024-01-20T08:12:27.115909+0000","last_fullsized":"2024-01-20T08:12:27.115909+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:55:51.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290209+0000","last_change":"2024-01-20T08:12:27.121940+0000","last_active":"2024-01-20T08:12:28.290209+0000","last_peered":"2024-01-20T08:12:28.290209+0000","last_clean":"2024-01-20T08:12:28.290209+0000","last_became_active":"2024-01-20T08:12:27.120614+0000","last_became_peered":"2024-01-20T08:12:27.120614+0000","last_unstale":"2024-01-20T08:12:28.290209+0000","last_undegraded":"2024-01-20T08:12:28.290209+0000","last_fullsized":"2024-01-20T08:12:28.290209+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:29.708595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.105228+0000","last_change":"2024-01-20T08:12:07.079204+0000","last_active":"2024-01-20T08:12:27.105228+0000","last_peered":"2024-01-20T08:12:27.105228+0000","last_clean":"2024-01-20T08:12:27.105228+0000","last_became_active":"2024-01-20T08:12:07.078933+0000","last_became_peered":"2024-01-20T08:12:07.078933+0000","last_unstale":"2024-01-20T08:12:27.105228+0000","last_undegraded":"2024-01-20T08:12:27.105228+0000","last_fullsized":"2024-01-20T08:12:27.105228+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.114934+0000","last_change":"2024-01-20T08:12:27.150436+0000","last_active":"2024-01-20T08:12:28.114934+0000","last_peered":"2024-01-20T08:12:28.114934+0000","last_clean":"2024-01-20T08:12:28.114934+0000","last_became_active":"2024-01-20T08:12:27.150076+0000","last_became_peered":"2024-01-20T08:12:27.150076+0000","last_unstale":"2024-01-20T08:12:28.114934+0000","last_undegraded":"2024-01-20T08:12:28.114934+0000","last_fullsized":"2024-01-20T08:12:28.114934+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.827457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116127+0000","last_change":"2024-01-20T08:12:07.078940+0000","last_active":"2024-01-20T08:12:27.116127+0000","last_peered":"2024-01-20T08:12:27.116127+0000","last_clean":"2024-01-20T08:12:27.116127+0000","last_became_active":"2024-01-20T08:12:07.076282+0000","last_became_peered":"2024-01-20T08:12:07.076282+0000","last_unstale":"2024-01-20T08:12:27.116127+0000","last_undegraded":"2024-01-20T08:12:27.116127+0000","last_fullsized":"2024-01-20T08:12:27.116127+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.171960+0000","last_change":"2024-01-20T08:12:27.127734+0000","last_active":"2024-01-20T08:12:29.171960+0000","last_peered":"2024-01-20T08:12:29.171960+0000","last_clean":"2024-01-20T08:12:29.171960+0000","last_became_active":"2024-01-20T08:12:27.127443+0000","last_became_peered":"2024-01-20T08:12:27.127443+0000","last_unstale":"2024-01-20T08:12:29.171960+0000","last_undegraded":"2024-01-20T08:12:29.171960+0000","last_fullsized":"2024-01-20T08:12:29.171960+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:48.751015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.100312+0000","last_change":"2024-01-20T08:12:07.079405+0000","last_active":"2024-01-20T08:12:27.100312+0000","last_peered":"2024-01-20T08:12:27.100312+0000","last_clean":"2024-01-20T08:12:27.100312+0000","last_became_active":"2024-01-20T08:12:07.079108+0000","last_became_peered":"2024-01-20T08:12:07.079108+0000","last_unstale":"2024-01-20T08:12:27.100312+0000","last_undegraded":"2024-01-20T08:12:27.100312+0000","last_fullsized":"2024-01-20T08:12:27.100312+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:18.953566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.111716+0000","last_change":"2024-01-20T08:12:27.142113+0000","last_active":"2024-01-20T08:12:28.111716+0000","last_peered":"2024-01-20T08:12:28.111716+0000","last_clean":"2024-01-20T08:12:28.111716+0000","last_became_active":"2024-01-20T08:12:27.141721+0000","last_became_peered":"2024-01-20T08:12:27.141721+0000","last_unstale":"2024-01-20T08:12:28.111716+0000","last_undegraded":"2024-01-20T08:12:28.111716+0000","last_fullsized":"2024-01-20T08:12:28.111716+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:59:26.255178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.124972+0000","last_change":"2024-01-20T08:12:07.069601+0000","last_active":"2024-01-20T08:12:27.124972+0000","last_peered":"2024-01-20T08:12:27.124972+0000","last_clean":"2024-01-20T08:12:27.124972+0000","last_became_active":"2024-01-20T08:12:07.069275+0000","last_became_peered":"2024-01-20T08:12:07.069275+0000","last_unstale":"2024-01-20T08:12:27.124972+0000","last_undegraded":"2024-01-20T08:12:27.124972+0000","last_fullsized":"2024-01-20T08:12:27.124972+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.107211+0000","last_change":"2024-01-20T08:12:27.110589+0000","last_active":"2024-01-20T08:12:28.107211+0000","last_peered":"2024-01-20T08:12:28.107211+0000","last_clean":"2024-01-20T08:12:28.107211+0000","last_became_active":"2024-01-20T08:12:27.110004+0000","last_became_peered":"2024-01-20T08:12:27.110004+0000","last_unstale":"2024-01-20T08:12:28.107211+0000","last_undegraded":"2024-01-20T08:12:28.107211+0000","last_fullsized":"2024-01-20T08:12:28.107211+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:41.912777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.121423+0000","last_change":"2024-01-20T08:12:07.075671+0000","last_active":"2024-01-20T08:12:27.121423+0000","last_peered":"2024-01-20T08:12:27.121423+0000","last_clean":"2024-01-20T08:12:27.121423+0000","last_became_active":"2024-01-20T08:12:07.074069+0000","last_became_peered":"2024-01-20T08:12:07.074069+0000","last_unstale":"2024-01-20T08:12:27.121423+0000","last_undegraded":"2024-01-20T08:12:27.121423+0000","last_fullsized":"2024-01-20T08:12:27.121423+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.113108+0000","last_change":"2024-01-20T08:12:27.142841+0000","last_active":"2024-01-20T08:12:28.113108+0000","last_peered":"2024-01-20T08:12:28.113108+0000","last_clean":"2024-01-20T08:12:28.113108+0000","last_became_active":"2024-01-20T08:12:27.137074+0000","last_became_peered":"2024-01-20T08:12:27.137074+0000","last_unstale":"2024-01-20T08:12:28.113108+0000","last_undegraded":"2024-01-20T08:12:28.113108+0000","last_fullsized":"2024-01-20T08:12:28.113108+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:37.383615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.111877+0000","last_change":"2024-01-20T08:12:07.066879+0000","last_active":"2024-01-20T08:12:27.111877+0000","last_peered":"2024-01-20T08:12:27.111877+0000","last_clean":"2024-01-20T08:12:27.111877+0000","last_became_active":"2024-01-20T08:12:07.066268+0000","last_became_peered":"2024-01-20T08:12:07.066268+0000","last_unstale":"2024-01-20T08:12:27.111877+0000","last_undegraded":"2024-01-20T08:12:27.111877+0000","last_fullsized":"2024-01-20T08:12:27.111877+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:22.466513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.289832+0000","last_change":"2024-01-20T08:12:27.132282+0000","last_active":"2024-01-20T08:12:28.289832+0000","last_peered":"2024-01-20T08:12:28.289832+0000","last_clean":"2024-01-20T08:12:28.289832+0000","last_became_active":"2024-01-20T08:12:27.132010+0000","last_became_peered":"2024-01-20T08:12:27.132010+0000","last_unstale":"2024-01-20T08:12:28.289832+0000","last_undegraded":"2024-01-20T08:12:28.289832+0000","last_fullsized":"2024-01-20T08:12:28.289832+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:17:52.313901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127708+0000","last_change":"2024-01-20T08:12:07.071750+0000","last_active":"2024-01-20T08:12:27.127708+0000","last_peered":"2024-01-20T08:12:27.127708+0000","last_clean":"2024-01-20T08:12:27.127708+0000","last_became_active":"2024-01-20T08:12:07.071410+0000","last_became_peered":"2024-01-20T08:12:07.071410+0000","last_unstale":"2024-01-20T08:12:27.127708+0000","last_undegraded":"2024-01-20T08:12:27.127708+0000","last_fullsized":"2024-01-20T08:12:27.127708+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:10.996654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:30.035213+0000","last_change":"2024-01-20T08:12:27.129855+0000","last_active":"2024-01-20T08:12:30.035213+0000","last_peered":"2024-01-20T08:12:30.035213+0000","last_clean":"2024-01-20T08:12:30.035213+0000","last_became_active":"2024-01-20T08:12:27.129551+0000","last_became_peered":"2024-01-20T08:12:27.129551+0000","last_unstale":"2024-01-20T08:12:30.035213+0000","last_undegraded":"2024-01-20T08:12:30.035213+0000","last_fullsized":"2024-01-20T08:12:30.035213+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:45.568341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.119337+0000","last_change":"2024-01-20T08:12:07.064925+0000","last_active":"2024-01-20T08:12:27.119337+0000","last_peered":"2024-01-20T08:12:27.119337+0000","last_clean":"2024-01-20T08:12:27.119337+0000","last_became_active":"2024-01-20T08:12:07.064314+0000","last_became_peered":"2024-01-20T08:12:07.064314+0000","last_unstale":"2024-01-20T08:12:27.119337+0000","last_undegraded":"2024-01-20T08:12:27.119337+0000","last_fullsized":"2024-01-20T08:12:27.119337+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:52.116068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.108391+0000","last_change":"2024-01-20T08:12:27.121877+0000","last_active":"2024-01-20T08:12:28.108391+0000","last_peered":"2024-01-20T08:12:28.108391+0000","last_clean":"2024-01-20T08:12:28.108391+0000","last_became_active":"2024-01-20T08:12:27.121366+0000","last_became_peered":"2024-01-20T08:12:27.121366+0000","last_unstale":"2024-01-20T08:12:28.108391+0000","last_undegraded":"2024-01-20T08:12:28.108391+0000","last_fullsized":"2024-01-20T08:12:28.108391+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:21:09.366259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.119081+0000","last_change":"2024-01-20T08:12:07.069329+0000","last_active":"2024-01-20T08:12:27.119081+0000","last_peered":"2024-01-20T08:12:27.119081+0000","last_clean":"2024-01-20T08:12:27.119081+0000","last_became_active":"2024-01-20T08:12:07.068957+0000","last_became_peered":"2024-01-20T08:12:07.068957+0000","last_unstale":"2024-01-20T08:12:27.119081+0000","last_undegraded":"2024-01-20T08:12:27.119081+0000","last_fullsized":"2024-01-20T08:12:27.119081+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:15.643241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.114819+0000","last_change":"2024-01-20T08:12:27.135565+0000","last_active":"2024-01-20T08:12:28.114819+0000","last_peered":"2024-01-20T08:12:28.114819+0000","last_clean":"2024-01-20T08:12:28.114819+0000","last_became_active":"2024-01-20T08:12:27.135281+0000","last_became_peered":"2024-01-20T08:12:27.135281+0000","last_unstale":"2024-01-20T08:12:28.114819+0000","last_undegraded":"2024-01-20T08:12:28.114819+0000","last_fullsized":"2024-01-20T08:12:28.114819+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:17.388858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116306+0000","last_change":"2024-01-20T08:12:07.077771+0000","last_active":"2024-01-20T08:12:27.116306+0000","last_peered":"2024-01-20T08:12:27.116306+0000","last_clean":"2024-01-20T08:12:27.116306+0000","last_became_active":"2024-01-20T08:12:07.077498+0000","last_became_peered":"2024-01-20T08:12:07.077498+0000","last_unstale":"2024-01-20T08:12:27.116306+0000","last_undegraded":"2024-01-20T08:12:27.116306+0000","last_fullsized":"2024-01-20T08:12:27.116306+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.116777+0000","last_change":"2024-01-20T08:12:27.133944+0000","last_active":"2024-01-20T08:12:29.116777+0000","last_peered":"2024-01-20T08:12:29.116777+0000","last_clean":"2024-01-20T08:12:29.116777+0000","last_became_active":"2024-01-20T08:12:27.133706+0000","last_became_peered":"2024-01-20T08:12:27.133706+0000","last_unstale":"2024-01-20T08:12:29.116777+0000","last_undegraded":"2024-01-20T08:12:29.116777+0000","last_fullsized":"2024-01-20T08:12:29.116777+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:50:11.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.135706+0000","last_change":"2024-01-20T08:12:07.070855+0000","last_active":"2024-01-20T08:12:27.135706+0000","last_peered":"2024-01-20T08:12:27.135706+0000","last_clean":"2024-01-20T08:12:27.135706+0000","last_became_active":"2024-01-20T08:12:07.070467+0000","last_became_peered":"2024-01-20T08:12:07.070467+0000","last_unstale":"2024-01-20T08:12:27.135706+0000","last_undegraded":"2024-01-20T08:12:27.135706+0000","last_fullsized":"2024-01-20T08:12:27.135706+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:45.947061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.110039+0000","last_change":"2024-01-20T08:12:27.145853+0000","last_active":"2024-01-20T08:12:28.110039+0000","last_peered":"2024-01-20T08:12:28.110039+0000","last_clean":"2024-01-20T08:12:28.110039+0000","last_became_active":"2024-01-20T08:12:27.144657+0000","last_became_peered":"2024-01-20T08:12:27.144657+0000","last_unstale":"2024-01-20T08:12:28.110039+0000","last_undegraded":"2024-01-20T08:12:28.110039+0000","last_fullsized":"2024-01-20T08:12:28.110039+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:37:08.848983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.123633+0000","last_change":"2024-01-20T08:12:07.066074+0000","last_active":"2024-01-20T08:12:27.123633+0000","last_peered":"2024-01-20T08:12:27.123633+0000","last_clean":"2024-01-20T08:12:27.123633+0000","last_became_active":"2024-01-20T08:12:07.063801+0000","last_became_peered":"2024-01-20T08:12:07.063801+0000","last_unstale":"2024-01-20T08:12:27.123633+0000","last_undegraded":"2024-01-20T08:12:27.123633+0000","last_fullsized":"2024-01-20T08:12:27.123633+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:40.896208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.117376+0000","last_change":"2024-01-20T08:12:27.141663+0000","last_active":"2024-01-20T08:12:29.117376+0000","last_peered":"2024-01-20T08:12:29.117376+0000","last_clean":"2024-01-20T08:12:29.117376+0000","last_became_active":"2024-01-20T08:12:27.141407+0000","last_became_peered":"2024-01-20T08:12:27.141407+0000","last_unstale":"2024-01-20T08:12:29.117376+0000","last_undegraded":"2024-01-20T08:12:29.117376+0000","last_fullsized":"2024-01-20T08:12:29.117376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:17:52.313901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.124012+0000","last_change":"2024-01-20T08:12:07.055740+0000","last_active":"2024-01-20T08:12:27.124012+0000","last_peered":"2024-01-20T08:12:27.124012+0000","last_clean":"2024-01-20T08:12:27.124012+0000","last_became_active":"2024-01-20T08:12:07.055037+0000","last_became_peered":"2024-01-20T08:12:07.055037+0000","last_unstale":"2024-01-20T08:12:27.124012+0000","last_undegraded":"2024-01-20T08:12:27.124012+0000","last_fullsized":"2024-01-20T08:12:27.124012+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:07.521556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.106830+0000","last_change":"2024-01-20T08:12:27.138089+0000","last_active":"2024-01-20T08:12:28.106830+0000","last_peered":"2024-01-20T08:12:28.106830+0000","last_clean":"2024-01-20T08:12:28.106830+0000","last_became_active":"2024-01-20T08:12:27.137823+0000","last_became_peered":"2024-01-20T08:12:27.137823+0000","last_unstale":"2024-01-20T08:12:28.106830+0000","last_undegraded":"2024-01-20T08:12:28.106830+0000","last_fullsized":"2024-01-20T08:12:28.106830+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:24:56.879222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.120513+0000","last_change":"2024-01-20T08:12:07.079668+0000","last_active":"2024-01-20T08:12:27.120513+0000","last_peered":"2024-01-20T08:12:27.120513+0000","last_clean":"2024-01-20T08:12:27.120513+0000","last_became_active":"2024-01-20T08:12:07.075321+0000","last_became_peered":"2024-01-20T08:12:07.075321+0000","last_unstale":"2024-01-20T08:12:27.120513+0000","last_undegraded":"2024-01-20T08:12:27.120513+0000","last_fullsized":"2024-01-20T08:12:27.120513+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.113019+0000","last_change":"2024-01-20T08:12:27.144694+0000","last_active":"2024-01-20T08:12:28.113019+0000","last_peered":"2024-01-20T08:12:28.113019+0000","last_clean":"2024-01-20T08:12:28.113019+0000","last_became_active":"2024-01-20T08:12:27.143615+0000","last_became_peered":"2024-01-20T08:12:27.143615+0000","last_unstale":"2024-01-20T08:12:28.113019+0000","last_undegraded":"2024-01-20T08:12:28.113019+0000","last_fullsized":"2024-01-20T08:12:28.113019+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:37:08.848983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116882+0000","last_change":"2024-01-20T08:12:07.068449+0000","last_active":"2024-01-20T08:12:27.116882+0000","last_peered":"2024-01-20T08:12:27.116882+0000","last_clean":"2024-01-20T08:12:27.116882+0000","last_became_active":"2024-01-20T08:12:07.067404+0000","last_became_peered":"2024-01-20T08:12:07.067404+0000","last_unstale":"2024-01-20T08:12:27.116882+0000","last_undegraded":"2024-01-20T08:12:27.116882+0000","last_fullsized":"2024-01-20T08:12:27.116882+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:33:44.143818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.117436+0000","last_change":"2024-01-20T08:12:27.138958+0000","last_active":"2024-01-20T08:12:29.117436+0000","last_peered":"2024-01-20T08:12:29.117436+0000","last_clean":"2024-01-20T08:12:29.117436+0000","last_became_active":"2024-01-20T08:12:27.138648+0000","last_became_peered":"2024-01-20T08:12:27.138648+0000","last_unstale":"2024-01-20T08:12:29.117436+0000","last_undegraded":"2024-01-20T08:12:29.117436+0000","last_fullsized":"2024-01-20T08:12:29.117436+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:51:53.239852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.107932+0000","last_change":"2024-01-20T08:12:07.081616+0000","last_active":"2024-01-20T08:12:27.107932+0000","last_peered":"2024-01-20T08:12:27.107932+0000","last_clean":"2024-01-20T08:12:27.107932+0000","last_became_active":"2024-01-20T08:12:07.081014+0000","last_became_peered":"2024-01-20T08:12:07.081014+0000","last_unstale":"2024-01-20T08:12:27.107932+0000","last_undegraded":"2024-01-20T08:12:27.107932+0000","last_fullsized":"2024-01-20T08:12:27.107932+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.108373+0000","last_change":"2024-01-20T08:12:27.121608+0000","last_active":"2024-01-20T08:12:28.108373+0000","last_peered":"2024-01-20T08:12:28.108373+0000","last_clean":"2024-01-20T08:12:28.108373+0000","last_became_active":"2024-01-20T08:12:27.121290+0000","last_became_peered":"2024-01-20T08:12:27.121290+0000","last_unstale":"2024-01-20T08:12:28.108373+0000","last_undegraded":"2024-01-20T08:12:28.108373+0000","last_fullsized":"2024-01-20T08:12:28.108373+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:33.842891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.101586+0000","last_change":"2024-01-20T08:12:07.077693+0000","last_active":"2024-01-20T08:12:27.101586+0000","last_peered":"2024-01-20T08:12:27.101586+0000","last_clean":"2024-01-20T08:12:27.101586+0000","last_became_active":"2024-01-20T08:12:07.077448+0000","last_became_peered":"2024-01-20T08:12:07.077448+0000","last_unstale":"2024-01-20T08:12:27.101586+0000","last_undegraded":"2024-01-20T08:12:27.101586+0000","last_fullsized":"2024-01-20T08:12:27.101586+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:50:56.215178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:30.035844+0000","last_change":"2024-01-20T08:12:27.143926+0000","last_active":"2024-01-20T08:12:30.035844+0000","last_peered":"2024-01-20T08:12:30.035844+0000","last_clean":"2024-01-20T08:12:30.035844+0000","last_became_active":"2024-01-20T08:12:27.143244+0000","last_became_peered":"2024-01-20T08:12:27.143244+0000","last_unstale":"2024-01-20T08:12:30.035844+0000","last_undegraded":"2024-01-20T08:12:30.035844+0000","last_fullsized":"2024-01-20T08:12:30.035844+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:42.460102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.113711+0000","last_change":"2024-01-20T08:12:07.079543+0000","last_active":"2024-01-20T08:12:27.113711+0000","last_peered":"2024-01-20T08:12:27.113711+0000","last_clean":"2024-01-20T08:12:27.113711+0000","last_became_active":"2024-01-20T08:12:07.078435+0000","last_became_peered":"2024-01-20T08:12:07.078435+0000","last_unstale":"2024-01-20T08:12:27.113711+0000","last_undegraded":"2024-01-20T08:12:27.113711+0000","last_fullsized":"2024-01-20T08:12:27.113711+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:26:28.706699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.288619+0000","last_change":"2024-01-20T08:12:27.138185+0000","last_active":"2024-01-20T08:12:28.288619+0000","last_peered":"2024-01-20T08:12:28.288619+0000","last_clean":"2024-01-20T08:12:28.288619+0000","last_became_active":"2024-01-20T08:12:27.137840+0000","last_became_peered":"2024-01-20T08:12:27.137840+0000","last_unstale":"2024-01-20T08:12:28.288619+0000","last_undegraded":"2024-01-20T08:12:28.288619+0000","last_fullsized":"2024-01-20T08:12:28.288619+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:02:51.834482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.102365+0000","last_change":"2024-01-20T08:12:07.080145+0000","last_active":"2024-01-20T08:12:27.102365+0000","last_peered":"2024-01-20T08:12:27.102365+0000","last_clean":"2024-01-20T08:12:27.102365+0000","last_became_active":"2024-01-20T08:12:07.079803+0000","last_became_peered":"2024-01-20T08:12:07.079803+0000","last_unstale":"2024-01-20T08:12:27.102365+0000","last_undegraded":"2024-01-20T08:12:27.102365+0000","last_fullsized":"2024-01-20T08:12:27.102365+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:35.347679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.288676+0000","last_change":"2024-01-20T08:12:27.124069+0000","last_active":"2024-01-20T08:12:28.288676+0000","last_peered":"2024-01-20T08:12:28.288676+0000","last_clean":"2024-01-20T08:12:28.288676+0000","last_became_active":"2024-01-20T08:12:27.123798+0000","last_became_peered":"2024-01-20T08:12:27.123798+0000","last_unstale":"2024-01-20T08:12:28.288676+0000","last_undegraded":"2024-01-20T08:12:28.288676+0000","last_fullsized":"2024-01-20T08:12:28.288676+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:50:11.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115380+0000","last_change":"2024-01-20T08:12:07.072637+0000","last_active":"2024-01-20T08:12:27.115380+0000","last_peered":"2024-01-20T08:12:27.115380+0000","last_clean":"2024-01-20T08:12:27.115380+0000","last_became_active":"2024-01-20T08:12:07.068029+0000","last_became_peered":"2024-01-20T08:12:07.068029+0000","last_unstale":"2024-01-20T08:12:27.115380+0000","last_undegraded":"2024-01-20T08:12:27.115380+0000","last_fullsized":"2024-01-20T08:12:27.115380+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:36:48.804666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.113337+0000","last_change":"2024-01-20T08:12:27.129949+0000","last_active":"2024-01-20T08:12:28.113337+0000","last_peered":"2024-01-20T08:12:28.113337+0000","last_clean":"2024-01-20T08:12:28.113337+0000","last_became_active":"2024-01-20T08:12:27.129698+0000","last_became_peered":"2024-01-20T08:12:27.129698+0000","last_unstale":"2024-01-20T08:12:28.113337+0000","last_undegraded":"2024-01-20T08:12:28.113337+0000","last_fullsized":"2024-01-20T08:12:28.113337+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:00:13.827457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.102267+0000","last_change":"2024-01-20T08:12:07.087617+0000","last_active":"2024-01-20T08:12:27.102267+0000","last_peered":"2024-01-20T08:12:27.102267+0000","last_clean":"2024-01-20T08:12:27.102267+0000","last_became_active":"2024-01-20T08:12:07.085114+0000","last_became_peered":"2024-01-20T08:12:07.085114+0000","last_unstale":"2024-01-20T08:12:27.102267+0000","last_undegraded":"2024-01-20T08:12:27.102267+0000","last_fullsized":"2024-01-20T08:12:27.102267+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.111233+0000","last_change":"2024-01-20T08:12:27.130602+0000","last_active":"2024-01-20T08:12:28.111233+0000","last_peered":"2024-01-20T08:12:28.111233+0000","last_clean":"2024-01-20T08:12:28.111233+0000","last_became_active":"2024-01-20T08:12:27.130333+0000","last_became_peered":"2024-01-20T08:12:27.130333+0000","last_unstale":"2024-01-20T08:12:28.111233+0000","last_undegraded":"2024-01-20T08:12:28.111233+0000","last_fullsized":"2024-01-20T08:12:28.111233+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:37.383615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.141294+0000","last_change":"2024-01-20T08:12:07.072912+0000","last_active":"2024-01-20T08:12:27.141294+0000","last_peered":"2024-01-20T08:12:27.141294+0000","last_clean":"2024-01-20T08:12:27.141294+0000","last_became_active":"2024-01-20T08:12:07.072564+0000","last_became_peered":"2024-01-20T08:12:07.072564+0000","last_unstale":"2024-01-20T08:12:27.141294+0000","last_undegraded":"2024-01-20T08:12:27.141294+0000","last_fullsized":"2024-01-20T08:12:27.141294+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:21.868460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.522097+0000","last_change":"2024-01-20T08:12:27.134211+0000","last_active":"2024-01-20T08:12:28.522097+0000","last_peered":"2024-01-20T08:12:28.522097+0000","last_clean":"2024-01-20T08:12:28.522097+0000","last_became_active":"2024-01-20T08:12:27.132394+0000","last_became_peered":"2024-01-20T08:12:27.132394+0000","last_unstale":"2024-01-20T08:12:28.522097+0000","last_undegraded":"2024-01-20T08:12:28.522097+0000","last_fullsized":"2024-01-20T08:12:28.522097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:44.590481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.101899+0000","last_change":"2024-01-20T08:12:07.076077+0000","last_active":"2024-01-20T08:12:27.101899+0000","last_peered":"2024-01-20T08:12:27.101899+0000","last_clean":"2024-01-20T08:12:27.101899+0000","last_became_active":"2024-01-20T08:12:07.075830+0000","last_became_peered":"2024-01-20T08:12:07.075830+0000","last_unstale":"2024-01-20T08:12:27.101899+0000","last_undegraded":"2024-01-20T08:12:27.101899+0000","last_fullsized":"2024-01-20T08:12:27.101899+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:33:22.791363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.113854+0000","last_change":"2024-01-20T08:12:27.134593+0000","last_active":"2024-01-20T08:12:28.113854+0000","last_peered":"2024-01-20T08:12:28.113854+0000","last_clean":"2024-01-20T08:12:28.113854+0000","last_became_active":"2024-01-20T08:12:27.134293+0000","last_became_peered":"2024-01-20T08:12:27.134293+0000","last_unstale":"2024-01-20T08:12:28.113854+0000","last_undegraded":"2024-01-20T08:12:28.113854+0000","last_fullsized":"2024-01-20T08:12:28.113854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:05.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.117825+0000","last_change":"2024-01-20T08:12:07.072412+0000","last_active":"2024-01-20T08:12:27.117825+0000","last_peered":"2024-01-20T08:12:27.117825+0000","last_clean":"2024-01-20T08:12:27.117825+0000","last_became_active":"2024-01-20T08:12:07.072119+0000","last_became_peered":"2024-01-20T08:12:07.072119+0000","last_unstale":"2024-01-20T08:12:27.117825+0000","last_undegraded":"2024-01-20T08:12:27.117825+0000","last_fullsized":"2024-01-20T08:12:27.117825+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:45.594628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.115768+0000","last_change":"2024-01-20T08:12:27.128957+0000","last_active":"2024-01-20T08:12:28.115768+0000","last_peered":"2024-01-20T08:12:28.115768+0000","last_clean":"2024-01-20T08:12:28.115768+0000","last_became_active":"2024-01-20T08:12:27.128703+0000","last_became_peered":"2024-01-20T08:12:27.128703+0000","last_unstale":"2024-01-20T08:12:28.115768+0000","last_undegraded":"2024-01-20T08:12:28.115768+0000","last_fullsized":"2024-01-20T08:12:28.115768+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:57.731969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127803+0000","last_change":"2024-01-20T08:12:07.077399+0000","last_active":"2024-01-20T08:12:27.127803+0000","last_peered":"2024-01-20T08:12:27.127803+0000","last_clean":"2024-01-20T08:12:27.127803+0000","last_became_active":"2024-01-20T08:12:07.077122+0000","last_became_peered":"2024-01-20T08:12:07.077122+0000","last_unstale":"2024-01-20T08:12:27.127803+0000","last_undegraded":"2024-01-20T08:12:27.127803+0000","last_fullsized":"2024-01-20T08:12:27.127803+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:25.524024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.173429+0000","last_change":"2024-01-20T08:12:27.145235+0000","last_active":"2024-01-20T08:12:29.173429+0000","last_peered":"2024-01-20T08:12:29.173429+0000","last_clean":"2024-01-20T08:12:29.173429+0000","last_became_active":"2024-01-20T08:12:27.144915+0000","last_became_peered":"2024-01-20T08:12:27.144915+0000","last_unstale":"2024-01-20T08:12:29.173429+0000","last_undegraded":"2024-01-20T08:12:29.173429+0000","last_fullsized":"2024-01-20T08:12:29.173429+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:50:11.670934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.099956+0000","last_change":"2024-01-20T08:12:07.076949+0000","last_active":"2024-01-20T08:12:27.099956+0000","last_peered":"2024-01-20T08:12:27.099956+0000","last_clean":"2024-01-20T08:12:27.099956+0000","last_became_active":"2024-01-20T08:12:07.076497+0000","last_became_peered":"2024-01-20T08:12:07.076497+0000","last_unstale":"2024-01-20T08:12:27.099956+0000","last_undegraded":"2024-01-20T08:12:27.099956+0000","last_fullsized":"2024-01-20T08:12:27.099956+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:04:40.245579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.172210+0000","last_change":"2024-01-20T08:12:27.135545+0000","last_active":"2024-01-20T08:12:29.172210+0000","last_peered":"2024-01-20T08:12:29.172210+0000","last_clean":"2024-01-20T08:12:29.172210+0000","last_became_active":"2024-01-20T08:12:27.135288+0000","last_became_peered":"2024-01-20T08:12:27.135288+0000","last_unstale":"2024-01-20T08:12:29.172210+0000","last_undegraded":"2024-01-20T08:12:29.172210+0000","last_fullsized":"2024-01-20T08:12:29.172210+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:28.282304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116403+0000","last_change":"2024-01-20T08:12:07.079522+0000","last_active":"2024-01-20T08:12:27.116403+0000","last_peered":"2024-01-20T08:12:27.116403+0000","last_clean":"2024-01-20T08:12:27.116403+0000","last_became_active":"2024-01-20T08:12:07.079268+0000","last_became_peered":"2024-01-20T08:12:07.079268+0000","last_unstale":"2024-01-20T08:12:27.116403+0000","last_undegraded":"2024-01-20T08:12:27.116403+0000","last_fullsized":"2024-01-20T08:12:27.116403+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:37.687652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.112406+0000","last_change":"2024-01-20T08:12:27.142440+0000","last_active":"2024-01-20T08:12:28.112406+0000","last_peered":"2024-01-20T08:12:28.112406+0000","last_clean":"2024-01-20T08:12:28.112406+0000","last_became_active":"2024-01-20T08:12:27.142085+0000","last_became_peered":"2024-01-20T08:12:27.142085+0000","last_unstale":"2024-01-20T08:12:28.112406+0000","last_undegraded":"2024-01-20T08:12:28.112406+0000","last_fullsized":"2024-01-20T08:12:28.112406+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:37:35.880239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.103484+0000","last_change":"2024-01-20T08:12:07.076533+0000","last_active":"2024-01-20T08:12:27.103484+0000","last_peered":"2024-01-20T08:12:27.103484+0000","last_clean":"2024-01-20T08:12:27.103484+0000","last_became_active":"2024-01-20T08:12:07.076184+0000","last_became_peered":"2024-01-20T08:12:07.076184+0000","last_unstale":"2024-01-20T08:12:27.103484+0000","last_undegraded":"2024-01-20T08:12:27.103484+0000","last_fullsized":"2024-01-20T08:12:27.103484+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:49:57.037227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.521357+0000","last_change":"2024-01-20T08:12:27.127864+0000","last_active":"2024-01-20T08:12:28.521357+0000","last_peered":"2024-01-20T08:12:28.521357+0000","last_clean":"2024-01-20T08:12:28.521357+0000","last_became_active":"2024-01-20T08:12:27.126382+0000","last_became_peered":"2024-01-20T08:12:27.126382+0000","last_unstale":"2024-01-20T08:12:28.521357+0000","last_undegraded":"2024-01-20T08:12:28.521357+0000","last_fullsized":"2024-01-20T08:12:28.521357+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:37:59.541151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.098623+0000","last_change":"2024-01-20T08:12:07.071054+0000","last_active":"2024-01-20T08:12:27.098623+0000","last_peered":"2024-01-20T08:12:27.098623+0000","last_clean":"2024-01-20T08:12:27.098623+0000","last_became_active":"2024-01-20T08:12:07.070741+0000","last_became_peered":"2024-01-20T08:12:07.070741+0000","last_unstale":"2024-01-20T08:12:27.098623+0000","last_undegraded":"2024-01-20T08:12:27.098623+0000","last_fullsized":"2024-01-20T08:12:27.098623+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:41:03.112854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.172339+0000","last_change":"2024-01-20T08:12:27.143917+0000","last_active":"2024-01-20T08:12:29.172339+0000","last_peered":"2024-01-20T08:12:29.172339+0000","last_clean":"2024-01-20T08:12:29.172339+0000","last_became_active":"2024-01-20T08:12:27.137780+0000","last_became_peered":"2024-01-20T08:12:27.137780+0000","last_unstale":"2024-01-20T08:12:29.172339+0000","last_undegraded":"2024-01-20T08:12:29.172339+0000","last_fullsized":"2024-01-20T08:12:29.172339+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:56:11.647675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.120733+0000","last_change":"2024-01-20T08:12:07.078867+0000","last_active":"2024-01-20T08:12:27.120733+0000","last_peered":"2024-01-20T08:12:27.120733+0000","last_clean":"2024-01-20T08:12:27.120733+0000","last_became_active":"2024-01-20T08:12:07.078639+0000","last_became_peered":"2024-01-20T08:12:07.078639+0000","last_unstale":"2024-01-20T08:12:27.120733+0000","last_undegraded":"2024-01-20T08:12:27.120733+0000","last_fullsized":"2024-01-20T08:12:27.120733+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.112858+0000","last_change":"2024-01-20T08:12:27.147473+0000","last_active":"2024-01-20T08:12:28.112858+0000","last_peered":"2024-01-20T08:12:28.112858+0000","last_clean":"2024-01-20T08:12:28.112858+0000","last_became_active":"2024-01-20T08:12:27.147104+0000","last_became_peered":"2024-01-20T08:12:27.147104+0000","last_unstale":"2024-01-20T08:12:28.112858+0000","last_undegraded":"2024-01-20T08:12:28.112858+0000","last_fullsized":"2024-01-20T08:12:28.112858+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:26:36.338404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.162308+0000","last_change":"2024-01-20T08:12:26.115997+0000","last_active":"2024-01-20T08:12:27.162308+0000","last_peered":"2024-01-20T08:12:27.162308+0000","last_clean":"2024-01-20T08:12:27.162308+0000","last_became_active":"2024-01-20T08:12:26.115679+0000","last_became_peered":"2024-01-20T08:12:26.115679+0000","last_unstale":"2024-01-20T08:12:27.162308+0000","last_undegraded":"2024-01-20T08:12:27.162308+0000","last_fullsized":"2024-01-20T08:12:27.162308+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:12:01.515598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.125508+0000","last_change":"2024-01-20T08:12:07.080377+0000","last_active":"2024-01-20T08:12:27.125508+0000","last_peered":"2024-01-20T08:12:27.125508+0000","last_clean":"2024-01-20T08:12:27.125508+0000","last_became_active":"2024-01-20T08:12:07.080044+0000","last_became_peered":"2024-01-20T08:12:07.080044+0000","last_unstale":"2024-01-20T08:12:27.125508+0000","last_undegraded":"2024-01-20T08:12:27.125508+0000","last_fullsized":"2024-01-20T08:12:27.125508+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:33.328172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"51'4","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.126520+0000","last_change":"2024-01-20T08:12:06.069013+0000","last_active":"2024-01-20T08:12:27.126520+0000","last_peered":"2024-01-20T08:12:27.126520+0000","last_clean":"2024-01-20T08:12:27.126520+0000","last_became_active":"2024-01-20T08:12:06.068785+0000","last_became_peered":"2024-01-20T08:12:06.068785+0000","last_unstale":"2024-01-20T08:12:27.126520+0000","last_undegraded":"2024-01-20T08:12:27.126520+0000","last_fullsized":"2024-01-20T08:12:27.126520+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:48.916750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290096+0000","last_change":"2024-01-20T08:12:27.134586+0000","last_active":"2024-01-20T08:12:28.290096+0000","last_peered":"2024-01-20T08:12:28.290096+0000","last_clean":"2024-01-20T08:12:28.290096+0000","last_became_active":"2024-01-20T08:12:27.134178+0000","last_became_peered":"2024-01-20T08:12:27.134178+0000","last_unstale":"2024-01-20T08:12:28.290096+0000","last_undegraded":"2024-01-20T08:12:28.290096+0000","last_fullsized":"2024-01-20T08:12:28.290096+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:51:53.239852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.161815+0000","last_change":"2024-01-20T08:12:26.111012+0000","last_active":"2024-01-20T08:12:27.161815+0000","last_peered":"2024-01-20T08:12:27.161815+0000","last_clean":"2024-01-20T08:12:27.161815+0000","last_became_active":"2024-01-20T08:12:26.109316+0000","last_became_peered":"2024-01-20T08:12:26.109316+0000","last_unstale":"2024-01-20T08:12:27.161815+0000","last_undegraded":"2024-01-20T08:12:27.161815+0000","last_fullsized":"2024-01-20T08:12:27.161815+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:16.065901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118032+0000","last_change":"2024-01-20T08:12:07.074189+0000","last_active":"2024-01-20T08:12:27.118032+0000","last_peered":"2024-01-20T08:12:27.118032+0000","last_clean":"2024-01-20T08:12:27.118032+0000","last_became_active":"2024-01-20T08:12:07.073922+0000","last_became_peered":"2024-01-20T08:12:07.073922+0000","last_unstale":"2024-01-20T08:12:27.118032+0000","last_undegraded":"2024-01-20T08:12:27.118032+0000","last_fullsized":"2024-01-20T08:12:27.118032+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:06.100880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"51'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116066+0000","last_change":"2024-01-20T08:12:06.067289+0000","last_active":"2024-01-20T08:12:27.116066+0000","last_peered":"2024-01-20T08:12:27.116066+0000","last_clean":"2024-01-20T08:12:27.116066+0000","last_became_active":"2024-01-20T08:12:06.066945+0000","last_became_peered":"2024-01-20T08:12:06.066945+0000","last_unstale":"2024-01-20T08:12:27.116066+0000","last_undegraded":"2024-01-20T08:12:27.116066+0000","last_fullsized":"2024-01-20T08:12:27.116066+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:05.035478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290104+0000","last_change":"2024-01-20T08:12:27.151583+0000","last_active":"2024-01-20T08:12:28.290104+0000","last_peered":"2024-01-20T08:12:28.290104+0000","last_clean":"2024-01-20T08:12:28.290104+0000","last_became_active":"2024-01-20T08:12:27.149925+0000","last_became_peered":"2024-01-20T08:12:27.149925+0000","last_unstale":"2024-01-20T08:12:28.290104+0000","last_undegraded":"2024-01-20T08:12:28.290104+0000","last_fullsized":"2024-01-20T08:12:28.290104+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:55.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"55'4","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.156592+0000","last_change":"2024-01-20T08:12:26.103762+0000","last_active":"2024-01-20T08:12:27.156592+0000","last_peered":"2024-01-20T08:12:27.156592+0000","last_clean":"2024-01-20T08:12:27.156592+0000","last_became_active":"2024-01-20T08:12:26.103322+0000","last_became_peered":"2024-01-20T08:12:26.103322+0000","last_unstale":"2024-01-20T08:12:27.156592+0000","last_undegraded":"2024-01-20T08:12:27.156592+0000","last_fullsized":"2024-01-20T08:12:27.156592+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:37:34.864596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127763+0000","last_change":"2024-01-20T08:12:07.082658+0000","last_active":"2024-01-20T08:12:27.127763+0000","last_peered":"2024-01-20T08:12:27.127763+0000","last_clean":"2024-01-20T08:12:27.127763+0000","last_became_active":"2024-01-20T08:12:07.082212+0000","last_became_peered":"2024-01-20T08:12:07.082212+0000","last_unstale":"2024-01-20T08:12:27.127763+0000","last_undegraded":"2024-01-20T08:12:27.127763+0000","last_fullsized":"2024-01-20T08:12:27.127763+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.128212+0000","last_change":"2024-01-20T08:12:06.058720+0000","last_active":"2024-01-20T08:12:27.128212+0000","last_peered":"2024-01-20T08:12:27.128212+0000","last_clean":"2024-01-20T08:12:27.128212+0000","last_became_active":"2024-01-20T08:12:06.058352+0000","last_became_peered":"2024-01-20T08:12:06.058352+0000","last_unstale":"2024-01-20T08:12:27.128212+0000","last_undegraded":"2024-01-20T08:12:27.128212+0000","last_fullsized":"2024-01-20T08:12:27.128212+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:09.990692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.108706+0000","last_change":"2024-01-20T08:12:27.125100+0000","last_active":"2024-01-20T08:12:28.108706+0000","last_peered":"2024-01-20T08:12:28.108706+0000","last_clean":"2024-01-20T08:12:28.108706+0000","last_became_active":"2024-01-20T08:12:27.121626+0000","last_became_peered":"2024-01-20T08:12:27.121626+0000","last_unstale":"2024-01-20T08:12:28.108706+0000","last_undegraded":"2024-01-20T08:12:28.108706+0000","last_fullsized":"2024-01-20T08:12:28.108706+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:35.687558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.148268+0000","last_change":"2024-01-20T08:12:26.089717+0000","last_active":"2024-01-20T08:12:27.148268+0000","last_peered":"2024-01-20T08:12:27.148268+0000","last_clean":"2024-01-20T08:12:27.148268+0000","last_became_active":"2024-01-20T08:12:26.089424+0000","last_became_peered":"2024-01-20T08:12:26.089424+0000","last_unstale":"2024-01-20T08:12:27.148268+0000","last_undegraded":"2024-01-20T08:12:27.148268+0000","last_fullsized":"2024-01-20T08:12:27.148268+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:03:16.373216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.128024+0000","last_change":"2024-01-20T08:12:07.080508+0000","last_active":"2024-01-20T08:12:27.128024+0000","last_peered":"2024-01-20T08:12:27.128024+0000","last_clean":"2024-01-20T08:12:27.128024+0000","last_became_active":"2024-01-20T08:12:07.080057+0000","last_became_peered":"2024-01-20T08:12:07.080057+0000","last_unstale":"2024-01-20T08:12:27.128024+0000","last_undegraded":"2024-01-20T08:12:27.128024+0000","last_fullsized":"2024-01-20T08:12:27.128024+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:34:22.415785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116936+0000","last_change":"2024-01-20T08:12:06.073731+0000","last_active":"2024-01-20T08:12:27.116936+0000","last_peered":"2024-01-20T08:12:27.116936+0000","last_clean":"2024-01-20T08:12:27.116936+0000","last_became_active":"2024-01-20T08:12:06.073398+0000","last_became_peered":"2024-01-20T08:12:06.073398+0000","last_unstale":"2024-01-20T08:12:27.116936+0000","last_undegraded":"2024-01-20T08:12:27.116936+0000","last_fullsized":"2024-01-20T08:12:27.116936+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:50:14.637280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.106918+0000","last_change":"2024-01-20T08:12:27.136505+0000","last_active":"2024-01-20T08:12:28.106918+0000","last_peered":"2024-01-20T08:12:28.106918+0000","last_clean":"2024-01-20T08:12:28.106918+0000","last_became_active":"2024-01-20T08:12:27.135631+0000","last_became_peered":"2024-01-20T08:12:27.135631+0000","last_unstale":"2024-01-20T08:12:28.106918+0000","last_undegraded":"2024-01-20T08:12:28.106918+0000","last_fullsized":"2024-01-20T08:12:28.106918+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:53.055972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.110895+0000","last_change":"2024-01-20T08:12:26.103678+0000","last_active":"2024-01-20T08:12:27.110895+0000","last_peered":"2024-01-20T08:12:27.110895+0000","last_clean":"2024-01-20T08:12:27.110895+0000","last_became_active":"2024-01-20T08:12:26.103052+0000","last_became_peered":"2024-01-20T08:12:26.103052+0000","last_unstale":"2024-01-20T08:12:27.110895+0000","last_undegraded":"2024-01-20T08:12:27.110895+0000","last_fullsized":"2024-01-20T08:12:27.110895+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:54.376353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115489+0000","last_change":"2024-01-20T08:12:07.072285+0000","last_active":"2024-01-20T08:12:27.115489+0000","last_peered":"2024-01-20T08:12:27.115489+0000","last_clean":"2024-01-20T08:12:27.115489+0000","last_became_active":"2024-01-20T08:12:07.068016+0000","last_became_peered":"2024-01-20T08:12:07.068016+0000","last_unstale":"2024-01-20T08:12:27.115489+0000","last_undegraded":"2024-01-20T08:12:27.115489+0000","last_fullsized":"2024-01-20T08:12:27.115489+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:23:17.339298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"51'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.124429+0000","last_change":"2024-01-20T08:12:06.062959+0000","last_active":"2024-01-20T08:12:27.124429+0000","last_peered":"2024-01-20T08:12:27.124429+0000","last_clean":"2024-01-20T08:12:27.124429+0000","last_became_active":"2024-01-20T08:12:06.062074+0000","last_became_peered":"2024-01-20T08:12:06.062074+0000","last_unstale":"2024-01-20T08:12:27.124429+0000","last_undegraded":"2024-01-20T08:12:27.124429+0000","last_fullsized":"2024-01-20T08:12:27.124429+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:20.862498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.116854+0000","last_change":"2024-01-20T08:12:27.135342+0000","last_active":"2024-01-20T08:12:29.116854+0000","last_peered":"2024-01-20T08:12:29.116854+0000","last_clean":"2024-01-20T08:12:29.116854+0000","last_became_active":"2024-01-20T08:12:27.135040+0000","last_became_peered":"2024-01-20T08:12:27.135040+0000","last_unstale":"2024-01-20T08:12:29.116854+0000","last_undegraded":"2024-01-20T08:12:29.116854+0000","last_fullsized":"2024-01-20T08:12:29.116854+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:35:43.764582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.098753+0000","last_change":"2024-01-20T08:12:26.091424+0000","last_active":"2024-01-20T08:12:27.098753+0000","last_peered":"2024-01-20T08:12:27.098753+0000","last_clean":"2024-01-20T08:12:27.098753+0000","last_became_active":"2024-01-20T08:12:26.091124+0000","last_became_peered":"2024-01-20T08:12:26.091124+0000","last_unstale":"2024-01-20T08:12:27.098753+0000","last_undegraded":"2024-01-20T08:12:27.098753+0000","last_fullsized":"2024-01-20T08:12:27.098753+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:38:03.972892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116157+0000","last_change":"2024-01-20T08:12:07.073980+0000","last_active":"2024-01-20T08:12:27.116157+0000","last_peered":"2024-01-20T08:12:27.116157+0000","last_clean":"2024-01-20T08:12:27.116157+0000","last_became_active":"2024-01-20T08:12:07.072685+0000","last_became_peered":"2024-01-20T08:12:07.072685+0000","last_unstale":"2024-01-20T08:12:27.116157+0000","last_undegraded":"2024-01-20T08:12:27.116157+0000","last_fullsized":"2024-01-20T08:12:27.116157+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:02:57.344542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"51'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127530+0000","last_change":"2024-01-20T08:12:06.063065+0000","last_active":"2024-01-20T08:12:27.127530+0000","last_peered":"2024-01-20T08:12:27.127530+0000","last_clean":"2024-01-20T08:12:27.127530+0000","last_became_active":"2024-01-20T08:12:06.062833+0000","last_became_peered":"2024-01-20T08:12:06.062833+0000","last_unstale":"2024-01-20T08:12:27.127530+0000","last_undegraded":"2024-01-20T08:12:27.127530+0000","last_fullsized":"2024-01-20T08:12:27.127530+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.172488+0000","last_change":"2024-01-20T08:12:27.134127+0000","last_active":"2024-01-20T08:12:29.172488+0000","last_peered":"2024-01-20T08:12:29.172488+0000","last_clean":"2024-01-20T08:12:29.172488+0000","last_became_active":"2024-01-20T08:12:27.133728+0000","last_became_peered":"2024-01-20T08:12:27.133728+0000","last_unstale":"2024-01-20T08:12:29.172488+0000","last_undegraded":"2024-01-20T08:12:29.172488+0000","last_fullsized":"2024-01-20T08:12:29.172488+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:34:04.188134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.149647+0000","last_change":"2024-01-20T08:12:26.111573+0000","last_active":"2024-01-20T08:12:27.149647+0000","last_peered":"2024-01-20T08:12:27.149647+0000","last_clean":"2024-01-20T08:12:27.149647+0000","last_became_active":"2024-01-20T08:12:26.111240+0000","last_became_peered":"2024-01-20T08:12:26.111240+0000","last_unstale":"2024-01-20T08:12:27.149647+0000","last_undegraded":"2024-01-20T08:12:27.149647+0000","last_fullsized":"2024-01-20T08:12:27.149647+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:51:28.692953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.141430+0000","last_change":"2024-01-20T08:12:07.081364+0000","last_active":"2024-01-20T08:12:27.141430+0000","last_peered":"2024-01-20T08:12:27.141430+0000","last_clean":"2024-01-20T08:12:27.141430+0000","last_became_active":"2024-01-20T08:12:07.080761+0000","last_became_peered":"2024-01-20T08:12:07.080761+0000","last_unstale":"2024-01-20T08:12:27.141430+0000","last_undegraded":"2024-01-20T08:12:27.141430+0000","last_fullsized":"2024-01-20T08:12:27.141430+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:29.139178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115091+0000","last_change":"2024-01-20T08:12:06.071618+0000","last_active":"2024-01-20T08:12:27.115091+0000","last_peered":"2024-01-20T08:12:27.115091+0000","last_clean":"2024-01-20T08:12:27.115091+0000","last_became_active":"2024-01-20T08:12:06.070615+0000","last_became_peered":"2024-01-20T08:12:06.070615+0000","last_unstale":"2024-01-20T08:12:27.115091+0000","last_undegraded":"2024-01-20T08:12:27.115091+0000","last_fullsized":"2024-01-20T08:12:27.115091+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:21:51.110106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.112853+0000","last_change":"2024-01-20T08:12:27.145178+0000","last_active":"2024-01-20T08:12:28.112853+0000","last_peered":"2024-01-20T08:12:28.112853+0000","last_clean":"2024-01-20T08:12:28.112853+0000","last_became_active":"2024-01-20T08:12:27.144573+0000","last_became_peered":"2024-01-20T08:12:27.144573+0000","last_unstale":"2024-01-20T08:12:28.112853+0000","last_undegraded":"2024-01-20T08:12:28.112853+0000","last_fullsized":"2024-01-20T08:12:28.112853+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:42.510830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.153509+0000","last_change":"2024-01-20T08:12:26.112631+0000","last_active":"2024-01-20T08:12:27.153509+0000","last_peered":"2024-01-20T08:12:27.153509+0000","last_clean":"2024-01-20T08:12:27.153509+0000","last_became_active":"2024-01-20T08:12:26.111968+0000","last_became_peered":"2024-01-20T08:12:26.111968+0000","last_unstale":"2024-01-20T08:12:27.153509+0000","last_undegraded":"2024-01-20T08:12:27.153509+0000","last_fullsized":"2024-01-20T08:12:27.153509+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:01:49.976172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.114815+0000","last_change":"2024-01-20T08:12:07.078826+0000","last_active":"2024-01-20T08:12:27.114815+0000","last_peered":"2024-01-20T08:12:27.114815+0000","last_clean":"2024-01-20T08:12:27.114815+0000","last_became_active":"2024-01-20T08:12:07.078429+0000","last_became_peered":"2024-01-20T08:12:07.078429+0000","last_unstale":"2024-01-20T08:12:27.114815+0000","last_undegraded":"2024-01-20T08:12:27.114815+0000","last_fullsized":"2024-01-20T08:12:27.114815+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:20.143195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.122711+0000","last_change":"2024-01-20T08:12:06.055455+0000","last_active":"2024-01-20T08:12:27.122711+0000","last_peered":"2024-01-20T08:12:27.122711+0000","last_clean":"2024-01-20T08:12:27.122711+0000","last_became_active":"2024-01-20T08:12:06.053817+0000","last_became_peered":"2024-01-20T08:12:06.053817+0000","last_unstale":"2024-01-20T08:12:27.122711+0000","last_undegraded":"2024-01-20T08:12:27.122711+0000","last_fullsized":"2024-01-20T08:12:27.122711+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:55:32.005693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.113343+0000","last_change":"2024-01-20T08:12:27.157608+0000","last_active":"2024-01-20T08:12:28.113343+0000","last_peered":"2024-01-20T08:12:28.113343+0000","last_clean":"2024-01-20T08:12:28.113343+0000","last_became_active":"2024-01-20T08:12:27.150828+0000","last_became_peered":"2024-01-20T08:12:27.150828+0000","last_unstale":"2024-01-20T08:12:28.113343+0000","last_undegraded":"2024-01-20T08:12:28.113343+0000","last_fullsized":"2024-01-20T08:12:28.113343+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:38:42.510830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"55'3","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.152314+0000","last_change":"2024-01-20T08:12:26.097801+0000","last_active":"2024-01-20T08:12:27.152314+0000","last_peered":"2024-01-20T08:12:27.152314+0000","last_clean":"2024-01-20T08:12:27.152314+0000","last_became_active":"2024-01-20T08:12:26.097067+0000","last_became_peered":"2024-01-20T08:12:26.097067+0000","last_unstale":"2024-01-20T08:12:27.152314+0000","last_undegraded":"2024-01-20T08:12:27.152314+0000","last_fullsized":"2024-01-20T08:12:27.152314+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:46:14.200779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127408+0000","last_change":"2024-01-20T08:12:07.069110+0000","last_active":"2024-01-20T08:12:27.127408+0000","last_peered":"2024-01-20T08:12:27.127408+0000","last_clean":"2024-01-20T08:12:27.127408+0000","last_became_active":"2024-01-20T08:12:07.068542+0000","last_became_peered":"2024-01-20T08:12:07.068542+0000","last_unstale":"2024-01-20T08:12:27.127408+0000","last_undegraded":"2024-01-20T08:12:27.127408+0000","last_fullsized":"2024-01-20T08:12:27.127408+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:33.766825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.107890+0000","last_change":"2024-01-20T08:12:06.075567+0000","last_active":"2024-01-20T08:12:27.107890+0000","last_peered":"2024-01-20T08:12:27.107890+0000","last_clean":"2024-01-20T08:12:27.107890+0000","last_became_active":"2024-01-20T08:12:06.075224+0000","last_became_peered":"2024-01-20T08:12:06.075224+0000","last_unstale":"2024-01-20T08:12:27.107890+0000","last_undegraded":"2024-01-20T08:12:27.107890+0000","last_fullsized":"2024-01-20T08:12:27.107890+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:37.894928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.107656+0000","last_change":"2024-01-20T08:12:27.124228+0000","last_active":"2024-01-20T08:12:28.107656+0000","last_peered":"2024-01-20T08:12:28.107656+0000","last_clean":"2024-01-20T08:12:28.107656+0000","last_became_active":"2024-01-20T08:12:27.122772+0000","last_became_peered":"2024-01-20T08:12:27.122772+0000","last_unstale":"2024-01-20T08:12:28.107656+0000","last_undegraded":"2024-01-20T08:12:28.107656+0000","last_fullsized":"2024-01-20T08:12:28.107656+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:05.956678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"55'6","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.158643+0000","last_change":"2024-01-20T08:12:26.097992+0000","last_active":"2024-01-20T08:12:27.158643+0000","last_peered":"2024-01-20T08:12:27.158643+0000","last_clean":"2024-01-20T08:12:27.158643+0000","last_became_active":"2024-01-20T08:12:26.097728+0000","last_became_peered":"2024-01-20T08:12:26.097728+0000","last_unstale":"2024-01-20T08:12:27.158643+0000","last_undegraded":"2024-01-20T08:12:27.158643+0000","last_fullsized":"2024-01-20T08:12:27.158643+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:25.070113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.107251+0000","last_change":"2024-01-20T08:12:07.087383+0000","last_active":"2024-01-20T08:12:27.107251+0000","last_peered":"2024-01-20T08:12:27.107251+0000","last_clean":"2024-01-20T08:12:27.107251+0000","last_became_active":"2024-01-20T08:12:07.080077+0000","last_became_peered":"2024-01-20T08:12:07.080077+0000","last_unstale":"2024-01-20T08:12:27.107251+0000","last_undegraded":"2024-01-20T08:12:27.107251+0000","last_fullsized":"2024-01-20T08:12:27.107251+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:17.477872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116199+0000","last_change":"2024-01-20T08:12:06.061973+0000","last_active":"2024-01-20T08:12:27.116199+0000","last_peered":"2024-01-20T08:12:27.116199+0000","last_clean":"2024-01-20T08:12:27.116199+0000","last_became_active":"2024-01-20T08:12:06.061556+0000","last_became_peered":"2024-01-20T08:12:06.061556+0000","last_unstale":"2024-01-20T08:12:27.116199+0000","last_undegraded":"2024-01-20T08:12:27.116199+0000","last_fullsized":"2024-01-20T08:12:27.116199+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:13:44.588667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.173500+0000","last_change":"2024-01-20T08:12:27.138432+0000","last_active":"2024-01-20T08:12:29.173500+0000","last_peered":"2024-01-20T08:12:29.173500+0000","last_clean":"2024-01-20T08:12:29.173500+0000","last_became_active":"2024-01-20T08:12:27.138148+0000","last_became_peered":"2024-01-20T08:12:27.138148+0000","last_unstale":"2024-01-20T08:12:29.173500+0000","last_undegraded":"2024-01-20T08:12:29.173500+0000","last_fullsized":"2024-01-20T08:12:29.173500+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:35:43.764582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127604+0000","last_change":"2024-01-20T08:12:26.109704+0000","last_active":"2024-01-20T08:12:27.127604+0000","last_peered":"2024-01-20T08:12:27.127604+0000","last_clean":"2024-01-20T08:12:27.127604+0000","last_became_active":"2024-01-20T08:12:26.109120+0000","last_became_peered":"2024-01-20T08:12:26.109120+0000","last_unstale":"2024-01-20T08:12:27.127604+0000","last_undegraded":"2024-01-20T08:12:27.127604+0000","last_fullsized":"2024-01-20T08:12:27.127604+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:41:52.356846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118895+0000","last_change":"2024-01-20T08:12:07.057739+0000","last_active":"2024-01-20T08:12:27.118895+0000","last_peered":"2024-01-20T08:12:27.118895+0000","last_clean":"2024-01-20T08:12:27.118895+0000","last_became_active":"2024-01-20T08:12:07.055502+0000","last_became_peered":"2024-01-20T08:12:07.055502+0000","last_unstale":"2024-01-20T08:12:27.118895+0000","last_undegraded":"2024-01-20T08:12:27.118895+0000","last_fullsized":"2024-01-20T08:12:27.118895+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:54:13.798575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"51'3","reported_seq":19,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.105526+0000","last_change":"2024-01-20T08:12:06.075821+0000","last_active":"2024-01-20T08:12:27.105526+0000","last_peered":"2024-01-20T08:12:27.105526+0000","last_clean":"2024-01-20T08:12:27.105526+0000","last_became_active":"2024-01-20T08:12:06.075449+0000","last_became_peered":"2024-01-20T08:12:06.075449+0000","last_unstale":"2024-01-20T08:12:27.105526+0000","last_undegraded":"2024-01-20T08:12:27.105526+0000","last_fullsized":"2024-01-20T08:12:27.105526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:44.906399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290349+0000","last_change":"2024-01-20T08:12:27.152743+0000","last_active":"2024-01-20T08:12:28.290349+0000","last_peered":"2024-01-20T08:12:28.290349+0000","last_clean":"2024-01-20T08:12:28.290349+0000","last_became_active":"2024-01-20T08:12:27.151561+0000","last_became_peered":"2024-01-20T08:12:27.151561+0000","last_unstale":"2024-01-20T08:12:28.290349+0000","last_undegraded":"2024-01-20T08:12:28.290349+0000","last_fullsized":"2024-01-20T08:12:28.290349+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:46:15.216422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.135620+0000","last_change":"2024-01-20T08:12:26.116272+0000","last_active":"2024-01-20T08:12:27.135620+0000","last_peered":"2024-01-20T08:12:27.135620+0000","last_clean":"2024-01-20T08:12:27.135620+0000","last_became_active":"2024-01-20T08:12:26.115137+0000","last_became_peered":"2024-01-20T08:12:26.115137+0000","last_unstale":"2024-01-20T08:12:27.135620+0000","last_undegraded":"2024-01-20T08:12:27.135620+0000","last_fullsized":"2024-01-20T08:12:27.135620+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:25.070113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.105288+0000","last_change":"2024-01-20T08:12:07.081343+0000","last_active":"2024-01-20T08:12:27.105288+0000","last_peered":"2024-01-20T08:12:27.105288+0000","last_clean":"2024-01-20T08:12:27.105288+0000","last_became_active":"2024-01-20T08:12:07.079569+0000","last_became_peered":"2024-01-20T08:12:07.079569+0000","last_unstale":"2024-01-20T08:12:27.105288+0000","last_undegraded":"2024-01-20T08:12:27.105288+0000","last_fullsized":"2024-01-20T08:12:27.105288+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"52'9","reported_seq":25,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.126063+0000","last_change":"2024-01-20T08:12:06.066310+0000","last_active":"2024-01-20T08:12:27.126063+0000","last_peered":"2024-01-20T08:12:27.126063+0000","last_clean":"2024-01-20T08:12:27.126063+0000","last_became_active":"2024-01-20T08:12:06.065636+0000","last_became_peered":"2024-01-20T08:12:06.065636+0000","last_unstale":"2024-01-20T08:12:27.126063+0000","last_undegraded":"2024-01-20T08:12:27.126063+0000","last_fullsized":"2024-01-20T08:12:27.126063+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.116984+0000","last_change":"2024-01-20T08:12:27.144064+0000","last_active":"2024-01-20T08:12:29.116984+0000","last_peered":"2024-01-20T08:12:29.116984+0000","last_clean":"2024-01-20T08:12:29.116984+0000","last_became_active":"2024-01-20T08:12:27.143690+0000","last_became_peered":"2024-01-20T08:12:27.143690+0000","last_unstale":"2024-01-20T08:12:29.116984+0000","last_undegraded":"2024-01-20T08:12:29.116984+0000","last_fullsized":"2024-01-20T08:12:29.116984+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:47:59.325731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.114754+0000","last_change":"2024-01-20T08:12:26.096858+0000","last_active":"2024-01-20T08:12:27.114754+0000","last_peered":"2024-01-20T08:12:27.114754+0000","last_clean":"2024-01-20T08:12:27.114754+0000","last_became_active":"2024-01-20T08:12:26.096344+0000","last_became_peered":"2024-01-20T08:12:26.096344+0000","last_unstale":"2024-01-20T08:12:27.114754+0000","last_undegraded":"2024-01-20T08:12:27.114754+0000","last_fullsized":"2024-01-20T08:12:27.114754+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:37:34.864596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116494+0000","last_change":"2024-01-20T08:12:07.078287+0000","last_active":"2024-01-20T08:12:27.116494+0000","last_peered":"2024-01-20T08:12:27.116494+0000","last_clean":"2024-01-20T08:12:27.116494+0000","last_became_active":"2024-01-20T08:12:07.078008+0000","last_became_peered":"2024-01-20T08:12:07.078008+0000","last_unstale":"2024-01-20T08:12:27.116494+0000","last_undegraded":"2024-01-20T08:12:27.116494+0000","last_fullsized":"2024-01-20T08:12:27.116494+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:21.455319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116297+0000","last_change":"2024-01-20T08:12:06.065744+0000","last_active":"2024-01-20T08:12:27.116297+0000","last_peered":"2024-01-20T08:12:27.116297+0000","last_clean":"2024-01-20T08:12:27.116297+0000","last_became_active":"2024-01-20T08:12:06.065473+0000","last_became_peered":"2024-01-20T08:12:06.065473+0000","last_unstale":"2024-01-20T08:12:27.116297+0000","last_undegraded":"2024-01-20T08:12:27.116297+0000","last_fullsized":"2024-01-20T08:12:27.116297+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:28.564397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.106965+0000","last_change":"2024-01-20T08:12:27.122248+0000","last_active":"2024-01-20T08:12:28.106965+0000","last_peered":"2024-01-20T08:12:28.106965+0000","last_clean":"2024-01-20T08:12:28.106965+0000","last_became_active":"2024-01-20T08:12:27.121943+0000","last_became_peered":"2024-01-20T08:12:27.121943+0000","last_unstale":"2024-01-20T08:12:28.106965+0000","last_undegraded":"2024-01-20T08:12:28.106965+0000","last_fullsized":"2024-01-20T08:12:28.106965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:49.183494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"55'8","reported_seq":20,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.161825+0000","last_change":"2024-01-20T08:12:26.108021+0000","last_active":"2024-01-20T08:12:27.161825+0000","last_peered":"2024-01-20T08:12:27.161825+0000","last_clean":"2024-01-20T08:12:27.161825+0000","last_became_active":"2024-01-20T08:12:26.107695+0000","last_became_peered":"2024-01-20T08:12:26.107695+0000","last_unstale":"2024-01-20T08:12:27.161825+0000","last_undegraded":"2024-01-20T08:12:27.161825+0000","last_fullsized":"2024-01-20T08:12:27.161825+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:34.522123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.102598+0000","last_change":"2024-01-20T08:12:07.078220+0000","last_active":"2024-01-20T08:12:27.102598+0000","last_peered":"2024-01-20T08:12:27.102598+0000","last_clean":"2024-01-20T08:12:27.102598+0000","last_became_active":"2024-01-20T08:12:07.077812+0000","last_became_peered":"2024-01-20T08:12:07.077812+0000","last_unstale":"2024-01-20T08:12:27.102598+0000","last_undegraded":"2024-01-20T08:12:27.102598+0000","last_fullsized":"2024-01-20T08:12:27.102598+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:29:54.112972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.135425+0000","last_change":"2024-01-20T08:12:06.071522+0000","last_active":"2024-01-20T08:12:27.135425+0000","last_peered":"2024-01-20T08:12:27.135425+0000","last_clean":"2024-01-20T08:12:27.135425+0000","last_became_active":"2024-01-20T08:12:06.069659+0000","last_became_peered":"2024-01-20T08:12:06.069659+0000","last_unstale":"2024-01-20T08:12:27.135425+0000","last_undegraded":"2024-01-20T08:12:27.135425+0000","last_fullsized":"2024-01-20T08:12:27.135425+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.288799+0000","last_change":"2024-01-20T08:12:27.120796+0000","last_active":"2024-01-20T08:12:28.288799+0000","last_peered":"2024-01-20T08:12:28.288799+0000","last_clean":"2024-01-20T08:12:28.288799+0000","last_became_active":"2024-01-20T08:12:27.120352+0000","last_became_peered":"2024-01-20T08:12:27.120352+0000","last_unstale":"2024-01-20T08:12:28.288799+0000","last_undegraded":"2024-01-20T08:12:28.288799+0000","last_fullsized":"2024-01-20T08:12:28.288799+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:35:43.764582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.158319+0000","last_change":"2024-01-20T08:12:26.104035+0000","last_active":"2024-01-20T08:12:27.158319+0000","last_peered":"2024-01-20T08:12:27.158319+0000","last_clean":"2024-01-20T08:12:27.158319+0000","last_became_active":"2024-01-20T08:12:26.103533+0000","last_became_peered":"2024-01-20T08:12:26.103533+0000","last_unstale":"2024-01-20T08:12:27.158319+0000","last_undegraded":"2024-01-20T08:12:27.158319+0000","last_fullsized":"2024-01-20T08:12:27.158319+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:48.599033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.121357+0000","last_change":"2024-01-20T08:12:07.078740+0000","last_active":"2024-01-20T08:12:27.121357+0000","last_peered":"2024-01-20T08:12:27.121357+0000","last_clean":"2024-01-20T08:12:27.121357+0000","last_became_active":"2024-01-20T08:12:07.078413+0000","last_became_peered":"2024-01-20T08:12:07.078413+0000","last_unstale":"2024-01-20T08:12:27.121357+0000","last_undegraded":"2024-01-20T08:12:27.121357+0000","last_fullsized":"2024-01-20T08:12:27.121357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.190626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115283+0000","last_change":"2024-01-20T08:12:06.071714+0000","last_active":"2024-01-20T08:12:27.115283+0000","last_peered":"2024-01-20T08:12:27.115283+0000","last_clean":"2024-01-20T08:12:27.115283+0000","last_became_active":"2024-01-20T08:12:06.071263+0000","last_became_peered":"2024-01-20T08:12:06.071263+0000","last_unstale":"2024-01-20T08:12:27.115283+0000","last_undegraded":"2024-01-20T08:12:27.115283+0000","last_fullsized":"2024-01-20T08:12:27.115283+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:01:05.094918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.172629+0000","last_change":"2024-01-20T08:12:27.133335+0000","last_active":"2024-01-20T08:12:29.172629+0000","last_peered":"2024-01-20T08:12:29.172629+0000","last_clean":"2024-01-20T08:12:29.172629+0000","last_became_active":"2024-01-20T08:12:27.132864+0000","last_became_peered":"2024-01-20T08:12:27.132864+0000","last_unstale":"2024-01-20T08:12:29.172629+0000","last_undegraded":"2024-01-20T08:12:29.172629+0000","last_fullsized":"2024-01-20T08:12:29.172629+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:02:51.834482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.134933+0000","last_change":"2024-01-20T08:12:26.113297+0000","last_active":"2024-01-20T08:12:27.134933+0000","last_peered":"2024-01-20T08:12:27.134933+0000","last_clean":"2024-01-20T08:12:27.134933+0000","last_became_active":"2024-01-20T08:12:26.112958+0000","last_became_peered":"2024-01-20T08:12:26.112958+0000","last_unstale":"2024-01-20T08:12:27.134933+0000","last_undegraded":"2024-01-20T08:12:27.134933+0000","last_fullsized":"2024-01-20T08:12:27.134933+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:13.141646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.102517+0000","last_change":"2024-01-20T08:12:07.088126+0000","last_active":"2024-01-20T08:12:27.102517+0000","last_peered":"2024-01-20T08:12:27.102517+0000","last_clean":"2024-01-20T08:12:27.102517+0000","last_became_active":"2024-01-20T08:12:07.087789+0000","last_became_peered":"2024-01-20T08:12:07.087789+0000","last_unstale":"2024-01-20T08:12:27.102517+0000","last_undegraded":"2024-01-20T08:12:27.102517+0000","last_fullsized":"2024-01-20T08:12:27.102517+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"51'8","reported_seq":24,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.103294+0000","last_change":"2024-01-20T08:12:06.074824+0000","last_active":"2024-01-20T08:12:27.103294+0000","last_peered":"2024-01-20T08:12:27.103294+0000","last_clean":"2024-01-20T08:12:27.103294+0000","last_became_active":"2024-01-20T08:12:06.074111+0000","last_became_peered":"2024-01-20T08:12:06.074111+0000","last_unstale":"2024-01-20T08:12:27.103294+0000","last_undegraded":"2024-01-20T08:12:27.103294+0000","last_fullsized":"2024-01-20T08:12:27.103294+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:34:44.941100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:30.034995+0000","last_change":"2024-01-20T08:12:27.129995+0000","last_active":"2024-01-20T08:12:30.034995+0000","last_peered":"2024-01-20T08:12:30.034995+0000","last_clean":"2024-01-20T08:12:30.034995+0000","last_became_active":"2024-01-20T08:12:27.129710+0000","last_became_peered":"2024-01-20T08:12:27.129710+0000","last_unstale":"2024-01-20T08:12:30.034995+0000","last_undegraded":"2024-01-20T08:12:30.034995+0000","last_fullsized":"2024-01-20T08:12:30.034995+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:12:02.531241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.155750+0000","last_change":"2024-01-20T08:12:26.112906+0000","last_active":"2024-01-20T08:12:27.155750+0000","last_peered":"2024-01-20T08:12:27.155750+0000","last_clean":"2024-01-20T08:12:27.155750+0000","last_became_active":"2024-01-20T08:12:26.112543+0000","last_became_peered":"2024-01-20T08:12:26.112543+0000","last_unstale":"2024-01-20T08:12:27.155750+0000","last_undegraded":"2024-01-20T08:12:27.155750+0000","last_fullsized":"2024-01-20T08:12:27.155750+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:15:54.376353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.106939+0000","last_change":"2024-01-20T08:12:07.082593+0000","last_active":"2024-01-20T08:12:27.106939+0000","last_peered":"2024-01-20T08:12:27.106939+0000","last_clean":"2024-01-20T08:12:27.106939+0000","last_became_active":"2024-01-20T08:12:07.082366+0000","last_became_peered":"2024-01-20T08:12:07.082366+0000","last_unstale":"2024-01-20T08:12:27.106939+0000","last_undegraded":"2024-01-20T08:12:27.106939+0000","last_fullsized":"2024-01-20T08:12:27.106939+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"51'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116995+0000","last_change":"2024-01-20T08:12:06.065566+0000","last_active":"2024-01-20T08:12:27.116995+0000","last_peered":"2024-01-20T08:12:27.116995+0000","last_clean":"2024-01-20T08:12:27.116995+0000","last_became_active":"2024-01-20T08:12:06.065270+0000","last_became_peered":"2024-01-20T08:12:06.065270+0000","last_unstale":"2024-01-20T08:12:27.116995+0000","last_undegraded":"2024-01-20T08:12:27.116995+0000","last_fullsized":"2024-01-20T08:12:27.116995+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:45.655205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.107900+0000","last_change":"2024-01-20T08:12:27.137496+0000","last_active":"2024-01-20T08:12:28.107900+0000","last_peered":"2024-01-20T08:12:28.107900+0000","last_clean":"2024-01-20T08:12:28.107900+0000","last_became_active":"2024-01-20T08:12:27.137041+0000","last_became_peered":"2024-01-20T08:12:27.137041+0000","last_unstale":"2024-01-20T08:12:28.107900+0000","last_undegraded":"2024-01-20T08:12:28.107900+0000","last_fullsized":"2024-01-20T08:12:28.107900+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:58.945206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.105997+0000","last_change":"2024-01-20T08:12:26.103851+0000","last_active":"2024-01-20T08:12:27.105997+0000","last_peered":"2024-01-20T08:12:27.105997+0000","last_clean":"2024-01-20T08:12:27.105997+0000","last_became_active":"2024-01-20T08:12:26.103571+0000","last_became_peered":"2024-01-20T08:12:26.103571+0000","last_unstale":"2024-01-20T08:12:27.105997+0000","last_undegraded":"2024-01-20T08:12:27.105997+0000","last_fullsized":"2024-01-20T08:12:27.105997+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:26:35.322761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115681+0000","last_change":"2024-01-20T08:12:07.082690+0000","last_active":"2024-01-20T08:12:27.115681+0000","last_peered":"2024-01-20T08:12:27.115681+0000","last_clean":"2024-01-20T08:12:27.115681+0000","last_became_active":"2024-01-20T08:12:07.082364+0000","last_became_peered":"2024-01-20T08:12:07.082364+0000","last_unstale":"2024-01-20T08:12:27.115681+0000","last_undegraded":"2024-01-20T08:12:27.115681+0000","last_fullsized":"2024-01-20T08:12:27.115681+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.125649+0000","last_change":"2024-01-20T08:12:06.061749+0000","last_active":"2024-01-20T08:12:27.125649+0000","last_peered":"2024-01-20T08:12:27.125649+0000","last_clean":"2024-01-20T08:12:27.125649+0000","last_became_active":"2024-01-20T08:12:06.061466+0000","last_became_peered":"2024-01-20T08:12:06.061466+0000","last_unstale":"2024-01-20T08:12:27.125649+0000","last_undegraded":"2024-01-20T08:12:27.125649+0000","last_fullsized":"2024-01-20T08:12:27.125649+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:07:32.760864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.115956+0000","last_change":"2024-01-20T08:12:27.125865+0000","last_active":"2024-01-20T08:12:28.115956+0000","last_peered":"2024-01-20T08:12:28.115956+0000","last_clean":"2024-01-20T08:12:28.115956+0000","last_became_active":"2024-01-20T08:12:27.125515+0000","last_became_peered":"2024-01-20T08:12:27.125515+0000","last_unstale":"2024-01-20T08:12:28.115956+0000","last_undegraded":"2024-01-20T08:12:28.115956+0000","last_fullsized":"2024-01-20T08:12:28.115956+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:18:40.187511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"55'1","reported_seq":13,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.162011+0000","last_change":"2024-01-20T08:12:26.113722+0000","last_active":"2024-01-20T08:12:27.162011+0000","last_peered":"2024-01-20T08:12:27.162011+0000","last_clean":"2024-01-20T08:12:27.162011+0000","last_became_active":"2024-01-20T08:12:26.113345+0000","last_became_peered":"2024-01-20T08:12:26.113345+0000","last_unstale":"2024-01-20T08:12:27.162011+0000","last_undegraded":"2024-01-20T08:12:27.162011+0000","last_fullsized":"2024-01-20T08:12:27.162011+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:04.623302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115687+0000","last_change":"2024-01-20T08:12:07.065833+0000","last_active":"2024-01-20T08:12:27.115687+0000","last_peered":"2024-01-20T08:12:27.115687+0000","last_clean":"2024-01-20T08:12:27.115687+0000","last_became_active":"2024-01-20T08:12:07.065547+0000","last_became_peered":"2024-01-20T08:12:07.065547+0000","last_unstale":"2024-01-20T08:12:27.115687+0000","last_undegraded":"2024-01-20T08:12:27.115687+0000","last_fullsized":"2024-01-20T08:12:27.115687+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:08.237987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"51'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118377+0000","last_change":"2024-01-20T08:12:06.073869+0000","last_active":"2024-01-20T08:12:27.118377+0000","last_peered":"2024-01-20T08:12:27.118377+0000","last_clean":"2024-01-20T08:12:27.118377+0000","last_became_active":"2024-01-20T08:12:06.073514+0000","last_became_peered":"2024-01-20T08:12:06.073514+0000","last_unstale":"2024-01-20T08:12:27.118377+0000","last_undegraded":"2024-01-20T08:12:27.118377+0000","last_fullsized":"2024-01-20T08:12:27.118377+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290876+0000","last_change":"2024-01-20T08:12:27.141265+0000","last_active":"2024-01-20T08:12:28.290876+0000","last_peered":"2024-01-20T08:12:28.290876+0000","last_clean":"2024-01-20T08:12:28.290876+0000","last_became_active":"2024-01-20T08:12:27.140952+0000","last_became_peered":"2024-01-20T08:12:27.140952+0000","last_unstale":"2024-01-20T08:12:28.290876+0000","last_undegraded":"2024-01-20T08:12:28.290876+0000","last_fullsized":"2024-01-20T08:12:28.290876+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:27:31.083584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.162313+0000","last_change":"2024-01-20T08:12:26.115065+0000","last_active":"2024-01-20T08:12:27.162313+0000","last_peered":"2024-01-20T08:12:27.162313+0000","last_clean":"2024-01-20T08:12:27.162313+0000","last_became_active":"2024-01-20T08:12:26.114731+0000","last_became_peered":"2024-01-20T08:12:26.114731+0000","last_unstale":"2024-01-20T08:12:27.162313+0000","last_undegraded":"2024-01-20T08:12:27.162313+0000","last_fullsized":"2024-01-20T08:12:27.162313+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:53:44.552698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.105382+0000","last_change":"2024-01-20T08:12:07.084906+0000","last_active":"2024-01-20T08:12:27.105382+0000","last_peered":"2024-01-20T08:12:27.105382+0000","last_clean":"2024-01-20T08:12:27.105382+0000","last_became_active":"2024-01-20T08:12:07.080034+0000","last_became_peered":"2024-01-20T08:12:07.080034+0000","last_unstale":"2024-01-20T08:12:27.105382+0000","last_undegraded":"2024-01-20T08:12:27.105382+0000","last_fullsized":"2024-01-20T08:12:27.105382+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:02.403047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.128862+0000","last_change":"2024-01-20T08:12:06.056008+0000","last_active":"2024-01-20T08:12:27.128862+0000","last_peered":"2024-01-20T08:12:27.128862+0000","last_clean":"2024-01-20T08:12:27.128862+0000","last_became_active":"2024-01-20T08:12:06.055317+0000","last_became_peered":"2024-01-20T08:12:06.055317+0000","last_unstale":"2024-01-20T08:12:27.128862+0000","last_undegraded":"2024-01-20T08:12:27.128862+0000","last_fullsized":"2024-01-20T08:12:27.128862+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:11.184665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.520772+0000","last_change":"2024-01-20T08:12:27.128515+0000","last_active":"2024-01-20T08:12:28.520772+0000","last_peered":"2024-01-20T08:12:28.520772+0000","last_clean":"2024-01-20T08:12:28.520772+0000","last_became_active":"2024-01-20T08:12:27.126745+0000","last_became_peered":"2024-01-20T08:12:27.126745+0000","last_unstale":"2024-01-20T08:12:28.520772+0000","last_undegraded":"2024-01-20T08:12:28.520772+0000","last_fullsized":"2024-01-20T08:12:28.520772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:01:27.871699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.114261+0000","last_change":"2024-01-20T08:12:26.096615+0000","last_active":"2024-01-20T08:12:27.114261+0000","last_peered":"2024-01-20T08:12:27.114261+0000","last_clean":"2024-01-20T08:12:27.114261+0000","last_became_active":"2024-01-20T08:12:26.095932+0000","last_became_peered":"2024-01-20T08:12:26.095932+0000","last_unstale":"2024-01-20T08:12:27.114261+0000","last_undegraded":"2024-01-20T08:12:27.114261+0000","last_fullsized":"2024-01-20T08:12:27.114261+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:48:07.750641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116634+0000","last_change":"2024-01-20T08:12:07.078035+0000","last_active":"2024-01-20T08:12:27.116634+0000","last_peered":"2024-01-20T08:12:27.116634+0000","last_clean":"2024-01-20T08:12:27.116634+0000","last_became_active":"2024-01-20T08:12:07.076150+0000","last_became_peered":"2024-01-20T08:12:07.076150+0000","last_unstale":"2024-01-20T08:12:27.116634+0000","last_undegraded":"2024-01-20T08:12:27.116634+0000","last_fullsized":"2024-01-20T08:12:27.116634+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:29.570359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116532+0000","last_change":"2024-01-20T08:12:06.058384+0000","last_active":"2024-01-20T08:12:27.116532+0000","last_peered":"2024-01-20T08:12:27.116532+0000","last_clean":"2024-01-20T08:12:27.116532+0000","last_became_active":"2024-01-20T08:12:06.058097+0000","last_became_peered":"2024-01-20T08:12:06.058097+0000","last_unstale":"2024-01-20T08:12:27.116532+0000","last_undegraded":"2024-01-20T08:12:27.116532+0000","last_fullsized":"2024-01-20T08:12:27.116532+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:12.503467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.520772+0000","last_change":"2024-01-20T08:12:27.126404+0000","last_active":"2024-01-20T08:12:28.520772+0000","last_peered":"2024-01-20T08:12:28.520772+0000","last_clean":"2024-01-20T08:12:28.520772+0000","last_became_active":"2024-01-20T08:12:27.126114+0000","last_became_peered":"2024-01-20T08:12:27.126114+0000","last_unstale":"2024-01-20T08:12:28.520772+0000","last_undegraded":"2024-01-20T08:12:28.520772+0000","last_fullsized":"2024-01-20T08:12:28.520772+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:37.008440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.120651+0000","last_change":"2024-01-20T08:12:26.094293+0000","last_active":"2024-01-20T08:12:27.120651+0000","last_peered":"2024-01-20T08:12:27.120651+0000","last_clean":"2024-01-20T08:12:27.120651+0000","last_became_active":"2024-01-20T08:12:26.092536+0000","last_became_peered":"2024-01-20T08:12:26.092536+0000","last_unstale":"2024-01-20T08:12:27.120651+0000","last_undegraded":"2024-01-20T08:12:27.120651+0000","last_fullsized":"2024-01-20T08:12:27.120651+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:04.116597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.121302+0000","last_change":"2024-01-20T08:12:07.077060+0000","last_active":"2024-01-20T08:12:27.121302+0000","last_peered":"2024-01-20T08:12:27.121302+0000","last_clean":"2024-01-20T08:12:27.121302+0000","last_became_active":"2024-01-20T08:12:07.074560+0000","last_became_peered":"2024-01-20T08:12:07.074560+0000","last_unstale":"2024-01-20T08:12:27.121302+0000","last_undegraded":"2024-01-20T08:12:27.121302+0000","last_fullsized":"2024-01-20T08:12:27.121302+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:11:42.486924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.112078+0000","last_change":"2024-01-20T08:12:06.061716+0000","last_active":"2024-01-20T08:12:27.112078+0000","last_peered":"2024-01-20T08:12:27.112078+0000","last_clean":"2024-01-20T08:12:27.112078+0000","last_became_active":"2024-01-20T08:12:06.061410+0000","last_became_peered":"2024-01-20T08:12:06.061410+0000","last_unstale":"2024-01-20T08:12:27.112078+0000","last_undegraded":"2024-01-20T08:12:27.112078+0000","last_fullsized":"2024-01-20T08:12:27.112078+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:45:45.631946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.520846+0000","last_change":"2024-01-20T08:12:27.124709+0000","last_active":"2024-01-20T08:12:28.520846+0000","last_peered":"2024-01-20T08:12:28.520846+0000","last_clean":"2024-01-20T08:12:28.520846+0000","last_became_active":"2024-01-20T08:12:27.124450+0000","last_became_peered":"2024-01-20T08:12:27.124450+0000","last_unstale":"2024-01-20T08:12:28.520846+0000","last_undegraded":"2024-01-20T08:12:28.520846+0000","last_fullsized":"2024-01-20T08:12:28.520846+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:57:31.484847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.135303+0000","last_change":"2024-01-20T08:12:26.112301+0000","last_active":"2024-01-20T08:12:27.135303+0000","last_peered":"2024-01-20T08:12:27.135303+0000","last_clean":"2024-01-20T08:12:27.135303+0000","last_became_active":"2024-01-20T08:12:26.111382+0000","last_became_peered":"2024-01-20T08:12:26.111382+0000","last_unstale":"2024-01-20T08:12:27.135303+0000","last_undegraded":"2024-01-20T08:12:27.135303+0000","last_fullsized":"2024-01-20T08:12:27.135303+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:40.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.121902+0000","last_change":"2024-01-20T08:12:07.077678+0000","last_active":"2024-01-20T08:12:27.121902+0000","last_peered":"2024-01-20T08:12:27.121902+0000","last_clean":"2024-01-20T08:12:27.121902+0000","last_became_active":"2024-01-20T08:12:07.077094+0000","last_became_peered":"2024-01-20T08:12:07.077094+0000","last_unstale":"2024-01-20T08:12:27.121902+0000","last_undegraded":"2024-01-20T08:12:27.121902+0000","last_fullsized":"2024-01-20T08:12:27.121902+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:39:46.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115267+0000","last_change":"2024-01-20T08:12:06.063892+0000","last_active":"2024-01-20T08:12:27.115267+0000","last_peered":"2024-01-20T08:12:27.115267+0000","last_clean":"2024-01-20T08:12:27.115267+0000","last_became_active":"2024-01-20T08:12:06.063601+0000","last_became_peered":"2024-01-20T08:12:06.063601+0000","last_unstale":"2024-01-20T08:12:27.115267+0000","last_undegraded":"2024-01-20T08:12:27.115267+0000","last_fullsized":"2024-01-20T08:12:27.115267+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:48.315980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.289572+0000","last_change":"2024-01-20T08:12:27.150463+0000","last_active":"2024-01-20T08:12:28.289572+0000","last_peered":"2024-01-20T08:12:28.289572+0000","last_clean":"2024-01-20T08:12:28.289572+0000","last_became_active":"2024-01-20T08:12:27.150168+0000","last_became_peered":"2024-01-20T08:12:27.150168+0000","last_unstale":"2024-01-20T08:12:28.289572+0000","last_undegraded":"2024-01-20T08:12:28.289572+0000","last_fullsized":"2024-01-20T08:12:28.289572+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:47:59.325731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.102074+0000","last_change":"2024-01-20T08:12:26.095914+0000","last_active":"2024-01-20T08:12:27.102074+0000","last_peered":"2024-01-20T08:12:27.102074+0000","last_clean":"2024-01-20T08:12:27.102074+0000","last_became_active":"2024-01-20T08:12:26.095634+0000","last_became_peered":"2024-01-20T08:12:26.095634+0000","last_unstale":"2024-01-20T08:12:27.102074+0000","last_undegraded":"2024-01-20T08:12:27.102074+0000","last_fullsized":"2024-01-20T08:12:27.102074+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:37:15.098144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118074+0000","last_change":"2024-01-20T08:12:07.073337+0000","last_active":"2024-01-20T08:12:27.118074+0000","last_peered":"2024-01-20T08:12:27.118074+0000","last_clean":"2024-01-20T08:12:27.118074+0000","last_became_active":"2024-01-20T08:12:07.073087+0000","last_became_peered":"2024-01-20T08:12:07.073087+0000","last_unstale":"2024-01-20T08:12:27.118074+0000","last_undegraded":"2024-01-20T08:12:27.118074+0000","last_fullsized":"2024-01-20T08:12:27.118074+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:13.509429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"51'2","reported_seq":18,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118122+0000","last_change":"2024-01-20T08:12:06.049193+0000","last_active":"2024-01-20T08:12:27.118122+0000","last_peered":"2024-01-20T08:12:27.118122+0000","last_clean":"2024-01-20T08:12:27.118122+0000","last_became_active":"2024-01-20T08:12:06.048916+0000","last_became_peered":"2024-01-20T08:12:06.048916+0000","last_unstale":"2024-01-20T08:12:27.118122+0000","last_undegraded":"2024-01-20T08:12:27.118122+0000","last_fullsized":"2024-01-20T08:12:27.118122+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:53.905817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.290201+0000","last_change":"2024-01-20T08:12:27.138390+0000","last_active":"2024-01-20T08:12:28.290201+0000","last_peered":"2024-01-20T08:12:28.290201+0000","last_clean":"2024-01-20T08:12:28.290201+0000","last_became_active":"2024-01-20T08:12:27.137968+0000","last_became_peered":"2024-01-20T08:12:27.137968+0000","last_unstale":"2024-01-20T08:12:28.290201+0000","last_undegraded":"2024-01-20T08:12:28.290201+0000","last_fullsized":"2024-01-20T08:12:28.290201+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:03.773613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.127667+0000","last_change":"2024-01-20T08:12:26.107773+0000","last_active":"2024-01-20T08:12:27.127667+0000","last_peered":"2024-01-20T08:12:27.127667+0000","last_clean":"2024-01-20T08:12:27.127667+0000","last_became_active":"2024-01-20T08:12:26.107480+0000","last_became_peered":"2024-01-20T08:12:26.107480+0000","last_unstale":"2024-01-20T08:12:27.127667+0000","last_undegraded":"2024-01-20T08:12:27.127667+0000","last_fullsized":"2024-01-20T08:12:27.127667+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:48:56.716326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115854+0000","last_change":"2024-01-20T08:12:07.082890+0000","last_active":"2024-01-20T08:12:27.115854+0000","last_peered":"2024-01-20T08:12:27.115854+0000","last_clean":"2024-01-20T08:12:27.115854+0000","last_became_active":"2024-01-20T08:12:07.080723+0000","last_became_peered":"2024-01-20T08:12:07.080723+0000","last_unstale":"2024-01-20T08:12:27.115854+0000","last_undegraded":"2024-01-20T08:12:27.115854+0000","last_fullsized":"2024-01-20T08:12:27.115854+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:28:15.493449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"52'1","reported_seq":17,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.125741+0000","last_change":"2024-01-20T08:12:06.062568+0000","last_active":"2024-01-20T08:12:27.125741+0000","last_peered":"2024-01-20T08:12:27.125741+0000","last_clean":"2024-01-20T08:12:27.125741+0000","last_became_active":"2024-01-20T08:12:06.062294+0000","last_became_peered":"2024-01-20T08:12:06.062294+0000","last_unstale":"2024-01-20T08:12:27.125741+0000","last_undegraded":"2024-01-20T08:12:27.125741+0000","last_fullsized":"2024-01-20T08:12:27.125741+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:36:39.890247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.118239+0000","last_change":"2024-01-20T08:12:27.136693+0000","last_active":"2024-01-20T08:12:29.118239+0000","last_peered":"2024-01-20T08:12:29.118239+0000","last_clean":"2024-01-20T08:12:29.118239+0000","last_became_active":"2024-01-20T08:12:27.136350+0000","last_became_peered":"2024-01-20T08:12:27.136350+0000","last_unstale":"2024-01-20T08:12:29.118239+0000","last_undegraded":"2024-01-20T08:12:29.118239+0000","last_fullsized":"2024-01-20T08:12:29.118239+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:04:55.710578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.161912+0000","last_change":"2024-01-20T08:12:26.111032+0000","last_active":"2024-01-20T08:12:27.161912+0000","last_peered":"2024-01-20T08:12:27.161912+0000","last_clean":"2024-01-20T08:12:27.161912+0000","last_became_active":"2024-01-20T08:12:26.110676+0000","last_became_peered":"2024-01-20T08:12:26.110676+0000","last_unstale":"2024-01-20T08:12:27.161912+0000","last_undegraded":"2024-01-20T08:12:27.161912+0000","last_fullsized":"2024-01-20T08:12:27.161912+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:57:32.538103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118966+0000","last_change":"2024-01-20T08:12:07.060815+0000","last_active":"2024-01-20T08:12:27.118966+0000","last_peered":"2024-01-20T08:12:27.118966+0000","last_clean":"2024-01-20T08:12:27.118966+0000","last_became_active":"2024-01-20T08:12:07.057155+0000","last_became_peered":"2024-01-20T08:12:07.057155+0000","last_unstale":"2024-01-20T08:12:27.118966+0000","last_undegraded":"2024-01-20T08:12:27.118966+0000","last_fullsized":"2024-01-20T08:12:27.118966+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:20:49.321942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.135342+0000","last_change":"2024-01-20T08:12:06.063244+0000","last_active":"2024-01-20T08:12:27.135342+0000","last_peered":"2024-01-20T08:12:27.135342+0000","last_clean":"2024-01-20T08:12:27.135342+0000","last_became_active":"2024-01-20T08:12:06.062628+0000","last_became_peered":"2024-01-20T08:12:06.062628+0000","last_unstale":"2024-01-20T08:12:27.135342+0000","last_undegraded":"2024-01-20T08:12:27.135342+0000","last_fullsized":"2024-01-20T08:12:27.135342+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:29.173630+0000","last_change":"2024-01-20T08:12:27.124990+0000","last_active":"2024-01-20T08:12:29.173630+0000","last_peered":"2024-01-20T08:12:29.173630+0000","last_clean":"2024-01-20T08:12:29.173630+0000","last_became_active":"2024-01-20T08:12:27.124668+0000","last_became_peered":"2024-01-20T08:12:27.124668+0000","last_unstale":"2024-01-20T08:12:29.173630+0000","last_undegraded":"2024-01-20T08:12:29.173630+0000","last_fullsized":"2024-01-20T08:12:29.173630+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:47:59.325731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.117691+0000","last_change":"2024-01-20T08:12:26.100507+0000","last_active":"2024-01-20T08:12:27.117691+0000","last_peered":"2024-01-20T08:12:27.117691+0000","last_clean":"2024-01-20T08:12:27.117691+0000","last_became_active":"2024-01-20T08:12:26.100190+0000","last_became_peered":"2024-01-20T08:12:26.100190+0000","last_unstale":"2024-01-20T08:12:27.117691+0000","last_undegraded":"2024-01-20T08:12:27.117691+0000","last_fullsized":"2024-01-20T08:12:27.117691+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:26:35.322761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.128110+0000","last_change":"2024-01-20T08:12:07.088893+0000","last_active":"2024-01-20T08:12:27.128110+0000","last_peered":"2024-01-20T08:12:27.128110+0000","last_clean":"2024-01-20T08:12:27.128110+0000","last_became_active":"2024-01-20T08:12:07.088233+0000","last_became_peered":"2024-01-20T08:12:07.088233+0000","last_unstale":"2024-01-20T08:12:27.128110+0000","last_undegraded":"2024-01-20T08:12:27.128110+0000","last_fullsized":"2024-01-20T08:12:27.128110+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:39:05.418205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.116779+0000","last_change":"2024-01-20T08:12:06.069603+0000","last_active":"2024-01-20T08:12:27.116779+0000","last_peered":"2024-01-20T08:12:27.116779+0000","last_clean":"2024-01-20T08:12:27.116779+0000","last_became_active":"2024-01-20T08:12:06.069220+0000","last_became_peered":"2024-01-20T08:12:06.069220+0000","last_unstale":"2024-01-20T08:12:27.116779+0000","last_undegraded":"2024-01-20T08:12:27.116779+0000","last_fullsized":"2024-01-20T08:12:27.116779+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:58:06.515594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:30.034424+0000","last_change":"2024-01-20T08:12:27.121897+0000","last_active":"2024-01-20T08:12:30.034424+0000","last_peered":"2024-01-20T08:12:30.034424+0000","last_clean":"2024-01-20T08:12:30.034424+0000","last_became_active":"2024-01-20T08:12:27.121613+0000","last_became_peered":"2024-01-20T08:12:27.121613+0000","last_unstale":"2024-01-20T08:12:30.034424+0000","last_undegraded":"2024-01-20T08:12:30.034424+0000","last_fullsized":"2024-01-20T08:12:30.034424+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:37.522189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.121406+0000","last_change":"2024-01-20T08:12:26.108102+0000","last_active":"2024-01-20T08:12:27.121406+0000","last_peered":"2024-01-20T08:12:27.121406+0000","last_clean":"2024-01-20T08:12:27.121406+0000","last_became_active":"2024-01-20T08:12:26.107810+0000","last_became_peered":"2024-01-20T08:12:26.107810+0000","last_unstale":"2024-01-20T08:12:27.121406+0000","last_undegraded":"2024-01-20T08:12:27.121406+0000","last_fullsized":"2024-01-20T08:12:27.121406+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:29:21.431721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.115630+0000","last_change":"2024-01-20T08:12:07.066751+0000","last_active":"2024-01-20T08:12:27.115630+0000","last_peered":"2024-01-20T08:12:27.115630+0000","last_clean":"2024-01-20T08:12:27.115630+0000","last_became_active":"2024-01-20T08:12:07.063086+0000","last_became_peered":"2024-01-20T08:12:07.063086+0000","last_unstale":"2024-01-20T08:12:27.115630+0000","last_undegraded":"2024-01-20T08:12:27.115630+0000","last_fullsized":"2024-01-20T08:12:27.115630+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:18:45.087923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.114106+0000","last_change":"2024-01-20T08:12:06.066906+0000","last_active":"2024-01-20T08:12:27.114106+0000","last_peered":"2024-01-20T08:12:27.114106+0000","last_clean":"2024-01-20T08:12:27.114106+0000","last_became_active":"2024-01-20T08:12:06.066598+0000","last_became_peered":"2024-01-20T08:12:06.066598+0000","last_unstale":"2024-01-20T08:12:27.114106+0000","last_undegraded":"2024-01-20T08:12:27.114106+0000","last_fullsized":"2024-01-20T08:12:27.114106+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.111815+0000","last_change":"2024-01-20T08:12:27.125208+0000","last_active":"2024-01-20T08:12:28.111815+0000","last_peered":"2024-01-20T08:12:28.111815+0000","last_clean":"2024-01-20T08:12:28.111815+0000","last_became_active":"2024-01-20T08:12:27.124843+0000","last_became_peered":"2024-01-20T08:12:27.124843+0000","last_unstale":"2024-01-20T08:12:28.111815+0000","last_undegraded":"2024-01-20T08:12:28.111815+0000","last_fullsized":"2024-01-20T08:12:28.111815+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:16:50.240517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.137210+0000","last_change":"2024-01-20T08:12:26.107065+0000","last_active":"2024-01-20T08:12:27.137210+0000","last_peered":"2024-01-20T08:12:27.137210+0000","last_clean":"2024-01-20T08:12:27.137210+0000","last_became_active":"2024-01-20T08:12:26.106722+0000","last_became_peered":"2024-01-20T08:12:26.106722+0000","last_unstale":"2024-01-20T08:12:27.137210+0000","last_undegraded":"2024-01-20T08:12:27.137210+0000","last_fullsized":"2024-01-20T08:12:27.137210+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:40:05.689841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.103169+0000","last_change":"2024-01-20T08:12:07.088972+0000","last_active":"2024-01-20T08:12:27.103169+0000","last_peered":"2024-01-20T08:12:27.103169+0000","last_clean":"2024-01-20T08:12:27.103169+0000","last_became_active":"2024-01-20T08:12:07.088534+0000","last_became_peered":"2024-01-20T08:12:07.088534+0000","last_unstale":"2024-01-20T08:12:27.103169+0000","last_undegraded":"2024-01-20T08:12:27.103169+0000","last_fullsized":"2024-01-20T08:12:27.103169+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:06:06.041439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.123739+0000","last_change":"2024-01-20T08:12:06.061867+0000","last_active":"2024-01-20T08:12:27.123739+0000","last_peered":"2024-01-20T08:12:27.123739+0000","last_clean":"2024-01-20T08:12:27.123739+0000","last_became_active":"2024-01-20T08:12:06.061474+0000","last_became_peered":"2024-01-20T08:12:06.061474+0000","last_unstale":"2024-01-20T08:12:27.123739+0000","last_undegraded":"2024-01-20T08:12:27.123739+0000","last_fullsized":"2024-01-20T08:12:27.123739+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:36:28.133216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.107255+0000","last_change":"2024-01-20T08:12:27.123848+0000","last_active":"2024-01-20T08:12:28.107255+0000","last_peered":"2024-01-20T08:12:28.107255+0000","last_clean":"2024-01-20T08:12:28.107255+0000","last_became_active":"2024-01-20T08:12:27.123567+0000","last_became_peered":"2024-01-20T08:12:27.123567+0000","last_unstale":"2024-01-20T08:12:28.107255+0000","last_undegraded":"2024-01-20T08:12:28.107255+0000","last_fullsized":"2024-01-20T08:12:28.107255+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:35:05.991378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.100409+0000","last_change":"2024-01-20T08:12:26.101081+0000","last_active":"2024-01-20T08:12:27.100409+0000","last_peered":"2024-01-20T08:12:27.100409+0000","last_clean":"2024-01-20T08:12:27.100409+0000","last_became_active":"2024-01-20T08:12:26.100776+0000","last_became_peered":"2024-01-20T08:12:26.100776+0000","last_unstale":"2024-01-20T08:12:27.100409+0000","last_undegraded":"2024-01-20T08:12:27.100409+0000","last_fullsized":"2024-01-20T08:12:27.100409+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:16:32.353501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.118552+0000","last_change":"2024-01-20T08:12:07.075925+0000","last_active":"2024-01-20T08:12:27.118552+0000","last_peered":"2024-01-20T08:12:27.118552+0000","last_clean":"2024-01-20T08:12:27.118552+0000","last_became_active":"2024-01-20T08:12:07.075681+0000","last_became_peered":"2024-01-20T08:12:07.075681+0000","last_unstale":"2024-01-20T08:12:27.118552+0000","last_undegraded":"2024-01-20T08:12:27.118552+0000","last_fullsized":"2024-01-20T08:12:27.118552+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:29:38.900889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.111356+0000","last_change":"2024-01-20T08:12:06.056764+0000","last_active":"2024-01-20T08:12:27.111356+0000","last_peered":"2024-01-20T08:12:27.111356+0000","last_clean":"2024-01-20T08:12:27.111356+0000","last_became_active":"2024-01-20T08:12:06.056438+0000","last_became_peered":"2024-01-20T08:12:06.056438+0000","last_unstale":"2024-01-20T08:12:27.111356+0000","last_undegraded":"2024-01-20T08:12:27.111356+0000","last_fullsized":"2024-01-20T08:12:27.111356+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:26:34.911039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.111815+0000","last_change":"2024-01-20T08:12:27.159447+0000","last_active":"2024-01-20T08:12:28.111815+0000","last_peered":"2024-01-20T08:12:28.111815+0000","last_clean":"2024-01-20T08:12:28.111815+0000","last_became_active":"2024-01-20T08:12:27.156035+0000","last_became_peered":"2024-01-20T08:12:27.156035+0000","last_unstale":"2024-01-20T08:12:28.111815+0000","last_undegraded":"2024-01-20T08:12:28.111815+0000","last_fullsized":"2024-01-20T08:12:28.111815+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:48:08.766284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":12,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.111745+0000","last_change":"2024-01-20T08:12:26.111208+0000","last_active":"2024-01-20T08:12:27.111745+0000","last_peered":"2024-01-20T08:12:27.111745+0000","last_clean":"2024-01-20T08:12:27.111745+0000","last_became_active":"2024-01-20T08:12:26.110830+0000","last_became_peered":"2024-01-20T08:12:26.110830+0000","last_unstale":"2024-01-20T08:12:27.111745+0000","last_undegraded":"2024-01-20T08:12:27.111745+0000","last_fullsized":"2024-01-20T08:12:27.111745+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:40.483993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.114924+0000","last_change":"2024-01-20T08:12:07.075968+0000","last_active":"2024-01-20T08:12:27.114924+0000","last_peered":"2024-01-20T08:12:27.114924+0000","last_clean":"2024-01-20T08:12:27.114924+0000","last_became_active":"2024-01-20T08:12:07.071647+0000","last_became_peered":"2024-01-20T08:12:07.071647+0000","last_unstale":"2024-01-20T08:12:27.114924+0000","last_undegraded":"2024-01-20T08:12:27.114924+0000","last_fullsized":"2024-01-20T08:12:27.114924+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:52:22.273859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.112087+0000","last_change":"2024-01-20T08:12:06.060007+0000","last_active":"2024-01-20T08:12:27.112087+0000","last_peered":"2024-01-20T08:12:27.112087+0000","last_clean":"2024-01-20T08:12:27.112087+0000","last_became_active":"2024-01-20T08:12:06.059513+0000","last_became_peered":"2024-01-20T08:12:06.059513+0000","last_unstale":"2024-01-20T08:12:27.112087+0000","last_undegraded":"2024-01-20T08:12:27.112087+0000","last_fullsized":"2024-01-20T08:12:27.112087+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:19:20.449358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":11,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-01-20T08:12:28.521320+0000","last_change":"2024-01-20T08:12:27.136215+0000","last_active":"2024-01-20T08:12:28.521320+0000","last_peered":"2024-01-20T08:12:28.521320+0000","last_clean":"2024-01-20T08:12:28.521320+0000","last_became_active":"2024-01-20T08:12:27.135946+0000","last_became_peered":"2024-01-20T08:12:27.135946+0000","last_unstale":"2024-01-20T08:12:28.521320+0000","last_undegraded":"2024-01-20T08:12:28.521320+0000","last_fullsized":"2024-01-20T08:12:28.521320+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:26.062497+0000","last_clean_scrub_stamp":"2024-01-20T08:12:26.062497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:49:28.334802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"55'2","reported_seq":14,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.161735+0000","last_change":"2024-01-20T08:12:26.110797+0000","last_active":"2024-01-20T08:12:27.161735+0000","last_peered":"2024-01-20T08:12:27.161735+0000","last_clean":"2024-01-20T08:12:27.161735+0000","last_became_active":"2024-01-20T08:12:26.108676+0000","last_became_peered":"2024-01-20T08:12:26.108676+0000","last_unstale":"2024-01-20T08:12:27.161735+0000","last_undegraded":"2024-01-20T08:12:27.161735+0000","last_fullsized":"2024-01-20T08:12:27.161735+0000","mapping_epoch":53,"log_start":"0'0","ondisk_log_start":"0'0","created":53,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:25.046854+0000","last_clean_scrub_stamp":"2024-01-20T08:12:25.046854+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:38:48.599033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":15,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.111983+0000","last_change":"2024-01-20T08:12:07.073628+0000","last_active":"2024-01-20T08:12:27.111983+0000","last_peered":"2024-01-20T08:12:27.111983+0000","last_clean":"2024-01-20T08:12:27.111983+0000","last_became_active":"2024-01-20T08:12:07.073348+0000","last_became_peered":"2024-01-20T08:12:07.073348+0000","last_unstale":"2024-01-20T08:12:27.111983+0000","last_undegraded":"2024-01-20T08:12:27.111983+0000","last_fullsized":"2024-01-20T08:12:27.111983+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":50,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:06.018180+0000","last_clean_scrub_stamp":"2024-01-20T08:12:06.018180+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:59:53.783140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":16,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.134754+0000","last_change":"2024-01-20T08:12:06.067638+0000","last_active":"2024-01-20T08:12:27.134754+0000","last_peered":"2024-01-20T08:12:27.134754+0000","last_clean":"2024-01-20T08:12:27.134754+0000","last_became_active":"2024-01-20T08:12:06.067251+0000","last_became_peered":"2024-01-20T08:12:06.067251+0000","last_unstale":"2024-01-20T08:12:27.134754+0000","last_undegraded":"2024-01-20T08:12:27.134754+0000","last_fullsized":"2024-01-20T08:12:27.134754+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:12:05.012218+0000","last_clean_scrub_stamp":"2024-01-20T08:12:05.012218+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:30:48.951308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":196,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-01-20T08:12:27.103538+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:12:27.103538+0000","last_peered":"2024-01-20T08:12:27.103538+0000","last_clean":"2024-01-20T08:12:27.103538+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:12:27.103538+0000","last_undegraded":"2024-01-20T08:12:27.103538+0000","last_fullsized":"2024-01-20T08:12:27.103538+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1282048,"data_stored":881861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0109999999999999,"5min":1.1990000000000001,"15min":1.23},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.421,"5min":3.008,"15min":3.008},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.022,"5min":1.1519999999999999,"15min":1.1739999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.522,"5min":1.768,"15min":1.768},"last":1.284}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1399999999999999,"5min":1.2270000000000001,"15min":1.2410000000000001},"min":{"1min":0.69999999999999996,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.5309999999999999,"5min":1.843,"15min":1.843},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.0620000000000001,"5min":1.218,"15min":1.244},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.6100000000000001,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.85899999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.216,"15min":1.2210000000000001},"min":{"1min":0.88600000000000001,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.6180000000000001,"5min":2.1019999999999999,"15min":2.1019999999999999},"last":1.5620000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.425,"15min":1.4550000000000001},"min":{"1min":0.85299999999999998,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.712,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.337}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.383,"15min":1.4239999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.494,"5min":2.7599999999999998,"15min":2.7599999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.1339999999999999,"5min":1.306,"15min":1.3340000000000001},"min":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":1.4219999999999999,"5min":2.5710000000000002,"15min":2.5710000000000002},"last":1.1890000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.518,"15min":1.5669999999999999},"min":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.8480000000000001,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.393,"5min":1.655,"15min":1.6990000000000001},"min":{"1min":0.95899999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"max":{"1min":2.0030000000000001,"5min":3.54,"15min":3.54},"last":1.6899999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.518,"15min":1.5620000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.714,"5min":3.069,"15min":3.069},"last":1.6539999999999999},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.5429999999999999,"15min":1.581},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":1.698,"5min":3.1040000000000001,"15min":3.1040000000000001},"last":2.0339999999999998}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.4119999999999999,"5min":1.639,"15min":1.677},"min":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"max":{"1min":1.742,"5min":3.0840000000000001,"15min":3.0840000000000001},"last":1.9350000000000001},{"interface":"front","average":{"1min":1.3919999999999999,"5min":1.6919999999999999,"15min":1.742},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":1.929,"5min":3.786,"15min":3.786},"last":1.796}]}]},{"osd":6,"up_from":13,"seq":55834574880,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31852,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339988,"statfs":{"total":96636764160,"available":96604147712,"internally_reserved":0,"allocated":679936,"data_stored":290809,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":0.96599999999999997,"5min":1.1899999999999999,"15min":1.2270000000000001},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4359999999999999,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1479999999999999,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.9119999999999999,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.90500000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.129,"5min":1.286,"15min":1.3120000000000001},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.6100000000000001,"5min":2.008,"15min":2.008},"last":1.3660000000000001},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.2829999999999999,"15min":1.2769999999999999},"min":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":2.004,"5min":2.004,"15min":2.004},"last":1.1890000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1659999999999999,"15min":1.1699999999999999},"min":{"1min":0.71599999999999997,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.8129999999999999,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.079},{"interface":"front","average":{"1min":1.1599999999999999,"5min":1.3080000000000001,"15min":1.333},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5489999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.4239999999999999,"15min":1.444},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.0720000000000001,"5min":2.222,"15min":2.222},"last":1.5},{"interface":"front","average":{"1min":1.278,"5min":1.4379999999999999,"15min":1.464},"min":{"1min":0.82199999999999995,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.5980000000000001,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.6060000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.5529999999999999,"15min":1.599},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.825,"5min":2.915,"15min":2.915},"last":1.673},{"interface":"front","average":{"1min":1.4830000000000001,"5min":1.659,"15min":1.6890000000000001},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.2189999999999999,"5min":2.718,"15min":2.718},"last":1.7210000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.5580000000000001,"15min":1.579},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.085,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.784},{"interface":"front","average":{"1min":1.419,"5min":1.74,"15min":1.794},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.0259999999999998,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.8740000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.734,"15min":1.758},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3500000000000001,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.8280000000000001},{"interface":"front","average":{"1min":1.536,"5min":1.746,"15min":1.7809999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.0209999999999999,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.917}]}]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31848,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339992,"statfs":{"total":96636764160,"available":96604151808,"internally_reserved":0,"allocated":684032,"data_stored":291459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":1.054,"15min":1.056},"min":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1890000000000001},{"interface":"front","average":{"1min":1.069,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.75700000000000001,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":1.4830000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.0980000000000001,"15min":1.1100000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.2909999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.129,"15min":1.129},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.8600000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2310000000000001,"15min":1.236},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.806,"5min":1.806,"15min":1.806},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.2629999999999999,"5min":1.272,"15min":1.274},"min":{"1min":0.871,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.6579999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1220000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.27,"5min":1.3580000000000001,"15min":1.373},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.542,"5min":1.776,"15min":1.776},"last":1.77},{"interface":"front","average":{"1min":1.347,"5min":1.4019999999999999,"15min":1.411},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.7689999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.383}]},{"osd":4,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.349,"5min":1.3939999999999999,"15min":1.4019999999999999},"min":{"1min":0.59799999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.8320000000000001,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.248},{"interface":"front","average":{"1min":1.4239999999999999,"5min":1.4450000000000001,"15min":1.4490000000000001},"min":{"1min":0.80300000000000005,"5min":0.753,"15min":0.753},"max":{"1min":1.8200000000000001,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.913}]},{"osd":6,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.444,"5min":1.5189999999999999,"15min":1.5309999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.903,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.72},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5669999999999999,"15min":1.575},"min":{"1min":0.76800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.954,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.6319999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:12:03 2024","interfaces":[{"interface":"back","average":{"1min":1.5509999999999999,"5min":1.571,"15min":1.575},"min":{"1min":0.874,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.956,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":2.097},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.724,"15min":1.746},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.9930000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.8109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":293894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.2230000000000001,"15min":1.2549999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":1.482,"5min":3.165,"15min":3.165},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.97999999999999998,"5min":1.0129999999999999,"15min":1.0189999999999999},"min":{"1min":0.65000000000000002,"5min":0.623,"15min":0.623},"max":{"1min":1.6899999999999999,"5min":1.71,"15min":1.71},"last":1.546}]},{"osd":1,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.411,"15min":1.4470000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.7190000000000001,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.2729999999999999},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.345,"15min":1.3999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.3919999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.454}]},{"osd":2,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.169,"5min":1.0800000000000001,"15min":1.0649999999999999},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.532,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.171},{"interface":"front","average":{"1min":1.2390000000000001,"5min":1.2629999999999999,"15min":1.2669999999999999},"min":{"1min":0.84599999999999997,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.671,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.997}]},{"osd":3,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.27,"15min":1.282},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.992,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.3839999999999999,"15min":1.407},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.6830000000000001,"5min":2.613,"15min":2.613},"last":1.492}]},{"osd":5,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.3140000000000001,"5min":1.337,"15min":1.341},"min":{"1min":0.874,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.7,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.3799999999999999},{"interface":"front","average":{"1min":1.272,"5min":1.3480000000000001,"15min":1.361},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.72,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.329}]},{"osd":6,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.431,"5min":1.411,"15min":1.4079999999999999},"min":{"1min":0.78700000000000003,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.776,"5min":1.919,"15min":1.919},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.5089999999999999,"15min":1.5149999999999999},"min":{"1min":0.90500000000000003,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.8740000000000001,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.621}]},{"osd":7,"last update":"Sat Jan 20 08:12:01 2024","interfaces":[{"interface":"back","average":{"1min":1.417,"5min":1.5409999999999999,"15min":1.5620000000000001},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.895,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.571},{"interface":"front","average":{"1min":1.496,"5min":1.581,"15min":1.595},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.875,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.653}]}]},{"osd":3,"up_from":13,"seq":55834574880,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31856,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339984,"statfs":{"total":96636764160,"available":96604143616,"internally_reserved":0,"allocated":688128,"data_stored":290885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.81399999999999995,"5min":0.75,"15min":0.73899999999999999},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1759999999999999},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.85299999999999998,"15min":0.83499999999999996},"min":{"1min":0.55900000000000005,"5min":0.501,"15min":0.501},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":1.1399999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.84799999999999998,"15min":0.84699999999999998},"min":{"1min":0.48699999999999999,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.0740000000000001,"5min":0.95799999999999996,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5960000000000001,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.75}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.101,"15min":1.101},"min":{"1min":0.58399999999999996,"5min":0.433,"15min":0.433},"max":{"1min":1.8899999999999999,"5min":3.02,"15min":3.02},"last":1.21},{"interface":"front","average":{"1min":1.111,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.639,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.0980000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":1.2450000000000001,"15min":1.252},"min":{"1min":0.74199999999999999,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.6200000000000001,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.2450000000000001,"5min":1.216,"15min":1.2110000000000001},"min":{"1min":0.751,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6080000000000001,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.569}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.335,"15min":1.343},"min":{"1min":0.81599999999999995,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":1.798,"5min":2.153,"15min":2.153},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.28,"5min":1.351,"15min":1.363},"min":{"1min":0.92600000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.7190000000000001,"5min":2.359,"15min":2.359},"last":1.0469999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.377,"15min":1.383},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":1.796,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.7070000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.339,"15min":1.337},"min":{"1min":0.85099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"max":{"1min":1.742,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.6830000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.379,"5min":1.419,"15min":1.4259999999999999},"min":{"1min":0.81699999999999995,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.984,"5min":2.286,"15min":2.286},"last":1.605},{"interface":"front","average":{"1min":1.421,"5min":1.4099999999999999,"15min":1.4079999999999999},"min":{"1min":0.94099999999999995,"5min":0.88500000000000001,"15min":0.88500000000000001},"max":{"1min":2.0859999999999999,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.8009999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":692224,"data_stored":292385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.92700000000000005,"15min":0.94299999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.431,"5min":1.712,"15min":1.712},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":0.96799999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.327,"5min":1.546,"15min":1.546},"last":0.64800000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.96699999999999997,"5min":1.075,"15min":1.093},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.55,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.95799999999999996,"5min":1.081,"15min":1.101},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.446,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.038}]},{"osd":3,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":1.056,"15min":1.1040000000000001},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.173,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.256,"15min":1.2929999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6439999999999999,"5min":2.177,"15min":2.177},"last":1.107}]},{"osd":4,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.276,"5min":1.496,"15min":1.5329999999999999},"min":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.7869999999999999,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.3089999999999999,"5min":1.4630000000000001,"15min":1.4890000000000001},"min":{"1min":1.0549999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":1.9399999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.1459999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.2949999999999999,"15min":1.3240000000000001},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.7969999999999999,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.90200000000000002},{"interface":"front","average":{"1min":1.272,"5min":1.52,"15min":1.5609999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.9710000000000001,"5min":2.29,"15min":2.29},"last":1.198}]},{"osd":6,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.373,"5min":1.5449999999999999,"15min":1.5740000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.1850000000000001,"5min":2.734,"15min":2.734},"last":1.3819999999999999},{"interface":"front","average":{"1min":1.278,"5min":1.51,"15min":1.5489999999999999},"min":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"max":{"1min":1.921,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.94299999999999995}]},{"osd":7,"last update":"Sat Jan 20 08:12:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.581,"15min":1.625},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":2.0249999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.333},{"interface":"front","average":{"1min":1.238,"5min":1.5820000000000001,"15min":1.6399999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.994,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.2390000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":696320,"data_stored":293035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81200000000000006,"15min":0.81499999999999995},"min":{"1min":0.434,"5min":0.375,"15min":0.375},"max":{"1min":1.2330000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.80300000000000005,"15min":0.79700000000000004},"min":{"1min":0.53100000000000003,"5min":0.504,"15min":0.504},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.67400000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.91700000000000004,"15min":0.90700000000000003},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.45400000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.4119999999999999,"5min":1.444,"15min":1.444},"last":0.83199999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.0469999999999999,"5min":0.97399999999999998,"15min":0.96199999999999997},"min":{"1min":0.499,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.97399999999999998,"5min":1.0009999999999999,"15min":1.0049999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.758,"5min":1.758,"15min":1.758},"last":1.2350000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.1830000000000001,"15min":1.171},"min":{"1min":0.69999999999999996,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":0.99299999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.258,"15min":1.2529999999999999},"min":{"1min":0.91500000000000004,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.758,"5min":2.069,"15min":2.069},"last":1.2110000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.2749999999999999,"15min":1.282},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.345,"5min":1.2889999999999999,"15min":1.28},"min":{"1min":0.90200000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.8180000000000001,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.1879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3340000000000001,"5min":1.3220000000000001,"15min":1.3200000000000001},"min":{"1min":0.88200000000000001,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.859,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3160000000000001},{"interface":"front","average":{"1min":1.3140000000000001,"5min":1.3879999999999999,"15min":1.3999999999999999},"min":{"1min":0.76300000000000001,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.97,"5min":1.97,"15min":1.97},"last":1.452}]},{"osd":7,"last update":"Sat Jan 20 08:12:04 2024","interfaces":[{"interface":"back","average":{"1min":1.3120000000000001,"5min":1.3580000000000001,"15min":1.3660000000000001},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.8799999999999999,"5min":1.8799999999999999,"15min":1.8799999999999999},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3979999999999999,"15min":1.401},"min":{"1min":0.81299999999999994,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":2.0099999999999998,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4019999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32436,"kb_used_data":1252,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339404,"statfs":{"total":96636764160,"available":96603549696,"internally_reserved":0,"allocated":1282048,"data_stored":884774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.79800000000000004,"15min":0.79800000000000004},"min":{"1min":0.48099999999999998,"5min":0.379,"15min":0.379},"max":{"1min":1.4019999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.84399999999999997,"5min":0.85199999999999998,"15min":0.85399999999999998},"min":{"1min":0.46999999999999997,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.1859999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0029999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.85799999999999998,"15min":0.85599999999999998},"min":{"1min":0.47199999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.256,"5min":1.3540000000000001,"15min":1.3540000000000001},"last":1.722},{"interface":"front","average":{"1min":1.018,"5min":0.96099999999999997,"15min":0.95099999999999996},"min":{"1min":0.58799999999999997,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.724,"5min":1.724,"15min":1.724},"last":2.0699999999999998}]},{"osd":3,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.81999999999999995,"15min":0.82499999999999996},"min":{"1min":0.40100000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.131,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.554},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.97899999999999998,"15min":0.99299999999999999},"min":{"1min":0.54300000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.492,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.9239999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.107,"15min":1.091},"min":{"1min":0.67000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.968},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1160000000000001,"15min":1.115},"min":{"1min":0.85299999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.502,"5min":1.589,"15min":1.589},"last":1.6870000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1639999999999999,"15min":1.1679999999999999},"min":{"1min":0.74299999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.5700000000000001,"5min":1.865,"15min":1.865},"last":1.786},{"interface":"front","average":{"1min":1.2030000000000001,"5min":1.244,"15min":1.2509999999999999},"min":{"1min":0.82699999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.02,"5min":2.427,"15min":2.427},"last":1.3049999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.3240000000000001,"15min":1.3280000000000001},"min":{"1min":0.86799999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":2.1150000000000002,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.472},{"interface":"front","average":{"1min":1.236,"5min":1.276,"15min":1.282},"min":{"1min":0.81000000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.772,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.3480000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:12:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3049999999999999,"5min":1.371,"15min":1.3819999999999999},"min":{"1min":0.88300000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.7889999999999999,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.8660000000000001},{"interface":"front","average":{"1min":1.2410000000000001,"5min":1.359,"15min":1.379},"min":{"1min":0.84799999999999998,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.853,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":2.0219999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:12:32.054 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:12:32.054 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-20T08:12:32.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.300+0000 7f26db200640 1 Processor -- start 2024-01-20T08:12:32.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.300+0000 7f26db200640 1 -- start start 2024-01-20T08:12:32.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.301+0000 7f26db200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26d41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.301+0000 7f26db200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f26d40c2970 0x7f26d40c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.301+0000 7f26db200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d40c3430 con 0x7f26d4158790 2024-01-20T08:12:32.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.301+0000 7f26db200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d41557e0 con 0x7f26d40c2970 2024-01-20T08:12:32.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.301+0000 7f26db200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c6150 con 0x7f26d40c7b40 2024-01-20T08:12:32.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d9200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f26d4158790 0x7f26d40aa190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39132/0 (socket says 172.21.15.100:39132) 2024-01-20T08:12:32.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d9200640 1 -- 172.21.15.100:0/879775014 learned_addr learned my addr 172.21.15.100:0/879775014 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d3400640 1 --2- 172.21.15.100:0/879775014 >> v2:172.21.15.110:3300/0 conn(0x7f26d40c2970 0x7f26d40c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d3e00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26d41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3460879135 0 0) 0x7f26cc001110 con 0x7f26d4158790 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.302+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26b4003520 con 0x7f26d4158790 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4004476688 0 0) 0x7f26b4003520 con 0x7f26d4158790 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 msgr2=0x7f26d41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26d41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 >> v2:172.21.15.110:3300/0 conn(0x7f26d40c2970 msgr2=0x7f26d40c6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 --2- 172.21.15.100:0/879775014 >> v2:172.21.15.110:3300/0 conn(0x7f26d40c2970 0x7f26d40c6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d40c7180 con 0x7f26d4158790 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f26cc001800 con 0x7f26d4158790 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 >> v1:172.21.15.100:6789/0 conn(0x7f26d4158790 legacy=0x7f26d40aa190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b4003970 0x7f26b4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26b40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26b4004d00 0x7f26b4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d41557e0 con 0x7f26b4004d00 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40c6150 con 0x7f26b4003970 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26b400bab0 con 0x7f26d40c7b40 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d9200640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26b4004d00 0x7f26b4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d3e00640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b4003970 0x7f26b4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.303+0000 7f26d3400640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26b40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.304+0000 7f26d9200640 1 -- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 msgr2=0x7f26b40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.304+0000 7f26d9200640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26d40c7b40 0x7f26b40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.304+0000 7f26d9200640 1 -- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b4003970 msgr2=0x7f26b4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.304+0000 7f26d9200640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26b4003970 0x7f26b4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.304+0000 7f26d9200640 1 -- 172.21.15.100:0/879775014 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b4003520 con 0x7f26b4004d00 2024-01-20T08:12:32.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26d9200640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26b4004d00 0x7f26b4005180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00c240 tx=0x7f26b40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65be19dbb06e083 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc005ad0 con 0x7f26b4004d00 2024-01-20T08:12:32.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc005c30 con 0x7f26b4004d00 2024-01-20T08:12:32.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26d2a00640 1 -- 172.21.15.100:0/879775014 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc02c8d0 con 0x7f26b4004d00 2024-01-20T08:12:32.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26db200640 1 -- 172.21.15.100:0/879775014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26b4004d00 msgr2=0x7f26b4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26db200640 1 --2- 172.21.15.100:0/879775014 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26b4004d00 0x7f26b4005180 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f26cc00c240 tx=0x7f26b40057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.305+0000 7f26d9200640 1 -- 172.21.15.100:0/879775014 reap_dead start 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.306+0000 7f26db200640 1 -- 172.21.15.100:0/879775014 shutdown_connections 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.306+0000 7f26db200640 1 -- 172.21.15.100:0/879775014 >> 172.21.15.100:0/879775014 conn(0x7f26d4066730 msgr2=0x7f26d4066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.306+0000 7f26db200640 1 -- 172.21.15.100:0/879775014 shutdown_connections 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.306+0000 7f26db200640 1 -- 172.21.15.100:0/879775014 wait complete. 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.307+0000 7f26db200640 1 Processor -- start 2024-01-20T08:12:32.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 -- start start 2024-01-20T08:12:32.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26b4004d00 0x7f26d4149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26d4147f20 0x7f26d4154d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40702b0 con 0x7f26d40ac4d0 2024-01-20T08:12:32.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d40ab320 con 0x7f26d4147f20 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.308+0000 7f26db200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d406b6f0 con 0x7f26b4004d00 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35426/0 (socket says 172.21.15.100:35426) 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 -- 172.21.15.100:0/2913183226 learned_addr learned my addr 172.21.15.100:0/2913183226 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3e00640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26b4004d00 0x7f26d4149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 -- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26b4004d00 msgr2=0x7f26d4149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26b4004d00 0x7f26d4149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 -- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26d4147f20 msgr2=0x7f26d4154d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26d4147f20 0x7f26d4154d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 -- 172.21.15.100:0/2913183226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d4155260 con 0x7f26d40ac4d0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.309+0000 7f26d3400640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0116d0 tx=0x7f26bc011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.310+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00f940 con 0x7f26d40ac4d0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.310+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26bc00faa0 con 0x7f26d40ac4d0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.310+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00fe10 con 0x7f26d40ac4d0 2024-01-20T08:12:32.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.310+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d406b990 con 0x7f26d40ac4d0 2024-01-20T08:12:32.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.310+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d40aafb0 con 0x7f26d40ac4d0 2024-01-20T08:12:32.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.311+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d40aae10 con 0x7f26d40ac4d0 2024-01-20T08:12:32.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.312+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f26bc015460 con 0x7f26d40ac4d0 2024-01-20T08:12:32.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.313+0000 7f26cbe00640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 0x7f26ac06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.313+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f26bc089e80 con 0x7f26d40ac4d0 2024-01-20T08:12:32.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.313+0000 7f26d3e00640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 0x7f26ac06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.314+0000 7f26d3e00640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 0x7f26ac06d3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26d406fcc0 tx=0x7f26c400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.317+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f26d40aae10 con 0x7f26d40ac4d0 2024-01-20T08:12:32.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.582+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f26d40aae10 con 0x7f26d40ac4d0 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.587+0000 7f26cbe00640 1 -- 172.21.15.100:0/2913183226 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v15) v1 ==== 185+0+142 (secure 0 0 0) 0x7f26bc0220a0 con 0x7f26d40ac4d0 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw== 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-20T08:12:32.590 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.1 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.589+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 msgr2=0x7f26ac06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.589+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 0x7f26ac06d3c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26d406fcc0 tx=0x7f26c400b040 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.589+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 msgr2=0x7f26d41547e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.589+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f26bc0116d0 tx=0x7f26bc011b90 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 shutdown_connections 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f26d4147f20 0x7f26d4154d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f26d40ac4d0 0x7f26d41547e0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f26ac06af00 0x7f26ac06d3c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 --2- 172.21.15.100:0/2913183226 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f26b4004d00 0x7f26d4149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 >> 172.21.15.100:0/2913183226 conn(0x7f26d4066730 msgr2=0x7f26d41576d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 shutdown_connections 2024-01-20T08:12:32.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.590+0000 7f26db200640 1 -- 172.21.15.100:0/2913183226 wait complete. 2024-01-20T08:12:32.611 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:32.611 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:32.611 INFO:tasks.ceph.mds.d.smithi110.stderr:2024-01-20T08:12:32.608+0000 7fd08e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:12:32.667 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:32.667 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:32.719 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.925+0000 7f8a02e00640 1 Processor -- start 2024-01-20T08:12:32.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.925+0000 7f8a02e00640 1 -- start start 2024-01-20T08:12:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f8a02e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f89fc147f20 0x7f89fc0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f8a02e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89fc151f60 0x7f89fc070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f8a02e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89fc0c1670 con 0x7f89fc0c1b00 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f8a02e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc1524b0 con 0x7f89fc151f60 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f8a02e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89fc0c0d40 con 0x7f89fc147f20 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f89fb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89fc151f60 0x7f89fc070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f89fb400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f89fc151f60 0x7f89fc070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35436/0 (socket says 172.21.15.100:35436) 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.927+0000 7f89fb400640 1 -- 172.21.15.100:0/968086513 learned_addr learned my addr 172.21.15.100:0/968086513 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.928+0000 7f89fb400640 1 -- 172.21.15.100:0/968086513 >> v2:172.21.15.110:3300/0 conn(0x7f89fc147f20 msgr2=0x7f89fc0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.928+0000 7f89fb400640 1 --2- 172.21.15.100:0/968086513 >> v2:172.21.15.110:3300/0 conn(0x7f89fc147f20 0x7f89fc0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.928+0000 7f89fb400640 1 -- 172.21.15.100:0/968086513 >> v1:172.21.15.110:6789/0 conn(0x7f89fc0c1b00 legacy=0x7f89fc0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:32.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.928+0000 7f89fb400640 1 -- 172.21.15.100:0/968086513 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89fc0c1020 con 0x7f89fc151f60 2024-01-20T08:12:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.929+0000 7f89fb400640 1 --2- 172.21.15.100:0/968086513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc151f60 0x7f89fc070370 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89fc06e5d0 tx=0x7f89e402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a1f2fa142673bf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.929+0000 7f89faa00640 1 -- 172.21.15.100:0/968086513 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4031890 con 0x7f89fc151f60 2024-01-20T08:12:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.929+0000 7f89faa00640 1 -- 172.21.15.100:0/968086513 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e40319f0 con 0x7f89fc151f60 2024-01-20T08:12:32.932 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.929+0000 7f89faa00640 1 -- 172.21.15.100:0/968086513 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e4031d80 con 0x7f89fc151f60 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 -- 172.21.15.100:0/968086513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc151f60 msgr2=0x7f89fc070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 --2- 172.21.15.100:0/968086513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc151f60 0x7f89fc070370 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89fc06e5d0 tx=0x7f89e402b930 comp rx=0 tx=0).stop 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 -- 172.21.15.100:0/968086513 shutdown_connections 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 --2- 172.21.15.100:0/968086513 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc151f60 0x7f89fc070370 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 --2- 172.21.15.100:0/968086513 >> v2:172.21.15.110:3300/0 conn(0x7f89fc147f20 0x7f89fc0abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 -- 172.21.15.100:0/968086513 >> 172.21.15.100:0/968086513 conn(0x7f89fc06a5e0 msgr2=0x7f89fc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 -- 172.21.15.100:0/968086513 shutdown_connections 2024-01-20T08:12:32.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.930+0000 7f8a02e00640 1 -- 172.21.15.100:0/968086513 wait complete. 2024-01-20T08:12:32.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.932+0000 7f8a02e00640 1 Processor -- start 2024-01-20T08:12:32.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.932+0000 7f8a02e00640 1 -- start start 2024-01-20T08:12:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc147f20 0x7f89fc0bf840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89fc151f60 0x7f89fc14c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc14dd00 con 0x7f89fc0c1b00 2024-01-20T08:12:32.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc14c370 con 0x7f89fc147f20 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f8a02e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89fc1ee2d0 con 0x7f89fc151f60 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35446/0 (socket says 172.21.15.100:35446) 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 -- 172.21.15.100:0/2269504913 learned_addr learned my addr 172.21.15.100:0/2269504913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 -- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89fc151f60 msgr2=0x7f89fc14c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89fc151f60 0x7f89fc14c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 -- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc147f20 msgr2=0x7f89fc0bf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc147f20 0x7f89fc0bf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.933+0000 7f89fbe00640 1 -- 172.21.15.100:0/2269504913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40094d0 con 0x7f89fc0c1b00 2024-01-20T08:12:32.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f89fbe00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00ba50 tx=0x7f89ec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec00cbe0 con 0x7f89fc0c1b00 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00cd60 con 0x7f89fc0c1b00 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89fc0c0570 con 0x7f89fc0c1b00 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec014680 con 0x7f89fc0c1b00 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.934+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89fc15e510 con 0x7f89fc0c1b00 2024-01-20T08:12:32.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.935+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89fc04e970 con 0x7f89fc0c1b00 2024-01-20T08:12:32.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.936+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f89ec007370 con 0x7f89fc0c1b00 2024-01-20T08:12:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.937+0000 7f89f3e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 0x7f89d406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.937+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f89ec089940 con 0x7f89fc0c1b00 2024-01-20T08:12:32.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.937+0000 7f89fb400640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 0x7f89d406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:32.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.938+0000 7f89fb400640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 0x7f89d406d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89e4036000 tx=0x7f89e4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:32.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:32.942+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f89ec0544b0 con 0x7f89fc0c1b00 2024-01-20T08:12:33.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.120+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89fc0c0700 con 0x7f89fc0c1b00 2024-01-20T08:12:33.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.124+0000 7f89f3e00640 1 -- 172.21.15.100:0/2269504913 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7f89ec057ad0 con 0x7f89fc0c1b00 2024-01-20T08:12:33.127 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:33.127 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:33.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.126+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 msgr2=0x7f89d406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.126+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 0x7f89d406d390 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f89e4036000 tx=0x7f89e4030000 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.126+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 msgr2=0x7f89fc1edd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.126+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f89ec00ba50 tx=0x7f89ec00bf10 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.126+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 shutdown_connections 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f89d406aed0 0x7f89d406d390 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f89fc151f60 0x7f89fc14c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f89fc147f20 0x7f89fc0bf840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 --2- 172.21.15.100:0/2269504913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f89fc0c1b00 0x7f89fc1edd90 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 >> 172.21.15.100:0/2269504913 conn(0x7f89fc06a5e0 msgr2=0x7f89fc0a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 shutdown_connections 2024-01-20T08:12:33.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.127+0000 7f8a02e00640 1 -- 172.21.15.100:0/2269504913 wait complete. 2024-01-20T08:12:33.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:12:04.385777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:12:05.510105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:12:24.716271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:12:25.562320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:33.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:33.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.356+0000 7f3c21a00640 1 Processor -- start 2024-01-20T08:12:33.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.356+0000 7f3c21a00640 1 -- start start 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c21a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c06b140 0x7f3c1c06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c21a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c21a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c1c0c5880 con 0x7f3c1c151d50 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c21a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c4a60 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c21a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c9a40 con 0x7f3c1c06b140 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.357+0000 7f3c1b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35456/0 (socket says 172.21.15.100:35456) 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 -- 172.21.15.100:0/3610252430 learned_addr learned my addr 172.21.15.100:0/3610252430 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c11e00640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c06b140 0x7f3c1c06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 -- 172.21.15.100:0/3610252430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c06b140 msgr2=0x7f3c1c06b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c06b140 0x7f3c1c06b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 -- 172.21.15.100:0/3610252430 >> v1:172.21.15.110:6789/0 conn(0x7f3c1c151d50 legacy=0x7f3c1c1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:33.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.358+0000 7f3c1b400640 1 -- 172.21.15.100:0/3610252430 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c0c9f10 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.359+0000 7f3c1b400640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009870 tx=0x7f3c1402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3191b147e2005ea server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.359+0000 7f3c1a000640 1 -- 172.21.15.100:0/3610252430 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c140317c0 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.359+0000 7f3c1a000640 1 -- 172.21.15.100:0/3610252430 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14031920 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.359+0000 7f3c1a000640 1 -- 172.21.15.100:0/3610252430 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14031cb0 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 -- 172.21.15.100:0/3610252430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 msgr2=0x7f3c1c0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f3c14009870 tx=0x7f3c1402b860 comp rx=0 tx=0).stop 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 -- 172.21.15.100:0/3610252430 shutdown_connections 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c0c61a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 --2- 172.21.15.100:0/3610252430 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c06b140 0x7f3c1c06b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 -- 172.21.15.100:0/3610252430 >> 172.21.15.100:0/3610252430 conn(0x7f3c1c0ca0e0 msgr2=0x7f3c1c0ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 -- 172.21.15.100:0/3610252430 shutdown_connections 2024-01-20T08:12:33.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.360+0000 7f3c21a00640 1 -- 172.21.15.100:0/3610252430 wait complete. 2024-01-20T08:12:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.362+0000 7f3c21a00640 1 Processor -- start 2024-01-20T08:12:33.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.362+0000 7f3c21a00640 1 -- start start 2024-01-20T08:12:33.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c06b140 0x7f3c1c157f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 0x7f3c1c1eb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c4210 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c0b80 con 0x7f3c1c06b140 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c21a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c0c3c90 con 0x7f3c1c151d50 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35468/0 (socket says 172.21.15.100:35468) 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c11e00640 1 -- 172.21.15.100:0/1043390337 learned_addr learned my addr 172.21.15.100:0/1043390337 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.363+0000 7f3c1aa00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c06b140 0x7f3c1c157f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 -- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 msgr2=0x7f3c1c1eb3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c1b400640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 0x7f3c1c1eb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 0x7f3c1c1eb3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 -- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c06b140 msgr2=0x7f3c1c157f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c06b140 0x7f3c1c157f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 -- 172.21.15.100:0/1043390337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140094d0 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c1b400640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 0x7f3c1c1eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c11e00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007e40 tx=0x7f3c0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04014620 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c0400ee90 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c0c3f30 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c040149c0 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.364+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c158b40 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.366+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c04e970 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.366+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3c04014b20 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.367+0000 7f3c13400640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 0x7f3bf406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.367+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f3c0408a250 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.367+0000 7f3c1aa00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 0x7f3bf406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.368+0000 7f3c1aa00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 0x7f3bf406d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004ea0 tx=0x7f3c0c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.372+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3c04054e50 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.561+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c1c0c0cc0 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.562+0000 7f3c13400640 1 -- 172.21.15.100:0/1043390337 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c04058470 con 0x7f3c1c0c5d10 2024-01-20T08:12:33.565 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 msgr2=0x7f3bf406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 0x7f3bf406d390 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c004ea0 tx=0x7f3c0c009040 comp rx=0 tx=0).stop 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 msgr2=0x7f3c1c14d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f3c04007e40 tx=0x7f3c0400e4b0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 shutdown_connections 2024-01-20T08:12:33.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3bf406aed0 0x7f3bf406d390 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3c1c151d50 0x7f3c1c1eb3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3c1c0c5d10 0x7f3c1c14d170 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 --2- 172.21.15.100:0/1043390337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3c1c06b140 0x7f3c1c157f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 >> 172.21.15.100:0/1043390337 conn(0x7f3c1c0ca0e0 msgr2=0x7f3c1c151010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 shutdown_connections 2024-01-20T08:12:33.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.565+0000 7f3c21a00640 1 -- 172.21.15.100:0/1043390337 wait complete. 2024-01-20T08:12:33.586 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:12:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.790+0000 7f49dd000640 1 Processor -- start 2024-01-20T08:12:33.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.790+0000 7f49dd000640 1 -- start start 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49dd000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49d81481a0 0x7f49d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49dd000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80c05a0 0x7f49d80701e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49dd000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d806d220 con 0x7f49d8154af0 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49dd000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d806dbf0 con 0x7f49d81481a0 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49dd000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81557a0 con 0x7f49d80c05a0 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49d5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49d81481a0 0x7f49d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49d5e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f49d81481a0 0x7f49d806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35480/0 (socket says 172.21.15.100:35480) 2024-01-20T08:12:33.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.792+0000 7f49d5e00640 1 -- 172.21.15.100:0/4100944100 learned_addr learned my addr 172.21.15.100:0/4100944100 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.793+0000 7f49cd200640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80c05a0 0x7f49d80701e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.793+0000 7f49d5e00640 1 -- 172.21.15.100:0/4100944100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80c05a0 msgr2=0x7f49d80701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.793+0000 7f49d5e00640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80c05a0 0x7f49d80701e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.793+0000 7f49d5e00640 1 -- 172.21.15.100:0/4100944100 >> v1:172.21.15.110:6789/0 conn(0x7f49d8154af0 legacy=0x7f49d8154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:33.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.793+0000 7f49d5e00640 1 -- 172.21.15.100:0/4100944100 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d806c8f0 con 0x7f49d81481a0 2024-01-20T08:12:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.794+0000 7f49d5e00640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d81481a0 0x7f49d806d6b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009870 tx=0x7f49c802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afdcc3cece20709 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.794+0000 7f49d5400640 1 -- 172.21.15.100:0/4100944100 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80317c0 con 0x7f49d81481a0 2024-01-20T08:12:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.794+0000 7f49d5400640 1 -- 172.21.15.100:0/4100944100 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c8031920 con 0x7f49d81481a0 2024-01-20T08:12:33.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.794+0000 7f49d5400640 1 -- 172.21.15.100:0/4100944100 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c8031cb0 con 0x7f49d81481a0 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 -- 172.21.15.100:0/4100944100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d81481a0 msgr2=0x7f49d806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d81481a0 0x7f49d806d6b0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f49c8009870 tx=0x7f49c802b860 comp rx=0 tx=0).stop 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 -- 172.21.15.100:0/4100944100 shutdown_connections 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80c05a0 0x7f49d80701e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 --2- 172.21.15.100:0/4100944100 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d81481a0 0x7f49d806d6b0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 -- 172.21.15.100:0/4100944100 >> 172.21.15.100:0/4100944100 conn(0x7f49d80c6090 msgr2=0x7f49d80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 -- 172.21.15.100:0/4100944100 shutdown_connections 2024-01-20T08:12:33.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.795+0000 7f49dd000640 1 -- 172.21.15.100:0/4100944100 wait complete. 2024-01-20T08:12:33.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.797+0000 7f49dd000640 1 Processor -- start 2024-01-20T08:12:33.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.797+0000 7f49dd000640 1 -- start start 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 0x7f49d81e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80ab6c0 0x7f49d814fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d80bd5c0 con 0x7f49d8150080 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81e7150 con 0x7f49d8154af0 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49dd000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8151070 con 0x7f49d80ab6c0 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35492/0 (socket says 172.21.15.100:35492) 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 -- 172.21.15.100:0/2065662966 learned_addr learned my addr 172.21.15.100:0/2065662966 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:33.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d5e00640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 0x7f49d81e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49cd200640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80ab6c0 0x7f49d814fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 -- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80ab6c0 msgr2=0x7f49d814fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80ab6c0 0x7f49d814fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 -- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 msgr2=0x7f49d81e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 0x7f49d81e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d6800640 1 -- 172.21.15.100:0/2065662966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80094d0 con 0x7f49d8150080 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.798+0000 7f49d5e00640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 0x7f49d81e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49d6800640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f49d000b970 tx=0x7f49d000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000cb40 con 0x7f49d8150080 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000cca0 con 0x7f49d8150080 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d0014680 con 0x7f49d8150080 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d8151350 con 0x7f49d8150080 2024-01-20T08:12:33.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.799+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d814f620 con 0x7f49d8150080 2024-01-20T08:12:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.801+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d80a9540 con 0x7f49d8150080 2024-01-20T08:12:33.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.801+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f49d001d3b0 con 0x7f49d8150080 2024-01-20T08:12:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.802+0000 7f49cea00640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 0x7f49b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.802+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f49d00896e0 con 0x7f49d8150080 2024-01-20T08:12:33.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.802+0000 7f49d5e00640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 0x7f49b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:33.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.803+0000 7f49d5e00640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 0x7f49b006d390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f49c8036000 tx=0x7f49c803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:33.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.807+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f49d00542e0 con 0x7f49d8150080 2024-01-20T08:12:34.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.998+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f49d804ea50 con 0x7f49d8150080 2024-01-20T08:12:34.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:33.999+0000 7f49cea00640 1 -- 172.21.15.100:0/2065662966 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f49d0057900 con 0x7f49d8150080 2024-01-20T08:12:34.002 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 msgr2=0x7f49b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 0x7f49b006d390 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f49c8036000 tx=0x7f49c803d040 comp rx=0 tx=0).stop 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 msgr2=0x7f49d8139870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f49d000b970 tx=0x7f49d000be30 comp rx=0 tx=0).stop 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 shutdown_connections 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f49d8150080 0x7f49d8139870 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f49b006aed0 0x7f49b006d390 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f49d80ab6c0 0x7f49d814fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 --2- 172.21.15.100:0/2065662966 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f49d8154af0 0x7f49d81e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 >> 172.21.15.100:0/2065662966 conn(0x7f49d80c6090 msgr2=0x7f49d81528f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:34.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 shutdown_connections 2024-01-20T08:12:34.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.002+0000 7f49dd000640 1 -- 172.21.15.100:0/2065662966 wait complete. 2024-01-20T08:12:34.023 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:12:34.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.217+0000 7f1957c00640 1 Processor -- start 2024-01-20T08:12:34.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.217+0000 7f1957c00640 1 -- start start 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.218+0000 7f1957c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f195014b720 0x7f19501515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.218+0000 7f1957c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f19500c1d00 0x7f195006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.218+0000 7f1957c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1950154ba0 con 0x7f19500c1850 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.218+0000 7f1957c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f195014bb00 con 0x7f195014b720 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.218+0000 7f1957c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1950155a00 con 0x7f19500c1d00 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f195014b720 0x7f19501515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f195014b720 0x7f19501515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35494/0 (socket says 172.21.15.100:35494) 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 -- 172.21.15.100:0/3929223248 learned_addr learned my addr 172.21.15.100:0/3929223248 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955c00640 1 --2- 172.21.15.100:0/3929223248 >> v2:172.21.15.110:3300/0 conn(0x7f19500c1d00 0x7f195006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 -- 172.21.15.100:0/3929223248 >> v2:172.21.15.110:3300/0 conn(0x7f19500c1d00 msgr2=0x7f195006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:34.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 --2- 172.21.15.100:0/3929223248 >> v2:172.21.15.110:3300/0 conn(0x7f19500c1d00 0x7f195006cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 -- 172.21.15.100:0/3929223248 >> v1:172.21.15.110:6789/0 conn(0x7f19500c1850 legacy=0x7f195006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.219+0000 7f1955200640 1 -- 172.21.15.100:0/3929223248 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1950154df0 con 0x7f195014b720 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.220+0000 7f1955200640 1 --2- 172.21.15.100:0/3929223248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195014b720 0x7f19501515b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1950074650 tx=0x7f194002e060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8895111042d47644 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.220+0000 7f194fe00640 1 -- 172.21.15.100:0/3929223248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194002ea00 con 0x7f195014b720 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f194fe00640 1 -- 172.21.15.100:0/3929223248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194002eb60 con 0x7f195014b720 2024-01-20T08:12:34.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f194fe00640 1 -- 172.21.15.100:0/3929223248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940009600 con 0x7f195014b720 2024-01-20T08:12:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 -- 172.21.15.100:0/3929223248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195014b720 msgr2=0x7f19501515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 --2- 172.21.15.100:0/3929223248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195014b720 0x7f19501515b0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f1950074650 tx=0x7f194002e060 comp rx=0 tx=0).stop 2024-01-20T08:12:34.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 -- 172.21.15.100:0/3929223248 shutdown_connections 2024-01-20T08:12:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 --2- 172.21.15.100:0/3929223248 >> v2:172.21.15.110:3300/0 conn(0x7f19500c1d00 0x7f195006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 --2- 172.21.15.100:0/3929223248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f195014b720 0x7f19501515b0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 -- 172.21.15.100:0/3929223248 >> 172.21.15.100:0/3929223248 conn(0x7f19500c2940 msgr2=0x7f19500c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 -- 172.21.15.100:0/3929223248 shutdown_connections 2024-01-20T08:12:34.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.221+0000 7f1957c00640 1 -- 172.21.15.100:0/3929223248 wait complete. 2024-01-20T08:12:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.223+0000 7f1957c00640 1 Processor -- start 2024-01-20T08:12:34.226 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.223+0000 7f1957c00640 1 -- start start 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c1d00 0x7f19500bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 0x7f195013e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500aa1f0 con 0x7f19500c1850 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19501443a0 con 0x7f19500c1d00 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1957c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500a96e0 con 0x7f195014b720 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1955200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1955200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35510/0 (socket says 172.21.15.100:35510) 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.224+0000 7f1955200640 1 -- 172.21.15.100:0/1611670933 learned_addr learned my addr 172.21.15.100:0/1611670933 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 0x7f195013e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.229 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 -- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 msgr2=0x7f195013e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1947c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c1d00 0x7f19500bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 0x7f195013e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 -- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c1d00 msgr2=0x7f19500bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c1d00 0x7f19500bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 -- 172.21.15.100:0/1611670933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194000bd40 con 0x7f19500c1850 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 0x7f195013e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f1955200640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1940038040 tx=0x7f1940004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.225+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194002ea00 con 0x7f19500c1850 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.226+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940036820 con 0x7f19500c1850 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.226+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940036bd0 con 0x7f19500c1850 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.226+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19500a99c0 con 0x7f19500c1850 2024-01-20T08:12:34.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.226+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19500bfa20 con 0x7f19500c1850 2024-01-20T08:12:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.227+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195004e970 con 0x7f19500c1850 2024-01-20T08:12:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.228+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1940036d30 con 0x7f19500c1850 2024-01-20T08:12:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.228+0000 7f194d600640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 0x7f192806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.229+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f19400ace90 con 0x7f19500c1850 2024-01-20T08:12:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.229+0000 7f1947c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 0x7f192806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.232 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.229+0000 7f1947c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 0x7f192806d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1950154b70 tx=0x7f1938009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.233+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1940077b30 con 0x7f19500c1850 2024-01-20T08:12:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.411+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f195004e970 con 0x7f19500c1850 2024-01-20T08:12:34.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.412+0000 7f194d600640 1 -- 172.21.15.100:0/1611670933 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1940035e80 con 0x7f19500c1850 2024-01-20T08:12:34.415 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.414+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 msgr2=0x7f192806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.414+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 0x7f192806d390 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1950154b70 tx=0x7f1938009040 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 msgr2=0x7f19500ab2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f1940038040 tx=0x7f1940004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 shutdown_connections 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f192806aed0 0x7f192806d390 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f195014b720 0x7f195013e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f19500c1d00 0x7f19500bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 --2- 172.21.15.100:0/1611670933 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f19500c1850 0x7f19500ab2e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 >> 172.21.15.100:0/1611670933 conn(0x7f19500c2940 msgr2=0x7f195006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 shutdown_connections 2024-01-20T08:12:34.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.415+0000 7f1957c00640 1 -- 172.21.15.100:0/1611670933 wait complete. 2024-01-20T08:12:34.437 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:12:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.647+0000 7f00b7a00640 1 Processor -- start 2024-01-20T08:12:34.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.647+0000 7f00b7a00640 1 -- start start 2024-01-20T08:12:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.648+0000 7f00b7a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00b014c750 0x7f00b0153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.648+0000 7f00b7a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f00b00ab0b0 0x7f00b00a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b7a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00b00ab620 con 0x7f00b00a96f0 2024-01-20T08:12:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b7a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b014cb30 con 0x7f00b014c750 2024-01-20T08:12:34.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b7a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00b00ab900 con 0x7f00b00ab0b0 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00b014c750 0x7f00b0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b5000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f00b014c750 0x7f00b0153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35512/0 (socket says 172.21.15.100:35512) 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.649+0000 7f00b5000640 1 -- 172.21.15.100:0/860732185 learned_addr learned my addr 172.21.15.100:0/860732185 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.650+0000 7f00afe00640 1 --2- 172.21.15.100:0/860732185 >> v2:172.21.15.110:3300/0 conn(0x7f00b00ab0b0 0x7f00b00a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.650+0000 7f00b5000640 1 -- 172.21.15.100:0/860732185 >> v2:172.21.15.110:3300/0 conn(0x7f00b00ab0b0 msgr2=0x7f00b00a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.650+0000 7f00b5000640 1 --2- 172.21.15.100:0/860732185 >> v2:172.21.15.110:3300/0 conn(0x7f00b00ab0b0 0x7f00b00a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.650+0000 7f00b5000640 1 -- 172.21.15.100:0/860732185 >> v1:172.21.15.110:6789/0 conn(0x7f00b00a96f0 legacy=0x7f00b00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:34.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.650+0000 7f00b5000640 1 -- 172.21.15.100:0/860732185 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b00abbe0 con 0x7f00b014c750 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00b5000640 1 --2- 172.21.15.100:0/860732185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0153190 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f00b006e380 tx=0x7f00a002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba294402edbdfe03 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00af400640 1 -- 172.21.15.100:0/860732185 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0031870 con 0x7f00b014c750 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00af400640 1 -- 172.21.15.100:0/860732185 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a00319d0 con 0x7f00b014c750 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00af400640 1 -- 172.21.15.100:0/860732185 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a0031d60 con 0x7f00b014c750 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00b7a00640 1 -- 172.21.15.100:0/860732185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 msgr2=0x7f00b0153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.651+0000 7f00b7a00640 1 --2- 172.21.15.100:0/860732185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0153190 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f00b006e380 tx=0x7f00a002b910 comp rx=0 tx=0).stop 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 -- 172.21.15.100:0/860732185 shutdown_connections 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 --2- 172.21.15.100:0/860732185 >> v2:172.21.15.110:3300/0 conn(0x7f00b00ab0b0 0x7f00b00a91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 --2- 172.21.15.100:0/860732185 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0153190 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 -- 172.21.15.100:0/860732185 >> 172.21.15.100:0/860732185 conn(0x7f00b00c6090 msgr2=0x7f00b00c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 -- 172.21.15.100:0/860732185 shutdown_connections 2024-01-20T08:12:34.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.652+0000 7f00b7a00640 1 -- 172.21.15.100:0/860732185 wait complete. 2024-01-20T08:12:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.653+0000 7f00b7a00640 1 Processor -- start 2024-01-20T08:12:34.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.653+0000 7f00b7a00640 1 -- start start 2024-01-20T08:12:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00b00a96f0 0x7f00b0152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00b00ab0b0 0x7f00b0145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b014e350 con 0x7f00b014c750 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00b014d240 con 0x7f00b00ab0b0 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.654+0000 7f00b7a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00b014d520 con 0x7f00b00a96f0 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35514/0 (socket says 172.21.15.100:35514) 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 -- 172.21.15.100:0/317163499 learned_addr learned my addr 172.21.15.100:0/317163499 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5000640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00b00a96f0 0x7f00b0152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 -- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00b00a96f0 msgr2=0x7f00b0152290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00b00a96f0 0x7f00b0152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 -- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00b00ab0b0 msgr2=0x7f00b0145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00b00ab0b0 0x7f00b0145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 -- 172.21.15.100:0/317163499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a00094d0 con 0x7f00b014c750 2024-01-20T08:12:34.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b5a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c780 tx=0x7f00a800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a8004b60 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00a800ce90 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00b014d800 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.655+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00a800a850 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.656+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00b014ddc0 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.657+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00b004ea50 con 0x7f00b014c750 2024-01-20T08:12:34.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.658+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f00a800a9b0 con 0x7f00b014c750 2024-01-20T08:12:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.658+0000 7f00acc00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 0x7f008806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.658+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f00a8089b30 con 0x7f00b014c750 2024-01-20T08:12:34.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.659+0000 7f00b5000640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 0x7f008806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:34.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.659+0000 7f00b5000640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 0x7f008806d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f00a0036000 tx=0x7f00a003c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:34.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.663+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f00a8054690 con 0x7f00b014c750 2024-01-20T08:12:34.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.839+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f00b00702b0 con 0x7f00b014c750 2024-01-20T08:12:34.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.840+0000 7f00acc00640 1 -- 172.21.15.100:0/317163499 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7f00a8057cb0 con 0x7f00b014c750 2024-01-20T08:12:34.843 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 msgr2=0x7f008806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 0x7f008806d390 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f00a0036000 tx=0x7f00a003c040 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 msgr2=0x7f00b0146130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f00a800c780 tx=0x7f00a800cc40 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 shutdown_connections 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f00b014c750 0x7f00b0146130 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f00b00ab0b0 0x7f00b0145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f008806aed0 0x7f008806d390 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 --2- 172.21.15.100:0/317163499 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f00b00a96f0 0x7f00b0152290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:34.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 >> 172.21.15.100:0/317163499 conn(0x7f00b00c6090 msgr2=0x7f00b00c39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:34.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 shutdown_connections 2024-01-20T08:12:34.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:34.843+0000 7f00b7a00640 1 -- 172.21.15.100:0/317163499 wait complete. 2024-01-20T08:12:34.863 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:12:35.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.074+0000 7fae74a00640 1 Processor -- start 2024-01-20T08:12:35.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.074+0000 7fae74a00640 1 -- start start 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae74a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae6c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae74a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fae6c06ce10 0x7fae6c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae74a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae6c154ba0 con 0x7fae6c14b720 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae74a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae6c14bb00 con 0x7fae6c06ce10 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae74a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c155a00 con 0x7fae6c1515b0 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae72000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fae6c14b720 0x7fae6c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39136/0 (socket says 172.21.15.100:39136) 2024-01-20T08:12:35.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae72000640 1 -- 172.21.15.100:0/25694743 learned_addr learned my addr 172.21.15.100:0/25694743 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:35.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae71600640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae6c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae72a00640 1 --2- 172.21.15.100:0/25694743 >> v2:172.21.15.110:3300/0 conn(0x7fae6c06ce10 0x7fae6c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.076+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1201047622 0 0) 0x7fae6c154ba0 con 0x7fae6c14b720 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae4c005730 con 0x7fae6c14b720 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1936188911 0 0) 0x7fae4c005730 con 0x7fae6c14b720 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 msgr2=0x7fae6c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae6c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 >> v2:172.21.15.110:3300/0 conn(0x7fae6c06ce10 msgr2=0x7fae6c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 --2- 172.21.15.100:0/25694743 >> v2:172.21.15.110:3300/0 conn(0x7fae6c06ce10 0x7fae6c15bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c154df0 con 0x7fae6c14b720 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fae5c001670 con 0x7fae6c14b720 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 >> v1:172.21.15.100:6789/0 conn(0x7fae6c14b720 legacy=0x7fae6c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae4c005b80 0x7fae4c005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae4c0069d0 0x7fae4c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae4c007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c14bb00 con 0x7fae4c005b80 2024-01-20T08:12:35.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c155a00 con 0x7fae4c0069d0 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c00dbe0 con 0x7fae6c1515b0 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.077+0000 7fae72000640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae4c005b80 0x7fae4c005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae71600640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae4c0069d0 0x7fae4c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72a00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae4c007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72000640 1 -- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 msgr2=0x7fae4c007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72000640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae6c1515b0 0x7fae4c007390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72000640 1 -- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae4c0069d0 msgr2=0x7fae4c006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72000640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae4c0069d0 0x7fae4c006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.078+0000 7fae72000640 1 -- 172.21.15.100:0/25694743 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c005730 con 0x7fae4c005b80 2024-01-20T08:12:35.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.079+0000 7fae72000640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae4c005b80 0x7fae4c005fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c110 tx=0x7fae4c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f7fedfad1f7505 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.079+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c005ad0 con 0x7fae4c005b80 2024-01-20T08:12:35.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.079+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae5c005c30 con 0x7fae4c005b80 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.079+0000 7fae70c00640 1 -- 172.21.15.100:0/25694743 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae5c02c7e0 con 0x7fae4c005b80 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 -- 172.21.15.100:0/25694743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae4c005b80 msgr2=0x7fae4c005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 --2- 172.21.15.100:0/25694743 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae4c005b80 0x7fae4c005fa0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fae5c00c110 tx=0x7fae4c007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae72a00640 1 -- 172.21.15.100:0/25694743 reap_dead start 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 -- 172.21.15.100:0/25694743 shutdown_connections 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 -- 172.21.15.100:0/25694743 >> 172.21.15.100:0/25694743 conn(0x7fae6c0c2940 msgr2=0x7fae6c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 -- 172.21.15.100:0/25694743 shutdown_connections 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.080+0000 7fae74a00640 1 -- 172.21.15.100:0/25694743 wait complete. 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.082+0000 7fae74a00640 1 Processor -- start 2024-01-20T08:12:35.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.082+0000 7fae74a00640 1 -- start start 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.082+0000 7fae74a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae4c005b80 0x7fae6c1459a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae74a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c1475b0 0x7fae6c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae74a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae74a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c0c4050 con 0x7fae6c14a310 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae74a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c145210 con 0x7fae6c1475b0 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae74a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae6c1eae40 con 0x7fae4c005b80 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35528/0 (socket says 172.21.15.100:35528) 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 -- 172.21.15.100:0/3881852115 learned_addr learned my addr 172.21.15.100:0/3881852115 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72000640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae4c005b80 0x7fae6c1459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 -- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae4c005b80 msgr2=0x7fae6c1459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae4c005b80 0x7fae6c1459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 -- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c1475b0 msgr2=0x7fae6c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c1475b0 0x7fae6c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.083+0000 7fae72a00640 1 -- 172.21.15.100:0/3881852115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae6c1eb120 con 0x7fae6c14a310 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae72a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06fd60 tx=0x7fae6400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae64017400 con 0x7fae6c14a310 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae64011040 con 0x7fae6c14a310 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae640177c0 con 0x7fae6c14a310 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6c0c3ce0 con 0x7fae6c14a310 2024-01-20T08:12:35.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.084+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae6c14a790 con 0x7fae6c14a310 2024-01-20T08:12:35.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.085+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6c0c4200 con 0x7fae6c14a310 2024-01-20T08:12:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.086+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fae64017920 con 0x7fae6c14a310 2024-01-20T08:12:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.087+0000 7fae6a000640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 0x7fae4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.087+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fae64089e40 con 0x7fae6c14a310 2024-01-20T08:12:35.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.087+0000 7fae72000640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 0x7fae4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.088+0000 7fae72000640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 0x7fae4406d3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae5c034000 tx=0x7fae5c007000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.091+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fae6c0c4200 con 0x7fae6c14a310 2024-01-20T08:12:35.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.291+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fae6c0c4200 con 0x7fae6c14a310 2024-01-20T08:12:35.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.292+0000 7fae6a000640 1 -- 172.21.15.100:0/3881852115 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7fae6c0c4200 con 0x7fae6c14a310 2024-01-20T08:12:35.295 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.294+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 msgr2=0x7fae4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.294+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 0x7fae4406d3c0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fae5c034000 tx=0x7fae5c007000 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.294+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 msgr2=0x7fae6c152aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.294+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fae6c06fd60 tx=0x7fae6400f4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 shutdown_connections 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae6c14a310 0x7fae6c152aa0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae6c1475b0 0x7fae6c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4406af00 0x7fae4406d3c0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 --2- 172.21.15.100:0/3881852115 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae4c005b80 0x7fae6c1459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 >> 172.21.15.100:0/3881852115 conn(0x7fae6c0c2940 msgr2=0x7fae6c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 shutdown_connections 2024-01-20T08:12:35.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.295+0000 7fae74a00640 1 -- 172.21.15.100:0/3881852115 wait complete. 2024-01-20T08:12:35.315 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:12:35.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.510+0000 7f1078e00640 1 Processor -- start 2024-01-20T08:12:35.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.510+0000 7f1078e00640 1 -- start start 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1078e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 0x7f10741550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1078e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f10740c7e10 0x7f10740ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1078e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1074157d00 con 0x7f10740ca9a0 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1078e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740c4890 con 0x7f10740c7e10 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1078e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f107406cd00 con 0x7f107414e690 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1073e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f10740ca9a0 0x7f10741581e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39144/0 (socket says 172.21.15.100:39144) 2024-01-20T08:12:35.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f1073e00640 1 -- 172.21.15.100:0/2119359557 learned_addr learned my addr 172.21.15.100:0/2119359557 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.512+0000 7f106a800640 1 --2- 172.21.15.100:0/2119359557 >> v2:172.21.15.110:3300/0 conn(0x7f10740c7e10 0x7f10740ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1073400640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 0x7f10741550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 921045685 0 0) 0x7f1074157d00 con 0x7f10740ca9a0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1054003520 con 0x7f10740ca9a0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1739886924 0 0) 0x7f1054003520 con 0x7f10740ca9a0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 msgr2=0x7f10741550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 0x7f10741550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 >> v2:172.21.15.110:3300/0 conn(0x7f10740c7e10 msgr2=0x7f10740ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 --2- 172.21.15.100:0/2119359557 >> v2:172.21.15.110:3300/0 conn(0x7f10740c7e10 0x7f10740ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10740c4b50 con 0x7f10740ca9a0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f106c0019f0 con 0x7f10740ca9a0 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 >> v1:172.21.15.100:6789/0 conn(0x7f10740ca9a0 legacy=0x7f10741581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1054003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 0x7f10540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1054004d00 0x7f1054005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740c4890 con 0x7f1054003970 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f107406cd00 con 0x7f1054004d00 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105400b9b0 con 0x7f107414e690 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.513+0000 7f1073400640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1054003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073400640 1 -- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 msgr2=0x7f10540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073400640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f107414e690 0x7f10540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073400640 1 -- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1054004d00 msgr2=0x7f1054005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073e00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1054004d00 0x7f1054005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073400640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1054004d00 0x7f1054005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073400640 1 -- 172.21.15.100:0/2119359557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1054003520 con 0x7f1054003970 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.514+0000 7f1073e00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1054004d00 0x7f1054005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:35.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.515+0000 7f1073400640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1054003d90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1064009ac0 tx=0x7f10540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0fdfd8a822ce275 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.515+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106402c710 con 0x7f1054003970 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.515+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106402c870 con 0x7f1054003970 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.515+0000 7f1072a00640 1 -- 172.21.15.100:0/2119359557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106402cc00 con 0x7f1054003970 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 -- 172.21.15.100:0/2119359557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 msgr2=0x7f1054003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 --2- 172.21.15.100:0/2119359557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1054003d90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1064009ac0 tx=0x7f10540057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1073e00640 1 -- 172.21.15.100:0/2119359557 reap_dead start 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 -- 172.21.15.100:0/2119359557 shutdown_connections 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 -- 172.21.15.100:0/2119359557 >> 172.21.15.100:0/2119359557 conn(0x7f1074072130 msgr2=0x7f1074072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 -- 172.21.15.100:0/2119359557 shutdown_connections 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.516+0000 7f1078e00640 1 -- 172.21.15.100:0/2119359557 wait complete. 2024-01-20T08:12:35.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.518+0000 7f1078e00640 1 Processor -- start 2024-01-20T08:12:35.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.518+0000 7f1078e00640 1 -- start start 2024-01-20T08:12:35.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10740c3ce0 0x7f1074148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10740a9950 0x7f1074148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074148ed0 con 0x7f1054003970 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740ae0b0 con 0x7f10740c3ce0 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1078e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10740ac8c0 con 0x7f10740a9950 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35550/0 (socket says 172.21.15.100:35550) 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 -- 172.21.15.100:0/768916549 learned_addr learned my addr 172.21.15.100:0/768916549 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 -- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10740a9950 msgr2=0x7f1074148990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10740a9950 0x7f1074148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 -- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10740c3ce0 msgr2=0x7f1074148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10740c3ce0 0x7f1074148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.519+0000 7f1073400640 1 -- 172.21.15.100:0/768916549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10741edf00 con 0x7f1054003970 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f1073400640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1064000c00 tx=0x7f1064004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064003810 con 0x7f1054003970 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106402de90 con 0x7f1054003970 2024-01-20T08:12:35.524 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1064003b70 con 0x7f1054003970 2024-01-20T08:12:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10741ee1e0 con 0x7f1054003970 2024-01-20T08:12:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.520+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10740add40 con 0x7f1054003970 2024-01-20T08:12:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.521+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107404e970 con 0x7f1054003970 2024-01-20T08:12:35.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.522+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1064003cd0 con 0x7f1054003970 2024-01-20T08:12:35.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.523+0000 7f106be00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 0x7f104c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:35.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.524+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f10640aba30 con 0x7f1054003970 2024-01-20T08:12:35.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.524+0000 7f106a800640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 0x7f104c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:35.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.524+0000 7f106a800640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 0x7f104c06d3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f105c0093d0 tx=0x7f105c009300 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:35.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.528+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1064076770 con 0x7f1054003970 2024-01-20T08:12:35.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.716+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f107406ca00 con 0x7f1054003970 2024-01-20T08:12:35.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.717+0000 7f106be00640 1 -- 172.21.15.100:0/768916549 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1064079d90 con 0x7f1054003970 2024-01-20T08:12:35.720 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 msgr2=0x7f104c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 0x7f104c06d3c0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f105c0093d0 tx=0x7f105c009300 comp rx=0 tx=0).stop 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 msgr2=0x7f1074156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1064000c00 tx=0x7f1064004730 comp rx=0 tx=0).stop 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 shutdown_connections 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f104c06af00 0x7f104c06d3c0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f10740a9950 0x7f1074148990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f10740c3ce0 0x7f1074148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.719+0000 7f1078e00640 1 --2- 172.21.15.100:0/768916549 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1054003970 0x7f1074156e50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.720+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 >> 172.21.15.100:0/768916549 conn(0x7f1074072130 msgr2=0x7f107414c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.720+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 shutdown_connections 2024-01-20T08:12:35.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:35.720+0000 7f1078e00640 1 -- 172.21.15.100:0/768916549 wait complete. 2024-01-20T08:12:35.740 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:12:35.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:35.740 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:35.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:12:35.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:35.849 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:12:35.900 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:35.900 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:35.947 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:12:35.947 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:12:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.157+0000 7f9252200640 1 Processor -- start 2024-01-20T08:12:36.160 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.157+0000 7f9252200640 1 -- start start 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f9252200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f924c14b720 0x7f924c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f9252200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f924c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f9252200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924c154ba0 con 0x7f924c06c8d0 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f9252200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f924c14bb00 con 0x7f924c14b720 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f9252200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c155a00 con 0x7f924c0c1850 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f924be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f924c06c8d0 0x7f924c06cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39146/0 (socket says 172.21.15.100:39146) 2024-01-20T08:12:36.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.158+0000 7f924be00640 1 -- 172.21.15.100:0/802601227 learned_addr learned my addr 172.21.15.100:0/802601227 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:36.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924b400640 1 --2- 172.21.15.100:0/802601227 >> v2:172.21.15.110:3300/0 conn(0x7f924c14b720 0x7f924c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f9242800640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f924c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3440203599 0 0) 0x7f924c154ba0 con 0x7f924c06c8d0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f922c003520 con 0x7f924c06c8d0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1541809058 0 0) 0x7f922c003520 con 0x7f924c06c8d0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 msgr2=0x7f924c0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f924c0c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 >> v2:172.21.15.110:3300/0 conn(0x7f924c14b720 msgr2=0x7f924c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 --2- 172.21.15.100:0/802601227 >> v2:172.21.15.110:3300/0 conn(0x7f924c14b720 0x7f924c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c154df0 con 0x7f924c06c8d0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f92440019f0 con 0x7f924c06c8d0 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 >> v1:172.21.15.100:6789/0 conn(0x7f924c06c8d0 legacy=0x7f924c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f922c003970 0x7f922c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c0047c0 0x7f922c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f922c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c14bb00 con 0x7f922c003970 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.159+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c155a00 con 0x7f922c0047c0 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922c00b9d0 con 0x7f924c0c1850 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f922c003970 0x7f922c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f9242800640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c0047c0 0x7f922c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924be00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f922c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 -- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 msgr2=0x7f922c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f922c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 -- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c0047c0 msgr2=0x7f922c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c0047c0 0x7f922c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924b400640 1 -- 172.21.15.100:0/802601227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922c003520 con 0x7f922c003970 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f924be00640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c0c1850 0x7f922c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:36.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.160+0000 7f9242800640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c0047c0 0x7f922c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:36.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f924b400640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f922c003970 0x7f922c003d90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f923c009af0 tx=0x7f922c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd306c487792f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:36.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c02c710 con 0x7f922c003970 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923c02c870 con 0x7f922c003970 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f924aa00640 1 -- 172.21.15.100:0/802601227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c02cc00 con 0x7f922c003970 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f9252200640 1 -- 172.21.15.100:0/802601227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f922c003970 msgr2=0x7f922c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f9252200640 1 --2- 172.21.15.100:0/802601227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f922c003970 0x7f922c003d90 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f923c009af0 tx=0x7f922c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.162+0000 7f924be00640 1 -- 172.21.15.100:0/802601227 reap_dead start 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.163+0000 7f9252200640 1 -- 172.21.15.100:0/802601227 shutdown_connections 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.163+0000 7f9252200640 1 -- 172.21.15.100:0/802601227 >> 172.21.15.100:0/802601227 conn(0x7f924c0c2940 msgr2=0x7f924c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.163+0000 7f9252200640 1 -- 172.21.15.100:0/802601227 shutdown_connections 2024-01-20T08:12:36.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.163+0000 7f9252200640 1 -- 172.21.15.100:0/802601227 wait complete. 2024-01-20T08:12:36.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.165+0000 7f9252200640 1 Processor -- start 2024-01-20T08:12:36.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.165+0000 7f9252200640 1 -- start start 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 0x7f924c1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c151610 0x7f924c0c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c13e7e0 con 0x7f924c14f160 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c143350 con 0x7f922c003970 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f9252200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c143630 con 0x7f924c151610 2024-01-20T08:12:36.169 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f924be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f924be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35568/0 (socket says 172.21.15.100:35568) 2024-01-20T08:12:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f924be00640 1 -- 172.21.15.100:0/1396822252 learned_addr learned my addr 172.21.15.100:0/1396822252 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.166+0000 7f924b400640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 0x7f924c1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f9242800640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c151610 0x7f924c0c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 -- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c151610 msgr2=0x7f924c0c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c151610 0x7f924c0c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 -- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 msgr2=0x7f924c1510d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 0x7f924c1510d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 -- 172.21.15.100:0/1396822252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f924c1eabc0 con 0x7f924c14f160 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924b400640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 0x7f924c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.167+0000 7f924be00640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f924c06fe10 tx=0x7f924400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.168+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244004d60 con 0x7f924c14f160 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.168+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924400bb80 con 0x7f924c14f160 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.168+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c1eaea0 con 0x7f924c14f160 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.168+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9244007070 con 0x7f924c14f160 2024-01-20T08:12:36.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.168+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c0c53a0 con 0x7f924c14f160 2024-01-20T08:12:36.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.169+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c1eb090 con 0x7f924c14f160 2024-01-20T08:12:36.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.170+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f92440071d0 con 0x7f924c14f160 2024-01-20T08:12:36.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.171+0000 7f9243e00640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 0x7f922406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:36.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.171+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9244089ce0 con 0x7f924c14f160 2024-01-20T08:12:36.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.171+0000 7f924b400640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 0x7f922406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:36.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.172+0000 7f924b400640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 0x7f922406d390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f923c036000 tx=0x7f923c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:36.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.176+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9244054850 con 0x7f924c14f160 2024-01-20T08:12:36.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.402+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f924c04e970 con 0x7f924c14f160 2024-01-20T08:12:36.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.403+0000 7f9243e00640 1 -- 172.21.15.100:0/1396822252 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7f9244057e70 con 0x7f924c14f160 2024-01-20T08:12:36.406 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:12:36.406 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:12:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 msgr2=0x7f922406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 0x7f922406d390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f923c036000 tx=0x7f923c030000 comp rx=0 tx=0).stop 2024-01-20T08:12:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 msgr2=0x7f924c153d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f924c06fe10 tx=0x7f924400b4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 shutdown_connections 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f924c14f160 0x7f924c153d70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f922406aed0 0x7f922406d390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f924c151610 0x7f924c0c4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 --2- 172.21.15.100:0/1396822252 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f922c003970 0x7f924c1510d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 >> 172.21.15.100:0/1396822252 conn(0x7f924c0c2940 msgr2=0x7f924c071980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 shutdown_connections 2024-01-20T08:12:36.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:36.405+0000 7f9252200640 1 -- 172.21.15.100:0/1396822252 wait complete. 2024-01-20T08:12:36.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:12:36.426 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:12:36.427 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:12:36.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:12:36.427 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:12:36.428 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:36.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.428 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:12:36.482 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:12:36.483 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.484 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:12:36.485 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.485 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:12:36.485 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:12:36.485 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:12:36.485 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:36.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.486 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:12:36.615 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:12:36.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.620 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:12:36.672 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:12:36.672 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:12:36.672 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:12:36.672 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:12:36.672 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:12:36.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:12:36.674 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:12:36.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.853 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:12:36.900 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:12:36.901 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:36.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:36.901 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:12:36.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:36.985 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:37.038 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:12:37.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:37.039 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:37.087 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-20T08:12:37.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:37.087 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:37.220 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:37.220 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:37.254 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:37.254 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:37.254 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:12:37.254 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:12:37.254 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:12:37.256 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:12:37.256 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:12:37.256 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:12:37.256 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:12:37.256 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:12:37.261 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:12:37.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:37.261 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:37.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:37.345 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:12:37.406 INFO:teuthology.orchestra.run.smithi110.stdout:client6030 2024-01-20T08:12:37.407 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:37.407 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:37.454 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow rw fsname=cephfs, allow rw fsname=cephfs2' osd 'allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2' mds 'allow rw fsname=cephfs' 2024-01-20T08:12:37.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.671+0000 7efec3600640 1 Processor -- start 2024-01-20T08:12:37.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.672+0000 7efec3600640 1 -- start start 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efec3600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efebc0af850 0x7efebc0c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efec3600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc0c4ad0 con 0x7efebc0c9cb0 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efec3600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efebc158900 con 0x7efebc0c70a0 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efec3600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efebc152350 con 0x7efebc0af850 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efebbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7efebc0c9cb0 0x7efebc154960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39160/0 (socket says 172.21.15.100:39160) 2024-01-20T08:12:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.673+0000 7efebbe00640 1 -- 172.21.15.100:0/1462840648 learned_addr learned my addr 172.21.15.100:0/1462840648 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424815061 0 0) 0x7efebc0c4ad0 con 0x7efebc0c9cb0 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe9c003520 con 0x7efebc0c9cb0 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efec0c00640 1 --2- 172.21.15.100:0/1462840648 >> v2:172.21.15.110:3300/0 conn(0x7efebc0af850 0x7efebc0c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1005698698 0 0) 0x7efe9c003520 con 0x7efebc0c9cb0 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 >> v2:172.21.15.110:3300/0 conn(0x7efebc0af850 msgr2=0x7efebc0c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 --2- 172.21.15.100:0/1462840648 >> v2:172.21.15.110:3300/0 conn(0x7efebc0af850 0x7efebc0c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 >> v1:172.21.15.110:6789/0 conn(0x7efebc0c70a0 legacy=0x7efebc155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc158be0 con 0x7efebc0c9cb0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7efea4001670 con 0x7efebc0c9cb0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 >> v1:172.21.15.100:6789/0 conn(0x7efebc0c9cb0 legacy=0x7efebc154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c0039c0 0x7efe9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe9c0047c0 0x7efe9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 0x7efe9c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c00c230 con 0x7efe9c005380 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c00c3a0 con 0x7efe9c0047c0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe9c00c560 con 0x7efe9c0039c0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.674+0000 7efec1600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 0x7efe9c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec0c00640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c0039c0 0x7efe9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efebbe00640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe9c0047c0 0x7efe9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec1600640 1 -- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c0039c0 msgr2=0x7efe9c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:37.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec1600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c0039c0 0x7efe9c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec1600640 1 -- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe9c0047c0 msgr2=0x7efe9c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:37.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec1600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efe9c0047c0 0x7efe9c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.675+0000 7efec1600640 1 -- 172.21.15.100:0/1462840648 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c003520 con 0x7efe9c005380 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.676+0000 7efec1600640 1 -- 172.21.15.100:0/1462840648 reap_dead start 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.676+0000 7efec1600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 0x7efe9c00b980 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efeb4001750 tx=0x7efe9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b90162bf300b3b5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.676+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb40052d0 con 0x7efe9c005380 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.676+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb402e050 con 0x7efe9c005380 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.676+0000 7efebb400640 1 -- 172.21.15.100:0/1462840648 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4003830 con 0x7efe9c005380 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 -- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 msgr2=0x7efe9c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 0x7efe9c00b980 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7efeb4001750 tx=0x7efe9c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 -- 172.21.15.100:0/1462840648 shutdown_connections 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 --2- 172.21.15.100:0/1462840648 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efe9c005380 0x7efe9c00b980 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 -- 172.21.15.100:0/1462840648 >> 172.21.15.100:0/1462840648 conn(0x7efebc0abec0 msgr2=0x7efebc0ac2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:37.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 -- 172.21.15.100:0/1462840648 shutdown_connections 2024-01-20T08:12:37.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.677+0000 7efec3600640 1 -- 172.21.15.100:0/1462840648 wait complete. 2024-01-20T08:12:37.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.679+0000 7efec3600640 1 Processor -- start 2024-01-20T08:12:37.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.679+0000 7efec3600640 1 -- start start 2024-01-20T08:12:37.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c005380 0x7efebc151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0ab840 0x7efebc0bc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0bf6b0 con 0x7efebc0bc920 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0be6b0 con 0x7efebc0ab840 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec3600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc151eb0 con 0x7efe9c005380 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35584/0 (socket says 172.21.15.100:35584) 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 -- 172.21.15.100:0/4048468872 learned_addr learned my addr 172.21.15.100:0/4048468872 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec0c00640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c005380 0x7efebc151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 -- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c005380 msgr2=0x7efebc151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c005380 0x7efebc151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 -- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0ab840 msgr2=0x7efebc0bc3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0ab840 0x7efebc0bc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.680+0000 7efec1600640 1 -- 172.21.15.100:0/4048468872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc1ee0d0 con 0x7efebc0bc920 2024-01-20T08:12:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efec1600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efeb402bd00 tx=0x7efeb4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4007030 con 0x7efebc0bc920 2024-01-20T08:12:37.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb4007190 con 0x7efebc0bc920 2024-01-20T08:12:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4007500 con 0x7efebc0bc920 2024-01-20T08:12:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0be3d0 con 0x7efebc0bc920 2024-01-20T08:12:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.681+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc0be0b0 con 0x7efebc0bc920 2024-01-20T08:12:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.682+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc0bdc30 con 0x7efebc0bc920 2024-01-20T08:12:37.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.683+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efeb403a070 con 0x7efebc0bc920 2024-01-20T08:12:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.684+0000 7efeb8c00640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 0x7efe9406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.684+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7efeb4037070 con 0x7efebc0bc920 2024-01-20T08:12:37.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.684+0000 7efec0c00640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 0x7efe9406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:37.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.685+0000 7efec0c00640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 0x7efe9406d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efeac0041e0 tx=0x7efeac00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:37.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.688+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efebc0bdc30 con 0x7efebc0bc920 2024-01-20T08:12:37.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.951+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]} v 0) v1 -- 0x7efebc0bdc30 con 0x7efebc0bc920 2024-01-20T08:12:37.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.955+0000 7efeb8c00640 1 -- 172.21.15.100:0/4048468872 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow rw fsname=cephfs, allow rw fsname=cephfs2", "osd", "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2", "mds", "allow rw fsname=cephfs"]}]=0 added key for client.testuser v16) v1 ==== 291+0+0 (secure 0 0 0) 0x7efebc0bdc30 con 0x7efebc0bc920 2024-01-20T08:12:37.958 INFO:teuthology.orchestra.run.smithi100.stderr:added key for client.testuser 2024-01-20T08:12:37.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 msgr2=0x7efe9406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 0x7efe9406d3c0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efeac0041e0 tx=0x7efeac00b040 comp rx=0 tx=0).stop 2024-01-20T08:12:37.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 msgr2=0x7efebc0be990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:37.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efeb402bd00 tx=0x7efeb4001120 comp rx=0 tx=0).stop 2024-01-20T08:12:37.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 shutdown_connections 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efebc0bc920 0x7efebc0be990 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efebc0ab840 0x7efebc0bc3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efe9406af00 0x7efe9406d3c0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 --2- 172.21.15.100:0/4048468872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efe9c005380 0x7efebc151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 >> 172.21.15.100:0/4048468872 conn(0x7efebc0abec0 msgr2=0x7efebc0ac2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 shutdown_connections 2024-01-20T08:12:37.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:37.958+0000 7efec3600640 1 -- 172.21.15.100:0/4048468872 wait complete. 2024-01-20T08:12:37.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-01-20T08:12:38.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.189+0000 7fb062a00640 1 Processor -- start 2024-01-20T08:12:38.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.190+0000 7fb062a00640 1 -- start start 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb062a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb05c0c7e10 0x7fb05c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb062a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 0x7fb05c158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb062a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb05c158bb0 con 0x7fb05c14e690 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb062a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c157d00 con 0x7fb05c0c7e10 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb062a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb05c0c4890 con 0x7fb05c1581e0 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb060c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb05c0c7e10 0x7fb05c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb060c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb05c0c7e10 0x7fb05c1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35586/0 (socket says 172.21.15.100:35586) 2024-01-20T08:12:38.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.191+0000 7fb060c00640 1 -- 172.21.15.100:0/539564951 learned_addr learned my addr 172.21.15.100:0/539564951 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb062000640 1 --2- 172.21.15.100:0/539564951 >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 0x7fb05c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb060c00640 1 -- 172.21.15.100:0/539564951 >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 msgr2=0x7fb05c158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb060c00640 1 --2- 172.21.15.100:0/539564951 >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 0x7fb05c158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb060c00640 1 -- 172.21.15.100:0/539564951 >> v1:172.21.15.110:6789/0 conn(0x7fb05c14e690 legacy=0x7fb05c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb060c00640 1 -- 172.21.15.100:0/539564951 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05c06cd00 con 0x7fb05c0c7e10 2024-01-20T08:12:38.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.192+0000 7fb062000640 1 --2- 172.21.15.100:0/539564951 >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 0x7fb05c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.193+0000 7fb060c00640 1 --2- 172.21.15.100:0/539564951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c1550f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0c6480 tx=0x7fb04402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=138350fe5667fabc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.193+0000 7fb05be00640 1 -- 172.21.15.100:0/539564951 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044031800 con 0x7fb05c0c7e10 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.193+0000 7fb05be00640 1 -- 172.21.15.100:0/539564951 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb044031960 con 0x7fb05c0c7e10 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.193+0000 7fb05be00640 1 -- 172.21.15.100:0/539564951 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb044031cf0 con 0x7fb05c0c7e10 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 -- 172.21.15.100:0/539564951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 msgr2=0x7fb05c1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 --2- 172.21.15.100:0/539564951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c1550f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fb05c0c6480 tx=0x7fb04402b8a0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 -- 172.21.15.100:0/539564951 shutdown_connections 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 --2- 172.21.15.100:0/539564951 >> v2:172.21.15.110:3300/0 conn(0x7fb05c1581e0 0x7fb05c158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 --2- 172.21.15.100:0/539564951 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c1550f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 -- 172.21.15.100:0/539564951 >> 172.21.15.100:0/539564951 conn(0x7fb05c072130 msgr2=0x7fb05c072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 -- 172.21.15.100:0/539564951 shutdown_connections 2024-01-20T08:12:38.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.194+0000 7fb062a00640 1 -- 172.21.15.100:0/539564951 wait complete. 2024-01-20T08:12:38.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.196+0000 7fb062a00640 1 Processor -- start 2024-01-20T08:12:38.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.196+0000 7fb062a00640 1 -- start start 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb05c14e690 0x7fb05c0c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 0x7fb05c0ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c0afb40 con 0x7fb05c0c7e10 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1e99a0 con 0x7fb05c1581e0 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05c1e9c60 con 0x7fb05c14e690 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:35600/0 (socket says 172.21.15.100:35600) 2024-01-20T08:12:38.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 -- 172.21.15.100:0/143941116 learned_addr learned my addr 172.21.15.100:0/143941116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb062000640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 0x7fb05c0ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 -- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb05c14e690 msgr2=0x7fb05c0c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb060c00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb05c14e690 0x7fb05c0c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb05c14e690 0x7fb05c0c0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 -- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 msgr2=0x7fb05c0ae8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 0x7fb05c0ae8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.197+0000 7fb061600640 1 -- 172.21.15.100:0/143941116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0440094d0 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb062000640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 0x7fb05c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb061600640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c430 tx=0x7fb04c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c011790 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04c0118f0 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04c011ce0 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05c1e9f40 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.198+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05c1ea500 con 0x7fb05c0c7e10 2024-01-20T08:12:38.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.199+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05c04e970 con 0x7fb05c0c7e10 2024-01-20T08:12:38.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.200+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb04c01c460 con 0x7fb05c0c7e10 2024-01-20T08:12:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.201+0000 7fb059600640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 0x7fb03406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.201+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb04c089980 con 0x7fb05c0c7e10 2024-01-20T08:12:38.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.202+0000 7fb060c00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 0x7fb03406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.202+0000 7fb060c00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 0x7fb03406d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb044036000 tx=0x7fb04403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.205+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb04c0544e0 con 0x7fb05c0c7e10 2024-01-20T08:12:38.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.461+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7fb05c06ca00 con 0x7fb05c0c7e10 2024-01-20T08:12:38.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.462+0000 7fb059600640 1 -- 172.21.15.100:0/143941116 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v16) v1 ==== 85+0+245 (secure 0 0 0) 0x7fb04c057b00 con 0x7fb05c0c7e10 2024-01-20T08:12:38.465 INFO:teuthology.orchestra.run.smithi100.stdout:[client.testuser] 2024-01-20T08:12:38.465 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew== 2024-01-20T08:12:38.466 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow rw fsname=cephfs" 2024-01-20T08:12:38.466 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" 2024-01-20T08:12:38.466 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 msgr2=0x7fb03406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 0x7fb03406d390 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb044036000 tx=0x7fb04403c040 comp rx=0 tx=0).stop 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 msgr2=0x7fb05c0c2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00c430 tx=0x7fb04c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 shutdown_connections 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb05c1581e0 0x7fb05c0ae8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb03406aed0 0x7fb03406d390 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb05c14e690 0x7fb05c0c0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 --2- 172.21.15.100:0/143941116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb05c0c7e10 0x7fb05c0c2f10 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 >> 172.21.15.100:0/143941116 conn(0x7fb05c072130 msgr2=0x7fb05c072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:38.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 shutdown_connections 2024-01-20T08:12:38.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.465+0000 7fb062a00640 1 -- 172.21.15.100:0/143941116 wait complete. 2024-01-20T08:12:38.486 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:12:38.533 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.uGA87eX8Mm 2024-01-20T08:12:38.533 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:38.534 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/tmp/tmp.uGA87eX8Mm 2024-01-20T08:12:38.584 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:38.584 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:38.679 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:38.679 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:38.727 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:38.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.975+0000 7fa8e2800640 1 Processor -- start 2024-01-20T08:12:38.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.975+0000 7fa8e2800640 1 -- start start 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8e2800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa8dc0a93c0 0x7fa8dc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8e2800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc0a9940 con 0x7fa8dc0aae00 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8e2800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8dc1500c0 con 0x7fa8dc14fce0 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8e2800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8dc156810 con 0x7fa8dc0a93c0 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8dbe00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa8dc0aae00 0x7fa8dc0ab2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39164/0 (socket says 172.21.15.100:39164) 2024-01-20T08:12:38.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.977+0000 7fa8dbe00640 1 -- 172.21.15.100:0/1524480804 learned_addr learned my addr 172.21.15.100:0/1524480804 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:38.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1524480804 >> v2:172.21.15.110:3300/0 conn(0x7fa8dc0a93c0 0x7fa8dc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113711930 0 0) 0x7fa8dc0a9940 con 0x7fa8dc0aae00 2024-01-20T08:12:38.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8bc003520 con 0x7fa8dc0aae00 2024-01-20T08:12:38.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 212322340 0 0) 0x7fa8bc003520 con 0x7fa8dc0aae00 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 >> v2:172.21.15.110:3300/0 conn(0x7fa8dc0a93c0 msgr2=0x7fa8dc153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 --2- 172.21.15.100:0/1524480804 >> v2:172.21.15.110:3300/0 conn(0x7fa8dc0a93c0 0x7fa8dc153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 >> v1:172.21.15.110:6789/0 conn(0x7fa8dc14fce0 legacy=0x7fa8dc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc156af0 con 0x7fa8dc0aae00 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fa8d40019f0 con 0x7fa8dc0aae00 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 >> v1:172.21.15.100:6789/0 conn(0x7fa8dc0aae00 legacy=0x7fa8dc0ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8bc003970 0x7fa8bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 0x7fa8bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc156810 con 0x7fa8bc0047c0 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc00c020 con 0x7fa8bc005180 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.978+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc00c1e0 con 0x7fa8bc003970 2024-01-20T08:12:38.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 0x7fa8bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8db400640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8bc003970 0x7fa8bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 -- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8bc003970 msgr2=0x7fa8bc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8dbe00640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8bc003970 0x7fa8bc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 -- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc005180 msgr2=0x7fa8bc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc005180 0x7fa8bc00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8daa00640 1 -- 172.21.15.100:0/1524480804 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc003520 con 0x7fa8bc0047c0 2024-01-20T08:12:38.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.979+0000 7fa8dbe00640 1 -- 172.21.15.100:0/1524480804 reap_dead start 2024-01-20T08:12:38.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.980+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 0x7fa8bc004c40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009ac0 tx=0x7fa8bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10d80be86c8bbda3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.980+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c402c6b0 con 0x7fa8bc0047c0 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.980+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c402c810 con 0x7fa8bc0047c0 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.980+0000 7fa8da000640 1 -- 172.21.15.100:0/1524480804 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c402cba0 con 0x7fa8bc0047c0 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 -- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 msgr2=0x7fa8bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 0x7fa8bc004c40 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4009ac0 tx=0x7fa8bc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 -- 172.21.15.100:0/1524480804 shutdown_connections 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1524480804 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8bc0047c0 0x7fa8bc004c40 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 -- 172.21.15.100:0/1524480804 >> 172.21.15.100:0/1524480804 conn(0x7fa8dc06a5e0 msgr2=0x7fa8dc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 -- 172.21.15.100:0/1524480804 shutdown_connections 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.981+0000 7fa8e2800640 1 -- 172.21.15.100:0/1524480804 wait complete. 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.983+0000 7fa8e2800640 1 Processor -- start 2024-01-20T08:12:38.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.983+0000 7fa8e2800640 1 -- start start 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc0047c0 0x7fa8dc14cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8dc1e6d10 0x7fa8dc149880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c2d00 con 0x7fa8dc070270 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc1e60a0 con 0x7fa8bc0047c0 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8e2800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8dc0c17e0 con 0x7fa8dc1e6d10 2024-01-20T08:12:38.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42632/0 (socket says 172.21.15.100:42632) 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 -- 172.21.15.100:0/1712244650 learned_addr learned my addr 172.21.15.100:0/1712244650 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8dbe00640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8dc1e6d10 0x7fa8dc149880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 -- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8dc1e6d10 msgr2=0x7fa8dc149880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8db400640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc0047c0 0x7fa8dc14cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8dc1e6d10 0x7fa8dc149880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 -- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc0047c0 msgr2=0x7fa8dc14cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc0047c0 0x7fa8dc14cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.984+0000 7fa8daa00640 1 -- 172.21.15.100:0/1712244650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8dc1e6340 con 0x7fa8dc070270 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8daa00640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4037040 tx=0x7fa8c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003810 con 0x7fa8dc070270 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c4003970 con 0x7fa8dc070270 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c4003d20 con 0x7fa8dc070270 2024-01-20T08:12:38.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8dc14a560 con 0x7fa8dc070270 2024-01-20T08:12:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.985+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8dc14d520 con 0x7fa8dc070270 2024-01-20T08:12:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.986+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8dc1e64d0 con 0x7fa8dc070270 2024-01-20T08:12:38.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.987+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa8c4034440 con 0x7fa8dc070270 2024-01-20T08:12:38.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.988+0000 7fa8d3400640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 0x7fa8b406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:38.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.988+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa8c40ab890 con 0x7fa8dc070270 2024-01-20T08:12:38.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.988+0000 7fa8db400640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 0x7fa8b406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:38.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.989+0000 7fa8db400640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 0x7fa8b406d3c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:38.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:38.993+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa8c40764a0 con 0x7fa8dc070270 2024-01-20T08:12:39.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.194+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8dc0c2c60 con 0x7fa8dc070270 2024-01-20T08:12:39.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.198+0000 7fa8d3400640 1 -- 172.21.15.100:0/1712244650 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7fa8c40044e0 con 0x7fa8dc070270 2024-01-20T08:12:39.202 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:39.202 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 msgr2=0x7fa8b406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 0x7fa8b406d3c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc007fd0 tx=0x7fa8cc009040 comp rx=0 tx=0).stop 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 msgr2=0x7fa8dc1e67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa8c4037040 tx=0x7fa8c4004730 comp rx=0 tx=0).stop 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 shutdown_connections 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa8b406af00 0x7fa8b406d3c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa8dc1e6d10 0x7fa8dc149880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa8dc070270 0x7fa8dc1e67d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 --2- 172.21.15.100:0/1712244650 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa8bc0047c0 0x7fa8dc14cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 >> 172.21.15.100:0/1712244650 conn(0x7fa8dc06a5e0 msgr2=0x7fa8dc150810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 shutdown_connections 2024-01-20T08:12:39.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.201+0000 7fa8e2800640 1 -- 172.21.15.100:0/1712244650 wait complete. 2024-01-20T08:12:39.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:12:04.385777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:12:05.510105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:12:24.716271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:12:25.562320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:39.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:39.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.428+0000 7f866dc00640 1 Processor -- start 2024-01-20T08:12:39.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.428+0000 7f866dc00640 1 -- start start 2024-01-20T08:12:39.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.429+0000 7f866dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86680a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.429+0000 7f866dc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86680a5240 0x7f86680c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866dc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8668156710 con 0x7f86680c4ed0 2024-01-20T08:12:39.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866dc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866814fff0 con 0x7f86680a5240 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8668072d10 con 0x7f866814fc10 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86680a5240 0x7f86680c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f86680a5240 0x7f86680c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42644/0 (socket says 172.21.15.100:42644) 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866d200640 1 -- 172.21.15.100:0/438191222 learned_addr learned my addr 172.21.15.100:0/438191222 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f8667e00640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86680a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866d200640 1 -- 172.21.15.100:0/438191222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 msgr2=0x7f86680a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.430+0000 7f866d200640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86680a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.431+0000 7f866d200640 1 -- 172.21.15.100:0/438191222 >> v1:172.21.15.110:6789/0 conn(0x7f86680c4ed0 legacy=0x7f86680c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.431+0000 7f866d200640 1 -- 172.21.15.100:0/438191222 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8668155b00 con 0x7f86680a5240 2024-01-20T08:12:39.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.432+0000 7f866d200640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86680c41b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8660009e50 tx=0x7f866002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc1895ff741ae3a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.432+0000 7f8666a00640 1 -- 172.21.15.100:0/438191222 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f866002ca70 con 0x7f86680a5240 2024-01-20T08:12:39.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.432+0000 7f8666a00640 1 -- 172.21.15.100:0/438191222 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f866002cbd0 con 0x7f86680a5240 2024-01-20T08:12:39.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.432+0000 7f8666a00640 1 -- 172.21.15.100:0/438191222 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86600343f0 con 0x7f86680a5240 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 -- 172.21.15.100:0/438191222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 msgr2=0x7f86680c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86680c41b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f8660009e50 tx=0x7f866002bed0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 -- 172.21.15.100:0/438191222 shutdown_connections 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86680c41b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 --2- 172.21.15.100:0/438191222 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86680a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 -- 172.21.15.100:0/438191222 >> 172.21.15.100:0/438191222 conn(0x7f86680c5ba0 msgr2=0x7f86680c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 -- 172.21.15.100:0/438191222 shutdown_connections 2024-01-20T08:12:39.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.433+0000 7f866dc00640 1 -- 172.21.15.100:0/438191222 wait complete. 2024-01-20T08:12:39.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.435+0000 7f866dc00640 1 Processor -- start 2024-01-20T08:12:39.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.435+0000 7f866dc00640 1 -- start start 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86680c4ed0 0x7f866806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86681eb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8668152b40 con 0x7f86680a5240 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86681eaee0 con 0x7f86680c4ed0 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f866dc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8668154040 con 0x7f866814fc10 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42658/0 (socket says 172.21.15.100:42658) 2024-01-20T08:12:39.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 -- 172.21.15.100:0/3659996587 learned_addr learned my addr 172.21.15.100:0/3659996587 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:39.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 -- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 msgr2=0x7f86681eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86681eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 -- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86680c4ed0 msgr2=0x7f866806cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86680c4ed0 0x7f866806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.436+0000 7f8667e00640 1 -- 172.21.15.100:0/3659996587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660009b30 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f8667e00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f865800d5d0 tx=0x7f865800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86580125f0 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8658012770 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658012b20 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866806d040 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.437+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866806d8e0 con 0x7f86680a5240 2024-01-20T08:12:39.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.438+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866804e970 con 0x7f86680a5240 2024-01-20T08:12:39.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.439+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8658012c80 con 0x7f86680a5240 2024-01-20T08:12:39.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.440+0000 7f865fe00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.441+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8658089eb0 con 0x7f86680a5240 2024-01-20T08:12:39.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.441+0000 7f8667400640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.441+0000 7f8667400640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 0x7f864006d3c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8650000f60 tx=0x7f86500079d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.445+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8658054a20 con 0x7f86680a5240 2024-01-20T08:12:39.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.639+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f86680c4cb0 con 0x7f86680a5240 2024-01-20T08:12:39.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.639+0000 7f865fe00640 1 -- 172.21.15.100:0/3659996587 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8658058040 con 0x7f86680a5240 2024-01-20T08:12:39.643 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 msgr2=0x7f864006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 0x7f864006d3c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8650000f60 tx=0x7f86500079d0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 msgr2=0x7f86681ea9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f865800d5d0 tx=0x7f865800da90 comp rx=0 tx=0).stop 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 shutdown_connections 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f864006af00 0x7f864006d3c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f866814fc10 0x7f86681eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f86680c4ed0 0x7f866806cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 --2- 172.21.15.100:0/3659996587 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f86680a5240 0x7f86681ea9a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 >> 172.21.15.100:0/3659996587 conn(0x7f86680c5ba0 msgr2=0x7f8668153860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:39.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 shutdown_connections 2024-01-20T08:12:39.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.642+0000 7f866dc00640 1 -- 172.21.15.100:0/3659996587 wait complete. 2024-01-20T08:12:39.662 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:12:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.874+0000 7f809da00640 1 Processor -- start 2024-01-20T08:12:39.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.874+0000 7f809da00640 1 -- start start 2024-01-20T08:12:39.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f809da00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f809814c750 0x7f8098153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f809da00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980ab620 con 0x7f80980ab0b0 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f809da00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80980ab900 con 0x7f80980715a0 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f809da00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f809814cb30 con 0x7f809814c750 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f808de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f80980ab0b0 0x7f80980a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54536/0 (socket says 172.21.15.100:54536) 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.875+0000 7f808de00640 1 -- 172.21.15.100:0/516271538 learned_addr learned my addr 172.21.15.100:0/516271538 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096a00640 1 --2- 172.21.15.100:0/516271538 >> v2:172.21.15.110:3300/0 conn(0x7f809814c750 0x7f8098153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2528471408 0 0) 0x7f80980ab620 con 0x7f80980ab0b0 2024-01-20T08:12:39.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8078003520 con 0x7f80980ab0b0 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 334050716 0 0) 0x7f8078003520 con 0x7f80980ab0b0 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 >> v2:172.21.15.110:3300/0 conn(0x7f809814c750 msgr2=0x7f8098153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 --2- 172.21.15.100:0/516271538 >> v2:172.21.15.110:3300/0 conn(0x7f809814c750 0x7f8098153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 >> v1:172.21.15.110:6789/0 conn(0x7f80980715a0 legacy=0x7f8098071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80980abbe0 con 0x7f80980ab0b0 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f80800019f0 con 0x7f80980ab0b0 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 >> v1:172.21.15.100:6789/0 conn(0x7f80980ab0b0 legacy=0x7f80980a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.876+0000 7f8096000640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80780039c0 0x7f8078003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8096000640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80780047c0 0x7f8078004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8096000640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f807800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809814cb30 con 0x7f8078005180 2024-01-20T08:12:39.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807800c080 con 0x7f80780039c0 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807800c240 con 0x7f80780047c0 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f807800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f808de00640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80780047c0 0x7f8078004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 -- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80780047c0 msgr2=0x7f8078004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80780047c0 0x7f8078004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 -- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80780039c0 msgr2=0x7f8078003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80780039c0 0x7f8078003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.877+0000 7f8097400640 1 -- 172.21.15.100:0/516271538 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8078003520 con 0x7f8078005180 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.878+0000 7f8097400640 1 -- 172.21.15.100:0/516271538 reap_dead start 2024-01-20T08:12:39.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.878+0000 7f8097400640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f807800b980 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8090001750 tx=0x7f80780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba1c58244d74a68 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80900052d0 con 0x7f8078005180 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809002e050 con 0x7f8078005180 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f8096000640 1 -- 172.21.15.100:0/516271538 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090003830 con 0x7f8078005180 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 -- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 msgr2=0x7f807800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f807800b980 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8090001750 tx=0x7f80780057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 -- 172.21.15.100:0/516271538 shutdown_connections 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 --2- 172.21.15.100:0/516271538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f807800b980 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 -- 172.21.15.100:0/516271538 >> 172.21.15.100:0/516271538 conn(0x7f80980c6090 msgr2=0x7f80980c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:39.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 -- 172.21.15.100:0/516271538 shutdown_connections 2024-01-20T08:12:39.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.879+0000 7f809da00640 1 -- 172.21.15.100:0/516271538 wait complete. 2024-01-20T08:12:39.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.881+0000 7f809da00640 1 Processor -- start 2024-01-20T08:12:39.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.881+0000 7f809da00640 1 -- start start 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80981e9ff0 0x7f809806bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80980bf730 0x7f80981479e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8098154ac0 con 0x7f8078005180 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f809806df70 con 0x7f80981e9ff0 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f809da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8098156010 con 0x7f80980bf730 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f8096a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f8096a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42666/0 (socket says 172.21.15.100:42666) 2024-01-20T08:12:39.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.882+0000 7f8096a00640 1 -- 172.21.15.100:0/2694151640 learned_addr learned my addr 172.21.15.100:0/2694151640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:39.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f808de00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80981e9ff0 0x7f809806bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8097400640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80980bf730 0x7f80981479e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 -- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80980bf730 msgr2=0x7f80981479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80980bf730 0x7f80981479e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 -- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80981e9ff0 msgr2=0x7f809806bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80981e9ff0 0x7f809806bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 -- 172.21.15.100:0/2694151640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f809806c480 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f8096a00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f808800e7d0 tx=0x7f808800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.883+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800eee0 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.884+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808800c940 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.884+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808800ccd0 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.884+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8098154d10 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.884+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80981552d0 con 0x7f8078005180 2024-01-20T08:12:39.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.885+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809804ea50 con 0x7f8078005180 2024-01-20T08:12:39.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.886+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8088013470 con 0x7f8078005180 2024-01-20T08:12:39.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.886+0000 7f808f400640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 0x7f807006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:39.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.886+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f8088089980 con 0x7f8078005180 2024-01-20T08:12:39.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.887+0000 7f808de00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 0x7f807006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:39.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.887+0000 7f808de00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 0x7f807006d3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f809814daa0 tx=0x7f8080009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:39.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:39.891+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8088054580 con 0x7f8078005180 2024-01-20T08:12:40.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.085+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f80980702b0 con 0x7f8078005180 2024-01-20T08:12:40.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.086+0000 7f808f400640 1 -- 172.21.15.100:0/2694151640 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8088057ba0 con 0x7f8078005180 2024-01-20T08:12:40.089 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.088+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 msgr2=0x7f807006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.088+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 0x7f807006d3c0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f809814daa0 tx=0x7f8080009040 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 msgr2=0x7f8098155ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f808800e7d0 tx=0x7f808800ec90 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 shutdown_connections 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f807006af00 0x7f807006d3c0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80980bf730 0x7f80981479e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80981e9ff0 0x7f809806bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 --2- 172.21.15.100:0/2694151640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8078005180 0x7f8098155ad0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 >> 172.21.15.100:0/2694151640 conn(0x7f80980c6090 msgr2=0x7f80980c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:40.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 shutdown_connections 2024-01-20T08:12:40.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.089+0000 7f809da00640 1 -- 172.21.15.100:0/2694151640 wait complete. 2024-01-20T08:12:40.111 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:12:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.309+0000 7f747ae00640 1 Processor -- start 2024-01-20T08:12:40.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.309+0000 7f747ae00640 1 -- start start 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f747ae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f74740c3460 0x7f7474152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f747ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 0x7f747415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f747ae00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7474150190 con 0x7f747414fdb0 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f747ae00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74740a9ce0 con 0x7f74740c3460 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f747ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74740a93b0 con 0x7f7474153120 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f7473e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f747414fdb0 0x7f74740c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54550/0 (socket says 172.21.15.100:54550) 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f7473e00640 1 -- 172.21.15.100:0/3426408557 learned_addr learned my addr 172.21.15.100:0/3426408557 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:40.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f746be00640 1 --2- 172.21.15.100:0/3426408557 >> v2:172.21.15.100:3300/0 conn(0x7f74740c3460 0x7f7474152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f7478e00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 0x7f747415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f746be00640 1 -- 172.21.15.100:0/3426408557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 msgr2=0x7f747415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f746be00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 0x7f747415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f7473400640 1 -- 172.21.15.100:0/3426408557 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3336915734 0 0) 0x7f7474150190 con 0x7f747414fdb0 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f746be00640 1 -- 172.21.15.100:0/3426408557 >> v1:172.21.15.100:6789/0 conn(0x7f747414fdb0 legacy=0x7f74740c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f746be00640 1 -- 172.21.15.100:0/3426408557 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74741535b0 con 0x7f74740c3460 2024-01-20T08:12:40.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.311+0000 7f7478e00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 0x7f747415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f746be00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f7474152be0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097a0 tx=0x7f745c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aa14c549ce90bc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f7473400640 1 -- 172.21.15.100:0/3426408557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c031830 con 0x7f74740c3460 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f7473400640 1 -- 172.21.15.100:0/3426408557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c031990 con 0x7f74740c3460 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f7473400640 1 -- 172.21.15.100:0/3426408557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745c031d20 con 0x7f74740c3460 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f747ae00640 1 -- 172.21.15.100:0/3426408557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 msgr2=0x7f7474152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.313+0000 7f747ae00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f7474152be0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f745c0097a0 tx=0x7f745c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 -- 172.21.15.100:0/3426408557 shutdown_connections 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7474153120 0x7f747415cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 --2- 172.21.15.100:0/3426408557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f7474152be0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 -- 172.21.15.100:0/3426408557 >> 172.21.15.100:0/3426408557 conn(0x7f74740c2940 msgr2=0x7f74740c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 -- 172.21.15.100:0/3426408557 shutdown_connections 2024-01-20T08:12:40.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.314+0000 7f747ae00640 1 -- 172.21.15.100:0/3426408557 wait complete. 2024-01-20T08:12:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.315+0000 7f747ae00640 1 Processor -- start 2024-01-20T08:12:40.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 -- start start 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f747414fdb0 0x7f74741518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7474153120 0x7f74741ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741ee580 con 0x7f74740c3460 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74741555e0 con 0x7f7474153120 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.316+0000 7f747ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74741563f0 con 0x7f747414fdb0 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42688/0 (socket says 172.21.15.100:42688) 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 -- 172.21.15.100:0/3931258267 learned_addr learned my addr 172.21.15.100:0/3931258267 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 -- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f747414fdb0 msgr2=0x7f74741518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f747414fdb0 0x7f74741518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 -- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7474153120 msgr2=0x7f74741ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7474153120 0x7f74741ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 -- 172.21.15.100:0/3931258267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c009400 con 0x7f74740c3460 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.317+0000 7f7473e00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f746400c4d0 tx=0x7f746400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.318+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74640074e0 con 0x7f74740c3460 2024-01-20T08:12:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.318+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7464007660 con 0x7f74740c3460 2024-01-20T08:12:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.318+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7464004a20 con 0x7f74740c3460 2024-01-20T08:12:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.318+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7474156be0 con 0x7f74740c3460 2024-01-20T08:12:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.318+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7474150f50 con 0x7f74740c3460 2024-01-20T08:12:40.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.319+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7474150d20 con 0x7f74740c3460 2024-01-20T08:12:40.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.320+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7464004b80 con 0x7f74740c3460 2024-01-20T08:12:40.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.321+0000 7f7470c00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 0x7f744c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.321+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7464088990 con 0x7f74740c3460 2024-01-20T08:12:40.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.321+0000 7f746be00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 0x7f744c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.322+0000 7f746be00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 0x7f744c06d390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f745c036000 tx=0x7f745c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.325+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7474150d20 con 0x7f74740c3460 2024-01-20T08:12:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.516+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7474150d20 con 0x7f74740c3460 2024-01-20T08:12:40.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.517+0000 7f7470c00640 1 -- 172.21.15.100:0/3931258267 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7474150d20 con 0x7f74740c3460 2024-01-20T08:12:40.520 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.519+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 msgr2=0x7f744c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.519+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 0x7f744c06d390 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f745c036000 tx=0x7f745c030000 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.519+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 msgr2=0x7f747406d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.519+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f746400c4d0 tx=0x7f746400c990 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 shutdown_connections 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7474153120 0x7f74741ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f744c06aed0 0x7f744c06d390 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f747414fdb0 0x7f74741518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 --2- 172.21.15.100:0/3931258267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f74740c3460 0x7f747406d570 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 >> 172.21.15.100:0/3931258267 conn(0x7f74740c2940 msgr2=0x7f74740bf270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 shutdown_connections 2024-01-20T08:12:40.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.520+0000 7f747ae00640 1 -- 172.21.15.100:0/3931258267 wait complete. 2024-01-20T08:12:40.542 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:12:40.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.753+0000 7fe37c000640 1 Processor -- start 2024-01-20T08:12:40.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.753+0000 7fe37c000640 1 -- start start 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe37c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe3740c1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe37c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe374071a30 con 0x7fe3740bf4c0 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe37c000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3740c0b30 con 0x7fe37413dcc0 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe37c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740707d0 con 0x7fe3740bf900 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe378c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe3740bf4c0 0x7fe3740c1610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54562/0 (socket says 172.21.15.100:54562) 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe378c00640 1 -- 172.21.15.100:0/1373629480 learned_addr learned my addr 172.21.15.100:0/1373629480 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:40.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.755+0000 7fe37a000640 1 --2- 172.21.15.100:0/1373629480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe3740c1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.756+0000 7fe373e00640 1 -- 172.21.15.100:0/1373629480 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162575874 0 0) 0x7fe374071a30 con 0x7fe3740bf4c0 2024-01-20T08:12:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.756+0000 7fe373e00640 1 -- 172.21.15.100:0/1373629480 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe354003520 con 0x7fe3740bf4c0 2024-01-20T08:12:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.756+0000 7fe37a000640 1 -- 172.21.15.100:0/1373629480 >> v1:172.21.15.110:6789/0 conn(0x7fe37413dcc0 legacy=0x7fe374071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.756+0000 7fe37a000640 1 -- 172.21.15.100:0/1373629480 >> v1:172.21.15.100:6789/0 conn(0x7fe3740bf4c0 legacy=0x7fe3740c1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.756+0000 7fe37a000640 1 -- 172.21.15.100:0/1373629480 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3740c0e10 con 0x7fe3740bf900 2024-01-20T08:12:40.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.757+0000 7fe37a000640 1 --2- 172.21.15.100:0/1373629480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe3740c1d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009dc0 tx=0x7fe36c02bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89233572a8c6ee7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe373e00640 1 -- 172.21.15.100:0/1373629480 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c02ccc0 con 0x7fe3740bf900 2024-01-20T08:12:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe373e00640 1 -- 172.21.15.100:0/1373629480 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c02ce20 con 0x7fe3740bf900 2024-01-20T08:12:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe373e00640 1 -- 172.21.15.100:0/1373629480 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c034640 con 0x7fe3740bf900 2024-01-20T08:12:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe37c000640 1 -- 172.21.15.100:0/1373629480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 msgr2=0x7fe3740c1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe37c000640 1 --2- 172.21.15.100:0/1373629480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe3740c1d20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009dc0 tx=0x7fe36c02bf10 comp rx=0 tx=0).stop 2024-01-20T08:12:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe37c000640 1 -- 172.21.15.100:0/1373629480 shutdown_connections 2024-01-20T08:12:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.758+0000 7fe37c000640 1 --2- 172.21.15.100:0/1373629480 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe3740c1d20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.759+0000 7fe37c000640 1 -- 172.21.15.100:0/1373629480 >> 172.21.15.100:0/1373629480 conn(0x7fe3740c6090 msgr2=0x7fe3740c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.759+0000 7fe37c000640 1 -- 172.21.15.100:0/1373629480 shutdown_connections 2024-01-20T08:12:40.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.759+0000 7fe37c000640 1 -- 172.21.15.100:0/1373629480 wait complete. 2024-01-20T08:12:40.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.761+0000 7fe37c000640 1 Processor -- start 2024-01-20T08:12:40.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.761+0000 7fe37c000640 1 -- start start 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 0x7fe3741ee3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe37413c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741ee8f0 con 0x7fe37413dcc0 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3741ebd20 con 0x7fe3740bf4c0 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3740c5e80 con 0x7fe3740bf900 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42702/0 (socket says 172.21.15.100:42702) 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.762+0000 7fe37a000640 1 -- 172.21.15.100:0/597782180 learned_addr learned my addr 172.21.15.100:0/597782180 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe379600640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 0x7fe3741ee3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe378c00640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe37413c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 -- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 msgr2=0x7fe37413c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe37413c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 -- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 msgr2=0x7fe3741ee3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 0x7fe3741ee3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 -- 172.21.15.100:0/597782180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe36c009a70 con 0x7fe37413dcc0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe379600640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 0x7fe3741ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe378c00640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe37413c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37a000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe36c037040 tx=0x7fe36c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c003b90 con 0x7fe37413dcc0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c003cf0 con 0x7fe37413dcc0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c003ea0 con 0x7fe37413dcc0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.763+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3740c58c0 con 0x7fe37413dcc0 2024-01-20T08:12:40.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.764+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3741eb9b0 con 0x7fe37413dcc0 2024-01-20T08:12:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.765+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3741ebb70 con 0x7fe37413dcc0 2024-01-20T08:12:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.766+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe36c004230 con 0x7fe37413dcc0 2024-01-20T08:12:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.766+0000 7fe371600640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 0x7fe34c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:40.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.767+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe36c0ac3c0 con 0x7fe37413dcc0 2024-01-20T08:12:40.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.767+0000 7fe379600640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 0x7fe34c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:40.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.767+0000 7fe379600640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 0x7fe34c06d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe3640015e0 tx=0x7fe364009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:40.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.772+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe36c077040 con 0x7fe37413dcc0 2024-01-20T08:12:40.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.969+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe3741ebe90 con 0x7fe37413dcc0 2024-01-20T08:12:40.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.970+0000 7fe371600640 1 -- 172.21.15.100:0/597782180 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe36c009450 con 0x7fe37413dcc0 2024-01-20T08:12:40.973 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 msgr2=0x7fe34c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 0x7fe34c06d390 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe3640015e0 tx=0x7fe364009040 comp rx=0 tx=0).stop 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 msgr2=0x7fe374151400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fe36c037040 tx=0x7fe36c004ab0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 shutdown_connections 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe37413dcc0 0x7fe374151400 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe34c06aed0 0x7fe34c06d390 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3740bf900 0x7fe37413c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 --2- 172.21.15.100:0/597782180 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3740bf4c0 0x7fe3741ee3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:40.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 >> 172.21.15.100:0/597782180 conn(0x7fe3740c6090 msgr2=0x7fe3740c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:40.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 shutdown_connections 2024-01-20T08:12:40.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:40.973+0000 7fe37c000640 1 -- 172.21.15.100:0/597782180 wait complete. 2024-01-20T08:12:40.996 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:12:41.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.205+0000 7f2cfc400640 1 Processor -- start 2024-01-20T08:12:41.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.205+0000 7f2cfc400640 1 -- start start 2024-01-20T08:12:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cf414fdb0 0x7f2cf40c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cf40c3460 0x7f2cf4153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40a9ce0 con 0x7f2cf40c3460 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40a93b0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.206+0000 7f2cfc400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4152790 con 0x7f2cf40c1d90 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cf40c3460 0x7f2cf4153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cf40c3460 0x7f2cf4153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42704/0 (socket says 172.21.15.100:42704) 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 -- 172.21.15.100:0/4240606853 learned_addr learned my addr 172.21.15.100:0/4240606853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:41.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 -- 172.21.15.100:0/4240606853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 msgr2=0x7f2cf4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 --2- 172.21.15.100:0/4240606853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 -- 172.21.15.100:0/4240606853 >> v2:172.21.15.110:3300/0 conn(0x7f2cf414fdb0 msgr2=0x7f2cf40c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 --2- 172.21.15.100:0/4240606853 >> v2:172.21.15.110:3300/0 conn(0x7f2cf414fdb0 0x7f2cf40c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.207+0000 7f2cfa400640 1 -- 172.21.15.100:0/4240606853 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf4150190 con 0x7f2cf40c3460 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.208+0000 7f2cfa400640 1 --2- 172.21.15.100:0/4240606853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf40c3460 0x7f2cf4153120 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2cf406e580 tx=0x7f2cec02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb668dece67d0f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cf3e00640 1 -- 172.21.15.100:0/4240606853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec02ca70 con 0x7f2cf40c3460 2024-01-20T08:12:41.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cf3e00640 1 -- 172.21.15.100:0/4240606853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec02cbd0 con 0x7f2cf40c3460 2024-01-20T08:12:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cf3e00640 1 -- 172.21.15.100:0/4240606853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0343f0 con 0x7f2cf40c3460 2024-01-20T08:12:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 -- 172.21.15.100:0/4240606853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf40c3460 msgr2=0x7f2cf4153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 --2- 172.21.15.100:0/4240606853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf40c3460 0x7f2cf4153120 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f2cf406e580 tx=0x7f2cec02bed0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 -- 172.21.15.100:0/4240606853 shutdown_connections 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 --2- 172.21.15.100:0/4240606853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf40c3460 0x7f2cf4153120 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 --2- 172.21.15.100:0/4240606853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 --2- 172.21.15.100:0/4240606853 >> v2:172.21.15.110:3300/0 conn(0x7f2cf414fdb0 0x7f2cf40c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 -- 172.21.15.100:0/4240606853 >> 172.21.15.100:0/4240606853 conn(0x7f2cf40c2940 msgr2=0x7f2cf40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 -- 172.21.15.100:0/4240606853 shutdown_connections 2024-01-20T08:12:41.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.209+0000 7f2cfc400640 1 -- 172.21.15.100:0/4240606853 wait complete. 2024-01-20T08:12:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.211+0000 7f2cfc400640 1 Processor -- start 2024-01-20T08:12:41.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.211+0000 7f2cfc400640 1 -- start start 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf40c0e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 0x7f2cf4150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf41545b0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf414aef0 con 0x7f2cf40c3460 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfc400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf414c0f0 con 0x7f2cf40c1d90 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.212+0000 7f2cfa400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42708/0 (socket says 172.21.15.100:42708) 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 -- 172.21.15.100:0/2998460637 learned_addr learned my addr 172.21.15.100:0/2998460637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cf9a00640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf40c0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cf9000640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 0x7f2cf4150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 -- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 msgr2=0x7f2cf40c0e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf40c0e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 -- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 msgr2=0x7f2cf4150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 0x7f2cf4150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 -- 172.21.15.100:0/2998460637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec009b30 con 0x7f2cf414fdb0 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cf9a00640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf40c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cf9000640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 0x7f2cf4150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:41.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.213+0000 7f2cfa400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2cec036040 tx=0x7f2cec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.214+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec009510 con 0x7f2cf414fdb0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.214+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cec03e450 con 0x7f2cf414fdb0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.214+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec03e7c0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.214+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf414bb50 con 0x7f2cf414fdb0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.214+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf414be10 con 0x7f2cf414fdb0 2024-01-20T08:12:41.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.215+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf414acc0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.216+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2cec03e920 con 0x7f2cf414fdb0 2024-01-20T08:12:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.217+0000 7f2cf1600640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 0x7f2ccc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.217+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f2cec0ac4d0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.218+0000 7f2cf9a00640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 0x7f2ccc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.218+0000 7f2cf9a00640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 0x7f2ccc06d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a870 tx=0x7f2ce4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.222+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2cf414acc0 con 0x7f2cf414fdb0 2024-01-20T08:12:41.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.414+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f2cf414b060 con 0x7f2cf414fdb0 2024-01-20T08:12:41.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.415+0000 7f2cf1600640 1 -- 172.21.15.100:0/2998460637 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7f2cf414b060 con 0x7f2cf414fdb0 2024-01-20T08:12:41.418 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:41.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.417+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 msgr2=0x7f2ccc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.417+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 0x7f2ccc06d3c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400a870 tx=0x7f2ce4008040 comp rx=0 tx=0).stop 2024-01-20T08:12:41.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.417+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 msgr2=0x7f2cf4150ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.417+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f2cec036040 tx=0x7f2cec004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:41.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 shutdown_connections 2024-01-20T08:12:41.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cf414fdb0 0x7f2cf4150ad0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cf40c3460 0x7f2cf4150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ccc06af00 0x7f2ccc06d3c0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 --2- 172.21.15.100:0/2998460637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cf40c1d90 0x7f2cf40c0e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 >> 172.21.15.100:0/2998460637 conn(0x7f2cf40c2940 msgr2=0x7f2cf40c02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:41.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 shutdown_connections 2024-01-20T08:12:41.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.418+0000 7f2cfc400640 1 -- 172.21.15.100:0/2998460637 wait complete. 2024-01-20T08:12:41.438 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:12:41.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.643+0000 7f7ffb200640 1 Processor -- start 2024-01-20T08:12:41.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.643+0000 7f7ffb200640 1 -- start start 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7ffc0c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ffb200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc156710 con 0x7f7ffc14fc10 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ffb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ffc155b00 con 0x7f7ffc0c4ed0 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ffb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc14fff0 con 0x7f7ffc0aa330 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ff9e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7ffc14fc10 0x7f7ffc0a4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54566/0 (socket says 172.21.15.100:54566) 2024-01-20T08:12:41.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ff9e00640 1 -- 172.21.15.100:0/2078264742 learned_addr learned my addr 172.21.15.100:0/2078264742 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.645+0000 7f7ffa800640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7ffc0c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030483127 0 0) 0x7f7ffc156710 con 0x7f7ffc14fc10 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7fdc003520 con 0x7f7ffc14fc10 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2283880455 0 0) 0x7f7fdc003520 con 0x7f7ffc14fc10 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 msgr2=0x7f7ffc0c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7ffc0c41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 >> v1:172.21.15.110:6789/0 conn(0x7f7ffc0c4ed0 legacy=0x7f7ffc0c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc155de0 con 0x7f7ffc14fc10 2024-01-20T08:12:41.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7fec001670 con 0x7f7ffc14fc10 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 >> v1:172.21.15.100:6789/0 conn(0x7f7ffc14fc10 legacy=0x7f7ffc0a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7fdc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fdc003f70 0x7f7fdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7fdc005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc14fff0 con 0x7f7fdc004d00 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc00bc10 con 0x7f7fdc003f70 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.646+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fdc00bdd0 con 0x7f7ffc0aa330 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7fdc005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ff9e00640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7fdc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 -- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 msgr2=0x7f7fdc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc0aa330 0x7f7fdc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 -- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fdc003f70 msgr2=0x7f7fdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ff3e00640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fdc003f70 0x7f7fdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fdc003f70 0x7f7fdc0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.647+0000 7f7ffa800640 1 -- 172.21.15.100:0/2078264742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fdc003520 con 0x7f7fdc004d00 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.648+0000 7f7ffa800640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7fdc005160 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009fa0 tx=0x7f7fdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349038157e63efee server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.648+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff402ccb0 con 0x7f7fdc004d00 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.648+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400f040 con 0x7f7fdc004d00 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.648+0000 7f7ff9400640 1 -- 172.21.15.100:0/2078264742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4034660 con 0x7f7fdc004d00 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 -- 172.21.15.100:0/2078264742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 msgr2=0x7f7fdc005160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 --2- 172.21.15.100:0/2078264742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7fdc005160 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009fa0 tx=0x7f7fdc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffa800640 1 -- 172.21.15.100:0/2078264742 reap_dead start 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 -- 172.21.15.100:0/2078264742 shutdown_connections 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 -- 172.21.15.100:0/2078264742 >> 172.21.15.100:0/2078264742 conn(0x7f7ffc0c5ba0 msgr2=0x7f7ffc0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 -- 172.21.15.100:0/2078264742 shutdown_connections 2024-01-20T08:12:41.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.649+0000 7f7ffb200640 1 -- 172.21.15.100:0/2078264742 wait complete. 2024-01-20T08:12:41.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.651+0000 7f7ffb200640 1 Processor -- start 2024-01-20T08:12:41.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.651+0000 7f7ffb200640 1 -- start start 2024-01-20T08:12:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc1eab90 0x7f7ffc1544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ffc0a7210 0x7f7ffc154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc1ea700 con 0x7f7fdc004d00 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc1e9e30 con 0x7f7ffc0a7210 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ffb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc1ed540 con 0x7f7ffc1eab90 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ff9e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42730/0 (socket says 172.21.15.100:42730) 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.652+0000 7f7ff9e00640 1 -- 172.21.15.100:0/3546371193 learned_addr learned my addr 172.21.15.100:0/3546371193 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff3e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc1eab90 0x7f7ffc1544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 -- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc1eab90 msgr2=0x7f7ffc1544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc1eab90 0x7f7ffc1544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 -- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ffc0a7210 msgr2=0x7f7ffc154a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ffc0a7210 0x7f7ffc154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 -- 172.21.15.100:0/3546371193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ffc1ea0b0 con 0x7f7fdc004d00 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff9e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00e7b0 tx=0x7f7fec00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00ee60 con 0x7f7fdc004d00 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fec00c850 con 0x7f7fdc004d00 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fec00cc20 con 0x7f7fdc004d00 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc1ea390 con 0x7f7fdc004d00 2024-01-20T08:12:41.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.653+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc155860 con 0x7f7fdc004d00 2024-01-20T08:12:41.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.655+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc04e970 con 0x7f7fdc004d00 2024-01-20T08:12:41.659 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.656+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7fec01d460 con 0x7f7fdc004d00 2024-01-20T08:12:41.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.657+0000 7f7ff2000640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 0x7f7fd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:41.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.657+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7fec089920 con 0x7f7fdc004d00 2024-01-20T08:12:41.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.657+0000 7f7ff3e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 0x7f7fd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:41.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.658+0000 7f7ff3e00640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 0x7f7fd406d390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc067820 tx=0x7f7fe4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:41.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.662+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fec057fb0 con 0x7f7fdc004d00 2024-01-20T08:12:41.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.865+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ffc0c2e30 con 0x7f7fdc004d00 2024-01-20T08:12:41.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.866+0000 7f7ff2000640 1 -- 172.21.15.100:0/3546371193 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7fec057b40 con 0x7f7fdc004d00 2024-01-20T08:12:41.869 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.868+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 msgr2=0x7f7fd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.868+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 0x7f7fd406d390 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc067820 tx=0x7f7fe4009040 comp rx=0 tx=0).stop 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.868+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 msgr2=0x7f7ffc06d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.868+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00e7b0 tx=0x7f7fec00ec70 comp rx=0 tx=0).stop 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 shutdown_connections 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7ffc0a7210 0x7f7ffc154a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fd406aed0 0x7f7fd406d390 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7ffc1eab90 0x7f7ffc1544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 --2- 172.21.15.100:0/3546371193 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fdc004d00 0x7f7ffc06d1b0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 >> 172.21.15.100:0/3546371193 conn(0x7f7ffc0c5ba0 msgr2=0x7f7ffc14e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 shutdown_connections 2024-01-20T08:12:41.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:41.869+0000 7f7ffb200640 1 -- 172.21.15.100:0/3546371193 wait complete. 2024-01-20T08:12:41.891 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T08:12:41.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:41.891 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:41.980 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:12:41.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:41.980 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T08:12:42.028 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:42.028 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:42.119 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:12:42.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:12:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.367+0000 7fd6bce00640 1 Processor -- start 2024-01-20T08:12:42.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.367+0000 7fd6bce00640 1 -- start start 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.368+0000 7fd6bce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 0x7fd6b806c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.368+0000 7fd6bce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6b806ce10 0x7fd6b806d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.368+0000 7fd6bce00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6b8154ba0 con 0x7fd6b814b720 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.368+0000 7fd6bce00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b814bb00 con 0x7fd6b806ce10 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.368+0000 7fd6bce00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6b8155a00 con 0x7fd6b81515b0 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6b806ce10 0x7fd6b806d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6b806ce10 0x7fd6b806d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42746/0 (socket says 172.21.15.100:42746) 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 -- 172.21.15.100:0/1574764857 learned_addr learned my addr 172.21.15.100:0/1574764857 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b5400640 1 --2- 172.21.15.100:0/1574764857 >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 0x7fd6b806c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:42.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 -- 172.21.15.100:0/1574764857 >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 msgr2=0x7fd6b806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 --2- 172.21.15.100:0/1574764857 >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 0x7fd6b806c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 -- 172.21.15.100:0/1574764857 >> v1:172.21.15.110:6789/0 conn(0x7fd6b814b720 legacy=0x7fd6b80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b6800640 1 -- 172.21.15.100:0/1574764857 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8154df0 con 0x7fd6b806ce10 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.369+0000 7fd6b5400640 1 --2- 172.21.15.100:0/1574764857 >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 0x7fd6b806c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.370+0000 7fd6b6800640 1 --2- 172.21.15.100:0/1574764857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b806ce10 0x7fd6b806d210 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ac030 tx=0x7fd6b002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb47d6c685d126 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.370+0000 7fd6b4a00640 1 -- 172.21.15.100:0/1574764857 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b002c9f0 con 0x7fd6b806ce10 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6b4a00640 1 -- 172.21.15.100:0/1574764857 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b002cb50 con 0x7fd6b806ce10 2024-01-20T08:12:42.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6b4a00640 1 -- 172.21.15.100:0/1574764857 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00343f0 con 0x7fd6b806ce10 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 -- 172.21.15.100:0/1574764857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b806ce10 msgr2=0x7fd6b806d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1574764857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b806ce10 0x7fd6b806d210 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fd6b80ac030 tx=0x7fd6b002be50 comp rx=0 tx=0).stop 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 -- 172.21.15.100:0/1574764857 shutdown_connections 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1574764857 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b806ce10 0x7fd6b806d210 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1574764857 >> v2:172.21.15.110:3300/0 conn(0x7fd6b81515b0 0x7fd6b806c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 -- 172.21.15.100:0/1574764857 >> 172.21.15.100:0/1574764857 conn(0x7fd6b80c2940 msgr2=0x7fd6b80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 -- 172.21.15.100:0/1574764857 shutdown_connections 2024-01-20T08:12:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.371+0000 7fd6bce00640 1 -- 172.21.15.100:0/1574764857 wait complete. 2024-01-20T08:12:42.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.373+0000 7fd6bce00640 1 Processor -- start 2024-01-20T08:12:42.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.373+0000 7fd6bce00640 1 -- start start 2024-01-20T08:12:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6b806ce10 0x7fd6b81456a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b814b720 0x7fd6b8071d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8070c30 con 0x7fd6b81515b0 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b8070190 con 0x7fd6b814b720 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6bce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6b81eddd0 con 0x7fd6b806ce10 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6b6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42752/0 (socket says 172.21.15.100:42752) 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.374+0000 7fd6b6800640 1 -- 172.21.15.100:0/1382313281 learned_addr learned my addr 172.21.15.100:0/1382313281 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 -- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6b806ce10 msgr2=0x7fd6b81456a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6b806ce10 0x7fd6b81456a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 -- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b814b720 msgr2=0x7fd6b8071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b814b720 0x7fd6b8071d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 -- 172.21.15.100:0/1382313281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b0009b30 con 0x7fd6b81515b0 2024-01-20T08:12:42.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6b6800640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009f40 tx=0x7fd6b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b003e450 con 0x7fd6b81515b0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b003e5b0 con 0x7fd6b81515b0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b003e960 con 0x7fd6b81515b0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6b81ee0b0 con 0x7fd6b81515b0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.375+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6b80c40a0 con 0x7fd6b81515b0 2024-01-20T08:12:42.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.376+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6b80c4230 con 0x7fd6b81515b0 2024-01-20T08:12:42.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.377+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd6b003eac0 con 0x7fd6b81515b0 2024-01-20T08:12:42.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.378+0000 7fd6ae000640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 0x7fd69006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:42.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.378+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fd6b00ac720 con 0x7fd6b81515b0 2024-01-20T08:12:42.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.378+0000 7fd6b5e00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 0x7fd69006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:42.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.379+0000 7fd6b5e00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 0x7fd69006d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8003cc0 tx=0x7fd6a80079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:42.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.383+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd6b0077280 con 0x7fd6b81515b0 2024-01-20T08:12:42.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.614+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd6b806e190 con 0x7fd6b81515b0 2024-01-20T08:12:42.618 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.615+0000 7fd6ae000640 1 -- 172.21.15.100:0/1382313281 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v37) v1 ==== 53+0+149 (secure 0 0 0) 0x7fd6b007a8a0 con 0x7fd6b81515b0 2024-01-20T08:12:42.618 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:12:42.618 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:12:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 msgr2=0x7fd69006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:42.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 0x7fd69006d3c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8003cc0 tx=0x7fd6a80079b0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 msgr2=0x7fd6b8143df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009f40 tx=0x7fd6b0004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 shutdown_connections 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6b81515b0 0x7fd6b8143df0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6b814b720 0x7fd6b8071d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd69006af00 0x7fd69006d3c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 --2- 172.21.15.100:0/1382313281 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd6b806ce10 0x7fd6b81456a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.618+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 >> 172.21.15.100:0/1382313281 conn(0x7fd6b80c2940 msgr2=0x7fd6b80c16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.619+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 shutdown_connections 2024-01-20T08:12:42.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:42.619+0000 7fd6bce00640 1 -- 172.21.15.100:0/1382313281 wait complete. 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:12:42.641 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.uGA87eX8Mm 2024-01-20T08:12:42.642 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:12:42.692 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.M2qY9w0nfm 2024-01-20T08:12:42.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /tmp/tmp.uGA87eX8Mm /tmp/tmp.M2qY9w0nfm 2024-01-20T08:12:42.787 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.M2qY9w0nfm 2024-01-20T08:12:42.940 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.M2qY9w0nfm is 245B 2024-01-20T08:12:42.999 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.M2qY9w0nfm 2024-01-20T08:12:43.051 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew== caps mds = "allow rw fsname=cephfs" caps mon = "allow rw fsname=cephfs, allow rw fsname=cephfs2" caps osd = "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-20T08:12:43.051 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:12:43.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.052 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:12:43.100 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42510sec preferred_lft 42510sec 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:12:43.101 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:12:43.102 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:12:43.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.103 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:12:43.185 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:12:43.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.189 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:12:43.238 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:12:43.238 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:12:43.239 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:12:43.239 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:12:43.239 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:12:43.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:12:43.240 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:12:43.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.415 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:12:43.465 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:12:43.466 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:12:43.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.466 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:12:43.561 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:43.561 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:43.612 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:12:43.612 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:12:43.612 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:12:43.656 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:43.656 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/tmp/tmp.uGA87eX8Mm of=/dev/stdout 2024-01-20T08:12:43.752 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-20T08:12:43.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:43.752 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:43.894 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:43.894 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:43.894 INFO:teuthology.orchestra.run.smithi100.stdout:keyring.get_secret failed 2024-01-20T08:12:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:mount.ceph: kernel BUG! 2024-01-20T08:12:43.932 INFO:teuthology.orchestra.run.smithi100.stderr:mount error 13 = Permission denied 2024-01-20T08:12:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:12:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:12:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:12:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: testuser@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:12:43.933 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:12:43.940 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-01-20T08:12:43.940 INFO:tasks.cephfs.kernel_mount:mount command failed 2024-01-20T08:12:43.941 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:12:43.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:12:44.047 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:12:44.163 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:12:44.164 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:12:44.164 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:44.221 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:12:44.221 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:44.221 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:44.278 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:12:44.278 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:12:44.333 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.545+0000 7f6496a00640 1 Processor -- start 2024-01-20T08:12:44.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.545+0000 7f6496a00640 1 -- start start 2024-01-20T08:12:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.546+0000 7f6496a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 0x7f64900abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.546+0000 7f6496a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6490151f60 0x7f6490070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.546+0000 7f6496a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64900c1670 con 0x7f64900c1b00 2024-01-20T08:12:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.546+0000 7f6496a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64901524b0 con 0x7f6490151f60 2024-01-20T08:12:44.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.546+0000 7f6496a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64900c0d40 con 0x7f6490147f20 2024-01-20T08:12:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6490151f60 0x7f6490070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f6494a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f64900c1b00 0x7f64900c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54572/0 (socket says 172.21.15.100:54572) 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f6494a00640 1 -- 172.21.15.100:0/35564879 learned_addr learned my addr 172.21.15.100:0/35564879 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648fe00640 1 --2- 172.21.15.100:0/35564879 >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 0x7f64900abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648ea00640 1 -- 172.21.15.100:0/35564879 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600298127 0 0) 0x7f64900c1670 con 0x7f64900c1b00 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648f400640 1 -- 172.21.15.100:0/35564879 >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 msgr2=0x7f64900abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648f400640 1 --2- 172.21.15.100:0/35564879 >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 0x7f64900abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648f400640 1 -- 172.21.15.100:0/35564879 >> v1:172.21.15.100:6789/0 conn(0x7f64900c1b00 legacy=0x7f64900c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648f400640 1 -- 172.21.15.100:0/35564879 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64900c1020 con 0x7f6490151f60 2024-01-20T08:12:44.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.547+0000 7f648fe00640 1 --2- 172.21.15.100:0/35564879 >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 0x7f64900abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.548+0000 7f648f400640 1 --2- 172.21.15.100:0/35564879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6490151f60 0x7f6490070370 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f649006e5d0 tx=0x7f647802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adcd7113de42ab40 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f648ea00640 1 -- 172.21.15.100:0/35564879 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478031830 con 0x7f6490151f60 2024-01-20T08:12:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f648ea00640 1 -- 172.21.15.100:0/35564879 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478031990 con 0x7f6490151f60 2024-01-20T08:12:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f648ea00640 1 -- 172.21.15.100:0/35564879 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478031d20 con 0x7f6490151f60 2024-01-20T08:12:44.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 -- 172.21.15.100:0/35564879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6490151f60 msgr2=0x7f6490070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 --2- 172.21.15.100:0/35564879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6490151f60 0x7f6490070370 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f649006e5d0 tx=0x7f647802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 -- 172.21.15.100:0/35564879 shutdown_connections 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 --2- 172.21.15.100:0/35564879 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6490151f60 0x7f6490070370 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 --2- 172.21.15.100:0/35564879 >> v2:172.21.15.110:3300/0 conn(0x7f6490147f20 0x7f64900abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 -- 172.21.15.100:0/35564879 >> 172.21.15.100:0/35564879 conn(0x7f649006a5e0 msgr2=0x7f649006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.549+0000 7f6496a00640 1 -- 172.21.15.100:0/35564879 shutdown_connections 2024-01-20T08:12:44.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.550+0000 7f6496a00640 1 -- 172.21.15.100:0/35564879 wait complete. 2024-01-20T08:12:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.551+0000 7f6496a00640 1 Processor -- start 2024-01-20T08:12:44.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.551+0000 7f6496a00640 1 -- start start 2024-01-20T08:12:44.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6490147f20 0x7f649014bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490151f60 0x7f649014c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f649014ddb0 con 0x7f64900c1b00 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6490153410 con 0x7f6490147f20 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f6496a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64901536f0 con 0x7f6490151f60 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f648fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f648fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42772/0 (socket says 172.21.15.100:42772) 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.552+0000 7f648fe00640 1 -- 172.21.15.100:0/4026503387 learned_addr learned my addr 172.21.15.100:0/4026503387 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 -- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490151f60 msgr2=0x7f649014c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490151f60 0x7f649014c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 -- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6490147f20 msgr2=0x7f649014bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6490147f20 0x7f649014bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 -- 172.21.15.100:0/4026503387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6478009400 con 0x7f64900c1b00 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f648fe00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f648000c7f0 tx=0x7f648000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6480007a30 con 0x7f64900c1b00 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6480007b90 con 0x7f64900c1b00 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648000ce40 con 0x7f64900c1b00 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.553+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64901539d0 con 0x7f64900c1b00 2024-01-20T08:12:44.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.554+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6490153f90 con 0x7f64900c1b00 2024-01-20T08:12:44.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.555+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6490154180 con 0x7f64900c1b00 2024-01-20T08:12:44.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.555+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f64800113f0 con 0x7f64900c1b00 2024-01-20T08:12:44.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.556+0000 7f6487e00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 0x7f646806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.556+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6480089b80 con 0x7f64900c1b00 2024-01-20T08:12:44.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.557+0000 7f648f400640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 0x7f646806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.557+0000 7f648f400640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 0x7f646806d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6478036000 tx=0x7f6478030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:44.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.561+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6480054650 con 0x7f64900c1b00 2024-01-20T08:12:44.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.754+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f649004e970 con 0x7f64900c1b00 2024-01-20T08:12:44.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.759+0000 7f6487e00640 1 -- 172.21.15.100:0/4026503387 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7f648001f090 con 0x7f64900c1b00 2024-01-20T08:12:44.762 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:44.762 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:44.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 msgr2=0x7f646806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 0x7f646806d390 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6478036000 tx=0x7f6478030000 comp rx=0 tx=0).stop 2024-01-20T08:12:44.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 msgr2=0x7f649013de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f648000c7f0 tx=0x7f648000cbf0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 shutdown_connections 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646806aed0 0x7f646806d390 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6490151f60 0x7f649014c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6490147f20 0x7f649014bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 --2- 172.21.15.100:0/4026503387 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64900c1b00 0x7f649013de40 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.761+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 >> 172.21.15.100:0/4026503387 conn(0x7f649006a5e0 msgr2=0x7f64900a9bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.762+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 shutdown_connections 2024-01-20T08:12:44.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.762+0000 7f6496a00640 1 -- 172.21.15.100:0/4026503387 wait complete. 2024-01-20T08:12:44.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:12:04.385777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:12:05.510105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:12:24.716271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:12:25.562320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:44.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:44.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.990+0000 7fdf13e00640 1 Processor -- start 2024-01-20T08:12:44.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.990+0000 7fdf13e00640 1 -- start start 2024-01-20T08:12:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c14b720 0x7fdf0c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf13e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf13e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf0c154ba0 con 0x7fdf0c06c8d0 2024-01-20T08:12:44.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf13e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf0c14bb00 con 0x7fdf0c0c1850 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf13e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c155a00 con 0x7fdf0c14b720 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf10a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf10a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42776/0 (socket says 172.21.15.100:42776) 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.991+0000 7fdf11e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fdf0c06c8d0 0x7fdf0c06cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54588/0 (socket says 172.21.15.100:54588) 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf10a00640 1 -- 172.21.15.100:0/3502582671 learned_addr learned my addr 172.21.15.100:0/3502582671 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf11400640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c14b720 0x7fdf0c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf10a00640 1 -- 172.21.15.100:0/3502582671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c14b720 msgr2=0x7fdf0c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf10a00640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c14b720 0x7fdf0c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf10a00640 1 -- 172.21.15.100:0/3502582671 >> v1:172.21.15.100:6789/0 conn(0x7fdf0c06c8d0 legacy=0x7fdf0c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf10a00640 1 -- 172.21.15.100:0/3502582671 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf0c154df0 con 0x7fdf0c0c1850 2024-01-20T08:12:44.996 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.992+0000 7fdf0be00640 1 -- 172.21.15.100:0/3502582671 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 739638171 0 0) 0x7fdf0c154ba0 con 0x7fdf0c06c8d0 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.993+0000 7fdf10a00640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009870 tx=0x7fdef402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b717a5ee06d5072 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.993+0000 7fdf0be00640 1 -- 172.21.15.100:0/3502582671 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031640 con 0x7fdf0c0c1850 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.993+0000 7fdf0be00640 1 -- 172.21.15.100:0/3502582671 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef40317a0 con 0x7fdf0c0c1850 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.993+0000 7fdf0be00640 1 -- 172.21.15.100:0/3502582671 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef4031b30 con 0x7fdf0c0c1850 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 -- 172.21.15.100:0/3502582671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c0c1850 msgr2=0x7fdf0c0c1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fdef4009870 tx=0x7fdef402b8f0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 -- 172.21.15.100:0/3502582671 shutdown_connections 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c0c1850 0x7fdf0c0c1cd0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 --2- 172.21.15.100:0/3502582671 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c14b720 0x7fdf0c1515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:44.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 -- 172.21.15.100:0/3502582671 >> 172.21.15.100:0/3502582671 conn(0x7fdf0c0c2940 msgr2=0x7fdf0c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:44.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 -- 172.21.15.100:0/3502582671 shutdown_connections 2024-01-20T08:12:44.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.994+0000 7fdf13e00640 1 -- 172.21.15.100:0/3502582671 wait complete. 2024-01-20T08:12:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.996+0000 7fdf13e00640 1 Processor -- start 2024-01-20T08:12:44.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.996+0000 7fdf13e00640 1 -- start start 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c0c1850 0x7fdf0c1404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf0c14b720 0x7fdf0c143680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c141cd0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c140fd0 con 0x7fdf0c14b720 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf13e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0c140a30 con 0x7fdf0c0c1850 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf11400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf11400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42788/0 (socket says 172.21.15.100:42788) 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf11400640 1 -- 172.21.15.100:0/267328265 learned_addr learned my addr 172.21.15.100:0/267328265 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf11400640 1 -- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c0c1850 msgr2=0x7fdf0c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.997+0000 7fdf10a00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c0c1850 0x7fdf0c1404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf0c14b720 0x7fdf0c143680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11400640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c0c1850 0x7fdf0c1404f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11400640 1 -- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf0c14b720 msgr2=0x7fdf0c143680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11400640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf0c14b720 0x7fdf0c143680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11400640 1 -- 172.21.15.100:0/267328265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef40094d0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf11400640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00d830 tx=0x7fdefc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00b6c0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdefc00b820 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdefc00bbb0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0c140ca0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:44.998+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0c144950 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.000+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0c04e970 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.000+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdefc01e460 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.002+0000 7fdf09600640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 0x7fdee406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.002+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdefc08a160 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.002+0000 7fdf10a00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 0x7fdee406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.003+0000 7fdf10a00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 0x7fdee406d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdef4036000 tx=0x7fdef403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.008+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdefc054cc0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.200+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf0c0c37e0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.202+0000 7fdf09600640 1 -- 172.21.15.100:0/267328265 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdefc0582e0 con 0x7fdf0c06c8d0 2024-01-20T08:12:45.204 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 msgr2=0x7fdee406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 0x7fdee406d390 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdef4036000 tx=0x7fdef403c040 comp rx=0 tx=0).stop 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 msgr2=0x7fdf0c13ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fdefc00d830 tx=0x7fdefc00dcf0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 shutdown_connections 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf0c14b720 0x7fdf0c143680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee406aed0 0x7fdee406d390 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf0c0c1850 0x7fdf0c1404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 --2- 172.21.15.100:0/267328265 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf0c06c8d0 0x7fdf0c13ffb0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 >> 172.21.15.100:0/267328265 conn(0x7fdf0c0c2940 msgr2=0x7fdf0c071370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 shutdown_connections 2024-01-20T08:12:45.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.205+0000 7fdf13e00640 1 -- 172.21.15.100:0/267328265 wait complete. 2024-01-20T08:12:45.226 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:12:45.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.427+0000 7fe297e00640 1 Processor -- start 2024-01-20T08:12:45.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.427+0000 7fe297e00640 1 -- start start 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe297e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe298152310 0x7fe298160220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe297e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe298154b80 con 0x7fe2980c7f70 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe297e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2980c59c0 con 0x7fe2980c5070 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe297e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe29806ad40 con 0x7fe298152310 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe296000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe2980c7f70 0x7fe298151c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54600/0 (socket says 172.21.15.100:54600) 2024-01-20T08:12:45.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.429+0000 7fe296000640 1 -- 172.21.15.100:0/1478422362 learned_addr learned my addr 172.21.15.100:0/1478422362 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:45.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe297400640 1 --2- 172.21.15.100:0/1478422362 >> v2:172.21.15.110:3300/0 conn(0x7fe298152310 0x7fe298160220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934554187 0 0) 0x7fe298154b80 con 0x7fe2980c7f70 2024-01-20T08:12:45.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe278003520 con 0x7fe2980c7f70 2024-01-20T08:12:45.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3268741180 0 0) 0x7fe278003520 con 0x7fe2980c7f70 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 >> v2:172.21.15.110:3300/0 conn(0x7fe298152310 msgr2=0x7fe298160220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 --2- 172.21.15.100:0/1478422362 >> v2:172.21.15.110:3300/0 conn(0x7fe298152310 0x7fe298160220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 >> v1:172.21.15.110:6789/0 conn(0x7fe2980c5070 legacy=0x7fe29806b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2980c9dd0 con 0x7fe2980c7f70 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe2800019f0 con 0x7fe2980c7f70 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 >> v1:172.21.15.100:6789/0 conn(0x7fe2980c7f70 legacy=0x7fe298151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe278003970 0x7fe278003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2780047c0 0x7fe278004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe27800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29806ad40 con 0x7fe278005180 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27800c120 con 0x7fe2780047c0 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.430+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27800c2e0 con 0x7fe278003970 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe27800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe296000640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2780047c0 0x7fe278004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe296a00640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe278003970 0x7fe278003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 -- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe278003970 msgr2=0x7fe278003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe278003970 0x7fe278003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 -- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2780047c0 msgr2=0x7fe278004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2780047c0 0x7fe278004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe297400640 1 -- 172.21.15.100:0/1478422362 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe278003520 con 0x7fe278005180 2024-01-20T08:12:45.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.431+0000 7fe296000640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe2780047c0 0x7fe278004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.432+0000 7fe297400640 1 -- 172.21.15.100:0/1478422362 reap_dead start 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.432+0000 7fe297400640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe27800b980 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe290009ac0 tx=0x7fe2780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22468aec017d1ca server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.432+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe290004020 con 0x7fe278005180 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.432+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe290004180 con 0x7fe278005180 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.432+0000 7fe295600640 1 -- 172.21.15.100:0/1478422362 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900044f0 con 0x7fe278005180 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 -- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 msgr2=0x7fe27800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe27800b980 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe290009ac0 tx=0x7fe2780057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 -- 172.21.15.100:0/1478422362 shutdown_connections 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 --2- 172.21.15.100:0/1478422362 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe27800b980 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 -- 172.21.15.100:0/1478422362 >> 172.21.15.100:0/1478422362 conn(0x7fe2980ca070 msgr2=0x7fe2980ca480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 -- 172.21.15.100:0/1478422362 shutdown_connections 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.433+0000 7fe297e00640 1 -- 172.21.15.100:0/1478422362 wait complete. 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.435+0000 7fe297e00640 1 Processor -- start 2024-01-20T08:12:45.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.435+0000 7fe297e00640 1 -- start start 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2981ea490 0x7fe2981ea910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29814a210 0x7fe29814a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe29814d410 con 0x7fe278005180 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2981eae50 con 0x7fe29814a210 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe297e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2980af7c0 con 0x7fe2981ea490 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe296a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe296a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42808/0 (socket says 172.21.15.100:42808) 2024-01-20T08:12:45.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.436+0000 7fe296a00640 1 -- 172.21.15.100:0/813690470 learned_addr learned my addr 172.21.15.100:0/813690470 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 -- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2981ea490 msgr2=0x7fe2981ea910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2981ea490 0x7fe2981ea910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 -- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29814a210 msgr2=0x7fe29814a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29814a210 0x7fe29814a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 -- 172.21.15.100:0/813690470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2981e9fb0 con 0x7fe278005180 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe296a00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe28800d570 tx=0x7fe28800da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288003610 con 0x7fe278005180 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe288003770 con 0x7fe278005180 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2980aab20 con 0x7fe278005180 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe288003b20 con 0x7fe278005180 2024-01-20T08:12:45.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.437+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2980afa10 con 0x7fe278005180 2024-01-20T08:12:45.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.438+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe29804e9e0 con 0x7fe278005180 2024-01-20T08:12:45.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.439+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe288003c80 con 0x7fe278005180 2024-01-20T08:12:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.440+0000 7fe28f400640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 0x7fe27006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.440+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe288089830 con 0x7fe278005180 2024-01-20T08:12:45.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.441+0000 7fe296000640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 0x7fe27006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.441+0000 7fe296000640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 0x7fe27006d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe280001580 tx=0x7fe280009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.445+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe2880544f0 con 0x7fe278005180 2024-01-20T08:12:45.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.638+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2980c6820 con 0x7fe278005180 2024-01-20T08:12:45.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.638+0000 7fe28f400640 1 -- 172.21.15.100:0/813690470 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe288057b10 con 0x7fe278005180 2024-01-20T08:12:45.641 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 msgr2=0x7fe27006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 0x7fe27006d390 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe280001580 tx=0x7fe280009040 comp rx=0 tx=0).stop 2024-01-20T08:12:45.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 msgr2=0x7fe2980c3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe28800d570 tx=0x7fe28800da30 comp rx=0 tx=0).stop 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 shutdown_connections 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe29814a210 0x7fe29814a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe27006aed0 0x7fe27006d390 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe2981ea490 0x7fe2981ea910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 --2- 172.21.15.100:0/813690470 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe278005180 0x7fe2980c3580 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 >> 172.21.15.100:0/813690470 conn(0x7fe2980ca070 msgr2=0x7fe2980c8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 shutdown_connections 2024-01-20T08:12:45.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.641+0000 7fe297e00640 1 -- 172.21.15.100:0/813690470 wait complete. 2024-01-20T08:12:45.661 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:12:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.863+0000 7f6cc9600640 1 Processor -- start 2024-01-20T08:12:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.863+0000 7f6cc9600640 1 -- start start 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.864+0000 7f6cc9600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc414b720 0x7f6cc41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.864+0000 7f6cc9600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 0x7f6cc40c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.864+0000 7f6cc9600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cc4154ba0 con 0x7f6cc406c8d0 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.864+0000 7f6cc9600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc414bb00 con 0x7f6cc414b720 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.864+0000 7f6cc9600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cc4155a00 con 0x7f6cc40c1850 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc414b720 0x7f6cc41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6cc414b720 0x7f6cc41515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42810/0 (socket says 172.21.15.100:42810) 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 -- 172.21.15.100:0/949886466 learned_addr learned my addr 172.21.15.100:0/949886466 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc3400640 1 --1- 172.21.15.100:0/949886466 >> v1:172.21.15.100:6789/0 conn(0x7f6cc406c8d0 0x7f6cc406cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54606/0 (socket says 172.21.15.100:54606) 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2000640 1 --2- 172.21.15.100:0/949886466 >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 0x7f6cc40c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 -- 172.21.15.100:0/949886466 >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 msgr2=0x7f6cc40c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 --2- 172.21.15.100:0/949886466 >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 0x7f6cc40c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 -- 172.21.15.100:0/949886466 >> v1:172.21.15.100:6789/0 conn(0x7f6cc406c8d0 legacy=0x7f6cc406cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2a00640 1 -- 172.21.15.100:0/949886466 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cc4154df0 con 0x7f6cc414b720 2024-01-20T08:12:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.865+0000 7f6cc2000640 1 --2- 172.21.15.100:0/949886466 >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 0x7f6cc40c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.866+0000 7f6cc2a00640 1 --2- 172.21.15.100:0/949886466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc414b720 0x7f6cc41515b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40ac030 tx=0x7f6cb402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc9437ce5b699bd1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc1600640 1 -- 172.21.15.100:0/949886466 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb402ca80 con 0x7f6cc414b720 2024-01-20T08:12:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc1600640 1 -- 172.21.15.100:0/949886466 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cb402cbe0 con 0x7f6cc414b720 2024-01-20T08:12:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc1600640 1 -- 172.21.15.100:0/949886466 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cb40343f0 con 0x7f6cc414b720 2024-01-20T08:12:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 -- 172.21.15.100:0/949886466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc414b720 msgr2=0x7f6cc41515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 --2- 172.21.15.100:0/949886466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc414b720 0x7f6cc41515b0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6cc40ac030 tx=0x7f6cb402bee0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 -- 172.21.15.100:0/949886466 shutdown_connections 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 --2- 172.21.15.100:0/949886466 >> v2:172.21.15.110:3300/0 conn(0x7f6cc40c1850 0x7f6cc40c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 --2- 172.21.15.100:0/949886466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc414b720 0x7f6cc41515b0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.867+0000 7f6cc9600640 1 -- 172.21.15.100:0/949886466 >> 172.21.15.100:0/949886466 conn(0x7f6cc40c2940 msgr2=0x7f6cc40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.868+0000 7f6cc9600640 1 -- 172.21.15.100:0/949886466 shutdown_connections 2024-01-20T08:12:45.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.868+0000 7f6cc9600640 1 -- 172.21.15.100:0/949886466 wait complete. 2024-01-20T08:12:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.869+0000 7f6cc9600640 1 Processor -- start 2024-01-20T08:12:45.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.869+0000 7f6cc9600640 1 -- start start 2024-01-20T08:12:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cc406c8d0 0x7f6cc40aa710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 0x7f6cc4147910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414bd70 con 0x7f6cc40c1850 2024-01-20T08:12:45.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414c050 con 0x7f6cc414b720 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc9600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cc414c780 con 0x7f6cc406c8d0 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42812/0 (socket says 172.21.15.100:42812) 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.870+0000 7f6cc2000640 1 -- 172.21.15.100:0/2908809219 learned_addr learned my addr 172.21.15.100:0/2908809219 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2a00640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cc406c8d0 0x7f6cc40aa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 -- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cc406c8d0 msgr2=0x7f6cc40aa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cc406c8d0 0x7f6cc40aa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 -- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 msgr2=0x7f6cc4147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc3400640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 0x7f6cc4147910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 0x7f6cc4147910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 -- 172.21.15.100:0/2908809219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cb4009b30 con 0x7f6cc40c1850 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc3400640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 0x7f6cc4147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc2000640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c7f0 tx=0x7f6cac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac007a30 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cac007b90 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cc414ca60 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.871+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cac00ce40 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.872+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cc40a9a30 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.873+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cc404e970 con 0x7f6cc40c1850 2024-01-20T08:12:45.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.873+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6cac0113f0 con 0x7f6cc40c1850 2024-01-20T08:12:45.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.874+0000 7f6cbaa00640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 0x7f6c9c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:45.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.874+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6cac089b20 con 0x7f6cc40c1850 2024-01-20T08:12:45.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.875+0000 7f6cc2a00640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 0x7f6c9c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:45.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.875+0000 7f6cc2a00640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 0x7f6c9c06d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4035000 tx=0x7f6cb4030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:45.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:45.879+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6cac054680 con 0x7f6cc40c1850 2024-01-20T08:12:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.074+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6cc40c37e0 con 0x7f6cc40c1850 2024-01-20T08:12:46.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.075+0000 7f6cbaa00640 1 -- 172.21.15.100:0/2908809219 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6cac01f0a0 con 0x7f6cc40c1850 2024-01-20T08:12:46.078 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 msgr2=0x7f6c9c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 0x7f6c9c06d3c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f6cb4035000 tx=0x7f6cb4030000 comp rx=0 tx=0).stop 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 msgr2=0x7f6cc40bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6cac00c7f0 tx=0x7f6cac00cbf0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 shutdown_connections 2024-01-20T08:12:46.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6cc414b720 0x7f6cc4147910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6cc40c1850 0x7f6cc40bf4e0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6c9c06af00 0x7f6c9c06d3c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 --2- 172.21.15.100:0/2908809219 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6cc406c8d0 0x7f6cc40aa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 >> 172.21.15.100:0/2908809219 conn(0x7f6cc40c2940 msgr2=0x7f6cc40c44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 shutdown_connections 2024-01-20T08:12:46.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.078+0000 7f6cc9600640 1 -- 172.21.15.100:0/2908809219 wait complete. 2024-01-20T08:12:46.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:12:46.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.295+0000 7f85bea00640 1 Processor -- start 2024-01-20T08:12:46.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.296+0000 7f85bea00640 1 -- start start 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85bea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 0x7f85b8153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85bea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80ab620 con 0x7f85b80ab0b0 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85bea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85b80ab900 con 0x7f85b80715a0 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85bea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b814cb30 con 0x7f85b814c750 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85b7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f85b80ab0b0 0x7f85b80a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54612/0 (socket says 172.21.15.100:54612) 2024-01-20T08:12:46.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.297+0000 7f85b7400640 1 -- 172.21.15.100:0/3696391137 learned_addr learned my addr 172.21.15.100:0/3696391137 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:46.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b7e00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 0x7f85b8153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2373202290 0 0) 0x7f85b80ab620 con 0x7f85b80ab0b0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8598003520 con 0x7f85b80ab0b0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3496485043 0 0) 0x7f8598003520 con 0x7f85b80ab0b0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 msgr2=0x7f85b8153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 0x7f85b8153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 >> v1:172.21.15.110:6789/0 conn(0x7f85b80715a0 legacy=0x7f85b8071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b80abbe0 con 0x7f85b80ab0b0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f85a0001670 con 0x7f85b80ab0b0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 >> v1:172.21.15.100:6789/0 conn(0x7f85b80ab0b0 legacy=0x7f85b80a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85980039a0 0x7f8598003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 0x7f85980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8598004d00 0x7f8598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b814cb30 con 0x7f85980039a0 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859800ba30 con 0x7f8598004d00 2024-01-20T08:12:46.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.298+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859800bbf0 con 0x7f85b814c750 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85980039a0 0x7f8598003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85bca00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8598004d00 0x7f8598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 -- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 msgr2=0x7f85980047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814c750 0x7f85980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 -- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8598004d00 msgr2=0x7f8598005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8598004d00 0x7f8598005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.299+0000 7f85b7e00640 1 -- 172.21.15.100:0/3696391137 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8598003520 con 0x7f85980039a0 2024-01-20T08:12:46.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.300+0000 7f85b7e00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85980039a0 0x7f8598003dc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009a90 tx=0x7f85980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7530ab6dc7f3513 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.300+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a802c6b0 con 0x7f85980039a0 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.300+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a802c810 con 0x7f85980039a0 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.300+0000 7f85b6a00640 1 -- 172.21.15.100:0/3696391137 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a802cba0 con 0x7f85980039a0 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 -- 172.21.15.100:0/3696391137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85980039a0 msgr2=0x7f8598003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 --2- 172.21.15.100:0/3696391137 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85980039a0 0x7f8598003dc0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f85a8009a90 tx=0x7f85980057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bca00640 1 -- 172.21.15.100:0/3696391137 reap_dead start 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 -- 172.21.15.100:0/3696391137 shutdown_connections 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 -- 172.21.15.100:0/3696391137 >> 172.21.15.100:0/3696391137 conn(0x7f85b80c6090 msgr2=0x7f85b80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 -- 172.21.15.100:0/3696391137 shutdown_connections 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.301+0000 7f85bea00640 1 -- 172.21.15.100:0/3696391137 wait complete. 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.303+0000 7f85bea00640 1 Processor -- start 2024-01-20T08:12:46.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.303+0000 7f85bea00640 1 -- start start 2024-01-20T08:12:46.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 0x7f85b814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 0x7f85b81eb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b81ec740 con 0x7f85b81ebd70 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85b8154160 con 0x7f85980039a0 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85b81e6600 con 0x7f85b814f810 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42824/0 (socket says 172.21.15.100:42824) 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 -- 172.21.15.100:0/4266851649 learned_addr learned my addr 172.21.15.100:0/4266851649 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85b7400640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 0x7f85b81eb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85b7e00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 0x7f85b814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 -- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 msgr2=0x7f85b81eb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 0x7f85b81eb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 -- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 msgr2=0x7f85b814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 0x7f85b814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85bca00640 1 -- 172.21.15.100:0/4266851649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8153ba0 con 0x7f85b81ebd70 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85b7400640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 0x7f85b81eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.304+0000 7f85b7e00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 0x7f85b814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85bca00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f85b806fed0 tx=0x7f85b000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b0003b70 con 0x7f85b81ebd70 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b0003cd0 con 0x7f85b81ebd70 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b00052b0 con 0x7f85b81ebd70 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85b8153e80 con 0x7f85b81ebd70 2024-01-20T08:12:46.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.305+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85b8152a60 con 0x7f85b81ebd70 2024-01-20T08:12:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.306+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85b804ea50 con 0x7f85b81ebd70 2024-01-20T08:12:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.307+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f85b0005410 con 0x7f85b81ebd70 2024-01-20T08:12:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.308+0000 7f85afe00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.308+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f85b0089450 con 0x7f85b81ebd70 2024-01-20T08:12:46.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.308+0000 7f85b7e00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.309+0000 7f85b7e00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 0x7f859006d3c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85a8036000 tx=0x7f85a8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.313+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f85b0053fb0 con 0x7f85b81ebd70 2024-01-20T08:12:46.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.505+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85b8071ad0 con 0x7f85b81ebd70 2024-01-20T08:12:46.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.506+0000 7f85afe00640 1 -- 172.21.15.100:0/4266851649 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7f85b00575d0 con 0x7f85b81ebd70 2024-01-20T08:12:46.509 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:46.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 msgr2=0x7f859006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 0x7f859006d3c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f85a8036000 tx=0x7f85a8030000 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 msgr2=0x7f85b8147490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f85b806fed0 tx=0x7f85b000dc00 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 shutdown_connections 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f85b81ebd70 0x7f85b8147490 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f859006af00 0x7f859006d3c0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f85b814f810 0x7f85b81eb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.508+0000 7f85bea00640 1 --2- 172.21.15.100:0/4266851649 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f85980039a0 0x7f85b814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.509+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 >> 172.21.15.100:0/4266851649 conn(0x7f85b80c6090 msgr2=0x7f85b814a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.509+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 shutdown_connections 2024-01-20T08:12:46.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.509+0000 7f85bea00640 1 -- 172.21.15.100:0/4266851649 wait complete. 2024-01-20T08:12:46.529 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:12:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.731+0000 7fe335600640 1 Processor -- start 2024-01-20T08:12:46.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.731+0000 7fe335600640 1 -- start start 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe335600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe33014fdb0 0x7fe3300c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe335600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe330150190 con 0x7fe3301532f0 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe335600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3300a8810 con 0x7fe3300c1d90 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe335600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3300a9ce0 con 0x7fe33014fdb0 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe32f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe3301532f0 0x7fe33015cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54618/0 (socket says 172.21.15.100:54618) 2024-01-20T08:12:46.736 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.733+0000 7fe32f400640 1 -- 172.21.15.100:0/1032746635 learned_addr learned my addr 172.21.15.100:0/1032746635 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32ea00640 1 --2- 172.21.15.100:0/1032746635 >> v2:172.21.15.110:3300/0 conn(0x7fe33014fdb0 0x7fe3300c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122973733 0 0) 0x7fe330150190 con 0x7fe3301532f0 2024-01-20T08:12:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe310003520 con 0x7fe3301532f0 2024-01-20T08:12:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 322885009 0 0) 0x7fe310003520 con 0x7fe3301532f0 2024-01-20T08:12:46.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 >> v2:172.21.15.110:3300/0 conn(0x7fe33014fdb0 msgr2=0x7fe3300c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 --2- 172.21.15.100:0/1032746635 >> v2:172.21.15.110:3300/0 conn(0x7fe33014fdb0 0x7fe3300c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 >> v1:172.21.15.110:6789/0 conn(0x7fe3300c1d90 legacy=0x7fe330152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3300a8df0 con 0x7fe3301532f0 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe3280019f0 con 0x7fe3301532f0 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 >> v1:172.21.15.100:6789/0 conn(0x7fe3301532f0 legacy=0x7fe33015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe310003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3100047c0 0x7fe310004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe310005180 0x7fe31000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31000bff0 con 0x7fe310003970 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31000c160 con 0x7fe3100047c0 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.734+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31000c320 con 0x7fe310005180 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe310003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 -- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe310005180 msgr2=0x7fe31000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe310005180 0x7fe31000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 -- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3100047c0 msgr2=0x7fe310004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3100047c0 0x7fe310004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32ea00640 1 -- 172.21.15.100:0/1032746635 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310003520 con 0x7fe310003970 2024-01-20T08:12:46.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.735+0000 7fe32f400640 1 -- 172.21.15.100:0/1032746635 reap_dead start 2024-01-20T08:12:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.736+0000 7fe32ea00640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe310003d90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe320009ac0 tx=0x7fe3100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34014bf6b240130b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.736+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32002c6b0 con 0x7fe310003970 2024-01-20T08:12:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.736+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe32002c810 con 0x7fe310003970 2024-01-20T08:12:46.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.736+0000 7fe32e000640 1 -- 172.21.15.100:0/1032746635 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe32002cba0 con 0x7fe310003970 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 -- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 msgr2=0x7fe310003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe310003d90 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fe320009ac0 tx=0x7fe3100057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 -- 172.21.15.100:0/1032746635 shutdown_connections 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 --2- 172.21.15.100:0/1032746635 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe310003d90 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 -- 172.21.15.100:0/1032746635 >> 172.21.15.100:0/1032746635 conn(0x7fe3300c2940 msgr2=0x7fe3300c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 -- 172.21.15.100:0/1032746635 shutdown_connections 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.737+0000 7fe335600640 1 -- 172.21.15.100:0/1032746635 wait complete. 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.739+0000 7fe335600640 1 Processor -- start 2024-01-20T08:12:46.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.739+0000 7fe335600640 1 -- start start 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3301522b0 0x7fe3300bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3300bf7b0 0x7fe33006cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3301455e0 con 0x7fe310003970 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3301ee2e0 con 0x7fe3300bf7b0 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe335600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe33006c720 con 0x7fe3301522b0 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42838/0 (socket says 172.21.15.100:42838) 2024-01-20T08:12:46.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 -- 172.21.15.100:0/4038898640 learned_addr learned my addr 172.21.15.100:0/4038898640 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 -- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3301522b0 msgr2=0x7fe3300bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3301522b0 0x7fe3300bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 -- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3300bf7b0 msgr2=0x7fe33006cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3300bf7b0 0x7fe33006cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.740+0000 7fe32ea00640 1 -- 172.21.15.100:0/4038898640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe330071450 con 0x7fe310003970 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe32ea00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe320004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320003810 con 0x7fe310003970 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe320003970 con 0x7fe310003970 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe320003d20 con 0x7fe310003970 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe330070bb0 con 0x7fe310003970 2024-01-20T08:12:46.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.741+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe330071170 con 0x7fe310003970 2024-01-20T08:12:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.742+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3300c6c90 con 0x7fe310003970 2024-01-20T08:12:46.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.743+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe320034440 con 0x7fe310003970 2024-01-20T08:12:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.744+0000 7fe326a00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 0x7fe30806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.744+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe3200ab850 con 0x7fe310003970 2024-01-20T08:12:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.744+0000 7fe327e00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 0x7fe30806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:46.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.745+0000 7fe327e00640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 0x7fe30806d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe3300aa4c0 tx=0x7fe3180079d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:46.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.749+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe3200764f0 con 0x7fe310003970 2024-01-20T08:12:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.939+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe33006c510 con 0x7fe310003970 2024-01-20T08:12:46.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.940+0000 7fe326a00640 1 -- 172.21.15.100:0/4038898640 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe3200044e0 con 0x7fe310003970 2024-01-20T08:12:46.943 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 msgr2=0x7fe30806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 0x7fe30806d3c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe3300aa4c0 tx=0x7fe3180079d0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 msgr2=0x7fe3301edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fe320000c00 tx=0x7fe320004730 comp rx=0 tx=0).stop 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 shutdown_connections 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe3300bf7b0 0x7fe33006cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe30806af00 0x7fe30806d3c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe3301522b0 0x7fe3300bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 --2- 172.21.15.100:0/4038898640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe310003970 0x7fe3301edda0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 >> 172.21.15.100:0/4038898640 conn(0x7fe3300c2940 msgr2=0x7fe33014e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 shutdown_connections 2024-01-20T08:12:46.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:46.942+0000 7fe335600640 1 -- 172.21.15.100:0/4038898640 wait complete. 2024-01-20T08:12:46.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:12:47.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.170+0000 7f5b8f200640 1 Processor -- start 2024-01-20T08:12:47.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.170+0000 7f5b8f200640 1 -- start start 2024-01-20T08:12:47.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b90155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b9006d750 con 0x7f5b900c4e20 2024-01-20T08:12:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b901559b0 con 0x7f5b9006cbb0 2024-01-20T08:12:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900c1930 con 0x7f5b900c0ed0 2024-01-20T08:12:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8de00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5b900c4e20 0x7f5b900aa8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54622/0 (socket says 172.21.15.100:54622) 2024-01-20T08:12:47.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8de00640 1 -- 172.21.15.100:0/2262546449 learned_addr learned my addr 172.21.15.100:0/2262546449 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826703676 0 0) 0x7f5b9006d750 con 0x7f5b900c4e20 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b70005730 con 0x7f5b900c4e20 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.172+0000 7f5b8d400640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b90155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3035255356 0 0) 0x7f5b70005730 con 0x7f5b900c4e20 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 msgr2=0x7f5b90155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b90155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 >> v1:172.21.15.110:6789/0 conn(0x7f5b9006cbb0 legacy=0x7f5b9006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b9006c160 con 0x7f5b900c4e20 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f5b80001670 con 0x7f5b900c4e20 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 >> v1:172.21.15.100:6789/0 conn(0x7f5b900c4e20 legacy=0x7f5b900aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b70005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b700061e0 0x7f5b700069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006f10 0x7f5b70007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b900c1930 con 0x7f5b70006f10 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000dd50 con 0x7f5b700061e0 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b7000df10 con 0x7f5b900c0ed0 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006f10 0x7f5b70007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8de00640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b70005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.173+0000 7f5b8d400640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b700061e0 0x7f5b700069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8e800640 1 -- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 msgr2=0x7f5b70005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b900c0ed0 0x7f5b70005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8e800640 1 -- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b700061e0 msgr2=0x7f5b700069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b700061e0 0x7f5b700069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8e800640 1 -- 172.21.15.100:0/2262546449 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b70005730 con 0x7f5b70006f10 2024-01-20T08:12:47.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.174+0000 7f5b8d400640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b700061e0 0x7f5b700069d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:47.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006f10 0x7f5b70007390 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5b88001cb0 tx=0x7f5b70007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2145e0fe6055a8d9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88003b70 con 0x7f5b70006f10 2024-01-20T08:12:47.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b8802d040 con 0x7f5b70006f10 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8ca00640 1 -- 172.21.15.100:0/2262546449 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b880050d0 con 0x7f5b70006f10 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8f200640 1 -- 172.21.15.100:0/2262546449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006f10 msgr2=0x7f5b70007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2262546449 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b70006f10 0x7f5b70007390 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5b88001cb0 tx=0x7f5b70007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.175+0000 7f5b8e800640 1 -- 172.21.15.100:0/2262546449 reap_dead start 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.176+0000 7f5b8f200640 1 -- 172.21.15.100:0/2262546449 shutdown_connections 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.176+0000 7f5b8f200640 1 -- 172.21.15.100:0/2262546449 >> 172.21.15.100:0/2262546449 conn(0x7f5b900c5ba0 msgr2=0x7f5b900c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.176+0000 7f5b8f200640 1 -- 172.21.15.100:0/2262546449 shutdown_connections 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.176+0000 7f5b8f200640 1 -- 172.21.15.100:0/2262546449 wait complete. 2024-01-20T08:12:47.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.177+0000 7f5b8f200640 1 Processor -- start 2024-01-20T08:12:47.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.177+0000 7f5b8f200640 1 -- start start 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 0x7f5b90152580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 0x7f5b90153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9014ee20 con 0x7f5b9013ec70 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9014db70 con 0x7f5b70006f10 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.178+0000 7f5b8f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b9013f660 con 0x7f5b9014d570 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42846/0 (socket says 172.21.15.100:42846) 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 -- 172.21.15.100:0/2242491294 learned_addr learned my addr 172.21.15.100:0/2242491294 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8d400640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 0x7f5b90153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8de00640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 0x7f5b90152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 -- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 msgr2=0x7f5b90153b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 0x7f5b90153b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 -- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 msgr2=0x7f5b90152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 0x7f5b90152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 -- 172.21.15.100:0/2242491294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90152c80 con 0x7f5b9013ec70 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8de00640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 0x7f5b90152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:47.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8d400640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 0x7f5b90153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.179+0000 7f5b8e800640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5b8802bed0 tx=0x7f5b880014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.180+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88007db0 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.180+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b88005400 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.180+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b90152f60 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.180+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b88005790 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.180+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b90153520 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.181+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b9014ef90 con 0x7f5b9013ec70 2024-01-20T08:12:47.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.182+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5b88007030 con 0x7f5b9013ec70 2024-01-20T08:12:47.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.182+0000 7f5b86000640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 0x7f5b6806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.183+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5b880ab510 con 0x7f5b9013ec70 2024-01-20T08:12:47.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.183+0000 7f5b8de00640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 0x7f5b6806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.183+0000 7f5b8de00640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 0x7f5b6806d390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b800017a0 tx=0x7f5b80001df0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.187+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5b9014ef90 con 0x7f5b9013ec70 2024-01-20T08:12:47.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.374+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5b901559b0 con 0x7f5b9013ec70 2024-01-20T08:12:47.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.375+0000 7f5b86000640 1 -- 172.21.15.100:0/2242491294 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v56) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5b901559b0 con 0x7f5b9013ec70 2024-01-20T08:12:47.378 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:12:47.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 msgr2=0x7f5b6806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 0x7f5b6806d390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b800017a0 tx=0x7f5b80001df0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 msgr2=0x7f5b9013f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f5b8802bed0 tx=0x7f5b880014a0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 shutdown_connections 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b9013ec70 0x7f5b9013f120 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5b6806aed0 0x7f5b6806d390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5b9014d570 0x7f5b90153b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 --2- 172.21.15.100:0/2242491294 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5b70006f10 0x7f5b90152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 >> 172.21.15.100:0/2242491294 conn(0x7f5b900c5ba0 msgr2=0x7f5b900aa6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 shutdown_connections 2024-01-20T08:12:47.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.378+0000 7f5b8f200640 1 -- 172.21.15.100:0/2242491294 wait complete. 2024-01-20T08:12:47.399 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:12:47.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:47.399 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:12:47.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:12:47.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:12:47.511 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:12:47.563 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 Processor -- start 2024-01-20T08:12:47.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 -- start start 2024-01-20T08:12:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcdc006d2b0 0x7fcdc006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc01523a0 con 0x7fcdc00c5570 2024-01-20T08:12:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc00706a0 con 0x7fcdc006d2b0 2024-01-20T08:12:47.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.771+0000 7fcdc6600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0151ee0 con 0x7fcdc00c3e00 2024-01-20T08:12:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.772+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.772+0000 7fcdbfe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:55184/0 (socket says 172.21.15.100:55184) 2024-01-20T08:12:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.772+0000 7fcdbfe00640 1 -- 172.21.15.100:0/3353668731 learned_addr learned my addr 172.21.15.100:0/3353668731 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:47.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.772+0000 7fcdc5200640 1 --2- 172.21.15.100:0/3353668731 >> v2:172.21.15.110:3300/0 conn(0x7fcdc006d2b0 0x7fcdc006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.773+0000 7fcdbfe00640 1 -- 172.21.15.100:0/3353668731 >> v2:172.21.15.110:3300/0 conn(0x7fcdc006d2b0 msgr2=0x7fcdc006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:47.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.773+0000 7fcdbfe00640 1 --2- 172.21.15.100:0/3353668731 >> v2:172.21.15.110:3300/0 conn(0x7fcdc006d2b0 0x7fcdc006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.773+0000 7fcdbfe00640 1 -- 172.21.15.100:0/3353668731 >> v1:172.21.15.110:6789/0 conn(0x7fcdc00c5570 legacy=0x7fcdc006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.773+0000 7fcdbfe00640 1 -- 172.21.15.100:0/3353668731 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc00a53f0 con 0x7fcdc00c3e00 2024-01-20T08:12:47.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.774+0000 7fcdbfe00640 1 --2- 172.21.15.100:0/3353668731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcda800bb10 tx=0x7fcda802e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=936f9e463c4436a8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.775+0000 7fcdbf400640 1 -- 172.21.15.100:0/3353668731 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda802ede0 con 0x7fcdc00c3e00 2024-01-20T08:12:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.775+0000 7fcdbf400640 1 -- 172.21.15.100:0/3353668731 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda8036440 con 0x7fcdc00c3e00 2024-01-20T08:12:47.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.775+0000 7fcdbf400640 1 -- 172.21.15.100:0/3353668731 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda80367d0 con 0x7fcdc00c3e00 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.775+0000 7fcdc6600640 1 -- 172.21.15.100:0/3353668731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 msgr2=0x7fcdc006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.775+0000 7fcdc6600640 1 --2- 172.21.15.100:0/3353668731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fcda800bb10 tx=0x7fcda802e030 comp rx=0 tx=0).stop 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 -- 172.21.15.100:0/3353668731 shutdown_connections 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 --2- 172.21.15.100:0/3353668731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc006c460 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 --2- 172.21.15.100:0/3353668731 >> v2:172.21.15.110:3300/0 conn(0x7fcdc006d2b0 0x7fcdc006d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 -- 172.21.15.100:0/3353668731 >> 172.21.15.100:0/3353668731 conn(0x7fcdc00c2590 msgr2=0x7fcdc00c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 -- 172.21.15.100:0/3353668731 shutdown_connections 2024-01-20T08:12:47.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.776+0000 7fcdc6600640 1 -- 172.21.15.100:0/3353668731 wait complete. 2024-01-20T08:12:47.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.777+0000 7fcdc6600640 1 Processor -- start 2024-01-20T08:12:47.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.777+0000 7fcdc6600640 1 -- start start 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc01eac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc00c5570 0x7fcdc01ee0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc0153400 con 0x7fcdc006d2b0 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01ea7e0 con 0x7fcdc00c5570 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.778+0000 7fcdc6600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc01ee620 con 0x7fcdc00c3e00 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42854/0 (socket says 172.21.15.100:42854) 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 -- 172.21.15.100:0/1478721572 learned_addr learned my addr 172.21.15.100:0/1478721572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdbfe00640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc01eac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 -- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 msgr2=0x7fcdc01eac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc01eac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5c00640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc00c5570 0x7fcdc01ee0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 -- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc00c5570 msgr2=0x7fcdc01ee0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc00c5570 0x7fcdc01ee0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:47.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.779+0000 7fcdc5200640 1 -- 172.21.15.100:0/1478721572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda800b770 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdc5200640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d620 tx=0x7fcdb000dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000b620 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb000b780 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb000bb30 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc01ea1b0 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.780+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc0153930 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.781+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc00749e0 con 0x7fcdc006d2b0 2024-01-20T08:12:47.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.782+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcdb000bc90 con 0x7fcdc006d2b0 2024-01-20T08:12:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.783+0000 7fcdbcc00640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.783+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcdb0089e70 con 0x7fcdc006d2b0 2024-01-20T08:12:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.783+0000 7fcdbfe00640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:47.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.784+0000 7fcdbfe00640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 0x7fcd9806d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcda8038000 tx=0x7fcda8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:47.790 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:47.788+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcdb00549e0 con 0x7fcdc006d2b0 2024-01-20T08:12:48.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.020+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcdc00c1ff0 con 0x7fcdc006d2b0 2024-01-20T08:12:48.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.023+0000 7fcdbcc00640 1 -- 172.21.15.100:0/1478721572 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6191 (secure 0 0 0) 0x7fcdb0058000 con 0x7fcdc006d2b0 2024-01-20T08:12:48.025 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:48.025 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:48.025 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-01-20T08:12:48.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 msgr2=0x7fcd9806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 0x7fcd9806d390 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcda8038000 tx=0x7fcda8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 msgr2=0x7fcdc00a9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fcdb000d620 tx=0x7fcdb000dae0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 shutdown_connections 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcdc00c5570 0x7fcdc01ee0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcd9806aed0 0x7fcd9806d390 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcdc00c3e00 0x7fcdc01eac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 --2- 172.21.15.100:0/1478721572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcdc006d2b0 0x7fcdc00a9e60 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.024+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 >> 172.21.15.100:0/1478721572 conn(0x7fcdc00c2590 msgr2=0x7fcdc006c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.026+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 shutdown_connections 2024-01-20T08:12:48.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.026+0000 7fcdc6600640 1 -- 172.21.15.100:0/1478721572 wait complete. 2024-01-20T08:12:48.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.251+0000 7f46aca00640 1 Processor -- start 2024-01-20T08:12:48.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.251+0000 7f46aca00640 1 -- start start 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f46a4147f20 0x7f46a40abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aca00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a40c1670 con 0x7f46a4070370 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aca00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46a4070800 con 0x7f46a4151f60 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46a40c2210 con 0x7f46a4147f20 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aaa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f46a4070370 0x7f46a40c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54632/0 (socket says 172.21.15.100:54632) 2024-01-20T08:12:48.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.253+0000 7f46aaa00640 1 -- 172.21.15.100:0/1834188358 learned_addr learned my addr 172.21.15.100:0/1834188358 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055265113 0 0) 0x7f46a40c1670 con 0x7f46a4070370 2024-01-20T08:12:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46aa000640 1 --2- 172.21.15.100:0/1834188358 >> v2:172.21.15.110:3300/0 conn(0x7f46a4147f20 0x7f46a40abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4684003520 con 0x7f46a4070370 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2256211073 0 0) 0x7f4684003520 con 0x7f46a4070370 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 >> v2:172.21.15.110:3300/0 conn(0x7f46a4147f20 msgr2=0x7f46a40abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 --2- 172.21.15.100:0/1834188358 >> v2:172.21.15.110:3300/0 conn(0x7f46a4147f20 0x7f46a40abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 >> v1:172.21.15.110:6789/0 conn(0x7f46a4151f60 legacy=0x7f46a40c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a40c0d40 con 0x7f46a4070370 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f469c001670 con 0x7f46a4070370 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46aa000640 1 --2- 172.21.15.100:0/1834188358 >> v2:172.21.15.110:3300/0 conn(0x7f46a4147f20 0x7f46a40abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 >> v1:172.21.15.100:6789/0 conn(0x7f46a4070370 legacy=0x7f46a40c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840039c0 0x7f4684003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 0x7f4684004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840051d0 0x7f468400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a40c2210 con 0x7f46840047c0 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f468400c120 con 0x7f46840051d0 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.254+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f468400e4f0 con 0x7f46840039c0 2024-01-20T08:12:48.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 0x7f4684004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46aaa00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840051d0 0x7f468400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46aa000640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840039c0 0x7f4684003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 -- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840039c0 msgr2=0x7f4684003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840039c0 0x7f4684003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 -- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840051d0 msgr2=0x7f468400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46840051d0 0x7f468400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46a9600640 1 -- 172.21.15.100:0/1834188358 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684003520 con 0x7f46840047c0 2024-01-20T08:12:48.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.255+0000 7f46aaa00640 1 -- 172.21.15.100:0/1834188358 reap_dead start 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.256+0000 7f46a9600640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 0x7f4684004c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f468c001720 tx=0x7f46840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfde84e2d455649e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.256+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0052d0 con 0x7f46840047c0 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.256+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c02e050 con 0x7f46840047c0 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.256+0000 7f46a8c00640 1 -- 172.21.15.100:0/1834188358 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c003830 con 0x7f46840047c0 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 -- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 msgr2=0x7f4684004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 0x7f4684004c40 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f468c001720 tx=0x7f46840057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 -- 172.21.15.100:0/1834188358 shutdown_connections 2024-01-20T08:12:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 --2- 172.21.15.100:0/1834188358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46840047c0 0x7f4684004c40 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 -- 172.21.15.100:0/1834188358 >> 172.21.15.100:0/1834188358 conn(0x7f46a406a5e0 msgr2=0x7f46a406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 -- 172.21.15.100:0/1834188358 shutdown_connections 2024-01-20T08:12:48.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.257+0000 7f46aca00640 1 -- 172.21.15.100:0/1834188358 wait complete. 2024-01-20T08:12:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.259+0000 7f46aca00640 1 Processor -- start 2024-01-20T08:12:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.259+0000 7f46aca00640 1 -- start start 2024-01-20T08:12:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 0x7f46a414d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 0x7f46a4144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a4155680 con 0x7f46a4150f20 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46a414ff50 con 0x7f46a414e9b0 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46aca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46a414de50 con 0x7f46840047c0 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46a9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46a9600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42876/0 (socket says 172.21.15.100:42876) 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.260+0000 7f46a9600640 1 -- 172.21.15.100:0/123588677 learned_addr learned my addr 172.21.15.100:0/123588677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46aaa00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 0x7f46a4144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46aa000640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 0x7f46a414d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 -- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 msgr2=0x7f46a414d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 0x7f46a414d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 -- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 msgr2=0x7f46a4144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 0x7f46a4144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 -- 172.21.15.100:0/123588677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46a4155870 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46aaa00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 0x7f46a4144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46aa000640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 0x7f46a414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a9600640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f468c000c00 tx=0x7f468c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0076c0 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468c007a30 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46a4150160 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.261+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c006be0 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.262+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46a414bcc0 con 0x7f46a4150f20 2024-01-20T08:12:48.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.263+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46a4150c40 con 0x7f46a4150f20 2024-01-20T08:12:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.263+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f468c006d40 con 0x7f46a4150f20 2024-01-20T08:12:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.264+0000 7f46a2000640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 0x7f467c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.264+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f468c0ab640 con 0x7f46a4150f20 2024-01-20T08:12:48.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.265+0000 7f46aa000640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 0x7f467c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.265+0000 7f46aa000640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 0x7f467c06d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46a404fbe0 tx=0x7f469400b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.269+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f46a4150c40 con 0x7f46a4150f20 2024-01-20T08:12:48.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.461+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46a4150c40 con 0x7f46a4150f20 2024-01-20T08:12:48.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.465+0000 7f46a2000640 1 -- 172.21.15.100:0/123588677 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7f46a4150c40 con 0x7f46a4150f20 2024-01-20T08:12:48.467 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:48.467 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.467+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 msgr2=0x7f467c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.467+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 0x7f467c06d390 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f46a404fbe0 tx=0x7f469400b040 comp rx=0 tx=0).stop 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.467+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 msgr2=0x7f46a414e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.467+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f468c000c00 tx=0x7f468c001120 comp rx=0 tx=0).stop 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 shutdown_connections 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f46a414e9b0 0x7f46a4144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46a4150f20 0x7f46a414e470 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f467c06aed0 0x7f467c06d390 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 --2- 172.21.15.100:0/123588677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46840047c0 0x7f46a414d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 >> 172.21.15.100:0/123588677 conn(0x7f46a406a5e0 msgr2=0x7f46a41457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 shutdown_connections 2024-01-20T08:12:48.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.468+0000 7f46aca00640 1 -- 172.21.15.100:0/123588677 wait complete. 2024-01-20T08:12:48.488 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:12:04.385777+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:12:05.510105+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '52', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:12:24.716271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:12:25.562320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:48.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:48.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.698+0000 7f4bdea00640 1 Processor -- start 2024-01-20T08:12:48.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.699+0000 7f4bdea00640 1 -- start start 2024-01-20T08:12:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bd814e690 0x7f4bd81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4bd80c7e10 0x7f4bd80ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bd8157d00 con 0x7f4bd80ca9a0 2024-01-20T08:12:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdea00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd80c4890 con 0x7f4bd814e690 2024-01-20T08:12:48.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bd806cd00 con 0x7f4bd80c7e10 2024-01-20T08:12:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.700+0000 7f4bdd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bd814e690 0x7f4bd81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4bd814e690 0x7f4bd81550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42886/0 (socket says 172.21.15.100:42886) 2024-01-20T08:12:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 -- 172.21.15.100:0/2530054642 learned_addr learned my addr 172.21.15.100:0/2530054642 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 -- 172.21.15.100:0/2530054642 >> v2:172.21.15.110:3300/0 conn(0x7f4bd80c7e10 msgr2=0x7f4bd80ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:48.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 --2- 172.21.15.100:0/2530054642 >> v2:172.21.15.110:3300/0 conn(0x7f4bd80c7e10 0x7f4bd80ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 -- 172.21.15.100:0/2530054642 >> v1:172.21.15.110:6789/0 conn(0x7f4bd80ca9a0 legacy=0x7f4bd81581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.701+0000 7f4bdd600640 1 -- 172.21.15.100:0/2530054642 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bd80c4b50 con 0x7f4bd814e690 2024-01-20T08:12:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.702+0000 7f4bdd600640 1 --2- 172.21.15.100:0/2530054642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd814e690 0x7f4bd81550f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80caf80 tx=0x7f4bc802be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=716d863655586bd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.703+0000 7f4bd7e00640 1 -- 172.21.15.100:0/2530054642 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc802ca10 con 0x7f4bd814e690 2024-01-20T08:12:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.703+0000 7f4bd7e00640 1 -- 172.21.15.100:0/2530054642 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc802cb70 con 0x7f4bd814e690 2024-01-20T08:12:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.703+0000 7f4bd7e00640 1 -- 172.21.15.100:0/2530054642 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc80343f0 con 0x7f4bd814e690 2024-01-20T08:12:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.703+0000 7f4bdea00640 1 -- 172.21.15.100:0/2530054642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd814e690 msgr2=0x7f4bd81550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.703+0000 7f4bdea00640 1 --2- 172.21.15.100:0/2530054642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd814e690 0x7f4bd81550f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80caf80 tx=0x7f4bc802be70 comp rx=0 tx=0).stop 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 -- 172.21.15.100:0/2530054642 shutdown_connections 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 --2- 172.21.15.100:0/2530054642 >> v2:172.21.15.110:3300/0 conn(0x7f4bd80c7e10 0x7f4bd80ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 --2- 172.21.15.100:0/2530054642 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd814e690 0x7f4bd81550f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 -- 172.21.15.100:0/2530054642 >> 172.21.15.100:0/2530054642 conn(0x7f4bd8072130 msgr2=0x7f4bd8072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 -- 172.21.15.100:0/2530054642 shutdown_connections 2024-01-20T08:12:48.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.704+0000 7f4bdea00640 1 -- 172.21.15.100:0/2530054642 wait complete. 2024-01-20T08:12:48.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.706+0000 7f4bdea00640 1 Processor -- start 2024-01-20T08:12:48.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.706+0000 7f4bdea00640 1 -- start start 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bd80ca9a0 0x7f4bd81edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 0x7f4bd814c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80c1a90 con 0x7f4bd80c7e10 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd80c1d70 con 0x7f4bd80ca9a0 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd81ed2c0 con 0x7f4bd814e690 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdd600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdd600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42892/0 (socket says 172.21.15.100:42892) 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.707+0000 7f4bdd600640 1 -- 172.21.15.100:0/919635837 learned_addr learned my addr 172.21.15.100:0/919635837 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 -- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 msgr2=0x7f4bd814c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdcc00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bd80ca9a0 0x7f4bd81edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bde000640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 0x7f4bd814c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 0x7f4bd814c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 -- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bd80ca9a0 msgr2=0x7f4bd81edda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bd80ca9a0 0x7f4bd81edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 -- 172.21.15.100:0/919635837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc8009b30 con 0x7f4bd80c7e10 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bde000640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 0x7f4bd814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdd600640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f80 tx=0x7f4bc8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc803e450 con 0x7f4bd80c7e10 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bc803e5f0 con 0x7f4bd80c7e10 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bc803e9a0 con 0x7f4bd80c7e10 2024-01-20T08:12:48.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.708+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd81ed5a0 con 0x7f4bd80c7e10 2024-01-20T08:12:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.709+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd814c930 con 0x7f4bd80c7e10 2024-01-20T08:12:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.710+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd804e970 con 0x7f4bd80c7e10 2024-01-20T08:12:48.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.710+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4bc803eb00 con 0x7f4bd80c7e10 2024-01-20T08:12:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.711+0000 7f4bd5600640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 0x7f4bb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.711+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f4bc80ac540 con 0x7f4bd80c7e10 2024-01-20T08:12:48.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.712+0000 7f4bdcc00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 0x7f4bb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:48.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.712+0000 7f4bdcc00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 0x7f4bb006d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80c2060 tx=0x7f4bc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:48.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.716+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4bc8077140 con 0x7f4bd80c7e10 2024-01-20T08:12:48.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.908+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bd80c1bd0 con 0x7f4bd80c7e10 2024-01-20T08:12:48.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.909+0000 7f4bd5600640 1 -- 172.21.15.100:0/919635837 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bd80c1bd0 con 0x7f4bd80c7e10 2024-01-20T08:12:48.911 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 msgr2=0x7f4bb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 0x7f4bb006d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f4bd80c2060 tx=0x7f4bc0008040 comp rx=0 tx=0).stop 2024-01-20T08:12:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 msgr2=0x7f4bd8145060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8000f80 tx=0x7f4bc8004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:48.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 shutdown_connections 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4bb006af00 0x7f4bb006d3c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4bd814e690 0x7f4bd814c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4bd80ca9a0 0x7f4bd81edda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 --2- 172.21.15.100:0/919635837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bd80c7e10 0x7f4bd8145060 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 >> 172.21.15.100:0/919635837 conn(0x7f4bd8072130 msgr2=0x7f4bd8154ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 shutdown_connections 2024-01-20T08:12:48.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:48.911+0000 7f4bdea00640 1 -- 172.21.15.100:0/919635837 wait complete. 2024-01-20T08:12:48.930 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:12:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.129+0000 7f0c6ce00640 1 Processor -- start 2024-01-20T08:12:49.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.129+0000 7f0c6ce00640 1 -- start start 2024-01-20T08:12:49.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.130+0000 7f0c6ce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 0x7f0c68153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c6ce00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c680ab0b0 0x7f0c680a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c6ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c680715a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c6ce00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c6814cb30 con 0x7f0c680ab0b0 2024-01-20T08:12:49.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c6ce00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c680ab620 con 0x7f0c6814c750 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c6ce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c680ab900 con 0x7f0c680a96f0 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c680ab0b0 0x7f0c680a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0c680ab0b0 0x7f0c680a91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:59996/0 (socket says 172.21.15.100:59996) 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 -- 172.21.15.100:0/4151939601 learned_addr learned my addr 172.21.15.100:0/4151939601 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c65e00640 1 --2- 172.21.15.100:0/4151939601 >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 0x7f0c68153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 -- 172.21.15.100:0/4151939601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 msgr2=0x7f0c680715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/4151939601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c680715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 -- 172.21.15.100:0/4151939601 >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 msgr2=0x7f0c68153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/4151939601 >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 0x7f0c68153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c5fe00640 1 -- 172.21.15.100:0/4151939601 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c680abbe0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.131+0000 7f0c65e00640 1 --2- 172.21.15.100:0/4151939601 >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 0x7f0c68153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:49.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.133+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/4151939601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c680a91b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0c6806fed0 tx=0x7f0c5002b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dc146a20104b798 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.133+0000 7f0c65400640 1 -- 172.21.15.100:0/4151939601 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50031860 con 0x7f0c680ab0b0 2024-01-20T08:12:49.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.133+0000 7f0c65400640 1 -- 172.21.15.100:0/4151939601 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500319c0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.133+0000 7f0c65400640 1 -- 172.21.15.100:0/4151939601 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50031d50 con 0x7f0c680ab0b0 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 -- 172.21.15.100:0/4151939601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 msgr2=0x7f0c680a91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/4151939601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c680a91b0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f0c6806fed0 tx=0x7f0c5002b900 comp rx=0 tx=0).stop 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 -- 172.21.15.100:0/4151939601 shutdown_connections 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/4151939601 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c680715a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/4151939601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c680a91b0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/4151939601 >> v2:172.21.15.110:3300/0 conn(0x7f0c6814c750 0x7f0c68153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 -- 172.21.15.100:0/4151939601 >> 172.21.15.100:0/4151939601 conn(0x7f0c680c6090 msgr2=0x7f0c680c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:49.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 -- 172.21.15.100:0/4151939601 shutdown_connections 2024-01-20T08:12:49.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.134+0000 7f0c6ce00640 1 -- 172.21.15.100:0/4151939601 wait complete. 2024-01-20T08:12:49.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.135+0000 7f0c6ce00640 1 Processor -- start 2024-01-20T08:12:49.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 -- start start 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c6806c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6814c750 0x7f0c68146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c681553c0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c68153a70 con 0x7f0c6814c750 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.136+0000 7f0c6ce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6806cbb0 con 0x7f0c680a96f0 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60002/0 (socket says 172.21.15.100:60002) 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 -- 172.21.15.100:0/1939349801 learned_addr learned my addr 172.21.15.100:0/1939349801 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c65e00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c6806c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c66800640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6814c750 0x7f0c68146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 -- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 msgr2=0x7f0c6806c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c6806c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 -- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6814c750 msgr2=0x7f0c68146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6814c750 0x7f0c68146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 -- 172.21.15.100:0/1939349801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c500094d0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.137+0000 7f0c5fe00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0c5002b940 tx=0x7f0c500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.138+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c50031830 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.138+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c500443f0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.138+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c500447a0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.138+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6806ce90 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.138+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6806c6f0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.139+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c681541e0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.140+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0c50044900 con 0x7f0c680ab0b0 2024-01-20T08:12:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.141+0000 7f0c5e000640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 0x7f0c4006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.141+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0c500ac340 con 0x7f0c680ab0b0 2024-01-20T08:12:49.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.142+0000 7f0c65e00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 0x7f0c4006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.142+0000 7f0c65e00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 0x7f0c4006d3c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800b840 tx=0x7f0c58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.146+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0c681541e0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.336+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c681541e0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.337+0000 7f0c5e000640 1 -- 172.21.15.100:0/1939349801 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v56) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c681541e0 con 0x7f0c680ab0b0 2024-01-20T08:12:49.339 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.339+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 msgr2=0x7f0c4006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.339+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 0x7f0c4006d3c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0c5800b840 tx=0x7f0c58008040 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.339+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 msgr2=0x7f0c681468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.339+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f0c5002b940 tx=0x7f0c500046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.339+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 shutdown_connections 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6814c750 0x7f0c68146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c680ab0b0 0x7f0c681468d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c4006af00 0x7f0c4006d3c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 --2- 172.21.15.100:0/1939349801 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c680a96f0 0x7f0c6806c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 >> 172.21.15.100:0/1939349801 conn(0x7f0c680c6090 msgr2=0x7f0c680c5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 shutdown_connections 2024-01-20T08:12:49.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.340+0000 7f0c6ce00640 1 -- 172.21.15.100:0/1939349801 wait complete. 2024-01-20T08:12:49.360 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:12:49.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.569+0000 7f9acd400640 1 Processor -- start 2024-01-20T08:12:49.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.570+0000 7f9acd400640 1 -- start start 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.571+0000 7f9acd400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.571+0000 7f9acd400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9ac81532f0 0x7f9ac815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.571+0000 7f9acd400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac8150190 con 0x7f9ac80c1d90 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.571+0000 7f9acd400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac80a9ce0 con 0x7f9ac81532f0 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.571+0000 7f9acd400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80a93b0 con 0x7f9ac814fdb0 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9ac81532f0 0x7f9ac815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9ac81532f0 0x7f9ac815cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60010/0 (socket says 172.21.15.100:60010) 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 -- 172.21.15.100:0/2137424970 learned_addr learned my addr 172.21.15.100:0/2137424970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac5e00640 1 --1- 172.21.15.100:0/2137424970 >> v1:172.21.15.100:6789/0 conn(0x7f9ac80c1d90 0x7f9ac8152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37202/0 (socket says 172.21.15.100:37202) 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac6800640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 -- 172.21.15.100:0/2137424970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 msgr2=0x7f9ac80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:49.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac80c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 -- 172.21.15.100:0/2137424970 >> v1:172.21.15.100:6789/0 conn(0x7f9ac80c1d90 legacy=0x7f9ac8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac5400640 1 -- 172.21.15.100:0/2137424970 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 954349947 0 0) 0x7f9ac8150190 con 0x7f9ac80c1d90 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.572+0000 7f9ac7200640 1 -- 172.21.15.100:0/2137424970 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80a8810 con 0x7f9ac81532f0 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.573+0000 7f9ac7200640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac815cfc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e50 tx=0x7f9ac002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1353e96586b0bd51 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9ac5400640 1 -- 172.21.15.100:0/2137424970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac002cb00 con 0x7f9ac81532f0 2024-01-20T08:12:49.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9ac5400640 1 -- 172.21.15.100:0/2137424970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac002cc60 con 0x7f9ac81532f0 2024-01-20T08:12:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9ac5400640 1 -- 172.21.15.100:0/2137424970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac00343f0 con 0x7f9ac81532f0 2024-01-20T08:12:49.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 -- 172.21.15.100:0/2137424970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 msgr2=0x7f9ac815cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac815cfc0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e50 tx=0x7f9ac002bf60 comp rx=0 tx=0).stop 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 -- 172.21.15.100:0/2137424970 shutdown_connections 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac815cfc0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 --2- 172.21.15.100:0/2137424970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac80c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 -- 172.21.15.100:0/2137424970 >> 172.21.15.100:0/2137424970 conn(0x7f9ac80c2940 msgr2=0x7f9ac80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.574+0000 7f9acd400640 1 -- 172.21.15.100:0/2137424970 shutdown_connections 2024-01-20T08:12:49.577 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.575+0000 7f9acd400640 1 -- 172.21.15.100:0/2137424970 wait complete. 2024-01-20T08:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.576+0000 7f9acd400640 1 Processor -- start 2024-01-20T08:12:49.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.576+0000 7f9acd400640 1 -- start start 2024-01-20T08:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ac80c1d90 0x7f9ac814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac81ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81f25c0 con 0x7f9ac81532f0 2024-01-20T08:12:49.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81ee0d0 con 0x7f9ac80c1d90 2024-01-20T08:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9acd400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8072620 con 0x7f9ac814fdb0 2024-01-20T08:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9ac7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9ac7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60014/0 (socket says 172.21.15.100:60014) 2024-01-20T08:12:49.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.577+0000 7f9ac7200640 1 -- 172.21.15.100:0/3320191654 learned_addr learned my addr 172.21.15.100:0/3320191654 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac5e00640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac81ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac6800640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ac80c1d90 0x7f9ac814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 -- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 msgr2=0x7f9ac81ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac81ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 -- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ac80c1d90 msgr2=0x7f9ac814a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ac80c1d90 0x7f9ac814a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 -- 172.21.15.100:0/3320191654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0009b30 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.578+0000 7f9ac7200640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036040 tx=0x7f9ac0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.579+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0040670 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.579+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac00407d0 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.579+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0040b80 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.579+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac81ee2e0 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.579+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac8072340 con 0x7f9ac81532f0 2024-01-20T08:12:49.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.580+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac804e970 con 0x7f9ac81532f0 2024-01-20T08:12:49.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.581+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9ac0040ce0 con 0x7f9ac81532f0 2024-01-20T08:12:49.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.582+0000 7f9abea00640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 0x7f9aa006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:49.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.582+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9ac00aca00 con 0x7f9ac81532f0 2024-01-20T08:12:49.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.582+0000 7f9ac6800640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 0x7f9aa006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:49.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.583+0000 7f9ac6800640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 0x7f9aa006d3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8006fd0 tx=0x7f9ab8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:49.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.586+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9ac0077560 con 0x7f9ac81532f0 2024-01-20T08:12:49.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.778+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9ac81ee470 con 0x7f9ac81532f0 2024-01-20T08:12:49.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.778+0000 7f9abea00640 1 -- 172.21.15.100:0/3320191654 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v56) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9ac0009510 con 0x7f9ac81532f0 2024-01-20T08:12:49.780 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.781+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 msgr2=0x7f9aa006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.781+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 0x7f9aa006d3c0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8006fd0 tx=0x7f9ab8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.781+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 msgr2=0x7f9ac814c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.781+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0036040 tx=0x7f9ac0004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 shutdown_connections 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ac81532f0 0x7f9ac814c1b0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9aa006af00 0x7f9aa006d3c0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9ac814fdb0 0x7f9ac81ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 --2- 172.21.15.100:0/3320191654 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9ac80c1d90 0x7f9ac814a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 >> 172.21.15.100:0/3320191654 conn(0x7f9ac80c2940 msgr2=0x7f9ac814d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 shutdown_connections 2024-01-20T08:12:49.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:49.782+0000 7f9acd400640 1 -- 172.21.15.100:0/3320191654 wait complete. 2024-01-20T08:12:49.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:12:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.007+0000 7fa9fee00640 1 Processor -- start 2024-01-20T08:12:50.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.007+0000 7fa9fee00640 1 -- start start 2024-01-20T08:12:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9fee00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9f80c05a0 0x7fa9f806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9fee00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 0x7fa9f8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9fee00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9f806d220 con 0x7fa9f81481a0 2024-01-20T08:12:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9fee00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f806dbf0 con 0x7fa9f80c05a0 2024-01-20T08:12:50.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9fee00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9f81557a0 con 0x7fa9f8154af0 2024-01-20T08:12:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9f7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9f80c05a0 0x7fa9f806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9f7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa9f80c05a0 0x7fa9f806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60024/0 (socket says 172.21.15.100:60024) 2024-01-20T08:12:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.009+0000 7fa9f7400640 1 -- 172.21.15.100:0/2880818414 learned_addr learned my addr 172.21.15.100:0/2880818414 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:50.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9fce00640 1 --2- 172.21.15.100:0/2880818414 >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 0x7fa9f8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9f7400640 1 -- 172.21.15.100:0/2880818414 >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 msgr2=0x7fa9f8154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9f7400640 1 --2- 172.21.15.100:0/2880818414 >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 0x7fa9f8154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9f7400640 1 -- 172.21.15.100:0/2880818414 >> v1:172.21.15.110:6789/0 conn(0x7fa9f81481a0 legacy=0x7fa9f80701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9f7400640 1 -- 172.21.15.100:0/2880818414 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9f806c8f0 con 0x7fa9f80c05a0 2024-01-20T08:12:50.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.010+0000 7fa9fce00640 1 --2- 172.21.15.100:0/2880818414 >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 0x7fa9f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.011+0000 7fa9f7400640 1 --2- 172.21.15.100:0/2880818414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80c05a0 0x7fa9f806d6b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80c7130 tx=0x7fa9e002e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b51de9d2acd26b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.011+0000 7fa9f6a00640 1 -- 172.21.15.100:0/2880818414 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e002ee90 con 0x7fa9f80c05a0 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.011+0000 7fa9f6a00640 1 -- 172.21.15.100:0/2880818414 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0036440 con 0x7fa9f80c05a0 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.011+0000 7fa9f6a00640 1 -- 172.21.15.100:0/2880818414 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e00367d0 con 0x7fa9f80c05a0 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 -- 172.21.15.100:0/2880818414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80c05a0 msgr2=0x7fa9f806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 --2- 172.21.15.100:0/2880818414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80c05a0 0x7fa9f806d6b0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa9f80c7130 tx=0x7fa9e002e0e0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 -- 172.21.15.100:0/2880818414 shutdown_connections 2024-01-20T08:12:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 --2- 172.21.15.100:0/2880818414 >> v2:172.21.15.110:3300/0 conn(0x7fa9f8154af0 0x7fa9f8154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 --2- 172.21.15.100:0/2880818414 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80c05a0 0x7fa9f806d6b0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 -- 172.21.15.100:0/2880818414 >> 172.21.15.100:0/2880818414 conn(0x7fa9f80c6090 msgr2=0x7fa9f80c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 -- 172.21.15.100:0/2880818414 shutdown_connections 2024-01-20T08:12:50.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.012+0000 7fa9fee00640 1 -- 172.21.15.100:0/2880818414 wait complete. 2024-01-20T08:12:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.014+0000 7fa9fee00640 1 Processor -- start 2024-01-20T08:12:50.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.014+0000 7fa9fee00640 1 -- start start 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 0x7fa9f81eb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9f8141bb0 0x7fa9f8142040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f814db90 con 0x7fa9f80a9f30 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f81eb650 con 0x7fa9f8154af0 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9fee00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9f80ab920 con 0x7fa9f8141bb0 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9f7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9f7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60034/0 (socket says 172.21.15.100:60034) 2024-01-20T08:12:50.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.015+0000 7fa9f7400640 1 -- 172.21.15.100:0/3967158912 learned_addr learned my addr 172.21.15.100:0/3967158912 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7e00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 0x7fa9f81eb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 -- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9f8141bb0 msgr2=0x7fa9f8142040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9f8141bb0 0x7fa9f8142040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 -- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 msgr2=0x7fa9f81eb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 0x7fa9f81eb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 -- 172.21.15.100:0/3967158912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9e000b770 con 0x7fa9f80a9f30 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7e00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 0x7fa9f81eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9f7400640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa9e002e120 tx=0x7fa9e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0034b80 con 0x7fa9f80a9f30 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9e0034d00 con 0x7fa9f80a9f30 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9f80abc00 con 0x7fa9f80a9f30 2024-01-20T08:12:50.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9e0041680 con 0x7fa9f80a9f30 2024-01-20T08:12:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.016+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9f80ac1c0 con 0x7fa9f80a9f30 2024-01-20T08:12:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.018+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9f80a9540 con 0x7fa9f80a9f30 2024-01-20T08:12:50.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.018+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa9e00403e0 con 0x7fa9f80a9f30 2024-01-20T08:12:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.019+0000 7fa9efe00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 0x7fa9d006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.019+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa9e00ac100 con 0x7fa9f80a9f30 2024-01-20T08:12:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.020+0000 7fa9f7e00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 0x7fa9d006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.020+0000 7fa9f7e00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 0x7fa9d006d3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8003eb0 tx=0x7fa9e8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.024+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa9e0076c60 con 0x7fa9f80a9f30 2024-01-20T08:12:50.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.218+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9f80ac350 con 0x7fa9f80a9f30 2024-01-20T08:12:50.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.219+0000 7fa9efe00640 1 -- 172.21.15.100:0/3967158912 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v56) v1 ==== 105+0+11 (secure 0 0 0) 0x7fa9e007a280 con 0x7fa9f80a9f30 2024-01-20T08:12:50.221 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 msgr2=0x7fa9d006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 0x7fa9d006d3c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fa9e8003eb0 tx=0x7fa9e8009040 comp rx=0 tx=0).stop 2024-01-20T08:12:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 msgr2=0x7fa9f814bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa9e002e120 tx=0x7fa9e00046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 shutdown_connections 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa9d006af00 0x7fa9d006d3c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa9f8141bb0 0x7fa9f8142040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa9f80a9f30 0x7fa9f814bda0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 --2- 172.21.15.100:0/3967158912 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa9f8154af0 0x7fa9f81eb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 >> 172.21.15.100:0/3967158912 conn(0x7fa9f80c6090 msgr2=0x7fa9f80bf4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 shutdown_connections 2024-01-20T08:12:50.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.222+0000 7fa9fee00640 1 -- 172.21.15.100:0/3967158912 wait complete. 2024-01-20T08:12:50.242 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:12:50.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.453+0000 7f046b200640 1 Processor -- start 2024-01-20T08:12:50.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.453+0000 7f046b200640 1 -- start start 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.454+0000 7f046b200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f046c0c4e20 0x7f046c155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.454+0000 7f046b200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c06d750 con 0x7f046c06cbb0 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.454+0000 7f046b200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f046c1559b0 con 0x7f046c0c0ed0 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.454+0000 7f046b200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f046c0c1930 con 0x7f046c0c4e20 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f046a800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f046c06cbb0 0x7f046c06d040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37206/0 (socket says 172.21.15.100:37206) 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f046a800640 1 -- 172.21.15.100:0/3241648835 learned_addr learned my addr 172.21.15.100:0/3241648835 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197465632 0 0) 0x7f046c06d750 con 0x7f046c06cbb0 2024-01-20T08:12:50.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f044c005730 con 0x7f046c06cbb0 2024-01-20T08:12:50.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f0469e00640 1 --2- 172.21.15.100:0/3241648835 >> v2:172.21.15.110:3300/0 conn(0x7f046c0c4e20 0x7f046c155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908533575 0 0) 0x7f044c005730 con 0x7f046c06cbb0 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.455+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 >> v2:172.21.15.110:3300/0 conn(0x7f046c0c4e20 msgr2=0x7f046c155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 --2- 172.21.15.100:0/3241648835 >> v2:172.21.15.110:3300/0 conn(0x7f046c0c4e20 0x7f046c155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 >> v1:172.21.15.110:6789/0 conn(0x7f046c0c0ed0 legacy=0x7f046c0aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c06c160 con 0x7f046c06cbb0 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f04640019f0 con 0x7f046c06cbb0 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 >> v1:172.21.15.100:6789/0 conn(0x7f046c06cbb0 legacy=0x7f046c06d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c005b80 0x7f044c005f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 0x7f044c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044c0074b0 0x7f044c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c0c1930 con 0x7f044c0069d0 2024-01-20T08:12:50.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c00e3b0 con 0x7f044c005b80 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f044c00e570 con 0x7f044c0074b0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 0x7f044c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0469e00640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c005b80 0x7f044c005f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 -- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044c0074b0 msgr2=0x7f044c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f046a800640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044c0074b0 0x7f044c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f044c0074b0 0x7f044c00db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 -- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c005b80 msgr2=0x7f044c005f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c005b80 0x7f044c005f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.456+0000 7f0463e00640 1 -- 172.21.15.100:0/3241648835 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c005730 con 0x7f044c0069d0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.457+0000 7f046a800640 1 -- 172.21.15.100:0/3241648835 reap_dead start 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f0463e00640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 0x7f044c006e50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f046c0c1310 tx=0x7f044c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=739cc3fd239cdcf7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0454032600 con 0x7f044c0069d0 2024-01-20T08:12:50.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f045402e050 con 0x7f044c0069d0 2024-01-20T08:12:50.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f0469400640 1 -- 172.21.15.100:0/3241648835 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04540329e0 con 0x7f044c0069d0 2024-01-20T08:12:50.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f046b200640 1 -- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 msgr2=0x7f044c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f046b200640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 0x7f044c006e50 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f046c0c1310 tx=0x7f044c007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f046b200640 1 -- 172.21.15.100:0/3241648835 shutdown_connections 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f046b200640 1 --2- 172.21.15.100:0/3241648835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f044c0069d0 0x7f044c006e50 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.458+0000 7f046b200640 1 -- 172.21.15.100:0/3241648835 >> 172.21.15.100:0/3241648835 conn(0x7f046c0c5ba0 msgr2=0x7f046c0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.459+0000 7f046b200640 1 -- 172.21.15.100:0/3241648835 shutdown_connections 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.459+0000 7f046b200640 1 -- 172.21.15.100:0/3241648835 wait complete. 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.460+0000 7f046b200640 1 Processor -- start 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.460+0000 7f046b200640 1 -- start start 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c0069d0 0x7f046c09fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 0x7f046c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c09e090 con 0x7f046c1ed210 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046c09e320 con 0x7f044c0069d0 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f046c09e600 con 0x7f046c153130 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.461+0000 7f046a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60052/0 (socket says 172.21.15.100:60052) 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 -- 172.21.15.100:0/839468146 learned_addr learned my addr 172.21.15.100:0/839468146 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f0469e00640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c0069d0 0x7f046c09fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f0463e00640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 0x7f046c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 -- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 msgr2=0x7f046c1535b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 0x7f046c1535b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 -- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c0069d0 msgr2=0x7f046c09fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c0069d0 0x7f046c09fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 -- 172.21.15.100:0/839468146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c09e8e0 con 0x7f046c1ed210 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f0463e00640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 0x7f046c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f046a800640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0464001580 tx=0x7f046400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.462+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464004d60 con 0x7f046c1ed210 2024-01-20T08:12:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.463+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046400bb80 con 0x7f046c1ed210 2024-01-20T08:12:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.463+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0464007070 con 0x7f046c1ed210 2024-01-20T08:12:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.463+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046c09ebc0 con 0x7f046c1ed210 2024-01-20T08:12:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.463+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046c0a0380 con 0x7f046c1ed210 2024-01-20T08:12:50.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.464+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f046c09f0e0 con 0x7f046c1ed210 2024-01-20T08:12:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.465+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f04640071d0 con 0x7f046c1ed210 2024-01-20T08:12:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.466+0000 7f0462000640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 0x7f044406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.466+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0464089ad0 con 0x7f046c1ed210 2024-01-20T08:12:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.466+0000 7f0469e00640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 0x7f044406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.467+0000 7f0469e00640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 0x7f044406d3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f045c006fd0 tx=0x7f045c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.473 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.471+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f046c09f0e0 con 0x7f046c1ed210 2024-01-20T08:12:50.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.662+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f046c09f0e0 con 0x7f046c1ed210 2024-01-20T08:12:50.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.663+0000 7f0462000640 1 -- 172.21.15.100:0/839468146 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v56) v1 ==== 101+0+11 (secure 0 0 0) 0x7f046c09f0e0 con 0x7f046c1ed210 2024-01-20T08:12:50.665 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:50.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 msgr2=0x7f044406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 0x7f044406d3c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f045c006fd0 tx=0x7f045c008040 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 msgr2=0x7f046c1ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f0464001580 tx=0x7f046400b4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 shutdown_connections 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f046c1ed210 0x7f046c1ed6c0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f044406af00 0x7f044406d3c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f046c153130 0x7f046c1535b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 --2- 172.21.15.100:0/839468146 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f044c0069d0 0x7f046c09fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 >> 172.21.15.100:0/839468146 conn(0x7f046c0c5ba0 msgr2=0x7f046c0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 shutdown_connections 2024-01-20T08:12:50.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.666+0000 7f046b200640 1 -- 172.21.15.100:0/839468146 wait complete. 2024-01-20T08:12:50.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.884+0000 7fece1e00640 1 Processor -- start 2024-01-20T08:12:50.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.884+0000 7fece1e00640 1 -- start start 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fece1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecdc0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fece1e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0c1670 con 0x7fecdc151f60 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fece1e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc070800 con 0x7fecdc070370 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fece1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c2210 con 0x7fecdc147f20 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fecd1e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fecdc151f60 0x7fecdc0c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37218/0 (socket says 172.21.15.100:37218) 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.886+0000 7fecd1e00640 1 -- 172.21.15.100:0/4235563773 learned_addr learned my addr 172.21.15.100:0/4235563773 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:50.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecdaa00640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecdc0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802754277 0 0) 0x7fecdc0c1670 con 0x7fecdc151f60 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecbc005730 con 0x7fecdc151f60 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2751120044 0 0) 0x7fecbc005730 con 0x7fecdc151f60 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 msgr2=0x7fecdc0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecdc0abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 >> v1:172.21.15.110:6789/0 conn(0x7fecdc070370 legacy=0x7fecdc0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc0c0d40 con 0x7fecdc151f60 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fecc4001670 con 0x7fecdc151f60 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 >> v1:172.21.15.100:6789/0 conn(0x7fecdc151f60 legacy=0x7fecdc0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecbc005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006180 0x7fecbc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc006f10 0x7fecbc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0c2210 con 0x7fecbc006f10 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00dcd0 con 0x7fecbc006180 2024-01-20T08:12:50.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.887+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecbc00de90 con 0x7fecdc147f20 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc006f10 0x7fecbc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecd1e00640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006180 0x7fecbc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdaa00640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecbc005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 -- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 msgr2=0x7fecbc005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc147f20 0x7fecbc005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 -- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006180 msgr2=0x7fecbc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006180 0x7fecbc0069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.888+0000 7fecdb400640 1 -- 172.21.15.100:0/4235563773 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc005730 con 0x7fecbc006f10 2024-01-20T08:12:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.889+0000 7fecdb400640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc006f10 0x7fecbc007390 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fecd4001750 tx=0x7fecbc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fe8dc5ec251692 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.889+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40052d0 con 0x7fecbc006f10 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.889+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd402e050 con 0x7fecbc006f10 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.889+0000 7fecda000640 1 -- 172.21.15.100:0/4235563773 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4003830 con 0x7fecbc006f10 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 -- 172.21.15.100:0/4235563773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc006f10 msgr2=0x7fecbc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 --2- 172.21.15.100:0/4235563773 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecbc006f10 0x7fecbc007390 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fecd4001750 tx=0x7fecbc007a00 comp rx=0 tx=0).stop 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fecdb400640 1 -- 172.21.15.100:0/4235563773 reap_dead start 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 -- 172.21.15.100:0/4235563773 shutdown_connections 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 -- 172.21.15.100:0/4235563773 >> 172.21.15.100:0/4235563773 conn(0x7fecdc06a5e0 msgr2=0x7fecdc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 -- 172.21.15.100:0/4235563773 shutdown_connections 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.890+0000 7fece1e00640 1 -- 172.21.15.100:0/4235563773 wait complete. 2024-01-20T08:12:50.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.892+0000 7fece1e00640 1 Processor -- start 2024-01-20T08:12:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.892+0000 7fece1e00640 1 -- start start 2024-01-20T08:12:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 0x7fecdc141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc14f970 0x7fecdc0c4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1508f0 con 0x7fecdc141cb0 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc142110 con 0x7fecbc006f10 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fece1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc1eacb0 con 0x7fecdc14f970 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fecd1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60082/0 (socket says 172.21.15.100:60082) 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.893+0000 7fecd1e00640 1 -- 172.21.15.100:0/184765900 learned_addr learned my addr 172.21.15.100:0/184765900 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecdaa00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 0x7fecdc141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 -- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc14f970 msgr2=0x7fecdc0c4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc14f970 0x7fecdc0c4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 -- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 msgr2=0x7fecdc141770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 0x7fecdc141770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 -- 172.21.15.100:0/184765900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc1eaf90 con 0x7fecdc141cb0 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecdaa00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 0x7fecdc141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e7e0 tx=0x7fecc400eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400c850 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc400c9b0 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc0c5640 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400cd60 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.894+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0c5c00 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.896+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc04e970 con 0x7fecdc141cb0 2024-01-20T08:12:50.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.896+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fecc401d460 con 0x7fecdc141cb0 2024-01-20T08:12:50.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.897+0000 7fecd3e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 0x7fecb406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:50.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.897+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fecc4089970 con 0x7fecdc141cb0 2024-01-20T08:12:50.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.898+0000 7fecdaa00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 0x7fecb406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:50.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.898+0000 7fecdaa00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 0x7fecb406d390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feccc007440 tx=0x7feccc00b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:50.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:50.902+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fecc4054570 con 0x7fecdc141cb0 2024-01-20T08:12:51.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.140+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecdc0c38d0 con 0x7fecdc141cb0 2024-01-20T08:12:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.141+0000 7fecd3e00640 1 -- 172.21.15.100:0/184765900 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6191 (secure 0 0 0) 0x7fecc40015a0 con 0x7fecdc141cb0 2024-01-20T08:12:51.143 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:51.143 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:51.143 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 msgr2=0x7fecb406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 0x7fecb406d390 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7feccc007440 tx=0x7feccc00b040 comp rx=0 tx=0).stop 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 msgr2=0x7fecdc14f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fecc400e7e0 tx=0x7fecc400eca0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 shutdown_connections 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fecb406aed0 0x7fecb406d390 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecdc14f970 0x7fecdc0c4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecdc141cb0 0x7fecdc14f430 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 --2- 172.21.15.100:0/184765900 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecbc006f10 0x7fecdc141770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 >> 172.21.15.100:0/184765900 conn(0x7fecdc06a5e0 msgr2=0x7fecdc0c2be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 shutdown_connections 2024-01-20T08:12:51.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.144+0000 7fece1e00640 1 -- 172.21.15.100:0/184765900 wait complete. 2024-01-20T08:12:51.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.367+0000 7fc23c000640 1 Processor -- start 2024-01-20T08:12:51.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.367+0000 7fc23c000640 1 -- start start 2024-01-20T08:12:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.368+0000 7fc23c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 0x7fc234153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.368+0000 7fc23c000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2340a93c0 0x7fc234152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc23c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2340a9940 con 0x7fc234153440 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc23c000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2341500c0 con 0x7fc2340a93c0 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc23c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc234156810 con 0x7fc23414fce0 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2340a93c0 0x7fc234152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2340a93c0 0x7fc234152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60084/0 (socket says 172.21.15.100:60084) 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 -- 172.21.15.100:0/1317863677 learned_addr learned my addr 172.21.15.100:0/1317863677 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc23a000640 1 --1- 172.21.15.100:0/1317863677 >> v1:172.21.15.100:6789/0 conn(0x7fc234153440 0x7fc2340aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37232/0 (socket says 172.21.15.100:37232) 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc239600640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 0x7fc234153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 -- 172.21.15.100:0/1317863677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 msgr2=0x7fc234153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 0x7fc234153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 -- 172.21.15.100:0/1317863677 >> v1:172.21.15.100:6789/0 conn(0x7fc234153440 legacy=0x7fc2340aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc238c00640 1 -- 172.21.15.100:0/1317863677 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc234156af0 con 0x7fc2340a93c0 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc233e00640 1 -- 172.21.15.100:0/1317863677 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122916950 0 0) 0x7fc2340a9940 con 0x7fc234153440 2024-01-20T08:12:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.369+0000 7fc239600640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 0x7fc234153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc238c00640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2340a93c0 0x7fc234152f00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009870 tx=0x7fc21c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd82596c7b743509 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc233e00640 1 -- 172.21.15.100:0/1317863677 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c030840 con 0x7fc2340a93c0 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc233e00640 1 -- 172.21.15.100:0/1317863677 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc21c0309a0 con 0x7fc2340a93c0 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc233e00640 1 -- 172.21.15.100:0/1317863677 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21c030d30 con 0x7fc2340a93c0 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc23c000640 1 -- 172.21.15.100:0/1317863677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2340a93c0 msgr2=0x7fc234152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.371+0000 7fc23c000640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2340a93c0 0x7fc234152f00 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc21c009870 tx=0x7fc21c02b980 comp rx=0 tx=0).stop 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 -- 172.21.15.100:0/1317863677 shutdown_connections 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2340a93c0 0x7fc234152f00 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 --2- 172.21.15.100:0/1317863677 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc23414fce0 0x7fc234153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 -- 172.21.15.100:0/1317863677 >> 172.21.15.100:0/1317863677 conn(0x7fc23406a5e0 msgr2=0x7fc23406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 -- 172.21.15.100:0/1317863677 shutdown_connections 2024-01-20T08:12:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.372+0000 7fc23c000640 1 -- 172.21.15.100:0/1317863677 wait complete. 2024-01-20T08:12:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.373+0000 7fc23c000640 1 Processor -- start 2024-01-20T08:12:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.373+0000 7fc23c000640 1 -- start start 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 0x7fc234143bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 0x7fc2340c05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc234148490 con 0x7fc234153440 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340c28d0 con 0x7fc23414fce0 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.374+0000 7fc23c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2340c2dc0 con 0x7fc2340a93c0 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60094/0 (socket says 172.21.15.100:60094) 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 -- 172.21.15.100:0/3153082179 learned_addr learned my addr 172.21.15.100:0/3153082179 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc239600640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 0x7fc234143bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc238c00640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 0x7fc2340c05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 -- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 msgr2=0x7fc234143bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 0x7fc234143bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 -- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 msgr2=0x7fc2340c05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 0x7fc2340c05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 -- 172.21.15.100:0/3153082179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc21c0094d0 con 0x7fc234153440 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc239600640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 0x7fc234143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc238c00640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 0x7fc2340c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.375+0000 7fc23a000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c700 tx=0x7fc22c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.376+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00ce10 con 0x7fc234153440 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.376+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22c00a640 con 0x7fc234153440 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.376+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22c00aa70 con 0x7fc234153440 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.376+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2341ebfe0 con 0x7fc234153440 2024-01-20T08:12:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.376+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2340c2ae0 con 0x7fc234153440 2024-01-20T08:12:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.377+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23404e970 con 0x7fc234153440 2024-01-20T08:12:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.378+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc22c00abd0 con 0x7fc234153440 2024-01-20T08:12:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.379+0000 7fc231600640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 0x7fc20c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.379+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc22c088e20 con 0x7fc234153440 2024-01-20T08:12:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.379+0000 7fc239600640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 0x7fc20c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.380+0000 7fc239600640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 0x7fc20c06d390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc2341509f0 tx=0x7fc224008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.383+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc22c053a20 con 0x7fc234153440 2024-01-20T08:12:51.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.578+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc234144be0 con 0x7fc234153440 2024-01-20T08:12:51.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.582+0000 7fc231600640 1 -- 172.21.15.100:0/3153082179 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7fc22c018070 con 0x7fc234153440 2024-01-20T08:12:51.584 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:51.584 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 msgr2=0x7fc20c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 0x7fc20c06d390 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc2341509f0 tx=0x7fc224008040 comp rx=0 tx=0).stop 2024-01-20T08:12:51.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 msgr2=0x7fc23414c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00c700 tx=0x7fc22c00cbc0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 shutdown_connections 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc234153440 0x7fc23414c9d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc23414fce0 0x7fc2340c05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc20c06aed0 0x7fc20c06d390 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 --2- 172.21.15.100:0/3153082179 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2340a93c0 0x7fc234143bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 >> 172.21.15.100:0/3153082179 conn(0x7fc23406a5e0 msgr2=0x7fc23414daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 shutdown_connections 2024-01-20T08:12:51.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.584+0000 7fc23c000640 1 -- 172.21.15.100:0/3153082179 wait complete. 2024-01-20T08:12:51.605 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T08:12:51.605 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:51.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.807+0000 7f0d73e00640 1 Processor -- start 2024-01-20T08:12:51.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.808+0000 7f0d73e00640 1 -- start start 2024-01-20T08:12:51.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.809+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 0x7f0d6c155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.809+0000 7f0d73e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 0x7f0d6c155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.809+0000 7f0d73e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d6c155790 con 0x7f0d6c1519a0 2024-01-20T08:12:51.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.809+0000 7f0d73e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d6c0c8650 con 0x7f0d6c0c8ae0 2024-01-20T08:12:51.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.809+0000 7f0d73e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0c8070 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.810+0000 7f0d71400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 0x7f0d6c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.810+0000 7f0d70a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 0x7f0d6c155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.810+0000 7f0d71e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7f0d6c1519a0 0x7f0d6c157dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:35128/0 (socket says 172.21.15.100:35128) 2024-01-20T08:12:51.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.810+0000 7f0d71e00640 1 -- 172.21.15.100:0/298949594 learned_addr learned my addr 172.21.15.100:0/298949594 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.811+0000 7f0d71400640 1 -- 172.21.15.100:0/298949594 >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 msgr2=0x7f0d6c155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.810+0000 7f0d6be00640 1 -- 172.21.15.100:0/298949594 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 828275294 0 0) 0x7f0d64001110 con 0x7f0d6c1519a0 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.811+0000 7f0d71400640 1 --2- 172.21.15.100:0/298949594 >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 0x7f0d6c155cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.811+0000 7f0d71400640 1 -- 172.21.15.100:0/298949594 >> v1:172.21.15.110:6789/0 conn(0x7f0d6c1519a0 legacy=0x7f0d6c157dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.811+0000 7f0d71400640 1 -- 172.21.15.100:0/298949594 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d6c0c4dd0 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.811+0000 7f0d70a00640 1 --2- 172.21.15.100:0/298949594 >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 0x7f0d6c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.812+0000 7f0d71400640 1 --2- 172.21.15.100:0/298949594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 0x7f0d6c155250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097a0 tx=0x7f0d5402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c75d5061e11e7dab server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.813+0000 7f0d6be00640 1 -- 172.21.15.100:0/298949594 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54031780 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.813+0000 7f0d6be00640 1 -- 172.21.15.100:0/298949594 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d540318e0 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.813+0000 7f0d6be00640 1 -- 172.21.15.100:0/298949594 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54031c70 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 -- 172.21.15.100:0/298949594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 msgr2=0x7f0d6c155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 --2- 172.21.15.100:0/298949594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 0x7f0d6c155250 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0d540097a0 tx=0x7f0d5402b820 comp rx=0 tx=0).stop 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 -- 172.21.15.100:0/298949594 shutdown_connections 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 --2- 172.21.15.100:0/298949594 >> v2:172.21.15.110:3300/0 conn(0x7f0d6c0c8ae0 0x7f0d6c155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 --2- 172.21.15.100:0/298949594 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c06b3b0 0x7f0d6c155250 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 -- 172.21.15.100:0/298949594 >> 172.21.15.100:0/298949594 conn(0x7f0d6c0abc00 msgr2=0x7f0d6c0ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 -- 172.21.15.100:0/298949594 shutdown_connections 2024-01-20T08:12:51.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.814+0000 7f0d73e00640 1 -- 172.21.15.100:0/298949594 wait complete. 2024-01-20T08:12:51.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.816+0000 7f0d73e00640 1 Processor -- start 2024-01-20T08:12:51.818 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.816+0000 7f0d73e00640 1 -- start start 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d6c06b3b0 0x7f0d6c0c1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 0x7f0d6c1eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1ea620 con 0x7f0d6c1519a0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c1ea320 con 0x7f0d6c06b3b0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d73e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6c0c39e0 con 0x7f0d6c0c8ae0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d71e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d71e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60098/0 (socket says 172.21.15.100:60098) 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.817+0000 7f0d71e00640 1 -- 172.21.15.100:0/3304631705 learned_addr learned my addr 172.21.15.100:0/3304631705 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71400640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d6c06b3b0 0x7f0d6c0c1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d70a00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 0x7f0d6c1eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 -- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 msgr2=0x7f0d6c1eaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.820 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 0x7f0d6c1eaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 -- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d6c06b3b0 msgr2=0x7f0d6c0c1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d6c06b3b0 0x7f0d6c0c1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 -- 172.21.15.100:0/3304631705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c009a70 con 0x7f0d6c1519a0 2024-01-20T08:12:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d70a00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 0x7f0d6c1eaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:51.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d71e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c7b0 tx=0x7f0d6400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d640072d0 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d64007430 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d64001d10 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.818+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d54009400 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.819+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6c0c3fa0 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.820+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d6c1ea7d0 con 0x7f0d6c1519a0 2024-01-20T08:12:51.822 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.821+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0d640047e0 con 0x7f0d6c1519a0 2024-01-20T08:12:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.821+0000 7f0d69600640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 0x7f0d4406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:51.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.822+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f0d640887e0 con 0x7f0d6c1519a0 2024-01-20T08:12:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.822+0000 7f0d71400640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 0x7f0d4406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:51.824 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.823+0000 7f0d71400640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 0x7f0d4406d3c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d54036000 tx=0x7f0d5403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:51.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:51.826+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0d6c1ea7d0 con 0x7f0d6c1519a0 2024-01-20T08:12:52.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.055+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d6c155790 con 0x7f0d6c1519a0 2024-01-20T08:12:52.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.057+0000 7f0d69600640 1 -- 172.21.15.100:0/3304631705 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6191 (secure 0 0 0) 0x7f0d6c155790 con 0x7f0d6c1519a0 2024-01-20T08:12:52.059 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:52.059 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:52.059 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 msgr2=0x7f0d4406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 0x7f0d4406d3c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0d54036000 tx=0x7f0d5403d040 comp rx=0 tx=0).stop 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 msgr2=0x7f0d6c0be2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f0d6400c7b0 tx=0x7f0d6400cc70 comp rx=0 tx=0).stop 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 shutdown_connections 2024-01-20T08:12:52.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d6c1519a0 0x7f0d6c0be2f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0d4406af00 0x7f0d4406d3c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d6c0c8ae0 0x7f0d6c1eaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 --2- 172.21.15.100:0/3304631705 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d6c06b3b0 0x7f0d6c0c1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 >> 172.21.15.100:0/3304631705 conn(0x7f0d6c0abc00 msgr2=0x7f0d6c0bd320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 shutdown_connections 2024-01-20T08:12:52.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.059+0000 7f0d73e00640 1 -- 172.21.15.100:0/3304631705 wait complete. 2024-01-20T08:12:52.079 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:52.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.283+0000 7f2810800640 1 Processor -- start 2024-01-20T08:12:52.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.283+0000 7f2810800640 1 -- start start 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f2810800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808147f20 0x7f28080abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f2810800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2808070370 0x7f28080c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f2810800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080c1670 con 0x7f2808151f60 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f2810800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080c2210 con 0x7f2808070370 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f2810800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28081524b0 con 0x7f2808147f20 2024-01-20T08:12:52.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f280e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2808070370 0x7f28080c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f280e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2808070370 0x7f28080c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60102/0 (socket says 172.21.15.100:60102) 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.285+0000 7f280e800640 1 -- 172.21.15.100:0/2571943845 learned_addr learned my addr 172.21.15.100:0/2571943845 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.286+0000 7f280de00640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808147f20 0x7f28080abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.286+0000 7f280e800640 1 -- 172.21.15.100:0/2571943845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808147f20 msgr2=0x7f28080abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.286+0000 7f280e800640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808147f20 0x7f28080abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.286+0000 7f280e800640 1 -- 172.21.15.100:0/2571943845 >> v1:172.21.15.110:6789/0 conn(0x7f2808151f60 legacy=0x7f28080c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.288 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.286+0000 7f280e800640 1 -- 172.21.15.100:0/2571943845 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2808070800 con 0x7f2808070370 2024-01-20T08:12:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.287+0000 7f280e800640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808070370 0x7f28080c2c30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2800009e50 tx=0x7f280002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb922b8a84a7fbc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.287+0000 7f280ca00640 1 -- 172.21.15.100:0/2571943845 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280002caf0 con 0x7f2808070370 2024-01-20T08:12:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.287+0000 7f280ca00640 1 -- 172.21.15.100:0/2571943845 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280002cc50 con 0x7f2808070370 2024-01-20T08:12:52.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.287+0000 7f280ca00640 1 -- 172.21.15.100:0/2571943845 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000343f0 con 0x7f2808070370 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 -- 172.21.15.100:0/2571943845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808070370 msgr2=0x7f28080c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808070370 0x7f28080c2c30 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f2800009e50 tx=0x7f280002bf50 comp rx=0 tx=0).stop 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 -- 172.21.15.100:0/2571943845 shutdown_connections 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808070370 0x7f28080c2c30 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 --2- 172.21.15.100:0/2571943845 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808147f20 0x7f28080abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 -- 172.21.15.100:0/2571943845 >> 172.21.15.100:0/2571943845 conn(0x7f280806a5e0 msgr2=0x7f280806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 -- 172.21.15.100:0/2571943845 shutdown_connections 2024-01-20T08:12:52.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.288+0000 7f2810800640 1 -- 172.21.15.100:0/2571943845 wait complete. 2024-01-20T08:12:52.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.290+0000 7f2810800640 1 Processor -- start 2024-01-20T08:12:52.292 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.290+0000 7f2810800640 1 -- start start 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808070370 0x7f28081df340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2808147f20 0x7f28081552b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081ed4b0 con 0x7f2808151f60 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28081df880 con 0x7f2808147f20 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f2810800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280814e690 con 0x7f2808070370 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f280e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f280e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60108/0 (socket says 172.21.15.100:60108) 2024-01-20T08:12:52.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.291+0000 7f280e800640 1 -- 172.21.15.100:0/2866198689 learned_addr learned my addr 172.21.15.100:0/2866198689 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:52.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 -- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808070370 msgr2=0x7f28081df340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280d400640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2808147f20 0x7f28081552b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280de00640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808070370 0x7f28081df340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808070370 0x7f28081df340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 -- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2808147f20 msgr2=0x7f28081552b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2808147f20 0x7f28081552b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 -- 172.21.15.100:0/2866198689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2800009b30 con 0x7f2808151f60 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f280e800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2800036040 tx=0x7f2800004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800009510 con 0x7f2808151f60 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280003e450 con 0x7f2808151f60 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280003e7e0 con 0x7f2808151f60 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280814e970 con 0x7f2808151f60 2024-01-20T08:12:52.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.292+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28081557f0 con 0x7f2808151f60 2024-01-20T08:12:52.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.294+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28081ed620 con 0x7f2808151f60 2024-01-20T08:12:52.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.294+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f280003e940 con 0x7f2808151f60 2024-01-20T08:12:52.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.295+0000 7f2806000640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.295+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f28000ac400 con 0x7f2808151f60 2024-01-20T08:12:52.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.295+0000 7f280de00640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.296+0000 7f280de00640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 0x7f27e006d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006fd0 tx=0x7f27f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.300+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2800077000 con 0x7f2808151f60 2024-01-20T08:12:52.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.511+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f280804e970 con 0x7f2808151f60 2024-01-20T08:12:52.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.512+0000 7f2806000640 1 -- 172.21.15.100:0/2866198689 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+6191 (secure 0 0 0) 0x7f2800047e90 con 0x7f2808151f60 2024-01-20T08:12:52.515 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:52.515 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":37,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:06.508402+0000","modified":"2024-01-20T08:12:09.558331+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5679},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5679":{"gid":5679,"name":"b","rank":0,"incarnation":28,"state":"up:active","state_seq":3,"addr":"172.21.15.110:6835/1123618406","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1123618406},{"type":"v1","addr":"172.21.15.110:6835","nonce":1123618406}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4},{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:52.515 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 37 2024-01-20T08:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 msgr2=0x7f27e006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 0x7f27e006d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f27f8006fd0 tx=0x7f27f8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 msgr2=0x7f2808144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f2800036040 tx=0x7f2800004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:52.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 shutdown_connections 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2808151f60 0x7f2808144ac0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2808147f20 0x7f28081552b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f27e006af00 0x7f27e006d3c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 --2- 172.21.15.100:0/2866198689 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2808070370 0x7f28081df340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 >> 172.21.15.100:0/2866198689 conn(0x7f280806a5e0 msgr2=0x7f28080c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 shutdown_connections 2024-01-20T08:12:52.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.515+0000 7f2810800640 1 -- 172.21.15.100:0/2866198689 wait complete. 2024-01-20T08:12:52.535 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.735+0000 7f339ac00640 1 Processor -- start 2024-01-20T08:12:52.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.735+0000 7f339ac00640 1 -- start start 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940c5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339ac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f339414de40 0x7f339414e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3394150e40 con 0x7f33940a50d0 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339ac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3394072d10 con 0x7f339414de40 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3394150c30 con 0x7f33940a4b80 2024-01-20T08:12:52.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f3398e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f33940a50d0 0x7f33940c39b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37248/0 (socket says 172.21.15.100:37248) 2024-01-20T08:12:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f3398e00640 1 -- 172.21.15.100:0/2340401029 learned_addr learned my addr 172.21.15.100:0/2340401029 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.736+0000 7f339a200640 1 --2- 172.21.15.100:0/2340401029 >> v2:172.21.15.100:3300/0 conn(0x7f339414de40 0x7f339414e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f3399800640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940c5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f3393e00640 1 -- 172.21.15.100:0/2340401029 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4157579538 0 0) 0x7f3394150e40 con 0x7f33940a50d0 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f3393e00640 1 -- 172.21.15.100:0/2340401029 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3374003520 con 0x7f33940a50d0 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f339a200640 1 -- 172.21.15.100:0/2340401029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 msgr2=0x7f33940c5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f339a200640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940c5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f339a200640 1 -- 172.21.15.100:0/2340401029 >> v1:172.21.15.100:6789/0 conn(0x7f33940a50d0 legacy=0x7f33940c39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.737+0000 7f339a200640 1 -- 172.21.15.100:0/2340401029 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3394151120 con 0x7f339414de40 2024-01-20T08:12:52.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.738+0000 7f339a200640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f339414e2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314cd8c513242dd0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.738+0000 7f3393e00640 1 -- 172.21.15.100:0/2340401029 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c02cbc0 con 0x7f339414de40 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.738+0000 7f3393e00640 1 -- 172.21.15.100:0/2340401029 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c02cd20 con 0x7f339414de40 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.738+0000 7f3393e00640 1 -- 172.21.15.100:0/2340401029 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c034660 con 0x7f339414de40 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 -- 172.21.15.100:0/2340401029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 msgr2=0x7f339414e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f339414e2d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f338c009d90 tx=0x7f338c02be10 comp rx=0 tx=0).stop 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 -- 172.21.15.100:0/2340401029 shutdown_connections 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f339414e2d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 --2- 172.21.15.100:0/2340401029 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940c5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 -- 172.21.15.100:0/2340401029 >> 172.21.15.100:0/2340401029 conn(0x7f33940c2590 msgr2=0x7f33940c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:52.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 -- 172.21.15.100:0/2340401029 shutdown_connections 2024-01-20T08:12:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.739+0000 7f339ac00640 1 -- 172.21.15.100:0/2340401029 wait complete. 2024-01-20T08:12:52.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.741+0000 7f339ac00640 1 Processor -- start 2024-01-20T08:12:52.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.741+0000 7f339ac00640 1 -- start start 2024-01-20T08:12:52.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940bf130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33940a50d0 0x7f3394143410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33940c2210 con 0x7f339414de40 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3394143e90 con 0x7f33940a50d0 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3394149340 con 0x7f33940a4b80 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60132/0 (socket says 172.21.15.100:60132) 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 -- 172.21.15.100:0/10002547 learned_addr learned my addr 172.21.15.100:0/10002547 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f3399800640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940bf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 -- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 msgr2=0x7f33940bf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940bf130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f3398e00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33940a50d0 0x7f3394143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 -- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33940a50d0 msgr2=0x7f3394143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33940a50d0 0x7f3394143410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.742+0000 7f339a200640 1 -- 172.21.15.100:0/10002547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f338c009a70 con 0x7f339414de40 2024-01-20T08:12:52.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f339a200640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f338c009eb0 tx=0x7f338c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c040650 con 0x7f339414de40 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f338c02ce90 con 0x7f339414de40 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338c0409f0 con 0x7f339414de40 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33940c1f30 con 0x7f339414de40 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.743+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33941498c0 con 0x7f339414de40 2024-01-20T08:12:52.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.744+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33941491a0 con 0x7f339414de40 2024-01-20T08:12:52.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.745+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f338c040b50 con 0x7f339414de40 2024-01-20T08:12:52.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.746+0000 7f3391600640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 0x7f336c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:52.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.746+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f338c0ac670 con 0x7f339414de40 2024-01-20T08:12:52.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.746+0000 7f3399800640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 0x7f336c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:52.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.747+0000 7f3399800640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 0x7f336c06d3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:52.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.750+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f33941491a0 con 0x7f339414de40 2024-01-20T08:12:52.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.943+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33941491a0 con 0x7f339414de40 2024-01-20T08:12:52.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.947+0000 7f3391600640 1 -- 172.21.15.100:0/10002547 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+20257 (secure 0 0 0) 0x7f33941491a0 con 0x7f339414de40 2024-01-20T08:12:52.950 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:52.950 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":56,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:28.093015+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:12:04.385777+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-01-20T08:12:05.510105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"52","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 msgr2=0x7f336c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 0x7f336c06d3c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3384006fd0 tx=0x7f3384008040 comp rx=0 tx=0).stop 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 msgr2=0x7f3394143950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f338c009eb0 tx=0x7f338c004a40 comp rx=0 tx=0).stop 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 shutdown_connections 2024-01-20T08:12:52.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f339414de40 0x7f3394143950 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33940a50d0 0x7f3394143410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f336c06af00 0x7f336c06d3c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 --2- 172.21.15.100:0/10002547 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33940a4b80 0x7f33940bf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 >> 172.21.15.100:0/10002547 conn(0x7f33940c2590 msgr2=0x7f3394072230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 shutdown_connections 2024-01-20T08:12:52.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:52.950+0000 7f339ac00640 1 -- 172.21.15.100:0/10002547 wait complete. 2024-01-20T08:12:52.970 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T08:12:53.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.159+0000 7f07e7000640 1 Processor -- start 2024-01-20T08:12:53.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.159+0000 7f07e7000640 1 -- start start 2024-01-20T08:12:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.160+0000 7f07e7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e014b720 0x7f07e01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.163 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.160+0000 7f07e7000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e0154ba0 con 0x7f07e00c1850 2024-01-20T08:12:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.160+0000 7f07e7000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e0155a00 con 0x7f07e00c1d00 2024-01-20T08:12:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.160+0000 7f07e7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e014bb00 con 0x7f07e014b720 2024-01-20T08:12:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e014b720 0x7f07e01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f07e014b720 0x7f07e01515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60142/0 (socket says 172.21.15.100:60142) 2024-01-20T08:12:53.164 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 -- 172.21.15.100:0/3242927196 learned_addr learned my addr 172.21.15.100:0/3242927196 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 -- 172.21.15.100:0/3242927196 >> v1:172.21.15.110:6789/0 conn(0x7f07e00c1d00 legacy=0x7f07e006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 -- 172.21.15.100:0/3242927196 >> v1:172.21.15.100:6789/0 conn(0x7f07e00c1850 legacy=0x7f07e006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dea00640 1 -- 172.21.15.100:0/3242927196 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670641991 0 0) 0x7f07e0154ba0 con 0x7f07e00c1850 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.161+0000 7f07dfe00640 1 -- 172.21.15.100:0/3242927196 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e0154df0 con 0x7f07e014b720 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.162+0000 7f07dfe00640 1 --2- 172.21.15.100:0/3242927196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e01515b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009870 tx=0x7f07d002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fcd363d94204a9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.162+0000 7f07dea00640 1 -- 172.21.15.100:0/3242927196 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d00317e0 con 0x7f07e014b720 2024-01-20T08:12:53.165 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07dea00640 1 -- 172.21.15.100:0/3242927196 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0031940 con 0x7f07e014b720 2024-01-20T08:12:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07dea00640 1 -- 172.21.15.100:0/3242927196 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0031cd0 con 0x7f07e014b720 2024-01-20T08:12:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 -- 172.21.15.100:0/3242927196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 msgr2=0x7f07e01515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.166 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 --2- 172.21.15.100:0/3242927196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e01515b0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f07d0009870 tx=0x7f07d002b880 comp rx=0 tx=0).stop 2024-01-20T08:12:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 -- 172.21.15.100:0/3242927196 shutdown_connections 2024-01-20T08:12:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 --2- 172.21.15.100:0/3242927196 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e01515b0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 -- 172.21.15.100:0/3242927196 >> 172.21.15.100:0/3242927196 conn(0x7f07e00c2940 msgr2=0x7f07e00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 -- 172.21.15.100:0/3242927196 shutdown_connections 2024-01-20T08:12:53.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.163+0000 7f07e7000640 1 -- 172.21.15.100:0/3242927196 wait complete. 2024-01-20T08:12:53.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.165+0000 7f07e7000640 1 Processor -- start 2024-01-20T08:12:53.168 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.165+0000 7f07e7000640 1 -- start start 2024-01-20T08:12:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00c1850 0x7f07e014bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00c1d00 0x7f07e01ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01daf80 con 0x7f07e014b720 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e0149460 con 0x7f07e00c1850 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.166+0000 7f07e7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e01496b0 con 0x7f07e00c1d00 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60144/0 (socket says 172.21.15.100:60144) 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 -- 172.21.15.100:0/3696574853 learned_addr learned my addr 172.21.15.100:0/3696574853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07dfe00640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00c1850 0x7f07e014bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07df400640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00c1d00 0x7f07e01ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 -- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00c1d00 msgr2=0x7f07e01ed6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00c1d00 0x7f07e01ed6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 -- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00c1850 msgr2=0x7f07e014bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00c1850 0x7f07e014bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 -- 172.21.15.100:0/3696574853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d00094d0 con 0x7f07e014b720 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.167+0000 7f07e5000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7b0 tx=0x7f07d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.168+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d8004b60 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.168+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d8004cc0 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.168+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800aa90 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.168+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e01ee170 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.168+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e014c9b0 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.169+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e004e970 con 0x7f07e014b720 2024-01-20T08:12:53.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.170+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f07d800abf0 con 0x7f07e014b720 2024-01-20T08:12:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.171+0000 7f07d7e00640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 0x7f07b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.171+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f07d8089ae0 con 0x7f07e014b720 2024-01-20T08:12:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.171+0000 7f07dfe00640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 0x7f07b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.172+0000 7f07dfe00640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 0x7f07b806d390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07d0036000 tx=0x7f07d003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.175+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f07d8054640 con 0x7f07e014b720 2024-01-20T08:12:53.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.404+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f07e00c37e0 con 0x7f07e014b720 2024-01-20T08:12:53.407 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:12:53.404+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:12:53.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.408+0000 7f07d7e00640 1 -- 172.21.15.100:0/3696574853 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v38) v1 ==== 161+0+0 (secure 0 0 0) 0x7f07d8057c60 con 0x7f07e014b720 2024-01-20T08:12:53.412 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:12:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.411+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 msgr2=0x7f07b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.411+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 0x7f07b806d390 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f07d0036000 tx=0x7f07d003d040 comp rx=0 tx=0).stop 2024-01-20T08:12:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.411+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 msgr2=0x7f07e0150470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.411+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f07d800c7b0 tx=0x7f07d800cc70 comp rx=0 tx=0).stop 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 shutdown_connections 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07e014b720 0x7f07e0150470 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07b806aed0 0x7f07b806d390 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07e00c1d00 0x7f07e01ed6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 --2- 172.21.15.100:0/3696574853 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07e00c1850 0x7f07e014bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 >> 172.21.15.100:0/3696574853 conn(0x7f07e00c2940 msgr2=0x7f07e00c55f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 shutdown_connections 2024-01-20T08:12:53.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.412+0000 7f07e7000640 1 -- 172.21.15.100:0/3696574853 wait complete. 2024-01-20T08:12:53.435 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T08:12:53.439 INFO:tasks.ceph.mds.b.smithi110.stderr: -3064> 2024-01-20T08:12:12.607+0000 7f1bf4200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:12:53.521 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:12:53.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.634+0000 7f0802400640 1 Processor -- start 2024-01-20T08:12:53.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.634+0000 7f0802400640 1 -- start start 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f0802400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 0x7f07fc157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f0802400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc071d00 con 0x7f07fc0c24f0 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f0802400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07fc071fa0 con 0x7f07fc1550c0 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f0802400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc154ca0 con 0x7f07fc158af0 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f07faa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f07fc0c24f0 0x7f07fc06e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37276/0 (socket says 172.21.15.100:37276) 2024-01-20T08:12:53.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.636+0000 7f07faa00640 1 -- 172.21.15.100:0/373365258 learned_addr learned my addr 172.21.15.100:0/373365258 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fb400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 0x7f07fc157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611826701 0 0) 0x7f07fc071d00 con 0x7f07fc0c24f0 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07dc003520 con 0x7f07fc0c24f0 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2343501607 0 0) 0x7f07dc003520 con 0x7f07fc0c24f0 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 msgr2=0x7f07fc157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 0x7f07fc157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 >> v1:172.21.15.110:6789/0 conn(0x7f07fc1550c0 legacy=0x7f07fc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc072280 con 0x7f07fc0c24f0 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f07e4001670 con 0x7f07fc0c24f0 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 >> v1:172.21.15.100:6789/0 conn(0x7f07fc0c24f0 legacy=0x7f07fc06e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07dc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.637+0000 7f07fa000640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 0x7f07dc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fa000640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07dc004d00 0x7f07dc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc154ca0 con 0x7f07dc0039a0 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc00bb40 con 0x7f07dc004d00 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07dc00bd00 con 0x7f07fc158af0 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07dc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 -- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 msgr2=0x7f07dc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc158af0 0x7f07dc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 -- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07dc004d00 msgr2=0x7f07dc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07dc004d00 0x7f07dc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.638+0000 7f07fb400640 1 -- 172.21.15.100:0/373365258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07dc003520 con 0x7f07dc0039a0 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.639+0000 7f07fb400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07dc003dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ac0 tx=0x7f07dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1707ce1726b7f292 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.639+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec02c710 con 0x7f07dc0039a0 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.639+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec02c870 con 0x7f07dc0039a0 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.639+0000 7f07fa000640 1 -- 172.21.15.100:0/373365258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec02cc00 con 0x7f07dc0039a0 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 -- 172.21.15.100:0/373365258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 msgr2=0x7f07dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 --2- 172.21.15.100:0/373365258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07dc003dc0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009ac0 tx=0x7f07dc0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f07fbe00640 1 -- 172.21.15.100:0/373365258 reap_dead start 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 -- 172.21.15.100:0/373365258 shutdown_connections 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 -- 172.21.15.100:0/373365258 >> 172.21.15.100:0/373365258 conn(0x7f07fc0c2940 msgr2=0x7f07fc0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 -- 172.21.15.100:0/373365258 shutdown_connections 2024-01-20T08:12:53.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.640+0000 7f0802400640 1 -- 172.21.15.100:0/373365258 wait complete. 2024-01-20T08:12:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.642+0000 7f0802400640 1 Processor -- start 2024-01-20T08:12:53.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.642+0000 7f0802400640 1 -- start start 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc1dde10 0x7f07fc1466f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc1579b0 0x7f07fc146c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1deca0 con 0x7f07dc0039a0 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1ee8d0 con 0x7f07fc1579b0 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f0802400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07fc1deeb0 con 0x7f07fc1dde10 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f07fb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f07fb400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60160/0 (socket says 172.21.15.100:60160) 2024-01-20T08:12:53.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f07fb400640 1 -- 172.21.15.100:0/3245853865 learned_addr learned my addr 172.21.15.100:0/3245853865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.643+0000 7f07fb400640 1 -- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc1dde10 msgr2=0x7f07fc1466f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07fb400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc1dde10 0x7f07fc1466f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07fb400640 1 -- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc1579b0 msgr2=0x7f07fc146c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07fb400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc1579b0 0x7f07fc146c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07fb400640 1 -- 172.21.15.100:0/3245853865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07fc1df190 con 0x7f07dc0039a0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07fb400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f07ec000c00 tx=0x7f07ec004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec003810 con 0x7f07dc0039a0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ec02de90 con 0x7f07dc0039a0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07fc1df470 con 0x7f07dc0039a0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ec003b70 con 0x7f07dc0039a0 2024-01-20T08:12:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.644+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07fc1ee550 con 0x7f07dc0039a0 2024-01-20T08:12:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.645+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07fc04e970 con 0x7f07dc0039a0 2024-01-20T08:12:53.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.647+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f07ec003cd0 con 0x7f07dc0039a0 2024-01-20T08:12:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.648+0000 7f07f3400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.648+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6651+0+0 (secure 0 0 0) 0x7f07ec0ab910 con 0x7f07dc0039a0 2024-01-20T08:12:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.648+0000 7f07faa00640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:53.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.648+0000 7f07faa00640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 0x7f07d406d3c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f07e40011e0 tx=0x7f07e40014e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:53.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.652+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f07ec076440 con 0x7f07dc0039a0 2024-01-20T08:12:53.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:53.880+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f07fc1df600 con 0x7f07dc0039a0 2024-01-20T08:12:54.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.420+0000 7f07f3400640 1 -- 172.21.15.100:0/3245853865 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v39) v1 ==== 104+0+0 (secure 0 0 0) 0x7f07ec079a60 con 0x7f07dc0039a0 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 msgr2=0x7f07d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 0x7f07d406d3c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f07e40011e0 tx=0x7f07e40014e0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 msgr2=0x7f07fc0c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f07ec000c00 tx=0x7f07ec004730 comp rx=0 tx=0).stop 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 shutdown_connections 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f07fc1579b0 0x7f07fc146c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f07d406af00 0x7f07d406d3c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f07fc1dde10 0x7f07fc1466f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 --2- 172.21.15.100:0/3245853865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f07dc0039a0 0x7f07fc0c4cd0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 >> 172.21.15.100:0/3245853865 conn(0x7f07fc0c2940 msgr2=0x7f07fc0c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:54.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 shutdown_connections 2024-01-20T08:12:54.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.425+0000 7f0802400640 1 -- 172.21.15.100:0/3245853865 wait complete. 2024-01-20T08:12:54.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T08:12:54.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.662+0000 7fa236a00640 1 Processor -- start 2024-01-20T08:12:54.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.662+0000 7fa236a00640 1 -- start start 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa236a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2300c70b0 0x7fa2300c7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa236a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2300c9e90 con 0x7fa230155d70 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa236a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa23006b6a0 con 0x7fa230151fe0 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa236a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa23006b980 con 0x7fa2300c70b0 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa234a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa2300c70b0 0x7fa2300c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:54.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa22f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa230155d70 0x7fa2300c8880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37290/0 (socket says 172.21.15.100:37290) 2024-01-20T08:12:54.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.663+0000 7fa22f400640 1 -- 172.21.15.100:0/319476338 learned_addr learned my addr 172.21.15.100:0/319476338 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:54.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.664+0000 7fa234a00640 1 -- 172.21.15.100:0/319476338 >> v1:172.21.15.110:6789/0 conn(0x7fa230151fe0 legacy=0x7fa230155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.664+0000 7fa234a00640 1 -- 172.21.15.100:0/319476338 >> v1:172.21.15.100:6789/0 conn(0x7fa230155d70 legacy=0x7fa2300c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.664+0000 7fa234a00640 1 -- 172.21.15.100:0/319476338 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2300c8080 con 0x7fa2300c70b0 2024-01-20T08:12:54.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.664+0000 7fa22ea00640 1 -- 172.21.15.100:0/319476338 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3288983698 0 0) 0x7fa2300c9e90 con 0x7fa230155d70 2024-01-20T08:12:54.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa234a00640 1 --2- 172.21.15.100:0/319476338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2300c70b0 0x7fa2300c7520 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa228009d90 tx=0x7fa22802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac4875f0e1891d2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:54.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa22ea00640 1 -- 172.21.15.100:0/319476338 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22802cc60 con 0x7fa2300c70b0 2024-01-20T08:12:54.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa22ea00640 1 -- 172.21.15.100:0/319476338 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa22802cdc0 con 0x7fa2300c70b0 2024-01-20T08:12:54.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa22ea00640 1 -- 172.21.15.100:0/319476338 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228034660 con 0x7fa2300c70b0 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa236a00640 1 -- 172.21.15.100:0/319476338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2300c70b0 msgr2=0x7fa2300c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.666+0000 7fa236a00640 1 --2- 172.21.15.100:0/319476338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2300c70b0 0x7fa2300c7520 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fa228009d90 tx=0x7fa22802beb0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.667+0000 7fa236a00640 1 -- 172.21.15.100:0/319476338 shutdown_connections 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.667+0000 7fa236a00640 1 --2- 172.21.15.100:0/319476338 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa2300c70b0 0x7fa2300c7520 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.667+0000 7fa236a00640 1 -- 172.21.15.100:0/319476338 >> 172.21.15.100:0/319476338 conn(0x7fa2300ac010 msgr2=0x7fa2300ac420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.667+0000 7fa236a00640 1 -- 172.21.15.100:0/319476338 shutdown_connections 2024-01-20T08:12:54.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.667+0000 7fa236a00640 1 -- 172.21.15.100:0/319476338 wait complete. 2024-01-20T08:12:54.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.668+0000 7fa236a00640 1 Processor -- start 2024-01-20T08:12:54.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 -- start start 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300c70b0 0x7fa2301ea2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa230155d70 0x7fa2300aad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa230148560 con 0x7fa230151fe0 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2301487b0 con 0x7fa2300c70b0 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.669+0000 7fa236a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2300bd0a0 con 0x7fa230155d70 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60168/0 (socket says 172.21.15.100:60168) 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 -- 172.21.15.100:0/3810811542 learned_addr learned my addr 172.21.15.100:0/3810811542 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 -- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa230155d70 msgr2=0x7fa2300aad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa230155d70 0x7fa2300aad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 -- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300c70b0 msgr2=0x7fa2301ea2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300c70b0 0x7fa2301ea2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 -- 172.21.15.100:0/3810811542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa228009a70 con 0x7fa230151fe0 2024-01-20T08:12:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa22f400640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c3f0 tx=0x7fa21800c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:54.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.670+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2180074e0 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.671+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa218007640 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.671+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2301ed8c0 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.671+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa218004a00 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.671+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2300ab890 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.672+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2301edde0 con 0x7fa230151fe0 2024-01-20T08:12:54.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.673+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa218004b60 con 0x7fa230151fe0 2024-01-20T08:12:54.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.674+0000 7fa227e00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 0x7fa20806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:54.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.674+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 6651+0+0 (secure 0 0 0) 0x7fa2180897f0 con 0x7fa230151fe0 2024-01-20T08:12:54.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.674+0000 7fa22fe00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 0x7fa20806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:54.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.675+0000 7fa22fe00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 0x7fa20806d390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa2200079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:54.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.678+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa2301edde0 con 0x7fa230151fe0 2024-01-20T08:12:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:54.870+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa2301edde0 con 0x7fa230151fe0 2024-01-20T08:12:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.424+0000 7fa227e00640 1 -- 172.21.15.100:0/3810811542 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v58) v1 ==== 181+0+0 (secure 0 0 0) 0x7fa2301edde0 con 0x7fa230151fe0 2024-01-20T08:12:55.428 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.428+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 msgr2=0x7fa20806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.428+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 0x7fa20806d390 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa220000f60 tx=0x7fa2200079b0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.428+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 msgr2=0x7fa2301ee0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.428+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa21800c3f0 tx=0x7fa21800c8b0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 shutdown_connections 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa20806aed0 0x7fa20806d390 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa230155d70 0x7fa2300aad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa230151fe0 0x7fa2301ee0c0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 --2- 172.21.15.100:0/3810811542 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa2300c70b0 0x7fa2301ea2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 >> 172.21.15.100:0/3810811542 conn(0x7fa2300ac010 msgr2=0x7fa230150000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:55.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 shutdown_connections 2024-01-20T08:12:55.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.429+0000 7fa236a00640 1 -- 172.21.15.100:0/3810811542 wait complete. 2024-01-20T08:12:55.455 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T08:12:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.664+0000 7fafe6e00640 1 Processor -- start 2024-01-20T08:12:55.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.664+0000 7fafe6e00640 1 -- start start 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe6e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fafe00c1330 0x7fafe00c1710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe6e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe006c4c0 0x7fafe01551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe6e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe0154d50 con 0x7fafe0070680 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe6e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe01547f0 con 0x7fafe006c4c0 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe6e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe00c70d0 con 0x7fafe00c1330 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe4e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe006c4c0 0x7fafe01551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe4e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fafe006c4c0 0x7fafe01551e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60176/0 (socket says 172.21.15.100:60176) 2024-01-20T08:12:55.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafe4e00640 1 -- 172.21.15.100:0/1054420212 learned_addr learned my addr 172.21.15.100:0/1054420212 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.666+0000 7fafdfe00640 1 --2- 172.21.15.100:0/1054420212 >> v2:172.21.15.110:3300/0 conn(0x7fafe00c1330 0x7fafe00c1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.667+0000 7fafe4e00640 1 -- 172.21.15.100:0/1054420212 >> v2:172.21.15.110:3300/0 conn(0x7fafe00c1330 msgr2=0x7fafe00c1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.667+0000 7fafe4e00640 1 --2- 172.21.15.100:0/1054420212 >> v2:172.21.15.110:3300/0 conn(0x7fafe00c1330 0x7fafe00c1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.667+0000 7fafe4e00640 1 -- 172.21.15.100:0/1054420212 >> v1:172.21.15.110:6789/0 conn(0x7fafe0070680 legacy=0x7fafe01587f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:55.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.667+0000 7fafe4e00640 1 -- 172.21.15.100:0/1054420212 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe00c73b0 con 0x7fafe006c4c0 2024-01-20T08:12:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.668+0000 7fafe4e00640 1 --2- 172.21.15.100:0/1054420212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01551e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafe006b450 tx=0x7fafd802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec4aff64ae7cb08 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.668+0000 7fafdea00640 1 -- 172.21.15.100:0/1054420212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd802ca80 con 0x7fafe006c4c0 2024-01-20T08:12:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.668+0000 7fafdea00640 1 -- 172.21.15.100:0/1054420212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd802cbe0 con 0x7fafe006c4c0 2024-01-20T08:12:55.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.668+0000 7fafdea00640 1 -- 172.21.15.100:0/1054420212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd80343f0 con 0x7fafe006c4c0 2024-01-20T08:12:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 -- 172.21.15.100:0/1054420212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 msgr2=0x7fafe01551e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 --2- 172.21.15.100:0/1054420212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01551e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafe006b450 tx=0x7fafd802bee0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 -- 172.21.15.100:0/1054420212 shutdown_connections 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 --2- 172.21.15.100:0/1054420212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01551e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 --2- 172.21.15.100:0/1054420212 >> v2:172.21.15.110:3300/0 conn(0x7fafe00c1330 0x7fafe00c1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 -- 172.21.15.100:0/1054420212 >> 172.21.15.100:0/1054420212 conn(0x7fafe00a9cb0 msgr2=0x7fafe00aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 -- 172.21.15.100:0/1054420212 shutdown_connections 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.669+0000 7fafe6e00640 1 -- 172.21.15.100:0/1054420212 wait complete. 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.671+0000 7fafe6e00640 1 Processor -- start 2024-01-20T08:12:55.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.671+0000 7fafe6e00640 1 -- start start 2024-01-20T08:12:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 0x7fafe006f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafe00c1330 0x7fafe01de130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01576d0 con 0x7fafe006c4c0 2024-01-20T08:12:55.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01e0d40 con 0x7fafe0070680 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafe6e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe01e0130 con 0x7fafe00c1330 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60188/0 (socket says 172.21.15.100:60188) 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 -- 172.21.15.100:0/942188545 learned_addr learned my addr 172.21.15.100:0/942188545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdf400640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 0x7fafe006f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 -- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafe00c1330 msgr2=0x7fafe01de130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafe00c1330 0x7fafe01de130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 -- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 msgr2=0x7fafe006f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 0x7fafe006f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdfe00640 1 -- 172.21.15.100:0/942188545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafd8009b30 con 0x7fafe006c4c0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.672+0000 7fafdf400640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 0x7fafe006f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafdfe00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d800 tx=0x7fafd000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000b6c0 con 0x7fafe006c4c0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafd000b820 con 0x7fafe006c4c0 2024-01-20T08:12:55.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafd000bbb0 con 0x7fafe006c4c0 2024-01-20T08:12:55.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe01e0410 con 0x7fafe006c4c0 2024-01-20T08:12:55.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.673+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe01e09d0 con 0x7fafe006c4c0 2024-01-20T08:12:55.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.674+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe0074300 con 0x7fafe006c4c0 2024-01-20T08:12:55.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.675+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fafd000bd10 con 0x7fafe006c4c0 2024-01-20T08:12:55.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.676+0000 7fafd7e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 0x7fafb806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:55.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.676+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 6213+0+0 (secure 0 0 0) 0x7fafd0089dd0 con 0x7fafe006c4c0 2024-01-20T08:12:55.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.676+0000 7fafdf400640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 0x7fafb806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:55.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.677+0000 7fafdf400640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 0x7fafb806d390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fafe01dfef0 tx=0x7fafc8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:55.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.681+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fafd0054a90 con 0x7fafe006c4c0 2024-01-20T08:12:55.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:55.874+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafe01e0b90 con 0x7fafe006c4c0 2024-01-20T08:12:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.439+0000 7fafd7e00640 1 -- 172.21.15.100:0/942188545 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v59) v1 ==== 169+0+0 (secure 0 0 0) 0x7fafd00580b0 con 0x7fafe006c4c0 2024-01-20T08:12:56.443 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-20T08:12:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.443+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 msgr2=0x7fafb806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.443+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 0x7fafb806d390 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fafe01dfef0 tx=0x7fafc8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.443+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 msgr2=0x7fafe01587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.443+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafd000d800 tx=0x7fafd000dcc0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 shutdown_connections 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fafb806aed0 0x7fafb806d390 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fafe00c1330 0x7fafe01de130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fafe0070680 0x7fafe006f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 --2- 172.21.15.100:0/942188545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fafe006c4c0 0x7fafe01587b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 >> 172.21.15.100:0/942188545 conn(0x7fafe00a9cb0 msgr2=0x7fafe0153af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 shutdown_connections 2024-01-20T08:12:56.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.444+0000 7fafe6e00640 1 -- 172.21.15.100:0/942188545 wait complete. 2024-01-20T08:12:56.482 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:56.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.661+0000 7f6373200640 1 Processor -- start 2024-01-20T08:12:56.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.661+0000 7f6373200640 1 -- start start 2024-01-20T08:12:56.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.662+0000 7f6373200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6374072320 0x7f637414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.662+0000 7f6373200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63740c3240 0x7f637414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.662+0000 7f6373200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63740c1720 con 0x7f637406dd90 2024-01-20T08:12:56.665 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.662+0000 7f6373200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63740c20a0 con 0x7f6374072320 2024-01-20T08:12:56.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.662+0000 7f6373200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f637406c7c0 con 0x7f63740c3240 2024-01-20T08:12:56.666 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6374072320 0x7f637414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6374072320 0x7f637414f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60200/0 (socket says 172.21.15.100:60200) 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 -- 172.21.15.100:0/2348808288 learned_addr learned my addr 172.21.15.100:0/2348808288 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f636be00640 1 --1- 172.21.15.100:0/2348808288 >> v1:172.21.15.100:6789/0 conn(0x7f637406dd90 0x7f6374155b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37302/0 (socket says 172.21.15.100:37302) 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6372800640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63740c3240 0x7f637414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 -- 172.21.15.100:0/2348808288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63740c3240 msgr2=0x7f637414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63740c3240 0x7f637414fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 -- 172.21.15.100:0/2348808288 >> v1:172.21.15.100:6789/0 conn(0x7f637406dd90 legacy=0x7f6374155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371e00640 1 -- 172.21.15.100:0/2348808288 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63740a4f30 con 0x7f6374072320 2024-01-20T08:12:56.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.663+0000 7f6371400640 1 -- 172.21.15.100:0/2348808288 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779989481 0 0) 0x7f63740c1720 con 0x7f637406dd90 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.664+0000 7f6371e00640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374072320 0x7f637414f5d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6364009870 tx=0x7f636402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911c32065fc229c5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6371400640 1 -- 172.21.15.100:0/2348808288 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364030840 con 0x7f6374072320 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6371400640 1 -- 172.21.15.100:0/2348808288 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63640309a0 con 0x7f6374072320 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6371400640 1 -- 172.21.15.100:0/2348808288 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364030d30 con 0x7f6374072320 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 -- 172.21.15.100:0/2348808288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374072320 msgr2=0x7f637414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374072320 0x7f637414f5d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f6364009870 tx=0x7f636402b980 comp rx=0 tx=0).stop 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 -- 172.21.15.100:0/2348808288 shutdown_connections 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63740c3240 0x7f637414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 --2- 172.21.15.100:0/2348808288 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6374072320 0x7f637414f5d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.665+0000 7f6373200640 1 -- 172.21.15.100:0/2348808288 >> 172.21.15.100:0/2348808288 conn(0x7f63740c2590 msgr2=0x7f63740c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.666+0000 7f6373200640 1 -- 172.21.15.100:0/2348808288 shutdown_connections 2024-01-20T08:12:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.666+0000 7f6373200640 1 -- 172.21.15.100:0/2348808288 wait complete. 2024-01-20T08:12:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.667+0000 7f6373200640 1 Processor -- start 2024-01-20T08:12:56.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.668+0000 7f6373200640 1 -- start start 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 0x7f63741e7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63740c3240 0x7f63741e8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63741ebd80 con 0x7f637406dd90 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63740a6890 con 0x7f63740c3240 2024-01-20T08:12:56.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6373200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63741ec270 con 0x7f6374072320 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60206/0 (socket says 172.21.15.100:60206) 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 -- 172.21.15.100:0/170072283 learned_addr learned my addr 172.21.15.100:0/170072283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 -- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 msgr2=0x7f63741e7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f636be00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 0x7f63741e7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 0x7f63741e7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 -- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63740c3240 msgr2=0x7f63741e8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63740c3240 0x7f63741e8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f6371e00640 1 -- 172.21.15.100:0/170072283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640094d0 con 0x7f637406dd90 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.669+0000 7f636be00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 0x7f63741e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f6371e00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6364009870 tx=0x7f6364004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63640307f0 con 0x7f637406dd90 2024-01-20T08:12:56.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6364039d90 con 0x7f637406dd90 2024-01-20T08:12:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364043630 con 0x7f637406dd90 2024-01-20T08:12:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6374149ae0 con 0x7f637406dd90 2024-01-20T08:12:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.670+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63741ebf90 con 0x7f637406dd90 2024-01-20T08:12:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.671+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63740749e0 con 0x7f637406dd90 2024-01-20T08:12:56.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.672+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6364042390 con 0x7f637406dd90 2024-01-20T08:12:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.673+0000 7f636a000640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 0x7f634c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.673+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f63640aba30 con 0x7f637406dd90 2024-01-20T08:12:56.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.673+0000 7f636be00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 0x7f634c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:56.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.674+0000 7f636be00640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 0x7f634c06d390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f635c000f60 tx=0x7f635c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:56.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.678+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6364076850 con 0x7f637406dd90 2024-01-20T08:12:56.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.874+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6374153300 con 0x7f637406dd90 2024-01-20T08:12:56.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.876+0000 7f636a000640 1 -- 172.21.15.100:0/170072283 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16778 (secure 0 0 0) 0x7f6364034090 con 0x7f637406dd90 2024-01-20T08:12:56.879 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:56.880 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":59,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:56.426339+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/1123618406":"2024-01-21T08:12:53.405796+0000","172.21.15.110:6833/1123618406":"2024-01-21T08:12:53.405796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:56.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 msgr2=0x7f634c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 0x7f634c06d390 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f635c000f60 tx=0x7f635c009040 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 msgr2=0x7f6374148050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f6364009870 tx=0x7f6364004730 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 shutdown_connections 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63740c3240 0x7f63741e8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634c06aed0 0x7f634c06d390 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6374072320 0x7f63741e7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 --2- 172.21.15.100:0/170072283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f637406dd90 0x7f6374148050 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.879+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 >> 172.21.15.100:0/170072283 conn(0x7f63740c2590 msgr2=0x7f637414df70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.880+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 shutdown_connections 2024-01-20T08:12:56.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:56.880+0000 7f6373200640 1 -- 172.21.15.100:0/170072283 wait complete. 2024-01-20T08:12:56.901 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:12:24.716271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '55', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:12:25.562320+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:12:56.902 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:12:57.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.114+0000 7f7fd8800640 1 Processor -- start 2024-01-20T08:12:57.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.114+0000 7f7fd8800640 1 -- start start 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd8800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f7fd014fdb0 0x7f7fd00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd8800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fd01532f0 0x7f7fd015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd8800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fd0150190 con 0x7f7fd00c1d90 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd8800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00a9ce0 con 0x7f7fd01532f0 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd8800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fd00a93b0 con 0x7f7fd014fdb0 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd6800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7fd01532f0 0x7f7fd015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd5400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7fd00c1d90 0x7f7fd0152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37308/0 (socket says 172.21.15.100:37308) 2024-01-20T08:12:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd5400640 1 -- 172.21.15.100:0/839769977 learned_addr learned my addr 172.21.15.100:0/839769977 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.116+0000 7f7fd5e00640 1 --2- 172.21.15.100:0/839769977 >> v2:172.21.15.110:3300/0 conn(0x7f7fd014fdb0 0x7f7fd00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.117+0000 7f7fd6800640 1 -- 172.21.15.100:0/839769977 >> v2:172.21.15.110:3300/0 conn(0x7f7fd014fdb0 msgr2=0x7f7fd00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.117+0000 7f7fd6800640 1 --2- 172.21.15.100:0/839769977 >> v2:172.21.15.110:3300/0 conn(0x7f7fd014fdb0 0x7f7fd00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.117+0000 7f7fd6800640 1 -- 172.21.15.100:0/839769977 >> v1:172.21.15.100:6789/0 conn(0x7f7fd00c1d90 legacy=0x7f7fd0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.117+0000 7f7fd6800640 1 -- 172.21.15.100:0/839769977 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fd00a8810 con 0x7f7fd01532f0 2024-01-20T08:12:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.117+0000 7f7fd4a00640 1 -- 172.21.15.100:0/839769977 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364082866 0 0) 0x7f7fd0150190 con 0x7f7fd00c1d90 2024-01-20T08:12:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.118+0000 7f7fd6800640 1 --2- 172.21.15.100:0/839769977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd01532f0 0x7f7fd015cfc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7fd006e580 tx=0x7f7fc802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f630c07c1f029d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.118+0000 7f7fd4a00640 1 -- 172.21.15.100:0/839769977 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc802cc80 con 0x7f7fd01532f0 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.118+0000 7f7fd4a00640 1 -- 172.21.15.100:0/839769977 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fc802cde0 con 0x7f7fd01532f0 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.118+0000 7f7fd4a00640 1 -- 172.21.15.100:0/839769977 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fc8034660 con 0x7f7fd01532f0 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 -- 172.21.15.100:0/839769977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd01532f0 msgr2=0x7f7fd015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 --2- 172.21.15.100:0/839769977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd01532f0 0x7f7fd015cfc0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f7fd006e580 tx=0x7f7fc802bed0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 -- 172.21.15.100:0/839769977 shutdown_connections 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 --2- 172.21.15.100:0/839769977 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd01532f0 0x7f7fd015cfc0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 --2- 172.21.15.100:0/839769977 >> v2:172.21.15.110:3300/0 conn(0x7f7fd014fdb0 0x7f7fd00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 -- 172.21.15.100:0/839769977 >> 172.21.15.100:0/839769977 conn(0x7f7fd00c2940 msgr2=0x7f7fd00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 -- 172.21.15.100:0/839769977 shutdown_connections 2024-01-20T08:12:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.119+0000 7f7fd8800640 1 -- 172.21.15.100:0/839769977 wait complete. 2024-01-20T08:12:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.120+0000 7f7fd8800640 1 Processor -- start 2024-01-20T08:12:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.121+0000 7f7fd8800640 1 -- start start 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fd00c1d90 0x7f7fd01edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fd01532f0 0x7f7fd0154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd0153a90 con 0x7f7fd014fdb0 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd01e9a90 con 0x7f7fd00c1d90 2024-01-20T08:12:57.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd8800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fd01e9ce0 con 0x7f7fd01532f0 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60226/0 (socket says 172.21.15.100:60226) 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 -- 172.21.15.100:0/1538591132 learned_addr learned my addr 172.21.15.100:0/1538591132 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5e00640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fd00c1d90 0x7f7fd01edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 -- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fd01532f0 msgr2=0x7f7fd0154a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fd01532f0 0x7f7fd0154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 -- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fd00c1d90 msgr2=0x7f7fd01edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fd00c1d90 0x7f7fd01edae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.122+0000 7f7fd5400640 1 -- 172.21.15.100:0/1538591132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc8009a70 con 0x7f7fd014fdb0 2024-01-20T08:12:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fd5400640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c4d0 tx=0x7f7fb800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb80074e0 con 0x7f7fd014fdb0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb8007660 con 0x7f7fd014fdb0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb8004a20 con 0x7f7fd014fdb0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fd01ed000 con 0x7f7fd014fdb0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.123+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fd01ed5c0 con 0x7f7fd014fdb0 2024-01-20T08:12:57.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.124+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd01ed7b0 con 0x7f7fd014fdb0 2024-01-20T08:12:57.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.125+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7fb8004b80 con 0x7f7fd014fdb0 2024-01-20T08:12:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.126+0000 7f7fce000640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 0x7f7fa806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.126+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f7fb8088b70 con 0x7f7fd014fdb0 2024-01-20T08:12:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.126+0000 7f7fd5e00640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 0x7f7fa806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.127+0000 7f7fd5e00640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 0x7f7fa806d390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006fd0 tx=0x7f7fc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.130+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7fb8053a30 con 0x7f7fd014fdb0 2024-01-20T08:12:57.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.320+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7fd004e970 con 0x7f7fd014fdb0 2024-01-20T08:12:57.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.321+0000 7f7fce000640 1 -- 172.21.15.100:0/1538591132 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7fb8018020 con 0x7f7fd014fdb0 2024-01-20T08:12:57.324 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:12:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 msgr2=0x7f7fa806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 0x7f7fa806d390 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0006fd0 tx=0x7f7fc0008040 comp rx=0 tx=0).stop 2024-01-20T08:12:57.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 msgr2=0x7f7fd00c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f7fb800c4d0 tx=0x7f7fb800c990 comp rx=0 tx=0).stop 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 shutdown_connections 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7fa806aed0 0x7f7fa806d390 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7fd01532f0 0x7f7fd0154a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7fd014fdb0 0x7f7fd00c5410 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 --2- 172.21.15.100:0/1538591132 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7fd00c1d90 0x7f7fd01edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 >> 172.21.15.100:0/1538591132 conn(0x7f7fd00c2940 msgr2=0x7f7fd00c0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 shutdown_connections 2024-01-20T08:12:57.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.324+0000 7f7fd8800640 1 -- 172.21.15.100:0/1538591132 wait complete. 2024-01-20T08:12:57.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:12:57.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.550+0000 7f3139000640 1 Processor -- start 2024-01-20T08:12:57.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.550+0000 7f3139000640 1 -- start start 2024-01-20T08:12:57.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.551+0000 7f3139000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 0x7f3134153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.551+0000 7f3139000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f31340715a0 0x7f3134071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.551+0000 7f3139000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31340ab620 con 0x7f313414c750 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.551+0000 7f3139000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313414cb30 con 0x7f31340715a0 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.551+0000 7f3139000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31340ab900 con 0x7f31340ab0b0 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3131e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f313414c750 0x7f31340a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37322/0 (socket says 172.21.15.100:37322) 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3131e00640 1 -- 172.21.15.100:0/4175891530 learned_addr learned my addr 172.21.15.100:0/4175891530 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:57.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3132800640 1 --2- 172.21.15.100:0/4175891530 >> v2:172.21.15.100:3300/0 conn(0x7f31340715a0 0x7f3134071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3131400640 1 --2- 172.21.15.100:0/4175891530 >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 0x7f3134153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3130a00640 1 -- 172.21.15.100:0/4175891530 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374150643 0 0) 0x7f31340ab620 con 0x7f313414c750 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3132800640 1 -- 172.21.15.100:0/4175891530 >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 msgr2=0x7f3134153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3132800640 1 --2- 172.21.15.100:0/4175891530 >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 0x7f3134153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3132800640 1 -- 172.21.15.100:0/4175891530 >> v1:172.21.15.100:6789/0 conn(0x7f313414c750 legacy=0x7f31340a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3132800640 1 -- 172.21.15.100:0/4175891530 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31340abbe0 con 0x7f31340715a0 2024-01-20T08:12:57.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.552+0000 7f3131400640 1 --2- 172.21.15.100:0/4175891530 >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 0x7f3134153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:57.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.553+0000 7f3132800640 1 --2- 172.21.15.100:0/4175891530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31340715a0 0x7f3134071a30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f313406e380 tx=0x7f312402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad1bd11b462515f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3130a00640 1 -- 172.21.15.100:0/4175891530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124031830 con 0x7f31340715a0 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3130a00640 1 -- 172.21.15.100:0/4175891530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124031990 con 0x7f31340715a0 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3130a00640 1 -- 172.21.15.100:0/4175891530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124031d20 con 0x7f31340715a0 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 -- 172.21.15.100:0/4175891530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31340715a0 msgr2=0x7f3134071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 --2- 172.21.15.100:0/4175891530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31340715a0 0x7f3134071a30 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f313406e380 tx=0x7f312402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 -- 172.21.15.100:0/4175891530 shutdown_connections 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 --2- 172.21.15.100:0/4175891530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31340715a0 0x7f3134071a30 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 --2- 172.21.15.100:0/4175891530 >> v2:172.21.15.110:3300/0 conn(0x7f31340ab0b0 0x7f3134153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.554+0000 7f3139000640 1 -- 172.21.15.100:0/4175891530 >> 172.21.15.100:0/4175891530 conn(0x7f31340c6090 msgr2=0x7f31340c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.555+0000 7f3139000640 1 -- 172.21.15.100:0/4175891530 shutdown_connections 2024-01-20T08:12:57.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.555+0000 7f3139000640 1 -- 172.21.15.100:0/4175891530 wait complete. 2024-01-20T08:12:57.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.556+0000 7f3139000640 1 Processor -- start 2024-01-20T08:12:57.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.556+0000 7f3139000640 1 -- start start 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 0x7f31341eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 0x7f3134146be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134153fa0 con 0x7f313414c750 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3134147c10 con 0x7f31340715a0 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3139000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31341ee370 con 0x7f31340ab0b0 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3132800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3132800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60248/0 (socket says 172.21.15.100:60248) 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.557+0000 7f3132800640 1 -- 172.21.15.100:0/3624787059 learned_addr learned my addr 172.21.15.100:0/3624787059 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:57.561 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3131e00640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 0x7f31341eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3131400640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 0x7f3134146be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 -- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 msgr2=0x7f3134146be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 0x7f3134146be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 -- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 msgr2=0x7f31341eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 0x7f31341eda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 -- 172.21.15.100:0/3624787059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3124009400 con 0x7f313414c750 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3131400640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 0x7f3134146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3131e00640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 0x7f31341eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:57.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f3132800640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3124034040 tx=0x7f31240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.558+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312403a9e0 con 0x7f313414c750 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.559+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312403ab40 con 0x7f313414c750 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.559+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240443f0 con 0x7f313414c750 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.559+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3134147660 con 0x7f313414c750 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.559+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3134153cc0 con 0x7f313414c750 2024-01-20T08:12:57.563 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.560+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31341ee530 con 0x7f313414c750 2024-01-20T08:12:57.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.561+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3124044550 con 0x7f313414c750 2024-01-20T08:12:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.562+0000 7f312a000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 0x7f310c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.562+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f31240ab980 con 0x7f313414c750 2024-01-20T08:12:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.562+0000 7f3131e00640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 0x7f310c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:57.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.563+0000 7f3131e00640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 0x7f310c06d390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f312c0012e0 tx=0x7f312c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:57.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.567+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3124076960 con 0x7f313414c750 2024-01-20T08:12:57.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.757+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f313404ea50 con 0x7f313414c750 2024-01-20T08:12:57.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.758+0000 7f312a000640 1 -- 172.21.15.100:0/3624787059 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v60) v1 ==== 105+0+11 (secure 0 0 0) 0x7f31240350b0 con 0x7f313414c750 2024-01-20T08:12:57.760 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 msgr2=0x7f310c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 0x7f310c06d390 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f312c0012e0 tx=0x7f312c009040 comp rx=0 tx=0).stop 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 msgr2=0x7f3134147120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f3124034040 tx=0x7f31240046c0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 shutdown_connections 2024-01-20T08:12:57.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f313414c750 0x7f3134147120 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f310c06aed0 0x7f310c06d390 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f31340ab0b0 0x7f3134146be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 --2- 172.21.15.100:0/3624787059 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f31340715a0 0x7f31341eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 >> 172.21.15.100:0/3624787059 conn(0x7f31340c6090 msgr2=0x7f31340a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 shutdown_connections 2024-01-20T08:12:57.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.760+0000 7f3139000640 1 -- 172.21.15.100:0/3624787059 wait complete. 2024-01-20T08:12:57.783 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.993+0000 7fe8c9a00640 1 Processor -- start 2024-01-20T08:12:57.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.994+0000 7fe8c9a00640 1 -- start start 2024-01-20T08:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c9a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8c414e8f0 0x7fe8c41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c9a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c4158300 0x7fe8c41587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c9a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8c414ecd0 con 0x7fe8c406d970 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c9a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8c4157e70 con 0x7fe8c414e8f0 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c9a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c4158cf0 con 0x7fe8c4158300 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c2a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe8c414e8f0 0x7fe8c41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.995+0000 7fe8c2000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe8c406d970 0x7fe8c406b5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:37328/0 (socket says 172.21.15.100:37328) 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c2000640 1 -- 172.21.15.100:0/3725934502 learned_addr learned my addr 172.21.15.100:0/3725934502 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c3400640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c4158300 0x7fe8c41587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c2a00640 1 -- 172.21.15.100:0/3725934502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c4158300 msgr2=0x7fe8c41587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c2a00640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c4158300 0x7fe8c41587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c2a00640 1 -- 172.21.15.100:0/3725934502 >> v1:172.21.15.100:6789/0 conn(0x7fe8c406d970 legacy=0x7fe8c406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c1600640 1 -- 172.21.15.100:0/3725934502 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 293118738 0 0) 0x7fe8c414ecd0 con 0x7fe8c406d970 2024-01-20T08:12:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.996+0000 7fe8c2a00640 1 -- 172.21.15.100:0/3725934502 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c4154e10 con 0x7fe8c414e8f0 2024-01-20T08:12:58.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.997+0000 7fe8c2a00640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c41547c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097a0 tx=0x7fe8b402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=461ebe7f005f5c3c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c1600640 1 -- 172.21.15.100:0/3725934502 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b402e070 con 0x7fe8c414e8f0 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c1600640 1 -- 172.21.15.100:0/3725934502 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8b40315a0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c1600640 1 -- 172.21.15.100:0/3725934502 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4031930 con 0x7fe8c414e8f0 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 -- 172.21.15.100:0/3725934502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 msgr2=0x7fe8c41547c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c41547c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097a0 tx=0x7fe8b402b840 comp rx=0 tx=0).stop 2024-01-20T08:12:58.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 -- 172.21.15.100:0/3725934502 shutdown_connections 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c4158300 0x7fe8c41587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/3725934502 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c41547c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 -- 172.21.15.100:0/3725934502 >> 172.21.15.100:0/3725934502 conn(0x7fe8c40c3170 msgr2=0x7fe8c40c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 -- 172.21.15.100:0/3725934502 shutdown_connections 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:57.998+0000 7fe8c9a00640 1 -- 172.21.15.100:0/3725934502 wait complete. 2024-01-20T08:12:58.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.000+0000 7fe8c9a00640 1 Processor -- start 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.000+0000 7fe8c9a00640 1 -- start start 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c406d970 0x7fe8c414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8c4158300 0x7fe8c41543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c414ab80 con 0x7fe8c414e8f0 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c40aa6a0 con 0x7fe8c4158300 2024-01-20T08:12:58.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c9a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8c414a8e0 con 0x7fe8c406d970 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.001+0000 7fe8c2000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60260/0 (socket says 172.21.15.100:60260) 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 -- 172.21.15.100:0/1705181066 learned_addr learned my addr 172.21.15.100:0/1705181066 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c406d970 0x7fe8c414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c3400640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8c4158300 0x7fe8c41543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 -- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c406d970 msgr2=0x7fe8c414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c406d970 0x7fe8c414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 -- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8c4158300 msgr2=0x7fe8c41543a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8c4158300 0x7fe8c41543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 -- 172.21.15.100:0/1705181066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b4009400 con 0x7fe8c414e8f0 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.002+0000 7fe8c2000640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c850 tx=0x7fe8ac00cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.003+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00a640 con 0x7fe8c414e8f0 2024-01-20T08:12:58.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.003+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8ac00a7c0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.003+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac00ab70 con 0x7fe8c414e8f0 2024-01-20T08:12:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.003+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8c40a9680 con 0x7fe8c414e8f0 2024-01-20T08:12:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.003+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8c40a9c40 con 0x7fe8c414e8f0 2024-01-20T08:12:58.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.004+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8c40a94e0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.005+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe8ac00acd0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.006+0000 7fe8baa00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 0x7fe89c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.006+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fe8ac088bc0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.006+0000 7fe8c2a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 0x7fe89c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.007+0000 7fe8c2a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 0x7fe89c06d390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4036000 tx=0x7fe8b403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.011+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe8c40a94e0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.206+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fe8c40a94e0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.207+0000 7fe8baa00640 1 -- 172.21.15.100:0/1705181066 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v60) v1 ==== 101+0+11 (secure 0 0 0) 0x7fe8c40a94e0 con 0x7fe8c414e8f0 2024-01-20T08:12:58.210 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 msgr2=0x7fe89c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 0x7fe89c06d390 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4036000 tx=0x7fe8b403d040 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 msgr2=0x7fe8c40aa160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c850 tx=0x7fe8ac00cd10 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 shutdown_connections 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe8c4158300 0x7fe8c41543a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8c414e8f0 0x7fe8c40aa160 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe89c06aed0 0x7fe89c06d390 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 --2- 172.21.15.100:0/1705181066 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8c406d970 0x7fe8c414d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 >> 172.21.15.100:0/1705181066 conn(0x7fe8c40c3170 msgr2=0x7fe8c406e1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 shutdown_connections 2024-01-20T08:12:58.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.210+0000 7fe8c9a00640 1 -- 172.21.15.100:0/1705181066 wait complete. 2024-01-20T08:12:58.233 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.433+0000 7feebec00640 1 Processor -- start 2024-01-20T08:12:58.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.433+0000 7feebec00640 1 -- start start 2024-01-20T08:12:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feeb806b3b0 0x7feeb8155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c8ae0 0x7feeb8155cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 0x7feeb8151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb8155790 con 0x7feeb806b3b0 2024-01-20T08:12:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeb80c8650 con 0x7feeb81519a0 2024-01-20T08:12:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feebec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c8070 con 0x7feeb80c8ae0 2024-01-20T08:12:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.434+0000 7feeb7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feeb806b3b0 0x7feeb8155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7feeb806b3b0 0x7feeb8155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60268/0 (socket says 172.21.15.100:60268) 2024-01-20T08:12:58.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 -- 172.21.15.100:0/2104115320 learned_addr learned my addr 172.21.15.100:0/2104115320 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeaf200640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c8ae0 0x7feeb8155cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feebcc00640 1 --2- 172.21.15.100:0/2104115320 >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 0x7feeb8151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 -- 172.21.15.100:0/2104115320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c8ae0 msgr2=0x7feeb8155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c8ae0 0x7feeb8155cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 -- 172.21.15.100:0/2104115320 >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 msgr2=0x7feeb8151dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 --2- 172.21.15.100:0/2104115320 >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 0x7feeb8151dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feeb7e00640 1 -- 172.21.15.100:0/2104115320 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb80c4dd0 con 0x7feeb806b3b0 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.435+0000 7feebcc00640 1 --2- 172.21.15.100:0/2104115320 >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 0x7feeb8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:58.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.436+0000 7feeb7e00640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb806b3b0 0x7feeb8155250 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7feeb80c7c00 tx=0x7feea802b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70797a322ca6a411 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.436+0000 7feeb7400640 1 -- 172.21.15.100:0/2104115320 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea80317d0 con 0x7feeb806b3b0 2024-01-20T08:12:58.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.436+0000 7feeb7400640 1 -- 172.21.15.100:0/2104115320 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feea8031930 con 0x7feeb806b3b0 2024-01-20T08:12:58.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.436+0000 7feeb7400640 1 -- 172.21.15.100:0/2104115320 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feea8031cc0 con 0x7feeb806b3b0 2024-01-20T08:12:58.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 -- 172.21.15.100:0/2104115320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb806b3b0 msgr2=0x7feeb8155250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb806b3b0 0x7feeb8155250 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7feeb80c7c00 tx=0x7feea802b870 comp rx=0 tx=0).stop 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 -- 172.21.15.100:0/2104115320 shutdown_connections 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 --2- 172.21.15.100:0/2104115320 >> v2:172.21.15.110:3300/0 conn(0x7feeb81519a0 0x7feeb8151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb80c8ae0 0x7feeb8155cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 --2- 172.21.15.100:0/2104115320 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb806b3b0 0x7feeb8155250 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 -- 172.21.15.100:0/2104115320 >> 172.21.15.100:0/2104115320 conn(0x7feeb80abc00 msgr2=0x7feeb80ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 -- 172.21.15.100:0/2104115320 shutdown_connections 2024-01-20T08:12:58.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.437+0000 7feebec00640 1 -- 172.21.15.100:0/2104115320 wait complete. 2024-01-20T08:12:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.439+0000 7feebec00640 1 Processor -- start 2024-01-20T08:12:58.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.439+0000 7feebec00640 1 -- start start 2024-01-20T08:12:58.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 0x7feeb814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c8ae0 0x7feeb81f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c1c20 con 0x7feeb81519a0 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeb81f29f0 con 0x7feeb80c8ae0 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeb80c3150 con 0x7feeb806b3b0 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60278/0 (socket says 172.21.15.100:60278) 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.440+0000 7feebcc00640 1 -- 172.21.15.100:0/3753913567 learned_addr learned my addr 172.21.15.100:0/3753913567 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feeb7e00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 0x7feeb814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 -- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 msgr2=0x7feeb814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 0x7feeb814e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 -- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c8ae0 msgr2=0x7feeb81f1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c8ae0 0x7feeb81f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 -- 172.21.15.100:0/3753913567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea80094d0 con 0x7feeb81519a0 2024-01-20T08:12:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feeb7e00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 0x7feeb814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:58.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebcc00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feeb000cd50 tx=0x7feeb000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000f680 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb000f800 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeb80c3430 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb000fbb0 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.441+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeb814ea30 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.442+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeb80c1d60 con 0x7feeb81519a0 2024-01-20T08:12:58.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.443+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feeb000b040 con 0x7feeb81519a0 2024-01-20T08:12:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.444+0000 7feeb4c00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 0x7fee9006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.444+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7feeb008a0a0 con 0x7feeb81519a0 2024-01-20T08:12:58.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.445+0000 7feeb7e00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 0x7fee9006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.445+0000 7feeb7e00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 0x7fee9006d3c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feea8036000 tx=0x7feea803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.449+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feeb80c1d60 con 0x7feeb81519a0 2024-01-20T08:12:58.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.681+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feeb80c1d60 con 0x7feeb81519a0 2024-01-20T08:12:58.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.682+0000 7feeb4c00640 1 -- 172.21.15.100:0/3753913567 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4951 (secure 0 0 0) 0x7feeb80c1d60 con 0x7feeb81519a0 2024-01-20T08:12:58.686 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:58.686 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3904635499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3904635499},{"type":"v1","addr":"172.21.15.110:6835","nonce":3904635499}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 39 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 msgr2=0x7fee9006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 0x7fee9006d3c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7feea8036000 tx=0x7feea803d040 comp rx=0 tx=0).stop 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 msgr2=0x7feeb80c2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7feeb000cd50 tx=0x7feeb000a650 comp rx=0 tx=0).stop 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 shutdown_connections 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feeb81519a0 0x7feeb80c2040 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feeb80c8ae0 0x7feeb81f1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee9006af00 0x7fee9006d3c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 --2- 172.21.15.100:0/3753913567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feeb806b3b0 0x7feeb814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 >> 172.21.15.100:0/3753913567 conn(0x7feeb80abc00 msgr2=0x7feeb8157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:58.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 shutdown_connections 2024-01-20T08:12:58.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.686+0000 7feebec00640 1 -- 172.21.15.100:0/3753913567 wait complete. 2024-01-20T08:12:58.709 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:12:58.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.911+0000 7f72cfc00640 1 Processor -- start 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.911+0000 7f72cfc00640 1 -- start start 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.912+0000 7f72cfc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 0x7f72c80abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.912+0000 7f72cfc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72c8151f60 0x7f72c8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.912+0000 7f72cfc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c80c1670 con 0x7f72c80c1b00 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.912+0000 7f72cfc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c81524b0 con 0x7f72c8151f60 2024-01-20T08:12:58.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.912+0000 7f72cfc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c80c0d40 con 0x7f72c8147f20 2024-01-20T08:12:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72c8151f60 0x7f72c8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f72c8151f60 0x7f72c8070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60286/0 (socket says 172.21.15.100:60286) 2024-01-20T08:12:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 -- 172.21.15.100:0/3325010188 learned_addr learned my addr 172.21.15.100:0/3325010188 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72cd200640 1 --2- 172.21.15.100:0/3325010188 >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 0x7f72c80abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 -- 172.21.15.100:0/3325010188 >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 msgr2=0x7f72c80abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 --2- 172.21.15.100:0/3325010188 >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 0x7f72c80abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 -- 172.21.15.100:0/3325010188 >> v1:172.21.15.110:6789/0 conn(0x7f72c80c1b00 legacy=0x7f72c80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72bfc00640 1 -- 172.21.15.100:0/3325010188 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c80c1020 con 0x7f72c8151f60 2024-01-20T08:12:58.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.913+0000 7f72cd200640 1 --2- 172.21.15.100:0/3325010188 >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 0x7f72c80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.914+0000 7f72bfc00640 1 --2- 172.21.15.100:0/3325010188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c8070370 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f72c806e5d0 tx=0x7f72b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4deb09d7cbfbb6f6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72c7e00640 1 -- 172.21.15.100:0/3325010188 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0031870 con 0x7f72c8151f60 2024-01-20T08:12:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72c7e00640 1 -- 172.21.15.100:0/3325010188 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b00319d0 con 0x7f72c8151f60 2024-01-20T08:12:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72c7e00640 1 -- 172.21.15.100:0/3325010188 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0031d60 con 0x7f72c8151f60 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72cfc00640 1 -- 172.21.15.100:0/3325010188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 msgr2=0x7f72c8070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72cfc00640 1 --2- 172.21.15.100:0/3325010188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c8070370 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f72c806e5d0 tx=0x7f72b002b910 comp rx=0 tx=0).stop 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72cfc00640 1 -- 172.21.15.100:0/3325010188 shutdown_connections 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72cfc00640 1 --2- 172.21.15.100:0/3325010188 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c8070370 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.915+0000 7f72cfc00640 1 --2- 172.21.15.100:0/3325010188 >> v2:172.21.15.110:3300/0 conn(0x7f72c8147f20 0x7f72c80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.916+0000 7f72cfc00640 1 -- 172.21.15.100:0/3325010188 >> 172.21.15.100:0/3325010188 conn(0x7f72c806a5e0 msgr2=0x7f72c806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.916+0000 7f72cfc00640 1 -- 172.21.15.100:0/3325010188 shutdown_connections 2024-01-20T08:12:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.916+0000 7f72cfc00640 1 -- 172.21.15.100:0/3325010188 wait complete. 2024-01-20T08:12:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.918+0000 7f72cfc00640 1 Processor -- start 2024-01-20T08:12:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.918+0000 7f72cfc00640 1 -- start start 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72c80c1b00 0x7f72c81e96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c8147f20 0x7f72c80c6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c81ea300 con 0x7f72c8151f60 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c43f0 con 0x7f72c8147f20 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cfc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c80c6fe0 con 0x7f72c80c1b00 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cdc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:60292/0 (socket says 172.21.15.100:60292) 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.919+0000 7f72cdc00640 1 -- 172.21.15.100:0/2970156112 learned_addr learned my addr 172.21.15.100:0/2970156112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cd200640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72c80c1b00 0x7f72c81e96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72bfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c8147f20 0x7f72c80c6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 -- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72c80c1b00 msgr2=0x7f72c81e96e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72c80c1b00 0x7f72c81e96e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 -- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c8147f20 msgr2=0x7f72c80c6560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c8147f20 0x7f72c80c6560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 -- 172.21.15.100:0/2970156112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094d0 con 0x7f72c8151f60 2024-01-20T08:12:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cdc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c780 tx=0x7f72c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c0004b60 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72c000ce90 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c000a850 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.920+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c813fad0 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.921+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c81e9c20 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.922+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c804e970 con 0x7f72c8151f60 2024-01-20T08:12:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.923+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f72c000a9b0 con 0x7f72c8151f60 2024-01-20T08:12:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.924+0000 7f72c5600640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 0x7f72a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.924+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f72c0089900 con 0x7f72c8151f60 2024-01-20T08:12:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.924+0000 7f72cd200640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 0x7f72a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.925+0000 7f72cd200640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 0x7f72a006d390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72b800a990 tx=0x7f72b8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:58.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:58.928+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f72c0054690 con 0x7f72c8151f60 2024-01-20T08:12:59.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.125+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72c80c38d0 con 0x7f72c8151f60 2024-01-20T08:12:59.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.129+0000 7f72c5600640 1 -- 172.21.15.100:0/2970156112 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16778 (secure 0 0 0) 0x7f72c0057cb0 con 0x7f72c8151f60 2024-01-20T08:12:59.132 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:59.132 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:57.440423+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/1123618406":"2024-01-21T08:12:53.405796+0000","172.21.15.110:6833/1123618406":"2024-01-21T08:12:53.405796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.131+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 msgr2=0x7f72a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.131+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 0x7f72a006d390 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f72b800a990 tx=0x7f72b8008040 comp rx=0 tx=0).stop 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 msgr2=0x7f72c80c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f72c000c780 tx=0x7f72c000cc40 comp rx=0 tx=0).stop 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 shutdown_connections 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72c8151f60 0x7f72c80c6aa0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f72c8147f20 0x7f72c80c6560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f72a006aed0 0x7f72a006d390 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 --2- 172.21.15.100:0/2970156112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f72c80c1b00 0x7f72c81e96e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 >> 172.21.15.100:0/2970156112 conn(0x7f72c806a5e0 msgr2=0x7f72c806aae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:59.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 shutdown_connections 2024-01-20T08:12:59.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.132+0000 7f72cfc00640 1 -- 172.21.15.100:0/2970156112 wait complete. 2024-01-20T08:12:59.154 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-20T08:12:59.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.353+0000 7fe280a00640 1 Processor -- start 2024-01-20T08:12:59.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.353+0000 7fe280a00640 1 -- start start 2024-01-20T08:12:59.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.354+0000 7fe280a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe27c0bd5c0 0x7fe27c0720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.354+0000 7fe280a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe27c154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe280a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe27c158560 con 0x7fe27c071d10 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe280a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27c0c5640 con 0x7fe27c0bd5c0 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe280a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c50a0 con 0x7fe27c0c7e30 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe27b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe27c071d10 0x7fe27c154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58262/0 (socket says 172.21.15.100:58262) 2024-01-20T08:12:59.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe27b400640 1 -- 172.21.15.100:0/2044136337 learned_addr learned my addr 172.21.15.100:0/2044136337 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe273e00640 1 --2- 172.21.15.100:0/2044136337 >> v2:172.21.15.110:3300/0 conn(0x7fe27c0bd5c0 0x7fe27c0720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.355+0000 7fe27be00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe27c154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429113096 0 0) 0x7fe27c158560 con 0x7fe27c071d10 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe25c003520 con 0x7fe27c071d10 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3733209062 0 0) 0x7fe25c003520 con 0x7fe27c071d10 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 msgr2=0x7fe27c154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.360 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe27c154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 >> v2:172.21.15.110:3300/0 conn(0x7fe27c0bd5c0 msgr2=0x7fe27c0720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 --2- 172.21.15.100:0/2044136337 >> v2:172.21.15.110:3300/0 conn(0x7fe27c0bd5c0 0x7fe27c0720f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c06cb90 con 0x7fe27c071d10 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe26c001670 con 0x7fe27c071d10 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 >> v1:172.21.15.100:6789/0 conn(0x7fe27c071d10 legacy=0x7fe27c154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c003970 0x7fe25c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe25c0047c0 0x7fe25c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe25c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c5640 con 0x7fe25c0047c0 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c50a0 con 0x7fe25c003970 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe25c00ba00 con 0x7fe27c0c7e30 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.356+0000 7fe273e00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe25c0047c0 0x7fe25c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe27b400640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c003970 0x7fe25c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe27be00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe25c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe273e00640 1 -- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 msgr2=0x7fe25c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe273e00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe25c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe273e00640 1 -- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c003970 msgr2=0x7fe25c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe273e00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c003970 0x7fe25c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe273e00640 1 -- 172.21.15.100:0/2044136337 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe25c003520 con 0x7fe25c0047c0 2024-01-20T08:12:59.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.357+0000 7fe27be00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c7e30 0x7fe25c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:12:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.358+0000 7fe273e00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe25c0047c0 0x7fe25c004c40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe264009a90 tx=0x7fe25c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7e04980cc820fc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.358+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402c6b0 con 0x7fe25c0047c0 2024-01-20T08:12:59.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.358+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26402c810 con 0x7fe25c0047c0 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.358+0000 7fe27aa00640 1 -- 172.21.15.100:0/2044136337 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26402cba0 con 0x7fe25c0047c0 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 -- 172.21.15.100:0/2044136337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe25c0047c0 msgr2=0x7fe25c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 --2- 172.21.15.100:0/2044136337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe25c0047c0 0x7fe25c004c40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fe264009a90 tx=0x7fe25c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe27be00640 1 -- 172.21.15.100:0/2044136337 reap_dead start 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 -- 172.21.15.100:0/2044136337 shutdown_connections 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 -- 172.21.15.100:0/2044136337 >> 172.21.15.100:0/2044136337 conn(0x7fe27c0c9f30 msgr2=0x7fe27c0ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 -- 172.21.15.100:0/2044136337 shutdown_connections 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.359+0000 7fe280a00640 1 -- 172.21.15.100:0/2044136337 wait complete. 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.361+0000 7fe280a00640 1 Processor -- start 2024-01-20T08:12:59.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.361+0000 7fe280a00640 1 -- start start 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0047c0 0x7fe27c1edd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c1290 0x7fe27c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c3c40 con 0x7fe27c0bf210 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c3f20 con 0x7fe25c0047c0 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe280a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27c0c4200 con 0x7fe27c0c1290 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33992/0 (socket says 172.21.15.100:33992) 2024-01-20T08:12:59.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 -- 172.21.15.100:0/515874467 learned_addr learned my addr 172.21.15.100:0/515874467 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27b400640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0047c0 0x7fe27c1edd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 -- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c1290 msgr2=0x7fe27c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c1290 0x7fe27c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 -- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0047c0 msgr2=0x7fe27c1edd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0047c0 0x7fe27c1edd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.362+0000 7fe27be00640 1 -- 172.21.15.100:0/515874467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe27c1ed230 con 0x7fe27c0bf210 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe27be00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0c6840 tx=0x7fe27400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274017400 con 0x7fe27c0bf210 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe274011040 con 0x7fe27c0bf210 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe274017780 con 0x7fe27c0bf210 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27c1ed510 con 0x7fe27c0bf210 2024-01-20T08:12:59.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.363+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe27c0c3560 con 0x7fe27c0bf210 2024-01-20T08:12:59.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.364+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe27c0749e0 con 0x7fe27c0bf210 2024-01-20T08:12:59.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.365+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe2740203b0 con 0x7fe27c0bf210 2024-01-20T08:12:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.366+0000 7fe273400640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 0x7fe25406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.366+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7fe274089970 con 0x7fe27c0bf210 2024-01-20T08:12:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.366+0000 7fe27b400640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 0x7fe25406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.367+0000 7fe27b400640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 0x7fe25406d3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe26c001050 tx=0x7fe26c000f10 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.371+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe274054830 con 0x7fe27c0bf210 2024-01-20T08:12:59.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.601+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe27c1eda30 con 0x7fe27c0bf210 2024-01-20T08:12:59.606 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.603+0000 7fe273400640 1 -- 172.21.15.100:0/515874467 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4951 (secure 0 0 0) 0x7fe27c1eda30 con 0x7fe27c0bf210 2024-01-20T08:12:59.606 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:12:59.606 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3904635499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3904635499},{"type":"v1","addr":"172.21.15.110:6835","nonce":3904635499}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:12:59.606 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 39 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.605+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 msgr2=0x7fe25406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.605+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 0x7fe25406d3c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe26c001050 tx=0x7fe26c000f10 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 msgr2=0x7fe27c0bfeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fe27c0c6840 tx=0x7fe27400f4a0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 shutdown_connections 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe27c0bf210 0x7fe27c0bfeb0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe25406af00 0x7fe25406d3c0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe27c0c1290 0x7fe27c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 --2- 172.21.15.100:0/515874467 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe25c0047c0 0x7fe27c1edd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 >> 172.21.15.100:0/515874467 conn(0x7fe27c0c9f30 msgr2=0x7fe27c0c97d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 shutdown_connections 2024-01-20T08:12:59.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.606+0000 7fe280a00640 1 -- 172.21.15.100:0/515874467 wait complete. 2024-01-20T08:12:59.627 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:12:59.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.832+0000 7f5e27a00640 1 Processor -- start 2024-01-20T08:12:59.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.832+0000 7f5e27a00640 1 -- start start 2024-01-20T08:12:59.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.833+0000 7f5e27a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.833+0000 7f5e27a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e200bfae0 0x7f5e20151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.833+0000 7f5e27a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e200c0fb0 con 0x7f5e201521e0 2024-01-20T08:12:59.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.833+0000 7f5e27a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e200c04a0 con 0x7f5e200bfae0 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e27a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2006def0 con 0x7f5e20071220 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e200bfae0 0x7f5e20151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e200bfae0 0x7f5e20151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33996/0 (socket says 172.21.15.100:33996) 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 -- 172.21.15.100:0/505324126 learned_addr learned my addr 172.21.15.100:0/505324126 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e25000640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 -- 172.21.15.100:0/505324126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 msgr2=0x7f5e20071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.834+0000 7f5e1fe00640 1 -- 172.21.15.100:0/505324126 >> v1:172.21.15.110:6789/0 conn(0x7f5e201521e0 legacy=0x7f5e20157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:12:59.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.835+0000 7f5e1fe00640 1 -- 172.21.15.100:0/505324126 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2006e1d0 con 0x7f5e200bfae0 2024-01-20T08:12:59.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.836+0000 7f5e1fe00640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e20151ca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009870 tx=0x7f5e0802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51d626a83db392f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.836+0000 7f5e1f400640 1 -- 172.21.15.100:0/505324126 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08031740 con 0x7f5e200bfae0 2024-01-20T08:12:59.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.836+0000 7f5e1f400640 1 -- 172.21.15.100:0/505324126 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e080318a0 con 0x7f5e200bfae0 2024-01-20T08:12:59.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.836+0000 7f5e1f400640 1 -- 172.21.15.100:0/505324126 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08031c30 con 0x7f5e200bfae0 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 -- 172.21.15.100:0/505324126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 msgr2=0x7f5e20151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e20151ca0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009870 tx=0x7f5e0802b7e0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 -- 172.21.15.100:0/505324126 shutdown_connections 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e20151ca0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 --2- 172.21.15.100:0/505324126 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20071600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 -- 172.21.15.100:0/505324126 >> 172.21.15.100:0/505324126 conn(0x7f5e2006a5e0 msgr2=0x7f5e2006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 -- 172.21.15.100:0/505324126 shutdown_connections 2024-01-20T08:12:59.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.837+0000 7f5e27a00640 1 -- 172.21.15.100:0/505324126 wait complete. 2024-01-20T08:12:59.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.840+0000 7f5e27a00640 1 Processor -- start 2024-01-20T08:12:59.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.840+0000 7f5e27a00640 1 -- start start 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20147f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e201521e0 0x7f5e201ed530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200ac300 con 0x7f5e200bfae0 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e200aa0b0 con 0x7f5e201521e0 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e27a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e20148440 con 0x7f5e20071220 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e1fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e1fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34000/0 (socket says 172.21.15.100:34000) 2024-01-20T08:12:59.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.841+0000 7f5e1fe00640 1 -- 172.21.15.100:0/1461931347 learned_addr learned my addr 172.21.15.100:0/1461931347 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e25000640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20147f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e25a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e201521e0 0x7f5e201ed530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 -- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 msgr2=0x7f5e20147f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20147f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 -- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e201521e0 msgr2=0x7f5e201ed530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e201521e0 0x7f5e201ed530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 -- 172.21.15.100:0/1461931347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e080094d0 con 0x7f5e200bfae0 2024-01-20T08:12:59.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.842+0000 7f5e1fe00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009870 tx=0x7f5e080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.843+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e08033c70 con 0x7f5e200bfae0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.843+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e08033df0 con 0x7f5e200bfae0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.843+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e200ab960 con 0x7f5e200bfae0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.843+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0803d6b0 con 0x7f5e200bfae0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.843+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e200abf20 con 0x7f5e200bfae0 2024-01-20T08:12:59.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.844+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e200ac440 con 0x7f5e200bfae0 2024-01-20T08:12:59.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.845+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5e0803a040 con 0x7f5e200bfae0 2024-01-20T08:12:59.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.846+0000 7f5e1cc00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 0x7f5df806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:12:59.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.846+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f5e080ab670 con 0x7f5e200bfae0 2024-01-20T08:12:59.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.846+0000 7f5e25000640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 0x7f5df806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:12:59.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.847+0000 7f5e25000640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 0x7f5df806d3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:12:59.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:12:59.851+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5e200ac440 con 0x7f5e200bfae0 2024-01-20T08:13:00.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.083+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5e200ac440 con 0x7f5e200bfae0 2024-01-20T08:13:00.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.084+0000 7f5e1cc00640 1 -- 172.21.15.100:0/1461931347 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+4951 (secure 0 0 0) 0x7f5e200ac440 con 0x7f5e200bfae0 2024-01-20T08:13:00.087 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:00.088 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":39,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3904635499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3904635499},{"type":"v1","addr":"172.21.15.110:6835","nonce":3904635499}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:12:26.535810+0000","modified":"2024-01-20T08:12:29.618103+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5676},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5676":{"gid":5676,"name":"d","rank":0,"incarnation":33,"state":"up:active","state_seq":8,"addr":"172.21.15.110:6834/275078505","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":275078505},{"type":"v1","addr":"172.21.15.110:6834","nonce":275078505}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-01-20T08:13:00.088 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 39 2024-01-20T08:13:00.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 msgr2=0x7f5df806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 0x7f5df806d3c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f5e10006fd0 tx=0x7f5e10008040 comp rx=0 tx=0).stop 2024-01-20T08:13:00.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 msgr2=0x7f5e200c4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5e08009870 tx=0x7f5e080046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 shutdown_connections 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e201521e0 0x7f5e201ed530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e200bfae0 0x7f5e200c4ff0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5df806af00 0x7f5df806d3c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 --2- 172.21.15.100:0/1461931347 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e20071220 0x7f5e20147f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 >> 172.21.15.100:0/1461931347 conn(0x7f5e2006a5e0 msgr2=0x7f5e2006d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 shutdown_connections 2024-01-20T08:13:00.091 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.087+0000 7f5e27a00640 1 -- 172.21.15.100:0/1461931347 wait complete. 2024-01-20T08:13:00.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.316+0000 7f9742e00640 1 Processor -- start 2024-01-20T08:13:00.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.316+0000 7f9742e00640 1 -- start start 2024-01-20T08:13:00.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.317+0000 7f9742e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f973c0abfd0 0x7f973c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.317+0000 7f9742e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0c1670 con 0x7f973c151f60 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.317+0000 7f9742e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0c0d40 con 0x7f973c147f20 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f9742e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0c2210 con 0x7f973c0abfd0 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f9740e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f973c0abfd0 0x7f973c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f973b400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f973c151f60 0x7f973c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58272/0 (socket says 172.21.15.100:58272) 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f973b400640 1 -- 172.21.15.100:0/263472110 learned_addr learned my addr 172.21.15.100:0/263472110 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f9740e00640 1 -- 172.21.15.100:0/263472110 >> v1:172.21.15.110:6789/0 conn(0x7f973c147f20 legacy=0x7f973c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:00.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f9740e00640 1 -- 172.21.15.100:0/263472110 >> v1:172.21.15.100:6789/0 conn(0x7f973c151f60 legacy=0x7f973c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f9740e00640 1 -- 172.21.15.100:0/263472110 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0c1020 con 0x7f973c0abfd0 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.318+0000 7f973aa00640 1 -- 172.21.15.100:0/263472110 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 961920133 0 0) 0x7f973c0c1670 con 0x7f973c151f60 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.319+0000 7f9740e00640 1 --2- 172.21.15.100:0/263472110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c0abfd0 0x7f973c070370 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9734009d90 tx=0x7f973402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2ef742da1ae9891 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f973aa00640 1 -- 172.21.15.100:0/263472110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973402cc60 con 0x7f973c0abfd0 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f973aa00640 1 -- 172.21.15.100:0/263472110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973402cdc0 con 0x7f973c0abfd0 2024-01-20T08:13:00.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f973aa00640 1 -- 172.21.15.100:0/263472110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734034660 con 0x7f973c0abfd0 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 -- 172.21.15.100:0/263472110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c0abfd0 msgr2=0x7f973c070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 --2- 172.21.15.100:0/263472110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c0abfd0 0x7f973c070370 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f9734009d90 tx=0x7f973402beb0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 -- 172.21.15.100:0/263472110 shutdown_connections 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 --2- 172.21.15.100:0/263472110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c0abfd0 0x7f973c070370 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 -- 172.21.15.100:0/263472110 >> 172.21.15.100:0/263472110 conn(0x7f973c06a5e0 msgr2=0x7f973c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:00.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 -- 172.21.15.100:0/263472110 shutdown_connections 2024-01-20T08:13:00.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.320+0000 7f9742e00640 1 -- 172.21.15.100:0/263472110 wait complete. 2024-01-20T08:13:00.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.322+0000 7f9742e00640 1 Processor -- start 2024-01-20T08:13:00.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.322+0000 7f9742e00640 1 -- start start 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c0abfd0 0x7f973c1e9110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c147f20 0x7f973c0c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c152c50 con 0x7f973c151f60 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0c6100 con 0x7f973c147f20 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.323+0000 7f9742e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1e99e0 con 0x7f973c0abfd0 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34022/0 (socket says 172.21.15.100:34022) 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 -- 172.21.15.100:0/2645432289 learned_addr learned my addr 172.21.15.100:0/2645432289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f973be00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c0abfd0 0x7f973c1e9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f973b400640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c147f20 0x7f973c0c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 -- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c0abfd0 msgr2=0x7f973c1e9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c0abfd0 0x7f973c1e9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 -- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c147f20 msgr2=0x7f973c0c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c147f20 0x7f973c0c6600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 -- 172.21.15.100:0/2645432289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734009a70 con 0x7f973c151f60 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9740e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9734009eb0 tx=0x7f9734004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.324+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973403e610 con 0x7f973c151f60 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.325+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973403e770 con 0x7f973c151f60 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.325+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973403eb20 con 0x7f973c151f60 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.325+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c152e50 con 0x7f973c151f60 2024-01-20T08:13:00.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.325+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1510a0 con 0x7f973c151f60 2024-01-20T08:13:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.326+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973c04e970 con 0x7f973c151f60 2024-01-20T08:13:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.327+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f973403b050 con 0x7f973c151f60 2024-01-20T08:13:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.327+0000 7f9733e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 0x7f971406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.328+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f97340ac050 con 0x7f973c151f60 2024-01-20T08:13:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.328+0000 7f973be00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 0x7f971406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.328+0000 7f973be00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 0x7f971406d390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f972c004ea0 tx=0x7f972c009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.332+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9734077030 con 0x7f973c151f60 2024-01-20T08:13:00.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.530+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f973c0c38d0 con 0x7f973c151f60 2024-01-20T08:13:00.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.531+0000 7f9733e00640 1 -- 172.21.15.100:0/2645432289 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16778 (secure 0 0 0) 0x7f973407a650 con 0x7f973c151f60 2024-01-20T08:13:00.535 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:00.535 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":60,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:12:57.440423+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:12:24.716271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"55","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:12:25.562320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6835/1123618406":"2024-01-21T08:12:53.405796+0000","172.21.15.110:6833/1123618406":"2024-01-21T08:12:53.405796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:00.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 msgr2=0x7f971406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 0x7f971406d390 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f972c004ea0 tx=0x7f972c009040 comp rx=0 tx=0).stop 2024-01-20T08:13:00.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 msgr2=0x7f973c0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.537 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9734009eb0 tx=0x7f9734004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 shutdown_connections 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f973c151f60 0x7f973c0c6b40 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f973c147f20 0x7f973c0c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f971406aed0 0x7f971406d390 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 --2- 172.21.15.100:0/2645432289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f973c0abfd0 0x7f973c1e9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 >> 172.21.15.100:0/2645432289 conn(0x7f973c06a5e0 msgr2=0x7f973c06ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 shutdown_connections 2024-01-20T08:13:00.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.534+0000 7f9742e00640 1 -- 172.21.15.100:0/2645432289 wait complete. 2024-01-20T08:13:00.557 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-20T08:13:00.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.760+0000 7f1365800640 1 Processor -- start 2024-01-20T08:13:00.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.760+0000 7f1365800640 1 -- start start 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1365800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f136006e0b0 0x7f1360158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1365800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13600c3c30 0x7f13600c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1365800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1360158dd0 con 0x7f1360072500 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1365800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600c1830 con 0x7f13600c3c30 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1365800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13600c05a0 con 0x7f136006e0b0 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1364e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13600c3c30 0x7f13600c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1364e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f13600c3c30 0x7f13600c40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34034/0 (socket says 172.21.15.100:34034) 2024-01-20T08:13:00.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.762+0000 7f1364e00640 1 -- 172.21.15.100:0/2950414952 learned_addr learned my addr 172.21.15.100:0/2950414952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.763+0000 7f135fe00640 1 --2- 172.21.15.100:0/2950414952 >> v2:172.21.15.110:3300/0 conn(0x7f136006e0b0 0x7f1360158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.763+0000 7f1364e00640 1 -- 172.21.15.100:0/2950414952 >> v2:172.21.15.110:3300/0 conn(0x7f136006e0b0 msgr2=0x7f1360158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.763+0000 7f1364e00640 1 --2- 172.21.15.100:0/2950414952 >> v2:172.21.15.110:3300/0 conn(0x7f136006e0b0 0x7f1360158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.763+0000 7f1364e00640 1 -- 172.21.15.100:0/2950414952 >> v1:172.21.15.110:6789/0 conn(0x7f1360072500 legacy=0x7f13600c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:00.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.763+0000 7f1364e00640 1 -- 172.21.15.100:0/2950414952 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600c0fb0 con 0x7f13600c3c30 2024-01-20T08:13:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.764+0000 7f1364e00640 1 --2- 172.21.15.100:0/2950414952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f13600c40c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1360079ab0 tx=0x7f135802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f5c95aa718e34f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.764+0000 7f135f400640 1 -- 172.21.15.100:0/2950414952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135802ca80 con 0x7f13600c3c30 2024-01-20T08:13:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.764+0000 7f135f400640 1 -- 172.21.15.100:0/2950414952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135802cbe0 con 0x7f13600c3c30 2024-01-20T08:13:00.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.764+0000 7f135f400640 1 -- 172.21.15.100:0/2950414952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13580343f0 con 0x7f13600c3c30 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 -- 172.21.15.100:0/2950414952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 msgr2=0x7f13600c40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 --2- 172.21.15.100:0/2950414952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f13600c40c0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f1360079ab0 tx=0x7f135802bee0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 -- 172.21.15.100:0/2950414952 shutdown_connections 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 --2- 172.21.15.100:0/2950414952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f13600c40c0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 --2- 172.21.15.100:0/2950414952 >> v2:172.21.15.110:3300/0 conn(0x7f136006e0b0 0x7f1360158890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 -- 172.21.15.100:0/2950414952 >> 172.21.15.100:0/2950414952 conn(0x7f13600c5ba0 msgr2=0x7f13600c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:00.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 -- 172.21.15.100:0/2950414952 shutdown_connections 2024-01-20T08:13:00.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.765+0000 7f1365800640 1 -- 172.21.15.100:0/2950414952 wait complete. 2024-01-20T08:13:00.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.767+0000 7f1365800640 1 Processor -- start 2024-01-20T08:13:00.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.767+0000 7f1365800640 1 -- start start 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136006e0b0 0x7f136014abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1360072500 0x7f13601ea9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1360158bc0 con 0x7f13600c3c30 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136014b100 con 0x7f136006e0b0 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1365800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1360071bc0 con 0x7f1360072500 2024-01-20T08:13:00.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34044/0 (socket says 172.21.15.100:34044) 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 -- 172.21.15.100:0/2894248816 learned_addr learned my addr 172.21.15.100:0/2894248816 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 -- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1360072500 msgr2=0x7f13601ea9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1360072500 0x7f13601ea9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 -- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136006e0b0 msgr2=0x7f136014abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136006e0b0 0x7f136014abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:00.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.768+0000 7f1364e00640 1 -- 172.21.15.100:0/2894248816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1358009b30 con 0x7f13600c3c30 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f1364e00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1358036040 tx=0x7f1358004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1358009510 con 0x7f13600c3c30 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135803e450 con 0x7f13600c3c30 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135803e7e0 con 0x7f13600c3c30 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13601eaf10 con 0x7f13600c3c30 2024-01-20T08:13:00.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.769+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13600aabe0 con 0x7f13600c3c30 2024-01-20T08:13:00.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.771+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136004e970 con 0x7f13600c3c30 2024-01-20T08:13:00.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.771+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f135802cd50 con 0x7f13600c3c30 2024-01-20T08:13:00.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.772+0000 7f135cc00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 0x7f133806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:00.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.772+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5857+0+0 (secure 0 0 0) 0x7f13580abd20 con 0x7f13600c3c30 2024-01-20T08:13:00.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.772+0000 7f135fe00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 0x7f133806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:00.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.773+0000 7f135fe00640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 0x7f133806d3c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13500098f0 tx=0x7f1350008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:00.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:00.776+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1358076be0 con 0x7f13600c3c30 2024-01-20T08:13:01.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.006+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7f1360158dd0 con 0x7f13600c3c30 2024-01-20T08:13:01.010 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:13:01.007+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:13:01.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.010+0000 7f135cc00640 1 -- 172.21.15.100:0/2894248816 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) v1 ==== 163+0+0 (secure 0 0 0) 0x7f1360158dd0 con 0x7f13600c3c30 2024-01-20T08:13:01.013 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 msgr2=0x7f133806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 0x7f133806d3c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f13500098f0 tx=0x7f1350008040 comp rx=0 tx=0).stop 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 msgr2=0x7f1360156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f1358036040 tx=0x7f1358004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 shutdown_connections 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f13600c3c30 0x7f1360156470 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f133806af00 0x7f133806d3c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1360072500 0x7f13601ea9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 --2- 172.21.15.100:0/2894248816 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f136006e0b0 0x7f136014abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 >> 172.21.15.100:0/2894248816 conn(0x7f13600c5ba0 msgr2=0x7f13600c2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 shutdown_connections 2024-01-20T08:13:01.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.014+0000 7f1365800640 1 -- 172.21.15.100:0/2894248816 wait complete. 2024-01-20T08:13:01.037 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-20T08:13:01.038 INFO:tasks.ceph.mds.d.smithi110.stderr: -2164> 2024-01-20T08:12:32.608+0000 7fd08e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:13:01.110 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-20T08:13:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.232+0000 7f3ccaa00640 1 Processor -- start 2024-01-20T08:13:01.235 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.232+0000 7f3ccaa00640 1 -- start start 2024-01-20T08:13:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.233+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 0x7f3cc41550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.233+0000 7f3ccaa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3cc41581e0 0x7f3cc41585e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.236 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.233+0000 7f3ccaa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc4157d00 con 0x7f3cc414e690 2024-01-20T08:13:01.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.233+0000 7f3ccaa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc40c4890 con 0x7f3cc41581e0 2024-01-20T08:13:01.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc406cd00 con 0x7f3cc40c7e10 2024-01-20T08:13:01.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cc9600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3cc414e690 0x7f3cc40ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58282/0 (socket says 172.21.15.100:58282) 2024-01-20T08:13:01.237 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cc9600640 1 -- 172.21.15.100:0/3041148786 learned_addr learned my addr 172.21.15.100:0/3041148786 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cc8c00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 0x7f3cc41550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165388275 0 0) 0x7f3cc4157d00 con 0x7f3cc414e690 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ca4003520 con 0x7f3cc414e690 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.234+0000 7f3cca000640 1 --2- 172.21.15.100:0/3041148786 >> v2:172.21.15.110:3300/0 conn(0x7f3cc41581e0 0x7f3cc41585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3713646228 0 0) 0x7f3ca4003520 con 0x7f3cc414e690 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 msgr2=0x7f3cc41550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 0x7f3cc41550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 >> v2:172.21.15.110:3300/0 conn(0x7f3cc41581e0 msgr2=0x7f3cc41585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 --2- 172.21.15.100:0/3041148786 >> v2:172.21.15.110:3300/0 conn(0x7f3cc41581e0 0x7f3cc41585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc40c4b50 con 0x7f3cc414e690 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3cb4001670 con 0x7f3cc414e690 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 >> v1:172.21.15.100:6789/0 conn(0x7f3cc414e690 legacy=0x7f3cc40ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.239 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ca4003970 0x7f3ca4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 0x7f3ca40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ca4004d00 0x7f3ca4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc40c4890 con 0x7f3ca4004d00 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc406cd00 con 0x7f3ca4003970 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ca400ba30 con 0x7f3cc40c7e10 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ca4004d00 0x7f3ca4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cc9600640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ca4003970 0x7f3ca4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 -- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 msgr2=0x7f3ca40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3cc40c7e10 0x7f3ca40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 -- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ca4003970 msgr2=0x7f3ca4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3ca4003970 0x7f3ca4003d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.240 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.235+0000 7f3cca000640 1 -- 172.21.15.100:0/3041148786 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca4003520 con 0x7f3ca4004d00 2024-01-20T08:13:01.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.236+0000 7f3cca000640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ca4004d00 0x7f3ca4005180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc007360 tx=0x7f3ca40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5b9b1ea8dbbf9e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:01.241 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc02ccf0 con 0x7f3ca4004d00 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cbc02ce50 con 0x7f3ca4004d00 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3cc3e00640 1 -- 172.21.15.100:0/3041148786 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cbc034660 con 0x7f3ca4004d00 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 -- 172.21.15.100:0/3041148786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ca4004d00 msgr2=0x7f3ca4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/3041148786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3ca4004d00 0x7f3ca4005180 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3cbc007360 tx=0x7f3ca40057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3cca000640 1 -- 172.21.15.100:0/3041148786 reap_dead start 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 -- 172.21.15.100:0/3041148786 shutdown_connections 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 -- 172.21.15.100:0/3041148786 >> 172.21.15.100:0/3041148786 conn(0x7f3cc4072130 msgr2=0x7f3cc4072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 -- 172.21.15.100:0/3041148786 shutdown_connections 2024-01-20T08:13:01.242 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.237+0000 7f3ccaa00640 1 -- 172.21.15.100:0/3041148786 wait complete. 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.239+0000 7f3ccaa00640 1 Processor -- start 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.239+0000 7f3ccaa00640 1 -- start start 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ca4004d00 0x7f3cc40a9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc40c23f0 0x7f3cc40c2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc4158770 con 0x7f3cc41ed430 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc41ecdf0 con 0x7f3cc40c23f0 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3ccaa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc41ed0d0 con 0x7f3ca4004d00 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3cc8c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34068/0 (socket says 172.21.15.100:34068) 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.240+0000 7f3cc8c00640 1 -- 172.21.15.100:0/2049739477 learned_addr learned my addr 172.21.15.100:0/2049739477 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:01.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc9600640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ca4004d00 0x7f3cc40a9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cca000640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc40c23f0 0x7f3cc40c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 -- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ca4004d00 msgr2=0x7f3cc40a9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ca4004d00 0x7f3cc40a9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 -- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc40c23f0 msgr2=0x7f3cc40c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc40c23f0 0x7f3cc40c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 -- 172.21.15.100:0/2049739477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc41ee120 con 0x7f3cc41ed430 2024-01-20T08:13:01.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc8c00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e7c0 tx=0x7f3cac00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00c730 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cac00c890 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cac00cc40 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.241+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc41eddf0 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.242+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc40c2f90 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.243+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc41548f0 con 0x7f3cc41ed430 2024-01-20T08:13:01.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.243+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3cac013470 con 0x7f3cc41ed430 2024-01-20T08:13:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.244+0000 7f3cc1600640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 0x7f3c9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.244+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f3cac0897b0 con 0x7f3cc41ed430 2024-01-20T08:13:01.247 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.245+0000 7f3cc9600640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 0x7f3c9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:01.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.245+0000 7f3cc9600640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 0x7f3c9c06d390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40c9700 tx=0x7f3cb4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:01.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.249+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3cac058010 con 0x7f3cc41ed430 2024-01-20T08:13:01.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:01.481+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3cc40c2030 con 0x7f3cc41ed430 2024-01-20T08:13:02.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.014+0000 7f3cc1600640 1 -- 172.21.15.100:0/2049739477 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 105+0+0 (secure 0 0 0) 0x7f3cac057ba0 con 0x7f3cc41ed430 2024-01-20T08:13:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 msgr2=0x7f3c9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:02.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 0x7f3c9c06d390 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f3cc40c9700 tx=0x7f3cb4009040 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 msgr2=0x7f3cc41ed8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f3cac00e7c0 tx=0x7f3cac00ebc0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 shutdown_connections 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3cc40c23f0 0x7f3cc40c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3cc41ed430 0x7f3cc41ed8b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3c9c06aed0 0x7f3c9c06d390 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 --2- 172.21.15.100:0/2049739477 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3ca4004d00 0x7f3cc40a9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.018+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 >> 172.21.15.100:0/2049739477 conn(0x7f3cc4072130 msgr2=0x7f3cc414c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.019+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 shutdown_connections 2024-01-20T08:13:02.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.019+0000 7f3ccaa00640 1 -- 172.21.15.100:0/2049739477 wait complete. 2024-01-20T08:13:02.044 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-20T08:13:02.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.247+0000 7f6370a00640 1 Processor -- start 2024-01-20T08:13:02.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.248+0000 7f6370a00640 1 -- start start 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f6370a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f636814c5a0 0x7f6368153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f6370a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f636806d570 0x7f636806d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f6370a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636806d0e0 con 0x7f636806bdb0 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f6370a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6368153560 con 0x7f636806d570 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f6370a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63680aaf10 con 0x7f636814c5a0 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f636ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f636806d570 0x7f636806d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f636ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f636806d570 0x7f636806d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34082/0 (socket says 172.21.15.100:34082) 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.249+0000 7f636ea00640 1 -- 172.21.15.100:0/2043283929 learned_addr learned my addr 172.21.15.100:0/2043283929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.250+0000 7f636e000640 1 --2- 172.21.15.100:0/2043283929 >> v2:172.21.15.110:3300/0 conn(0x7f636814c5a0 0x7f6368153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.250+0000 7f636ea00640 1 -- 172.21.15.100:0/2043283929 >> v2:172.21.15.110:3300/0 conn(0x7f636814c5a0 msgr2=0x7f6368153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.250+0000 7f636ea00640 1 --2- 172.21.15.100:0/2043283929 >> v2:172.21.15.110:3300/0 conn(0x7f636814c5a0 0x7f6368153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.250+0000 7f636ea00640 1 -- 172.21.15.100:0/2043283929 >> v1:172.21.15.110:6789/0 conn(0x7f636806bdb0 legacy=0x7f63680c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:02.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.250+0000 7f636ea00640 1 -- 172.21.15.100:0/2043283929 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636814c980 con 0x7f636806d570 2024-01-20T08:13:02.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.251+0000 7f636ea00640 1 --2- 172.21.15.100:0/2043283929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636806d570 0x7f636806d9e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f636806b480 tx=0x7f636002bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ddfd710cdf7e73 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:02.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.251+0000 7f636cc00640 1 -- 172.21.15.100:0/2043283929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002c960 con 0x7f636806d570 2024-01-20T08:13:02.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f636cc00640 1 -- 172.21.15.100:0/2043283929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636002cac0 con 0x7f636806d570 2024-01-20T08:13:02.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f636cc00640 1 -- 172.21.15.100:0/2043283929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636002ce50 con 0x7f636806d570 2024-01-20T08:13:02.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 -- 172.21.15.100:0/2043283929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636806d570 msgr2=0x7f636806d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:02.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 --2- 172.21.15.100:0/2043283929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636806d570 0x7f636806d9e0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f636806b480 tx=0x7f636002bdc0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 -- 172.21.15.100:0/2043283929 shutdown_connections 2024-01-20T08:13:02.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 --2- 172.21.15.100:0/2043283929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636806d570 0x7f636806d9e0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 --2- 172.21.15.100:0/2043283929 >> v2:172.21.15.110:3300/0 conn(0x7f636814c5a0 0x7f6368153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 -- 172.21.15.100:0/2043283929 >> 172.21.15.100:0/2043283929 conn(0x7f63680c2b00 msgr2=0x7f63680c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:02.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 -- 172.21.15.100:0/2043283929 shutdown_connections 2024-01-20T08:13:02.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.252+0000 7f6370a00640 1 -- 172.21.15.100:0/2043283929 wait complete. 2024-01-20T08:13:02.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.255+0000 7f6370a00640 1 Processor -- start 2024-01-20T08:13:02.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.255+0000 7f6370a00640 1 -- start start 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f636806bdb0 0x7f6368153970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 0x7f6368146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63681480a0 con 0x7f636814c5a0 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6368147250 con 0x7f636806d570 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f6370a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63681eb3b0 con 0x7f636806bdb0 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f636ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f636ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34084/0 (socket says 172.21.15.100:34084) 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.256+0000 7f636ea00640 1 -- 172.21.15.100:0/2665376037 learned_addr learned my addr 172.21.15.100:0/2665376037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636e000640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f636806bdb0 0x7f6368153970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636d600640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 0x7f6368146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 -- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f636806bdb0 msgr2=0x7f6368153970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f636806bdb0 0x7f6368153970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 -- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 msgr2=0x7f6368146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 0x7f6368146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 -- 172.21.15.100:0/2665376037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009b30 con 0x7f636814c5a0 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636d600640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 0x7f6368146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:02.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f636ea00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6360009f40 tx=0x7f6360004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6360009510 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.257+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636003e450 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.258+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63681eb690 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.258+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636003e7e0 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.258+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63681474a0 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.259+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63681eb820 con 0x7f636814c5a0 2024-01-20T08:13:02.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.260+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f636003e940 con 0x7f636814c5a0 2024-01-20T08:13:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.261+0000 7f6366000640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 0x7f634006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.261+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5943+0+0 (secure 0 0 0) 0x7f63600ac1f0 con 0x7f636814c5a0 2024-01-20T08:13:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.261+0000 7f636e000640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 0x7f634006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:02.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.262+0000 7f636e000640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 0x7f634006d3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:02.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.265+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6360076fc0 con 0x7f636814c5a0 2024-01-20T08:13:02.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:02.457+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6368074450 con 0x7f636814c5a0 2024-01-20T08:13:03.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.017+0000 7f6366000640 1 -- 172.21.15.100:0/2665376037 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v62) v1 ==== 184+0+0 (secure 0 0 0) 0x7f636007a5e0 con 0x7f636814c5a0 2024-01-20T08:13:03.021 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' removed 2024-01-20T08:13:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 msgr2=0x7f634006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 0x7f634006d3c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f6358006fd0 tx=0x7f6358008040 comp rx=0 tx=0).stop 2024-01-20T08:13:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 msgr2=0x7f63681491b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f6360009f40 tx=0x7f6360004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:03.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 shutdown_connections 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f636814c5a0 0x7f63681491b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f636806d570 0x7f6368146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f634006af00 0x7f634006d3c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 --2- 172.21.15.100:0/2665376037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f636806bdb0 0x7f6368153970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 >> 172.21.15.100:0/2665376037 conn(0x7f63680c2b00 msgr2=0x7f6368152d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 shutdown_connections 2024-01-20T08:13:03.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.021+0000 7f6370a00640 1 -- 172.21.15.100:0/2665376037 wait complete. 2024-01-20T08:13:03.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-20T08:13:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.247+0000 7fe856800640 1 Processor -- start 2024-01-20T08:13:03.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.247+0000 7fe856800640 1 -- start start 2024-01-20T08:13:03.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.248+0000 7fe856800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe850148080 0x7fe8500c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.248+0000 7fe856800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8500a84a0 0x7fe85015be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe856800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe85006d1d0 con 0x7fe850070c00 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe856800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500a8ce0 con 0x7fe850148080 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe856800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe850148460 con 0x7fe8500a84a0 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe847e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe850070c00 0x7fe85006d660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58284/0 (socket says 172.21.15.100:58284) 2024-01-20T08:13:03.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe847e00640 1 -- 172.21.15.100:0/281522837 learned_addr learned my addr 172.21.15.100:0/281522837 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe84f400640 1 --2- 172.21.15.100:0/281522837 >> v2:172.21.15.110:3300/0 conn(0x7fe850148080 0x7fe8500c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3037174295 0 0) 0x7fe85006d1d0 con 0x7fe850070c00 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe830003520 con 0x7fe850070c00 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.249+0000 7fe84fe00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8500a84a0 0x7fe85015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714839177 0 0) 0x7fe830003520 con 0x7fe850070c00 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8500a84a0 msgr2=0x7fe85015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe8500a84a0 0x7fe85015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 >> v2:172.21.15.110:3300/0 conn(0x7fe850148080 msgr2=0x7fe8500c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:03.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 --2- 172.21.15.100:0/281522837 >> v2:172.21.15.110:3300/0 conn(0x7fe850148080 0x7fe8500c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500c2540 con 0x7fe850070c00 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe838001670 con 0x7fe850070c00 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 >> v1:172.21.15.100:6789/0 conn(0x7fe850070c00 legacy=0x7fe85006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830003970 0x7fe830003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe830004360 0x7fe830004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe830005000 0x7fe83000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500a8ce0 con 0x7fe830004360 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe850148460 con 0x7fe830005000 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe83000bfa0 con 0x7fe830003970 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe847e00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe830004360 0x7fe830004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84f400640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830003970 0x7fe830003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe84fe00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe830005000 0x7fe83000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe847e00640 1 -- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830003970 msgr2=0x7fe830003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.250+0000 7fe847e00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830003970 0x7fe830003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.251+0000 7fe847e00640 1 -- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe830005000 msgr2=0x7fe83000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.251+0000 7fe847e00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe830005000 0x7fe83000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.251+0000 7fe847e00640 1 -- 172.21.15.100:0/281522837 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe830003520 con 0x7fe830004360 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe847e00640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe830004360 0x7fe830004840 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c210 tx=0x7fe8300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d1d8262847a6c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838005ad0 con 0x7fe830004360 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe838005c30 con 0x7fe830004360 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe84ea00640 1 -- 172.21.15.100:0/281522837 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83802cad0 con 0x7fe830004360 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe856800640 1 -- 172.21.15.100:0/281522837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe830004360 msgr2=0x7fe830004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe856800640 1 --2- 172.21.15.100:0/281522837 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe830004360 0x7fe830004840 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fe83800c210 tx=0x7fe8300057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.252+0000 7fe84fe00640 1 -- 172.21.15.100:0/281522837 reap_dead start 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.253+0000 7fe856800640 1 -- 172.21.15.100:0/281522837 shutdown_connections 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.253+0000 7fe856800640 1 -- 172.21.15.100:0/281522837 >> 172.21.15.100:0/281522837 conn(0x7fe8500c2b00 msgr2=0x7fe8500c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:03.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.253+0000 7fe856800640 1 -- 172.21.15.100:0/281522837 shutdown_connections 2024-01-20T08:13:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.253+0000 7fe856800640 1 -- 172.21.15.100:0/281522837 wait complete. 2024-01-20T08:13:03.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.254+0000 7fe856800640 1 Processor -- start 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 -- start start 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830004360 0x7fe850149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85014b020 0x7fe85014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe85014ab90 con 0x7fe8501eb850 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501dab10 con 0x7fe85014b020 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.255+0000 7fe856800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8501ec3b0 con 0x7fe830004360 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34104/0 (socket says 172.21.15.100:34104) 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 -- 172.21.15.100:0/734485113 learned_addr learned my addr 172.21.15.100:0/734485113 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe84f400640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830004360 0x7fe850149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe84fe00640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85014b020 0x7fe85014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 -- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830004360 msgr2=0x7fe850149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830004360 0x7fe850149620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 -- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85014b020 msgr2=0x7fe85014b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85014b020 0x7fe85014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 -- 172.21.15.100:0/734485113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8501dadb0 con 0x7fe8501eb850 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.256+0000 7fe847e00640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe838000f60 tx=0x7fe838001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.257+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe838039070 con 0x7fe8501eb850 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.257+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe83802dd30 con 0x7fe8501eb850 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.257+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe83802dea0 con 0x7fe8501eb850 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.257+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8501db090 con 0x7fe8501eb850 2024-01-20T08:13:03.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.257+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8501485a0 con 0x7fe8501eb850 2024-01-20T08:13:03.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.258+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850074450 con 0x7fe8501eb850 2024-01-20T08:13:03.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.259+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe838032070 con 0x7fe8501eb850 2024-01-20T08:13:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.260+0000 7fe847400640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 0x7fe82806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.260+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5503+0+0 (secure 0 0 0) 0x7fe83803c040 con 0x7fe8501eb850 2024-01-20T08:13:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.260+0000 7fe84f400640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 0x7fe82806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:03.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.261+0000 7fe84f400640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 0x7fe82806d390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe8400099d0 tx=0x7fe840008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:03.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.264+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe838075670 con 0x7fe8501eb850 2024-01-20T08:13:03.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:03.459+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe85004ea50 con 0x7fe8501eb850 2024-01-20T08:13:04.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.020+0000 7fe847400640 1 -- 172.21.15.100:0/734485113 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v63) v1 ==== 172+0+0 (secure 0 0 0) 0x7fe838045020 con 0x7fe8501eb850 2024-01-20T08:13:04.024 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' removed 2024-01-20T08:13:04.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.025+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 msgr2=0x7fe82806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.025+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 0x7fe82806d390 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe8400099d0 tx=0x7fe840008040 comp rx=0 tx=0).stop 2024-01-20T08:13:04.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.025+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 msgr2=0x7fe8501ebcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.028 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.025+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe838000f60 tx=0x7fe838001a00 comp rx=0 tx=0).stop 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 shutdown_connections 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe85014b020 0x7fe85014b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe8501eb850 0x7fe8501ebcb0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe82806aed0 0x7fe82806d390 secure :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe8400099d0 tx=0x7fe840008040 comp rx=0 tx=0).stop 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 --2- 172.21.15.100:0/734485113 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe830004360 0x7fe850149620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.027+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 >> 172.21.15.100:0/734485113 conn(0x7fe8500c2b00 msgr2=0x7fe850143a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.028+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 shutdown_connections 2024-01-20T08:13:04.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.028+0000 7fe856800640 1 -- 172.21.15.100:0/734485113 wait complete. 2024-01-20T08:13:04.059 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-20T08:13:04.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.246+0000 7f3ba3800640 1 Processor -- start 2024-01-20T08:13:04.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.246+0000 7f3ba3800640 1 -- start start 2024-01-20T08:13:04.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.247+0000 7f3ba3800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f3b9c14fdb0 0x7f3b9c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.247+0000 7f3ba3800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b9c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.247+0000 7f3ba3800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b9c150190 con 0x7f3b9c0c3460 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3ba3800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b9c0a9ce0 con 0x7f3b9c14fdb0 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3ba3800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0a93b0 con 0x7f3b9c0c1d90 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3ba1800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3b9c0c3460 0x7f3b9c155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58286/0 (socket says 172.21.15.100:58286) 2024-01-20T08:13:04.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3ba1800640 1 -- 172.21.15.100:0/2335057856 learned_addr learned my addr 172.21.15.100:0/2335057856 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341917126 0 0) 0x7f3b9c150190 con 0x7f3b9c0c3460 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b7c003520 con 0x7f3b9c0c3460 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3b93e00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b9c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.248+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2335057856 >> v2:172.21.15.110:3300/0 conn(0x7f3b9c14fdb0 0x7f3b9c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 163008758 0 0) 0x7f3b7c003520 con 0x7f3b9c0c3460 2024-01-20T08:13:04.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 msgr2=0x7f3b9c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b9c152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 >> v2:172.21.15.110:3300/0 conn(0x7f3b9c14fdb0 msgr2=0x7f3b9c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 --2- 172.21.15.100:0/2335057856 >> v2:172.21.15.110:3300/0 conn(0x7f3b9c14fdb0 0x7f3b9c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c0a8810 con 0x7f3b9c0c3460 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3b940019f0 con 0x7f3b9c0c3460 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2335057856 >> v2:172.21.15.110:3300/0 conn(0x7f3b9c14fdb0 0x7f3b9c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 >> v1:172.21.15.100:6789/0 conn(0x7f3b9c0c3460 legacy=0x7f3b9c155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7c003970 0x7f3b7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c0a93b0 con 0x7f3b7c004d00 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c00b980 con 0x7f3b7c003970 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.249+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7c00bac0 con 0x7f3b9c0c1d90 2024-01-20T08:13:04.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3b93e00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7c003970 0x7f3b7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 -- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 msgr2=0x7f3b7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c0c1d90 0x7f3b7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 -- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7c003970 msgr2=0x7f3b7c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b7c003970 0x7f3b7c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.250+0000 7f3ba1800640 1 -- 172.21.15.100:0/2335057856 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c003520 con 0x7f3b7c004d00 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.251+0000 7f3ba1800640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b7c005180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400a900 tx=0x7f3b7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df83094ca9afc86 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.251+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94034630 con 0x7f3b7c004d00 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.251+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b9402f070 con 0x7f3b7c004d00 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.251+0000 7f3b9be00640 1 -- 172.21.15.100:0/2335057856 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940349d0 con 0x7f3b7c004d00 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 -- 172.21.15.100:0/2335057856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 msgr2=0x7f3b7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2335057856 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b7c005180 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400a900 tx=0x7f3b7c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba1800640 1 -- 172.21.15.100:0/2335057856 reap_dead start 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 -- 172.21.15.100:0/2335057856 shutdown_connections 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 -- 172.21.15.100:0/2335057856 >> 172.21.15.100:0/2335057856 conn(0x7f3b9c0c2940 msgr2=0x7f3b9c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 -- 172.21.15.100:0/2335057856 shutdown_connections 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.252+0000 7f3ba3800640 1 -- 172.21.15.100:0/2335057856 wait complete. 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.254+0000 7f3ba3800640 1 Processor -- start 2024-01-20T08:13:04.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.254+0000 7f3ba3800640 1 -- start start 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b9c06de60 0x7f3b9c14e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c1e9b00 0x7f3b9c1ed890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1ea3c0 con 0x7f3b7c004d00 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1ea6a0 con 0x7f3b9c06de60 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba3800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9c1ea980 con 0x7f3b9c1e9b00 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba0e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34134/0 (socket says 172.21.15.100:34134) 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.255+0000 7f3ba0e00640 1 -- 172.21.15.100:0/2463580979 learned_addr learned my addr 172.21.15.100:0/2463580979 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3b93e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b9c06de60 0x7f3b9c14e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba1800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c1e9b00 0x7f3b9c1ed890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 -- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c1e9b00 msgr2=0x7f3b9c1ed890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c1e9b00 0x7f3b9c1ed890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 -- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b9c06de60 msgr2=0x7f3b9c14e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b9c06de60 0x7f3b9c14e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 -- 172.21.15.100:0/2463580979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c1ed090 con 0x7f3b7c004d00 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3ba0e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c010860 tx=0x7f3b8c010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00eb60 con 0x7f3b7c004d00 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b8c00c050 con 0x7f3b7c004d00 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.256+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c00eec0 con 0x7f3b7c004d00 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.257+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b9c1ed370 con 0x7f3b7c004d00 2024-01-20T08:13:04.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.257+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b9c1e9f80 con 0x7f3b7c004d00 2024-01-20T08:13:04.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.258+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b9c04e970 con 0x7f3b7c004d00 2024-01-20T08:13:04.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.259+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3b8c015470 con 0x7f3b7c004d00 2024-01-20T08:13:04.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.260+0000 7f3b99600640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.260+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3b8c089ce0 con 0x7f3b7c004d00 2024-01-20T08:13:04.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.260+0000 7f3b93e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.261+0000 7f3b93e00640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 0x7f3b7406d3c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c14c340 tx=0x7f3b84008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.264+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3b8c054ee0 con 0x7f3b7c004d00 2024-01-20T08:13:04.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.458+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f3b9c0c2260 con 0x7f3b7c004d00 2024-01-20T08:13:04.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.465+0000 7f3b99600640 1 -- 172.21.15.100:0/2463580979 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f3b8c058500 con 0x7f3b7c004d00 2024-01-20T08:13:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 msgr2=0x7f3b7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 0x7f3b7406d3c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f3b9c14c340 tx=0x7f3b84008040 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 msgr2=0x7f3b9c14a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c010860 tx=0x7f3b8c010d20 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 shutdown_connections 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b7406af00 0x7f3b7406d3c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b9c1e9b00 0x7f3b9c1ed890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b9c06de60 0x7f3b9c14e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 --2- 172.21.15.100:0/2463580979 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b7c004d00 0x7f3b9c14a050 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.468+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 >> 172.21.15.100:0/2463580979 conn(0x7f3b9c0c2940 msgr2=0x7f3b9c14ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.469+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 shutdown_connections 2024-01-20T08:13:04.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.469+0000 7f3ba3800640 1 -- 172.21.15.100:0/2463580979 wait complete. 2024-01-20T08:13:04.490 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent' 2024-01-20T08:13:04.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.695+0000 7f3052c00640 1 Processor -- start 2024-01-20T08:13:04.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.695+0000 7f3052c00640 1 -- start start 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 0x7f304c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c1581e0 0x7f304c158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f304c158bb0 con 0x7f304c0c7e10 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c157d00 con 0x7f304c1581e0 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f304c0c4890 con 0x7f304c14e690 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c1581e0 0x7f304c158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f304c1581e0 0x7f304c158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34144/0 (socket says 172.21.15.100:34144) 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.697+0000 7f3052200640 1 -- 172.21.15.100:0/3600909876 learned_addr learned my addr 172.21.15.100:0/3600909876 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3051800640 1 --2- 172.21.15.100:0/3600909876 >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 0x7f304c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3052200640 1 -- 172.21.15.100:0/3600909876 >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 msgr2=0x7f304c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3052200640 1 --2- 172.21.15.100:0/3600909876 >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 0x7f304c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3052200640 1 -- 172.21.15.100:0/3600909876 >> v1:172.21.15.110:6789/0 conn(0x7f304c0c7e10 legacy=0x7f304c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3052200640 1 -- 172.21.15.100:0/3600909876 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f304c06cd00 con 0x7f304c1581e0 2024-01-20T08:13:04.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.698+0000 7f3051800640 1 --2- 172.21.15.100:0/3600909876 >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 0x7f304c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.699+0000 7f3052200640 1 --2- 172.21.15.100:0/3600909876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c1581e0 0x7f304c158670 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f304c0acab0 tx=0x7f304402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7793d3e7365688b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.699+0000 7f304be00640 1 -- 172.21.15.100:0/3600909876 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30440317e0 con 0x7f304c1581e0 2024-01-20T08:13:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.699+0000 7f304be00640 1 -- 172.21.15.100:0/3600909876 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3044031940 con 0x7f304c1581e0 2024-01-20T08:13:04.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.699+0000 7f304be00640 1 -- 172.21.15.100:0/3600909876 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3044031cd0 con 0x7f304c1581e0 2024-01-20T08:13:04.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 -- 172.21.15.100:0/3600909876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c1581e0 msgr2=0x7f304c158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 --2- 172.21.15.100:0/3600909876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c1581e0 0x7f304c158670 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f304c0acab0 tx=0x7f304402b880 comp rx=0 tx=0).stop 2024-01-20T08:13:04.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 -- 172.21.15.100:0/3600909876 shutdown_connections 2024-01-20T08:13:04.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 --2- 172.21.15.100:0/3600909876 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c1581e0 0x7f304c158670 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 --2- 172.21.15.100:0/3600909876 >> v2:172.21.15.110:3300/0 conn(0x7f304c14e690 0x7f304c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 -- 172.21.15.100:0/3600909876 >> 172.21.15.100:0/3600909876 conn(0x7f304c072130 msgr2=0x7f304c072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 -- 172.21.15.100:0/3600909876 shutdown_connections 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.700+0000 7f3052c00640 1 -- 172.21.15.100:0/3600909876 wait complete. 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.702+0000 7f3052c00640 1 Processor -- start 2024-01-20T08:13:04.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.702+0000 7f3052c00640 1 -- start start 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304c14e690 0x7f304c1eda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c1581e0 0x7f304c148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0aa630 con 0x7f304c0c7e10 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0ade80 con 0x7f304c1581e0 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3052c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f304c0ad570 con 0x7f304c14e690 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34152/0 (socket says 172.21.15.100:34152) 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 -- 172.21.15.100:0/1586128425 learned_addr learned my addr 172.21.15.100:0/1586128425 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 -- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304c14e690 msgr2=0x7f304c1eda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304c14e690 0x7f304c1eda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 -- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c1581e0 msgr2=0x7f304c148100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c1581e0 0x7f304c148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.703+0000 7f3051800640 1 -- 172.21.15.100:0/1586128425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30440094d0 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3051800640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c7f0 tx=0x7f303c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c007a30 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f303c007b90 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f304c1ee3b0 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f303c00ce40 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.704+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c0adb10 con 0x7f304c0c7e10 2024-01-20T08:13:04.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.705+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f304c04e970 con 0x7f304c0c7e10 2024-01-20T08:13:04.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.706+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f303c0113f0 con 0x7f304c0c7e10 2024-01-20T08:13:04.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.707+0000 7f3049600640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 0x7f302406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:04.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.707+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f303c089590 con 0x7f304c0c7e10 2024-01-20T08:13:04.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.707+0000 7f3050e00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 0x7f302406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:04.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.708+0000 7f3050e00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 0x7f302406d3c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f304c152650 tx=0x7f3034009250 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:04.714 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.712+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f303c054660 con 0x7f304c0c7e10 2024-01-20T08:13:04.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:04.986+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]} v 0) v1 -- 0x7f304c0afb90 con 0x7f304c0c7e10 2024-01-20T08:13:05.044 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.041+0000 7f3049600640 1 -- 172.21.15.100:0/1586128425 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth.test_mount_mon_and_osd_caps_present_mds_caps_absent"]}]=0 v184) v1 ==== 184+0+0 (secure 0 0 0) 0x7f303c057c80 con 0x7f304c0c7e10 2024-01-20T08:13:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 msgr2=0x7f302406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 0x7f302406d3c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f304c152650 tx=0x7f3034009250 comp rx=0 tx=0).stop 2024-01-20T08:13:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 msgr2=0x7f304c0aa0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f303c00c7f0 tx=0x7f303c00cbf0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 shutdown_connections 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f304c1581e0 0x7f304c148100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f302406af00 0x7f302406d3c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f304c14e690 0x7f304c1eda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 --2- 172.21.15.100:0/1586128425 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f304c0c7e10 0x7f304c0aa0f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 >> 172.21.15.100:0/1586128425 conn(0x7f304c072130 msgr2=0x7f304c152e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 shutdown_connections 2024-01-20T08:13:05.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.045+0000 7f3052c00640 1 -- 172.21.15.100:0/1586128425 wait complete. 2024-01-20T08:13:05.068 INFO:tasks.cephfs_test_runner:test_mount_mon_and_osd_caps_present_mds_caps_absent (tasks.cephfs.test_multifs_auth.TestClientsWithoutAuth) ... ok 2024-01-20T08:13:05.068 INFO:tasks.cephfs_test_runner:Starting test: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-20T08:13:05.068 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.267+0000 7fd608e00640 1 Processor -- start 2024-01-20T08:13:05.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.267+0000 7fd608e00640 1 -- start start 2024-01-20T08:13:05.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.268+0000 7fd608e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 0x7fd6040721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.268+0000 7fd608e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6040ac000 0x7fd604159760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.268+0000 7fd608e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6041592d0 con 0x7fd60415a190 2024-01-20T08:13:05.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.268+0000 7fd608e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd604159ca0 con 0x7fd6040ac000 2024-01-20T08:13:05.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.268+0000 7fd608e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd604158ca0 con 0x7fd6040705e0 2024-01-20T08:13:05.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6040ac000 0x7fd604159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd6040ac000 0x7fd604159760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34164/0 (socket says 172.21.15.100:34164) 2024-01-20T08:13:05.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 -- 172.21.15.100:0/3408496929 learned_addr learned my addr 172.21.15.100:0/3408496929 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd601e00640 1 --2- 172.21.15.100:0/3408496929 >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 0x7fd6040721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 -- 172.21.15.100:0/3408496929 >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 msgr2=0x7fd6040721e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 --2- 172.21.15.100:0/3408496929 >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 0x7fd6040721e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 -- 172.21.15.100:0/3408496929 >> v1:172.21.15.100:6789/0 conn(0x7fd60415a190 legacy=0x7fd604156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd5f9200640 1 -- 172.21.15.100:0/3408496929 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60415cd40 con 0x7fd6040ac000 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.269+0000 7fd601e00640 1 --2- 172.21.15.100:0/3408496929 >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 0x7fd6040721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:05.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.270+0000 7fd5f9200640 1 --2- 172.21.15.100:0/3408496929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd604159760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd60406f920 tx=0x7fd5ec02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5b259c2c9808987 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd601400640 1 -- 172.21.15.100:0/3408496929 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec031870 con 0x7fd6040ac000 2024-01-20T08:13:05.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd601400640 1 -- 172.21.15.100:0/3408496929 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0319d0 con 0x7fd6040ac000 2024-01-20T08:13:05.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd601400640 1 -- 172.21.15.100:0/3408496929 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec031d60 con 0x7fd6040ac000 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 -- 172.21.15.100:0/3408496929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 msgr2=0x7fd604159760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 --2- 172.21.15.100:0/3408496929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd604159760 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fd60406f920 tx=0x7fd5ec02b910 comp rx=0 tx=0).stop 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 -- 172.21.15.100:0/3408496929 shutdown_connections 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 --2- 172.21.15.100:0/3408496929 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd604159760 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 --2- 172.21.15.100:0/3408496929 >> v2:172.21.15.110:3300/0 conn(0x7fd6040705e0 0x7fd6040721e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 -- 172.21.15.100:0/3408496929 >> 172.21.15.100:0/3408496929 conn(0x7fd60406a5e0 msgr2=0x7fd60406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 -- 172.21.15.100:0/3408496929 shutdown_connections 2024-01-20T08:13:05.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.271+0000 7fd608e00640 1 -- 172.21.15.100:0/3408496929 wait complete. 2024-01-20T08:13:05.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.273+0000 7fd608e00640 1 Processor -- start 2024-01-20T08:13:05.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.273+0000 7fd608e00640 1 -- start start 2024-01-20T08:13:05.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6040705e0 0x7fd6040bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60415a190 0x7fd6041573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6040bc210 con 0x7fd6040ac000 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6041eecc0 con 0x7fd6040705e0 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd608e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60415ae30 con 0x7fd60415a190 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd5f9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd5f9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34166/0 (socket says 172.21.15.100:34166) 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.274+0000 7fd5f9200640 1 -- 172.21.15.100:0/3707878887 learned_addr learned my addr 172.21.15.100:0/3707878887 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd601e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6040705e0 0x7fd6040bdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd602800640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60415a190 0x7fd6041573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 -- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60415a190 msgr2=0x7fd6041573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60415a190 0x7fd6041573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 -- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6040705e0 msgr2=0x7fd6040bdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6040705e0 0x7fd6040bdaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 -- 172.21.15.100:0/3707878887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ec0094d0 con 0x7fd6040ac000 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.275+0000 7fd5f9200640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec02b950 tx=0x7fd5ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.276+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec031860 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.276+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ec0443f0 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.276+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ec0447a0 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.276+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6040aadf0 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.276+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6040bc460 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.277+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60404e970 con 0x7fd6040ac000 2024-01-20T08:13:05.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.278+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd5ec04d450 con 0x7fd6040ac000 2024-01-20T08:13:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.279+0000 7fd5faa00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 0x7fd5dc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.279+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fd5ec02d040 con 0x7fd6040ac000 2024-01-20T08:13:05.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.279+0000 7fd601e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 0x7fd5dc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.280+0000 7fd601e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 0x7fd5dc06d3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd6040bd700 tx=0x7fd5f4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.283+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd5ec076c90 con 0x7fd6040ac000 2024-01-20T08:13:05.483 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.480+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6040676e0 con 0x7fd6040ac000 2024-01-20T08:13:05.485 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.482+0000 7fd5faa00640 1 -- 172.21.15.100:0/3707878887 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+13096 (secure 0 0 0) 0x7fd5ec035020 con 0x7fd6040ac000 2024-01-20T08:13:05.485 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:05.485 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":63,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:04.018105+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.110:6834/275078505":"2024-01-21T08:13:01.008394+0000","172.21.15.110:6832/275078505":"2024-01-21T08:13:01.008394+0000","172.21.15.110:6835/1123618406":"2024-01-21T08:12:53.405796+0000","172.21.15.110:6833/1123618406":"2024-01-21T08:12:53.405796+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 msgr2=0x7fd5dc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 0x7fd5dc06d3c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd6040bd700 tx=0x7fd5f4008040 comp rx=0 tx=0).stop 2024-01-20T08:13:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 msgr2=0x7fd6041ee780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fd5ec02b950 tx=0x7fd5ec0046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.488 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 shutdown_connections 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd5dc06af00 0x7fd5dc06d3c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd60415a190 0x7fd6041573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd6040ac000 0x7fd6041ee780 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 --2- 172.21.15.100:0/3707878887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd6040705e0 0x7fd6040bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 >> 172.21.15.100:0/3707878887 conn(0x7fd60406a5e0 msgr2=0x7fd6040c6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 shutdown_connections 2024-01-20T08:13:05.489 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.485+0000 7fd608e00640 1 -- 172.21.15.100:0/3707878887 wait complete. 2024-01-20T08:13:05.506 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:13:05.507 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:13:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.717+0000 7f2478400640 1 Processor -- start 2024-01-20T08:13:05.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.717+0000 7f2478400640 1 -- start start 2024-01-20T08:13:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.718+0000 7f2478400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f247006b140 0x7f2470154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.718+0000 7f2478400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f247006b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.718+0000 7f2478400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24700c9100 con 0x7f2470155eb0 2024-01-20T08:13:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.718+0000 7f2478400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24700c84f0 con 0x7f247006b140 2024-01-20T08:13:05.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.718+0000 7f2478400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c87d0 con 0x7f24700c7ff0 2024-01-20T08:13:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f2476400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2470155eb0 0x7f2470156360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58312/0 (socket says 172.21.15.100:58312) 2024-01-20T08:13:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f2476400640 1 -- 172.21.15.100:0/2712626269 learned_addr learned my addr 172.21.15.100:0/2712626269 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034759897 0 0) 0x7f24700c9100 con 0x7f2470155eb0 2024-01-20T08:13:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f2475a00640 1 --2- 172.21.15.100:0/2712626269 >> v2:172.21.15.110:3300/0 conn(0x7f247006b140 0x7f2470154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f2475000640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f247006b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.719+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2450003520 con 0x7f2470155eb0 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 667194674 0 0) 0x7f2450003520 con 0x7f2470155eb0 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 msgr2=0x7f247006b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f247006b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 >> v2:172.21.15.110:3300/0 conn(0x7f247006b140 msgr2=0x7f2470154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 --2- 172.21.15.100:0/2712626269 >> v2:172.21.15.110:3300/0 conn(0x7f247006b140 0x7f2470154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24700c8ab0 con 0x7f2470155eb0 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f24680019f0 con 0x7f2470155eb0 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 >> v1:172.21.15.100:6789/0 conn(0x7f2470155eb0 legacy=0x7f2470156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f2450003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450003f40 0x7f24500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2450004d00 0x7f2450005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c84f0 con 0x7f2450003f40 2024-01-20T08:13:05.724 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c87d0 con 0x7f2450004d00 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245000ba30 con 0x7f24700c7ff0 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450003f40 0x7f24500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475a00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f2450003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2476400640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2450004d00 0x7f2450005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 -- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 msgr2=0x7f2450003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f2450003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 -- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2450004d00 msgr2=0x7f2450005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2450004d00 0x7f2450005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475000640 1 -- 172.21.15.100:0/2712626269 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2450003520 con 0x7f2450003f40 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2475a00640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24700c7ff0 0x7f2450003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:05.725 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.720+0000 7f2476400640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2450004d00 0x7f2450005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2475000640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450003f40 0x7f24500047c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2458009ac0 tx=0x7f24500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc5bfb862462a2e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245802c6b0 con 0x7f2450003f40 2024-01-20T08:13:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f245802c810 con 0x7f2450003f40 2024-01-20T08:13:05.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f246fe00640 1 -- 172.21.15.100:0/2712626269 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245802cba0 con 0x7f2450003f40 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2478400640 1 -- 172.21.15.100:0/2712626269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450003f40 msgr2=0x7f24500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2478400640 1 --2- 172.21.15.100:0/2712626269 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2450003f40 0x7f24500047c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f2458009ac0 tx=0x7f24500057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2476400640 1 -- 172.21.15.100:0/2712626269 reap_dead start 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2478400640 1 -- 172.21.15.100:0/2712626269 shutdown_connections 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.722+0000 7f2478400640 1 -- 172.21.15.100:0/2712626269 >> 172.21.15.100:0/2712626269 conn(0x7f24700abc80 msgr2=0x7f24700ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.723+0000 7f2478400640 1 -- 172.21.15.100:0/2712626269 shutdown_connections 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.723+0000 7f2478400640 1 -- 172.21.15.100:0/2712626269 wait complete. 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.724+0000 7f2478400640 1 Processor -- start 2024-01-20T08:13:05.727 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.724+0000 7f2478400640 1 -- start start 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2450003f40 0x7f24701edc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 0x7f24700aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c17d0 con 0x7f24700c52d0 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24700c3910 con 0x7f24700aaae0 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.725+0000 7f2478400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24701ed7f0 con 0x7f2450003f40 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34184/0 (socket says 172.21.15.100:34184) 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 -- 172.21.15.100:0/2061658573 learned_addr learned my addr 172.21.15.100:0/2061658573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:05.729 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2476400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 0x7f24700aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475a00640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2450003f40 0x7f24701edc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 -- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2450003f40 msgr2=0x7f24701edc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2450003f40 0x7f24701edc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 -- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 msgr2=0x7f24700aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 0x7f24700aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2475000640 1 -- 172.21.15.100:0/2061658573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24701ee1c0 con 0x7f24700c52d0 2024-01-20T08:13:05.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.726+0000 7f2476400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 0x7f24700aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f2475000640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2458037040 tx=0x7f2458004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458003810 con 0x7f24700c52d0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458003970 con 0x7f24700c52d0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24700c14f0 con 0x7f24700c52d0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458003ce0 con 0x7f24700c52d0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.727+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24700c4030 con 0x7f24700c52d0 2024-01-20T08:13:05.731 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.728+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24701ed2e0 con 0x7f24700c52d0 2024-01-20T08:13:05.732 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.729+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2458034440 con 0x7f24700c52d0 2024-01-20T08:13:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.731+0000 7f246d600640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 0x7f244806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.731+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f24580ab240 con 0x7f24700c52d0 2024-01-20T08:13:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.731+0000 7f2475a00640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 0x7f244806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:05.734 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.732+0000 7f2475a00640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 0x7f244806d3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f24700c9370 tx=0x7f2460008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:05.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.735+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f24701ed2e0 con 0x7f24700c52d0 2024-01-20T08:13:05.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.927+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f24701ed2e0 con 0x7f24700c52d0 2024-01-20T08:13:05.930 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.928+0000 7f246d600640 1 -- 172.21.15.100:0/2061658573 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v63) v1 ==== 93+0+10 (secure 0 0 0) 0x7f24701ed2e0 con 0x7f24700c52d0 2024-01-20T08:13:05.931 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:13:05.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 msgr2=0x7f244806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 0x7f244806d3c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f24700c9370 tx=0x7f2460008040 comp rx=0 tx=0).stop 2024-01-20T08:13:05.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 msgr2=0x7f2470149860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:05.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f2458037040 tx=0x7f2458004730 comp rx=0 tx=0).stop 2024-01-20T08:13:05.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 shutdown_connections 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f24700aaae0 0x7f24700aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24700c52d0 0x7f2470149860 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f244806af00 0x7f244806d3c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 --2- 172.21.15.100:0/2061658573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2450003f40 0x7f24701edc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.930+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 >> 172.21.15.100:0/2061658573 conn(0x7f24700abc80 msgr2=0x7f24700ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.931+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 shutdown_connections 2024-01-20T08:13:05.934 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:05.931+0000 7f2478400640 1 -- 172.21.15.100:0/2061658573 wait complete. 2024-01-20T08:13:05.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-01-20T08:13:06.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.164+0000 7f3f10c00640 1 Processor -- start 2024-01-20T08:13:06.167 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.164+0000 7f3f10c00640 1 -- start start 2024-01-20T08:13:06.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.165+0000 7f3f10c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.165+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c06ce10 0x7f3f0c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.165+0000 7f3f10c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f0c154ba0 con 0x7f3f0c14b720 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.165+0000 7f3f10c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f0c14bb00 con 0x7f3f0c1515b0 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.165+0000 7f3f10c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c155a00 con 0x7f3f0c06ce10 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34200/0 (socket says 172.21.15.100:34200) 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 -- 172.21.15.100:0/109646237 learned_addr learned my addr 172.21.15.100:0/109646237 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f0a800640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c06ce10 0x7f3f0c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 -- 172.21.15.100:0/109646237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c06ce10 msgr2=0x7f3f0c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c06ce10 0x7f3f0c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 -- 172.21.15.100:0/109646237 >> v1:172.21.15.110:6789/0 conn(0x7f3f0c14b720 legacy=0x7f3f0c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.166+0000 7f3f01200640 1 -- 172.21.15.100:0/109646237 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c154df0 con 0x7f3f0c1515b0 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.167+0000 7f3f01200640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c14bc40 tx=0x7f3ef402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e4806a03c7179 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:06.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f09400640 1 -- 172.21.15.100:0/109646237 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef40317c0 con 0x7f3f0c1515b0 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f09400640 1 -- 172.21.15.100:0/109646237 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef4031920 con 0x7f3f0c1515b0 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f09400640 1 -- 172.21.15.100:0/109646237 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4031cb0 con 0x7f3f0c1515b0 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 -- 172.21.15.100:0/109646237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c1515b0 msgr2=0x7f3f0c06c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c14bc40 tx=0x7f3ef402b860 comp rx=0 tx=0).stop 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 -- 172.21.15.100:0/109646237 shutdown_connections 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c06ce10 0x7f3f0c15bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 --2- 172.21.15.100:0/109646237 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c06c8d0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 -- 172.21.15.100:0/109646237 >> 172.21.15.100:0/109646237 conn(0x7f3f0c0c2940 msgr2=0x7f3f0c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 -- 172.21.15.100:0/109646237 shutdown_connections 2024-01-20T08:13:06.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.168+0000 7f3f10c00640 1 -- 172.21.15.100:0/109646237 wait complete. 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.170+0000 7f3f10c00640 1 Processor -- start 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.170+0000 7f3f10c00640 1 -- start start 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 0x7f3f0c144770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c5480 con 0x7f3f0c06ce10 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0c5760 con 0x7f3f0c1515b0 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f10c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0c0ab690 con 0x7f3f0c14b720 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.171+0000 7f3f09e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34210/0 (socket says 172.21.15.100:34210) 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 -- 172.21.15.100:0/1031334722 learned_addr learned my addr 172.21.15.100:0/1031334722 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:06.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f01200640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 0x7f3f0c144770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f0a800640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 -- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 msgr2=0x7f3f0c144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 0x7f3f0c144770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 -- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f0c1515b0 msgr2=0x7f3f0c144cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c144cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 -- 172.21.15.100:0/1031334722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef40094d0 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f01200640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 0x7f3f0c144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.172+0000 7f3f09e00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c460 tx=0x7f3efc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.173+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc011790 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.173+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc011930 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.173+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc011ce0 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.173+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f0c0c4780 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.173+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f0c1472d0 con 0x7f3f0c06ce10 2024-01-20T08:13:06.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.174+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f0c04e970 con 0x7f3f0c06ce10 2024-01-20T08:13:06.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.175+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3efc01c460 con 0x7f3f0c06ce10 2024-01-20T08:13:06.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.176+0000 7f3f02a00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 0x7f3ee406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:06.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.176+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3efc089290 con 0x7f3f0c06ce10 2024-01-20T08:13:06.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.177+0000 7f3f01200640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 0x7f3ee406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:06.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.177+0000 7f3f01200640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 0x7f3ee406d3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4036000 tx=0x7f3ef403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:06.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.181+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3efc054470 con 0x7f3f0c06ce10 2024-01-20T08:13:06.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:06.446+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f3f0c0c37e0 con 0x7f3f0c06ce10 2024-01-20T08:13:06.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:13:06.547 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:13:07.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.053+0000 7f3f02a00640 1 -- 172.21.15.100:0/1031334722 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v186) v1 ==== 162+0+0 (secure 0 0 0) 0x7f3efc087e60 con 0x7f3f0c06ce10 2024-01-20T08:13:07.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 msgr2=0x7f3ee406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 0x7f3ee406d3c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4036000 tx=0x7f3ef403d040 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 msgr2=0x7f3f0c146d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00c460 tx=0x7f3efc00c920 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 shutdown_connections 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3f0c1515b0 0x7f3f0c144cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.057+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3ee406af00 0x7f3ee406d3c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.058+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3f0c14b720 0x7f3f0c144770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.058+0000 7f3f10c00640 1 --2- 172.21.15.100:0/1031334722 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f0c06ce10 0x7f3f0c146d90 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.058+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 >> 172.21.15.100:0/1031334722 conn(0x7f3f0c0c2940 msgr2=0x7f3f0c0c16d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.058+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 shutdown_connections 2024-01-20T08:13:07.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.058+0000 7f3f10c00640 1 -- 172.21.15.100:0/1031334722 wait complete. 2024-01-20T08:13:07.082 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-01-20T08:13:07.294 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.291+0000 7f8623800640 1 Processor -- start 2024-01-20T08:13:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.292+0000 7f8623800640 1 -- start start 2024-01-20T08:13:07.295 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f8623800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f861c14ecd0 0x7f861c0c3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f8623800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c0c26c0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f8623800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f861c1520d0 con 0x7f861c0c3650 2024-01-20T08:13:07.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f8623800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f861c14f0b0 con 0x7f861c14ecd0 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f8620e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f861c14ecd0 0x7f861c0c3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f861be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f861c0c1ac0 0x7f861c06d070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58326/0 (socket says 172.21.15.100:58326) 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.293+0000 7f861be00640 1 -- 172.21.15.100:0/3176648903 learned_addr learned my addr 172.21.15.100:0/3176648903 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.294+0000 7f8620e00640 1 -- 172.21.15.100:0/3176648903 >> v1:172.21.15.110:6789/0 conn(0x7f861c0c3650 legacy=0x7f861c15bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.294+0000 7f8620e00640 1 -- 172.21.15.100:0/3176648903 >> v1:172.21.15.100:6789/0 conn(0x7f861c0c1ac0 legacy=0x7f861c06d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.294+0000 7f8620e00640 1 -- 172.21.15.100:0/3176648903 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f861c1523b0 con 0x7f861c14ecd0 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.294+0000 7f861b400640 1 -- 172.21.15.100:0/3176648903 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554123151 0 0) 0x7f861c0c26c0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.295+0000 7f8620e00640 1 --2- 172.21.15.100:0/3176648903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c14ecd0 0x7f861c0c3110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097a0 tx=0x7f860c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3368bfcd766f16f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.295+0000 7f861b400640 1 -- 172.21.15.100:0/3176648903 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c02e070 con 0x7f861c14ecd0 2024-01-20T08:13:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.295+0000 7f861b400640 1 -- 172.21.15.100:0/3176648903 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c0315a0 con 0x7f861c14ecd0 2024-01-20T08:13:07.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.295+0000 7f861b400640 1 -- 172.21.15.100:0/3176648903 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c031930 con 0x7f861c14ecd0 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 -- 172.21.15.100:0/3176648903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c14ecd0 msgr2=0x7f861c0c3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 --2- 172.21.15.100:0/3176648903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c14ecd0 0x7f861c0c3110 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097a0 tx=0x7f860c02b840 comp rx=0 tx=0).stop 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 -- 172.21.15.100:0/3176648903 shutdown_connections 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 --2- 172.21.15.100:0/3176648903 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c14ecd0 0x7f861c0c3110 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 -- 172.21.15.100:0/3176648903 >> 172.21.15.100:0/3176648903 conn(0x7f861c0c3b10 msgr2=0x7f861c0c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 -- 172.21.15.100:0/3176648903 shutdown_connections 2024-01-20T08:13:07.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.296+0000 7f8623800640 1 -- 172.21.15.100:0/3176648903 wait complete. 2024-01-20T08:13:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.298+0000 7f8623800640 1 Processor -- start 2024-01-20T08:13:07.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.298+0000 7f8623800640 1 -- start start 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f861c0c3650 0x7f861c1e9790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f861c14ecd0 0x7f861c1e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c0c2cf0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f861c1dac10 con 0x7f861c14ecd0 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8623800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f861c1dae60 con 0x7f861c0c3650 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34238/0 (socket says 172.21.15.100:34238) 2024-01-20T08:13:07.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 -- 172.21.15.100:0/3355607707 learned_addr learned my addr 172.21.15.100:0/3355607707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 -- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f861c0c3650 msgr2=0x7f861c1e9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f861c0c3650 0x7f861c1e9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 -- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f861c14ecd0 msgr2=0x7f861c1e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f861c14ecd0 0x7f861c1e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.299+0000 7f8620e00640 1 -- 172.21.15.100:0/3355607707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f860c009400 con 0x7f861c0c1ac0 2024-01-20T08:13:07.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8620e00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097a0 tx=0x7f860c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c032900 con 0x7f861c0c1ac0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f860c032a60 con 0x7f861c0c1ac0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f861c1ebee0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f860c032e10 con 0x7f861c0c1ac0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.300+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f861c150860 con 0x7f861c0c1ac0 2024-01-20T08:13:07.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.301+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f861c1ec400 con 0x7f861c0c1ac0 2024-01-20T08:13:07.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.302+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f860c03b3f0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.303+0000 7f8618c00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 0x7f85f406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:07.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.304+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f860c0ab480 con 0x7f861c0c1ac0 2024-01-20T08:13:07.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.304+0000 7f861be00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 0x7f85f406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:07.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.304+0000 7f861be00640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 0x7f85f406d3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8604007fd0 tx=0x7f8604007920 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:07.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.308+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f860c0765e0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.502+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f861c0720f0 con 0x7f861c0c1ac0 2024-01-20T08:13:07.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.508+0000 7f8618c00640 1 -- 172.21.15.100:0/3355607707 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f860c079c00 con 0x7f861c0c1ac0 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 msgr2=0x7f85f406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 0x7f85f406d3c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8604007fd0 tx=0x7f8604007920 comp rx=0 tx=0).stop 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 msgr2=0x7f861c150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f860c0097a0 tx=0x7f860c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 shutdown_connections 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f861c14ecd0 0x7f861c1e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f85f406af00 0x7f85f406d3c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f861c0c3650 0x7f861c1e9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 --2- 172.21.15.100:0/3355607707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f861c0c1ac0 0x7f861c150320 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 >> 172.21.15.100:0/3355607707 conn(0x7f861c0c3b10 msgr2=0x7f861c073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 shutdown_connections 2024-01-20T08:13:07.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:07.511+0000 7f8623800640 1 -- 172.21.15.100:0/3355607707 wait complete. 2024-01-20T08:13:07.533 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:13:07.533 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:13:07.644 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:13:07.761 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:13:07.761 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:07.761 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:07.817 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:13:07.817 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:07.817 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:07.873 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:13:07.873 INFO:tasks.cephfs.cephfs_test_case:[, ] 2024-01-20T08:13:07.874 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:13:08.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.089+0000 7fae03800640 1 Processor -- start 2024-01-20T08:13:08.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.089+0000 7fae03800640 1 -- start start 2024-01-20T08:13:08.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.090+0000 7fae03800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fadfc14fce0 0x7fadfc153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.090+0000 7fae03800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.090+0000 7fae03800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadfc0a9940 con 0x7fadfc153440 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.090+0000 7fae03800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadfc1500c0 con 0x7fadfc14fce0 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.090+0000 7fae03800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc156810 con 0x7fadfc0a93c0 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae00e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fadfc14fce0 0x7fadfc153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae01800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fadfc153440 0x7fadfc0aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:58336/0 (socket says 172.21.15.100:58336) 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae01800640 1 -- 172.21.15.100:0/2170334925 learned_addr learned my addr 172.21.15.100:0/2170334925 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:08.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fadfbe00640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae00e00640 1 -- 172.21.15.100:0/2170334925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 msgr2=0x7fadfc152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae00e00640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae00e00640 1 -- 172.21.15.100:0/2170334925 >> v1:172.21.15.100:6789/0 conn(0x7fadfc153440 legacy=0x7fadfc0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fadfb400640 1 -- 172.21.15.100:0/2170334925 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305182249 0 0) 0x7fadfc0a9940 con 0x7fadfc153440 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.091+0000 7fae00e00640 1 -- 172.21.15.100:0/2170334925 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc156af0 con 0x7fadfc14fce0 2024-01-20T08:13:08.095 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.092+0000 7fae00e00640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc153b80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097a0 tx=0x7fadec02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a971d8723cada1f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:08.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.093+0000 7fadfb400640 1 -- 172.21.15.100:0/2170334925 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec02d040 con 0x7fadfc14fce0 2024-01-20T08:13:08.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.093+0000 7fadfb400640 1 -- 172.21.15.100:0/2170334925 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec031810 con 0x7fadfc14fce0 2024-01-20T08:13:08.096 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.093+0000 7fadfb400640 1 -- 172.21.15.100:0/2170334925 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec031ba0 con 0x7fadfc14fce0 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.093+0000 7fae03800640 1 -- 172.21.15.100:0/2170334925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 msgr2=0x7fadfc153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.093+0000 7fae03800640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc153b80 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fadec0097a0 tx=0x7fadec02b8b0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 -- 172.21.15.100:0/2170334925 shutdown_connections 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 --2- 172.21.15.100:0/2170334925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc153b80 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 -- 172.21.15.100:0/2170334925 >> 172.21.15.100:0/2170334925 conn(0x7fadfc06a5e0 msgr2=0x7fadfc06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 -- 172.21.15.100:0/2170334925 shutdown_connections 2024-01-20T08:13:08.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.094+0000 7fae03800640 1 -- 172.21.15.100:0/2170334925 wait complete. 2024-01-20T08:13:08.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.095+0000 7fae03800640 1 Processor -- start 2024-01-20T08:13:08.098 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 -- start start 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadfc153440 0x7fadfc145bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc147d30 con 0x7fadfc14fce0 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0c2c40 con 0x7fadfc153440 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.096+0000 7fae03800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc0c12f0 con 0x7fadfc0a93c0 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:34256/0 (socket says 172.21.15.100:34256) 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 -- 172.21.15.100:0/2022239060 learned_addr learned my addr 172.21.15.100:0/2022239060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fae00e00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fae01800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadfc153440 0x7fadfc145bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 -- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 msgr2=0x7fadfc146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 -- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadfc153440 msgr2=0x7fadfc145bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadfc153440 0x7fadfc145bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fadfbe00640 1 -- 172.21.15.100:0/2022239060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec009400 con 0x7fadfc14fce0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.097+0000 7fae00e00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fadfbe00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fade400d830 tx=0x7fade400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade400b6c0 con 0x7fadfc14fce0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade400b820 con 0x7fadfc14fce0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc1499f0 con 0x7fadfc14fce0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade400bbb0 con 0x7fadfc14fce0 2024-01-20T08:13:08.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.098+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc0c2e90 con 0x7fadfc14fce0 2024-01-20T08:13:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.099+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadfc0c3050 con 0x7fadfc14fce0 2024-01-20T08:13:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.100+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fade401e460 con 0x7fadfc14fce0 2024-01-20T08:13:08.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.101+0000 7fadf8c00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 0x7fadd406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.101+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fade4089b20 con 0x7fadfc14fce0 2024-01-20T08:13:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.101+0000 7fae00e00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 0x7fadd406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:08.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.102+0000 7fae00e00640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 0x7fadd406d390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fadec036000 tx=0x7fadec03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:08.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.105+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fade4054c80 con 0x7fadfc14fce0 2024-01-20T08:13:08.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.339+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadfc04e970 con 0x7fadfc14fce0 2024-01-20T08:13:08.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.340+0000 7fadf8c00640 1 -- 172.21.15.100:0/2022239060 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+3711 (secure 0 0 0) 0x7fade40582a0 con 0x7fadfc14fce0 2024-01-20T08:13:08.343 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:08.343 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":41,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4952,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/2457328889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":2457328889},{"type":"v1","addr":"172.21.15.110:6834","nonce":2457328889}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":41},{"gid":5281,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/3904635499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":3904635499},{"type":"v1","addr":"172.21.15.110:6835","nonce":3904635499}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":39},{"gid":5661,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6836/1319887781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":1319887781},{"type":"v1","addr":"172.21.15.100:6836","nonce":1319887781}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":26},{"gid":5664,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/1209671054","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6835","nonce":1209671054},{"type":"v1","addr":"172.21.15.100:6837","nonce":1209671054}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":27}],"filesystems":[]} 2024-01-20T08:13:08.344 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 41 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 msgr2=0x7fadd406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 0x7fadd406d390 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fadec036000 tx=0x7fadec03c040 comp rx=0 tx=0).stop 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 msgr2=0x7fadfc145690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fade400d830 tx=0x7fade400dcf0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 shutdown_connections 2024-01-20T08:13:08.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fadfc153440 0x7fadfc145bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fadfc14fce0 0x7fadfc145690 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fadd406aed0 0x7fadd406d390 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 --2- 172.21.15.100:0/2022239060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fadfc0a93c0 0x7fadfc146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 >> 172.21.15.100:0/2022239060 conn(0x7fadfc06a5e0 msgr2=0x7fadfc0c6180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 shutdown_connections 2024-01-20T08:13:08.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:08.343+0000 7fae03800640 1 -- 172.21.15.100:0/2022239060 wait complete. 2024-01-20T08:13:08.364 INFO:tasks.ceph.mds.a:Restarting daemon 2024-01-20T08:13:08.364 INFO:tasks.ceph.mds.a:Stopping old one... 2024-01-20T08:13:08.365 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T08:13:08.365 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:13:08.365 INFO:tasks.ceph.mds.c:Restarting daemon 2024-01-20T08:13:08.365 INFO:tasks.ceph.mds.c:Stopping old one... 2024-01-20T08:13:08.365 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T08:13:08.365 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:13:08.365 INFO:tasks.ceph.mds.b:Restarting daemon 2024-01-20T08:13:08.366 INFO:tasks.ceph.mds.b:Stopping old one... 2024-01-20T08:13:08.366 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T08:13:08.366 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:13:08.366 INFO:tasks.ceph.mds.d:Restarting daemon 2024-01-20T08:13:08.366 INFO:tasks.ceph.mds.d:Stopping old one... 2024-01-20T08:13:08.366 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T08:13:08.366 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:13:08.385 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T08:13:08.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-01-20T08:13:08.390 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T08:13:08.390 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-01-20T08:13:08.391 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T08:13:08.391 DEBUG:teuthology.orchestra.run.smithi110:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-01-20T08:13:08.433 INFO:tasks.ceph.mds.c:Started 2024-01-20T08:13:08.433 DEBUG:teuthology.parallel:result is None 2024-01-20T08:13:08.438 INFO:tasks.ceph.mds.d:Started 2024-01-20T08:13:08.438 DEBUG:teuthology.parallel:result is None 2024-01-20T08:13:08.444 INFO:tasks.ceph.mds.b:Started 2024-01-20T08:13:08.444 DEBUG:teuthology.parallel:result is None 2024-01-20T08:13:08.609 INFO:tasks.ceph.mds.d.smithi110.stdout:starting mds.d at 2024-01-20T08:13:08.610 INFO:tasks.ceph.mds.b.smithi110.stdout:starting mds.b at 2024-01-20T08:13:08.610 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:13:09.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-01-20T08:13:14.385 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T08:13:14.386 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-01-20T08:13:14.394 INFO:tasks.ceph.mds.a:Started 2024-01-20T08:13:14.394 DEBUG:teuthology.parallel:result is None 2024-01-20T08:13:14.395 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-01-20T08:13:14.551 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-20T08:13:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.595+0000 7f68c7600640 1 Processor -- start 2024-01-20T08:13:14.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.595+0000 7f68c7600640 1 -- start start 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.596+0000 7f68c7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c0155430 0x7f68c00c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.596+0000 7f68c7600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68c00c5f70 0x7f68c0070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.596+0000 7f68c7600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68c006cd40 con 0x7f68c014e8b0 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.596+0000 7f68c7600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c00c19e0 con 0x7f68c00c5f70 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.596+0000 7f68c7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00c1c80 con 0x7f68c0155430 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68c00c5f70 0x7f68c0070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68b7c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c0155430 0x7f68c00c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f68c00c5f70 0x7f68c0070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:47626/0 (socket says 172.21.15.100:47626) 2024-01-20T08:13:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 -- 172.21.15.100:0/1273501279 learned_addr learned my addr 172.21.15.100:0/1273501279 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 -- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c0155430 msgr2=0x7f68c00c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 --2- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c0155430 0x7f68c00c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 -- 172.21.15.100:0/1273501279 >> v1:172.21.15.110:6789/0 conn(0x7f68c014e8b0 legacy=0x7f68c006d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:14.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.597+0000 7f68c5600640 1 -- 172.21.15.100:0/1273501279 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c006c410 con 0x7f68c00c5f70 2024-01-20T08:13:14.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.599+0000 7f68c5600640 1 --2- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c0070560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009e50 tx=0x7f68b802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e20782782df2d8ac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.599+0000 7f68bfe00640 1 -- 172.21.15.100:0/1273501279 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b802cb00 con 0x7f68c00c5f70 2024-01-20T08:13:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.599+0000 7f68bfe00640 1 -- 172.21.15.100:0/1273501279 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b802cc60 con 0x7f68c00c5f70 2024-01-20T08:13:14.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.599+0000 7f68bfe00640 1 -- 172.21.15.100:0/1273501279 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b80343f0 con 0x7f68c00c5f70 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 -- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 msgr2=0x7f68c0070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 --2- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c0070560 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009e50 tx=0x7f68b802bf60 comp rx=0 tx=0).stop 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 -- 172.21.15.100:0/1273501279 shutdown_connections 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 --2- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c0070560 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 --2- 172.21.15.100:0/1273501279 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c0155430 0x7f68c00c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 -- 172.21.15.100:0/1273501279 >> 172.21.15.100:0/1273501279 conn(0x7f68c00a9e20 msgr2=0x7f68c00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 -- 172.21.15.100:0/1273501279 shutdown_connections 2024-01-20T08:13:14.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.600+0000 7f68c7600640 1 -- 172.21.15.100:0/1273501279 wait complete. 2024-01-20T08:13:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.601+0000 7f68c7600640 1 Processor -- start 2024-01-20T08:13:14.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 -- start start 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c014e8b0 0x7f68c00ab430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c00ad710 con 0x7f68c0155430 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0148f70 con 0x7f68c00c5f70 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.602+0000 7f68c7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c0153730 con 0x7f68c014e8b0 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40544/0 (socket says 172.21.15.100:40544) 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 -- 172.21.15.100:0/1505278606 learned_addr learned my addr 172.21.15.100:0/1505278606 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c4c00640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 -- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c014e8b0 msgr2=0x7f68c00ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:14.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68b7c00640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c014e8b0 0x7f68c00ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c014e8b0 0x7f68c00ab430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 -- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 msgr2=0x7f68c01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c01531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c5600640 1 -- 172.21.15.100:0/1505278606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b8009b30 con 0x7f68c0155430 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.603+0000 7f68c4c00640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68c5600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009e50 tx=0x7f68b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8009510 con 0x7f68c0155430 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b803e450 con 0x7f68c0155430 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c0152730 con 0x7f68c0155430 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b803e800 con 0x7f68c0155430 2024-01-20T08:13:14.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.604+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c0152040 con 0x7f68c0155430 2024-01-20T08:13:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.605+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c004e970 con 0x7f68c0155430 2024-01-20T08:13:14.609 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.606+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f68b803e960 con 0x7f68c0155430 2024-01-20T08:13:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.607+0000 7f68bd600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.607+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f68b80ac140 con 0x7f68c0155430 2024-01-20T08:13:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.607+0000 7f68c4c00640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:14.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.608+0000 7f68c4c00640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 0x7f689806d390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f68b0001680 tx=0x7f68b0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:14.614 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.612+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f68b8077210 con 0x7f68c0155430 2024-01-20T08:13:14.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:14.813+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f68c00c26e0 con 0x7f68c0155430 2024-01-20T08:13:16.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.086+0000 7f68bd600640 1 -- 172.21.15.100:0/1505278606 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f68b807a830 con 0x7f68c0155430 2024-01-20T08:13:16.090 INFO:teuthology.orchestra.run.smithi100.stderr: removed all blocklist entries 2024-01-20T08:13:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 msgr2=0x7f689806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 0x7f689806d390 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f68b0001680 tx=0x7f68b0009040 comp rx=0 tx=0).stop 2024-01-20T08:13:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 msgr2=0x7f68c0151b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009e50 tx=0x7f68b8004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 shutdown_connections 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f68c0155430 0x7f68c0151b00 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f689806aed0 0x7f689806d390 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f68c014e8b0 0x7f68c00ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 --2- 172.21.15.100:0/1505278606 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f68c00c5f70 0x7f68c01531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 >> 172.21.15.100:0/1505278606 conn(0x7f68c00a9e20 msgr2=0x7f68c00c2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 shutdown_connections 2024-01-20T08:13:16.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.090+0000 7f68c7600640 1 -- 172.21.15.100:0/1505278606 wait complete. 2024-01-20T08:13:16.114 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-01-20T08:13:16.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.309+0000 7ff6d1c00640 1 Processor -- start 2024-01-20T08:13:16.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.309+0000 7ff6d1c00640 1 -- start start 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.310+0000 7ff6d1c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff6cc14fdb0 0x7ff6cc0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6d1c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc150190 con 0x7ff6cc1532f0 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6d1c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6cc0a8810 con 0x7ff6cc0c1d90 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6d1c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6cc0a9ce0 con 0x7ff6cc14fdb0 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6cb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff6cc1532f0 0x7ff6cc15cfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54202/0 (socket says 172.21.15.100:54202) 2024-01-20T08:13:16.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6cb400640 1 -- 172.21.15.100:0/2457715381 learned_addr learned my addr 172.21.15.100:0/2457715381 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:16.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6caa00640 1 --2- 172.21.15.100:0/2457715381 >> v2:172.21.15.110:3300/0 conn(0x7ff6cc14fdb0 0x7ff6cc0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834955035 0 0) 0x7ff6cc150190 con 0x7ff6cc1532f0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.311+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6ac003520 con 0x7ff6cc1532f0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098345746 0 0) 0x7ff6ac003520 con 0x7ff6cc1532f0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 >> v2:172.21.15.110:3300/0 conn(0x7ff6cc14fdb0 msgr2=0x7ff6cc0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 --2- 172.21.15.100:0/2457715381 >> v2:172.21.15.110:3300/0 conn(0x7ff6cc14fdb0 0x7ff6cc0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 >> v1:172.21.15.110:6789/0 conn(0x7ff6cc0c1d90 legacy=0x7ff6cc152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0a8df0 con 0x7ff6cc1532f0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7ff6c40019f0 con 0x7ff6cc1532f0 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 >> v1:172.21.15.100:6789/0 conn(0x7ff6cc1532f0 legacy=0x7ff6cc15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 0x7ff6ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac0047c0 0x7ff6ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac005180 0x7ff6ac00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00bff0 con 0x7ff6ac003970 2024-01-20T08:13:16.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00c160 con 0x7ff6ac005180 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6ac00c320 con 0x7ff6ac0047c0 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.312+0000 7ff6caa00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 0x7ff6ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6ca000640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac0047c0 0x7ff6ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6cb400640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac005180 0x7ff6ac00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6caa00640 1 -- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac0047c0 msgr2=0x7ff6ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6caa00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac0047c0 0x7ff6ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6caa00640 1 -- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac005180 msgr2=0x7ff6ac00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6caa00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac005180 0x7ff6ac00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6caa00640 1 -- 172.21.15.100:0/2457715381 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6ac003520 con 0x7ff6ac003970 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6cb400640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6ac005180 0x7ff6ac00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:16.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.313+0000 7ff6cb400640 1 -- 172.21.15.100:0/2457715381 reap_dead start 2024-01-20T08:13:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.314+0000 7ff6caa00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 0x7ff6ac003d90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009ac0 tx=0x7ff6ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63a918f056dfea1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.314+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc02c6b0 con 0x7ff6ac003970 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.314+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc02c810 con 0x7ff6ac003970 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.314+0000 7ff6c9600640 1 -- 172.21.15.100:0/2457715381 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc02cba0 con 0x7ff6ac003970 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 -- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 msgr2=0x7ff6ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 0x7ff6ac003d90 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc009ac0 tx=0x7ff6ac0057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 -- 172.21.15.100:0/2457715381 shutdown_connections 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/2457715381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6ac003970 0x7ff6ac003d90 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 -- 172.21.15.100:0/2457715381 >> 172.21.15.100:0/2457715381 conn(0x7ff6cc0c2940 msgr2=0x7ff6cc0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 -- 172.21.15.100:0/2457715381 shutdown_connections 2024-01-20T08:13:16.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.315+0000 7ff6d1c00640 1 -- 172.21.15.100:0/2457715381 wait complete. 2024-01-20T08:13:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.317+0000 7ff6d1c00640 1 Processor -- start 2024-01-20T08:13:16.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.317+0000 7ff6d1c00640 1 -- start start 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac003970 0x7ff6cc06d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6cc1418d0 0x7ff6cc141d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc150ae0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc149200 con 0x7ff6cc1418d0 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6d1c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6cc1517a0 con 0x7ff6ac003970 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40566/0 (socket says 172.21.15.100:40566) 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 -- 172.21.15.100:0/1601420076 learned_addr learned my addr 172.21.15.100:0/1601420076 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:16.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 -- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac003970 msgr2=0x7ff6cc06d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac003970 0x7ff6cc06d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 -- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6cc1418d0 msgr2=0x7ff6cc141d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6cc1418d0 0x7ff6cc141d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.318+0000 7ff6ca000640 1 -- 172.21.15.100:0/1601420076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc151a80 con 0x7ff6cc0c5830 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6ca000640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400e500 tx=0x7ff6b400e9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b40053a0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b40035f0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6cc151d60 con 0x7ff6cc0c5830 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b4003980 con 0x7ff6cc0c5830 2024-01-20T08:13:16.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.319+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc06de10 con 0x7ff6cc0c5830 2024-01-20T08:13:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.320+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6cc04e970 con 0x7ff6cc0c5830 2024-01-20T08:13:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.321+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff6b4003ae0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.322+0000 7ff6c2a00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 0x7ff6a406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.322+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff6b4089110 con 0x7ff6cc0c5830 2024-01-20T08:13:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.322+0000 7ff6caa00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 0x7ff6a406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.323+0000 7ff6caa00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 0x7ff6a406d390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc036000 tx=0x7ff6bc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.326+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff6b40542a0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.584+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff6cc0ab820 con 0x7ff6cc0c5830 2024-01-20T08:13:16.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.585+0000 7ff6c2a00640 1 -- 172.21.15.100:0/1601420076 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5081 (secure 0 0 0) 0x7ff6b40578c0 con 0x7ff6cc0c5830 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "auth_dump": [ 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.a", 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl1DYBKhAAW3E/HAERBMsGrC4rMf53bQ==", 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.588 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.b", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl3YX/DxAAznFmYWhRluqcjxkZ5aIzOQ==", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.c", 2024-01-20T08:13:16.589 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tl/QN8OhAAToAKaEXXyxtgsbnP4CK9lg==", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mds.d", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tlJS3/IBAAyxDTy7tcAxzFhe/cO0LaAQ==", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:13:16.590 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.0", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCqf6tlONOfMxAAUv9z4O2m2+OR+OlKEVTAyQ==", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.1", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCuf6tlpdWGEBAA4XbJMFejMXMzlZtAcFI1rQ==", 2024-01-20T08:13:16.591 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.2", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCxf6tlH+NYKRAAp4T2SRL9Hb7JzDT7AbAzzA==", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.592 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.3", 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC1f6tlxVV0BhAAzktBoqojfG876bmIT8vaHg==", 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.593 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.4", 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC6f6tl+4ikCRAA1btg/3+O5ZPGTIUHPT8vgw==", 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.5", 2024-01-20T08:13:16.595 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQC9f6tlEsDvIRAAFJKBssqBywoRFRWZFtHraA==", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.6", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDAf6tl8W63OhAA/8jrYsmX0b/Jyf/bdIcR2A==", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.596 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "osd.7", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQDEf6tldmY8FxAA5SaAQB68UYfSJ3zFBwesuQ==", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow profile osd", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile osd", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.0", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA==", 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.597 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.1", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw==", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow r", 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw pool=cephfs2_data" 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.598 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.admin", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQCkf6tlP8ACHBAAfGPqDgVbicLXk4WIoRUypQ==", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mgr": "allow *", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow *", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "client.testuser", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQB1gKtlK1PMOBAA3/7+kv5KGZYOyN0fiC6Lew==", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow rw fsname=cephfs", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow rw fsname=cephfs, allow rw fsname=cephfs2", 2024-01-20T08:13:16.599 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow rw tag cephfs data=cephfs, allow rw tag cephfs data=cephfs2" 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.x", 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlWV55HhAAm9X0Xnf67LjDKy4V1A8DvQ==", 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "entity": "mgr.y", 2024-01-20T08:13:16.600 INFO:teuthology.orchestra.run.smithi100.stdout: "key": "AQClf6tlFW6MERAAzJBCQ7yx6sLPN6cv75rbhg==", 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "caps": { 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "mds": "allow *", 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "mon": "allow profile mgr", 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: "osd": "allow *" 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2024-01-20T08:13:16.601 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 msgr2=0x7ff6a406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 0x7ff6a406d390 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc036000 tx=0x7ff6bc02e000 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 msgr2=0x7ff6cc1488b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7ff6b400e500 tx=0x7ff6b400e9c0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 shutdown_connections 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff6cc1418d0 0x7ff6cc141d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6cc0c5830 0x7ff6cc1488b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff6a406aed0 0x7ff6a406d390 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 --2- 172.21.15.100:0/1601420076 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6ac003970 0x7ff6cc06d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.602 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 >> 172.21.15.100:0/1601420076 conn(0x7ff6cc0c2940 msgr2=0x7ff6cc0c1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 shutdown_connections 2024-01-20T08:13:16.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.587+0000 7ff6d1c00640 1 -- 172.21.15.100:0/1601420076 wait complete. 2024-01-20T08:13:16.609 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.testuser 2024-01-20T08:13:16.711 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-01-20T08:13:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.800+0000 7faab4200640 1 Processor -- start 2024-01-20T08:13:16.803 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.800+0000 7faab4200640 1 -- start start 2024-01-20T08:13:16.805 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab4200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7faaac06b140 0x7faaac06b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac0c5d10 0x7faaac0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab4200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0c5880 con 0x7faaac151d50 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab4200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0c4a60 con 0x7faaac06b140 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c9a40 con 0x7faaac0c5d10 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab1800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faaac151d50 0x7faaac1551e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54216/0 (socket says 172.21.15.100:54216) 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab1800640 1 -- 172.21.15.100:0/1666521448 learned_addr learned my addr 172.21.15.100:0/1666521448 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab0e00640 1 --2- 172.21.15.100:0/1666521448 >> v2:172.21.15.100:3300/0 conn(0x7faaac06b140 0x7faaac06b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.802+0000 7faab2200640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac0c5d10 0x7faaac0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faaabe00640 1 -- 172.21.15.100:0/1666521448 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2722798264 0 0) 0x7faaac0c5880 con 0x7faaac151d50 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faaabe00640 1 -- 172.21.15.100:0/1666521448 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa8c003520 con 0x7faaac151d50 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faab0e00640 1 -- 172.21.15.100:0/1666521448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac0c5d10 msgr2=0x7faaac0c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faab0e00640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac0c5d10 0x7faaac0c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faab0e00640 1 -- 172.21.15.100:0/1666521448 >> v1:172.21.15.100:6789/0 conn(0x7faaac151d50 legacy=0x7faaac1551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.803+0000 7faab0e00640 1 -- 172.21.15.100:0/1666521448 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0c9f10 con 0x7faaac06b140 2024-01-20T08:13:16.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.804+0000 7faab0e00640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac06b5a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faa940097a0 tx=0x7faa9402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d5aa188dcdc2c5d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.804+0000 7faaabe00640 1 -- 172.21.15.100:0/1666521448 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94031780 con 0x7faaac06b140 2024-01-20T08:13:16.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.804+0000 7faaabe00640 1 -- 172.21.15.100:0/1666521448 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa940318e0 con 0x7faaac06b140 2024-01-20T08:13:16.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.804+0000 7faaabe00640 1 -- 172.21.15.100:0/1666521448 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa94031c70 con 0x7faaac06b140 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 -- 172.21.15.100:0/1666521448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 msgr2=0x7faaac06b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac06b5a0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7faa940097a0 tx=0x7faa9402b820 comp rx=0 tx=0).stop 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 -- 172.21.15.100:0/1666521448 shutdown_connections 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac0c5d10 0x7faaac0c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 --2- 172.21.15.100:0/1666521448 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac06b5a0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 -- 172.21.15.100:0/1666521448 >> 172.21.15.100:0/1666521448 conn(0x7faaac0ca0e0 msgr2=0x7faaac0ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 -- 172.21.15.100:0/1666521448 shutdown_connections 2024-01-20T08:13:16.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.805+0000 7faab4200640 1 -- 172.21.15.100:0/1666521448 wait complete. 2024-01-20T08:13:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.806+0000 7faab4200640 1 Processor -- start 2024-01-20T08:13:16.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.807+0000 7faab4200640 1 -- start start 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.807+0000 7faab4200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.807+0000 7faab4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaac0c5d10 0x7faaac0c0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac151d50 0x7faaac0c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab4200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c0980 con 0x7faaac06b140 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c1fb0 con 0x7faaac0c5d10 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0bdd90 con 0x7faaac151d50 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40576/0 (socket says 172.21.15.100:40576) 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 -- 172.21.15.100:0/4091746612 learned_addr learned my addr 172.21.15.100:0/4091746612 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:16.811 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 -- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac151d50 msgr2=0x7faaac0c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac151d50 0x7faaac0c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 -- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaac0c5d10 msgr2=0x7faaac0c0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaac0c5d10 0x7faaac0c0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 -- 172.21.15.100:0/4091746612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa94009400 con 0x7faaac06b140 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.808+0000 7faab1800640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c390 tx=0x7faa9c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.812 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.809+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c005ce0 con 0x7faaac06b140 2024-01-20T08:13:16.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.809+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa9c005e40 con 0x7faaac06b140 2024-01-20T08:13:16.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.809+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa9c0072f0 con 0x7faaac06b140 2024-01-20T08:13:16.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.809+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac0be070 con 0x7faaac06b140 2024-01-20T08:13:16.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.809+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0be350 con 0x7faaac06b140 2024-01-20T08:13:16.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.810+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac1e9ce0 con 0x7faaac06b140 2024-01-20T08:13:16.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.811+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7faa9c007450 con 0x7faaac06b140 2024-01-20T08:13:16.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.812+0000 7faaa9600640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 0x7faa8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:16.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.812+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faa9c088850 con 0x7faaac06b140 2024-01-20T08:13:16.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.812+0000 7faab0e00640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 0x7faa8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:16.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.813+0000 7faab0e00640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 0x7faa8406d3c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faa94036000 tx=0x7faa94030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:16.819 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:16.817+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7faa9c053b00 con 0x7faaac06b140 2024-01-20T08:13:17.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.076+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.testuser"} v 0) v1 -- 0x7faaac04e970 con 0x7faaac06b140 2024-01-20T08:13:17.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.081+0000 7faaa9600640 1 -- 172.21.15.100:0/4091746612 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.testuser"}]=0 v17) v1 ==== 85+0+0 (secure 0 0 0) 0x7faa9c017020 con 0x7faaac06b140 2024-01-20T08:13:17.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.083+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 msgr2=0x7faa8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.083+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 0x7faa8406d3c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7faa94036000 tx=0x7faa94030000 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.083+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 msgr2=0x7faaac0c19d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.083+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7faa9c00c390 tx=0x7faa9c00c850 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 shutdown_connections 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7faa8406af00 0x7faa8406d3c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faaac151d50 0x7faaac0c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faaac0c5d10 0x7faaac0c0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 --2- 172.21.15.100:0/4091746612 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faaac06b140 0x7faaac0c19d0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 >> 172.21.15.100:0/4091746612 conn(0x7faaac0ca0e0 msgr2=0x7faaac0bd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 shutdown_connections 2024-01-20T08:13:17.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.084+0000 7faab4200640 1 -- 172.21.15.100:0/4091746612 wait complete. 2024-01-20T08:13:17.104 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:17.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.299+0000 7fcfa9400640 1 Processor -- start 2024-01-20T08:13:17.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.300+0000 7fcfa9400640 1 -- start start 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa9400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfa414fce0 0x7fcfa4153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa9400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa40a9940 con 0x7fcfa40a93c0 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa9400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa41500c0 con 0x7fcfa414fce0 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4156810 con 0x7fcfa40aae00 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfa414fce0 0x7fcfa4153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa2800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcfa414fce0 0x7fcfa4153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40590/0 (socket says 172.21.15.100:40590) 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.301+0000 7fcfa2800640 1 -- 172.21.15.100:0/3085375659 learned_addr learned my addr 172.21.15.100:0/3085375659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:17.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa2800640 1 -- 172.21.15.100:0/3085375659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 msgr2=0x7fcfa40ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:17.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa3200640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa2800640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40ab290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa2800640 1 -- 172.21.15.100:0/3085375659 >> v1:172.21.15.110:6789/0 conn(0x7fcfa40a93c0 legacy=0x7fcfa4152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:17.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa2800640 1 -- 172.21.15.100:0/3085375659 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa4156af0 con 0x7fcfa414fce0 2024-01-20T08:13:17.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.302+0000 7fcfa3200640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.303+0000 7fcfa2800640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa4153b80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009870 tx=0x7fcf9402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1391b7bdb925aca6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.303+0000 7fcfa1400640 1 -- 172.21.15.100:0/3085375659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94031640 con 0x7fcfa414fce0 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.303+0000 7fcfa1400640 1 -- 172.21.15.100:0/3085375659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf940317a0 con 0x7fcfa414fce0 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.303+0000 7fcfa1400640 1 -- 172.21.15.100:0/3085375659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf94031b30 con 0x7fcfa414fce0 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 -- 172.21.15.100:0/3085375659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 msgr2=0x7fcfa4153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa4153b80 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fcf94009870 tx=0x7fcf9402b8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 -- 172.21.15.100:0/3085375659 shutdown_connections 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3085375659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa4153b80 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 -- 172.21.15.100:0/3085375659 >> 172.21.15.100:0/3085375659 conn(0x7fcfa406a5e0 msgr2=0x7fcfa406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:17.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 -- 172.21.15.100:0/3085375659 shutdown_connections 2024-01-20T08:13:17.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.304+0000 7fcfa9400640 1 -- 172.21.15.100:0/3085375659 wait complete. 2024-01-20T08:13:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.306+0000 7fcfa9400640 1 Processor -- start 2024-01-20T08:13:17.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.306+0000 7fcfa9400640 1 -- start start 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa40a93c0 0x7fcfa40c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40c1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4144900 con 0x7fcfa414fce0 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa40c48d0 con 0x7fcfa40a93c0 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa9400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa4144b50 con 0x7fcfa40aae00 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40594/0 (socket says 172.21.15.100:40594) 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa3200640 1 -- 172.21.15.100:0/3435435742 learned_addr learned my addr 172.21.15.100:0/3435435742 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:17.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa2800640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa40a93c0 0x7fcfa40c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa1e00640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40c1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.307+0000 7fcfa3200640 1 -- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 msgr2=0x7fcfa40c1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa3200640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40c1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa3200640 1 -- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa40a93c0 msgr2=0x7fcfa40c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa3200640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa40a93c0 0x7fcfa40c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa3200640 1 -- 172.21.15.100:0/3435435742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940094d0 con 0x7fcfa414fce0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa3200640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cef0 tx=0x7fcf9c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00d840 con 0x7fcfa414fce0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf9c00d9c0 con 0x7fcfa414fce0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c00dd70 con 0x7fcfa414fce0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa40c3fa0 con 0x7fcfa414fce0 2024-01-20T08:13:17.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.308+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa40c4560 con 0x7fcfa414fce0 2024-01-20T08:13:17.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.309+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa40c4a40 con 0x7fcfa414fce0 2024-01-20T08:13:17.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.310+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcf9c01e3b0 con 0x7fcfa414fce0 2024-01-20T08:13:17.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.311+0000 7fcf9aa00640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 0x7fcf7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.311+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf9c089de0 con 0x7fcfa414fce0 2024-01-20T08:13:17.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.311+0000 7fcfa2800640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 0x7fcf7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.312+0000 7fcfa2800640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 0x7fcf7c06d390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcf94036000 tx=0x7fcf9403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.315+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcf9c0550b0 con 0x7fcfa414fce0 2024-01-20T08:13:17.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.508+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcfa404e970 con 0x7fcfa414fce0 2024-01-20T08:13:17.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.509+0000 7fcf9aa00640 1 -- 172.21.15.100:0/3435435742 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12835 (secure 0 0 0) 0x7fcf9c01a090 con 0x7fcfa414fce0 2024-01-20T08:13:17.512 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:17.512 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":68,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:16.083941+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":59,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:17.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 msgr2=0x7fcf7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 0x7fcf7c06d390 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fcf94036000 tx=0x7fcf9403c040 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 msgr2=0x7fcfa40c1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c00cef0 tx=0x7fcf9c00a710 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 shutdown_connections 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcfa414fce0 0x7fcfa40c1b90 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf7c06aed0 0x7fcf7c06d390 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcfa40aae00 0x7fcfa40c1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 --2- 172.21.15.100:0/3435435742 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcfa40a93c0 0x7fcfa40c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 >> 172.21.15.100:0/3435435742 conn(0x7fcfa406a5e0 msgr2=0x7fcfa4151a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 shutdown_connections 2024-01-20T08:13:17.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.512+0000 7fcfa9400640 1 -- 172.21.15.100:0/3435435742 wait complete. 2024-01-20T08:13:17.534 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:13:17.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:13:17.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.742+0000 7f9b1f400640 1 Processor -- start 2024-01-20T08:13:17.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.743+0000 7f9b1f400640 1 -- start start 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b180c4a80 0x7f9b180c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b1806b780 0x7f9b1806cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1f400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1806c620 con 0x7f9b1806b270 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1f400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b181523e0 con 0x7f9b180c4a80 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18158a10 con 0x7f9b1806b780 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b1ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b180c4a80 0x7f9b180c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b0fc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9b1806b270 0x7f9b180c8000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54222/0 (socket says 172.21.15.100:54222) 2024-01-20T08:13:17.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.744+0000 7f9b0fc00640 1 -- 172.21.15.100:0/3303608169 learned_addr learned my addr 172.21.15.100:0/3303608169 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b1d400640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b1806b780 0x7f9b1806cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3303608169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b1806b780 msgr2=0x7f9b1806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b1ca00640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b1806b780 0x7f9b1806cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3303608169 >> v1:172.21.15.100:6789/0 conn(0x7f9b1806b270 legacy=0x7f9b180c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3303608169 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18158cb0 con 0x7f9b180c4a80 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.745+0000 7f9b17e00640 1 -- 172.21.15.100:0/3303608169 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2844070687 0 0) 0x7f9b1806c620 con 0x7f9b1806b270 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.746+0000 7f9b1ca00640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b180c4a80 0x7f9b180c4e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097a0 tx=0x7f9b0802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b63a87aea05c4c0d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.746+0000 7f9b17e00640 1 -- 172.21.15.100:0/3303608169 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0802f050 con 0x7f9b180c4a80 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.746+0000 7f9b17e00640 1 -- 172.21.15.100:0/3303608169 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08031700 con 0x7f9b180c4a80 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.746+0000 7f9b17e00640 1 -- 172.21.15.100:0/3303608169 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08031a90 con 0x7f9b180c4a80 2024-01-20T08:13:17.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 -- 172.21.15.100:0/3303608169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b180c4a80 msgr2=0x7f9b180c4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b180c4a80 0x7f9b180c4e60 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f9b080097a0 tx=0x7f9b0802b7a0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 -- 172.21.15.100:0/3303608169 shutdown_connections 2024-01-20T08:13:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b1806b780 0x7f9b1806cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3303608169 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b180c4a80 0x7f9b180c4e60 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 -- 172.21.15.100:0/3303608169 >> 172.21.15.100:0/3303608169 conn(0x7f9b180ca100 msgr2=0x7f9b180ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 -- 172.21.15.100:0/3303608169 shutdown_connections 2024-01-20T08:13:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.747+0000 7f9b1f400640 1 -- 172.21.15.100:0/3303608169 wait complete. 2024-01-20T08:13:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.749+0000 7f9b1f400640 1 Processor -- start 2024-01-20T08:13:17.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.749+0000 7f9b1f400640 1 -- start start 2024-01-20T08:13:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1806b780 0x7f9b1814b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b180c4a80 0x7f9b180c35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b181549e0 con 0x7f9b1806b270 2024-01-20T08:13:17.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b18157ef0 con 0x7f9b1806b780 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b180c1880 con 0x7f9b180c4a80 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40608/0 (socket says 172.21.15.100:40608) 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3600412711 learned_addr learned my addr 172.21.15.100:0/3600412711 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b180c4a80 msgr2=0x7f9b180c35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b180c4a80 0x7f9b180c35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1806b780 msgr2=0x7f9b1814b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1806b780 0x7f9b1814b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.750+0000 7f9b1ca00640 1 -- 172.21.15.100:0/3600412711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b08009400 con 0x7f9b1806b270 2024-01-20T08:13:17.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b1ca00640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9b080098c0 tx=0x7f9b080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b08033c30 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b08033dd0 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803c640 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b180c1270 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.751+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b180c1510 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.752+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b180c9e60 con 0x7f9b1806b270 2024-01-20T08:13:17.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.753+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9b0803a040 con 0x7f9b1806b270 2024-01-20T08:13:17.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.754+0000 7f9b15600640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 0x7f9af006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:17.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.754+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9b080aaa90 con 0x7f9b1806b270 2024-01-20T08:13:17.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.754+0000 7f9b0fc00640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 0x7f9af006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:17.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.755+0000 7f9b0fc00640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 0x7f9af006d3c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b00007fd0 tx=0x7f9b00007920 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:17.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.758+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9b180c9e60 con 0x7f9b1806b270 2024-01-20T08:13:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.950+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9b180c9e60 con 0x7f9b1806b270 2024-01-20T08:13:17.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.951+0000 7f9b15600640 1 -- 172.21.15.100:0/3600412711 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9b180c9e60 con 0x7f9b1806b270 2024-01-20T08:13:17.953 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:13:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 msgr2=0x7f9af006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 0x7f9af006d3c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9b00007fd0 tx=0x7f9b00007920 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 msgr2=0x7f9b1814aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f9b080098c0 tx=0x7f9b080046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 shutdown_connections 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9af006af00 0x7f9af006d3c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b180c4a80 0x7f9b180c35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1806b780 0x7f9b1814b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 --2- 172.21.15.100:0/3600412711 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b1806b270 0x7f9b1814aed0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 >> 172.21.15.100:0/3600412711 conn(0x7f9b180ca100 msgr2=0x7f9b18150e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 shutdown_connections 2024-01-20T08:13:17.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:17.953+0000 7f9b1f400640 1 -- 172.21.15.100:0/3600412711 wait complete. 2024-01-20T08:13:17.975 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:13:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.173+0000 7f6134800640 1 Processor -- start 2024-01-20T08:13:18.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.173+0000 7f6134800640 1 -- start start 2024-01-20T08:13:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6134800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c06c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6134800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f612c06ce10 0x7f612c15bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6134800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f612c154ba0 con 0x7f612c14b720 2024-01-20T08:13:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6134800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f612c14bb00 con 0x7f612c06ce10 2024-01-20T08:13:18.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6134800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c155a00 con 0x7f612c1515b0 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.174+0000 7f6132800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f612c06ce10 0x7f612c15bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f612c06ce10 0x7f612c15bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40624/0 (socket says 172.21.15.100:40624) 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 -- 172.21.15.100:0/1992209596 learned_addr learned my addr 172.21.15.100:0/1992209596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6131400640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c06c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 -- 172.21.15.100:0/1992209596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 msgr2=0x7f612c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c06c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 -- 172.21.15.100:0/1992209596 >> v1:172.21.15.110:6789/0 conn(0x7f612c14b720 legacy=0x7f612c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:18.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.175+0000 7f6132800640 1 -- 172.21.15.100:0/1992209596 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f612c154df0 con 0x7f612c06ce10 2024-01-20T08:13:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.176+0000 7f6132800640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c15bf30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6124009e50 tx=0x7f612402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a3721ea6a74c55 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.176+0000 7f6130a00640 1 -- 172.21.15.100:0/1992209596 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612402c9e0 con 0x7f612c06ce10 2024-01-20T08:13:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6130a00640 1 -- 172.21.15.100:0/1992209596 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f612402cb40 con 0x7f612c06ce10 2024-01-20T08:13:18.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6130a00640 1 -- 172.21.15.100:0/1992209596 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240343f0 con 0x7f612c06ce10 2024-01-20T08:13:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 -- 172.21.15.100:0/1992209596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 msgr2=0x7f612c15bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c15bf30 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6124009e50 tx=0x7f612402be40 comp rx=0 tx=0).stop 2024-01-20T08:13:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 -- 172.21.15.100:0/1992209596 shutdown_connections 2024-01-20T08:13:18.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c15bf30 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 --2- 172.21.15.100:0/1992209596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c06c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 -- 172.21.15.100:0/1992209596 >> 172.21.15.100:0/1992209596 conn(0x7f612c0c2940 msgr2=0x7f612c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 -- 172.21.15.100:0/1992209596 shutdown_connections 2024-01-20T08:13:18.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.177+0000 7f6134800640 1 -- 172.21.15.100:0/1992209596 wait complete. 2024-01-20T08:13:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.179+0000 7f6134800640 1 Processor -- start 2024-01-20T08:13:18.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.179+0000 7f6134800640 1 -- start start 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f612c14b720 0x7f612c144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c144b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0c5580 con 0x7f612c06ce10 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c1e8c00 con 0x7f612c14b720 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6134800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f612c145080 con 0x7f612c1515b0 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40634/0 (socket says 172.21.15.100:40634) 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 -- 172.21.15.100:0/3458158010 learned_addr learned my addr 172.21.15.100:0/3458158010 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 -- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 msgr2=0x7f612c144b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c144b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 -- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f612c14b720 msgr2=0x7f612c144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.180+0000 7f6131e00640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f612c14b720 0x7f612c144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f6131e00640 1 -- 172.21.15.100:0/3458158010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6124009b30 con 0x7f612c06ce10 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f6131e00640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c430 tx=0x7f611c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c011790 con 0x7f612c06ce10 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f611c0118f0 con 0x7f612c06ce10 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c011ce0 con 0x7f612c06ce10 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c1545f0 con 0x7f612c06ce10 2024-01-20T08:13:18.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.181+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c146970 con 0x7f612c06ce10 2024-01-20T08:13:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.182+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c06c8b0 con 0x7f612c06ce10 2024-01-20T08:13:18.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.183+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f611c01c460 con 0x7f612c06ce10 2024-01-20T08:13:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.184+0000 7f612a000640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 0x7f610406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.185+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f611c089230 con 0x7f612c06ce10 2024-01-20T08:13:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.185+0000 7f6131400640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 0x7f610406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.185+0000 7f6131400640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 0x7f610406d390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.189+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f611c0544e0 con 0x7f612c06ce10 2024-01-20T08:13:18.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.384+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f612c1e8dc0 con 0x7f612c06ce10 2024-01-20T08:13:18.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.385+0000 7f612a000640 1 -- 172.21.15.100:0/3458158010 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7f611c057b00 con 0x7f612c06ce10 2024-01-20T08:13:18.388 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:18.388 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:13:18.388 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:18.388 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:13:18.389 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:13:18.389 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:18.389 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 msgr2=0x7f610406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 0x7f610406d390 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6114006fd0 tx=0x7f6114008040 comp rx=0 tx=0).stop 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 msgr2=0x7f612c1536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f611c00c430 tx=0x7f611c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 shutdown_connections 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f610406aed0 0x7f610406d390 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f612c1515b0 0x7f612c144b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f612c14b720 0x7f612c144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 --2- 172.21.15.100:0/3458158010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f612c06ce10 0x7f612c1536a0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 >> 172.21.15.100:0/3458158010 conn(0x7f612c0c2940 msgr2=0x7f612c0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:18.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 shutdown_connections 2024-01-20T08:13:18.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.388+0000 7f6134800640 1 -- 172.21.15.100:0/3458158010 wait complete. 2024-01-20T08:13:18.409 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-01-20T08:13:18.409 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-01-20T08:13:18.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.620+0000 7fb45e800640 1 Processor -- start 2024-01-20T08:13:18.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.620+0000 7fb45e800640 1 -- start start 2024-01-20T08:13:18.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.621+0000 7fb45e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb45814c5a0 0x7fb458153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.621+0000 7fb45e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 0x7fb4580c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.621+0000 7fb45e800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb45806d0e0 con 0x7fb4580c1f50 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.621+0000 7fb45e800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb458153560 con 0x7fb45814c5a0 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.621+0000 7fb45e800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580aaf10 con 0x7fb45806bdb0 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb45814c5a0 0x7fb458153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb4580c1f50 0x7fb45806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:54228/0 (socket says 172.21.15.100:54228) 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457e00640 1 -- 172.21.15.100:0/2609131628 learned_addr learned my addr 172.21.15.100:0/2609131628 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:18.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb456a00640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 0x7fb4580c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457400640 1 -- 172.21.15.100:0/2609131628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 msgr2=0x7fb4580c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457400640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 0x7fb4580c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb456000640 1 -- 172.21.15.100:0/2609131628 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1385345203 0 0) 0x7fb45806d0e0 con 0x7fb4580c1f50 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457400640 1 -- 172.21.15.100:0/2609131628 >> v1:172.21.15.100:6789/0 conn(0x7fb4580c1f50 legacy=0x7fb45806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb457400640 1 -- 172.21.15.100:0/2609131628 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45814c980 con 0x7fb45814c5a0 2024-01-20T08:13:18.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.622+0000 7fb456a00640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 0x7fb4580c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.623+0000 7fb457400640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458153020 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb4480097a0 tx=0x7fb44802b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df56f97510ceb20c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.623+0000 7fb456000640 1 -- 172.21.15.100:0/2609131628 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4480316f0 con 0x7fb45814c5a0 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb456000640 1 -- 172.21.15.100:0/2609131628 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb448031850 con 0x7fb45814c5a0 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb456000640 1 -- 172.21.15.100:0/2609131628 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb448031be0 con 0x7fb45814c5a0 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 -- 172.21.15.100:0/2609131628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 msgr2=0x7fb458153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458153020 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fb4480097a0 tx=0x7fb44802b790 comp rx=0 tx=0).stop 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 -- 172.21.15.100:0/2609131628 shutdown_connections 2024-01-20T08:13:18.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb45806bdb0 0x7fb4580c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 --2- 172.21.15.100:0/2609131628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458153020 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 -- 172.21.15.100:0/2609131628 >> 172.21.15.100:0/2609131628 conn(0x7fb4580c2b00 msgr2=0x7fb4580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:18.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 -- 172.21.15.100:0/2609131628 shutdown_connections 2024-01-20T08:13:18.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.624+0000 7fb45e800640 1 -- 172.21.15.100:0/2609131628 wait complete. 2024-01-20T08:13:18.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.626+0000 7fb45e800640 1 Processor -- start 2024-01-20T08:13:18.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.626+0000 7fb45e800640 1 -- start start 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45806bdb0 0x7fb458151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4580c1f50 0x7fb458156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458154950 con 0x7fb45814c5a0 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458142e80 con 0x7fb45806bdb0 2024-01-20T08:13:18.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb45e800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb458155450 con 0x7fb4580c1f50 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.627+0000 7fb457e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40650/0 (socket says 172.21.15.100:40650) 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 -- 172.21.15.100:0/920714529 learned_addr learned my addr 172.21.15.100:0/920714529 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457400640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45806bdb0 0x7fb458151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb456a00640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4580c1f50 0x7fb458156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 -- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4580c1f50 msgr2=0x7fb458156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4580c1f50 0x7fb458156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 -- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45806bdb0 msgr2=0x7fb458151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45806bdb0 0x7fb458151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 -- 172.21.15.100:0/920714529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb448009400 con 0x7fb45814c5a0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.628+0000 7fb457e00640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c7b0 tx=0x7fb45000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.629+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000a640 con 0x7fb45814c5a0 2024-01-20T08:13:18.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.629+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45000a7c0 con 0x7fb45814c5a0 2024-01-20T08:13:18.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.629+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45000ab70 con 0x7fb45814c5a0 2024-01-20T08:13:18.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.629+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458152790 con 0x7fb45814c5a0 2024-01-20T08:13:18.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.629+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458155910 con 0x7fb45814c5a0 2024-01-20T08:13:18.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.630+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb458074450 con 0x7fb45814c5a0 2024-01-20T08:13:18.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.631+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb45000acd0 con 0x7fb45814c5a0 2024-01-20T08:13:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.632+0000 7fb44f400640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.632+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb450088670 con 0x7fb45814c5a0 2024-01-20T08:13:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.632+0000 7fb457400640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:18.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.633+0000 7fb457400640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 0x7fb43006d3c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb448036000 tx=0x7fb448008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:18.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.636+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb450053920 con 0x7fb45814c5a0 2024-01-20T08:13:18.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:18.827+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb458143060 con 0x7fb45814c5a0 2024-01-20T08:13:19.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.129+0000 7fb44f400640 1 -- 172.21.15.100:0/920714529 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb4500180b0 con 0x7fb45814c5a0 2024-01-20T08:13:19.132 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' created 2024-01-20T08:13:19.136 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 msgr2=0x7fb43006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 0x7fb43006d3c0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fb448036000 tx=0x7fb448008030 comp rx=0 tx=0).stop 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 msgr2=0x7fb458156550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fb45000c7b0 tx=0x7fb45000cc70 comp rx=0 tx=0).stop 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 shutdown_connections 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb45814c5a0 0x7fb458156550 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb43006af00 0x7fb43006d3c0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.137 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4580c1f50 0x7fb458156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 --2- 172.21.15.100:0/920714529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb45806bdb0 0x7fb458151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.134+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 >> 172.21.15.100:0/920714529 conn(0x7fb4580c2b00 msgr2=0x7fb4580c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.135+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 shutdown_connections 2024-01-20T08:13:19.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.135+0000 7fb45e800640 1 -- 172.21.15.100:0/920714529 wait complete. 2024-01-20T08:13:19.163 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:13:19.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.361+0000 7fac78200640 1 Processor -- start 2024-01-20T08:13:19.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.361+0000 7fac78200640 1 -- start start 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac78200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fac700c29c0 0x7fac70151fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac78200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac700c17b0 con 0x7fac700c3240 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac78200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac701524f0 con 0x7fac70070880 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac78200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac700c0990 con 0x7fac700c29c0 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac74e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fac700c3240 0x7fac70070170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35376/0 (socket says 172.21.15.100:35376) 2024-01-20T08:13:19.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac74e00640 1 -- 172.21.15.100:0/436489110 learned_addr learned my addr 172.21.15.100:0/436489110 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac75800640 1 --2- 172.21.15.100:0/436489110 >> v2:172.21.15.110:3300/0 conn(0x7fac700c29c0 0x7fac70151fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.363+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599741160 0 0) 0x7fac700c17b0 con 0x7fac700c3240 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac50003520 con 0x7fac700c3240 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2487243183 0 0) 0x7fac50003520 con 0x7fac700c3240 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 >> v2:172.21.15.110:3300/0 conn(0x7fac700c29c0 msgr2=0x7fac70151fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 --2- 172.21.15.100:0/436489110 >> v2:172.21.15.110:3300/0 conn(0x7fac700c29c0 0x7fac70151fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 >> v1:172.21.15.110:6789/0 conn(0x7fac70070880 legacy=0x7fac7014af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac700c0ba0 con 0x7fac700c3240 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fac580019f0 con 0x7fac700c3240 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 >> v1:172.21.15.100:6789/0 conn(0x7fac700c3240 legacy=0x7fac70070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac500051d0 0x7fac5000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700c0990 con 0x7fac500039c0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c120 con 0x7fac500047c0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5000c2e0 con 0x7fac500051d0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.364+0000 7fac75800640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac74e00640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac75800640 1 -- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac500051d0 msgr2=0x7fac5000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac75800640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac500051d0 0x7fac5000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac75800640 1 -- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500047c0 msgr2=0x7fac50004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac75800640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500047c0 0x7fac50004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac75800640 1 -- 172.21.15.100:0/436489110 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac50003520 con 0x7fac500039c0 2024-01-20T08:13:19.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.365+0000 7fac76200640 1 -- 172.21.15.100:0/436489110 reap_dead start 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.366+0000 7fac75800640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 0x7fac50003de0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fac60009a90 tx=0x7fac500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c469ad8f5a5fb24b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.366+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6002c6b0 con 0x7fac500039c0 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.366+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac6002c810 con 0x7fac500039c0 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.366+0000 7fac6fe00640 1 -- 172.21.15.100:0/436489110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac6002cba0 con 0x7fac500039c0 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 -- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 msgr2=0x7fac50003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 0x7fac50003de0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fac60009a90 tx=0x7fac500057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 -- 172.21.15.100:0/436489110 shutdown_connections 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 --2- 172.21.15.100:0/436489110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac500039c0 0x7fac50003de0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 -- 172.21.15.100:0/436489110 >> 172.21.15.100:0/436489110 conn(0x7fac7006a5e0 msgr2=0x7fac7006a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 -- 172.21.15.100:0/436489110 shutdown_connections 2024-01-20T08:13:19.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.367+0000 7fac78200640 1 -- 172.21.15.100:0/436489110 wait complete. 2024-01-20T08:13:19.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.369+0000 7fac78200640 1 Processor -- start 2024-01-20T08:13:19.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.369+0000 7fac78200640 1 -- start start 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 0x7fac700aa550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac700ab0f0 0x7fac70152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac700ab580 con 0x7fac70145b70 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac701461f0 con 0x7fac500039c0 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac78200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac700bb3c0 con 0x7fac700ab0f0 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac76200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac76200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45446/0 (socket says 172.21.15.100:45446) 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.370+0000 7fac76200640 1 -- 172.21.15.100:0/3808141596 learned_addr learned my addr 172.21.15.100:0/3808141596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac75800640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 0x7fac700aa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 -- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac700ab0f0 msgr2=0x7fac70152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac74e00640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac700ab0f0 0x7fac70152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac700ab0f0 0x7fac70152950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 -- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 msgr2=0x7fac700aa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 0x7fac700aa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 -- 172.21.15.100:0/3808141596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac701eab00 con 0x7fac70145b70 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac75800640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 0x7fac700aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac76200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fac700c1760 tx=0x7fac6800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68007480 con 0x7fac70145b70 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac680075e0 con 0x7fac70145b70 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac68004260 con 0x7fac70145b70 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac700bb050 con 0x7fac70145b70 2024-01-20T08:13:19.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.371+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac70150d80 con 0x7fac70145b70 2024-01-20T08:13:19.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.372+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac700bb530 con 0x7fac70145b70 2024-01-20T08:13:19.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.374+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fac680057c0 con 0x7fac70145b70 2024-01-20T08:13:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.375+0000 7fac6d600640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 0x7fac4806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.375+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fac68088ae0 con 0x7fac70145b70 2024-01-20T08:13:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.375+0000 7fac75800640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 0x7fac4806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:19.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.376+0000 7fac75800640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 0x7fac4806d390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac60036000 tx=0x7fac60030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:19.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.379+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fac68053cb0 con 0x7fac70145b70 2024-01-20T08:13:19.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:19.572+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fac70067640 con 0x7fac70145b70 2024-01-20T08:13:20.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.136+0000 7fac6d600640 1 -- 172.21.15.100:0/3808141596 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7fac680572d0 con 0x7fac70145b70 2024-01-20T08:13:20.139 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' created 2024-01-20T08:13:20.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.140+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 msgr2=0x7fac4806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.140+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 0x7fac4806d390 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fac60036000 tx=0x7fac60030000 comp rx=0 tx=0).stop 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.140+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 msgr2=0x7fac70152e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.140+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fac700c1760 tx=0x7fac6800c820 comp rx=0 tx=0).stop 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 shutdown_connections 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac70145b70 0x7fac70152e90 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac4806aed0 0x7fac4806d390 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac700ab0f0 0x7fac70152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 --2- 172.21.15.100:0/3808141596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac500039c0 0x7fac700aa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 >> 172.21.15.100:0/3808141596 conn(0x7fac7006a5e0 msgr2=0x7fac7006d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:20.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 shutdown_connections 2024-01-20T08:13:20.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.141+0000 7fac78200640 1 -- 172.21.15.100:0/3808141596 wait complete. 2024-01-20T08:13:20.177 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-01-20T08:13:20.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.356+0000 7fb856a00640 1 Processor -- start 2024-01-20T08:13:20.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.356+0000 7fb856a00640 1 -- start start 2024-01-20T08:13:20.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.357+0000 7fb856a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb850152010 0x7fb8500c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb856a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8501589f0 0x7fb850157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb856a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8501523f0 con 0x7fb8500c1bd0 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb856a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8500c53a0 con 0x7fb850152010 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb856a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500c4b00 con 0x7fb8501589f0 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb850152010 0x7fb8500c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb850152010 0x7fb8500c1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45448/0 (socket says 172.21.15.100:45448) 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 -- 172.21.15.100:0/1733555639 learned_addr learned my addr 172.21.15.100:0/1733555639 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 -- 172.21.15.100:0/1733555639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8501589f0 msgr2=0x7fb850157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84f400640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8501589f0 0x7fb850157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8501589f0 0x7fb850157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 -- 172.21.15.100:0/1733555639 >> v1:172.21.15.100:6789/0 conn(0x7fb8500c1bd0 legacy=0x7fb8500c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.358+0000 7fb84fe00640 1 -- 172.21.15.100:0/1733555639 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8500c4de0 con 0x7fb850152010 2024-01-20T08:13:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb84fe00640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb8500c1690 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41bddb66a8282929 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb84ea00640 1 -- 172.21.15.100:0/1733555639 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84002ca80 con 0x7fb850152010 2024-01-20T08:13:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb84ea00640 1 -- 172.21.15.100:0/1733555639 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84002cbe0 con 0x7fb850152010 2024-01-20T08:13:20.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb84ea00640 1 -- 172.21.15.100:0/1733555639 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8400343f0 con 0x7fb850152010 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb856a00640 1 -- 172.21.15.100:0/1733555639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 msgr2=0x7fb8500c1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.360+0000 7fb856a00640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb8500c1690 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fb840009e50 tx=0x7fb84002bee0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 -- 172.21.15.100:0/1733555639 shutdown_connections 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8501589f0 0x7fb850157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 --2- 172.21.15.100:0/1733555639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb8500c1690 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 -- 172.21.15.100:0/1733555639 >> 172.21.15.100:0/1733555639 conn(0x7fb850066340 msgr2=0x7fb850066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 -- 172.21.15.100:0/1733555639 shutdown_connections 2024-01-20T08:13:20.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.361+0000 7fb856a00640 1 -- 172.21.15.100:0/1733555639 wait complete. 2024-01-20T08:13:20.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.362+0000 7fb856a00640 1 Processor -- start 2024-01-20T08:13:20.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.362+0000 7fb856a00640 1 -- start start 2024-01-20T08:13:20.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8500c1bd0 0x7fb85014d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8501589f0 0x7fb8500ac030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb850153930 con 0x7fb850152010 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8501537b0 con 0x7fb8501589f0 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.363+0000 7fb856a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8500ad460 con 0x7fb8500c1bd0 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45462/0 (socket says 172.21.15.100:45462) 2024-01-20T08:13:20.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 -- 172.21.15.100:0/197602885 learned_addr learned my addr 172.21.15.100:0/197602885 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:20.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 -- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8500c1bd0 msgr2=0x7fb85014d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb854a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8501589f0 0x7fb8500ac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84fe00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8500c1bd0 0x7fb85014d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8500c1bd0 0x7fb85014d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 -- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8501589f0 msgr2=0x7fb8500ac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8501589f0 0x7fb8500ac030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 -- 172.21.15.100:0/197602885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb840009b30 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.364+0000 7fb84f400640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c850 tx=0x7fb83800cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.365+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838004020 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.365+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838004180 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.365+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838007830 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.365+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8501531f0 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.365+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8501553e0 con 0x7fb850152010 2024-01-20T08:13:20.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.366+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb850155240 con 0x7fb850152010 2024-01-20T08:13:20.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.367+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb838007990 con 0x7fb850152010 2024-01-20T08:13:20.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.368+0000 7fb847e00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 0x7fb82806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:20.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.368+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb838089280 con 0x7fb850152010 2024-01-20T08:13:20.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.368+0000 7fb84fe00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 0x7fb82806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:20.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.369+0000 7fb84fe00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 0x7fb82806d390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb840035000 tx=0x7fb840030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:20.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.373+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb850155240 con 0x7fb850152010 2024-01-20T08:13:20.610 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:20.607+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb850155240 con 0x7fb850152010 2024-01-20T08:13:21.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.183+0000 7fb847e00640 1 -- 172.21.15.100:0/197602885 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v44) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb850155240 con 0x7fb850152010 2024-01-20T08:13:21.190 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 12 and data pool 13 2024-01-20T08:13:21.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.191+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 msgr2=0x7fb82806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.191+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 0x7fb82806d390 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb840035000 tx=0x7fb840030000 comp rx=0 tx=0).stop 2024-01-20T08:13:21.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.191+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 msgr2=0x7fb85014d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.191+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fb83800c850 tx=0x7fb83800cd10 comp rx=0 tx=0).stop 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 shutdown_connections 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb8501589f0 0x7fb8500ac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb850152010 0x7fb85014d7c0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb82806aed0 0x7fb82806d390 secure :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fb840035000 tx=0x7fb840030000 comp rx=0 tx=0).stop 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 --2- 172.21.15.100:0/197602885 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb8500c1bd0 0x7fb85014d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.192+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 >> 172.21.15.100:0/197602885 conn(0x7fb850066340 msgr2=0x7fb85006cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:21.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.193+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 shutdown_connections 2024-01-20T08:13:21.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.194+0000 7fb856a00640 1 -- 172.21.15.100:0/197602885 wait complete. 2024-01-20T08:13:21.236 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:21.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.409+0000 7f87df600640 1 Processor -- start 2024-01-20T08:13:21.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.410+0000 7f87df600640 1 -- start start 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87df600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f87d80a6c30 0x7f87d806f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87df600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d80c7310 con 0x7f87d80c67d0 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87df600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87d8155ff0 con 0x7f87d81556e0 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87df600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87d806e530 con 0x7f87d80a6c30 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87d7e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f87d80a6c30 0x7f87d806f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87dd600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f87d80c67d0 0x7f87d80c6c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35394/0 (socket says 172.21.15.100:35394) 2024-01-20T08:13:21.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.411+0000 7f87dd600640 1 -- 172.21.15.100:0/2103400995 learned_addr learned my addr 172.21.15.100:0/2103400995 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:21.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.412+0000 7f87d7e00640 1 -- 172.21.15.100:0/2103400995 >> v1:172.21.15.110:6789/0 conn(0x7f87d81556e0 legacy=0x7f87d80a9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:21.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.412+0000 7f87d7e00640 1 -- 172.21.15.100:0/2103400995 >> v1:172.21.15.100:6789/0 conn(0x7f87d80c67d0 legacy=0x7f87d80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.412+0000 7f87d7e00640 1 -- 172.21.15.100:0/2103400995 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d81562d0 con 0x7f87d80a6c30 2024-01-20T08:13:21.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.412+0000 7f87d7400640 1 -- 172.21.15.100:0/2103400995 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740870108 0 0) 0x7f87d80c7310 con 0x7f87d80c67d0 2024-01-20T08:13:21.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.413+0000 7f87d7e00640 1 --2- 172.21.15.100:0/2103400995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d806f860 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11905796708ba8ac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.413+0000 7f87d7400640 1 -- 172.21.15.100:0/2103400995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c002cb40 con 0x7f87d80a6c30 2024-01-20T08:13:21.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.413+0000 7f87d7400640 1 -- 172.21.15.100:0/2103400995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c002cca0 con 0x7f87d80a6c30 2024-01-20T08:13:21.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.413+0000 7f87d7400640 1 -- 172.21.15.100:0/2103400995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c0034660 con 0x7f87d80a6c30 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.413+0000 7f87df600640 1 -- 172.21.15.100:0/2103400995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 msgr2=0x7f87d806f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 --2- 172.21.15.100:0/2103400995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d806f860 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f87c0009d90 tx=0x7f87c002bd90 comp rx=0 tx=0).stop 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 -- 172.21.15.100:0/2103400995 shutdown_connections 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 --2- 172.21.15.100:0/2103400995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d806f860 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 -- 172.21.15.100:0/2103400995 >> 172.21.15.100:0/2103400995 conn(0x7f87d8066340 msgr2=0x7f87d8066720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 -- 172.21.15.100:0/2103400995 shutdown_connections 2024-01-20T08:13:21.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.414+0000 7f87df600640 1 -- 172.21.15.100:0/2103400995 wait complete. 2024-01-20T08:13:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.415+0000 7f87df600640 1 Processor -- start 2024-01-20T08:13:21.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.415+0000 7f87df600640 1 -- start start 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87d80c67d0 0x7f87d80bcea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87d81556e0 0x7f87d81e83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d8153620 con 0x7f87d80a6c30 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87d81e79f0 con 0x7f87d80c67d0 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.416+0000 7f87df600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87d80bfc20 con 0x7f87d81556e0 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45472/0 (socket says 172.21.15.100:45472) 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 -- 172.21.15.100:0/570183774 learned_addr learned my addr 172.21.15.100:0/570183774 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 -- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87d81556e0 msgr2=0x7f87d81e83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87d81556e0 0x7f87d81e83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 -- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87d80c67d0 msgr2=0x7f87d80bcea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87d80c67d0 0x7f87d80bcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 -- 172.21.15.100:0/570183774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c0009a70 con 0x7f87d80a6c30 2024-01-20T08:13:21.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.417+0000 7f87dcc00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b420 tx=0x7f87c800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.418+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011830 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.418+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87c8011990 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.418+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87c8011d40 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.418+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87d81ebe80 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.418+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87d80bd3e0 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.419+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87d804e970 con 0x7f87d80a6c30 2024-01-20T08:13:21.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.420+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f87c801b460 con 0x7f87d80a6c30 2024-01-20T08:13:21.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.421+0000 7f87d4c00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 0x7f87b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.421+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87c8089000 con 0x7f87d80a6c30 2024-01-20T08:13:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.421+0000 7f87d7e00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 0x7f87b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.422+0000 7f87d7e00640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 0x7f87b006d390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87c0036000 tx=0x7f87c002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.425+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f87c8053ed0 con 0x7f87d80a6c30 2024-01-20T08:13:21.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.614+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87d81ebe80 con 0x7f87d80a6c30 2024-01-20T08:13:21.619 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.615+0000 7f87d4c00640 1 -- 172.21.15.100:0/570183774 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16550 (secure 0 0 0) 0x7f87d81ebe80 con 0x7f87d80a6c30 2024-01-20T08:13:21.619 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:21.619 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":71,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:20.609345+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:21.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 msgr2=0x7f87b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 0x7f87b006d390 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87c0036000 tx=0x7f87c002e000 comp rx=0 tx=0).stop 2024-01-20T08:13:21.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 msgr2=0x7f87d81eb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f87c800b420 tx=0x7f87c800b8e0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 shutdown_connections 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f87b006aed0 0x7f87b006d390 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87d81556e0 0x7f87d81e83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87d80c67d0 0x7f87d80bcea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 --2- 172.21.15.100:0/570183774 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87d80a6c30 0x7f87d81eb940 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 >> 172.21.15.100:0/570183774 conn(0x7f87d8066340 msgr2=0x7f87d80accd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 shutdown_connections 2024-01-20T08:13:21.622 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.618+0000 7f87df600640 1 -- 172.21.15.100:0/570183774 wait complete. 2024-01-20T08:13:21.638 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:21.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.835+0000 7feece800640 1 Processor -- start 2024-01-20T08:13:21.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.835+0000 7feece800640 1 -- start start 2024-01-20T08:13:21.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.836+0000 7feece800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feec80a93c0 0x7feec8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feece800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec80a9940 con 0x7feec80aae00 2024-01-20T08:13:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feece800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec81500c0 con 0x7feec814fce0 2024-01-20T08:13:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feece800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec8156810 con 0x7feec80a93c0 2024-01-20T08:13:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feec7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7feec80aae00 0x7feec80ab2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35406/0 (socket says 172.21.15.100:35406) 2024-01-20T08:13:21.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feec7e00640 1 -- 172.21.15.100:0/704367341 learned_addr learned my addr 172.21.15.100:0/704367341 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feebfe00640 1 --2- 172.21.15.100:0/704367341 >> v2:172.21.15.110:3300/0 conn(0x7feec80a93c0 0x7feec8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341945041 0 0) 0x7feec80a9940 con 0x7feec80aae00 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.837+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea8003520 con 0x7feec80aae00 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 114176005 0 0) 0x7feea8003520 con 0x7feec80aae00 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 >> v2:172.21.15.110:3300/0 conn(0x7feec80a93c0 msgr2=0x7feec8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 --2- 172.21.15.100:0/704367341 >> v2:172.21.15.110:3300/0 conn(0x7feec80a93c0 0x7feec8153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 >> v1:172.21.15.110:6789/0 conn(0x7feec814fce0 legacy=0x7feec8152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8156af0 con 0x7feec80aae00 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7feec00019f0 con 0x7feec80aae00 2024-01-20T08:13:21.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 >> v1:172.21.15.100:6789/0 conn(0x7feec80aae00 legacy=0x7feec80ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea80047c0 0x7feea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8005180 0x7feea800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8156810 con 0x7feea8003970 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea800c020 con 0x7feea8005180 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea800c1e0 con 0x7feea80047c0 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 -- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea80047c0 msgr2=0x7feea8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea80047c0 0x7feea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 -- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8005180 msgr2=0x7feea800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8005180 0x7feea800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7400640 1 -- 172.21.15.100:0/704367341 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8003520 con 0x7feea8003970 2024-01-20T08:13:21.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.838+0000 7feec7e00640 1 -- 172.21.15.100:0/704367341 reap_dead start 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feec7400640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 0x7feea8003d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7feeb8001750 tx=0x7feea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=750fda2873398987 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb80052d0 con 0x7feea8003970 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb802e050 con 0x7feea8003970 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feec6a00640 1 -- 172.21.15.100:0/704367341 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003830 con 0x7feea8003970 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 -- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 msgr2=0x7feea8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 0x7feea8003d90 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7feeb8001750 tx=0x7feea80057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 -- 172.21.15.100:0/704367341 shutdown_connections 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 --2- 172.21.15.100:0/704367341 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 -- 172.21.15.100:0/704367341 >> 172.21.15.100:0/704367341 conn(0x7feec806a5e0 msgr2=0x7feec806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:21.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.840+0000 7feece800640 1 -- 172.21.15.100:0/704367341 shutdown_connections 2024-01-20T08:13:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.841+0000 7feece800640 1 -- 172.21.15.100:0/704367341 wait complete. 2024-01-20T08:13:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.842+0000 7feece800640 1 Processor -- start 2024-01-20T08:13:21.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.842+0000 7feece800640 1 -- start start 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8003970 0x7feec80c1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 0x7feec81e0600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8070eb0 con 0x7feec81e0b40 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec81e0fc0 con 0x7feea8003970 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feece800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec814a760 con 0x7feec80722f0 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feec7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feec7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45488/0 (socket says 172.21.15.100:45488) 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.843+0000 7feec7e00640 1 -- 172.21.15.100:0/3377430112 learned_addr learned my addr 172.21.15.100:0/3377430112 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:21.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7400640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8003970 0x7feec80c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feebfe00640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 0x7feec81e0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 -- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 msgr2=0x7feec81e0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 0x7feec81e0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 -- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8003970 msgr2=0x7feec80c1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8003970 0x7feec80c1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 -- 172.21.15.100:0/3377430112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec814aa00 con 0x7feec81e0b40 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feebfe00640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 0x7feec81e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feec7e00640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7feec806f920 tx=0x7feec000cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0004d60 con 0x7feec81e0b40 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec000a610 con 0x7feec81e0b40 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000a9c0 con 0x7feec81e0b40 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.844+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec8071100 con 0x7feec81e0b40 2024-01-20T08:13:21.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.845+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80716c0 con 0x7feec81e0b40 2024-01-20T08:13:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.845+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec804e970 con 0x7feec81e0b40 2024-01-20T08:13:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.846+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feec000ab20 con 0x7feec81e0b40 2024-01-20T08:13:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.847+0000 7feebf400640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:21.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.847+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec0089450 con 0x7feec81e0b40 2024-01-20T08:13:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.848+0000 7feec7400640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:21.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.848+0000 7feec7400640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feeb8033000 tx=0x7feeb8009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:21.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:21.851+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feec0054310 con 0x7feec81e0b40 2024-01-20T08:13:22.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.030+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feec806b320 con 0x7feec81e0b40 2024-01-20T08:13:22.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.033+0000 7feebf400640 1 -- 172.21.15.100:0/3377430112 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16550 (secure 0 0 0) 0x7feec005ce60 con 0x7feec81e0b40 2024-01-20T08:13:22.037 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:22.037 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":71,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:20.609345+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 msgr2=0x7feea006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7feeb8033000 tx=0x7feeb8009030 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 msgr2=0x7feec80c1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7feec806f920 tx=0x7feec000cb90 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 shutdown_connections 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec81e0b40 0x7feec80c1b00 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feec80722f0 0x7feec81e0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 --2- 172.21.15.100:0/3377430112 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea8003970 0x7feec80c1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 >> 172.21.15.100:0/3377430112 conn(0x7feec806a5e0 msgr2=0x7feec8150600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:22.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 shutdown_connections 2024-01-20T08:13:22.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.036+0000 7feece800640 1 -- 172.21.15.100:0/3377430112 wait complete. 2024-01-20T08:13:22.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-01-20T08:13:22.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.246+0000 7f4f5ec00640 1 Processor -- start 2024-01-20T08:13:22.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.246+0000 7f4f5ec00640 1 -- start start 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.247+0000 7f4f5ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f580a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.247+0000 7f4f5ec00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f580a5240 0x7f4f580c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.247+0000 7f4f5ec00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f58156710 con 0x7f4f580c4ed0 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.247+0000 7f4f5ec00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f5814fff0 con 0x7f4f580a5240 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.247+0000 7f4f5ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58072d10 con 0x7f4f5814fc10 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f580a5240 0x7f4f580c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f580a5240 0x7f4f580c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45504/0 (socket says 172.21.15.100:45504) 2024-01-20T08:13:22.251 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 -- 172.21.15.100:0/3168915862 learned_addr learned my addr 172.21.15.100:0/3168915862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:22.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5d800640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f580a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 -- 172.21.15.100:0/3168915862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 msgr2=0x7f4f580a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:22.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f580a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 -- 172.21.15.100:0/3168915862 >> v1:172.21.15.110:6789/0 conn(0x7f4f580c4ed0 legacy=0x7f4f580c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:22.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.248+0000 7f4f5e200640 1 -- 172.21.15.100:0/3168915862 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58155b00 con 0x7f4f580a5240 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.249+0000 7f4f5e200640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c41b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009e50 tx=0x7f4f5002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f775ea5ce0d375 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.249+0000 7f4f57e00640 1 -- 172.21.15.100:0/3168915862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5002c9f0 con 0x7f4f580a5240 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f57e00640 1 -- 172.21.15.100:0/3168915862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5002cb50 con 0x7f4f580a5240 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f57e00640 1 -- 172.21.15.100:0/3168915862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f500343f0 con 0x7f4f580a5240 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 -- 172.21.15.100:0/3168915862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 msgr2=0x7f4f580c41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c41b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f4f50009e50 tx=0x7f4f5002be50 comp rx=0 tx=0).stop 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 -- 172.21.15.100:0/3168915862 shutdown_connections 2024-01-20T08:13:22.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c41b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/3168915862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f580a4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 -- 172.21.15.100:0/3168915862 >> 172.21.15.100:0/3168915862 conn(0x7f4f580c5ba0 msgr2=0x7f4f580c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:22.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 -- 172.21.15.100:0/3168915862 shutdown_connections 2024-01-20T08:13:22.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.250+0000 7f4f5ec00640 1 -- 172.21.15.100:0/3168915862 wait complete. 2024-01-20T08:13:22.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.252+0000 7f4f5ec00640 1 Processor -- start 2024-01-20T08:13:22.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.252+0000 7f4f5ec00640 1 -- start start 2024-01-20T08:13:22.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580c4ed0 0x7f4f58151c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f5814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58151040 con 0x7f4f580a5240 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58150340 con 0x7f4f580c4ed0 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5ec00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5806e120 con 0x7f4f5814fc10 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5d800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45520/0 (socket says 172.21.15.100:45520) 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5d800640 1 -- 172.21.15.100:0/1773341102 learned_addr learned my addr 172.21.15.100:0/1773341102 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.253+0000 7f4f5e200640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f5814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5ce00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580c4ed0 0x7f4f58151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 -- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 msgr2=0x7f4f5814c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f5814c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 -- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580c4ed0 msgr2=0x7f4f58151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:22.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580c4ed0 0x7f4f58151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:22.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 -- 172.21.15.100:0/1773341102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f50009b30 con 0x7f4f580a5240 2024-01-20T08:13:22.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5d800640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c820 tx=0x7f4f4800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48004020 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f48004180 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f58150590 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f48007830 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.254+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5806ddb0 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.255+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f5804e970 con 0x7f4f580a5240 2024-01-20T08:13:22.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.256+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4f48007990 con 0x7f4f580a5240 2024-01-20T08:13:22.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.257+0000 7f4f55600640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 0x7f4f3006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:22.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.257+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f480892f0 con 0x7f4f580a5240 2024-01-20T08:13:22.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.258+0000 7f4f5ce00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 0x7f4f3006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:22.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.258+0000 7f4f5ce00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 0x7f4f3006d390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f581df680 tx=0x7f4f40009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:22.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.262+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4f480541b0 con 0x7f4f580a5240 2024-01-20T08:13:22.494 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:22.491+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f580c4cb0 con 0x7f4f580a5240 2024-01-20T08:13:23.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.195+0000 7f4f55600640 1 -- 172.21.15.100:0/1773341102 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f480577d0 con 0x7f4f580a5240 2024-01-20T08:13:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.199+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 msgr2=0x7f4f3006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.199+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 0x7f4f3006d390 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f4f581df680 tx=0x7f4f40009040 comp rx=0 tx=0).stop 2024-01-20T08:13:23.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 msgr2=0x7f4f580c1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c820 tx=0x7f4f4800cce0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 shutdown_connections 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f3006aed0 0x7f4f3006d390 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f5814fc10 0x7f4f5814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f580c4ed0 0x7f4f58151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 --2- 172.21.15.100:0/1773341102 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f580a5240 0x7f4f580c1dc0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 >> 172.21.15.100:0/1773341102 conn(0x7f4f580c5ba0 msgr2=0x7f4f58071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:23.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 shutdown_connections 2024-01-20T08:13:23.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.200+0000 7f4f5ec00640 1 -- 172.21.15.100:0/1773341102 wait complete. 2024-01-20T08:13:23.223 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:13:23.223 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-01-20T08:13:23.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.427+0000 7fb147600640 1 Processor -- start 2024-01-20T08:13:23.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.427+0000 7fb147600640 1 -- start start 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.428+0000 7fb147600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb14014fdb0 0x7fb1400c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb147600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1401532f0 0x7fb14015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb147600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb140150190 con 0x7fb1400c1d90 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb147600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1400a9ce0 con 0x7fb1401532f0 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb147600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1400a93b0 con 0x7fb14014fdb0 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb145600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb1401532f0 0x7fb14015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb137c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb1400c1d90 0x7fb140152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35408/0 (socket says 172.21.15.100:35408) 2024-01-20T08:13:23.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb137c00640 1 -- 172.21.15.100:0/2321875377 learned_addr learned my addr 172.21.15.100:0/2321875377 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb144c00640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb14014fdb0 0x7fb1400c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.429+0000 7fb13fe00640 1 -- 172.21.15.100:0/2321875377 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2572734176 0 0) 0x7fb140150190 con 0x7fb1400c1d90 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.430+0000 7fb13fe00640 1 -- 172.21.15.100:0/2321875377 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb120003520 con 0x7fb1400c1d90 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.430+0000 7fb145600640 1 -- 172.21.15.100:0/2321875377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb14014fdb0 msgr2=0x7fb1400c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.430+0000 7fb145600640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb14014fdb0 0x7fb1400c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.430+0000 7fb145600640 1 -- 172.21.15.100:0/2321875377 >> v1:172.21.15.100:6789/0 conn(0x7fb1400c1d90 legacy=0x7fb140152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.430+0000 7fb145600640 1 -- 172.21.15.100:0/2321875377 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1400a8810 con 0x7fb1401532f0 2024-01-20T08:13:23.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.431+0000 7fb145600640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1401532f0 0x7fb14015cfc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb138009d90 tx=0x7fb13802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d97df23c51e813 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:23.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.431+0000 7fb13fe00640 1 -- 172.21.15.100:0/2321875377 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13802cc60 con 0x7fb1401532f0 2024-01-20T08:13:23.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.431+0000 7fb13fe00640 1 -- 172.21.15.100:0/2321875377 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13802cdc0 con 0x7fb1401532f0 2024-01-20T08:13:23.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.431+0000 7fb13fe00640 1 -- 172.21.15.100:0/2321875377 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb138034640 con 0x7fb1401532f0 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 -- 172.21.15.100:0/2321875377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1401532f0 msgr2=0x7fb14015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1401532f0 0x7fb14015cfc0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fb138009d90 tx=0x7fb13802beb0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 -- 172.21.15.100:0/2321875377 shutdown_connections 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb1401532f0 0x7fb14015cfc0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 --2- 172.21.15.100:0/2321875377 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb14014fdb0 0x7fb1400c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 -- 172.21.15.100:0/2321875377 >> 172.21.15.100:0/2321875377 conn(0x7fb1400c2940 msgr2=0x7fb1400c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 -- 172.21.15.100:0/2321875377 shutdown_connections 2024-01-20T08:13:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.432+0000 7fb147600640 1 -- 172.21.15.100:0/2321875377 wait complete. 2024-01-20T08:13:23.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.434+0000 7fb147600640 1 Processor -- start 2024-01-20T08:13:23.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.434+0000 7fb147600640 1 -- start start 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1400c1d90 0x7fb140072160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 0x7fb1401401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb140070ba0 con 0x7fb14014fdb0 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb140151ef0 con 0x7fb1401532f0 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb140070df0 con 0x7fb1400c1d90 2024-01-20T08:13:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45552/0 (socket says 172.21.15.100:45552) 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 -- 172.21.15.100:0/2149028573 learned_addr learned my addr 172.21.15.100:0/2149028573 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb144c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1400c1d90 0x7fb140072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb145600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 0x7fb1401401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 -- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1400c1d90 msgr2=0x7fb140072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1400c1d90 0x7fb140072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 -- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 msgr2=0x7fb1401401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 0x7fb1401401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 -- 172.21.15.100:0/2149028573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb138009a70 con 0x7fb14014fdb0 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb145600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 0x7fb1401401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb137c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c430 tx=0x7fb12800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb128005ce0 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb128005e40 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1400710d0 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1280072f0 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.436+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1400c5940 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.437+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1400c3c40 con 0x7fb14014fdb0 2024-01-20T08:13:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.438+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb128007450 con 0x7fb14014fdb0 2024-01-20T08:13:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.439+0000 7fb13d600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 0x7fb11806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.439+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb128088cf0 con 0x7fb14014fdb0 2024-01-20T08:13:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.439+0000 7fb144c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 0x7fb11806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:23.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.440+0000 7fb144c00640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 0x7fb11806d390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb130006fd0 tx=0x7fb130008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.446+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb1400c3c40 con 0x7fb14014fdb0 2024-01-20T08:13:23.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:23.675+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb1400c3c40 con 0x7fb14014fdb0 2024-01-20T08:13:24.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.208+0000 7fb13d600640 1 -- 172.21.15.100:0/2149028573 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb1400c3c40 con 0x7fb14014fdb0 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 msgr2=0x7fb11806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 0x7fb11806d390 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fb130006fd0 tx=0x7fb130008040 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 msgr2=0x7fb140151540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fb12800c430 tx=0x7fb12800c8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 shutdown_connections 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb1401532f0 0x7fb1401401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb14014fdb0 0x7fb140151540 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb11806aed0 0x7fb11806d390 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.212+0000 7fb147600640 1 --2- 172.21.15.100:0/2149028573 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb1400c1d90 0x7fb140072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.213+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 >> 172.21.15.100:0/2149028573 conn(0x7fb1400c2940 msgr2=0x7fb14014ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.213+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 shutdown_connections 2024-01-20T08:13:24.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.213+0000 7fb147600640 1 -- 172.21.15.100:0/2149028573 wait complete. 2024-01-20T08:13:24.236 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-01-20T08:13:24.236 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:13:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.439+0000 7fe8a1a00640 1 Processor -- start 2024-01-20T08:13:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.439+0000 7fe8a1a00640 1 -- start start 2024-01-20T08:13:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.440+0000 7fe8a1a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe89c147f20 0x7fe89c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.440+0000 7fe8a1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe89c070370 0x7fe89c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.440+0000 7fe8a1a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe89c0c1670 con 0x7fe89c151f60 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.440+0000 7fe8a1a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c0c2210 con 0x7fe89c070370 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.440+0000 7fe8a1a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe89c1524b0 con 0x7fe89c147f20 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe89c070370 0x7fe89c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe89c070370 0x7fe89c0c2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45558/0 (socket says 172.21.15.100:45558) 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 -- 172.21.15.100:0/3352197580 learned_addr learned my addr 172.21.15.100:0/3352197580 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 -- 172.21.15.100:0/3352197580 >> v2:172.21.15.110:3300/0 conn(0x7fe89c147f20 msgr2=0x7fe89c0abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 --2- 172.21.15.100:0/3352197580 >> v2:172.21.15.110:3300/0 conn(0x7fe89c147f20 0x7fe89c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 -- 172.21.15.100:0/3352197580 >> v1:172.21.15.110:6789/0 conn(0x7fe89c151f60 legacy=0x7fe89c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.441+0000 7fe89b400640 1 -- 172.21.15.100:0/3352197580 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe89c070800 con 0x7fe89c070370 2024-01-20T08:13:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.442+0000 7fe89b400640 1 --2- 172.21.15.100:0/3352197580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c070370 0x7fe89c0c2c30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe89c06e5d0 tx=0x7fe89402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562725946f8d3965 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe899600640 1 -- 172.21.15.100:0/3352197580 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89402ca80 con 0x7fe89c070370 2024-01-20T08:13:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe899600640 1 -- 172.21.15.100:0/3352197580 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89402cbe0 con 0x7fe89c070370 2024-01-20T08:13:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe899600640 1 -- 172.21.15.100:0/3352197580 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8940343f0 con 0x7fe89c070370 2024-01-20T08:13:24.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 -- 172.21.15.100:0/3352197580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c070370 msgr2=0x7fe89c0c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/3352197580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c070370 0x7fe89c0c2c30 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe89c06e5d0 tx=0x7fe89402bee0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 -- 172.21.15.100:0/3352197580 shutdown_connections 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/3352197580 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c070370 0x7fe89c0c2c30 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/3352197580 >> v2:172.21.15.110:3300/0 conn(0x7fe89c147f20 0x7fe89c0abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 -- 172.21.15.100:0/3352197580 >> 172.21.15.100:0/3352197580 conn(0x7fe89c06a5e0 msgr2=0x7fe89c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.443+0000 7fe8a1a00640 1 -- 172.21.15.100:0/3352197580 shutdown_connections 2024-01-20T08:13:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.444+0000 7fe8a1a00640 1 -- 172.21.15.100:0/3352197580 wait complete. 2024-01-20T08:13:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.445+0000 7fe8a1a00640 1 Processor -- start 2024-01-20T08:13:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.445+0000 7fe8a1a00640 1 -- start start 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c070370 0x7fe89c144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c147f20 0x7fe89c152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c14ee60 con 0x7fe89c151f60 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1537a0 con 0x7fe89c147f20 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe8a1a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe89c1eae50 con 0x7fe89c070370 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.446+0000 7fe89b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45574/0 (socket says 172.21.15.100:45574) 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 -- 172.21.15.100:0/2642467261 learned_addr learned my addr 172.21.15.100:0/2642467261 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89a000640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c147f20 0x7fe89c152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89aa00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c070370 0x7fe89c144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 -- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c070370 msgr2=0x7fe89c144a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c070370 0x7fe89c144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 -- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c147f20 msgr2=0x7fe89c152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c147f20 0x7fe89c152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 -- 172.21.15.100:0/2642467261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe894009b30 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.447+0000 7fe89b400640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe894036040 tx=0x7fe894004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.448+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89403e450 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.448+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe89403e5d0 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.448+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe89403e980 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.448+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe89c0c51c0 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.448+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe89c0c5780 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.449+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe89c04e970 con 0x7fe89c151f60 2024-01-20T08:13:24.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.450+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe89402cd50 con 0x7fe89c151f60 2024-01-20T08:13:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.451+0000 7fe892a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 0x7fe87406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.451+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8940ac270 con 0x7fe89c151f60 2024-01-20T08:13:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.451+0000 7fe89aa00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 0x7fe87406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.452+0000 7fe89aa00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 0x7fe87406d390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00a810 tx=0x7fe88c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.456+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe894077130 con 0x7fe89c151f60 2024-01-20T08:13:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.695+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe89c0c38d0 con 0x7fe89c151f60 2024-01-20T08:13:24.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.695+0000 7fe892a00640 1 -- 172.21.15.100:0/2642467261 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4952 (secure 0 0 0) 0x7fe89407a750 con 0x7fe89c151f60 2024-01-20T08:13:24.698 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:24.698 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-01-20T08:13:24.698 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 48 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 msgr2=0x7fe87406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 0x7fe87406d390 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe88c00a810 tx=0x7fe88c008040 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 msgr2=0x7fe89c0c5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe894036040 tx=0x7fe894004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 shutdown_connections 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe89c151f60 0x7fe89c0c5ca0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe89c147f20 0x7fe89c152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe87406aed0 0x7fe87406d390 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 --2- 172.21.15.100:0/2642467261 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe89c070370 0x7fe89c144a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.698+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 >> 172.21.15.100:0/2642467261 conn(0x7fe89c06a5e0 msgr2=0x7fe89c146010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.699+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 shutdown_connections 2024-01-20T08:13:24.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.699+0000 7fe8a1a00640 1 -- 172.21.15.100:0/2642467261 wait complete. 2024-01-20T08:13:24.718 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:24.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.914+0000 7f294c400640 1 Processor -- start 2024-01-20T08:13:24.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.914+0000 7f294c400640 1 -- start start 2024-01-20T08:13:24.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294c400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f294414fce0 0x7f2944153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294c400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f29440a93c0 0x7f2944152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294c400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29440a9940 con 0x7f2944153440 2024-01-20T08:13:24.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294c400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29441500c0 con 0x7f294414fce0 2024-01-20T08:13:24.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294c400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2944156810 con 0x7f29440a93c0 2024-01-20T08:13:24.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f2949a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f294414fce0 0x7f2944153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294a400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2944153440 0x7f29440aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35418/0 (socket says 172.21.15.100:35418) 2024-01-20T08:13:24.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.916+0000 7f294a400640 1 -- 172.21.15.100:0/1517520539 learned_addr learned my addr 172.21.15.100:0/1517520539 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:24.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2949000640 1 --2- 172.21.15.100:0/1517520539 >> v2:172.21.15.110:3300/0 conn(0x7f29440a93c0 0x7f2944152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2943e00640 1 -- 172.21.15.100:0/1517520539 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1817075508 0 0) 0x7f29440a9940 con 0x7f2944153440 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2943e00640 1 -- 172.21.15.100:0/1517520539 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2924003520 con 0x7f2944153440 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2949a00640 1 -- 172.21.15.100:0/1517520539 >> v2:172.21.15.110:3300/0 conn(0x7f29440a93c0 msgr2=0x7f2944152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2949a00640 1 --2- 172.21.15.100:0/1517520539 >> v2:172.21.15.110:3300/0 conn(0x7f29440a93c0 0x7f2944152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2949a00640 1 -- 172.21.15.100:0/1517520539 >> v1:172.21.15.100:6789/0 conn(0x7f2944153440 legacy=0x7f29440aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.917+0000 7f2949a00640 1 -- 172.21.15.100:0/1517520539 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2944156af0 con 0x7f294414fce0 2024-01-20T08:13:24.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.918+0000 7f2949a00640 1 --2- 172.21.15.100:0/1517520539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944153b80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f294406fa40 tx=0x7f293402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ae18425ebd064ae server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f2943e00640 1 -- 172.21.15.100:0/1517520539 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f293402cc80 con 0x7f294414fce0 2024-01-20T08:13:24.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f2943e00640 1 -- 172.21.15.100:0/1517520539 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293402cde0 con 0x7f294414fce0 2024-01-20T08:13:24.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f2943e00640 1 -- 172.21.15.100:0/1517520539 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2934034660 con 0x7f294414fce0 2024-01-20T08:13:24.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 -- 172.21.15.100:0/1517520539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 msgr2=0x7f2944153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 --2- 172.21.15.100:0/1517520539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944153b80 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f294406fa40 tx=0x7f293402bed0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 -- 172.21.15.100:0/1517520539 shutdown_connections 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 --2- 172.21.15.100:0/1517520539 >> v2:172.21.15.110:3300/0 conn(0x7f29440a93c0 0x7f2944152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 --2- 172.21.15.100:0/1517520539 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944153b80 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 -- 172.21.15.100:0/1517520539 >> 172.21.15.100:0/1517520539 conn(0x7f294406a5e0 msgr2=0x7f294406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 -- 172.21.15.100:0/1517520539 shutdown_connections 2024-01-20T08:13:24.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.919+0000 7f294c400640 1 -- 172.21.15.100:0/1517520539 wait complete. 2024-01-20T08:13:24.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.921+0000 7f294c400640 1 Processor -- start 2024-01-20T08:13:24.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.921+0000 7f294c400640 1 -- start start 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440a93c0 0x7f2944070370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153440 0x7f29441ed9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29441dc1e0 con 0x7f294414fce0 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29441dbcf0 con 0x7f29440a93c0 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.922+0000 7f294c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29440708b0 con 0x7f2944153440 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45592/0 (socket says 172.21.15.100:45592) 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 -- 172.21.15.100:0/1825704752 learned_addr learned my addr 172.21.15.100:0/1825704752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949a00640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440a93c0 0x7f2944070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f294a400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153440 0x7f29441ed9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 -- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153440 msgr2=0x7f29441ed9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153440 0x7f29441ed9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 -- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440a93c0 msgr2=0x7f2944070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440a93c0 0x7f2944070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 -- 172.21.15.100:0/1825704752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2934009a70 con 0x7f294414fce0 2024-01-20T08:13:24.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.923+0000 7f2949000640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f292c00e9e0 tx=0x7f292c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.924+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c009670 con 0x7f294414fce0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.924+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f292c00c970 con 0x7f294414fce0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.924+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f292c00cd20 con 0x7f294414fce0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.924+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f294414cb20 con 0x7f294414fce0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.924+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f294414d490 con 0x7f294414fce0 2024-01-20T08:13:24.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.925+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29440c3a30 con 0x7f294414fce0 2024-01-20T08:13:24.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.926+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f292c013470 con 0x7f294414fce0 2024-01-20T08:13:24.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.927+0000 7f2941600640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:24.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.927+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f292c089850 con 0x7f294414fce0 2024-01-20T08:13:24.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.927+0000 7f2949a00640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:24.929 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.928+0000 7f2949a00640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 0x7f291c06d390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2934036000 tx=0x7f2934030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:24.933 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:24.931+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f292c054710 con 0x7f294414fce0 2024-01-20T08:13:25.105 INFO:tasks.ceph.mds.a.smithi100.stderr:2024-01-20T08:13:25.103+0000 7f9b23200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:13:25.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.126+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29441ee590 con 0x7f294414fce0 2024-01-20T08:13:25.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.128+0000 7f2941600640 1 -- 172.21.15.100:0/1825704752 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f29441ee590 con 0x7f294414fce0 2024-01-20T08:13:25.130 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:25.131 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":72,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:22.184420+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 msgr2=0x7f291c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 0x7f291c06d390 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f2934036000 tx=0x7f2934030000 comp rx=0 tx=0).stop 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 msgr2=0x7f2944071bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f292c00e9e0 tx=0x7f292c00eea0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 shutdown_connections 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f291c06aed0 0x7f291c06d390 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2944153440 0x7f29441ed9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f294414fce0 0x7f2944071bc0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 --2- 172.21.15.100:0/1825704752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f29440a93c0 0x7f2944070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 >> 172.21.15.100:0/1825704752 conn(0x7f294406a5e0 msgr2=0x7f2944153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:25.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 shutdown_connections 2024-01-20T08:13:25.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.131+0000 7f294c400640 1 -- 172.21.15.100:0/1825704752 wait complete. 2024-01-20T08:13:25.152 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:13:25.153 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.357+0000 7f45f1e00640 1 Processor -- start 2024-01-20T08:13:25.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.357+0000 7f45f1e00640 1 -- start start 2024-01-20T08:13:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45f1e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec0c1670 con 0x7f45ec070370 2024-01-20T08:13:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45f1e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45ec070820 con 0x7f45ec147f20 2024-01-20T08:13:25.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45f1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec0c2210 con 0x7f45ec151f60 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45eb400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f45ec070370 0x7f45ec0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35428/0 (socket says 172.21.15.100:35428) 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.359+0000 7f45eb400640 1 -- 172.21.15.100:0/230293791 learned_addr learned my addr 172.21.15.100:0/230293791 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45e3e00640 1 --2- 172.21.15.100:0/230293791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697551664 0 0) 0x7f45ec0c1670 con 0x7f45ec070370 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45cc003520 con 0x7f45ec070370 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 674481881 0 0) 0x7f45cc003520 con 0x7f45ec070370 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45e3e00640 1 -- 172.21.15.100:0/230293791 >> v1:172.21.15.110:6789/0 conn(0x7f45ec147f20 legacy=0x7f45ec0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45e3e00640 1 -- 172.21.15.100:0/230293791 >> v1:172.21.15.100:6789/0 conn(0x7f45ec070370 legacy=0x7f45ec0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.360+0000 7f45e3e00640 1 -- 172.21.15.100:0/230293791 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45ec0c0d40 con 0x7f45ec151f60 2024-01-20T08:13:25.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.361+0000 7f45e3e00640 1 --2- 172.21.15.100:0/230293791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec0abfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097d0 tx=0x7f45d402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=410ff89dfad8011 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.362+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40019f0 con 0x7f45ec151f60 2024-01-20T08:13:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.362+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d402e050 con 0x7f45ec151f60 2024-01-20T08:13:25.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.362+0000 7f45ea000640 1 -- 172.21.15.100:0/230293791 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d4030730 con 0x7f45ec151f60 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.362+0000 7f45f1e00640 1 -- 172.21.15.100:0/230293791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 msgr2=0x7f45ec0abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.362+0000 7f45f1e00640 1 --2- 172.21.15.100:0/230293791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec0abfd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f45d40097d0 tx=0x7f45d402b800 comp rx=0 tx=0).stop 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.363+0000 7f45f1e00640 1 -- 172.21.15.100:0/230293791 shutdown_connections 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.363+0000 7f45f1e00640 1 --2- 172.21.15.100:0/230293791 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec0abfd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.363+0000 7f45f1e00640 1 -- 172.21.15.100:0/230293791 >> 172.21.15.100:0/230293791 conn(0x7f45ec06a5e0 msgr2=0x7f45ec06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.363+0000 7f45f1e00640 1 -- 172.21.15.100:0/230293791 shutdown_connections 2024-01-20T08:13:25.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.363+0000 7f45f1e00640 1 -- 172.21.15.100:0/230293791 wait complete. 2024-01-20T08:13:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.364+0000 7f45f1e00640 1 Processor -- start 2024-01-20T08:13:25.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.364+0000 7f45f1e00640 1 -- start start 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45ec070370 0x7f45ec14e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec1eda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec14bca0 con 0x7f45ec147f20 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec14c7e0 con 0x7f45ec070370 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.365+0000 7f45f1e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45ec1edfa0 con 0x7f45ec151f60 2024-01-20T08:13:25.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45606/0 (socket says 172.21.15.100:45606) 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 -- 172.21.15.100:0/344476346 learned_addr learned my addr 172.21.15.100:0/344476346 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45eb400640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec1eda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45eaa00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45ec070370 0x7f45ec14e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 -- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 msgr2=0x7f45ec1eda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec1eda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 -- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45ec070370 msgr2=0x7f45ec14e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45ec070370 0x7f45ec14e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 -- 172.21.15.100:0/344476346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d4009400 con 0x7f45ec147f20 2024-01-20T08:13:25.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.366+0000 7f45e3e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f45d40098f0 tx=0x7f45d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.367+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d403d950 con 0x7f45ec147f20 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.367+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d403dab0 con 0x7f45ec147f20 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.367+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d403de60 con 0x7f45ec147f20 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.367+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45ec0c4a30 con 0x7f45ec147f20 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.367+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45ec14c190 con 0x7f45ec147f20 2024-01-20T08:13:25.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.368+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45ec04e970 con 0x7f45ec147f20 2024-01-20T08:13:25.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.369+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f45d4039040 con 0x7f45ec147f20 2024-01-20T08:13:25.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.370+0000 7f45e3400640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 0x7f45c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.370+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45d40ab610 con 0x7f45ec147f20 2024-01-20T08:13:25.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.370+0000 7f45eaa00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 0x7f45c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.371+0000 7f45eaa00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 0x7f45c406d390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f60 tx=0x7f45dc009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.374+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f45d4076690 con 0x7f45ec147f20 2024-01-20T08:13:25.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.564+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f45ec148300 con 0x7f45c406aed0 2024-01-20T08:13:25.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.587+0000 7f45e3400640 1 -- 172.21.15.100:0/344476346 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281510 (secure 0 0 0) 0x7f45dc001390 con 0x7f45c406aed0 2024-01-20T08:13:25.593 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:25.594 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 msgr2=0x7f45c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 0x7f45c406d390 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45dc000f60 tx=0x7f45dc009040 comp rx=0 tx=0).stop 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 msgr2=0x7f45ec150f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f45d40098f0 tx=0x7f45d40046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 shutdown_connections 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f45c406aed0 0x7f45c406d390 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f45ec151f60 0x7f45ec1eda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f45ec147f20 0x7f45ec150f00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 --2- 172.21.15.100:0/344476346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f45ec070370 0x7f45ec14e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.593+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 >> 172.21.15.100:0/344476346 conn(0x7f45ec06a5e0 msgr2=0x7f45ec06db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:25.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.594+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 shutdown_connections 2024-01-20T08:13:25.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.594+0000 7f45f1e00640 1 -- 172.21.15.100:0/344476346 wait complete. 2024-01-20T08:13:25.616 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":167,"stamp":"2024-01-20T08:13:23.948509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253176,"kb_used_data":7868,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721544,"statfs":{"total":773094113280,"available":772834861056,"internally_reserved":0,"allocated":8056832,"data_stored":4161621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.816903"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163013+0000","last_change":"2024-01-20T08:13:20.163013+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163013+0000","last_undegraded":"2024-01-20T08:13:20.163013+0000","last_fullsized":"2024-01-20T08:13:20.163013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164454+0000","last_change":"2024-01-20T08:13:20.164454+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164454+0000","last_undegraded":"2024-01-20T08:13:20.164454+0000","last_fullsized":"2024-01-20T08:13:20.164454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166455+0000","last_change":"2024-01-20T08:13:20.166455+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166455+0000","last_undegraded":"2024-01-20T08:13:20.166455+0000","last_fullsized":"2024-01-20T08:13:20.166455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163534+0000","last_change":"2024-01-20T08:13:20.163534+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163534+0000","last_undegraded":"2024-01-20T08:13:20.163534+0000","last_fullsized":"2024-01-20T08:13:20.163534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147178+0000","last_change":"2024-01-20T08:13:20.147178+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147178+0000","last_undegraded":"2024-01-20T08:13:20.147178+0000","last_fullsized":"2024-01-20T08:13:20.147178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166749+0000","last_change":"2024-01-20T08:13:20.166749+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166749+0000","last_undegraded":"2024-01-20T08:13:20.166749+0000","last_fullsized":"2024-01-20T08:13:20.166749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157286+0000","last_change":"2024-01-20T08:13:20.157286+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157286+0000","last_undegraded":"2024-01-20T08:13:20.157286+0000","last_fullsized":"2024-01-20T08:13:20.157286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164043+0000","last_change":"2024-01-20T08:13:20.164043+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164043+0000","last_undegraded":"2024-01-20T08:13:20.164043+0000","last_fullsized":"2024-01-20T08:13:20.164043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.168317+0000","last_change":"2024-01-20T08:13:20.168317+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.168317+0000","last_undegraded":"2024-01-20T08:13:20.168317+0000","last_fullsized":"2024-01-20T08:13:20.168317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.156070+0000","last_change":"2024-01-20T08:13:20.156070+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.156070+0000","last_undegraded":"2024-01-20T08:13:20.156070+0000","last_fullsized":"2024-01-20T08:13:20.156070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161431+0000","last_change":"2024-01-20T08:13:20.161431+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161431+0000","last_undegraded":"2024-01-20T08:13:20.161431+0000","last_fullsized":"2024-01-20T08:13:20.161431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164840+0000","last_change":"2024-01-20T08:13:20.164840+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164840+0000","last_undegraded":"2024-01-20T08:13:20.164840+0000","last_fullsized":"2024-01-20T08:13:20.164840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164216+0000","last_change":"2024-01-20T08:13:20.164216+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164216+0000","last_undegraded":"2024-01-20T08:13:20.164216+0000","last_fullsized":"2024-01-20T08:13:20.164216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162720+0000","last_change":"2024-01-20T08:13:20.162720+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162720+0000","last_undegraded":"2024-01-20T08:13:20.162720+0000","last_fullsized":"2024-01-20T08:13:20.162720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145088+0000","last_change":"2024-01-20T08:13:20.145088+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145088+0000","last_undegraded":"2024-01-20T08:13:20.145088+0000","last_fullsized":"2024-01-20T08:13:20.145088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145298+0000","last_change":"2024-01-20T08:13:20.145298+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145298+0000","last_undegraded":"2024-01-20T08:13:20.145298+0000","last_fullsized":"2024-01-20T08:13:20.145298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145913+0000","last_change":"2024-01-20T08:13:20.145913+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145913+0000","last_undegraded":"2024-01-20T08:13:20.145913+0000","last_fullsized":"2024-01-20T08:13:20.145913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165563+0000","last_change":"2024-01-20T08:13:20.165563+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165563+0000","last_undegraded":"2024-01-20T08:13:20.165563+0000","last_fullsized":"2024-01-20T08:13:20.165563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160092+0000","last_change":"2024-01-20T08:13:20.160092+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160092+0000","last_undegraded":"2024-01-20T08:13:20.160092+0000","last_fullsized":"2024-01-20T08:13:20.160092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162470+0000","last_change":"2024-01-20T08:13:20.162470+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162470+0000","last_undegraded":"2024-01-20T08:13:20.162470+0000","last_fullsized":"2024-01-20T08:13:20.162470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163726+0000","last_change":"2024-01-20T08:13:20.163726+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163726+0000","last_undegraded":"2024-01-20T08:13:20.163726+0000","last_fullsized":"2024-01-20T08:13:20.163726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162635+0000","last_change":"2024-01-20T08:13:20.162635+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162635+0000","last_undegraded":"2024-01-20T08:13:20.162635+0000","last_fullsized":"2024-01-20T08:13:20.162635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157075+0000","last_change":"2024-01-20T08:13:20.157075+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157075+0000","last_undegraded":"2024-01-20T08:13:20.157075+0000","last_fullsized":"2024-01-20T08:13:20.157075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167863+0000","last_change":"2024-01-20T08:13:20.167863+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167863+0000","last_undegraded":"2024-01-20T08:13:20.167863+0000","last_fullsized":"2024-01-20T08:13:20.167863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165389+0000","last_change":"2024-01-20T08:13:20.165389+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165389+0000","last_undegraded":"2024-01-20T08:13:20.165389+0000","last_fullsized":"2024-01-20T08:13:20.165389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163718+0000","last_change":"2024-01-20T08:13:20.163718+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163718+0000","last_undegraded":"2024-01-20T08:13:20.163718+0000","last_fullsized":"2024-01-20T08:13:20.163718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.149560+0000","last_change":"2024-01-20T08:13:20.149560+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.149560+0000","last_undegraded":"2024-01-20T08:13:20.149560+0000","last_fullsized":"2024-01-20T08:13:20.149560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160489+0000","last_change":"2024-01-20T08:13:20.160489+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160489+0000","last_undegraded":"2024-01-20T08:13:20.160489+0000","last_fullsized":"2024-01-20T08:13:20.160489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165517+0000","last_change":"2024-01-20T08:13:20.165517+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165517+0000","last_undegraded":"2024-01-20T08:13:20.165517+0000","last_fullsized":"2024-01-20T08:13:20.165517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162175+0000","last_change":"2024-01-20T08:13:20.162175+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162175+0000","last_undegraded":"2024-01-20T08:13:20.162175+0000","last_fullsized":"2024-01-20T08:13:20.162175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145247+0000","last_change":"2024-01-20T08:13:20.145247+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145247+0000","last_undegraded":"2024-01-20T08:13:20.145247+0000","last_fullsized":"2024-01-20T08:13:20.145247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158879+0000","last_change":"2024-01-20T08:13:20.158879+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158879+0000","last_undegraded":"2024-01-20T08:13:20.158879+0000","last_fullsized":"2024-01-20T08:13:20.158879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147903+0000","last_change":"2024-01-20T08:13:20.147903+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147903+0000","last_undegraded":"2024-01-20T08:13:20.147903+0000","last_fullsized":"2024-01-20T08:13:20.147903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178515+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:20.178515+0000","last_peered":"2024-01-20T08:13:20.178515+0000","last_clean":"2024-01-20T08:13:20.178515+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:20.178515+0000","last_undegraded":"2024-01-20T08:13:20.178515+0000","last_fullsized":"2024-01-20T08:13:20.178515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:39.161170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162264+0000","last_change":"2024-01-20T08:13:20.162264+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162264+0000","last_undegraded":"2024-01-20T08:13:20.162264+0000","last_fullsized":"2024-01-20T08:13:20.162264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166688+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:20.166688+0000","last_peered":"2024-01-20T08:13:20.166688+0000","last_clean":"2024-01-20T08:13:20.166688+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:20.166688+0000","last_undegraded":"2024-01-20T08:13:20.166688+0000","last_fullsized":"2024-01-20T08:13:20.166688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158859+0000","last_change":"2024-01-20T08:13:20.158859+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158859+0000","last_undegraded":"2024-01-20T08:13:20.158859+0000","last_fullsized":"2024-01-20T08:13:20.158859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179122+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:20.179122+0000","last_peered":"2024-01-20T08:13:20.179122+0000","last_clean":"2024-01-20T08:13:20.179122+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:20.179122+0000","last_undegraded":"2024-01-20T08:13:20.179122+0000","last_fullsized":"2024-01-20T08:13:20.179122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161850+0000","last_change":"2024-01-20T08:13:20.161850+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161850+0000","last_undegraded":"2024-01-20T08:13:20.161850+0000","last_fullsized":"2024-01-20T08:13:20.161850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180941+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:20.180941+0000","last_peered":"2024-01-20T08:13:20.180941+0000","last_clean":"2024-01-20T08:13:20.180941+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:20.180941+0000","last_undegraded":"2024-01-20T08:13:20.180941+0000","last_fullsized":"2024-01-20T08:13:20.180941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:14:23.230628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160827+0000","last_change":"2024-01-20T08:13:20.160827+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160827+0000","last_undegraded":"2024-01-20T08:13:20.160827+0000","last_fullsized":"2024-01-20T08:13:20.160827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166254+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:20.166254+0000","last_peered":"2024-01-20T08:13:20.166254+0000","last_clean":"2024-01-20T08:13:20.166254+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:20.166254+0000","last_undegraded":"2024-01-20T08:13:20.166254+0000","last_fullsized":"2024-01-20T08:13:20.166254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145198+0000","last_change":"2024-01-20T08:13:20.145198+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145198+0000","last_undegraded":"2024-01-20T08:13:20.145198+0000","last_fullsized":"2024-01-20T08:13:20.145198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.171982+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:20.171982+0000","last_peered":"2024-01-20T08:13:20.171982+0000","last_clean":"2024-01-20T08:13:20.171982+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:20.171982+0000","last_undegraded":"2024-01-20T08:13:20.171982+0000","last_fullsized":"2024-01-20T08:13:20.171982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:03.339169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.170159+0000","last_change":"2024-01-20T08:13:20.170159+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.170159+0000","last_undegraded":"2024-01-20T08:13:20.170159+0000","last_fullsized":"2024-01-20T08:13:20.170159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180925+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:20.180925+0000","last_peered":"2024-01-20T08:13:20.180925+0000","last_clean":"2024-01-20T08:13:20.180925+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:20.180925+0000","last_undegraded":"2024-01-20T08:13:20.180925+0000","last_fullsized":"2024-01-20T08:13:20.180925+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.144599+0000","last_change":"2024-01-20T08:13:20.144599+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.144599+0000","last_undegraded":"2024-01-20T08:13:20.144599+0000","last_fullsized":"2024-01-20T08:13:20.144599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174890+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:20.174890+0000","last_peered":"2024-01-20T08:13:20.174890+0000","last_clean":"2024-01-20T08:13:20.174890+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:20.174890+0000","last_undegraded":"2024-01-20T08:13:20.174890+0000","last_fullsized":"2024-01-20T08:13:20.174890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:27:41.805984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145120+0000","last_change":"2024-01-20T08:13:20.145120+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145120+0000","last_undegraded":"2024-01-20T08:13:20.145120+0000","last_fullsized":"2024-01-20T08:13:20.145120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174876+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:20.174876+0000","last_peered":"2024-01-20T08:13:20.174876+0000","last_clean":"2024-01-20T08:13:20.174876+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:20.174876+0000","last_undegraded":"2024-01-20T08:13:20.174876+0000","last_fullsized":"2024-01-20T08:13:20.174876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:56.828582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167845+0000","last_change":"2024-01-20T08:13:20.167845+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167845+0000","last_undegraded":"2024-01-20T08:13:20.167845+0000","last_fullsized":"2024-01-20T08:13:20.167845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178117+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:20.178117+0000","last_peered":"2024-01-20T08:13:20.178117+0000","last_clean":"2024-01-20T08:13:20.178117+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:20.178117+0000","last_undegraded":"2024-01-20T08:13:20.178117+0000","last_fullsized":"2024-01-20T08:13:20.178117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:47:08.271391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164901+0000","last_change":"2024-01-20T08:13:20.164901+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164901+0000","last_undegraded":"2024-01-20T08:13:20.164901+0000","last_fullsized":"2024-01-20T08:13:20.164901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178197+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:20.178197+0000","last_peered":"2024-01-20T08:13:20.178197+0000","last_clean":"2024-01-20T08:13:20.178197+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:20.178197+0000","last_undegraded":"2024-01-20T08:13:20.178197+0000","last_fullsized":"2024-01-20T08:13:20.178197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:28:24.138553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.148437+0000","last_change":"2024-01-20T08:13:20.148437+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.148437+0000","last_undegraded":"2024-01-20T08:13:20.148437+0000","last_fullsized":"2024-01-20T08:13:20.148437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178061+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:20.178061+0000","last_peered":"2024-01-20T08:13:20.178061+0000","last_clean":"2024-01-20T08:13:20.178061+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:20.178061+0000","last_undegraded":"2024-01-20T08:13:20.178061+0000","last_fullsized":"2024-01-20T08:13:20.178061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160826+0000","last_change":"2024-01-20T08:13:20.160826+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160826+0000","last_undegraded":"2024-01-20T08:13:20.160826+0000","last_fullsized":"2024-01-20T08:13:20.160826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180445+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:20.180445+0000","last_peered":"2024-01-20T08:13:20.180445+0000","last_clean":"2024-01-20T08:13:20.180445+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:20.180445+0000","last_undegraded":"2024-01-20T08:13:20.180445+0000","last_fullsized":"2024-01-20T08:13:20.180445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:37:21.337273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161515+0000","last_change":"2024-01-20T08:13:20.161515+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161515+0000","last_undegraded":"2024-01-20T08:13:20.161515+0000","last_fullsized":"2024-01-20T08:13:20.161515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.161327+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:20.161327+0000","last_peered":"2024-01-20T08:13:20.161327+0000","last_clean":"2024-01-20T08:13:20.161327+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:20.161327+0000","last_undegraded":"2024-01-20T08:13:20.161327+0000","last_fullsized":"2024-01-20T08:13:20.161327+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:23.036421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161479+0000","last_change":"2024-01-20T08:13:20.161479+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161479+0000","last_undegraded":"2024-01-20T08:13:20.161479+0000","last_fullsized":"2024-01-20T08:13:20.161479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179765+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:20.179765+0000","last_peered":"2024-01-20T08:13:20.179765+0000","last_clean":"2024-01-20T08:13:20.179765+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:20.179765+0000","last_undegraded":"2024-01-20T08:13:20.179765+0000","last_fullsized":"2024-01-20T08:13:20.179765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162721+0000","last_change":"2024-01-20T08:13:20.162721+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162721+0000","last_undegraded":"2024-01-20T08:13:20.162721+0000","last_fullsized":"2024-01-20T08:13:20.162721+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.181105+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:20.181105+0000","last_peered":"2024-01-20T08:13:20.181105+0000","last_clean":"2024-01-20T08:13:20.181105+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:20.181105+0000","last_undegraded":"2024-01-20T08:13:20.181105+0000","last_fullsized":"2024-01-20T08:13:20.181105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:06.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163269+0000","last_change":"2024-01-20T08:13:20.163269+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163269+0000","last_undegraded":"2024-01-20T08:13:20.163269+0000","last_fullsized":"2024-01-20T08:13:20.163269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178539+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:20.178539+0000","last_peered":"2024-01-20T08:13:20.178539+0000","last_clean":"2024-01-20T08:13:20.178539+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:20.178539+0000","last_undegraded":"2024-01-20T08:13:20.178539+0000","last_fullsized":"2024-01-20T08:13:20.178539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.159358+0000","last_change":"2024-01-20T08:13:20.159358+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.159358+0000","last_undegraded":"2024-01-20T08:13:20.159358+0000","last_fullsized":"2024-01-20T08:13:20.159358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178499+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:20.178499+0000","last_peered":"2024-01-20T08:13:20.178499+0000","last_clean":"2024-01-20T08:13:20.178499+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:20.178499+0000","last_undegraded":"2024-01-20T08:13:20.178499+0000","last_fullsized":"2024-01-20T08:13:20.178499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:37.645450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147364+0000","last_change":"2024-01-20T08:13:20.147364+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147364+0000","last_undegraded":"2024-01-20T08:13:20.147364+0000","last_fullsized":"2024-01-20T08:13:20.147364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180960+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:20.180960+0000","last_peered":"2024-01-20T08:13:20.180960+0000","last_clean":"2024-01-20T08:13:20.180960+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:20.180960+0000","last_undegraded":"2024-01-20T08:13:20.180960+0000","last_fullsized":"2024-01-20T08:13:20.180960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:14:53.410256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162258+0000","last_change":"2024-01-20T08:13:20.162258+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162258+0000","last_undegraded":"2024-01-20T08:13:20.162258+0000","last_fullsized":"2024-01-20T08:13:20.162258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175578+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:20.175578+0000","last_peered":"2024-01-20T08:13:20.175578+0000","last_clean":"2024-01-20T08:13:20.175578+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:20.175578+0000","last_undegraded":"2024-01-20T08:13:20.175578+0000","last_fullsized":"2024-01-20T08:13:20.175578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:18.533547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161124+0000","last_change":"2024-01-20T08:13:20.161124+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161124+0000","last_undegraded":"2024-01-20T08:13:20.161124+0000","last_fullsized":"2024-01-20T08:13:20.161124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183543+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:20.183543+0000","last_peered":"2024-01-20T08:13:20.183543+0000","last_clean":"2024-01-20T08:13:20.183543+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:20.183543+0000","last_undegraded":"2024-01-20T08:13:20.183543+0000","last_fullsized":"2024-01-20T08:13:20.183543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.693914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157106+0000","last_change":"2024-01-20T08:13:20.157106+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157106+0000","last_undegraded":"2024-01-20T08:13:20.157106+0000","last_fullsized":"2024-01-20T08:13:20.157106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183823+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:20.183823+0000","last_peered":"2024-01-20T08:13:20.183823+0000","last_clean":"2024-01-20T08:13:20.183823+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:20.183823+0000","last_undegraded":"2024-01-20T08:13:20.183823+0000","last_fullsized":"2024-01-20T08:13:20.183823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:26.608715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165602+0000","last_change":"2024-01-20T08:13:20.165602+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165602+0000","last_undegraded":"2024-01-20T08:13:20.165602+0000","last_fullsized":"2024-01-20T08:13:20.165602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172822+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:20.172822+0000","last_peered":"2024-01-20T08:13:20.172822+0000","last_clean":"2024-01-20T08:13:20.172822+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:20.172822+0000","last_undegraded":"2024-01-20T08:13:20.172822+0000","last_fullsized":"2024-01-20T08:13:20.172822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:46.201221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.146620+0000","last_change":"2024-01-20T08:13:20.146620+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.146620+0000","last_undegraded":"2024-01-20T08:13:20.146620+0000","last_fullsized":"2024-01-20T08:13:20.146620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183413+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:20.183413+0000","last_peered":"2024-01-20T08:13:20.183413+0000","last_clean":"2024-01-20T08:13:20.183413+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:20.183413+0000","last_undegraded":"2024-01-20T08:13:20.183413+0000","last_fullsized":"2024-01-20T08:13:20.183413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:34:57.243103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166532+0000","last_change":"2024-01-20T08:13:20.166532+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166532+0000","last_undegraded":"2024-01-20T08:13:20.166532+0000","last_fullsized":"2024-01-20T08:13:20.166532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183288+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:20.183288+0000","last_peered":"2024-01-20T08:13:20.183288+0000","last_clean":"2024-01-20T08:13:20.183288+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:20.183288+0000","last_undegraded":"2024-01-20T08:13:20.183288+0000","last_fullsized":"2024-01-20T08:13:20.183288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:04.702644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157513+0000","last_change":"2024-01-20T08:13:20.157513+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157513+0000","last_undegraded":"2024-01-20T08:13:20.157513+0000","last_fullsized":"2024-01-20T08:13:20.157513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178220+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:20.178220+0000","last_peered":"2024-01-20T08:13:20.178220+0000","last_clean":"2024-01-20T08:13:20.178220+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:20.178220+0000","last_undegraded":"2024-01-20T08:13:20.178220+0000","last_fullsized":"2024-01-20T08:13:20.178220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145432+0000","last_change":"2024-01-20T08:13:20.145432+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145432+0000","last_undegraded":"2024-01-20T08:13:20.145432+0000","last_fullsized":"2024-01-20T08:13:20.145432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175835+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:20.175835+0000","last_peered":"2024-01-20T08:13:20.175835+0000","last_clean":"2024-01-20T08:13:20.175835+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:20.175835+0000","last_undegraded":"2024-01-20T08:13:20.175835+0000","last_fullsized":"2024-01-20T08:13:20.175835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:22.763565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166278+0000","last_change":"2024-01-20T08:13:20.166278+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166278+0000","last_undegraded":"2024-01-20T08:13:20.166278+0000","last_fullsized":"2024-01-20T08:13:20.166278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183538+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:20.183538+0000","last_peered":"2024-01-20T08:13:20.183538+0000","last_clean":"2024-01-20T08:13:20.183538+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:20.183538+0000","last_undegraded":"2024-01-20T08:13:20.183538+0000","last_fullsized":"2024-01-20T08:13:20.183538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:08.839046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158478+0000","last_change":"2024-01-20T08:13:20.158478+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158478+0000","last_undegraded":"2024-01-20T08:13:20.158478+0000","last_fullsized":"2024-01-20T08:13:20.158478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172003+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:20.172003+0000","last_peered":"2024-01-20T08:13:20.172003+0000","last_clean":"2024-01-20T08:13:20.172003+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:20.172003+0000","last_undegraded":"2024-01-20T08:13:20.172003+0000","last_fullsized":"2024-01-20T08:13:20.172003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162181+0000","last_change":"2024-01-20T08:13:20.162181+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162181+0000","last_undegraded":"2024-01-20T08:13:20.162181+0000","last_fullsized":"2024-01-20T08:13:20.162181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.170394+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:20.170394+0000","last_peered":"2024-01-20T08:13:20.170394+0000","last_clean":"2024-01-20T08:13:20.170394+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:20.170394+0000","last_undegraded":"2024-01-20T08:13:20.170394+0000","last_fullsized":"2024-01-20T08:13:20.170394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:48.765547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.155566+0000","last_change":"2024-01-20T08:13:20.155566+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.155566+0000","last_undegraded":"2024-01-20T08:13:20.155566+0000","last_fullsized":"2024-01-20T08:13:20.155566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.176544+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:20.176544+0000","last_peered":"2024-01-20T08:13:20.176544+0000","last_clean":"2024-01-20T08:13:20.176544+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:20.176544+0000","last_undegraded":"2024-01-20T08:13:20.176544+0000","last_fullsized":"2024-01-20T08:13:20.176544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161594+0000","last_change":"2024-01-20T08:13:20.161594+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161594+0000","last_undegraded":"2024-01-20T08:13:20.161594+0000","last_fullsized":"2024-01-20T08:13:20.161594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179462+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:20.179462+0000","last_peered":"2024-01-20T08:13:20.179462+0000","last_clean":"2024-01-20T08:13:20.179462+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:20.179462+0000","last_undegraded":"2024-01-20T08:13:20.179462+0000","last_fullsized":"2024-01-20T08:13:20.179462+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-20T08:13:19.145639+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:19.145639+0000","last_peered":"2024-01-20T08:13:19.145639+0000","last_clean":"2024-01-20T08:13:19.145639+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:19.145639+0000","last_undegraded":"2024-01-20T08:13:19.145639+0000","last_fullsized":"2024-01-20T08:13:19.145639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.752},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.3500000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.27},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.5980000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.399}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.571},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.4530000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4870000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4279999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3320000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.373},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.619}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.5349999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.38},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.628},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.351}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.6819999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.024},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.179}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.129}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.593}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.268},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5309999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.736},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.825}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.653},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.86099999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":1.028},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.331}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":1.353},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":1.5129999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.395},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.2470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.371},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":367120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.371}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.6499999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.597},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.113}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:25.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.872+0000 7fe692a00640 1 Processor -- start 2024-01-20T08:13:25.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.872+0000 7fe692a00640 1 -- start start 2024-01-20T08:13:25.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.873+0000 7fe692a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe68c147f20 0x7fe68c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.873+0000 7fe692a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe68c151f60 0x7fe68c070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe692a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0c1670 con 0x7fe68c0c1b00 2024-01-20T08:13:25.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe692a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c1524b0 con 0x7fe68c147f20 2024-01-20T08:13:25.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe692a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0c0d40 con 0x7fe68c151f60 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe68c147f20 0x7fe68c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe68c147f20 0x7fe68c0abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45618/0 (socket says 172.21.15.100:45618) 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 -- 172.21.15.100:0/3856922848 learned_addr learned my addr 172.21.15.100:0/3856922848 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe690a00640 1 --1- 172.21.15.100:0/3856922848 >> v1:172.21.15.100:6789/0 conn(0x7fe68c0c1b00 0x7fe68c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35440/0 (socket says 172.21.15.100:35440) 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68b400640 1 --2- 172.21.15.100:0/3856922848 >> v2:172.21.15.110:3300/0 conn(0x7fe68c151f60 0x7fe68c070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 -- 172.21.15.100:0/3856922848 >> v2:172.21.15.110:3300/0 conn(0x7fe68c151f60 msgr2=0x7fe68c070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 --2- 172.21.15.100:0/3856922848 >> v2:172.21.15.110:3300/0 conn(0x7fe68c151f60 0x7fe68c070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 -- 172.21.15.100:0/3856922848 >> v1:172.21.15.100:6789/0 conn(0x7fe68c0c1b00 legacy=0x7fe68c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.874+0000 7fe68be00640 1 -- 172.21.15.100:0/3856922848 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0c1020 con 0x7fe68c147f20 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.875+0000 7fe68be00640 1 --2- 172.21.15.100:0/3856922848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c147f20 0x7fe68c0abfd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe68c06e550 tx=0x7fe67c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce24da16724d6ef server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe68aa00640 1 -- 172.21.15.100:0/3856922848 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c030860 con 0x7fe68c147f20 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe68aa00640 1 -- 172.21.15.100:0/3856922848 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c0309c0 con 0x7fe68c147f20 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe68aa00640 1 -- 172.21.15.100:0/3856922848 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c030d50 con 0x7fe68c147f20 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 -- 172.21.15.100:0/3856922848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c147f20 msgr2=0x7fe68c0abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 --2- 172.21.15.100:0/3856922848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c147f20 0x7fe68c0abfd0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fe68c06e550 tx=0x7fe67c02b9a0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 -- 172.21.15.100:0/3856922848 shutdown_connections 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 --2- 172.21.15.100:0/3856922848 >> v2:172.21.15.110:3300/0 conn(0x7fe68c151f60 0x7fe68c070370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 --2- 172.21.15.100:0/3856922848 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c147f20 0x7fe68c0abfd0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.876+0000 7fe692a00640 1 -- 172.21.15.100:0/3856922848 >> 172.21.15.100:0/3856922848 conn(0x7fe68c06a5e0 msgr2=0x7fe68c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.877+0000 7fe692a00640 1 -- 172.21.15.100:0/3856922848 shutdown_connections 2024-01-20T08:13:25.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.877+0000 7fe692a00640 1 -- 172.21.15.100:0/3856922848 wait complete. 2024-01-20T08:13:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.878+0000 7fe692a00640 1 Processor -- start 2024-01-20T08:13:25.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.878+0000 7fe692a00640 1 -- start start 2024-01-20T08:13:25.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe68c147f20 0x7fe68c143ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe68c151f60 0x7fe68c1ed630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c1eb320 con 0x7fe68c0c1b00 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c144530 con 0x7fe68c151f60 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.879+0000 7fe692a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c1e18a0 con 0x7fe68c147f20 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45634/0 (socket says 172.21.15.100:45634) 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 -- 172.21.15.100:0/1430118153 learned_addr learned my addr 172.21.15.100:0/1430118153 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 -- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe68c147f20 msgr2=0x7fe68c143ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe68c147f20 0x7fe68c143ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 -- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe68c151f60 msgr2=0x7fe68c1ed630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe68c151f60 0x7fe68c1ed630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 -- 172.21.15.100:0/1430118153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c0094d0 con 0x7fe68c0c1b00 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.880+0000 7fe68be00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000c00 tx=0x7fe67c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.881+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c039d60 con 0x7fe68c0c1b00 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.881+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c044480 con 0x7fe68c0c1b00 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.881+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c044830 con 0x7fe68c0c1b00 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.881+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c0c64b0 con 0x7fe68c0c1b00 2024-01-20T08:13:25.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.881+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c1eb570 con 0x7fe68c0c1b00 2024-01-20T08:13:25.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.882+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c04e970 con 0x7fe68c0c1b00 2024-01-20T08:13:25.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.883+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe67c04d3b0 con 0x7fe68c0c1b00 2024-01-20T08:13:25.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.884+0000 7fe683e00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 0x7fe66406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.884+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe67c03e070 con 0x7fe68c0c1b00 2024-01-20T08:13:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.884+0000 7fe68b400640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 0x7fe66406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:25.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.885+0000 7fe68b400640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 0x7fe66406d3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe674006fd0 tx=0x7fe674008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:25.890 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:25.888+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe67c077270 con 0x7fe68c0c1b00 2024-01-20T08:13:26.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.079+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe68c148300 con 0x7fe66406af00 2024-01-20T08:13:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.101+0000 7fe683e00640 1 -- 172.21.15.100:0/1430118153 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281510 (secure 0 0 0) 0x7fe6740090c0 con 0x7fe66406af00 2024-01-20T08:13:26.107 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:26.109 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.107+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 msgr2=0x7fe66406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.107+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 0x7fe66406d3c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe674006fd0 tx=0x7fe674008040 comp rx=0 tx=0).stop 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.107+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 msgr2=0x7fe68c143ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.107+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe67c000c00 tx=0x7fe67c004730 comp rx=0 tx=0).stop 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 shutdown_connections 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe68c151f60 0x7fe68c1ed630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe66406af00 0x7fe66406d3c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe68c147f20 0x7fe68c143ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 --2- 172.21.15.100:0/1430118153 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe68c0c1b00 0x7fe68c143ab0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 >> 172.21.15.100:0/1430118153 conn(0x7fe68c06a5e0 msgr2=0x7fe68c145a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 shutdown_connections 2024-01-20T08:13:26.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.108+0000 7fe692a00640 1 -- 172.21.15.100:0/1430118153 wait complete. 2024-01-20T08:13:26.129 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-01-20T08:13:25.949116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253176,"kb_used_data":7868,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721544,"statfs":{"total":773094113280,"available":772834861056,"internally_reserved":0,"allocated":8056832,"data_stored":4161621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001814"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163013+0000","last_change":"2024-01-20T08:13:20.163013+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163013+0000","last_undegraded":"2024-01-20T08:13:20.163013+0000","last_fullsized":"2024-01-20T08:13:20.163013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164454+0000","last_change":"2024-01-20T08:13:20.164454+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164454+0000","last_undegraded":"2024-01-20T08:13:20.164454+0000","last_fullsized":"2024-01-20T08:13:20.164454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166455+0000","last_change":"2024-01-20T08:13:20.166455+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166455+0000","last_undegraded":"2024-01-20T08:13:20.166455+0000","last_fullsized":"2024-01-20T08:13:20.166455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163534+0000","last_change":"2024-01-20T08:13:20.163534+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163534+0000","last_undegraded":"2024-01-20T08:13:20.163534+0000","last_fullsized":"2024-01-20T08:13:20.163534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147178+0000","last_change":"2024-01-20T08:13:20.147178+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147178+0000","last_undegraded":"2024-01-20T08:13:20.147178+0000","last_fullsized":"2024-01-20T08:13:20.147178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166749+0000","last_change":"2024-01-20T08:13:20.166749+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166749+0000","last_undegraded":"2024-01-20T08:13:20.166749+0000","last_fullsized":"2024-01-20T08:13:20.166749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157286+0000","last_change":"2024-01-20T08:13:20.157286+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157286+0000","last_undegraded":"2024-01-20T08:13:20.157286+0000","last_fullsized":"2024-01-20T08:13:20.157286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164043+0000","last_change":"2024-01-20T08:13:20.164043+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164043+0000","last_undegraded":"2024-01-20T08:13:20.164043+0000","last_fullsized":"2024-01-20T08:13:20.164043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.168317+0000","last_change":"2024-01-20T08:13:20.168317+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.168317+0000","last_undegraded":"2024-01-20T08:13:20.168317+0000","last_fullsized":"2024-01-20T08:13:20.168317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.156070+0000","last_change":"2024-01-20T08:13:20.156070+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.156070+0000","last_undegraded":"2024-01-20T08:13:20.156070+0000","last_fullsized":"2024-01-20T08:13:20.156070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161431+0000","last_change":"2024-01-20T08:13:20.161431+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161431+0000","last_undegraded":"2024-01-20T08:13:20.161431+0000","last_fullsized":"2024-01-20T08:13:20.161431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164840+0000","last_change":"2024-01-20T08:13:20.164840+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164840+0000","last_undegraded":"2024-01-20T08:13:20.164840+0000","last_fullsized":"2024-01-20T08:13:20.164840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164216+0000","last_change":"2024-01-20T08:13:20.164216+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164216+0000","last_undegraded":"2024-01-20T08:13:20.164216+0000","last_fullsized":"2024-01-20T08:13:20.164216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162720+0000","last_change":"2024-01-20T08:13:20.162720+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162720+0000","last_undegraded":"2024-01-20T08:13:20.162720+0000","last_fullsized":"2024-01-20T08:13:20.162720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145088+0000","last_change":"2024-01-20T08:13:20.145088+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145088+0000","last_undegraded":"2024-01-20T08:13:20.145088+0000","last_fullsized":"2024-01-20T08:13:20.145088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145298+0000","last_change":"2024-01-20T08:13:20.145298+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145298+0000","last_undegraded":"2024-01-20T08:13:20.145298+0000","last_fullsized":"2024-01-20T08:13:20.145298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145913+0000","last_change":"2024-01-20T08:13:20.145913+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145913+0000","last_undegraded":"2024-01-20T08:13:20.145913+0000","last_fullsized":"2024-01-20T08:13:20.145913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165563+0000","last_change":"2024-01-20T08:13:20.165563+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165563+0000","last_undegraded":"2024-01-20T08:13:20.165563+0000","last_fullsized":"2024-01-20T08:13:20.165563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160092+0000","last_change":"2024-01-20T08:13:20.160092+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160092+0000","last_undegraded":"2024-01-20T08:13:20.160092+0000","last_fullsized":"2024-01-20T08:13:20.160092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162470+0000","last_change":"2024-01-20T08:13:20.162470+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162470+0000","last_undegraded":"2024-01-20T08:13:20.162470+0000","last_fullsized":"2024-01-20T08:13:20.162470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163726+0000","last_change":"2024-01-20T08:13:20.163726+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163726+0000","last_undegraded":"2024-01-20T08:13:20.163726+0000","last_fullsized":"2024-01-20T08:13:20.163726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162635+0000","last_change":"2024-01-20T08:13:20.162635+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162635+0000","last_undegraded":"2024-01-20T08:13:20.162635+0000","last_fullsized":"2024-01-20T08:13:20.162635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157075+0000","last_change":"2024-01-20T08:13:20.157075+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157075+0000","last_undegraded":"2024-01-20T08:13:20.157075+0000","last_fullsized":"2024-01-20T08:13:20.157075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167863+0000","last_change":"2024-01-20T08:13:20.167863+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167863+0000","last_undegraded":"2024-01-20T08:13:20.167863+0000","last_fullsized":"2024-01-20T08:13:20.167863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165389+0000","last_change":"2024-01-20T08:13:20.165389+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165389+0000","last_undegraded":"2024-01-20T08:13:20.165389+0000","last_fullsized":"2024-01-20T08:13:20.165389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163718+0000","last_change":"2024-01-20T08:13:20.163718+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163718+0000","last_undegraded":"2024-01-20T08:13:20.163718+0000","last_fullsized":"2024-01-20T08:13:20.163718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.149560+0000","last_change":"2024-01-20T08:13:20.149560+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.149560+0000","last_undegraded":"2024-01-20T08:13:20.149560+0000","last_fullsized":"2024-01-20T08:13:20.149560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160489+0000","last_change":"2024-01-20T08:13:20.160489+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160489+0000","last_undegraded":"2024-01-20T08:13:20.160489+0000","last_fullsized":"2024-01-20T08:13:20.160489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165517+0000","last_change":"2024-01-20T08:13:20.165517+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165517+0000","last_undegraded":"2024-01-20T08:13:20.165517+0000","last_fullsized":"2024-01-20T08:13:20.165517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162175+0000","last_change":"2024-01-20T08:13:20.162175+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162175+0000","last_undegraded":"2024-01-20T08:13:20.162175+0000","last_fullsized":"2024-01-20T08:13:20.162175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145247+0000","last_change":"2024-01-20T08:13:20.145247+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145247+0000","last_undegraded":"2024-01-20T08:13:20.145247+0000","last_fullsized":"2024-01-20T08:13:20.145247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158879+0000","last_change":"2024-01-20T08:13:20.158879+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158879+0000","last_undegraded":"2024-01-20T08:13:20.158879+0000","last_fullsized":"2024-01-20T08:13:20.158879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147903+0000","last_change":"2024-01-20T08:13:20.147903+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147903+0000","last_undegraded":"2024-01-20T08:13:20.147903+0000","last_fullsized":"2024-01-20T08:13:20.147903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178515+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:20.178515+0000","last_peered":"2024-01-20T08:13:20.178515+0000","last_clean":"2024-01-20T08:13:20.178515+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:20.178515+0000","last_undegraded":"2024-01-20T08:13:20.178515+0000","last_fullsized":"2024-01-20T08:13:20.178515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:39.161170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162264+0000","last_change":"2024-01-20T08:13:20.162264+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162264+0000","last_undegraded":"2024-01-20T08:13:20.162264+0000","last_fullsized":"2024-01-20T08:13:20.162264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166688+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:20.166688+0000","last_peered":"2024-01-20T08:13:20.166688+0000","last_clean":"2024-01-20T08:13:20.166688+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:20.166688+0000","last_undegraded":"2024-01-20T08:13:20.166688+0000","last_fullsized":"2024-01-20T08:13:20.166688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158859+0000","last_change":"2024-01-20T08:13:20.158859+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158859+0000","last_undegraded":"2024-01-20T08:13:20.158859+0000","last_fullsized":"2024-01-20T08:13:20.158859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179122+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:20.179122+0000","last_peered":"2024-01-20T08:13:20.179122+0000","last_clean":"2024-01-20T08:13:20.179122+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:20.179122+0000","last_undegraded":"2024-01-20T08:13:20.179122+0000","last_fullsized":"2024-01-20T08:13:20.179122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161850+0000","last_change":"2024-01-20T08:13:20.161850+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161850+0000","last_undegraded":"2024-01-20T08:13:20.161850+0000","last_fullsized":"2024-01-20T08:13:20.161850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180941+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:20.180941+0000","last_peered":"2024-01-20T08:13:20.180941+0000","last_clean":"2024-01-20T08:13:20.180941+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:20.180941+0000","last_undegraded":"2024-01-20T08:13:20.180941+0000","last_fullsized":"2024-01-20T08:13:20.180941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:14:23.230628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160827+0000","last_change":"2024-01-20T08:13:20.160827+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160827+0000","last_undegraded":"2024-01-20T08:13:20.160827+0000","last_fullsized":"2024-01-20T08:13:20.160827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166254+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:20.166254+0000","last_peered":"2024-01-20T08:13:20.166254+0000","last_clean":"2024-01-20T08:13:20.166254+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:20.166254+0000","last_undegraded":"2024-01-20T08:13:20.166254+0000","last_fullsized":"2024-01-20T08:13:20.166254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145198+0000","last_change":"2024-01-20T08:13:20.145198+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145198+0000","last_undegraded":"2024-01-20T08:13:20.145198+0000","last_fullsized":"2024-01-20T08:13:20.145198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.171982+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:20.171982+0000","last_peered":"2024-01-20T08:13:20.171982+0000","last_clean":"2024-01-20T08:13:20.171982+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:20.171982+0000","last_undegraded":"2024-01-20T08:13:20.171982+0000","last_fullsized":"2024-01-20T08:13:20.171982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:03.339169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.170159+0000","last_change":"2024-01-20T08:13:20.170159+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.170159+0000","last_undegraded":"2024-01-20T08:13:20.170159+0000","last_fullsized":"2024-01-20T08:13:20.170159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180925+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:20.180925+0000","last_peered":"2024-01-20T08:13:20.180925+0000","last_clean":"2024-01-20T08:13:20.180925+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:20.180925+0000","last_undegraded":"2024-01-20T08:13:20.180925+0000","last_fullsized":"2024-01-20T08:13:20.180925+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.144599+0000","last_change":"2024-01-20T08:13:20.144599+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.144599+0000","last_undegraded":"2024-01-20T08:13:20.144599+0000","last_fullsized":"2024-01-20T08:13:20.144599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174890+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:20.174890+0000","last_peered":"2024-01-20T08:13:20.174890+0000","last_clean":"2024-01-20T08:13:20.174890+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:20.174890+0000","last_undegraded":"2024-01-20T08:13:20.174890+0000","last_fullsized":"2024-01-20T08:13:20.174890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:27:41.805984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145120+0000","last_change":"2024-01-20T08:13:20.145120+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145120+0000","last_undegraded":"2024-01-20T08:13:20.145120+0000","last_fullsized":"2024-01-20T08:13:20.145120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174876+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:20.174876+0000","last_peered":"2024-01-20T08:13:20.174876+0000","last_clean":"2024-01-20T08:13:20.174876+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:20.174876+0000","last_undegraded":"2024-01-20T08:13:20.174876+0000","last_fullsized":"2024-01-20T08:13:20.174876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:56.828582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167845+0000","last_change":"2024-01-20T08:13:20.167845+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167845+0000","last_undegraded":"2024-01-20T08:13:20.167845+0000","last_fullsized":"2024-01-20T08:13:20.167845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178117+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:20.178117+0000","last_peered":"2024-01-20T08:13:20.178117+0000","last_clean":"2024-01-20T08:13:20.178117+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:20.178117+0000","last_undegraded":"2024-01-20T08:13:20.178117+0000","last_fullsized":"2024-01-20T08:13:20.178117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:47:08.271391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164901+0000","last_change":"2024-01-20T08:13:20.164901+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164901+0000","last_undegraded":"2024-01-20T08:13:20.164901+0000","last_fullsized":"2024-01-20T08:13:20.164901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178197+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:20.178197+0000","last_peered":"2024-01-20T08:13:20.178197+0000","last_clean":"2024-01-20T08:13:20.178197+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:20.178197+0000","last_undegraded":"2024-01-20T08:13:20.178197+0000","last_fullsized":"2024-01-20T08:13:20.178197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:28:24.138553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.148437+0000","last_change":"2024-01-20T08:13:20.148437+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.148437+0000","last_undegraded":"2024-01-20T08:13:20.148437+0000","last_fullsized":"2024-01-20T08:13:20.148437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178061+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:20.178061+0000","last_peered":"2024-01-20T08:13:20.178061+0000","last_clean":"2024-01-20T08:13:20.178061+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:20.178061+0000","last_undegraded":"2024-01-20T08:13:20.178061+0000","last_fullsized":"2024-01-20T08:13:20.178061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160826+0000","last_change":"2024-01-20T08:13:20.160826+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160826+0000","last_undegraded":"2024-01-20T08:13:20.160826+0000","last_fullsized":"2024-01-20T08:13:20.160826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180445+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:20.180445+0000","last_peered":"2024-01-20T08:13:20.180445+0000","last_clean":"2024-01-20T08:13:20.180445+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:20.180445+0000","last_undegraded":"2024-01-20T08:13:20.180445+0000","last_fullsized":"2024-01-20T08:13:20.180445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:37:21.337273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161515+0000","last_change":"2024-01-20T08:13:20.161515+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161515+0000","last_undegraded":"2024-01-20T08:13:20.161515+0000","last_fullsized":"2024-01-20T08:13:20.161515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.161327+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:20.161327+0000","last_peered":"2024-01-20T08:13:20.161327+0000","last_clean":"2024-01-20T08:13:20.161327+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:20.161327+0000","last_undegraded":"2024-01-20T08:13:20.161327+0000","last_fullsized":"2024-01-20T08:13:20.161327+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:23.036421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161479+0000","last_change":"2024-01-20T08:13:20.161479+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161479+0000","last_undegraded":"2024-01-20T08:13:20.161479+0000","last_fullsized":"2024-01-20T08:13:20.161479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179765+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:20.179765+0000","last_peered":"2024-01-20T08:13:20.179765+0000","last_clean":"2024-01-20T08:13:20.179765+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:20.179765+0000","last_undegraded":"2024-01-20T08:13:20.179765+0000","last_fullsized":"2024-01-20T08:13:20.179765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162721+0000","last_change":"2024-01-20T08:13:20.162721+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162721+0000","last_undegraded":"2024-01-20T08:13:20.162721+0000","last_fullsized":"2024-01-20T08:13:20.162721+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.181105+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:20.181105+0000","last_peered":"2024-01-20T08:13:20.181105+0000","last_clean":"2024-01-20T08:13:20.181105+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:20.181105+0000","last_undegraded":"2024-01-20T08:13:20.181105+0000","last_fullsized":"2024-01-20T08:13:20.181105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:06.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163269+0000","last_change":"2024-01-20T08:13:20.163269+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163269+0000","last_undegraded":"2024-01-20T08:13:20.163269+0000","last_fullsized":"2024-01-20T08:13:20.163269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178539+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:20.178539+0000","last_peered":"2024-01-20T08:13:20.178539+0000","last_clean":"2024-01-20T08:13:20.178539+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:20.178539+0000","last_undegraded":"2024-01-20T08:13:20.178539+0000","last_fullsized":"2024-01-20T08:13:20.178539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.159358+0000","last_change":"2024-01-20T08:13:20.159358+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.159358+0000","last_undegraded":"2024-01-20T08:13:20.159358+0000","last_fullsized":"2024-01-20T08:13:20.159358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178499+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:20.178499+0000","last_peered":"2024-01-20T08:13:20.178499+0000","last_clean":"2024-01-20T08:13:20.178499+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:20.178499+0000","last_undegraded":"2024-01-20T08:13:20.178499+0000","last_fullsized":"2024-01-20T08:13:20.178499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:37.645450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147364+0000","last_change":"2024-01-20T08:13:20.147364+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147364+0000","last_undegraded":"2024-01-20T08:13:20.147364+0000","last_fullsized":"2024-01-20T08:13:20.147364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180960+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:20.180960+0000","last_peered":"2024-01-20T08:13:20.180960+0000","last_clean":"2024-01-20T08:13:20.180960+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:20.180960+0000","last_undegraded":"2024-01-20T08:13:20.180960+0000","last_fullsized":"2024-01-20T08:13:20.180960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:14:53.410256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162258+0000","last_change":"2024-01-20T08:13:20.162258+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162258+0000","last_undegraded":"2024-01-20T08:13:20.162258+0000","last_fullsized":"2024-01-20T08:13:20.162258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175578+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:20.175578+0000","last_peered":"2024-01-20T08:13:20.175578+0000","last_clean":"2024-01-20T08:13:20.175578+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:20.175578+0000","last_undegraded":"2024-01-20T08:13:20.175578+0000","last_fullsized":"2024-01-20T08:13:20.175578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:18.533547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161124+0000","last_change":"2024-01-20T08:13:20.161124+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161124+0000","last_undegraded":"2024-01-20T08:13:20.161124+0000","last_fullsized":"2024-01-20T08:13:20.161124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183543+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:20.183543+0000","last_peered":"2024-01-20T08:13:20.183543+0000","last_clean":"2024-01-20T08:13:20.183543+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:20.183543+0000","last_undegraded":"2024-01-20T08:13:20.183543+0000","last_fullsized":"2024-01-20T08:13:20.183543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.693914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157106+0000","last_change":"2024-01-20T08:13:20.157106+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157106+0000","last_undegraded":"2024-01-20T08:13:20.157106+0000","last_fullsized":"2024-01-20T08:13:20.157106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183823+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:20.183823+0000","last_peered":"2024-01-20T08:13:20.183823+0000","last_clean":"2024-01-20T08:13:20.183823+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:20.183823+0000","last_undegraded":"2024-01-20T08:13:20.183823+0000","last_fullsized":"2024-01-20T08:13:20.183823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:26.608715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165602+0000","last_change":"2024-01-20T08:13:20.165602+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165602+0000","last_undegraded":"2024-01-20T08:13:20.165602+0000","last_fullsized":"2024-01-20T08:13:20.165602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172822+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:20.172822+0000","last_peered":"2024-01-20T08:13:20.172822+0000","last_clean":"2024-01-20T08:13:20.172822+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:20.172822+0000","last_undegraded":"2024-01-20T08:13:20.172822+0000","last_fullsized":"2024-01-20T08:13:20.172822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:46.201221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.146620+0000","last_change":"2024-01-20T08:13:20.146620+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.146620+0000","last_undegraded":"2024-01-20T08:13:20.146620+0000","last_fullsized":"2024-01-20T08:13:20.146620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183413+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:20.183413+0000","last_peered":"2024-01-20T08:13:20.183413+0000","last_clean":"2024-01-20T08:13:20.183413+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:20.183413+0000","last_undegraded":"2024-01-20T08:13:20.183413+0000","last_fullsized":"2024-01-20T08:13:20.183413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:34:57.243103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166532+0000","last_change":"2024-01-20T08:13:20.166532+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166532+0000","last_undegraded":"2024-01-20T08:13:20.166532+0000","last_fullsized":"2024-01-20T08:13:20.166532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183288+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:20.183288+0000","last_peered":"2024-01-20T08:13:20.183288+0000","last_clean":"2024-01-20T08:13:20.183288+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:20.183288+0000","last_undegraded":"2024-01-20T08:13:20.183288+0000","last_fullsized":"2024-01-20T08:13:20.183288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:04.702644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157513+0000","last_change":"2024-01-20T08:13:20.157513+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157513+0000","last_undegraded":"2024-01-20T08:13:20.157513+0000","last_fullsized":"2024-01-20T08:13:20.157513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178220+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:20.178220+0000","last_peered":"2024-01-20T08:13:20.178220+0000","last_clean":"2024-01-20T08:13:20.178220+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:20.178220+0000","last_undegraded":"2024-01-20T08:13:20.178220+0000","last_fullsized":"2024-01-20T08:13:20.178220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145432+0000","last_change":"2024-01-20T08:13:20.145432+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145432+0000","last_undegraded":"2024-01-20T08:13:20.145432+0000","last_fullsized":"2024-01-20T08:13:20.145432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175835+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:20.175835+0000","last_peered":"2024-01-20T08:13:20.175835+0000","last_clean":"2024-01-20T08:13:20.175835+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:20.175835+0000","last_undegraded":"2024-01-20T08:13:20.175835+0000","last_fullsized":"2024-01-20T08:13:20.175835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:22.763565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166278+0000","last_change":"2024-01-20T08:13:20.166278+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166278+0000","last_undegraded":"2024-01-20T08:13:20.166278+0000","last_fullsized":"2024-01-20T08:13:20.166278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183538+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:20.183538+0000","last_peered":"2024-01-20T08:13:20.183538+0000","last_clean":"2024-01-20T08:13:20.183538+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:20.183538+0000","last_undegraded":"2024-01-20T08:13:20.183538+0000","last_fullsized":"2024-01-20T08:13:20.183538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:08.839046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158478+0000","last_change":"2024-01-20T08:13:20.158478+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158478+0000","last_undegraded":"2024-01-20T08:13:20.158478+0000","last_fullsized":"2024-01-20T08:13:20.158478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172003+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:20.172003+0000","last_peered":"2024-01-20T08:13:20.172003+0000","last_clean":"2024-01-20T08:13:20.172003+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:20.172003+0000","last_undegraded":"2024-01-20T08:13:20.172003+0000","last_fullsized":"2024-01-20T08:13:20.172003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162181+0000","last_change":"2024-01-20T08:13:20.162181+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162181+0000","last_undegraded":"2024-01-20T08:13:20.162181+0000","last_fullsized":"2024-01-20T08:13:20.162181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.170394+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:20.170394+0000","last_peered":"2024-01-20T08:13:20.170394+0000","last_clean":"2024-01-20T08:13:20.170394+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:20.170394+0000","last_undegraded":"2024-01-20T08:13:20.170394+0000","last_fullsized":"2024-01-20T08:13:20.170394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:48.765547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.155566+0000","last_change":"2024-01-20T08:13:20.155566+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.155566+0000","last_undegraded":"2024-01-20T08:13:20.155566+0000","last_fullsized":"2024-01-20T08:13:20.155566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.176544+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:20.176544+0000","last_peered":"2024-01-20T08:13:20.176544+0000","last_clean":"2024-01-20T08:13:20.176544+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:20.176544+0000","last_undegraded":"2024-01-20T08:13:20.176544+0000","last_fullsized":"2024-01-20T08:13:20.176544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161594+0000","last_change":"2024-01-20T08:13:20.161594+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161594+0000","last_undegraded":"2024-01-20T08:13:20.161594+0000","last_fullsized":"2024-01-20T08:13:20.161594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179462+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:20.179462+0000","last_peered":"2024-01-20T08:13:20.179462+0000","last_clean":"2024-01-20T08:13:20.179462+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:20.179462+0000","last_undegraded":"2024-01-20T08:13:20.179462+0000","last_fullsized":"2024-01-20T08:13:20.179462+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-20T08:13:19.145639+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:19.145639+0000","last_peered":"2024-01-20T08:13:19.145639+0000","last_clean":"2024-01-20T08:13:19.145639+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:19.145639+0000","last_undegraded":"2024-01-20T08:13:19.145639+0000","last_fullsized":"2024-01-20T08:13:19.145639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.752},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.3500000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.27},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.5980000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.399}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.571},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.4530000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4870000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4279999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3320000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.373},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.619}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.5349999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.38},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.628},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.351}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.6819999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.024},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.179}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.129}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.593}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.268},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5309999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.736},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.825}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.653},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.86099999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":1.028},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.331}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":1.353},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":1.5129999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.395},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.2470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.371},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":367120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.371}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.6499999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.597},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.113}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:26.134 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:26.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.381+0000 7f018e600640 1 Processor -- start 2024-01-20T08:13:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.382+0000 7f018e600640 1 -- start start 2024-01-20T08:13:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f018e600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f018806b3b0 0x7f0188155250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f018e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0188155790 con 0x7f01881519a0 2024-01-20T08:13:26.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f018e600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01880c8650 con 0x7f01880c8ae0 2024-01-20T08:13:26.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f018e600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01880c8070 con 0x7f018806b3b0 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f0187e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f01881519a0 0x7f018815f150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35454/0 (socket says 172.21.15.100:35454) 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f0187e00640 1 -- 172.21.15.100:0/1446496516 learned_addr learned my addr 172.21.15.100:0/1446496516 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.383+0000 7f0187400640 1 --2- 172.21.15.100:0/1446496516 >> v2:172.21.15.110:3300/0 conn(0x7f018806b3b0 0x7f0188155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2313099960 0 0) 0x7f0180001490 con 0x7f01881519a0 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0168003520 con 0x7f01881519a0 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1986073394 0 0) 0x7f0168003520 con 0x7f01881519a0 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 >> v2:172.21.15.110:3300/0 conn(0x7f018806b3b0 msgr2=0x7f0188155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:26.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 --2- 172.21.15.100:0/1446496516 >> v2:172.21.15.110:3300/0 conn(0x7f018806b3b0 0x7f0188155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 >> v1:172.21.15.110:6789/0 conn(0x7f01880c8ae0 legacy=0x7f0188155cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880c4dd0 con 0x7f01881519a0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f0180001b80 con 0x7f01881519a0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 >> v1:172.21.15.100:6789/0 conn(0x7f01881519a0 legacy=0x7f018815f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 0x7f0168003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01680047c0 0x7f0168004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680051d0 0x7f016800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880c8070 con 0x7f01680039c0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c120 con 0x7f01680051d0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016800c2e0 con 0x7f01680047c0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.384+0000 7f0187400640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 0x7f0168003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187400640 1 -- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01680047c0 msgr2=0x7f0168004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0186a00640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01680047c0 0x7f0168004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187400640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f01680047c0 0x7f0168004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187400640 1 -- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680051d0 msgr2=0x7f016800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187400640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680051d0 0x7f016800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187400640 1 -- 172.21.15.100:0/1446496516 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0168003520 con 0x7f01680039c0 2024-01-20T08:13:26.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.385+0000 7f0187e00640 1 -- 172.21.15.100:0/1446496516 reap_dead start 2024-01-20T08:13:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.386+0000 7f0187400640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 0x7f0168003de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0170009a90 tx=0x7f01680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525cb825c10a0811 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.386+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017002c680 con 0x7f01680039c0 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.386+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017002c7e0 con 0x7f01680039c0 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.386+0000 7f0186000640 1 -- 172.21.15.100:0/1446496516 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017002cb70 con 0x7f01680039c0 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 -- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 msgr2=0x7f0168003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 0x7f0168003de0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f0170009a90 tx=0x7f01680057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 -- 172.21.15.100:0/1446496516 shutdown_connections 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 --2- 172.21.15.100:0/1446496516 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01680039c0 0x7f0168003de0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 -- 172.21.15.100:0/1446496516 >> 172.21.15.100:0/1446496516 conn(0x7f01880abc00 msgr2=0x7f01880ac010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 -- 172.21.15.100:0/1446496516 shutdown_connections 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.387+0000 7f018e600640 1 -- 172.21.15.100:0/1446496516 wait complete. 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.388+0000 7f018e600640 1 Processor -- start 2024-01-20T08:13:26.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 -- start start 2024-01-20T08:13:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680039c0 0x7f01880aae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f018814c8e0 0x7f0188148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018814d570 con 0x7f01880c6e70 2024-01-20T08:13:26.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01880c63f0 con 0x7f01680039c0 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.389+0000 7f018e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018814e510 con 0x7f018814c8e0 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45656/0 (socket says 172.21.15.100:45656) 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 -- 172.21.15.100:0/3157058266 learned_addr learned my addr 172.21.15.100:0/3157058266 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 -- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f018814c8e0 msgr2=0x7f0188148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f018814c8e0 0x7f0188148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 -- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680039c0 msgr2=0x7f01880aae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680039c0 0x7f01880aae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 -- 172.21.15.100:0/3157058266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01880c5e30 con 0x7f01880c6e70 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.390+0000 7f0187e00640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f01880c85c0 tx=0x7f018000cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.391+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000ce50 con 0x7f01880c6e70 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.391+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018000a610 con 0x7f01880c6e70 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.391+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01880c6110 con 0x7f01880c6e70 2024-01-20T08:13:26.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.391+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018000a9c0 con 0x7f01880c6e70 2024-01-20T08:13:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.391+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018814d200 con 0x7f01880c6e70 2024-01-20T08:13:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.392+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01880cadc0 con 0x7f01880c6e70 2024-01-20T08:13:26.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.393+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f018000ab20 con 0x7f01880c6e70 2024-01-20T08:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.394+0000 7f017f400640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 0x7f016006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.394+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0180089180 con 0x7f01880c6e70 2024-01-20T08:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.394+0000 7f0187400640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 0x7f016006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.395+0000 7f0187400640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 0x7f016006d3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0170036000 tx=0x7f017002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.398+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f01800540e0 con 0x7f01880c6e70 2024-01-20T08:13:26.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.589+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f01880c98c0 con 0x7f016006af00 2024-01-20T08:13:26.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.598+0000 7f017f400640 1 -- 172.21.15.100:0/3157058266 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281510 (secure 0 0 0) 0x7f01880c98c0 con 0x7f016006af00 2024-01-20T08:13:26.604 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:26.606 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 msgr2=0x7f016006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 0x7f016006d3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f0170036000 tx=0x7f017002e000 comp rx=0 tx=0).stop 2024-01-20T08:13:26.607 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 msgr2=0x7f0188148c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f01880c85c0 tx=0x7f018000cc00 comp rx=0 tx=0).stop 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 shutdown_connections 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01880c6e70 0x7f0188148c50 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f016006af00 0x7f016006d3c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f018814c8e0 0x7f0188148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 --2- 172.21.15.100:0/3157058266 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f01680039c0 0x7f01880aae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 >> 172.21.15.100:0/3157058266 conn(0x7f01880abc00 msgr2=0x7f0188157420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 shutdown_connections 2024-01-20T08:13:26.608 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.605+0000 7f018e600640 1 -- 172.21.15.100:0/3157058266 wait complete. 2024-01-20T08:13:26.625 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-01-20T08:13:25.949116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253176,"kb_used_data":7868,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721544,"statfs":{"total":773094113280,"available":772834861056,"internally_reserved":0,"allocated":8056832,"data_stored":4161621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001814"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163013+0000","last_change":"2024-01-20T08:13:20.163013+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163013+0000","last_undegraded":"2024-01-20T08:13:20.163013+0000","last_fullsized":"2024-01-20T08:13:20.163013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164454+0000","last_change":"2024-01-20T08:13:20.164454+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164454+0000","last_undegraded":"2024-01-20T08:13:20.164454+0000","last_fullsized":"2024-01-20T08:13:20.164454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166455+0000","last_change":"2024-01-20T08:13:20.166455+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166455+0000","last_undegraded":"2024-01-20T08:13:20.166455+0000","last_fullsized":"2024-01-20T08:13:20.166455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163534+0000","last_change":"2024-01-20T08:13:20.163534+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163534+0000","last_undegraded":"2024-01-20T08:13:20.163534+0000","last_fullsized":"2024-01-20T08:13:20.163534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147178+0000","last_change":"2024-01-20T08:13:20.147178+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147178+0000","last_undegraded":"2024-01-20T08:13:20.147178+0000","last_fullsized":"2024-01-20T08:13:20.147178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166749+0000","last_change":"2024-01-20T08:13:20.166749+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166749+0000","last_undegraded":"2024-01-20T08:13:20.166749+0000","last_fullsized":"2024-01-20T08:13:20.166749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157286+0000","last_change":"2024-01-20T08:13:20.157286+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157286+0000","last_undegraded":"2024-01-20T08:13:20.157286+0000","last_fullsized":"2024-01-20T08:13:20.157286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164043+0000","last_change":"2024-01-20T08:13:20.164043+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164043+0000","last_undegraded":"2024-01-20T08:13:20.164043+0000","last_fullsized":"2024-01-20T08:13:20.164043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.168317+0000","last_change":"2024-01-20T08:13:20.168317+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.168317+0000","last_undegraded":"2024-01-20T08:13:20.168317+0000","last_fullsized":"2024-01-20T08:13:20.168317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.156070+0000","last_change":"2024-01-20T08:13:20.156070+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.156070+0000","last_undegraded":"2024-01-20T08:13:20.156070+0000","last_fullsized":"2024-01-20T08:13:20.156070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161431+0000","last_change":"2024-01-20T08:13:20.161431+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161431+0000","last_undegraded":"2024-01-20T08:13:20.161431+0000","last_fullsized":"2024-01-20T08:13:20.161431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164840+0000","last_change":"2024-01-20T08:13:20.164840+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164840+0000","last_undegraded":"2024-01-20T08:13:20.164840+0000","last_fullsized":"2024-01-20T08:13:20.164840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164216+0000","last_change":"2024-01-20T08:13:20.164216+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164216+0000","last_undegraded":"2024-01-20T08:13:20.164216+0000","last_fullsized":"2024-01-20T08:13:20.164216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162720+0000","last_change":"2024-01-20T08:13:20.162720+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162720+0000","last_undegraded":"2024-01-20T08:13:20.162720+0000","last_fullsized":"2024-01-20T08:13:20.162720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145088+0000","last_change":"2024-01-20T08:13:20.145088+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145088+0000","last_undegraded":"2024-01-20T08:13:20.145088+0000","last_fullsized":"2024-01-20T08:13:20.145088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145298+0000","last_change":"2024-01-20T08:13:20.145298+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145298+0000","last_undegraded":"2024-01-20T08:13:20.145298+0000","last_fullsized":"2024-01-20T08:13:20.145298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145913+0000","last_change":"2024-01-20T08:13:20.145913+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145913+0000","last_undegraded":"2024-01-20T08:13:20.145913+0000","last_fullsized":"2024-01-20T08:13:20.145913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165563+0000","last_change":"2024-01-20T08:13:20.165563+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165563+0000","last_undegraded":"2024-01-20T08:13:20.165563+0000","last_fullsized":"2024-01-20T08:13:20.165563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160092+0000","last_change":"2024-01-20T08:13:20.160092+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160092+0000","last_undegraded":"2024-01-20T08:13:20.160092+0000","last_fullsized":"2024-01-20T08:13:20.160092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162470+0000","last_change":"2024-01-20T08:13:20.162470+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162470+0000","last_undegraded":"2024-01-20T08:13:20.162470+0000","last_fullsized":"2024-01-20T08:13:20.162470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163726+0000","last_change":"2024-01-20T08:13:20.163726+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163726+0000","last_undegraded":"2024-01-20T08:13:20.163726+0000","last_fullsized":"2024-01-20T08:13:20.163726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162635+0000","last_change":"2024-01-20T08:13:20.162635+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162635+0000","last_undegraded":"2024-01-20T08:13:20.162635+0000","last_fullsized":"2024-01-20T08:13:20.162635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157075+0000","last_change":"2024-01-20T08:13:20.157075+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157075+0000","last_undegraded":"2024-01-20T08:13:20.157075+0000","last_fullsized":"2024-01-20T08:13:20.157075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167863+0000","last_change":"2024-01-20T08:13:20.167863+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167863+0000","last_undegraded":"2024-01-20T08:13:20.167863+0000","last_fullsized":"2024-01-20T08:13:20.167863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165389+0000","last_change":"2024-01-20T08:13:20.165389+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165389+0000","last_undegraded":"2024-01-20T08:13:20.165389+0000","last_fullsized":"2024-01-20T08:13:20.165389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163718+0000","last_change":"2024-01-20T08:13:20.163718+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163718+0000","last_undegraded":"2024-01-20T08:13:20.163718+0000","last_fullsized":"2024-01-20T08:13:20.163718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.149560+0000","last_change":"2024-01-20T08:13:20.149560+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.149560+0000","last_undegraded":"2024-01-20T08:13:20.149560+0000","last_fullsized":"2024-01-20T08:13:20.149560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160489+0000","last_change":"2024-01-20T08:13:20.160489+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160489+0000","last_undegraded":"2024-01-20T08:13:20.160489+0000","last_fullsized":"2024-01-20T08:13:20.160489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165517+0000","last_change":"2024-01-20T08:13:20.165517+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165517+0000","last_undegraded":"2024-01-20T08:13:20.165517+0000","last_fullsized":"2024-01-20T08:13:20.165517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162175+0000","last_change":"2024-01-20T08:13:20.162175+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162175+0000","last_undegraded":"2024-01-20T08:13:20.162175+0000","last_fullsized":"2024-01-20T08:13:20.162175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145247+0000","last_change":"2024-01-20T08:13:20.145247+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145247+0000","last_undegraded":"2024-01-20T08:13:20.145247+0000","last_fullsized":"2024-01-20T08:13:20.145247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158879+0000","last_change":"2024-01-20T08:13:20.158879+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158879+0000","last_undegraded":"2024-01-20T08:13:20.158879+0000","last_fullsized":"2024-01-20T08:13:20.158879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147903+0000","last_change":"2024-01-20T08:13:20.147903+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147903+0000","last_undegraded":"2024-01-20T08:13:20.147903+0000","last_fullsized":"2024-01-20T08:13:20.147903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178515+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:20.178515+0000","last_peered":"2024-01-20T08:13:20.178515+0000","last_clean":"2024-01-20T08:13:20.178515+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:20.178515+0000","last_undegraded":"2024-01-20T08:13:20.178515+0000","last_fullsized":"2024-01-20T08:13:20.178515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:39.161170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162264+0000","last_change":"2024-01-20T08:13:20.162264+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162264+0000","last_undegraded":"2024-01-20T08:13:20.162264+0000","last_fullsized":"2024-01-20T08:13:20.162264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166688+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:20.166688+0000","last_peered":"2024-01-20T08:13:20.166688+0000","last_clean":"2024-01-20T08:13:20.166688+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:20.166688+0000","last_undegraded":"2024-01-20T08:13:20.166688+0000","last_fullsized":"2024-01-20T08:13:20.166688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158859+0000","last_change":"2024-01-20T08:13:20.158859+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158859+0000","last_undegraded":"2024-01-20T08:13:20.158859+0000","last_fullsized":"2024-01-20T08:13:20.158859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179122+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:20.179122+0000","last_peered":"2024-01-20T08:13:20.179122+0000","last_clean":"2024-01-20T08:13:20.179122+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:20.179122+0000","last_undegraded":"2024-01-20T08:13:20.179122+0000","last_fullsized":"2024-01-20T08:13:20.179122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161850+0000","last_change":"2024-01-20T08:13:20.161850+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161850+0000","last_undegraded":"2024-01-20T08:13:20.161850+0000","last_fullsized":"2024-01-20T08:13:20.161850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180941+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:20.180941+0000","last_peered":"2024-01-20T08:13:20.180941+0000","last_clean":"2024-01-20T08:13:20.180941+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:20.180941+0000","last_undegraded":"2024-01-20T08:13:20.180941+0000","last_fullsized":"2024-01-20T08:13:20.180941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:14:23.230628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160827+0000","last_change":"2024-01-20T08:13:20.160827+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160827+0000","last_undegraded":"2024-01-20T08:13:20.160827+0000","last_fullsized":"2024-01-20T08:13:20.160827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166254+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:20.166254+0000","last_peered":"2024-01-20T08:13:20.166254+0000","last_clean":"2024-01-20T08:13:20.166254+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:20.166254+0000","last_undegraded":"2024-01-20T08:13:20.166254+0000","last_fullsized":"2024-01-20T08:13:20.166254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145198+0000","last_change":"2024-01-20T08:13:20.145198+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145198+0000","last_undegraded":"2024-01-20T08:13:20.145198+0000","last_fullsized":"2024-01-20T08:13:20.145198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.171982+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:20.171982+0000","last_peered":"2024-01-20T08:13:20.171982+0000","last_clean":"2024-01-20T08:13:20.171982+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:20.171982+0000","last_undegraded":"2024-01-20T08:13:20.171982+0000","last_fullsized":"2024-01-20T08:13:20.171982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:03.339169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.170159+0000","last_change":"2024-01-20T08:13:20.170159+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.170159+0000","last_undegraded":"2024-01-20T08:13:20.170159+0000","last_fullsized":"2024-01-20T08:13:20.170159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180925+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:20.180925+0000","last_peered":"2024-01-20T08:13:20.180925+0000","last_clean":"2024-01-20T08:13:20.180925+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:20.180925+0000","last_undegraded":"2024-01-20T08:13:20.180925+0000","last_fullsized":"2024-01-20T08:13:20.180925+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.144599+0000","last_change":"2024-01-20T08:13:20.144599+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.144599+0000","last_undegraded":"2024-01-20T08:13:20.144599+0000","last_fullsized":"2024-01-20T08:13:20.144599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174890+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:20.174890+0000","last_peered":"2024-01-20T08:13:20.174890+0000","last_clean":"2024-01-20T08:13:20.174890+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:20.174890+0000","last_undegraded":"2024-01-20T08:13:20.174890+0000","last_fullsized":"2024-01-20T08:13:20.174890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:27:41.805984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145120+0000","last_change":"2024-01-20T08:13:20.145120+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145120+0000","last_undegraded":"2024-01-20T08:13:20.145120+0000","last_fullsized":"2024-01-20T08:13:20.145120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174876+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:20.174876+0000","last_peered":"2024-01-20T08:13:20.174876+0000","last_clean":"2024-01-20T08:13:20.174876+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:20.174876+0000","last_undegraded":"2024-01-20T08:13:20.174876+0000","last_fullsized":"2024-01-20T08:13:20.174876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:56.828582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167845+0000","last_change":"2024-01-20T08:13:20.167845+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167845+0000","last_undegraded":"2024-01-20T08:13:20.167845+0000","last_fullsized":"2024-01-20T08:13:20.167845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178117+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:20.178117+0000","last_peered":"2024-01-20T08:13:20.178117+0000","last_clean":"2024-01-20T08:13:20.178117+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:20.178117+0000","last_undegraded":"2024-01-20T08:13:20.178117+0000","last_fullsized":"2024-01-20T08:13:20.178117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:47:08.271391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164901+0000","last_change":"2024-01-20T08:13:20.164901+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164901+0000","last_undegraded":"2024-01-20T08:13:20.164901+0000","last_fullsized":"2024-01-20T08:13:20.164901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178197+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:20.178197+0000","last_peered":"2024-01-20T08:13:20.178197+0000","last_clean":"2024-01-20T08:13:20.178197+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:20.178197+0000","last_undegraded":"2024-01-20T08:13:20.178197+0000","last_fullsized":"2024-01-20T08:13:20.178197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:28:24.138553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.148437+0000","last_change":"2024-01-20T08:13:20.148437+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.148437+0000","last_undegraded":"2024-01-20T08:13:20.148437+0000","last_fullsized":"2024-01-20T08:13:20.148437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178061+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:20.178061+0000","last_peered":"2024-01-20T08:13:20.178061+0000","last_clean":"2024-01-20T08:13:20.178061+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:20.178061+0000","last_undegraded":"2024-01-20T08:13:20.178061+0000","last_fullsized":"2024-01-20T08:13:20.178061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160826+0000","last_change":"2024-01-20T08:13:20.160826+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160826+0000","last_undegraded":"2024-01-20T08:13:20.160826+0000","last_fullsized":"2024-01-20T08:13:20.160826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180445+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:20.180445+0000","last_peered":"2024-01-20T08:13:20.180445+0000","last_clean":"2024-01-20T08:13:20.180445+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:20.180445+0000","last_undegraded":"2024-01-20T08:13:20.180445+0000","last_fullsized":"2024-01-20T08:13:20.180445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:37:21.337273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161515+0000","last_change":"2024-01-20T08:13:20.161515+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161515+0000","last_undegraded":"2024-01-20T08:13:20.161515+0000","last_fullsized":"2024-01-20T08:13:20.161515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.161327+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:20.161327+0000","last_peered":"2024-01-20T08:13:20.161327+0000","last_clean":"2024-01-20T08:13:20.161327+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:20.161327+0000","last_undegraded":"2024-01-20T08:13:20.161327+0000","last_fullsized":"2024-01-20T08:13:20.161327+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:23.036421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161479+0000","last_change":"2024-01-20T08:13:20.161479+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161479+0000","last_undegraded":"2024-01-20T08:13:20.161479+0000","last_fullsized":"2024-01-20T08:13:20.161479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179765+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:20.179765+0000","last_peered":"2024-01-20T08:13:20.179765+0000","last_clean":"2024-01-20T08:13:20.179765+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:20.179765+0000","last_undegraded":"2024-01-20T08:13:20.179765+0000","last_fullsized":"2024-01-20T08:13:20.179765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162721+0000","last_change":"2024-01-20T08:13:20.162721+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162721+0000","last_undegraded":"2024-01-20T08:13:20.162721+0000","last_fullsized":"2024-01-20T08:13:20.162721+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.181105+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:20.181105+0000","last_peered":"2024-01-20T08:13:20.181105+0000","last_clean":"2024-01-20T08:13:20.181105+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:20.181105+0000","last_undegraded":"2024-01-20T08:13:20.181105+0000","last_fullsized":"2024-01-20T08:13:20.181105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:06.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163269+0000","last_change":"2024-01-20T08:13:20.163269+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163269+0000","last_undegraded":"2024-01-20T08:13:20.163269+0000","last_fullsized":"2024-01-20T08:13:20.163269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178539+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:20.178539+0000","last_peered":"2024-01-20T08:13:20.178539+0000","last_clean":"2024-01-20T08:13:20.178539+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:20.178539+0000","last_undegraded":"2024-01-20T08:13:20.178539+0000","last_fullsized":"2024-01-20T08:13:20.178539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.159358+0000","last_change":"2024-01-20T08:13:20.159358+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.159358+0000","last_undegraded":"2024-01-20T08:13:20.159358+0000","last_fullsized":"2024-01-20T08:13:20.159358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178499+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:20.178499+0000","last_peered":"2024-01-20T08:13:20.178499+0000","last_clean":"2024-01-20T08:13:20.178499+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:20.178499+0000","last_undegraded":"2024-01-20T08:13:20.178499+0000","last_fullsized":"2024-01-20T08:13:20.178499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:37.645450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147364+0000","last_change":"2024-01-20T08:13:20.147364+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147364+0000","last_undegraded":"2024-01-20T08:13:20.147364+0000","last_fullsized":"2024-01-20T08:13:20.147364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180960+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:20.180960+0000","last_peered":"2024-01-20T08:13:20.180960+0000","last_clean":"2024-01-20T08:13:20.180960+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:20.180960+0000","last_undegraded":"2024-01-20T08:13:20.180960+0000","last_fullsized":"2024-01-20T08:13:20.180960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:14:53.410256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162258+0000","last_change":"2024-01-20T08:13:20.162258+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162258+0000","last_undegraded":"2024-01-20T08:13:20.162258+0000","last_fullsized":"2024-01-20T08:13:20.162258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175578+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:20.175578+0000","last_peered":"2024-01-20T08:13:20.175578+0000","last_clean":"2024-01-20T08:13:20.175578+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:20.175578+0000","last_undegraded":"2024-01-20T08:13:20.175578+0000","last_fullsized":"2024-01-20T08:13:20.175578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:18.533547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161124+0000","last_change":"2024-01-20T08:13:20.161124+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161124+0000","last_undegraded":"2024-01-20T08:13:20.161124+0000","last_fullsized":"2024-01-20T08:13:20.161124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183543+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:20.183543+0000","last_peered":"2024-01-20T08:13:20.183543+0000","last_clean":"2024-01-20T08:13:20.183543+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:20.183543+0000","last_undegraded":"2024-01-20T08:13:20.183543+0000","last_fullsized":"2024-01-20T08:13:20.183543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.693914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157106+0000","last_change":"2024-01-20T08:13:20.157106+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157106+0000","last_undegraded":"2024-01-20T08:13:20.157106+0000","last_fullsized":"2024-01-20T08:13:20.157106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183823+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:20.183823+0000","last_peered":"2024-01-20T08:13:20.183823+0000","last_clean":"2024-01-20T08:13:20.183823+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:20.183823+0000","last_undegraded":"2024-01-20T08:13:20.183823+0000","last_fullsized":"2024-01-20T08:13:20.183823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:26.608715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165602+0000","last_change":"2024-01-20T08:13:20.165602+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165602+0000","last_undegraded":"2024-01-20T08:13:20.165602+0000","last_fullsized":"2024-01-20T08:13:20.165602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172822+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:20.172822+0000","last_peered":"2024-01-20T08:13:20.172822+0000","last_clean":"2024-01-20T08:13:20.172822+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:20.172822+0000","last_undegraded":"2024-01-20T08:13:20.172822+0000","last_fullsized":"2024-01-20T08:13:20.172822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:46.201221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.146620+0000","last_change":"2024-01-20T08:13:20.146620+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.146620+0000","last_undegraded":"2024-01-20T08:13:20.146620+0000","last_fullsized":"2024-01-20T08:13:20.146620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183413+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:20.183413+0000","last_peered":"2024-01-20T08:13:20.183413+0000","last_clean":"2024-01-20T08:13:20.183413+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:20.183413+0000","last_undegraded":"2024-01-20T08:13:20.183413+0000","last_fullsized":"2024-01-20T08:13:20.183413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:34:57.243103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166532+0000","last_change":"2024-01-20T08:13:20.166532+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166532+0000","last_undegraded":"2024-01-20T08:13:20.166532+0000","last_fullsized":"2024-01-20T08:13:20.166532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183288+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:20.183288+0000","last_peered":"2024-01-20T08:13:20.183288+0000","last_clean":"2024-01-20T08:13:20.183288+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:20.183288+0000","last_undegraded":"2024-01-20T08:13:20.183288+0000","last_fullsized":"2024-01-20T08:13:20.183288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:04.702644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157513+0000","last_change":"2024-01-20T08:13:20.157513+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157513+0000","last_undegraded":"2024-01-20T08:13:20.157513+0000","last_fullsized":"2024-01-20T08:13:20.157513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178220+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:20.178220+0000","last_peered":"2024-01-20T08:13:20.178220+0000","last_clean":"2024-01-20T08:13:20.178220+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:20.178220+0000","last_undegraded":"2024-01-20T08:13:20.178220+0000","last_fullsized":"2024-01-20T08:13:20.178220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145432+0000","last_change":"2024-01-20T08:13:20.145432+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145432+0000","last_undegraded":"2024-01-20T08:13:20.145432+0000","last_fullsized":"2024-01-20T08:13:20.145432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175835+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:20.175835+0000","last_peered":"2024-01-20T08:13:20.175835+0000","last_clean":"2024-01-20T08:13:20.175835+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:20.175835+0000","last_undegraded":"2024-01-20T08:13:20.175835+0000","last_fullsized":"2024-01-20T08:13:20.175835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:22.763565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166278+0000","last_change":"2024-01-20T08:13:20.166278+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166278+0000","last_undegraded":"2024-01-20T08:13:20.166278+0000","last_fullsized":"2024-01-20T08:13:20.166278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183538+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:20.183538+0000","last_peered":"2024-01-20T08:13:20.183538+0000","last_clean":"2024-01-20T08:13:20.183538+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:20.183538+0000","last_undegraded":"2024-01-20T08:13:20.183538+0000","last_fullsized":"2024-01-20T08:13:20.183538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:08.839046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158478+0000","last_change":"2024-01-20T08:13:20.158478+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158478+0000","last_undegraded":"2024-01-20T08:13:20.158478+0000","last_fullsized":"2024-01-20T08:13:20.158478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172003+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:20.172003+0000","last_peered":"2024-01-20T08:13:20.172003+0000","last_clean":"2024-01-20T08:13:20.172003+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:20.172003+0000","last_undegraded":"2024-01-20T08:13:20.172003+0000","last_fullsized":"2024-01-20T08:13:20.172003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162181+0000","last_change":"2024-01-20T08:13:20.162181+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162181+0000","last_undegraded":"2024-01-20T08:13:20.162181+0000","last_fullsized":"2024-01-20T08:13:20.162181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.170394+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:20.170394+0000","last_peered":"2024-01-20T08:13:20.170394+0000","last_clean":"2024-01-20T08:13:20.170394+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:20.170394+0000","last_undegraded":"2024-01-20T08:13:20.170394+0000","last_fullsized":"2024-01-20T08:13:20.170394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:48.765547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.155566+0000","last_change":"2024-01-20T08:13:20.155566+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.155566+0000","last_undegraded":"2024-01-20T08:13:20.155566+0000","last_fullsized":"2024-01-20T08:13:20.155566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.176544+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:20.176544+0000","last_peered":"2024-01-20T08:13:20.176544+0000","last_clean":"2024-01-20T08:13:20.176544+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:20.176544+0000","last_undegraded":"2024-01-20T08:13:20.176544+0000","last_fullsized":"2024-01-20T08:13:20.176544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161594+0000","last_change":"2024-01-20T08:13:20.161594+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161594+0000","last_undegraded":"2024-01-20T08:13:20.161594+0000","last_fullsized":"2024-01-20T08:13:20.161594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179462+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:20.179462+0000","last_peered":"2024-01-20T08:13:20.179462+0000","last_clean":"2024-01-20T08:13:20.179462+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:20.179462+0000","last_undegraded":"2024-01-20T08:13:20.179462+0000","last_fullsized":"2024-01-20T08:13:20.179462+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-20T08:13:19.145639+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:19.145639+0000","last_peered":"2024-01-20T08:13:19.145639+0000","last_clean":"2024-01-20T08:13:19.145639+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:19.145639+0000","last_undegraded":"2024-01-20T08:13:19.145639+0000","last_fullsized":"2024-01-20T08:13:19.145639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.752},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.3500000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.27},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.5980000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.399}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.571},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.4530000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4870000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4279999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3320000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.373},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.619}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.5349999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.38},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.628},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.351}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.6819999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.024},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.179}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.129}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.593}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.268},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5309999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.736},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.825}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.653},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.86099999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":1.028},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.331}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":1.353},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":1.5129999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.395},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.2470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.371},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":367120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.371}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.6499999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.597},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.113}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:26.629 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2024-01-20T08:13:26.629 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.163013+0000', 'last_change': '2024-01-20T08:13:20.163013+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.163013+0000', 'last_undegraded': '2024-01-20T08:13:20.163013+0000', 'last_fullsized': '2024-01-20T08:13:20.163013+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.164454+0000', 'last_change': '2024-01-20T08:13:20.164454+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.164454+0000', 'last_undegraded': '2024-01-20T08:13:20.164454+0000', 'last_fullsized': '2024-01-20T08:13:20.164454+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.166455+0000', 'last_change': '2024-01-20T08:13:20.166455+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.166455+0000', 'last_undegraded': '2024-01-20T08:13:20.166455+0000', 'last_fullsized': '2024-01-20T08:13:20.166455+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.163534+0000', 'last_change': '2024-01-20T08:13:20.163534+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.163534+0000', 'last_undegraded': '2024-01-20T08:13:20.163534+0000', 'last_fullsized': '2024-01-20T08:13:20.163534+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.147178+0000', 'last_change': '2024-01-20T08:13:20.147178+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.147178+0000', 'last_undegraded': '2024-01-20T08:13:20.147178+0000', 'last_fullsized': '2024-01-20T08:13:20.147178+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.166749+0000', 'last_change': '2024-01-20T08:13:20.166749+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.166749+0000', 'last_undegraded': '2024-01-20T08:13:20.166749+0000', 'last_fullsized': '2024-01-20T08:13:20.166749+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2024-01-20T08:13:26.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.157286+0000', 'last_change': '2024-01-20T08:13:20.157286+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.157286+0000', 'last_undegraded': '2024-01-20T08:13:20.157286+0000', 'last_fullsized': '2024-01-20T08:13:20.157286+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.164043+0000', 'last_change': '2024-01-20T08:13:20.164043+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.164043+0000', 'last_undegraded': '2024-01-20T08:13:20.164043+0000', 'last_fullsized': '2024-01-20T08:13:20.164043+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.168317+0000', 'last_change': '2024-01-20T08:13:20.168317+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.168317+0000', 'last_undegraded': '2024-01-20T08:13:20.168317+0000', 'last_fullsized': '2024-01-20T08:13:20.168317+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.156070+0000', 'last_change': '2024-01-20T08:13:20.156070+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.156070+0000', 'last_undegraded': '2024-01-20T08:13:20.156070+0000', 'last_fullsized': '2024-01-20T08:13:20.156070+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161431+0000', 'last_change': '2024-01-20T08:13:20.161431+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161431+0000', 'last_undegraded': '2024-01-20T08:13:20.161431+0000', 'last_fullsized': '2024-01-20T08:13:20.161431+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.164840+0000', 'last_change': '2024-01-20T08:13:20.164840+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.164840+0000', 'last_undegraded': '2024-01-20T08:13:20.164840+0000', 'last_fullsized': '2024-01-20T08:13:20.164840+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2024-01-20T08:13:26.631 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.164216+0000', 'last_change': '2024-01-20T08:13:20.164216+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.164216+0000', 'last_undegraded': '2024-01-20T08:13:20.164216+0000', 'last_fullsized': '2024-01-20T08:13:20.164216+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162720+0000', 'last_change': '2024-01-20T08:13:20.162720+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162720+0000', 'last_undegraded': '2024-01-20T08:13:20.162720+0000', 'last_fullsized': '2024-01-20T08:13:20.162720+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145088+0000', 'last_change': '2024-01-20T08:13:20.145088+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145088+0000', 'last_undegraded': '2024-01-20T08:13:20.145088+0000', 'last_fullsized': '2024-01-20T08:13:20.145088+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145298+0000', 'last_change': '2024-01-20T08:13:20.145298+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145298+0000', 'last_undegraded': '2024-01-20T08:13:20.145298+0000', 'last_fullsized': '2024-01-20T08:13:20.145298+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145913+0000', 'last_change': '2024-01-20T08:13:20.145913+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145913+0000', 'last_undegraded': '2024-01-20T08:13:20.145913+0000', 'last_fullsized': '2024-01-20T08:13:20.145913+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2024-01-20T08:13:26.632 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.165563+0000', 'last_change': '2024-01-20T08:13:20.165563+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.165563+0000', 'last_undegraded': '2024-01-20T08:13:20.165563+0000', 'last_fullsized': '2024-01-20T08:13:20.165563+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.160092+0000', 'last_change': '2024-01-20T08:13:20.160092+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.160092+0000', 'last_undegraded': '2024-01-20T08:13:20.160092+0000', 'last_fullsized': '2024-01-20T08:13:20.160092+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162470+0000', 'last_change': '2024-01-20T08:13:20.162470+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162470+0000', 'last_undegraded': '2024-01-20T08:13:20.162470+0000', 'last_fullsized': '2024-01-20T08:13:20.162470+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.163726+0000', 'last_change': '2024-01-20T08:13:20.163726+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.163726+0000', 'last_undegraded': '2024-01-20T08:13:20.163726+0000', 'last_fullsized': '2024-01-20T08:13:20.163726+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162635+0000', 'last_change': '2024-01-20T08:13:20.162635+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162635+0000', 'last_undegraded': '2024-01-20T08:13:20.162635+0000', 'last_fullsized': '2024-01-20T08:13:20.162635+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.157075+0000', 'last_change': '2024-01-20T08:13:20.157075+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.157075+0000', 'last_undegraded': '2024-01-20T08:13:20.157075+0000', 'last_fullsized': '2024-01-20T08:13:20.157075+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2024-01-20T08:13:26.633 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.167863+0000', 'last_change': '2024-01-20T08:13:20.167863+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.167863+0000', 'last_undegraded': '2024-01-20T08:13:20.167863+0000', 'last_fullsized': '2024-01-20T08:13:20.167863+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.165389+0000', 'last_change': '2024-01-20T08:13:20.165389+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.165389+0000', 'last_undegraded': '2024-01-20T08:13:20.165389+0000', 'last_fullsized': '2024-01-20T08:13:20.165389+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.163718+0000', 'last_change': '2024-01-20T08:13:20.163718+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.163718+0000', 'last_undegraded': '2024-01-20T08:13:20.163718+0000', 'last_fullsized': '2024-01-20T08:13:20.163718+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.149560+0000', 'last_change': '2024-01-20T08:13:20.149560+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.149560+0000', 'last_undegraded': '2024-01-20T08:13:20.149560+0000', 'last_fullsized': '2024-01-20T08:13:20.149560+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.160489+0000', 'last_change': '2024-01-20T08:13:20.160489+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.160489+0000', 'last_undegraded': '2024-01-20T08:13:20.160489+0000', 'last_fullsized': '2024-01-20T08:13:20.160489+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.165517+0000', 'last_change': '2024-01-20T08:13:20.165517+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.165517+0000', 'last_undegraded': '2024-01-20T08:13:20.165517+0000', 'last_fullsized': '2024-01-20T08:13:20.165517+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2024-01-20T08:13:26.634 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162175+0000', 'last_change': '2024-01-20T08:13:20.162175+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162175+0000', 'last_undegraded': '2024-01-20T08:13:20.162175+0000', 'last_fullsized': '2024-01-20T08:13:20.162175+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145247+0000', 'last_change': '2024-01-20T08:13:20.145247+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145247+0000', 'last_undegraded': '2024-01-20T08:13:20.145247+0000', 'last_fullsized': '2024-01-20T08:13:20.145247+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.158879+0000', 'last_change': '2024-01-20T08:13:20.158879+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.158879+0000', 'last_undegraded': '2024-01-20T08:13:20.158879+0000', 'last_fullsized': '2024-01-20T08:13:20.158879+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.147903+0000', 'last_change': '2024-01-20T08:13:20.147903+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.147903+0000', 'last_undegraded': '2024-01-20T08:13:20.147903+0000', 'last_fullsized': '2024-01-20T08:13:20.147903+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162264+0000', 'last_change': '2024-01-20T08:13:20.162264+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162264+0000', 'last_undegraded': '2024-01-20T08:13:20.162264+0000', 'last_fullsized': '2024-01-20T08:13:20.162264+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2024-01-20T08:13:26.635 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.158859+0000', 'last_change': '2024-01-20T08:13:20.158859+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.158859+0000', 'last_undegraded': '2024-01-20T08:13:20.158859+0000', 'last_fullsized': '2024-01-20T08:13:20.158859+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161850+0000', 'last_change': '2024-01-20T08:13:20.161850+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161850+0000', 'last_undegraded': '2024-01-20T08:13:20.161850+0000', 'last_fullsized': '2024-01-20T08:13:20.161850+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.160827+0000', 'last_change': '2024-01-20T08:13:20.160827+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.160827+0000', 'last_undegraded': '2024-01-20T08:13:20.160827+0000', 'last_fullsized': '2024-01-20T08:13:20.160827+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145198+0000', 'last_change': '2024-01-20T08:13:20.145198+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145198+0000', 'last_undegraded': '2024-01-20T08:13:20.145198+0000', 'last_fullsized': '2024-01-20T08:13:20.145198+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.170159+0000', 'last_change': '2024-01-20T08:13:20.170159+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.170159+0000', 'last_undegraded': '2024-01-20T08:13:20.170159+0000', 'last_fullsized': '2024-01-20T08:13:20.170159+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.144599+0000', 'last_change': '2024-01-20T08:13:20.144599+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.144599+0000', 'last_undegraded': '2024-01-20T08:13:20.144599+0000', 'last_fullsized': '2024-01-20T08:13:20.144599+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2024-01-20T08:13:26.636 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145120+0000', 'last_change': '2024-01-20T08:13:20.145120+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145120+0000', 'last_undegraded': '2024-01-20T08:13:20.145120+0000', 'last_fullsized': '2024-01-20T08:13:20.145120+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.167845+0000', 'last_change': '2024-01-20T08:13:20.167845+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.167845+0000', 'last_undegraded': '2024-01-20T08:13:20.167845+0000', 'last_fullsized': '2024-01-20T08:13:20.167845+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.164901+0000', 'last_change': '2024-01-20T08:13:20.164901+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.164901+0000', 'last_undegraded': '2024-01-20T08:13:20.164901+0000', 'last_fullsized': '2024-01-20T08:13:20.164901+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.148437+0000', 'last_change': '2024-01-20T08:13:20.148437+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.148437+0000', 'last_undegraded': '2024-01-20T08:13:20.148437+0000', 'last_fullsized': '2024-01-20T08:13:20.148437+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.160826+0000', 'last_change': '2024-01-20T08:13:20.160826+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.160826+0000', 'last_undegraded': '2024-01-20T08:13:20.160826+0000', 'last_fullsized': '2024-01-20T08:13:20.160826+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161515+0000', 'last_change': '2024-01-20T08:13:20.161515+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161515+0000', 'last_undegraded': '2024-01-20T08:13:20.161515+0000', 'last_fullsized': '2024-01-20T08:13:20.161515+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.637 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161479+0000', 'last_change': '2024-01-20T08:13:20.161479+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161479+0000', 'last_undegraded': '2024-01-20T08:13:20.161479+0000', 'last_fullsized': '2024-01-20T08:13:20.161479+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162721+0000', 'last_change': '2024-01-20T08:13:20.162721+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162721+0000', 'last_undegraded': '2024-01-20T08:13:20.162721+0000', 'last_fullsized': '2024-01-20T08:13:20.162721+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.163269+0000', 'last_change': '2024-01-20T08:13:20.163269+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.163269+0000', 'last_undegraded': '2024-01-20T08:13:20.163269+0000', 'last_fullsized': '2024-01-20T08:13:20.163269+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.159358+0000', 'last_change': '2024-01-20T08:13:20.159358+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.159358+0000', 'last_undegraded': '2024-01-20T08:13:20.159358+0000', 'last_fullsized': '2024-01-20T08:13:20.159358+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.147364+0000', 'last_change': '2024-01-20T08:13:20.147364+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.147364+0000', 'last_undegraded': '2024-01-20T08:13:20.147364+0000', 'last_fullsized': '2024-01-20T08:13:20.147364+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2024-01-20T08:13:26.638 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162258+0000', 'last_change': '2024-01-20T08:13:20.162258+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162258+0000', 'last_undegraded': '2024-01-20T08:13:20.162258+0000', 'last_fullsized': '2024-01-20T08:13:20.162258+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161124+0000', 'last_change': '2024-01-20T08:13:20.161124+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161124+0000', 'last_undegraded': '2024-01-20T08:13:20.161124+0000', 'last_fullsized': '2024-01-20T08:13:20.161124+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.157106+0000', 'last_change': '2024-01-20T08:13:20.157106+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.157106+0000', 'last_undegraded': '2024-01-20T08:13:20.157106+0000', 'last_fullsized': '2024-01-20T08:13:20.157106+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.165602+0000', 'last_change': '2024-01-20T08:13:20.165602+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.165602+0000', 'last_undegraded': '2024-01-20T08:13:20.165602+0000', 'last_fullsized': '2024-01-20T08:13:20.165602+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.146620+0000', 'last_change': '2024-01-20T08:13:20.146620+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.146620+0000', 'last_undegraded': '2024-01-20T08:13:20.146620+0000', 'last_fullsized': '2024-01-20T08:13:20.146620+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.166532+0000', 'last_change': '2024-01-20T08:13:20.166532+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.166532+0000', 'last_undegraded': '2024-01-20T08:13:20.166532+0000', 'last_fullsized': '2024-01-20T08:13:20.166532+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2024-01-20T08:13:26.639 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.157513+0000', 'last_change': '2024-01-20T08:13:20.157513+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.157513+0000', 'last_undegraded': '2024-01-20T08:13:20.157513+0000', 'last_fullsized': '2024-01-20T08:13:20.157513+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.145432+0000', 'last_change': '2024-01-20T08:13:20.145432+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.145432+0000', 'last_undegraded': '2024-01-20T08:13:20.145432+0000', 'last_fullsized': '2024-01-20T08:13:20.145432+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.166278+0000', 'last_change': '2024-01-20T08:13:20.166278+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.166278+0000', 'last_undegraded': '2024-01-20T08:13:20.166278+0000', 'last_fullsized': '2024-01-20T08:13:20.166278+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.158478+0000', 'last_change': '2024-01-20T08:13:20.158478+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.158478+0000', 'last_undegraded': '2024-01-20T08:13:20.158478+0000', 'last_fullsized': '2024-01-20T08:13:20.158478+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.162181+0000', 'last_change': '2024-01-20T08:13:20.162181+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.162181+0000', 'last_undegraded': '2024-01-20T08:13:20.162181+0000', 'last_fullsized': '2024-01-20T08:13:20.162181+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2024-01-20T08:13:26.640 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.155566+0000', 'last_change': '2024-01-20T08:13:20.155566+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.155566+0000', 'last_undegraded': '2024-01-20T08:13:20.155566+0000', 'last_fullsized': '2024-01-20T08:13:20.155566+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:26.641 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2024-01-20T08:13:26.641 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 70, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:20.161594+0000', 'last_change': '2024-01-20T08:13:20.161594+0000', 'last_active': '2024-01-20T08:13:20.130046+0000', 'last_peered': '2024-01-20T08:13:20.130046+0000', 'last_clean': '2024-01-20T08:13:20.130046+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:20.161594+0000', 'last_undegraded': '2024-01-20T08:13:20.161594+0000', 'last_fullsized': '2024-01-20T08:13:20.161594+0000', 'mapping_epoch': 70, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 70, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:20.130046+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:26.641 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-20T08:13:26.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.873+0000 7f9d10e00640 1 Processor -- start 2024-01-20T08:13:26.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.874+0000 7f9d10e00640 1 -- start start 2024-01-20T08:13:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d10e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 0x7f9d0c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d10e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d10e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c157d00 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d10e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c0c4890 con 0x7f9d0c14e690 2024-01-20T08:13:26.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d10e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c06cd00 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.875+0000 7f9d0b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 0x7f9d0c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0aa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 0x7f9d0c1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:40274/0 (socket says 172.21.15.100:40274) 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0b400640 1 -- 172.21.15.100:0/1219558328 learned_addr learned my addr 172.21.15.100:0/1219558328 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0aa00640 1 -- 172.21.15.100:0/1219558328 >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 msgr2=0x7f9d0c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:26.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0aa00640 1 --2- 172.21.15.100:0/1219558328 >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 0x7f9d0c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0aa00640 1 -- 172.21.15.100:0/1219558328 >> v1:172.21.15.110:6789/0 conn(0x7f9d0c0ca9a0 legacy=0x7f9d0c1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.876+0000 7f9d0aa00640 1 -- 172.21.15.100:0/1219558328 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0c4b50 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.878+0000 7f9d0aa00640 1 --2- 172.21.15.100:0/1219558328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ca460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097a0 tx=0x7f9cf402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b3295f9675e269f8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.878+0000 7f9d0a000640 1 -- 172.21.15.100:0/1219558328 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf402e070 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.878+0000 7f9d0a000640 1 -- 172.21.15.100:0/1219558328 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40315a0 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.878+0000 7f9d0a000640 1 -- 172.21.15.100:0/1219558328 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4031930 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 -- 172.21.15.100:0/1219558328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 msgr2=0x7f9d0c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 --2- 172.21.15.100:0/1219558328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ca460 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097a0 tx=0x7f9cf402b840 comp rx=0 tx=0).stop 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 -- 172.21.15.100:0/1219558328 shutdown_connections 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 --2- 172.21.15.100:0/1219558328 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ca460 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 --2- 172.21.15.100:0/1219558328 >> v2:172.21.15.110:3300/0 conn(0x7f9d0c14e690 0x7f9d0c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 -- 172.21.15.100:0/1219558328 >> 172.21.15.100:0/1219558328 conn(0x7f9d0c072130 msgr2=0x7f9d0c072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 -- 172.21.15.100:0/1219558328 shutdown_connections 2024-01-20T08:13:26.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.879+0000 7f9d10e00640 1 -- 172.21.15.100:0/1219558328 wait complete. 2024-01-20T08:13:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.881+0000 7f9d10e00640 1 Processor -- start 2024-01-20T08:13:26.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.881+0000 7f9d10e00640 1 -- start start 2024-01-20T08:13:26.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ab4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c14e690 0x7f9d0c1e6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0ab050 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0afbd0 con 0x7f9d0c0c7e10 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.882+0000 7f9d10e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c0af230 con 0x7f9d0c14e690 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45668/0 (socket says 172.21.15.100:45668) 2024-01-20T08:13:26.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 -- 172.21.15.100:0/3309716462 learned_addr learned my addr 172.21.15.100:0/3309716462 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0b400640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ab4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0be00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c14e690 0x7f9d0c1e6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 -- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c14e690 msgr2=0x7f9d0c1e6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c14e690 0x7f9d0c1e6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 -- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 msgr2=0x7f9d0c0ab4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ab4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0aa00640 1 -- 172.21.15.100:0/3309716462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009400 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.883+0000 7f9d0b400640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d0aa00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40098c0 tx=0x7f9cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4032840 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40329c0 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4032d70 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c0aaa00 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.884+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c0ca5d0 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.885+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c04e970 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.886+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9cf404e430 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.887+0000 7f9d03400640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 0x7f9ce406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.887+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cf40ab680 con 0x7f9d0c0ca9a0 2024-01-20T08:13:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.887+0000 7f9d0b400640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 0x7f9ce406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:26.889 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.888+0000 7f9d0b400640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 0x7f9ce406d390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ac0 tx=0x7f9cfc008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:26.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:26.891+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9cf4076540 con 0x7f9d0c0ca9a0 2024-01-20T08:13:27.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.149+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f9d0c14d4d0 con 0x7f9d0c0ca9a0 2024-01-20T08:13:27.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.150+0000 7f9d03400640 1 -- 172.21.15.100:0/3309716462 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1324 (secure 0 0 0) 0x7f9cf4079b60 con 0x7f9d0c0ca9a0 2024-01-20T08:13:27.152 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:27.152 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":218,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":72,"num_osds":8,"num_up_osds":8,"osd_up_since":1705738200,"num_in_osds":8,"osd_in_since":1705738192,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":259252224,"bytes_avail":772834861056,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":48,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6432}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-01-20T08:13:03.942863+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-20T08:13:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 msgr2=0x7f9ce406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.154 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 0x7f9ce406d390 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc009ac0 tx=0x7f9cfc008040 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 msgr2=0x7f9d0c0acb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40098c0 tx=0x7f9cf40046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 shutdown_connections 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ce406aed0 0x7f9ce406d390 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9d0c14e690 0x7f9d0c1e6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d0c0ca9a0 0x7f9d0c0acb60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 --2- 172.21.15.100:0/3309716462 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9d0c0c7e10 0x7f9d0c0ab4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.152+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 >> 172.21.15.100:0/3309716462 conn(0x7f9d0c072130 msgr2=0x7f9d0c072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.153+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 shutdown_connections 2024-01-20T08:13:27.155 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.153+0000 7f9d10e00640 1 -- 172.21.15.100:0/3309716462 wait complete. 2024-01-20T08:13:27.173 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-20T08:13:27.173 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:27.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.377+0000 7fde0fe00640 1 Processor -- start 2024-01-20T08:13:27.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.377+0000 7fde0fe00640 1 -- start start 2024-01-20T08:13:27.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.378+0000 7fde0fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde10155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.378+0000 7fde0fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fde100c3240 0x7fde10156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.378+0000 7fde0fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde100c1720 con 0x7fde10072320 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.378+0000 7fde0fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde100c20a0 con 0x7fde100c3240 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.378+0000 7fde0fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde1006c7c0 con 0x7fde1006dd90 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fde10072320 0x7fde1014f5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:35470/0 (socket says 172.21.15.100:35470) 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0ea00640 1 -- 172.21.15.100:0/1118260255 learned_addr learned my addr 172.21.15.100:0/1118260255 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:27.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0f400640 1 --2- 172.21.15.100:0/1118260255 >> v2:172.21.15.100:3300/0 conn(0x7fde100c3240 0x7fde10156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde05e00640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde10155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0e000640 1 -- 172.21.15.100:0/1118260255 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2803715077 0 0) 0x7fde100c1720 con 0x7fde10072320 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0e000640 1 -- 172.21.15.100:0/1118260255 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddf0003520 con 0x7fde10072320 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0f400640 1 -- 172.21.15.100:0/1118260255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 msgr2=0x7fde10155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0f400640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde10155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0f400640 1 -- 172.21.15.100:0/1118260255 >> v1:172.21.15.100:6789/0 conn(0x7fde10072320 legacy=0x7fde1014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.379+0000 7fde0f400640 1 -- 172.21.15.100:0/1118260255 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde100a4f30 con 0x7fde100c3240 2024-01-20T08:13:27.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.380+0000 7fde0f400640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10156040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fde08009dc0 tx=0x7fde0802be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6146498a15f48bea server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:27.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0e000640 1 -- 172.21.15.100:0/1118260255 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde0802cc40 con 0x7fde100c3240 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0e000640 1 -- 172.21.15.100:0/1118260255 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde0802cda0 con 0x7fde100c3240 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0e000640 1 -- 172.21.15.100:0/1118260255 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08034660 con 0x7fde100c3240 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 -- 172.21.15.100:0/1118260255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 msgr2=0x7fde10156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10156040 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fde08009dc0 tx=0x7fde0802be90 comp rx=0 tx=0).stop 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 -- 172.21.15.100:0/1118260255 shutdown_connections 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10156040 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1118260255 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde10155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 -- 172.21.15.100:0/1118260255 >> 172.21.15.100:0/1118260255 conn(0x7fde100c2590 msgr2=0x7fde100c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 -- 172.21.15.100:0/1118260255 shutdown_connections 2024-01-20T08:13:27.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.381+0000 7fde0fe00640 1 -- 172.21.15.100:0/1118260255 wait complete. 2024-01-20T08:13:27.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.383+0000 7fde0fe00640 1 Processor -- start 2024-01-20T08:13:27.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.383+0000 7fde0fe00640 1 -- start start 2024-01-20T08:13:27.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde100a65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 0x7fde101519f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde101e85e0 con 0x7fde100c3240 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde101e8ad0 con 0x7fde10072320 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde10154a60 con 0x7fde1006dd90 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:45680/0 (socket says 172.21.15.100:45680) 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.384+0000 7fde0f400640 1 -- 172.21.15.100:0/1859213525 learned_addr learned my addr 172.21.15.100:0/1859213525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde05e00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 0x7fde101519f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0ea00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde100a65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 -- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 msgr2=0x7fde100a65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde100a65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 -- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 msgr2=0x7fde101519f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 0x7fde101519f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 -- 172.21.15.100:0/1859213525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde08009a70 con 0x7fde100c3240 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde05e00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 0x7fde101519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:27.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0f400640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fde08037040 tx=0x7fde08004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08040650 con 0x7fde100c3240 2024-01-20T08:13:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde080407b0 con 0x7fde100c3240 2024-01-20T08:13:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde08040b60 con 0x7fde100c3240 2024-01-20T08:13:27.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde10152940 con 0x7fde100c3240 2024-01-20T08:13:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.385+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde100a6b00 con 0x7fde100c3240 2024-01-20T08:13:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.386+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde100749e0 con 0x7fde100c3240 2024-01-20T08:13:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.387+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fde08040cc0 con 0x7fde100c3240 2024-01-20T08:13:27.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.389+0000 7fde07400640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 0x7fdde806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.389+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde080ac350 con 0x7fde100c3240 2024-01-20T08:13:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.389+0000 7fde0ea00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 0x7fdde806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:27.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.389+0000 7fde0ea00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 0x7fdde806d390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:27.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.393+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fde08077210 con 0x7fde100c3240 2024-01-20T08:13:27.569 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.567+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fde100c1cc0 con 0x7fdde806aed0 2024-01-20T08:13:27.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.589+0000 7fde07400640 1 -- 172.21.15.100:0/1859213525 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281510 (secure 0 0 0) 0x7fde000058d0 con 0x7fdde806aed0 2024-01-20T08:13:27.595 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:27.596 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 msgr2=0x7fdde806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 0x7fdde806d390 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fde00000f60 tx=0x7fde00009040 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 msgr2=0x7fde10151f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fde08037040 tx=0x7fde08004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 shutdown_connections 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fde100c3240 0x7fde10151f30 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fde10072320 0x7fde101519f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdde806aed0 0x7fdde806d390 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 --2- 172.21.15.100:0/1859213525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fde1006dd90 0x7fde100a65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 >> 172.21.15.100:0/1859213525 conn(0x7fde100c2590 msgr2=0x7fde100c3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:27.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 shutdown_connections 2024-01-20T08:13:27.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:27.594+0000 7fde0fe00640 1 -- 172.21.15.100:0/1859213525 wait complete. 2024-01-20T08:13:27.614 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":168,"stamp":"2024-01-20T08:13:25.949116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":70,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253176,"kb_used_data":7868,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721544,"statfs":{"total":773094113280,"available":772834861056,"internally_reserved":0,"allocated":8056832,"data_stored":4161621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001814"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163013+0000","last_change":"2024-01-20T08:13:20.163013+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163013+0000","last_undegraded":"2024-01-20T08:13:20.163013+0000","last_fullsized":"2024-01-20T08:13:20.163013+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164454+0000","last_change":"2024-01-20T08:13:20.164454+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164454+0000","last_undegraded":"2024-01-20T08:13:20.164454+0000","last_fullsized":"2024-01-20T08:13:20.164454+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166455+0000","last_change":"2024-01-20T08:13:20.166455+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166455+0000","last_undegraded":"2024-01-20T08:13:20.166455+0000","last_fullsized":"2024-01-20T08:13:20.166455+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163534+0000","last_change":"2024-01-20T08:13:20.163534+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163534+0000","last_undegraded":"2024-01-20T08:13:20.163534+0000","last_fullsized":"2024-01-20T08:13:20.163534+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147178+0000","last_change":"2024-01-20T08:13:20.147178+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147178+0000","last_undegraded":"2024-01-20T08:13:20.147178+0000","last_fullsized":"2024-01-20T08:13:20.147178+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166749+0000","last_change":"2024-01-20T08:13:20.166749+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166749+0000","last_undegraded":"2024-01-20T08:13:20.166749+0000","last_fullsized":"2024-01-20T08:13:20.166749+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157286+0000","last_change":"2024-01-20T08:13:20.157286+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157286+0000","last_undegraded":"2024-01-20T08:13:20.157286+0000","last_fullsized":"2024-01-20T08:13:20.157286+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164043+0000","last_change":"2024-01-20T08:13:20.164043+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164043+0000","last_undegraded":"2024-01-20T08:13:20.164043+0000","last_fullsized":"2024-01-20T08:13:20.164043+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.168317+0000","last_change":"2024-01-20T08:13:20.168317+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.168317+0000","last_undegraded":"2024-01-20T08:13:20.168317+0000","last_fullsized":"2024-01-20T08:13:20.168317+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.156070+0000","last_change":"2024-01-20T08:13:20.156070+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.156070+0000","last_undegraded":"2024-01-20T08:13:20.156070+0000","last_fullsized":"2024-01-20T08:13:20.156070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161431+0000","last_change":"2024-01-20T08:13:20.161431+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161431+0000","last_undegraded":"2024-01-20T08:13:20.161431+0000","last_fullsized":"2024-01-20T08:13:20.161431+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164840+0000","last_change":"2024-01-20T08:13:20.164840+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164840+0000","last_undegraded":"2024-01-20T08:13:20.164840+0000","last_fullsized":"2024-01-20T08:13:20.164840+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164216+0000","last_change":"2024-01-20T08:13:20.164216+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164216+0000","last_undegraded":"2024-01-20T08:13:20.164216+0000","last_fullsized":"2024-01-20T08:13:20.164216+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162720+0000","last_change":"2024-01-20T08:13:20.162720+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162720+0000","last_undegraded":"2024-01-20T08:13:20.162720+0000","last_fullsized":"2024-01-20T08:13:20.162720+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145088+0000","last_change":"2024-01-20T08:13:20.145088+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145088+0000","last_undegraded":"2024-01-20T08:13:20.145088+0000","last_fullsized":"2024-01-20T08:13:20.145088+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145298+0000","last_change":"2024-01-20T08:13:20.145298+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145298+0000","last_undegraded":"2024-01-20T08:13:20.145298+0000","last_fullsized":"2024-01-20T08:13:20.145298+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145913+0000","last_change":"2024-01-20T08:13:20.145913+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145913+0000","last_undegraded":"2024-01-20T08:13:20.145913+0000","last_fullsized":"2024-01-20T08:13:20.145913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165563+0000","last_change":"2024-01-20T08:13:20.165563+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165563+0000","last_undegraded":"2024-01-20T08:13:20.165563+0000","last_fullsized":"2024-01-20T08:13:20.165563+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160092+0000","last_change":"2024-01-20T08:13:20.160092+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160092+0000","last_undegraded":"2024-01-20T08:13:20.160092+0000","last_fullsized":"2024-01-20T08:13:20.160092+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162470+0000","last_change":"2024-01-20T08:13:20.162470+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162470+0000","last_undegraded":"2024-01-20T08:13:20.162470+0000","last_fullsized":"2024-01-20T08:13:20.162470+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163726+0000","last_change":"2024-01-20T08:13:20.163726+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163726+0000","last_undegraded":"2024-01-20T08:13:20.163726+0000","last_fullsized":"2024-01-20T08:13:20.163726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162635+0000","last_change":"2024-01-20T08:13:20.162635+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162635+0000","last_undegraded":"2024-01-20T08:13:20.162635+0000","last_fullsized":"2024-01-20T08:13:20.162635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157075+0000","last_change":"2024-01-20T08:13:20.157075+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157075+0000","last_undegraded":"2024-01-20T08:13:20.157075+0000","last_fullsized":"2024-01-20T08:13:20.157075+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167863+0000","last_change":"2024-01-20T08:13:20.167863+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167863+0000","last_undegraded":"2024-01-20T08:13:20.167863+0000","last_fullsized":"2024-01-20T08:13:20.167863+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165389+0000","last_change":"2024-01-20T08:13:20.165389+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165389+0000","last_undegraded":"2024-01-20T08:13:20.165389+0000","last_fullsized":"2024-01-20T08:13:20.165389+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163718+0000","last_change":"2024-01-20T08:13:20.163718+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163718+0000","last_undegraded":"2024-01-20T08:13:20.163718+0000","last_fullsized":"2024-01-20T08:13:20.163718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.149560+0000","last_change":"2024-01-20T08:13:20.149560+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.149560+0000","last_undegraded":"2024-01-20T08:13:20.149560+0000","last_fullsized":"2024-01-20T08:13:20.149560+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160489+0000","last_change":"2024-01-20T08:13:20.160489+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160489+0000","last_undegraded":"2024-01-20T08:13:20.160489+0000","last_fullsized":"2024-01-20T08:13:20.160489+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165517+0000","last_change":"2024-01-20T08:13:20.165517+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165517+0000","last_undegraded":"2024-01-20T08:13:20.165517+0000","last_fullsized":"2024-01-20T08:13:20.165517+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162175+0000","last_change":"2024-01-20T08:13:20.162175+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162175+0000","last_undegraded":"2024-01-20T08:13:20.162175+0000","last_fullsized":"2024-01-20T08:13:20.162175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145247+0000","last_change":"2024-01-20T08:13:20.145247+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145247+0000","last_undegraded":"2024-01-20T08:13:20.145247+0000","last_fullsized":"2024-01-20T08:13:20.145247+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158879+0000","last_change":"2024-01-20T08:13:20.158879+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158879+0000","last_undegraded":"2024-01-20T08:13:20.158879+0000","last_fullsized":"2024-01-20T08:13:20.158879+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147903+0000","last_change":"2024-01-20T08:13:20.147903+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147903+0000","last_undegraded":"2024-01-20T08:13:20.147903+0000","last_fullsized":"2024-01-20T08:13:20.147903+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178515+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:20.178515+0000","last_peered":"2024-01-20T08:13:20.178515+0000","last_clean":"2024-01-20T08:13:20.178515+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:20.178515+0000","last_undegraded":"2024-01-20T08:13:20.178515+0000","last_fullsized":"2024-01-20T08:13:20.178515+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:39.161170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162264+0000","last_change":"2024-01-20T08:13:20.162264+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162264+0000","last_undegraded":"2024-01-20T08:13:20.162264+0000","last_fullsized":"2024-01-20T08:13:20.162264+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166688+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:20.166688+0000","last_peered":"2024-01-20T08:13:20.166688+0000","last_clean":"2024-01-20T08:13:20.166688+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:20.166688+0000","last_undegraded":"2024-01-20T08:13:20.166688+0000","last_fullsized":"2024-01-20T08:13:20.166688+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158859+0000","last_change":"2024-01-20T08:13:20.158859+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158859+0000","last_undegraded":"2024-01-20T08:13:20.158859+0000","last_fullsized":"2024-01-20T08:13:20.158859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179122+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:20.179122+0000","last_peered":"2024-01-20T08:13:20.179122+0000","last_clean":"2024-01-20T08:13:20.179122+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:20.179122+0000","last_undegraded":"2024-01-20T08:13:20.179122+0000","last_fullsized":"2024-01-20T08:13:20.179122+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161850+0000","last_change":"2024-01-20T08:13:20.161850+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161850+0000","last_undegraded":"2024-01-20T08:13:20.161850+0000","last_fullsized":"2024-01-20T08:13:20.161850+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180941+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:20.180941+0000","last_peered":"2024-01-20T08:13:20.180941+0000","last_clean":"2024-01-20T08:13:20.180941+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:20.180941+0000","last_undegraded":"2024-01-20T08:13:20.180941+0000","last_fullsized":"2024-01-20T08:13:20.180941+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:14:23.230628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160827+0000","last_change":"2024-01-20T08:13:20.160827+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160827+0000","last_undegraded":"2024-01-20T08:13:20.160827+0000","last_fullsized":"2024-01-20T08:13:20.160827+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.166254+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:20.166254+0000","last_peered":"2024-01-20T08:13:20.166254+0000","last_clean":"2024-01-20T08:13:20.166254+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:20.166254+0000","last_undegraded":"2024-01-20T08:13:20.166254+0000","last_fullsized":"2024-01-20T08:13:20.166254+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145198+0000","last_change":"2024-01-20T08:13:20.145198+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145198+0000","last_undegraded":"2024-01-20T08:13:20.145198+0000","last_fullsized":"2024-01-20T08:13:20.145198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.171982+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:20.171982+0000","last_peered":"2024-01-20T08:13:20.171982+0000","last_clean":"2024-01-20T08:13:20.171982+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:20.171982+0000","last_undegraded":"2024-01-20T08:13:20.171982+0000","last_fullsized":"2024-01-20T08:13:20.171982+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:03.339169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.170159+0000","last_change":"2024-01-20T08:13:20.170159+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.170159+0000","last_undegraded":"2024-01-20T08:13:20.170159+0000","last_fullsized":"2024-01-20T08:13:20.170159+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180925+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:20.180925+0000","last_peered":"2024-01-20T08:13:20.180925+0000","last_clean":"2024-01-20T08:13:20.180925+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:20.180925+0000","last_undegraded":"2024-01-20T08:13:20.180925+0000","last_fullsized":"2024-01-20T08:13:20.180925+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.144599+0000","last_change":"2024-01-20T08:13:20.144599+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.144599+0000","last_undegraded":"2024-01-20T08:13:20.144599+0000","last_fullsized":"2024-01-20T08:13:20.144599+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174890+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:20.174890+0000","last_peered":"2024-01-20T08:13:20.174890+0000","last_clean":"2024-01-20T08:13:20.174890+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:20.174890+0000","last_undegraded":"2024-01-20T08:13:20.174890+0000","last_fullsized":"2024-01-20T08:13:20.174890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:27:41.805984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145120+0000","last_change":"2024-01-20T08:13:20.145120+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145120+0000","last_undegraded":"2024-01-20T08:13:20.145120+0000","last_fullsized":"2024-01-20T08:13:20.145120+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.174876+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:20.174876+0000","last_peered":"2024-01-20T08:13:20.174876+0000","last_clean":"2024-01-20T08:13:20.174876+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:20.174876+0000","last_undegraded":"2024-01-20T08:13:20.174876+0000","last_fullsized":"2024-01-20T08:13:20.174876+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:56.828582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.167845+0000","last_change":"2024-01-20T08:13:20.167845+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.167845+0000","last_undegraded":"2024-01-20T08:13:20.167845+0000","last_fullsized":"2024-01-20T08:13:20.167845+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178117+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:20.178117+0000","last_peered":"2024-01-20T08:13:20.178117+0000","last_clean":"2024-01-20T08:13:20.178117+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:20.178117+0000","last_undegraded":"2024-01-20T08:13:20.178117+0000","last_fullsized":"2024-01-20T08:13:20.178117+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:47:08.271391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.164901+0000","last_change":"2024-01-20T08:13:20.164901+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.164901+0000","last_undegraded":"2024-01-20T08:13:20.164901+0000","last_fullsized":"2024-01-20T08:13:20.164901+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178197+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:20.178197+0000","last_peered":"2024-01-20T08:13:20.178197+0000","last_clean":"2024-01-20T08:13:20.178197+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:20.178197+0000","last_undegraded":"2024-01-20T08:13:20.178197+0000","last_fullsized":"2024-01-20T08:13:20.178197+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:28:24.138553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.148437+0000","last_change":"2024-01-20T08:13:20.148437+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.148437+0000","last_undegraded":"2024-01-20T08:13:20.148437+0000","last_fullsized":"2024-01-20T08:13:20.148437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178061+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:20.178061+0000","last_peered":"2024-01-20T08:13:20.178061+0000","last_clean":"2024-01-20T08:13:20.178061+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:20.178061+0000","last_undegraded":"2024-01-20T08:13:20.178061+0000","last_fullsized":"2024-01-20T08:13:20.178061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.160826+0000","last_change":"2024-01-20T08:13:20.160826+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.160826+0000","last_undegraded":"2024-01-20T08:13:20.160826+0000","last_fullsized":"2024-01-20T08:13:20.160826+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180445+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:20.180445+0000","last_peered":"2024-01-20T08:13:20.180445+0000","last_clean":"2024-01-20T08:13:20.180445+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:20.180445+0000","last_undegraded":"2024-01-20T08:13:20.180445+0000","last_fullsized":"2024-01-20T08:13:20.180445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:37:21.337273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161515+0000","last_change":"2024-01-20T08:13:20.161515+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161515+0000","last_undegraded":"2024-01-20T08:13:20.161515+0000","last_fullsized":"2024-01-20T08:13:20.161515+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.161327+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:20.161327+0000","last_peered":"2024-01-20T08:13:20.161327+0000","last_clean":"2024-01-20T08:13:20.161327+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:20.161327+0000","last_undegraded":"2024-01-20T08:13:20.161327+0000","last_fullsized":"2024-01-20T08:13:20.161327+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:23.036421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161479+0000","last_change":"2024-01-20T08:13:20.161479+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161479+0000","last_undegraded":"2024-01-20T08:13:20.161479+0000","last_fullsized":"2024-01-20T08:13:20.161479+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179765+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:20.179765+0000","last_peered":"2024-01-20T08:13:20.179765+0000","last_clean":"2024-01-20T08:13:20.179765+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:20.179765+0000","last_undegraded":"2024-01-20T08:13:20.179765+0000","last_fullsized":"2024-01-20T08:13:20.179765+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162721+0000","last_change":"2024-01-20T08:13:20.162721+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162721+0000","last_undegraded":"2024-01-20T08:13:20.162721+0000","last_fullsized":"2024-01-20T08:13:20.162721+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.181105+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:20.181105+0000","last_peered":"2024-01-20T08:13:20.181105+0000","last_clean":"2024-01-20T08:13:20.181105+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:20.181105+0000","last_undegraded":"2024-01-20T08:13:20.181105+0000","last_fullsized":"2024-01-20T08:13:20.181105+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:06.656623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.163269+0000","last_change":"2024-01-20T08:13:20.163269+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.163269+0000","last_undegraded":"2024-01-20T08:13:20.163269+0000","last_fullsized":"2024-01-20T08:13:20.163269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178539+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:20.178539+0000","last_peered":"2024-01-20T08:13:20.178539+0000","last_clean":"2024-01-20T08:13:20.178539+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:20.178539+0000","last_undegraded":"2024-01-20T08:13:20.178539+0000","last_fullsized":"2024-01-20T08:13:20.178539+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:15:24.331234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.159358+0000","last_change":"2024-01-20T08:13:20.159358+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.159358+0000","last_undegraded":"2024-01-20T08:13:20.159358+0000","last_fullsized":"2024-01-20T08:13:20.159358+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178499+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:20.178499+0000","last_peered":"2024-01-20T08:13:20.178499+0000","last_clean":"2024-01-20T08:13:20.178499+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:20.178499+0000","last_undegraded":"2024-01-20T08:13:20.178499+0000","last_fullsized":"2024-01-20T08:13:20.178499+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:37.645450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.147364+0000","last_change":"2024-01-20T08:13:20.147364+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.147364+0000","last_undegraded":"2024-01-20T08:13:20.147364+0000","last_fullsized":"2024-01-20T08:13:20.147364+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.180960+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:20.180960+0000","last_peered":"2024-01-20T08:13:20.180960+0000","last_clean":"2024-01-20T08:13:20.180960+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:20.180960+0000","last_undegraded":"2024-01-20T08:13:20.180960+0000","last_fullsized":"2024-01-20T08:13:20.180960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:14:53.410256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162258+0000","last_change":"2024-01-20T08:13:20.162258+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162258+0000","last_undegraded":"2024-01-20T08:13:20.162258+0000","last_fullsized":"2024-01-20T08:13:20.162258+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175578+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:20.175578+0000","last_peered":"2024-01-20T08:13:20.175578+0000","last_clean":"2024-01-20T08:13:20.175578+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:20.175578+0000","last_undegraded":"2024-01-20T08:13:20.175578+0000","last_fullsized":"2024-01-20T08:13:20.175578+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:18.533547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161124+0000","last_change":"2024-01-20T08:13:20.161124+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161124+0000","last_undegraded":"2024-01-20T08:13:20.161124+0000","last_fullsized":"2024-01-20T08:13:20.161124+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183543+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:20.183543+0000","last_peered":"2024-01-20T08:13:20.183543+0000","last_clean":"2024-01-20T08:13:20.183543+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:20.183543+0000","last_undegraded":"2024-01-20T08:13:20.183543+0000","last_fullsized":"2024-01-20T08:13:20.183543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:14:58.693914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157106+0000","last_change":"2024-01-20T08:13:20.157106+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157106+0000","last_undegraded":"2024-01-20T08:13:20.157106+0000","last_fullsized":"2024-01-20T08:13:20.157106+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183823+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:20.183823+0000","last_peered":"2024-01-20T08:13:20.183823+0000","last_clean":"2024-01-20T08:13:20.183823+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:20.183823+0000","last_undegraded":"2024-01-20T08:13:20.183823+0000","last_fullsized":"2024-01-20T08:13:20.183823+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:26.608715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.165602+0000","last_change":"2024-01-20T08:13:20.165602+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.165602+0000","last_undegraded":"2024-01-20T08:13:20.165602+0000","last_fullsized":"2024-01-20T08:13:20.165602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172822+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:20.172822+0000","last_peered":"2024-01-20T08:13:20.172822+0000","last_clean":"2024-01-20T08:13:20.172822+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:20.172822+0000","last_undegraded":"2024-01-20T08:13:20.172822+0000","last_fullsized":"2024-01-20T08:13:20.172822+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:46.201221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.146620+0000","last_change":"2024-01-20T08:13:20.146620+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.146620+0000","last_undegraded":"2024-01-20T08:13:20.146620+0000","last_fullsized":"2024-01-20T08:13:20.146620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183413+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:20.183413+0000","last_peered":"2024-01-20T08:13:20.183413+0000","last_clean":"2024-01-20T08:13:20.183413+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:20.183413+0000","last_undegraded":"2024-01-20T08:13:20.183413+0000","last_fullsized":"2024-01-20T08:13:20.183413+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:34:57.243103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166532+0000","last_change":"2024-01-20T08:13:20.166532+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166532+0000","last_undegraded":"2024-01-20T08:13:20.166532+0000","last_fullsized":"2024-01-20T08:13:20.166532+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183288+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:20.183288+0000","last_peered":"2024-01-20T08:13:20.183288+0000","last_clean":"2024-01-20T08:13:20.183288+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:20.183288+0000","last_undegraded":"2024-01-20T08:13:20.183288+0000","last_fullsized":"2024-01-20T08:13:20.183288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:04.702644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.157513+0000","last_change":"2024-01-20T08:13:20.157513+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.157513+0000","last_undegraded":"2024-01-20T08:13:20.157513+0000","last_fullsized":"2024-01-20T08:13:20.157513+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.178220+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:20.178220+0000","last_peered":"2024-01-20T08:13:20.178220+0000","last_clean":"2024-01-20T08:13:20.178220+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:20.178220+0000","last_undegraded":"2024-01-20T08:13:20.178220+0000","last_fullsized":"2024-01-20T08:13:20.178220+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:14:07.671436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.145432+0000","last_change":"2024-01-20T08:13:20.145432+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.145432+0000","last_undegraded":"2024-01-20T08:13:20.145432+0000","last_fullsized":"2024-01-20T08:13:20.145432+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.175835+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:20.175835+0000","last_peered":"2024-01-20T08:13:20.175835+0000","last_clean":"2024-01-20T08:13:20.175835+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:20.175835+0000","last_undegraded":"2024-01-20T08:13:20.175835+0000","last_fullsized":"2024-01-20T08:13:20.175835+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:52:22.763565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.166278+0000","last_change":"2024-01-20T08:13:20.166278+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.166278+0000","last_undegraded":"2024-01-20T08:13:20.166278+0000","last_fullsized":"2024-01-20T08:13:20.166278+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.183538+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:20.183538+0000","last_peered":"2024-01-20T08:13:20.183538+0000","last_clean":"2024-01-20T08:13:20.183538+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:20.183538+0000","last_undegraded":"2024-01-20T08:13:20.183538+0000","last_fullsized":"2024-01-20T08:13:20.183538+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:08.839046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.158478+0000","last_change":"2024-01-20T08:13:20.158478+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.158478+0000","last_undegraded":"2024-01-20T08:13:20.158478+0000","last_fullsized":"2024-01-20T08:13:20.158478+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.172003+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:20.172003+0000","last_peered":"2024-01-20T08:13:20.172003+0000","last_clean":"2024-01-20T08:13:20.172003+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:20.172003+0000","last_undegraded":"2024-01-20T08:13:20.172003+0000","last_fullsized":"2024-01-20T08:13:20.172003+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.162181+0000","last_change":"2024-01-20T08:13:20.162181+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.162181+0000","last_undegraded":"2024-01-20T08:13:20.162181+0000","last_fullsized":"2024-01-20T08:13:20.162181+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.170394+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:20.170394+0000","last_peered":"2024-01-20T08:13:20.170394+0000","last_clean":"2024-01-20T08:13:20.170394+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:20.170394+0000","last_undegraded":"2024-01-20T08:13:20.170394+0000","last_fullsized":"2024-01-20T08:13:20.170394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:05:48.765547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.155566+0000","last_change":"2024-01-20T08:13:20.155566+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.155566+0000","last_undegraded":"2024-01-20T08:13:20.155566+0000","last_fullsized":"2024-01-20T08:13:20.155566+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.176544+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:20.176544+0000","last_peered":"2024-01-20T08:13:20.176544+0000","last_clean":"2024-01-20T08:13:20.176544+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:20.176544+0000","last_undegraded":"2024-01-20T08:13:20.176544+0000","last_fullsized":"2024-01-20T08:13:20.176544+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":1,"reported_epoch":70,"state":"creating+peering","last_fresh":"2024-01-20T08:13:20.161594+0000","last_change":"2024-01-20T08:13:20.161594+0000","last_active":"2024-01-20T08:13:20.130046+0000","last_peered":"2024-01-20T08:13:20.130046+0000","last_clean":"2024-01-20T08:13:20.130046+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:20.161594+0000","last_undegraded":"2024-01-20T08:13:20.161594+0000","last_fullsized":"2024-01-20T08:13:20.161594+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":9,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-01-20T08:13:20.179462+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:20.179462+0000","last_peered":"2024-01-20T08:13:20.179462+0000","last_clean":"2024-01-20T08:13:20.179462+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:20.179462+0000","last_undegraded":"2024-01-20T08:13:20.179462+0000","last_fullsized":"2024-01-20T08:13:20.179462+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:15.284639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":207,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-01-20T08:13:19.145639+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:19.145639+0000","last_peered":"2024-01-20T08:13:19.145639+0000","last_clean":"2024-01-20T08:13:19.145639+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:19.145639+0000","last_undegraded":"2024-01-20T08:13:19.145639+0000","last_fullsized":"2024-01-20T08:13:19.145639+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.752},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.3500000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.5329999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.27},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":0.89900000000000002}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.2170000000000001},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1299999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.5980000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.399}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.571},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.718}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.0669999999999999},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5740000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.4530000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.4870000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4279999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3320000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.373},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.619}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6719999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.5349999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.38},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.436}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.41299999999999998},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.55400000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":0.48099999999999998},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.49199999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.51000000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":0.65500000000000003}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.628},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":0.59699999999999998}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":0.72199999999999998},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":0.73399999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.70499999999999996},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.351}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.97599999999999998},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.6819999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.024},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.179}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.48},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.129}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.6559999999999999},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.593}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.268},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.5309999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.736},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.825}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32024,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339816,"statfs":{"total":96636764160,"available":96603971584,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":1.653},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.98299999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.86099999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":1.028},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.4630000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.331}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":1.353},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":1.5129999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.395},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.5760000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.6120000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.2470000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":373395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.57299999999999995}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.371},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.44400000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.82199999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":0.81200000000000006}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.76300000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.69599999999999995},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.58999999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32008,"kb_used_data":828,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339832,"statfs":{"total":96636764160,"available":96603987968,"internally_reserved":0,"allocated":847872,"data_stored":367120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.42799999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.371}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.78200000000000003}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.67000000000000004},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.79300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":0.80800000000000005}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574891,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32604,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339236,"statfs":{"total":96636764160,"available":96603377664,"internally_reserved":0,"allocated":1454080,"data_stored":963763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.55100000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88900000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.0680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.0329999999999999},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.2310000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.6499999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.597},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.1499999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.212},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.113}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:30.620 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.835+0000 7fd40c200640 1 Processor -- start 2024-01-20T08:13:30.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.835+0000 7fd40c200640 1 -- start start 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.836+0000 7fd40c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4040a93c0 0x7fd404153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.836+0000 7fd40c200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd4040aae00 0x7fd4040ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.836+0000 7fd40c200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4040a9940 con 0x7fd40414fce0 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.836+0000 7fd40c200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4041500c0 con 0x7fd4040aae00 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.836+0000 7fd40c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd404156810 con 0x7fd4040a93c0 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd4040aae00 0x7fd4040ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd4040aae00 0x7fd4040ab2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41980/0 (socket says 172.21.15.100:41980) 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 -- 172.21.15.100:0/2947686060 learned_addr learned my addr 172.21.15.100:0/2947686060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd408e00640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4040a93c0 0x7fd404153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 -- 172.21.15.100:0/2947686060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4040a93c0 msgr2=0x7fd404153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:30.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4040a93c0 0x7fd404153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 -- 172.21.15.100:0/2947686060 >> v1:172.21.15.110:6789/0 conn(0x7fd40414fce0 legacy=0x7fd404152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.837+0000 7fd40a200640 1 -- 172.21.15.100:0/2947686060 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd404156af0 con 0x7fd4040aae00 2024-01-20T08:13:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.838+0000 7fd40a200640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd4040ab2b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009870 tx=0x7fd3fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54250396438a69ea server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:30.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd403e00640 1 -- 172.21.15.100:0/2947686060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc031640 con 0x7fd4040aae00 2024-01-20T08:13:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd403e00640 1 -- 172.21.15.100:0/2947686060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3fc0317a0 con 0x7fd4040aae00 2024-01-20T08:13:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd403e00640 1 -- 172.21.15.100:0/2947686060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc031b30 con 0x7fd4040aae00 2024-01-20T08:13:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 -- 172.21.15.100:0/2947686060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 msgr2=0x7fd4040ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd4040ab2b0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc009870 tx=0x7fd3fc02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 -- 172.21.15.100:0/2947686060 shutdown_connections 2024-01-20T08:13:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd4040ab2b0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 --2- 172.21.15.100:0/2947686060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd4040a93c0 0x7fd404153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.839+0000 7fd40c200640 1 -- 172.21.15.100:0/2947686060 >> 172.21.15.100:0/2947686060 conn(0x7fd40406a5e0 msgr2=0x7fd40406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.840+0000 7fd40c200640 1 -- 172.21.15.100:0/2947686060 shutdown_connections 2024-01-20T08:13:30.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.840+0000 7fd40c200640 1 -- 172.21.15.100:0/2947686060 wait complete. 2024-01-20T08:13:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.841+0000 7fd40c200640 1 Processor -- start 2024-01-20T08:13:30.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.841+0000 7fd40c200640 1 -- start start 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 0x7fd404151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40414fce0 0x7fd40414c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c5850 con 0x7fd4040aae00 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4040c5e10 con 0x7fd4040a93c0 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd40c200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4041eafd0 con 0x7fd40414fce0 2024-01-20T08:13:30.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd408e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd408e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:41994/0 (socket says 172.21.15.100:41994) 2024-01-20T08:13:30.846 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.842+0000 7fd408e00640 1 -- 172.21.15.100:0/3355391914 learned_addr learned my addr 172.21.15.100:0/3355391914 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd40a200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40414fce0 0x7fd40414c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd409800640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 0x7fd404151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 -- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40414fce0 msgr2=0x7fd40414c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40414fce0 0x7fd40414c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 -- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 msgr2=0x7fd404151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 0x7fd404151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 -- 172.21.15.100:0/3355391914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc0094d0 con 0x7fd4040aae00 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd409800640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 0x7fd404151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:30.847 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd408e00640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c7f0 tx=0x7fd3ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec004220 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ec0043a0 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ec007860 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.843+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4041eb2b0 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.844+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4040c27d0 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.845+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40404e970 con 0x7fd4040aae00 2024-01-20T08:13:30.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.846+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd3ec007bd0 con 0x7fd4040aae00 2024-01-20T08:13:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.846+0000 7fd401600640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 0x7fd3dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.847+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3ec0895c0 con 0x7fd4040aae00 2024-01-20T08:13:30.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.847+0000 7fd409800640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 0x7fd3dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:30.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.847+0000 7fd409800640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 0x7fd3dc06d390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007e90 tx=0x7fd3f40073a0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:30.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:30.851+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd3ec054480 con 0x7fd4040aae00 2024-01-20T08:13:31.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.040+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd404152690 con 0x7fd3dc06aed0 2024-01-20T08:13:31.054 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.051+0000 7fd401600640 1 -- 172.21.15.100:0/3355391914 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286666 (secure 0 0 0) 0x7fd3f400cdb0 con 0x7fd3dc06aed0 2024-01-20T08:13:31.056 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:31.060 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 msgr2=0x7fd3dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 0x7fd3dc06d390 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fd3f4007e90 tx=0x7fd3f40073a0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 msgr2=0x7fd40414bd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec00c7f0 tx=0x7fd3ec00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 shutdown_connections 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd3dc06aed0 0x7fd3dc06d390 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd40414fce0 0x7fd40414c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd4040aae00 0x7fd40414bd40 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 --2- 172.21.15.100:0/3355391914 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd4040a93c0 0x7fd404151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.058+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 >> 172.21.15.100:0/3355391914 conn(0x7fd40406a5e0 msgr2=0x7fd40414dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.059+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 shutdown_connections 2024-01-20T08:13:31.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.059+0000 7fd40c200640 1 -- 172.21.15.100:0/3355391914 wait complete. 2024-01-20T08:13:31.079 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":170,"stamp":"2024-01-20T08:13:29.950787+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253440,"kb_used_data":8136,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721280,"statfs":{"total":773094113280,"available":772834590720,"internally_reserved":0,"allocated":8331264,"data_stored":4277316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":59,"apply_latency_ms":59,"commit_latency_ns":59000000,"apply_latency_ns":59000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.781107"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.433160+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:22.433160+0000","last_peered":"2024-01-20T08:13:22.433160+0000","last_clean":"2024-01-20T08:13:22.433160+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:22.433160+0000","last_undegraded":"2024-01-20T08:13:22.433160+0000","last_fullsized":"2024-01-20T08:13:22.433160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430373+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:22.430373+0000","last_peered":"2024-01-20T08:13:22.430373+0000","last_clean":"2024-01-20T08:13:22.430373+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:22.430373+0000","last_undegraded":"2024-01-20T08:13:22.430373+0000","last_fullsized":"2024-01-20T08:13:22.430373+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432173+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:22.432173+0000","last_peered":"2024-01-20T08:13:22.432173+0000","last_clean":"2024-01-20T08:13:22.432173+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:22.432173+0000","last_undegraded":"2024-01-20T08:13:22.432173+0000","last_fullsized":"2024-01-20T08:13:22.432173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429562+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:22.429562+0000","last_peered":"2024-01-20T08:13:22.429562+0000","last_clean":"2024-01-20T08:13:22.429562+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:22.429562+0000","last_undegraded":"2024-01-20T08:13:22.429562+0000","last_fullsized":"2024-01-20T08:13:22.429562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.200999+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:22.200999+0000","last_peered":"2024-01-20T08:13:22.200999+0000","last_clean":"2024-01-20T08:13:22.200999+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:22.200999+0000","last_undegraded":"2024-01-20T08:13:22.200999+0000","last_fullsized":"2024-01-20T08:13:22.200999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429110+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:22.429110+0000","last_peered":"2024-01-20T08:13:22.429110+0000","last_clean":"2024-01-20T08:13:22.429110+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:22.429110+0000","last_undegraded":"2024-01-20T08:13:22.429110+0000","last_fullsized":"2024-01-20T08:13:22.429110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.427718+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:22.427718+0000","last_peered":"2024-01-20T08:13:22.427718+0000","last_clean":"2024-01-20T08:13:22.427718+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:22.427718+0000","last_undegraded":"2024-01-20T08:13:22.427718+0000","last_fullsized":"2024-01-20T08:13:22.427718+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429125+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:22.429125+0000","last_peered":"2024-01-20T08:13:22.429125+0000","last_clean":"2024-01-20T08:13:22.429125+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:22.429125+0000","last_undegraded":"2024-01-20T08:13:22.429125+0000","last_fullsized":"2024-01-20T08:13:22.429125+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430173+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:22.430173+0000","last_peered":"2024-01-20T08:13:22.430173+0000","last_clean":"2024-01-20T08:13:22.430173+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:22.430173+0000","last_undegraded":"2024-01-20T08:13:22.430173+0000","last_fullsized":"2024-01-20T08:13:22.430173+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.433504+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:22.433504+0000","last_peered":"2024-01-20T08:13:22.433504+0000","last_clean":"2024-01-20T08:13:22.433504+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:22.433504+0000","last_undegraded":"2024-01-20T08:13:22.433504+0000","last_fullsized":"2024-01-20T08:13:22.433504+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430228+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:22.430228+0000","last_peered":"2024-01-20T08:13:22.430228+0000","last_clean":"2024-01-20T08:13:22.430228+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:22.430228+0000","last_undegraded":"2024-01-20T08:13:22.430228+0000","last_fullsized":"2024-01-20T08:13:22.430228+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.431635+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:22.431635+0000","last_peered":"2024-01-20T08:13:22.431635+0000","last_clean":"2024-01-20T08:13:22.431635+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:22.431635+0000","last_undegraded":"2024-01-20T08:13:22.431635+0000","last_fullsized":"2024-01-20T08:13:22.431635+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430355+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:22.430355+0000","last_peered":"2024-01-20T08:13:22.430355+0000","last_clean":"2024-01-20T08:13:22.430355+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:22.430355+0000","last_undegraded":"2024-01-20T08:13:22.430355+0000","last_fullsized":"2024-01-20T08:13:22.430355+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428463+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:22.428463+0000","last_peered":"2024-01-20T08:13:22.428463+0000","last_clean":"2024-01-20T08:13:22.428463+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:22.428463+0000","last_undegraded":"2024-01-20T08:13:22.428463+0000","last_fullsized":"2024-01-20T08:13:22.428463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.199369+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:22.199369+0000","last_peered":"2024-01-20T08:13:22.199369+0000","last_clean":"2024-01-20T08:13:22.199369+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:22.199369+0000","last_undegraded":"2024-01-20T08:13:22.199369+0000","last_fullsized":"2024-01-20T08:13:22.199369+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.200447+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:22.200447+0000","last_peered":"2024-01-20T08:13:22.200447+0000","last_clean":"2024-01-20T08:13:22.200447+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:22.200447+0000","last_undegraded":"2024-01-20T08:13:22.200447+0000","last_fullsized":"2024-01-20T08:13:22.200447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201519+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:22.201519+0000","last_peered":"2024-01-20T08:13:22.201519+0000","last_clean":"2024-01-20T08:13:22.201519+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:22.201519+0000","last_undegraded":"2024-01-20T08:13:22.201519+0000","last_fullsized":"2024-01-20T08:13:22.201519+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429209+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:22.429209+0000","last_peered":"2024-01-20T08:13:22.429209+0000","last_clean":"2024-01-20T08:13:22.429209+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:22.429209+0000","last_undegraded":"2024-01-20T08:13:22.429209+0000","last_fullsized":"2024-01-20T08:13:22.429209+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.196885+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:22.196885+0000","last_peered":"2024-01-20T08:13:22.196885+0000","last_clean":"2024-01-20T08:13:22.196885+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:22.196885+0000","last_undegraded":"2024-01-20T08:13:22.196885+0000","last_fullsized":"2024-01-20T08:13:22.196885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429739+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:22.429739+0000","last_peered":"2024-01-20T08:13:22.429739+0000","last_clean":"2024-01-20T08:13:22.429739+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:22.429739+0000","last_undegraded":"2024-01-20T08:13:22.429739+0000","last_fullsized":"2024-01-20T08:13:22.429739+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429499+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:22.429499+0000","last_peered":"2024-01-20T08:13:22.429499+0000","last_clean":"2024-01-20T08:13:22.429499+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:22.429499+0000","last_undegraded":"2024-01-20T08:13:22.429499+0000","last_fullsized":"2024-01-20T08:13:22.429499+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428443+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:22.428443+0000","last_peered":"2024-01-20T08:13:22.428443+0000","last_clean":"2024-01-20T08:13:22.428443+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:22.428443+0000","last_undegraded":"2024-01-20T08:13:22.428443+0000","last_fullsized":"2024-01-20T08:13:22.428443+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.431858+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:22.431858+0000","last_peered":"2024-01-20T08:13:22.431858+0000","last_clean":"2024-01-20T08:13:22.431858+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:22.431858+0000","last_undegraded":"2024-01-20T08:13:22.431858+0000","last_fullsized":"2024-01-20T08:13:22.431858+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.427567+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:22.427567+0000","last_peered":"2024-01-20T08:13:22.427567+0000","last_clean":"2024-01-20T08:13:22.427567+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:22.427567+0000","last_undegraded":"2024-01-20T08:13:22.427567+0000","last_fullsized":"2024-01-20T08:13:22.427567+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430045+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:22.430045+0000","last_peered":"2024-01-20T08:13:22.430045+0000","last_clean":"2024-01-20T08:13:22.430045+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:22.430045+0000","last_undegraded":"2024-01-20T08:13:22.430045+0000","last_fullsized":"2024-01-20T08:13:22.430045+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432339+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:22.432339+0000","last_peered":"2024-01-20T08:13:22.432339+0000","last_clean":"2024-01-20T08:13:22.432339+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:22.432339+0000","last_undegraded":"2024-01-20T08:13:22.432339+0000","last_fullsized":"2024-01-20T08:13:22.432339+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201130+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:22.201130+0000","last_peered":"2024-01-20T08:13:22.201130+0000","last_clean":"2024-01-20T08:13:22.201130+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:22.201130+0000","last_undegraded":"2024-01-20T08:13:22.201130+0000","last_fullsized":"2024-01-20T08:13:22.201130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.431948+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:22.431948+0000","last_peered":"2024-01-20T08:13:22.431948+0000","last_clean":"2024-01-20T08:13:22.431948+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:22.431948+0000","last_undegraded":"2024-01-20T08:13:22.431948+0000","last_fullsized":"2024-01-20T08:13:22.431948+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429610+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:22.429610+0000","last_peered":"2024-01-20T08:13:22.429610+0000","last_clean":"2024-01-20T08:13:22.429610+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:22.429610+0000","last_undegraded":"2024-01-20T08:13:22.429610+0000","last_fullsized":"2024-01-20T08:13:22.429610+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428562+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:22.428562+0000","last_peered":"2024-01-20T08:13:22.428562+0000","last_clean":"2024-01-20T08:13:22.428562+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:22.428562+0000","last_undegraded":"2024-01-20T08:13:22.428562+0000","last_fullsized":"2024-01-20T08:13:22.428562+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.200568+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:22.200568+0000","last_peered":"2024-01-20T08:13:22.200568+0000","last_clean":"2024-01-20T08:13:22.200568+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:22.200568+0000","last_undegraded":"2024-01-20T08:13:22.200568+0000","last_fullsized":"2024-01-20T08:13:22.200568+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430986+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:22.430986+0000","last_peered":"2024-01-20T08:13:22.430986+0000","last_clean":"2024-01-20T08:13:22.430986+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:22.430986+0000","last_undegraded":"2024-01-20T08:13:22.430986+0000","last_fullsized":"2024-01-20T08:13:22.430986+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201384+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:22.201384+0000","last_peered":"2024-01-20T08:13:22.201384+0000","last_clean":"2024-01-20T08:13:22.201384+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:22.201384+0000","last_undegraded":"2024-01-20T08:13:22.201384+0000","last_fullsized":"2024-01-20T08:13:22.201384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.223094+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:21.223094+0000","last_peered":"2024-01-20T08:13:21.223094+0000","last_clean":"2024-01-20T08:13:21.223094+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:21.223094+0000","last_undegraded":"2024-01-20T08:13:21.223094+0000","last_fullsized":"2024-01-20T08:13:21.223094+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.433328+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:22.433328+0000","last_peered":"2024-01-20T08:13:22.433328+0000","last_clean":"2024-01-20T08:13:22.433328+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:22.433328+0000","last_undegraded":"2024-01-20T08:13:22.433328+0000","last_fullsized":"2024-01-20T08:13:22.433328+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.219146+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:21.219146+0000","last_peered":"2024-01-20T08:13:21.219146+0000","last_clean":"2024-01-20T08:13:21.219146+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:21.219146+0000","last_undegraded":"2024-01-20T08:13:21.219146+0000","last_fullsized":"2024-01-20T08:13:21.219146+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432108+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:22.432108+0000","last_peered":"2024-01-20T08:13:22.432108+0000","last_clean":"2024-01-20T08:13:22.432108+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:22.432108+0000","last_undegraded":"2024-01-20T08:13:22.432108+0000","last_fullsized":"2024-01-20T08:13:22.432108+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.223863+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:21.223863+0000","last_peered":"2024-01-20T08:13:21.223863+0000","last_clean":"2024-01-20T08:13:21.223863+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:21.223863+0000","last_undegraded":"2024-01-20T08:13:21.223863+0000","last_fullsized":"2024-01-20T08:13:21.223863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432543+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:22.432543+0000","last_peered":"2024-01-20T08:13:22.432543+0000","last_clean":"2024-01-20T08:13:22.432543+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:22.432543+0000","last_undegraded":"2024-01-20T08:13:22.432543+0000","last_fullsized":"2024-01-20T08:13:22.432543+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.223675+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:21.223675+0000","last_peered":"2024-01-20T08:13:21.223675+0000","last_clean":"2024-01-20T08:13:21.223675+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:21.223675+0000","last_undegraded":"2024-01-20T08:13:21.223675+0000","last_fullsized":"2024-01-20T08:13:21.223675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428687+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:22.428687+0000","last_peered":"2024-01-20T08:13:22.428687+0000","last_clean":"2024-01-20T08:13:22.428687+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:22.428687+0000","last_undegraded":"2024-01-20T08:13:22.428687+0000","last_fullsized":"2024-01-20T08:13:22.428687+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.220439+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:21.220439+0000","last_peered":"2024-01-20T08:13:21.220439+0000","last_clean":"2024-01-20T08:13:21.220439+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:21.220439+0000","last_undegraded":"2024-01-20T08:13:21.220439+0000","last_fullsized":"2024-01-20T08:13:21.220439+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201130+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:22.201130+0000","last_peered":"2024-01-20T08:13:22.201130+0000","last_clean":"2024-01-20T08:13:22.201130+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:22.201130+0000","last_undegraded":"2024-01-20T08:13:22.201130+0000","last_fullsized":"2024-01-20T08:13:22.201130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.219844+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:21.219844+0000","last_peered":"2024-01-20T08:13:21.219844+0000","last_clean":"2024-01-20T08:13:21.219844+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:21.219844+0000","last_undegraded":"2024-01-20T08:13:21.219844+0000","last_fullsized":"2024-01-20T08:13:21.219844+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430913+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:22.430913+0000","last_peered":"2024-01-20T08:13:22.430913+0000","last_clean":"2024-01-20T08:13:22.430913+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:22.430913+0000","last_undegraded":"2024-01-20T08:13:22.430913+0000","last_fullsized":"2024-01-20T08:13:22.430913+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.201896+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:21.201896+0000","last_peered":"2024-01-20T08:13:21.201896+0000","last_clean":"2024-01-20T08:13:21.201896+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:21.201896+0000","last_undegraded":"2024-01-20T08:13:21.201896+0000","last_fullsized":"2024-01-20T08:13:21.201896+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.199225+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:22.199225+0000","last_peered":"2024-01-20T08:13:22.199225+0000","last_clean":"2024-01-20T08:13:22.199225+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:22.199225+0000","last_undegraded":"2024-01-20T08:13:22.199225+0000","last_fullsized":"2024-01-20T08:13:22.199225+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.176596+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:21.176596+0000","last_peered":"2024-01-20T08:13:21.176596+0000","last_clean":"2024-01-20T08:13:21.176596+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:21.176596+0000","last_undegraded":"2024-01-20T08:13:21.176596+0000","last_fullsized":"2024-01-20T08:13:21.176596+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.199985+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:22.199985+0000","last_peered":"2024-01-20T08:13:22.199985+0000","last_clean":"2024-01-20T08:13:22.199985+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:22.199985+0000","last_undegraded":"2024-01-20T08:13:22.199985+0000","last_fullsized":"2024-01-20T08:13:22.199985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.197837+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:21.197837+0000","last_peered":"2024-01-20T08:13:21.197837+0000","last_clean":"2024-01-20T08:13:21.197837+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:21.197837+0000","last_undegraded":"2024-01-20T08:13:21.197837+0000","last_fullsized":"2024-01-20T08:13:21.197837+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430510+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:22.430510+0000","last_peered":"2024-01-20T08:13:22.430510+0000","last_clean":"2024-01-20T08:13:22.430510+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:22.430510+0000","last_undegraded":"2024-01-20T08:13:22.430510+0000","last_fullsized":"2024-01-20T08:13:22.430510+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.196968+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:21.196968+0000","last_peered":"2024-01-20T08:13:21.196968+0000","last_clean":"2024-01-20T08:13:21.196968+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:21.196968+0000","last_undegraded":"2024-01-20T08:13:21.196968+0000","last_fullsized":"2024-01-20T08:13:21.196968+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.197155+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:22.197155+0000","last_peered":"2024-01-20T08:13:22.197155+0000","last_clean":"2024-01-20T08:13:22.197155+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:22.197155+0000","last_undegraded":"2024-01-20T08:13:22.197155+0000","last_fullsized":"2024-01-20T08:13:22.197155+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":15,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.224682+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:21.224682+0000","last_peered":"2024-01-20T08:13:21.224682+0000","last_clean":"2024-01-20T08:13:21.224682+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:21.224682+0000","last_undegraded":"2024-01-20T08:13:21.224682+0000","last_fullsized":"2024-01-20T08:13:21.224682+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201140+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:22.201140+0000","last_peered":"2024-01-20T08:13:22.201140+0000","last_clean":"2024-01-20T08:13:22.201140+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:22.201140+0000","last_undegraded":"2024-01-20T08:13:22.201140+0000","last_fullsized":"2024-01-20T08:13:22.201140+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"71'6","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.225447+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:21.225447+0000","last_peered":"2024-01-20T08:13:21.225447+0000","last_clean":"2024-01-20T08:13:21.225447+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:21.225447+0000","last_undegraded":"2024-01-20T08:13:21.225447+0000","last_fullsized":"2024-01-20T08:13:21.225447+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.196798+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:22.196798+0000","last_peered":"2024-01-20T08:13:22.196798+0000","last_clean":"2024-01-20T08:13:22.196798+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:22.196798+0000","last_undegraded":"2024-01-20T08:13:22.196798+0000","last_fullsized":"2024-01-20T08:13:22.196798+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.224504+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:21.224504+0000","last_peered":"2024-01-20T08:13:21.224504+0000","last_clean":"2024-01-20T08:13:21.224504+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:21.224504+0000","last_undegraded":"2024-01-20T08:13:21.224504+0000","last_fullsized":"2024-01-20T08:13:21.224504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.431313+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:22.431313+0000","last_peered":"2024-01-20T08:13:22.431313+0000","last_clean":"2024-01-20T08:13:22.431313+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:22.431313+0000","last_undegraded":"2024-01-20T08:13:22.431313+0000","last_fullsized":"2024-01-20T08:13:22.431313+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.174097+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:21.174097+0000","last_peered":"2024-01-20T08:13:21.174097+0000","last_clean":"2024-01-20T08:13:21.174097+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:21.174097+0000","last_undegraded":"2024-01-20T08:13:21.174097+0000","last_fullsized":"2024-01-20T08:13:21.174097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428891+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:22.428891+0000","last_peered":"2024-01-20T08:13:22.428891+0000","last_clean":"2024-01-20T08:13:22.428891+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:22.428891+0000","last_undegraded":"2024-01-20T08:13:22.428891+0000","last_fullsized":"2024-01-20T08:13:22.428891+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.193331+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:21.193331+0000","last_peered":"2024-01-20T08:13:21.193331+0000","last_clean":"2024-01-20T08:13:21.193331+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:21.193331+0000","last_undegraded":"2024-01-20T08:13:21.193331+0000","last_fullsized":"2024-01-20T08:13:21.193331+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428146+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:22.428146+0000","last_peered":"2024-01-20T08:13:22.428146+0000","last_clean":"2024-01-20T08:13:22.428146+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:22.428146+0000","last_undegraded":"2024-01-20T08:13:22.428146+0000","last_fullsized":"2024-01-20T08:13:22.428146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":20,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.222871+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:21.222871+0000","last_peered":"2024-01-20T08:13:21.222871+0000","last_clean":"2024-01-20T08:13:21.222871+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:21.222871+0000","last_undegraded":"2024-01-20T08:13:21.222871+0000","last_fullsized":"2024-01-20T08:13:21.222871+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432711+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:22.432711+0000","last_peered":"2024-01-20T08:13:22.432711+0000","last_clean":"2024-01-20T08:13:22.432711+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:22.432711+0000","last_undegraded":"2024-01-20T08:13:22.432711+0000","last_fullsized":"2024-01-20T08:13:22.432711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.222900+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:21.222900+0000","last_peered":"2024-01-20T08:13:21.222900+0000","last_clean":"2024-01-20T08:13:21.222900+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:21.222900+0000","last_undegraded":"2024-01-20T08:13:21.222900+0000","last_fullsized":"2024-01-20T08:13:21.222900+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.433584+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:22.433584+0000","last_peered":"2024-01-20T08:13:22.433584+0000","last_clean":"2024-01-20T08:13:22.433584+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:22.433584+0000","last_undegraded":"2024-01-20T08:13:22.433584+0000","last_fullsized":"2024-01-20T08:13:22.433584+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.220106+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:21.220106+0000","last_peered":"2024-01-20T08:13:21.220106+0000","last_clean":"2024-01-20T08:13:21.220106+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:21.220106+0000","last_undegraded":"2024-01-20T08:13:21.220106+0000","last_fullsized":"2024-01-20T08:13:21.220106+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201536+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:22.201536+0000","last_peered":"2024-01-20T08:13:22.201536+0000","last_clean":"2024-01-20T08:13:22.201536+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:22.201536+0000","last_undegraded":"2024-01-20T08:13:22.201536+0000","last_fullsized":"2024-01-20T08:13:22.201536+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.207722+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:21.207722+0000","last_peered":"2024-01-20T08:13:21.207722+0000","last_clean":"2024-01-20T08:13:21.207722+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:21.207722+0000","last_undegraded":"2024-01-20T08:13:21.207722+0000","last_fullsized":"2024-01-20T08:13:21.207722+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.428511+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:22.428511+0000","last_peered":"2024-01-20T08:13:22.428511+0000","last_clean":"2024-01-20T08:13:22.428511+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:22.428511+0000","last_undegraded":"2024-01-20T08:13:22.428511+0000","last_fullsized":"2024-01-20T08:13:22.428511+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.220951+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:21.220951+0000","last_peered":"2024-01-20T08:13:21.220951+0000","last_clean":"2024-01-20T08:13:21.220951+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:21.220951+0000","last_undegraded":"2024-01-20T08:13:21.220951+0000","last_fullsized":"2024-01-20T08:13:21.220951+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429171+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:22.429171+0000","last_peered":"2024-01-20T08:13:22.429171+0000","last_clean":"2024-01-20T08:13:22.429171+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:22.429171+0000","last_undegraded":"2024-01-20T08:13:22.429171+0000","last_fullsized":"2024-01-20T08:13:22.429171+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.198118+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:21.198118+0000","last_peered":"2024-01-20T08:13:21.198118+0000","last_clean":"2024-01-20T08:13:21.198118+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:21.198118+0000","last_undegraded":"2024-01-20T08:13:21.198118+0000","last_fullsized":"2024-01-20T08:13:21.198118+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.427788+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:22.427788+0000","last_peered":"2024-01-20T08:13:22.427788+0000","last_clean":"2024-01-20T08:13:22.427788+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:22.427788+0000","last_undegraded":"2024-01-20T08:13:22.427788+0000","last_fullsized":"2024-01-20T08:13:22.427788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.197774+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:21.197774+0000","last_peered":"2024-01-20T08:13:21.197774+0000","last_clean":"2024-01-20T08:13:21.197774+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:21.197774+0000","last_undegraded":"2024-01-20T08:13:21.197774+0000","last_fullsized":"2024-01-20T08:13:21.197774+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429110+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:22.429110+0000","last_peered":"2024-01-20T08:13:22.429110+0000","last_clean":"2024-01-20T08:13:22.429110+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:22.429110+0000","last_undegraded":"2024-01-20T08:13:22.429110+0000","last_fullsized":"2024-01-20T08:13:22.429110+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.174333+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:21.174333+0000","last_peered":"2024-01-20T08:13:21.174333+0000","last_clean":"2024-01-20T08:13:21.174333+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:21.174333+0000","last_undegraded":"2024-01-20T08:13:21.174333+0000","last_fullsized":"2024-01-20T08:13:21.174333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201403+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:22.201403+0000","last_peered":"2024-01-20T08:13:22.201403+0000","last_clean":"2024-01-20T08:13:22.201403+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:22.201403+0000","last_undegraded":"2024-01-20T08:13:22.201403+0000","last_fullsized":"2024-01-20T08:13:22.201403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.223977+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:21.223977+0000","last_peered":"2024-01-20T08:13:21.223977+0000","last_clean":"2024-01-20T08:13:21.223977+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:21.223977+0000","last_undegraded":"2024-01-20T08:13:21.223977+0000","last_fullsized":"2024-01-20T08:13:21.223977+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432586+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:22.432586+0000","last_peered":"2024-01-20T08:13:22.432586+0000","last_clean":"2024-01-20T08:13:22.432586+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:22.432586+0000","last_undegraded":"2024-01-20T08:13:22.432586+0000","last_fullsized":"2024-01-20T08:13:22.432586+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":13,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.430429+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:22.430429+0000","last_peered":"2024-01-20T08:13:22.430429+0000","last_clean":"2024-01-20T08:13:22.430429+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:22.430429+0000","last_undegraded":"2024-01-20T08:13:22.430429+0000","last_fullsized":"2024-01-20T08:13:22.430429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432571+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:22.432571+0000","last_peered":"2024-01-20T08:13:22.432571+0000","last_clean":"2024-01-20T08:13:22.432571+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:22.432571+0000","last_undegraded":"2024-01-20T08:13:22.432571+0000","last_fullsized":"2024-01-20T08:13:22.432571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.189559+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:21.189559+0000","last_peered":"2024-01-20T08:13:21.189559+0000","last_clean":"2024-01-20T08:13:21.189559+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:21.189559+0000","last_undegraded":"2024-01-20T08:13:21.189559+0000","last_fullsized":"2024-01-20T08:13:21.189559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.201523+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:22.201523+0000","last_peered":"2024-01-20T08:13:22.201523+0000","last_clean":"2024-01-20T08:13:22.201523+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:22.201523+0000","last_undegraded":"2024-01-20T08:13:22.201523+0000","last_fullsized":"2024-01-20T08:13:22.201523+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.197796+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:21.197796+0000","last_peered":"2024-01-20T08:13:21.197796+0000","last_clean":"2024-01-20T08:13:21.197796+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:21.197796+0000","last_undegraded":"2024-01-20T08:13:21.197796+0000","last_fullsized":"2024-01-20T08:13:21.197796+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429408+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:22.429408+0000","last_peered":"2024-01-20T08:13:22.429408+0000","last_clean":"2024-01-20T08:13:22.429408+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:22.429408+0000","last_undegraded":"2024-01-20T08:13:22.429408+0000","last_fullsized":"2024-01-20T08:13:22.429408+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.210037+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:21.210037+0000","last_peered":"2024-01-20T08:13:21.210037+0000","last_clean":"2024-01-20T08:13:21.210037+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:21.210037+0000","last_undegraded":"2024-01-20T08:13:21.210037+0000","last_fullsized":"2024-01-20T08:13:21.210037+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.196872+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:22.196872+0000","last_peered":"2024-01-20T08:13:22.196872+0000","last_clean":"2024-01-20T08:13:22.196872+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:22.196872+0000","last_undegraded":"2024-01-20T08:13:22.196872+0000","last_fullsized":"2024-01-20T08:13:22.196872+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.176429+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:21.176429+0000","last_peered":"2024-01-20T08:13:21.176429+0000","last_clean":"2024-01-20T08:13:21.176429+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:21.176429+0000","last_undegraded":"2024-01-20T08:13:21.176429+0000","last_fullsized":"2024-01-20T08:13:21.176429+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429689+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:22.429689+0000","last_peered":"2024-01-20T08:13:22.429689+0000","last_clean":"2024-01-20T08:13:22.429689+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:22.429689+0000","last_undegraded":"2024-01-20T08:13:22.429689+0000","last_fullsized":"2024-01-20T08:13:22.429689+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.194821+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:21.194821+0000","last_peered":"2024-01-20T08:13:21.194821+0000","last_clean":"2024-01-20T08:13:21.194821+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:21.194821+0000","last_undegraded":"2024-01-20T08:13:21.194821+0000","last_fullsized":"2024-01-20T08:13:21.194821+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.432118+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:22.432118+0000","last_peered":"2024-01-20T08:13:22.432118+0000","last_clean":"2024-01-20T08:13:22.432118+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:22.432118+0000","last_undegraded":"2024-01-20T08:13:22.432118+0000","last_fullsized":"2024-01-20T08:13:22.432118+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.177193+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:21.177193+0000","last_peered":"2024-01-20T08:13:21.177193+0000","last_clean":"2024-01-20T08:13:21.177193+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:21.177193+0000","last_undegraded":"2024-01-20T08:13:21.177193+0000","last_fullsized":"2024-01-20T08:13:21.177193+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":11,"reported_epoch":72,"state":"active+clean","last_fresh":"2024-01-20T08:13:22.429490+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:22.429490+0000","last_peered":"2024-01-20T08:13:22.429490+0000","last_clean":"2024-01-20T08:13:22.429490+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:22.429490+0000","last_undegraded":"2024-01-20T08:13:22.429490+0000","last_fullsized":"2024-01-20T08:13:22.429490+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.224306+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:21.224306+0000","last_peered":"2024-01-20T08:13:21.224306+0000","last_clean":"2024-01-20T08:13:21.224306+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:21.224306+0000","last_undegraded":"2024-01-20T08:13:21.224306+0000","last_fullsized":"2024-01-20T08:13:21.224306+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":209,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-01-20T08:13:21.190987+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:21.190987+0000","last_peered":"2024-01-20T08:13:21.190987+0000","last_clean":"2024-01-20T08:13:21.190987+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:21.190987+0000","last_undegraded":"2024-01-20T08:13:21.190987+0000","last_fullsized":"2024-01-20T08:13:21.190987+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574892,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":976908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":1.609},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.4059999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.6970000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.3100000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.49}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.1919999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1399999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.8240000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.9239999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.637},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.3720000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.5509999999999999},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.7629999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574891,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":387164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.879},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.64900000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.383}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.532},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.252}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.339}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.425},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.097}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.204},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.153}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.49},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.6339999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574891,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":901120,"data_stored":388104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2110000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.86299999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.96499999999999997}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":1.419},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92900000000000005}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.554}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.036},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.3799999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.75},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.175}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2889999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.659}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32048,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339792,"statfs":{"total":96636764160,"available":96603947008,"internally_reserved":0,"allocated":884736,"data_stored":386470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.619}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.7709999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.27},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4239999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.365},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.534}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.198},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.573}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.7370000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.6910000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.488},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.663}]}]},{"osd":3,"up_from":13,"seq":55834574891,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":388082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.67500000000000004}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.58699999999999997}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":0.629},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.69899999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.0109999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":0.76800000000000002},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":0.91900000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.282},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.194}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":0.98599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574891,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":888832,"data_stored":387052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.752},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.90400000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.0269999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.70799999999999996}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.998},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.125}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":0.95099999999999996}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":1.419},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.3640000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.454}]}]},{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32060,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339780,"statfs":{"total":96636764160,"available":96603934720,"internally_reserved":0,"allocated":897024,"data_stored":386664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":1.2509999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":1.4870000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":1.0680000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":1.181},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":1.3560000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":1.1639999999999999},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2909999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.4419999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4019999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574892,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32628,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339212,"statfs":{"total":96636764160,"available":96603353088,"internally_reserved":0,"allocated":1482752,"data_stored":976872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.59799999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.054}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.2390000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.3160000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.115},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.8839999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.6639999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.8300000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.577},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.413}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:31.118 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:13:31.118 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-01-20T08:13:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.335+0000 7f0c7e600640 1 Processor -- start 2024-01-20T08:13:31.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.335+0000 7f0c7e600640 1 -- start start 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c7e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c780c1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c7e600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7815d1f0 con 0x7f0c7815c650 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c7e600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c780704b0 con 0x7f0c78156230 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c7e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78070790 con 0x7f0c780c1000 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c77e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0c7815c650 0x7f0c7815cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34906/0 (socket says 172.21.15.100:34906) 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c77e00640 1 -- 172.21.15.100:0/3733025021 learned_addr learned my addr 172.21.15.100:0/3733025021 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:31.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c76a00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c780c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.337+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 589822444 0 0) 0x7f0c7815d1f0 con 0x7f0c7815c650 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c58003520 con 0x7f0c7815c650 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2009721423 0 0) 0x7f0c58003520 con 0x7f0c7815c650 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 msgr2=0x7f0c780c1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c780c1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 >> v1:172.21.15.110:6789/0 conn(0x7f0c78156230 legacy=0x7f0c78159740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c78070a70 con 0x7f0c7815c650 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f0c700019f0 con 0x7f0c7815c650 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 >> v1:172.21.15.100:6789/0 conn(0x7f0c7815c650 legacy=0x7f0c7815cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c580039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c58003f20 0x7f0c580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c58004d00 0x7f0c58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c78070790 con 0x7f0c58004d00 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5800bbc0 con 0x7f0c58003f20 2024-01-20T08:13:31.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c5800bd80 con 0x7f0c780c1000 2024-01-20T08:13:31.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.338+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c58004d00 0x7f0c58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77400640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c580039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c76a00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c58003f20 0x7f0c580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77e00640 1 -- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 msgr2=0x7f0c580039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c780c1000 0x7f0c580039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77e00640 1 -- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c58003f20 msgr2=0x7f0c580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c58003f20 0x7f0c580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c77e00640 1 -- 172.21.15.100:0/3733025021 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c58003520 con 0x7f0c58004d00 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.339+0000 7f0c76a00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c58003f20 0x7f0c580047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.340+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c58004d00 0x7f0c58005180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000a830 tx=0x7f0c580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894de2c88bb040 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.340+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700072d0 con 0x7f0c58004d00 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.340+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7002f070 con 0x7f0c58004d00 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.340+0000 7f0c76000640 1 -- 172.21.15.100:0/3733025021 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c700076f0 con 0x7f0c58004d00 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 -- 172.21.15.100:0/3733025021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c58004d00 msgr2=0x7f0c58005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3733025021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c58004d00 0x7f0c58005180 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000a830 tx=0x7f0c580057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c77e00640 1 -- 172.21.15.100:0/3733025021 reap_dead start 2024-01-20T08:13:31.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 -- 172.21.15.100:0/3733025021 shutdown_connections 2024-01-20T08:13:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 -- 172.21.15.100:0/3733025021 >> 172.21.15.100:0/3733025021 conn(0x7f0c7806a5e0 msgr2=0x7f0c7806a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 -- 172.21.15.100:0/3733025021 shutdown_connections 2024-01-20T08:13:31.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.341+0000 7f0c7e600640 1 -- 172.21.15.100:0/3733025021 wait complete. 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.343+0000 7f0c7e600640 1 Processor -- start 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.343+0000 7f0c7e600640 1 -- start start 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c58004d00 0x7f0c78145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c7815a0b0 0x7f0c7814dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781ebd10 con 0x7f0c7814e110 2024-01-20T08:13:31.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781f2530 con 0x7f0c7815a0b0 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c7e600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c781584b0 con 0x7f0c58004d00 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42016/0 (socket says 172.21.15.100:42016) 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 -- 172.21.15.100:0/3672160755 learned_addr learned my addr 172.21.15.100:0/3672160755 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77400640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c58004d00 0x7f0c78145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 -- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c58004d00 msgr2=0x7f0c78145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c58004d00 0x7f0c78145b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 -- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c7815a0b0 msgr2=0x7f0c7814dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c7815a0b0 0x7f0c7814dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.344+0000 7f0c77e00640 1 -- 172.21.15.100:0/3672160755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c781f2250 con 0x7f0c7814e110 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c77e00640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0c7002cc40 tx=0x7f0c70001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70040680 con 0x7f0c7814e110 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c700407e0 con 0x7f0c7814e110 2024-01-20T08:13:31.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c781586c0 con 0x7f0c7814e110 2024-01-20T08:13:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70040b70 con 0x7f0c7814e110 2024-01-20T08:13:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.345+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c78148100 con 0x7f0c7814e110 2024-01-20T08:13:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.346+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c780c0450 con 0x7f0c7814e110 2024-01-20T08:13:31.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.347+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0c70031030 con 0x7f0c7814e110 2024-01-20T08:13:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.348+0000 7f0c6f400640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 0x7f0c5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.348+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c700ab340 con 0x7f0c7814e110 2024-01-20T08:13:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.348+0000 7f0c77400640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 0x7f0c5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.349+0000 7f0c77400640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 0x7f0c5006d390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c68007fd0 tx=0x7f0c68009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.352+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0c70076200 con 0x7f0c7814e110 2024-01-20T08:13:31.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.614+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0c78067640 con 0x7f0c7814e110 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.618+0000 7f0c6f400640 1 -- 172.21.15.100:0/3672160755 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0c70079820 con 0x7f0c7814e110 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stdout:[client.0] 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tld1KOLhAAz/nT65gfdVUrb0Wfr4qdoA== 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:13:31.621 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-01-20T08:13:31.622 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.0 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.621+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 msgr2=0x7f0c5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.621+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 0x7f0c5006d390 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0c68007fd0 tx=0x7f0c68009040 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.621+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 msgr2=0x7f0c781463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.621+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f0c7002cc40 tx=0x7f0c70001d80 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 shutdown_connections 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c7814e110 0x7f0c781463a0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c7815a0b0 0x7f0c7814dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c5006aed0 0x7f0c5006d390 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 --2- 172.21.15.100:0/3672160755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c58004d00 0x7f0c78145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 >> 172.21.15.100:0/3672160755 conn(0x7f0c7806a5e0 msgr2=0x7f0c7814e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 shutdown_connections 2024-01-20T08:13:31.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.622+0000 7f0c7e600640 1 -- 172.21.15.100:0/3672160755 wait complete. 2024-01-20T08:13:31.643 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:13:31.849 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.846+0000 7facae400640 1 Processor -- start 2024-01-20T08:13:31.850 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.847+0000 7facae400640 1 -- start start 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7facae400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7faca8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7facae400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80c1670 con 0x7faca8151f60 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7facae400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80c0d40 con 0x7faca8147f20 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7facae400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c2210 con 0x7faca80abfd0 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7fac9e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7faca8151f60 0x7faca80c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34914/0 (socket says 172.21.15.100:34914) 2024-01-20T08:13:31.851 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7fac9e800640 1 -- 172.21.15.100:0/2429519218 learned_addr learned my addr 172.21.15.100:0/2429519218 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.848+0000 7faca7e00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7faca8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1335529784 0 0) 0x7faca80c1670 con 0x7faca8151f60 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac88003520 con 0x7faca8151f60 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084201344 0 0) 0x7fac88003520 con 0x7faca8151f60 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 msgr2=0x7faca8070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.853 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7faca8070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 >> v1:172.21.15.110:6789/0 conn(0x7faca8147f20 legacy=0x7faca80c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca80c1020 con 0x7faca8151f60 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fac90001670 con 0x7faca8151f60 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 >> v1:172.21.15.100:6789/0 conn(0x7faca8151f60 legacy=0x7faca80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7fac880039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac88003f70 0x7fac880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac88004d00 0x7fac88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80c2210 con 0x7fac88004d00 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8800bac0 con 0x7fac88003f70 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac8800bc80 con 0x7faca80abfd0 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.849+0000 7faca7e00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac88004d00 0x7fac88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7400640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7fac880039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7fac9e800640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac88003f70 0x7fac880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7e00640 1 -- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 msgr2=0x7fac880039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7e00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7faca80abfd0 0x7fac880039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7e00640 1 -- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac88003f70 msgr2=0x7fac880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7e00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac88003f70 0x7fac880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7faca7e00640 1 -- 172.21.15.100:0/2429519218 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac88003520 con 0x7fac88004d00 2024-01-20T08:13:31.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.850+0000 7fac9e800640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fac88003f70 0x7fac880047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.851+0000 7faca7e00640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac88004d00 0x7fac88005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7faca0009fc0 tx=0x7fac880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae071b8df15575b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.851+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca002cc20 con 0x7fac88004d00 2024-01-20T08:13:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.851+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca000f040 con 0x7fac88004d00 2024-01-20T08:13:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.851+0000 7faca6a00640 1 -- 172.21.15.100:0/2429519218 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0034440 con 0x7fac88004d00 2024-01-20T08:13:31.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 -- 172.21.15.100:0/2429519218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac88004d00 msgr2=0x7fac88005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 --2- 172.21.15.100:0/2429519218 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fac88004d00 0x7fac88005180 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7faca0009fc0 tx=0x7fac880057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7faca7e00640 1 -- 172.21.15.100:0/2429519218 reap_dead start 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 -- 172.21.15.100:0/2429519218 shutdown_connections 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 -- 172.21.15.100:0/2429519218 >> 172.21.15.100:0/2429519218 conn(0x7faca806a5e0 msgr2=0x7faca806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 -- 172.21.15.100:0/2429519218 shutdown_connections 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.852+0000 7facae400640 1 -- 172.21.15.100:0/2429519218 wait complete. 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.853+0000 7facae400640 1 Processor -- start 2024-01-20T08:13:31.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 -- start start 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac88004d00 0x7faca80705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faca814e950 0x7faca8141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca81e6750 con 0x7faca8141fd0 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8142450 con 0x7faca814e950 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.854+0000 7facae400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca81e5b40 con 0x7fac88004d00 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42034/0 (socket says 172.21.15.100:42034) 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 -- 172.21.15.100:0/395688103 learned_addr learned my addr 172.21.15.100:0/395688103 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac88004d00 0x7faca80705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7fac9e800640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faca814e950 0x7faca8141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 -- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac88004d00 msgr2=0x7faca80705e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac88004d00 0x7faca80705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 -- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faca814e950 msgr2=0x7faca8141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faca814e950 0x7faca8141a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 -- 172.21.15.100:0/395688103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca81e5e20 con 0x7faca8141fd0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.855+0000 7faca7e00640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faca000e230 tx=0x7faca0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.856+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0034b50 con 0x7faca8141fd0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.856+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faca0034cb0 con 0x7faca8141fd0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.856+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0003bd0 con 0x7faca8141fd0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.856+0000 7facae400640 1 -- 172.21.15.100:0/395688103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca81e6100 con 0x7faca8141fd0 2024-01-20T08:13:31.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.856+0000 7facae400640 1 -- 172.21.15.100:0/395688103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca8070b20 con 0x7faca8141fd0 2024-01-20T08:13:31.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.857+0000 7facae400640 1 -- 172.21.15.100:0/395688103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca804e970 con 0x7faca8141fd0 2024-01-20T08:13:31.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.858+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7faca003e440 con 0x7faca8141fd0 2024-01-20T08:13:31.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.859+0000 7fac9fe00640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 0x7fac8006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:31.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.859+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faca00ab320 con 0x7faca8141fd0 2024-01-20T08:13:31.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.859+0000 7faca7400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 0x7fac8006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:31.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.860+0000 7faca7400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 0x7fac8006d3e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fac98001590 tx=0x7fac98009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:31.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:31.863+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7faca0076260 con 0x7faca8141fd0 2024-01-20T08:13:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.100+0000 7facae400640 1 -- 172.21.15.100:0/395688103 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faca80c38d0 con 0x7faca8141fd0 2024-01-20T08:13:32.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.101+0000 7fac9fe00640 1 -- 172.21.15.100:0/395688103 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) v1 ==== 94+0+4952 (secure 0 0 0) 0x7faca0079880 con 0x7faca8141fd0 2024-01-20T08:13:32.104 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:32.104 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":48,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":6423,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-01-20T08:13:32.104 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 48 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.103+0000 7facae400640 1 -- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 msgr2=0x7fac8006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.103+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 0x7fac8006d3e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fac98001590 tx=0x7fac98009040 comp rx=0 tx=0).stop 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.103+0000 7facae400640 1 -- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 msgr2=0x7faca814f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.103+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7faca000e230 tx=0x7faca0009750 comp rx=0 tx=0).stop 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 -- 172.21.15.100:0/395688103 shutdown_connections 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7faca8141fd0 0x7faca814f6a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7faca814e950 0x7faca8141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fac8006af20 0x7fac8006d3e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 --2- 172.21.15.100:0/395688103 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fac88004d00 0x7faca80705e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 -- 172.21.15.100:0/395688103 >> 172.21.15.100:0/395688103 conn(0x7faca806a5e0 msgr2=0x7faca81450b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 -- 172.21.15.100:0/395688103 shutdown_connections 2024-01-20T08:13:32.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.104+0000 7facae400640 1 -- 172.21.15.100:0/395688103 wait complete. 2024-01-20T08:13:32.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-01-20T08:13:20.610416+0000', 'modified': '2024-01-20T08:13:23.677549+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6432}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6432': {'gid': 6432, 'name': 'a', 'rank': 0, 'incarnation': 44, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6837/1016959198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 1016959198}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 1016959198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701272860131327, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-01-20T08:13:32.528 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-01-20T08:13:32.528 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-01-20T08:13:32.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.742+0000 7ff79fe00640 1 Processor -- start 2024-01-20T08:13:32.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.743+0000 7ff79fe00640 1 -- start start 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79fe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7ff7a01588f0 0x7ff7a01550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a0157d00 con 0x7ff7a014e690 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7a00c4890 con 0x7ff7a00c7e10 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79fe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7a006cd00 con 0x7ff7a01588f0 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff7a014e690 0x7ff7a00ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34930/0 (socket says 172.21.15.100:34930) 2024-01-20T08:13:32.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79ea00640 1 -- 172.21.15.100:0/590960786 learned_addr learned my addr 172.21.15.100:0/590960786 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:32.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3847480493 0 0) 0x7ff7a0157d00 con 0x7ff7a014e690 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff780003520 con 0x7ff7a014e690 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.744+0000 7ff79f400640 1 --2- 172.21.15.100:0/590960786 >> v2:172.21.15.110:3300/0 conn(0x7ff7a01588f0 0x7ff7a01550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 639842392 0 0) 0x7ff780003520 con 0x7ff7a014e690 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 >> v2:172.21.15.110:3300/0 conn(0x7ff7a01588f0 msgr2=0x7ff7a01550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 --2- 172.21.15.100:0/590960786 >> v2:172.21.15.110:3300/0 conn(0x7ff7a01588f0 0x7ff7a01550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 >> v1:172.21.15.110:6789/0 conn(0x7ff7a00c7e10 legacy=0x7ff7a01581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00c4b50 con 0x7ff7a014e690 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7ff790001670 con 0x7ff7a014e690 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 >> v1:172.21.15.100:6789/0 conn(0x7ff7a014e690 legacy=0x7ff7a00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780003970 0x7ff780003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800047c0 0x7ff780004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 0x7ff78000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a006cd00 con 0x7ff7800052a0 2024-01-20T08:13:32.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000c150 con 0x7ff780003970 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78000c310 con 0x7ff7800047c0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79f400640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 0x7ff78000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.745+0000 7ff79ea00640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780003970 0x7ff780003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79e000640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800047c0 0x7ff780004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79f400640 1 -- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800047c0 msgr2=0x7ff780004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79f400640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800047c0 0x7ff780004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79f400640 1 -- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780003970 msgr2=0x7ff780003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79f400640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff780003970 0x7ff780003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.746+0000 7ff79f400640 1 -- 172.21.15.100:0/590960786 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff780003520 con 0x7ff7800052a0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79f400640 1 -- 172.21.15.100:0/590960786 reap_dead start 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79f400640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 0x7ff78000b980 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff798007330 tx=0x7ff7800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f43fa8172f0c4f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff79802ccd0 con 0x7ff7800052a0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79802ce30 con 0x7ff7800052a0 2024-01-20T08:13:32.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79d600640 1 -- 172.21.15.100:0/590960786 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798003bd0 con 0x7ff7800052a0 2024-01-20T08:13:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79fe00640 1 -- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 msgr2=0x7ff78000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.747+0000 7ff79fe00640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 0x7ff78000b980 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7ff798007330 tx=0x7ff7800057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.748+0000 7ff79fe00640 1 -- 172.21.15.100:0/590960786 shutdown_connections 2024-01-20T08:13:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.748+0000 7ff79fe00640 1 --2- 172.21.15.100:0/590960786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7800052a0 0x7ff78000b980 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.748+0000 7ff79fe00640 1 -- 172.21.15.100:0/590960786 >> 172.21.15.100:0/590960786 conn(0x7ff7a0072130 msgr2=0x7ff7a0072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.748+0000 7ff79fe00640 1 -- 172.21.15.100:0/590960786 shutdown_connections 2024-01-20T08:13:32.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.748+0000 7ff79fe00640 1 -- 172.21.15.100:0/590960786 wait complete. 2024-01-20T08:13:32.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.749+0000 7ff79fe00640 1 Processor -- start 2024-01-20T08:13:32.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.749+0000 7ff79fe00640 1 -- start start 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800052a0 0x7ff7a00abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a00a98b0 0x7ff7a01e72a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00ab300 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00ad740 con 0x7ff7a00a98b0 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.750+0000 7ff79fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a00aad40 con 0x7ff7800052a0 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42054/0 (socket says 172.21.15.100:42054) 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 -- 172.21.15.100:0/1286234136 learned_addr learned my addr 172.21.15.100:0/1286234136 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:32.757 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800052a0 0x7ff7a00abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 -- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800052a0 msgr2=0x7ff7a00abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800052a0 0x7ff7a00abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 -- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a00a98b0 msgr2=0x7ff7a01e72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a00a98b0 0x7ff7a01e72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 -- 172.21.15.100:0/1286234136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a00ab020 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.751+0000 7ff79e000640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff78800d4b0 tx=0x7ff78800d970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.752+0000 7ff797400640 1 -- 172.21.15.100:0/1286234136 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788007230 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.752+0000 7ff797400640 1 -- 172.21.15.100:0/1286234136 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff788007390 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.752+0000 7ff797400640 1 -- 172.21.15.100:0/1286234136 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7880067d0 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.752+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7a00ad3d0 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.752+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7a00c9570 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.758 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.754+0000 7ff797400640 1 -- 172.21.15.100:0/1286234136 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff788006930 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.755+0000 7ff797400640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.755+0000 7ff797400640 1 -- 172.21.15.100:0/1286234136 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7880894b0 con 0x7ff7a00aa7d0 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.755+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.755+0000 7ff7a8a0c740 1 Processor -- start 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 -- start start 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff790001050 tx=0x7ff790009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e6bf40 0x562450e6c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450dd8d80 con 0x562450ea85d0 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450dd6470 con 0x562450e6bf40 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.756+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562450dd1d60 con 0x562450e6d250 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42064/0 (socket says 172.21.15.100:42064) 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 -- 172.21.15.100:0/1542610060 learned_addr learned my addr 172.21.15.100:0/1542610060 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 -- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 msgr2=0x562450ea8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 -- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e6bf40 msgr2=0x562450e6c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e6bf40 0x562450e6c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 -- 172.21.15.100:0/1542610060 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562450d87280 con 0x562450ea85d0 2024-01-20T08:13:32.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.757+0000 7ff79f400640 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff798007420 tx=0x7ff79802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2a8b6dbfa70c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff78f400640 1 -- 172.21.15.100:0/1542610060 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798039070 con 0x562450ea85d0 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff78f400640 1 -- 172.21.15.100:0/1542610060 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff79802cb90 con 0x562450ea85d0 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff78f400640 1 -- 172.21.15.100:0/1542610060 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798003bd0 con 0x562450ea85d0 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1542610060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 msgr2=0x562450ea6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7ff798007420 tx=0x7ff79802e070 comp rx=0 tx=0).stop 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1542610060 shutdown_connections 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450ea6640 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.758+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1542610060 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e6bf40 0x562450e6c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.759+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1542610060 >> 172.21.15.100:0/1542610060 conn(0x562450e68b20 msgr2=0x562450e8d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.759+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1542610060 shutdown_connections 2024-01-20T08:13:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.759+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1542610060 wait complete. 2024-01-20T08:13:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.759+0000 7ff7a8a0c740 1 -- start start 2024-01-20T08:13:32.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.760+0000 7ff7a8a0c740 1 Processor -- start 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.760+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.760+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450ead110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450d6d740 con 0x562450e88770 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450d8b0c0 con 0x562450ea85d0 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562450b33f20 con 0x562450e6d250 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff7a8a0c740 10 client.0 _ll_register_callbacks cb 0x562450dc8200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42072/0 (socket says 172.21.15.100:42072) 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 -- 172.21.15.100:0/1351997579 learned_addr learned my addr 172.21.15.100:0/1351997579 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79e000640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450ead110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 -- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 msgr2=0x562450ea5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 -- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 msgr2=0x562450ead110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450ead110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79f400640 1 -- 172.21.15.100:0/1351997579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff780003520 con 0x562450e88770 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.761+0000 7ff79e000640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450ead110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff79f400640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff798007330 tx=0x7ff798004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190115b1c86ab6c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798004450 con 0x562450e88770 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7980045b0 con 0x562450e88770 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562450dcabf0 con 0x562450e88770 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff798003e80 con 0x562450e88770 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff7a8a0c740 10 client.6603 fetch_fsmap learned FSMap version 48 2024-01-20T08:13:32.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x562450dd03e0 con 0x562450e88770 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562450dcabf0 con 0x562450e88770 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.762+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff798034440 con 0x562450e88770 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 10 client.6603 fetch_fsmap finished waiting for FSMap version 48 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 10 client.6603 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 20 client.6603 populate_metadata read hostname 'smithi100' 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450eb8e40 0x562450ea4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 4 client.6603 mds_command: new command op to 6432 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 --> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562450dca910 con 0x562450eb8e40 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450eb8e40 0x562450ea4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff787e00640 10 client.6603 ms_handle_connect on v2:172.21.15.100:6836/1016959198 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.763+0000 7ff79ea00640 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450eb8e40 0x562450ea4020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a78907eb8cac859d server_cookie=6a73f0e799cbcedb in_seq=0 out_seq=0 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.764+0000 7ff787e00640 1 -- 172.21.15.100:0/1351997579 <== mds.0 v2:172.21.15.100:6836/1016959198 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562450dca910 con 0x562450eb8e40 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.764+0000 7ff787e00640 10 client.6603 handle_command_reply: tid=0 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.764+0000 7ff7a8a0c740 1 client.6603 shutdown 2024-01-20T08:13:32.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.764+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 msgr2=0x562450eb8830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.764+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff798007330 tx=0x7ff798004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 shutdown_connections 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450eb8e40 0x562450ea4020 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e88770 0x562450eb8830 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450ead110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/1351997579 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450ea5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff787e00640 0 client.6603 ms_handle_reset on v2:172.21.15.100:6836/1016959198 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 >> 172.21.15.100:0/1351997579 conn(0x562450e6bf40 msgr2=0x562450ea6fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 shutdown_connections 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/1351997579 wait complete. 2024-01-20T08:13:32.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.765+0000 7ff7a8a0c740 20 client.6603 trim_cache size 0 max 16384 2024-01-20T08:13:32.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 Processor -- start 2024-01-20T08:13:32.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 -- start start 2024-01-20T08:13:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450e8b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e88770 0x562450e870d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450d9bf80 con 0x562450ea85d0 2024-01-20T08:13:32.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450e685d0 con 0x562450e88770 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.782+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562450ea3500 con 0x562450e6d250 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42084/0 (socket says 172.21.15.100:42084) 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 -- 172.21.15.100:0/997142596 learned_addr learned my addr 172.21.15.100:0/997142596 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 -- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 msgr2=0x562450e8b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450e8b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 -- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e88770 msgr2=0x562450e870d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e88770 0x562450e870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 -- 172.21.15.100:0/997142596 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562450d6cfd0 con 0x562450ea85d0 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.783+0000 7ff79f400640 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff798000f80 tx=0x7ff798047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42fb87fa934bc937 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff78ea00640 1 -- 172.21.15.100:0/997142596 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798007140 con 0x562450ea85d0 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff78ea00640 1 -- 172.21.15.100:0/997142596 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff798034900 con 0x562450ea85d0 2024-01-20T08:13:32.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff78ea00640 1 -- 172.21.15.100:0/997142596 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff798034a70 con 0x562450ea85d0 2024-01-20T08:13:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/997142596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 msgr2=0x562450e87610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff798000f80 tx=0x7ff798047000 comp rx=0 tx=0).stop 2024-01-20T08:13:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/997142596 shutdown_connections 2024-01-20T08:13:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450ea85d0 0x562450e87610 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450e88770 0x562450e870d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/997142596 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e6d250 0x562450e8b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/997142596 >> 172.21.15.100:0/997142596 conn(0x562450e6bf40 msgr2=0x562450e621e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/997142596 shutdown_connections 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.784+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/997142596 wait complete. 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.785+0000 7ff7a8a0c740 1 -- start start 2024-01-20T08:13:32.789 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.785+0000 7ff7a8a0c740 1 Processor -- start 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 0x562450f1b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450f18160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450ebfed0 con 0x562450e6d250 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x562450ebf230 con 0x562450ea85d0 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x562450e8db40 con 0x562450e88770 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff7a8a0c740 10 client.0 _ll_register_callbacks cb 0x7ff7800036b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff79ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff79ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42088/0 (socket says 172.21.15.100:42088) 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.786+0000 7ff79ea00640 1 -- 172.21.15.100:0/4228220572 learned_addr learned my addr 172.21.15.100:0/4228220572 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79e000640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 0x562450f1b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 -- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 msgr2=0x562450f1b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 0x562450f1b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 -- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 msgr2=0x562450f18160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450f18160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 -- 172.21.15.100:0/4228220572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562450dd03e0 con 0x562450e6d250 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79e000640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 0x562450f1b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff79ea00640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff790001eb0 tx=0x7ff790000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb36a4acb413404c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff787e00640 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff790028070 con 0x562450e6d250 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mon.0 v2:172.21.15.100:3300/0 2 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff790005690 con 0x562450e6d250 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.787+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff79802cb90 con 0x562450e6d250 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff790023640 con 0x562450e6d250 2024-01-20T08:13:32.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 10 client.6609 fetch_fsmap learned FSMap version 48 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) v3 -- 0x562450d925c0 con 0x562450e6d250 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mon.0 v2:172.21.15.100:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff790032020 con 0x562450e6d250 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mon.0 v2:172.21.15.100:3300/0 5 ==== fsmap(e 48) v1 ==== 3294+0+0 (secure 0 0 0) 0x7ff79002b020 con 0x562450e6d250 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 10 client.6609 fetch_fsmap finished waiting for FSMap version 48 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 10 client.6609 resolve_mds: resolved name 'a' to daemon mds.a 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 20 client.6609 populate_metadata read hostname 'smithi100' 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450f186a0 0x562450f1e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 4 client.6609 mds_command: new command op to 6432 tid=0 multi_id=0 [{"prefix": "status"}] 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 --> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562450ad16c0 con 0x562450f186a0 2024-01-20T08:13:32.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.788+0000 7ff79e000640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450f186a0 0x562450f1e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff79e000640 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450f186a0 0x562450f1e320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1200fb923504c252 server_cookie=69da2489b9c2a111 in_seq=0 out_seq=0 2024-01-20T08:13:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff787e00640 10 client.6609 ms_handle_connect on v2:172.21.15.100:6836/1016959198 2024-01-20T08:13:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff787e00640 1 -- 172.21.15.100:0/4228220572 <== mds.0 v2:172.21.15.100:6836/1016959198 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562450ad16c0 con 0x562450f186a0 2024-01-20T08:13:32.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff787e00640 10 client.6609 handle_command_reply: tid=0 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 client.6609 shutdown 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 msgr2=0x562450e83ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff790001eb0 tx=0x7ff790000fe0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 shutdown_connections 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:6836/1016959198,v1:172.21.15.100:6837/1016959198] conn(0x562450f186a0 0x562450f1e320 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x562450ea85d0 0x562450f18160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x562450e88770 0x562450f1b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 --2- 172.21.15.100:0/4228220572 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x562450e6d250 0x562450e83ba0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff787e00640 0 client.6609 ms_handle_reset on v2:172.21.15.100:6836/1016959198 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 >> 172.21.15.100:0/4228220572 conn(0x562450e6bf40 msgr2=0x562450ea7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.789+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 shutdown_connections 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff7a8a0c740 1 -- 172.21.15.100:0/4228220572 wait complete. 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff7a8a0c740 20 client.6609 trim_cache size 0 max 16384 2024-01-20T08:13:32.795 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "cluster_fsid": "10ce7bd0-b73e-4b66-b126-32ffded4722e", 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "whoami": 0, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "id": 6432, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "want_state": "up:active", 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "state": "up:active", 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "fs_name": "cephfs", 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "rank_uptime": 11.600351656000001, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "mdsmap_epoch": 48, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch": 72, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "osdmap_epoch_barrier": 72, 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout: "uptime": 18.236900363 2024-01-20T08:13:32.796 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 msgr2=0x7ff77806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 0x7ff77806d3c0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ff790001050 tx=0x7ff790009040 comp rx=0 tx=0).stop 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 msgr2=0x7ff7a01e6d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7ff78800d4b0 tx=0x7ff78800d970 comp rx=0 tx=0).stop 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 shutdown_connections 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff7a00a98b0 0x7ff7a01e72a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff7a00aa7d0 0x7ff7a01e6d60 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff77806af00 0x7ff77806d3c0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 --2- 172.21.15.100:0/1286234136 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff7800052a0 0x7ff7a00abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 >> 172.21.15.100:0/1286234136 conn(0x7ff7a0072130 msgr2=0x7ff7a0153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 shutdown_connections 2024-01-20T08:13:32.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:32.790+0000 7ff79fe00640 1 -- 172.21.15.100:0/1286234136 wait complete. 2024-01-20T08:13:32.810 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:13:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.012+0000 7fa75fe00640 1 Processor -- start 2024-01-20T08:13:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.012+0000 7fa75fe00640 1 -- start start 2024-01-20T08:13:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.013+0000 7fa75fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa76014fc10 0x7fa7600a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.013+0000 7fa75fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa760156710 con 0x7fa7600c4ed0 2024-01-20T08:13:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.013+0000 7fa75fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa760155b00 con 0x7fa7600a5240 2024-01-20T08:13:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.013+0000 7fa75fe00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76014fff0 con 0x7fa76014fc10 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75e000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa7600c4ed0 0x7fa7600c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34940/0 (socket says 172.21.15.100:34940) 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75e000640 1 -- 172.21.15.100:0/4215456259 learned_addr learned my addr 172.21.15.100:0/4215456259 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa76014fc10 0x7fa7600a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75d600640 1 -- 172.21.15.100:0/4215456259 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2340369648 0 0) 0x7fa760156710 con 0x7fa7600c4ed0 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75d600640 1 -- 172.21.15.100:0/4215456259 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa740003520 con 0x7fa7600c4ed0 2024-01-20T08:13:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75ea00640 1 -- 172.21.15.100:0/4215456259 >> v1:172.21.15.110:6789/0 conn(0x7fa7600a5240 legacy=0x7fa7600c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75ea00640 1 -- 172.21.15.100:0/4215456259 >> v1:172.21.15.100:6789/0 conn(0x7fa7600c4ed0 legacy=0x7fa7600c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.014+0000 7fa75ea00640 1 -- 172.21.15.100:0/4215456259 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760155de0 con 0x7fa76014fc10 2024-01-20T08:13:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.015+0000 7fa75ea00640 1 --2- 172.21.15.100:0/4215456259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa7600a4d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa7500097a0 tx=0x7fa75002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b6c0f3e9916001 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75d600640 1 -- 172.21.15.100:0/4215456259 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75002f050 con 0x7fa76014fc10 2024-01-20T08:13:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75d600640 1 -- 172.21.15.100:0/4215456259 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa750031700 con 0x7fa76014fc10 2024-01-20T08:13:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75d600640 1 -- 172.21.15.100:0/4215456259 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750031a90 con 0x7fa76014fc10 2024-01-20T08:13:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 -- 172.21.15.100:0/4215456259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 msgr2=0x7fa7600a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 --2- 172.21.15.100:0/4215456259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa7600a4d00 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fa7500097a0 tx=0x7fa75002b7a0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 -- 172.21.15.100:0/4215456259 shutdown_connections 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 --2- 172.21.15.100:0/4215456259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa7600a4d00 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 -- 172.21.15.100:0/4215456259 >> 172.21.15.100:0/4215456259 conn(0x7fa7600c5ba0 msgr2=0x7fa7600c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.016+0000 7fa75fe00640 1 -- 172.21.15.100:0/4215456259 shutdown_connections 2024-01-20T08:13:33.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.017+0000 7fa75fe00640 1 -- 172.21.15.100:0/4215456259 wait complete. 2024-01-20T08:13:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.018+0000 7fa75fe00640 1 Processor -- start 2024-01-20T08:13:33.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.018+0000 7fa75fe00640 1 -- start start 2024-01-20T08:13:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7600a5240 0x7fa7601edaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 0x7fa7600c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:33.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760150be0 con 0x7fa76014fc10 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7600c6950 con 0x7fa7600a5240 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601519d0 con 0x7fa7600c4ed0 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.019+0000 7fa75f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42108/0 (socket says 172.21.15.100:42108) 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 -- 172.21.15.100:0/3631565105 learned_addr learned my addr 172.21.15.100:0/3631565105 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75ea00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7600a5240 0x7fa7601edaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75e000640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 0x7fa7600c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 -- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 msgr2=0x7fa7600c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 0x7fa7600c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 -- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7600a5240 msgr2=0x7fa7601edaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7600a5240 0x7fa7601edaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.024 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 -- 172.21.15.100:0/3631565105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa750009400 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75e000640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 0x7fa7600c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.020+0000 7fa75f400640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c780 tx=0x7fa75800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.021+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa758004b60 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.021+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75800ce90 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.021+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75800a850 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.021+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7601edfe0 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.021+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760150620 con 0x7fa76014fc10 2024-01-20T08:13:33.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.022+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa760156380 con 0x7fa76014fc10 2024-01-20T08:13:33.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.023+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa75800a9b0 con 0x7fa76014fc10 2024-01-20T08:13:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.024+0000 7fa756a00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 0x7fa73806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.024+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7580897d0 con 0x7fa76014fc10 2024-01-20T08:13:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.024+0000 7fa75ea00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 0x7fa73806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:33.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.025+0000 7fa75ea00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 0x7fa73806d390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa750035000 tx=0x7fa750008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:33.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.028+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa760156380 con 0x7fa76014fc10 2024-01-20T08:13:33.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.259+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa760156380 con 0x7fa76014fc10 2024-01-20T08:13:33.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.260+0000 7fa756a00640 1 -- 172.21.15.100:0/3631565105 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa760156380 con 0x7fa76014fc10 2024-01-20T08:13:33.263 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.262+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 msgr2=0x7fa73806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.262+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 0x7fa73806d390 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fa750035000 tx=0x7fa750008030 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.262+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 msgr2=0x7fa76014e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.262+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fa75800c780 tx=0x7fa75800cc40 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 shutdown_connections 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa76014fc10 0x7fa76014e100 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa73806aed0 0x7fa73806d390 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa7600c4ed0 0x7fa7600c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 --2- 172.21.15.100:0/3631565105 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa7600a5240 0x7fa7601edaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:33.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 >> 172.21.15.100:0/3631565105 conn(0x7fa7600c5ba0 msgr2=0x7fa7600c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:33.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 shutdown_connections 2024-01-20T08:13:33.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:33.263+0000 7fa75fe00640 1 -- 172.21.15.100:0/3631565105 wait complete. 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:13:33.286 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:13:33.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.287 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:33.337 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42460sec preferred_lft 42460sec 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:13:33.338 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:13:33.339 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:13:33.339 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:33.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.340 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:13:33.428 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:13:33.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.432 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:13:33.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:13:33.486 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:13:33.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.664 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:13:33.712 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:13:33.713 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:13:33.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:13:33.810 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:33.810 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:13:33.862 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:33.862 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:13:33.908 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-01-20T08:13:33.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:33.908 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:34.092 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:34.093 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:34.127 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:34.127 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:34.127 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:13:34.127 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: 0@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:13:34.127 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:13:34.129 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T08:13:34.129 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:13:34.129 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:13:34.129 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:13:34.129 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:13:34.136 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:13:34.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:34.137 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:13:34.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:34.219 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:13:34.282 INFO:teuthology.orchestra.run.smithi100.stdout:client6621 2024-01-20T08:13:34.283 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:34.283 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:34.335 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:13:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.538+0000 7f2429000640 1 Processor -- start 2024-01-20T08:13:34.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.538+0000 7f2429000640 1 -- start start 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2429000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f242406d2c0 0x7f2424155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2429000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242406d750 con 0x7f24240c0ed0 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2429000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24241559b0 con 0x7f24240c4e20 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2429000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24240c1930 con 0x7f242406d2c0 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2422a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f24240c0ed0 0x7f242406cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34956/0 (socket says 172.21.15.100:34956) 2024-01-20T08:13:34.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.539+0000 7f2422a00640 1 -- 172.21.15.100:0/2307626622 learned_addr learned my addr 172.21.15.100:0/2307626622 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2423e00640 1 --2- 172.21.15.100:0/2307626622 >> v2:172.21.15.110:3300/0 conn(0x7f242406d2c0 0x7f2424155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2024048461 0 0) 0x7f242406d750 con 0x7f24240c0ed0 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2404005730 con 0x7f24240c0ed0 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2740992891 0 0) 0x7f2404005730 con 0x7f24240c0ed0 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 >> v2:172.21.15.110:3300/0 conn(0x7f242406d2c0 msgr2=0x7f2424155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:34.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 --2- 172.21.15.100:0/2307626622 >> v2:172.21.15.110:3300/0 conn(0x7f242406d2c0 0x7f2424155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 >> v1:172.21.15.110:6789/0 conn(0x7f24240c4e20 legacy=0x7f24240aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242406c160 con 0x7f24240c0ed0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f240c001670 con 0x7f24240c0ed0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 >> v1:172.21.15.100:6789/0 conn(0x7f24240c0ed0 legacy=0x7f242406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 0x7f2404005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24040069d0 0x7f2404006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2404007390 0x7f240400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24240c1930 con 0x7f2404005bd0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f240400e290 con 0x7f2404007390 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f240400e450 con 0x7f24040069d0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.540+0000 7f2423400640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 0x7f2404005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423e00640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2404007390 0x7f240400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2422a00640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24040069d0 0x7f2404006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423400640 1 -- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24040069d0 msgr2=0x7f2404006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423400640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f24040069d0 0x7f2404006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423400640 1 -- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2404007390 msgr2=0x7f240400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:34.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423400640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2404007390 0x7f240400db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423400640 1 -- 172.21.15.100:0/2307626622 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2404005730 con 0x7f2404005bd0 2024-01-20T08:13:34.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423e00640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2404007390 0x7f240400db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:34.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.541+0000 7f2423e00640 1 -- 172.21.15.100:0/2307626622 reap_dead start 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.542+0000 7f2423400640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 0x7f2404005ff0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f24140015b0 tx=0x7f2404007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e09eb4f225e94a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.542+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24140052d0 con 0x7f2404005bd0 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.542+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241402e050 con 0x7f2404005bd0 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.542+0000 7f2422000640 1 -- 172.21.15.100:0/2307626622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2414003830 con 0x7f2404005bd0 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 -- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 msgr2=0x7f2404005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 0x7f2404005ff0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f24140015b0 tx=0x7f2404007a00 comp rx=0 tx=0).stop 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 -- 172.21.15.100:0/2307626622 shutdown_connections 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 --2- 172.21.15.100:0/2307626622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2404005bd0 0x7f2404005ff0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 -- 172.21.15.100:0/2307626622 >> 172.21.15.100:0/2307626622 conn(0x7f24240c5ba0 msgr2=0x7f24240c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 -- 172.21.15.100:0/2307626622 shutdown_connections 2024-01-20T08:13:34.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.543+0000 7f2429000640 1 -- 172.21.15.100:0/2307626622 wait complete. 2024-01-20T08:13:34.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.545+0000 7f2429000640 1 Processor -- start 2024-01-20T08:13:34.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.545+0000 7f2429000640 1 -- start start 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2404005bd0 0x7f24241ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f242414c5f0 0x7f2424153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24241e1970 con 0x7f24241e0fb0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24240a7600 con 0x7f242414c5f0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2429000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242414cc20 con 0x7f2404005bd0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42124/0 (socket says 172.21.15.100:42124) 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 -- 172.21.15.100:0/2003406604 learned_addr learned my addr 172.21.15.100:0/2003406604 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2422a00640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f242414c5f0 0x7f2424153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423400640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2404005bd0 0x7f24241ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 -- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2404005bd0 msgr2=0x7f24241ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2404005bd0 0x7f24241ea960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 -- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f242414c5f0 msgr2=0x7f2424153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f242414c5f0 0x7f2424153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.546+0000 7f2423e00640 1 -- 172.21.15.100:0/2003406604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24240a7040 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f2423e00640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f24240c0a50 tx=0x7f241c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c016420 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c016580 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0168f0 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24240a7320 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.547+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24241539a0 con 0x7f24241e0fb0 2024-01-20T08:13:34.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.548+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24240a56a0 con 0x7f24241e0fb0 2024-01-20T08:13:34.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.549+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f241c016a50 con 0x7f24241e0fb0 2024-01-20T08:13:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.550+0000 7f241b400640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 0x7f23fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.550+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f241c08a440 con 0x7f24241e0fb0 2024-01-20T08:13:34.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.550+0000 7f2423400640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 0x7f23fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:34.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.551+0000 7f2423400640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 0x7f23fc06d390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2414033000 tx=0x7f2414009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:34.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.555+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f24240a56a0 con 0x7f24241e0fb0 2024-01-20T08:13:34.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.788+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f24240a56a0 con 0x7f24241e0fb0 2024-01-20T08:13:34.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.789+0000 7f241b400640 1 -- 172.21.15.100:0/2003406604 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) v1 ==== 53+0+73 (secure 0 0 0) 0x7f24240a56a0 con 0x7f24241e0fb0 2024-01-20T08:13:34.792 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.791+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 msgr2=0x7f23fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.791+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 0x7f23fc06d390 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2414033000 tx=0x7f2414009030 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.791+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 msgr2=0x7f24241e1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.791+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f24240c0a50 tx=0x7f241c00f520 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 shutdown_connections 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f24241e0fb0 0x7f24241e1430 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f242414c5f0 0x7f2424153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f23fc06aed0 0x7f23fc06d390 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 --2- 172.21.15.100:0/2003406604 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2404005bd0 0x7f24241ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 >> 172.21.15.100:0/2003406604 conn(0x7f24240c5ba0 msgr2=0x7f24240a9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 shutdown_connections 2024-01-20T08:13:34.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:34.792+0000 7f2429000640 1 -- 172.21.15.100:0/2003406604 wait complete. 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:13:34.814 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:34.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:34.814 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:34.872 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42432sec preferred_lft 42432sec 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:13:34.873 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.874 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:13:34.874 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:13:34.874 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:13:34.874 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:34.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:34.875 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:13:34.965 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:13:34.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:34.970 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:13:35.019 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:13:35.019 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:13:35.020 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:13:35.020 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:13:35.020 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:13:35.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:13:35.021 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:13:35.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.195 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:13:35.244 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:13:35.245 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:35.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.245 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:13:35.329 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:35.329 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:35.380 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:35.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:35.380 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:35.426 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-01-20T08:13:35.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.426 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:35.606 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:35.607 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:13:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:13:35.642 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:13:35.644 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:13:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:13:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:13:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:13:35.644 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:13:35.647 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:13:35.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.648 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:35.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:35.729 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:13:35.781 INFO:teuthology.orchestra.run.smithi110.stdout:client6630 2024-01-20T08:13:35.781 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:35.781 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:35.830 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth rm client.testuser 2024-01-20T08:13:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.043+0000 7f8836200640 1 Processor -- start 2024-01-20T08:13:36.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.043+0000 7f8836200640 1 -- start start 2024-01-20T08:13:36.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f8836200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f883006cfe0 0x7f883015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f8836200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8830154ba0 con 0x7f88301515b0 2024-01-20T08:13:36.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f8836200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8830155a00 con 0x7f883014b720 2024-01-20T08:13:36.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f8836200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883014bb00 con 0x7f883006cfe0 2024-01-20T08:13:36.048 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f882fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f883006cfe0 0x7f883015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f882fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f883006cfe0 0x7f883015cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42130/0 (socket says 172.21.15.100:42130) 2024-01-20T08:13:36.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.045+0000 7f882fe00640 1 -- 172.21.15.100:0/3790655622 learned_addr learned my addr 172.21.15.100:0/3790655622 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.046+0000 7f882fe00640 1 -- 172.21.15.100:0/3790655622 >> v1:172.21.15.110:6789/0 conn(0x7f883014b720 legacy=0x7f88300c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:36.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.046+0000 7f882fe00640 1 -- 172.21.15.100:0/3790655622 >> v1:172.21.15.100:6789/0 conn(0x7f88301515b0 legacy=0x7f883006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.049 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.046+0000 7f882fe00640 1 -- 172.21.15.100:0/3790655622 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8830154df0 con 0x7f883006cfe0 2024-01-20T08:13:36.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.047+0000 7f882fe00640 1 --2- 172.21.15.100:0/3790655622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883006cfe0 0x7f883015cf40 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8828009e50 tx=0x7f882802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9511e0273d0af17 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.047+0000 7f882ea00640 1 -- 172.21.15.100:0/3790655622 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882802ca80 con 0x7f883006cfe0 2024-01-20T08:13:36.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.047+0000 7f882ea00640 1 -- 172.21.15.100:0/3790655622 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882802cbe0 con 0x7f883006cfe0 2024-01-20T08:13:36.050 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.047+0000 7f882ea00640 1 -- 172.21.15.100:0/3790655622 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88280343f0 con 0x7f883006cfe0 2024-01-20T08:13:36.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 -- 172.21.15.100:0/3790655622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883006cfe0 msgr2=0x7f883015cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.051 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 --2- 172.21.15.100:0/3790655622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883006cfe0 0x7f883015cf40 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f8828009e50 tx=0x7f882802bee0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 -- 172.21.15.100:0/3790655622 shutdown_connections 2024-01-20T08:13:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 --2- 172.21.15.100:0/3790655622 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883006cfe0 0x7f883015cf40 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 -- 172.21.15.100:0/3790655622 >> 172.21.15.100:0/3790655622 conn(0x7f88300c2940 msgr2=0x7f88300c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 -- 172.21.15.100:0/3790655622 shutdown_connections 2024-01-20T08:13:36.052 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.048+0000 7f8836200640 1 -- 172.21.15.100:0/3790655622 wait complete. 2024-01-20T08:13:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.050+0000 7f8836200640 1 Processor -- start 2024-01-20T08:13:36.053 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.050+0000 7f8836200640 1 -- start start 2024-01-20T08:13:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.051+0000 7f8836200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f883006cfe0 0x7f883014fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.051+0000 7f8836200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8836200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 0x7f8830149710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8836200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301eaeb0 con 0x7f883014b720 2024-01-20T08:13:36.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8836200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88301ea2a0 con 0x7f88301515b0 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8836200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88301ea580 con 0x7f883006cfe0 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42132/0 (socket says 172.21.15.100:42132) 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 -- 172.21.15.100:0/3225604037 learned_addr learned my addr 172.21.15.100:0/3225604037 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f882fe00640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 0x7f8830149710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 -- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f883006cfe0 msgr2=0x7f883014fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f882f400640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f883006cfe0 0x7f883014fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f883006cfe0 0x7f883014fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 -- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 msgr2=0x7f8830149710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.052+0000 7f8827e00640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 0x7f8830149710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8827e00640 1 -- 172.21.15.100:0/3225604037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8828009b30 con 0x7f883014b720 2024-01-20T08:13:36.056 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f882fe00640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 0x7f8830149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:13:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8827e00640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f881800c3c0 tx=0x7f881800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88180052d0 con 0x7f883014b720 2024-01-20T08:13:36.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8818005450 con 0x7f883014b720 2024-01-20T08:13:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88301ea860 con 0x7f883014b720 2024-01-20T08:13:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8818007260 con 0x7f883014b720 2024-01-20T08:13:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.053+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f883014ffb0 con 0x7f883014b720 2024-01-20T08:13:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.054+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883004e970 con 0x7f883014b720 2024-01-20T08:13:36.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.056+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f88180073c0 con 0x7f883014b720 2024-01-20T08:13:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.056+0000 7f8827400640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 0x7f880806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.057+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8818088950 con 0x7f883014b720 2024-01-20T08:13:36.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.057+0000 7f882f400640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 0x7f880806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.058+0000 7f882f400640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 0x7f880806d3c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f883014b230 tx=0x7f8820009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.061+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8818053810 con 0x7f883014b720 2024-01-20T08:13:36.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.322+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth rm", "entity": "client.testuser"} v 0) v1 -- 0x7f88300c11e0 con 0x7f883014b720 2024-01-20T08:13:36.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.323+0000 7f8827400640 1 -- 172.21.15.100:0/3225604037 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.testuser"}]=0 v18) v1 ==== 84+0+0 (secure 0 0 0) 0x7f8818056e30 con 0x7f883014b720 2024-01-20T08:13:36.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 msgr2=0x7f880806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 0x7f880806d3c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f883014b230 tx=0x7f8820009040 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 msgr2=0x7f88301491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f881800c3c0 tx=0x7f881800c880 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 shutdown_connections 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f88301515b0 0x7f8830149710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f883014b720 0x7f88301491d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f880806af00 0x7f880806d3c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 --2- 172.21.15.100:0/3225604037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f883006cfe0 0x7f883014fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 >> 172.21.15.100:0/3225604037 conn(0x7f88300c2940 msgr2=0x7f883006c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 shutdown_connections 2024-01-20T08:13:36.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.325+0000 7f8836200640 1 -- 172.21.15.100:0/3225604037 wait complete. 2024-01-20T08:13:36.348 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:36.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.544+0000 7f1560e00640 1 Processor -- start 2024-01-20T08:13:36.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.544+0000 7f1560e00640 1 -- start start 2024-01-20T08:13:36.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1560e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f155c14fce0 0x7f155c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1560e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c0a93c0 0x7f155c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1560e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155c0a9940 con 0x7f155c153440 2024-01-20T08:13:36.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1560e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f155c1500c0 con 0x7f155c14fce0 2024-01-20T08:13:36.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1560e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c156810 con 0x7f155c0a93c0 2024-01-20T08:13:36.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1559e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f155c14fce0 0x7f155c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1559e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f155c14fce0 0x7f155c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42144/0 (socket says 172.21.15.100:42144) 2024-01-20T08:13:36.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.545+0000 7f1559e00640 1 -- 172.21.15.100:0/1018296605 learned_addr learned my addr 172.21.15.100:0/1018296605 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.546+0000 7f1551200640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c0a93c0 0x7f155c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.546+0000 7f1559e00640 1 -- 172.21.15.100:0/1018296605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c0a93c0 msgr2=0x7f155c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:36.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.546+0000 7f1559e00640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c0a93c0 0x7f155c152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.546+0000 7f1559e00640 1 -- 172.21.15.100:0/1018296605 >> v1:172.21.15.110:6789/0 conn(0x7f155c153440 legacy=0x7f155c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:36.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.546+0000 7f1559e00640 1 -- 172.21.15.100:0/1018296605 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c156af0 con 0x7f155c14fce0 2024-01-20T08:13:36.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.547+0000 7f1559e00640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c14fce0 0x7f155c153b80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ecf1b1e42c08eb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.547+0000 7f1559400640 1 -- 172.21.15.100:0/1018296605 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c031640 con 0x7f155c14fce0 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.547+0000 7f1559400640 1 -- 172.21.15.100:0/1018296605 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c0317a0 con 0x7f155c14fce0 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.547+0000 7f1559400640 1 -- 172.21.15.100:0/1018296605 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c031b30 con 0x7f155c14fce0 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 -- 172.21.15.100:0/1018296605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c14fce0 msgr2=0x7f155c153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c14fce0 0x7f155c153b80 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f154c009870 tx=0x7f154c02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 -- 172.21.15.100:0/1018296605 shutdown_connections 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c0a93c0 0x7f155c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 --2- 172.21.15.100:0/1018296605 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c14fce0 0x7f155c153b80 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 -- 172.21.15.100:0/1018296605 >> 172.21.15.100:0/1018296605 conn(0x7f155c06a5e0 msgr2=0x7f155c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 -- 172.21.15.100:0/1018296605 shutdown_connections 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.548+0000 7f1560e00640 1 -- 172.21.15.100:0/1018296605 wait complete. 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.550+0000 7f1560e00640 1 Processor -- start 2024-01-20T08:13:36.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.550+0000 7f1560e00640 1 -- start start 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c14fce0 0x7f155c0ab050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c153440 0x7f155c0c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c1de610 con 0x7f155c0a93c0 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155c14cd50 con 0x7f155c153440 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1560e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155c14c570 con 0x7f155c14fce0 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42148/0 (socket says 172.21.15.100:42148) 2024-01-20T08:13:36.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 -- 172.21.15.100:0/3865304864 learned_addr learned my addr 172.21.15.100:0/3865304864 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 -- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c14fce0 msgr2=0x7f155c0ab050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c14fce0 0x7f155c0ab050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 -- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c153440 msgr2=0x7f155c0c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c153440 0x7f155c0c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.551+0000 7f1559e00640 1 -- 172.21.15.100:0/3865304864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f154c0094d0 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1559e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c03ac60 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c03ade0 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c044630 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155c0c1020 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.552+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f155c0ab590 con 0x7f155c0a93c0 2024-01-20T08:13:36.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.553+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f155c04e970 con 0x7f155c0a93c0 2024-01-20T08:13:36.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.554+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f154c02f050 con 0x7f155c0a93c0 2024-01-20T08:13:36.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.555+0000 7f1552a00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 0x7f153406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.555+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f154c0ab730 con 0x7f155c0a93c0 2024-01-20T08:13:36.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.555+0000 7f1551200640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 0x7f153406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.556+0000 7f1551200640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 0x7f153406d3c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1544006fd0 tx=0x7f1544008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.562 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.559+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f154c0765f0 con 0x7f155c0a93c0 2024-01-20T08:13:36.677 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:13:36.683 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:13:36.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.747+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f155c06b320 con 0x7f155c0a93c0 2024-01-20T08:13:36.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.749+0000 7f1552a00640 1 -- 172.21.15.100:0/3865304864 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16537 (secure 0 0 0) 0x7f154c079c10 con 0x7f155c0a93c0 2024-01-20T08:13:36.752 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:36.752 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":72,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:22.184420+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 msgr2=0x7f153406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 0x7f153406d3c0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f1544006fd0 tx=0x7f1544008040 comp rx=0 tx=0).stop 2024-01-20T08:13:36.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 msgr2=0x7f155c14c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f154c000c00 tx=0x7f154c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 shutdown_connections 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f155c153440 0x7f155c0c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f153406af00 0x7f153406d3c0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f155c14fce0 0x7f155c0ab050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 --2- 172.21.15.100:0/3865304864 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f155c0a93c0 0x7f155c14c810 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.751+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 >> 172.21.15.100:0/3865304864 conn(0x7f155c06a5e0 msgr2=0x7f155c155c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.752+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 shutdown_connections 2024-01-20T08:13:36.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.752+0000 7f1560e00640 1 -- 172.21.15.100:0/3865304864 wait complete. 2024-01-20T08:13:36.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:13:36.771 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:13:36.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.964+0000 7f82a7000640 1 Processor -- start 2024-01-20T08:13:36.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.964+0000 7f82a7000640 1 -- start start 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.965+0000 7f82a7000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a014b720 0x7f82a01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.965+0000 7f82a7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1d00 0x7f82a006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f82a7000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82a0154ba0 con 0x7f82a00c1850 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f82a7000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82a014bb00 con 0x7f82a014b720 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f82a7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0155a00 con 0x7f82a00c1d00 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a014b720 0x7f82a01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f82a014b720 0x7f82a01515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42156/0 (socket says 172.21.15.100:42156) 2024-01-20T08:13:36.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 -- 172.21.15.100:0/3123569846 learned_addr learned my addr 172.21.15.100:0/3123569846 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 -- 172.21.15.100:0/3123569846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1d00 msgr2=0x7f82a006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 --2- 172.21.15.100:0/3123569846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1d00 0x7f82a006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 -- 172.21.15.100:0/3123569846 >> v1:172.21.15.110:6789/0 conn(0x7f82a00c1850 legacy=0x7f82a006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.966+0000 7f829fe00640 1 -- 172.21.15.100:0/3123569846 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82a0154df0 con 0x7f82a014b720 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.967+0000 7f829fe00640 1 --2- 172.21.15.100:0/3123569846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a014b720 0x7f82a01515b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f829000bb10 tx=0x7f829002e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9150efae6c11086 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.967+0000 7f829ea00640 1 -- 172.21.15.100:0/3123569846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829002ede0 con 0x7f82a014b720 2024-01-20T08:13:36.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f829ea00640 1 -- 172.21.15.100:0/3123569846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8290036440 con 0x7f82a014b720 2024-01-20T08:13:36.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f829ea00640 1 -- 172.21.15.100:0/3123569846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82900367d0 con 0x7f82a014b720 2024-01-20T08:13:36.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 -- 172.21.15.100:0/3123569846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a014b720 msgr2=0x7f82a01515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 --2- 172.21.15.100:0/3123569846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a014b720 0x7f82a01515b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f829000bb10 tx=0x7f829002e030 comp rx=0 tx=0).stop 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 -- 172.21.15.100:0/3123569846 shutdown_connections 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 --2- 172.21.15.100:0/3123569846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1d00 0x7f82a006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 --2- 172.21.15.100:0/3123569846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a014b720 0x7f82a01515b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 -- 172.21.15.100:0/3123569846 >> 172.21.15.100:0/3123569846 conn(0x7f82a00c2940 msgr2=0x7f82a00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 -- 172.21.15.100:0/3123569846 shutdown_connections 2024-01-20T08:13:36.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.968+0000 7f82a7000640 1 -- 172.21.15.100:0/3123569846 wait complete. 2024-01-20T08:13:36.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.970+0000 7f82a7000640 1 Processor -- start 2024-01-20T08:13:36.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.970+0000 7f82a7000640 1 -- start start 2024-01-20T08:13:36.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1850 0x7f82a01eae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 0x7f82a01eb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a00aa900 con 0x7f82a00c1d00 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a0147ba0 con 0x7f82a014b720 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f82a7000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82a01ea9a0 con 0x7f82a00c1850 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f829f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f829f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42166/0 (socket says 172.21.15.100:42166) 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f829f400640 1 -- 172.21.15.100:0/803823908 learned_addr learned my addr 172.21.15.100:0/803823908 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.971+0000 7f829fe00640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1850 0x7f82a01eae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f82a5000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 0x7f82a01eb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 -- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1850 msgr2=0x7f82a01eae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1850 0x7f82a01eae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 -- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 msgr2=0x7f82a01eb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 0x7f82a01eb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:36.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 -- 172.21.15.100:0/803823908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829000b770 con 0x7f82a00c1d00 2024-01-20T08:13:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f82a5000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 0x7f82a01eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f829f400640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f828800c440 tx=0x7f828800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8288005480 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82880035f0 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82880039c0 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.972+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a00aa510 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.973+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a01ea370 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.974+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82a01eab10 con 0x7f82a00c1d00 2024-01-20T08:13:36.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.975+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8288003b20 con 0x7f82a00c1d00 2024-01-20T08:13:36.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.975+0000 7f8297e00640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 0x7f827806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:36.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.975+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8288088b00 con 0x7f82a00c1d00 2024-01-20T08:13:36.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.976+0000 7f829fe00640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 0x7f827806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:36.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.976+0000 7f829fe00640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 0x7f827806d390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8290038000 tx=0x7f8290008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:36.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:36.980+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8288053a60 con 0x7f82a00c1d00 2024-01-20T08:13:37.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.173+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f82a004e970 con 0x7f82a00c1d00 2024-01-20T08:13:37.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.174+0000 7f8297e00640 1 -- 172.21.15.100:0/803823908 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v72) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8288017070 con 0x7f82a00c1d00 2024-01-20T08:13:37.177 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:13:37.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 msgr2=0x7f827806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 0x7f827806d390 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8290038000 tx=0x7f8290008040 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 msgr2=0x7f82a00a9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f828800c440 tx=0x7f828800c900 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 shutdown_connections 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f82a014b720 0x7f82a01eb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f82a00c1d00 0x7f82a00a9fd0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f827806aed0 0x7f827806d390 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 --2- 172.21.15.100:0/803823908 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f82a00c1850 0x7f82a01eae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.176+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 >> 172.21.15.100:0/803823908 conn(0x7f82a00c2940 msgr2=0x7f82a00c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.177+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 shutdown_connections 2024-01-20T08:13:37.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.177+0000 7f82a7000640 1 -- 172.21.15.100:0/803823908 wait complete. 2024-01-20T08:13:37.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:13:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.390+0000 7f04a6c00640 1 Processor -- start 2024-01-20T08:13:37.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.390+0000 7f04a6c00640 1 -- start start 2024-01-20T08:13:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.391+0000 7f04a6c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f04a014c750 0x7f04a0153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.391+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f04a00a91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f04a6c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04a00ab620 con 0x7f04a00a96f0 2024-01-20T08:13:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f04a6c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04a014cb30 con 0x7f04a014c750 2024-01-20T08:13:37.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f04a6c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00ab900 con 0x7f04a00ab0b0 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f04a4c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f04a00a96f0 0x7f04a00715a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34972/0 (socket says 172.21.15.100:34972) 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f04a4c00640 1 -- 172.21.15.100:0/3241420479 learned_addr learned my addr 172.21.15.100:0/3241420479 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f049fe00640 1 --2- 172.21.15.100:0/3241420479 >> v2:172.21.15.110:3300/0 conn(0x7f04a014c750 0x7f04a0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f049f400640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f04a00a91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2462708505 0 0) 0x7f04a00ab620 con 0x7f04a00a96f0 2024-01-20T08:13:37.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.392+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0480003520 con 0x7f04a00a96f0 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3270768661 0 0) 0x7f0480003520 con 0x7f04a00a96f0 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 msgr2=0x7f04a00a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f04a00a91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 >> v2:172.21.15.110:3300/0 conn(0x7f04a014c750 msgr2=0x7f04a0153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 --2- 172.21.15.100:0/3241420479 >> v2:172.21.15.110:3300/0 conn(0x7f04a014c750 0x7f04a0153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a00abbe0 con 0x7f04a00a96f0 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f04980019f0 con 0x7f04a00a96f0 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 >> v1:172.21.15.100:6789/0 conn(0x7f04a00a96f0 legacy=0x7f04a00715a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f0480003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0480003ef0 0x7f04800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480004d00 0x7f0480005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a014cb30 con 0x7f0480003ef0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a00ab900 con 0x7f0480004d00 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f048000b980 con 0x7f04a00ab0b0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.393+0000 7f049f400640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0480003ef0 0x7f04800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049fe00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f0480003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049f400640 1 -- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 msgr2=0x7f0480003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049f400640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a00ab0b0 0x7f0480003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f04a4c00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480004d00 0x7f0480005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049f400640 1 -- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480004d00 msgr2=0x7f0480005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049f400640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480004d00 0x7f0480005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f049f400640 1 -- 172.21.15.100:0/3241420479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0480003520 con 0x7f0480003ef0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.394+0000 7f04a4c00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480004d00 0x7f0480005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.395+0000 7f049f400640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0480003ef0 0x7f04800047c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0488009ac0 tx=0x7f04800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3f9da4e412d386 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.395+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048802c6b0 con 0x7f0480003ef0 2024-01-20T08:13:37.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.395+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f048802c810 con 0x7f0480003ef0 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.395+0000 7f049ea00640 1 -- 172.21.15.100:0/3241420479 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f048802cba0 con 0x7f0480003ef0 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 -- 172.21.15.100:0/3241420479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0480003ef0 msgr2=0x7f04800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 --2- 172.21.15.100:0/3241420479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0480003ef0 0x7f04800047c0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f0488009ac0 tx=0x7f04800057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a4c00640 1 -- 172.21.15.100:0/3241420479 reap_dead start 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 -- 172.21.15.100:0/3241420479 shutdown_connections 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 -- 172.21.15.100:0/3241420479 >> 172.21.15.100:0/3241420479 conn(0x7f04a00c6090 msgr2=0x7f04a00c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 -- 172.21.15.100:0/3241420479 shutdown_connections 2024-01-20T08:13:37.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.396+0000 7f04a6c00640 1 -- 172.21.15.100:0/3241420479 wait complete. 2024-01-20T08:13:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.397+0000 7f04a6c00640 1 Processor -- start 2024-01-20T08:13:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.398+0000 7f04a6c00640 1 -- start start 2024-01-20T08:13:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.398+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 0x7f04a0140650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.398+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 0x7f04a0155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.398+0000 7f04a6c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.398+0000 7f04a6c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0154930 con 0x7f04a0156230 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a6c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0154be0 con 0x7f0480003ef0 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a6c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04a0154ec0 con 0x7f04a0153a70 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42194/0 (socket says 172.21.15.100:42194) 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 -- 172.21.15.100:0/2823272665 learned_addr learned my addr 172.21.15.100:0/2823272665 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f049fe00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 0x7f04a0140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f049f400640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 0x7f04a0155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 -- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 msgr2=0x7f04a0155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 0x7f04a0155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 -- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 msgr2=0x7f04a0140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 0x7f04a0140650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.404 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f04a4c00640 1 -- 172.21.15.100:0/2823272665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a01551a0 con 0x7f04a0156230 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f049f400640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 0x7f04a0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.399+0000 7f049fe00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 0x7f04a0140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f04a4c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f04a00c2af0 tx=0x7f049800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049800de70 con 0x7f04a0156230 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f049800bb80 con 0x7f04a0156230 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0498007110 con 0x7f04a0156230 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a014d2d0 con 0x7f04a0156230 2024-01-20T08:13:37.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.400+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a0140b90 con 0x7f04a0156230 2024-01-20T08:13:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.401+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04a014d130 con 0x7f04a0156230 2024-01-20T08:13:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.402+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0498007270 con 0x7f04a0156230 2024-01-20T08:13:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.403+0000 7f0497e00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 0x7f047806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.403+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0498089b10 con 0x7f04a0156230 2024-01-20T08:13:37.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.403+0000 7f049fe00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 0x7f047806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.404+0000 7f049fe00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 0x7f047806d390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0490009a80 tx=0x7f0490008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.407+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f04a014d130 con 0x7f04a0156230 2024-01-20T08:13:37.599 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.596+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f04a014d130 con 0x7f04a0156230 2024-01-20T08:13:37.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.597+0000 7f0497e00640 1 -- 172.21.15.100:0/2823272665 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v72) v1 ==== 104+0+11 (secure 0 0 0) 0x7f04a014d130 con 0x7f04a0156230 2024-01-20T08:13:37.600 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.599+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 msgr2=0x7f047806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.599+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 0x7f047806d390 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0490009a80 tx=0x7f0490008040 comp rx=0 tx=0).stop 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.599+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 msgr2=0x7f04a014d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.599+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f04a00c2af0 tx=0x7f049800b4a0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 shutdown_connections 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f04a0156230 0x7f04a014d7f0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f047806aed0 0x7f047806d390 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f04a0153a70 0x7f04a0155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.603 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 --2- 172.21.15.100:0/2823272665 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0480003ef0 0x7f04a0140650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 >> 172.21.15.100:0/2823272665 conn(0x7f04a00c6090 msgr2=0x7f04a00c0990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 shutdown_connections 2024-01-20T08:13:37.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.600+0000 7f04a6c00640 1 -- 172.21.15.100:0/2823272665 wait complete. 2024-01-20T08:13:37.621 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:13:37.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.829+0000 7f422ac00640 1 Processor -- start 2024-01-20T08:13:37.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.829+0000 7f422ac00640 1 -- start start 2024-01-20T08:13:37.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f422ac00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f42240c4ed0 0x7f42240c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f422ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42240aa330 0x7f42240c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f422ac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4224156710 con 0x7f422414fc10 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f422ac00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f422414fff0 con 0x7f42240c4ed0 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f422ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4224072d10 con 0x7f42240aa330 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f4228e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f42240c4ed0 0x7f42240c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f4229800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f422414fc10 0x7f42240a4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34986/0 (socket says 172.21.15.100:34986) 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.831+0000 7f4229800640 1 -- 172.21.15.100:0/3192947361 learned_addr learned my addr 172.21.15.100:0/3192947361 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.832+0000 7f422a200640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42240aa330 0x7f42240c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.832+0000 7f4228e00640 1 -- 172.21.15.100:0/3192947361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42240aa330 msgr2=0x7f42240c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.832+0000 7f4228e00640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42240aa330 0x7f42240c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.832+0000 7f4228e00640 1 -- 172.21.15.100:0/3192947361 >> v1:172.21.15.100:6789/0 conn(0x7f422414fc10 legacy=0x7f42240a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.832+0000 7f4228e00640 1 -- 172.21.15.100:0/3192947361 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4224155b00 con 0x7f42240c4ed0 2024-01-20T08:13:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.833+0000 7f4228e00640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f42240c3aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7e8fadb61baa661 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.833+0000 7f4223e00640 1 -- 172.21.15.100:0/3192947361 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c0316f0 con 0x7f42240c4ed0 2024-01-20T08:13:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.833+0000 7f4223e00640 1 -- 172.21.15.100:0/3192947361 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c031850 con 0x7f42240c4ed0 2024-01-20T08:13:37.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.833+0000 7f4223e00640 1 -- 172.21.15.100:0/3192947361 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c031be0 con 0x7f42240c4ed0 2024-01-20T08:13:37.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 -- 172.21.15.100:0/3192947361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 msgr2=0x7f42240c3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f42240c3aa0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f420c0097a0 tx=0x7f420c02b790 comp rx=0 tx=0).stop 2024-01-20T08:13:37.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 -- 172.21.15.100:0/3192947361 shutdown_connections 2024-01-20T08:13:37.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f42240aa330 0x7f42240c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 --2- 172.21.15.100:0/3192947361 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f42240c3aa0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 -- 172.21.15.100:0/3192947361 >> 172.21.15.100:0/3192947361 conn(0x7f42240c5ba0 msgr2=0x7f42240c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 -- 172.21.15.100:0/3192947361 shutdown_connections 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.834+0000 7f422ac00640 1 -- 172.21.15.100:0/3192947361 wait complete. 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.836+0000 7f422ac00640 1 Processor -- start 2024-01-20T08:13:37.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.836+0000 7f422ac00640 1 -- start start 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42240aa330 0x7f42240c18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422414fc10 0x7f42241529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241dbad0 con 0x7f42240c4ed0 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241516b0 con 0x7f42240aa330 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422ac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42241ee0b0 con 0x7f422414fc10 2024-01-20T08:13:37.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42214/0 (socket says 172.21.15.100:42214) 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 -- 172.21.15.100:0/4280097090 learned_addr learned my addr 172.21.15.100:0/4280097090 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f422a200640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422414fc10 0x7f42241529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 -- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422414fc10 msgr2=0x7f42241529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422414fc10 0x7f42241529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 -- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42240aa330 msgr2=0x7f42240c18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42240aa330 0x7f42240c18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.837+0000 7f4228e00640 1 -- 172.21.15.100:0/4280097090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420c009400 con 0x7f42240c4ed0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f4228e00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098c0 tx=0x7f420c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c034890 con 0x7f42240c4ed0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420c031f00 con 0x7f42240c4ed0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420c034c30 con 0x7f42240c4ed0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42241dbd20 con 0x7f42240c4ed0 2024-01-20T08:13:37.842 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.838+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42240c2120 con 0x7f42240c4ed0 2024-01-20T08:13:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.839+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f422404e970 con 0x7f42240c4ed0 2024-01-20T08:13:37.843 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.840+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f420c03b040 con 0x7f42240c4ed0 2024-01-20T08:13:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.841+0000 7f4221600640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.841+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f420c0aaff0 con 0x7f42240c4ed0 2024-01-20T08:13:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.841+0000 7f4229800640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:37.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.842+0000 7f4229800640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 0x7f41fc06d3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f42140012e0 tx=0x7f4214001590 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:37.848 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:37.846+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f420c075fd0 con 0x7f42240c4ed0 2024-01-20T08:13:38.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.039+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42240c4cb0 con 0x7f42240c4ed0 2024-01-20T08:13:38.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.040+0000 7f4221600640 1 -- 172.21.15.100:0/4280097090 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v72) v1 ==== 100+0+11 (secure 0 0 0) 0x7f420c0795f0 con 0x7f42240c4ed0 2024-01-20T08:13:38.043 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:13:38.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 msgr2=0x7f41fc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 0x7f41fc06d3c0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f42140012e0 tx=0x7f4214001590 comp rx=0 tx=0).stop 2024-01-20T08:13:38.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 msgr2=0x7f4224152480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f420c0098c0 tx=0x7f420c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.045 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 shutdown_connections 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f41fc06af00 0x7f41fc06d3c0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f422414fc10 0x7f42241529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f42240c4ed0 0x7f4224152480 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 --2- 172.21.15.100:0/4280097090 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f42240aa330 0x7f42240c18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 >> 172.21.15.100:0/4280097090 conn(0x7f42240c5ba0 msgr2=0x7f42240a7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 shutdown_connections 2024-01-20T08:13:38.046 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.042+0000 7f422ac00640 1 -- 172.21.15.100:0/4280097090 wait complete. 2024-01-20T08:13:38.063 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.266+0000 7fd1ef800640 1 Processor -- start 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.266+0000 7fd1ef800640 1 -- start start 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.267+0000 7fd1ef800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1e814b720 0x7fd1e81515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.267+0000 7fd1ef800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd1e80c1850 0x7fd1e80c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ef800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e8154ba0 con 0x7fd1e806c8d0 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ef800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e814bb00 con 0x7fd1e814b720 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ef800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e8155a00 con 0x7fd1e80c1850 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ece00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1e814b720 0x7fd1e81515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ed800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd1e806c8d0 0x7fd1e806cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:34990/0 (socket says 172.21.15.100:34990) 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ece00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd1e814b720 0x7fd1e81515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42220/0 (socket says 172.21.15.100:42220) 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ed800640 1 -- 172.21.15.100:0/272652399 learned_addr learned my addr 172.21.15.100:0/272652399 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1e7e00640 1 --2- 172.21.15.100:0/272652399 >> v2:172.21.15.110:3300/0 conn(0x7fd1e80c1850 0x7fd1e80c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ece00640 1 -- 172.21.15.100:0/272652399 >> v2:172.21.15.110:3300/0 conn(0x7fd1e80c1850 msgr2=0x7fd1e80c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ece00640 1 --2- 172.21.15.100:0/272652399 >> v2:172.21.15.110:3300/0 conn(0x7fd1e80c1850 0x7fd1e80c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1ece00640 1 -- 172.21.15.100:0/272652399 >> v1:172.21.15.100:6789/0 conn(0x7fd1e806c8d0 legacy=0x7fd1e806cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.268+0000 7fd1e7400640 1 -- 172.21.15.100:0/272652399 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2150987373 0 0) 0x7fd1e8154ba0 con 0x7fd1e806c8d0 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.269+0000 7fd1ece00640 1 -- 172.21.15.100:0/272652399 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8154df0 con 0x7fd1e814b720 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1ece00640 1 --2- 172.21.15.100:0/272652399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e81515b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80ac030 tx=0x7fd1d802e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed4fc20269646a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1e7400640 1 -- 172.21.15.100:0/272652399 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d802edc0 con 0x7fd1e814b720 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1e7400640 1 -- 172.21.15.100:0/272652399 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d8036440 con 0x7fd1e814b720 2024-01-20T08:13:38.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1e7400640 1 -- 172.21.15.100:0/272652399 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d80367d0 con 0x7fd1e814b720 2024-01-20T08:13:38.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1ef800640 1 -- 172.21.15.100:0/272652399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 msgr2=0x7fd1e81515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1ef800640 1 --2- 172.21.15.100:0/272652399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e81515b0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd1e80ac030 tx=0x7fd1d802e010 comp rx=0 tx=0).stop 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1ef800640 1 -- 172.21.15.100:0/272652399 shutdown_connections 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.270+0000 7fd1ef800640 1 --2- 172.21.15.100:0/272652399 >> v2:172.21.15.110:3300/0 conn(0x7fd1e80c1850 0x7fd1e80c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.271+0000 7fd1ef800640 1 --2- 172.21.15.100:0/272652399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e81515b0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.271+0000 7fd1ef800640 1 -- 172.21.15.100:0/272652399 >> 172.21.15.100:0/272652399 conn(0x7fd1e80c2940 msgr2=0x7fd1e80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.271+0000 7fd1ef800640 1 -- 172.21.15.100:0/272652399 shutdown_connections 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.271+0000 7fd1ef800640 1 -- 172.21.15.100:0/272652399 wait complete. 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.272+0000 7fd1ef800640 1 Processor -- start 2024-01-20T08:13:38.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.272+0000 7fd1ef800640 1 -- start start 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1e806c8d0 0x7fd1e8071580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 0x7fd1e81478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e814c430 con 0x7fd1e814b720 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81ee1f0 con 0x7fd1e806c8d0 2024-01-20T08:13:38.279 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.273+0000 7fd1ef800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81ee4d0 con 0x7fd1e80c1850 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42234/0 (socket says 172.21.15.100:42234) 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 -- 172.21.15.100:0/2754004149 learned_addr learned my addr 172.21.15.100:0/2754004149 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1e7e00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 0x7fd1e81478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ece00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1e806c8d0 0x7fd1e8071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 -- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 msgr2=0x7fd1e81478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 0x7fd1e81478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 -- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1e806c8d0 msgr2=0x7fd1e8071580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1e806c8d0 0x7fd1e8071580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 -- 172.21.15.100:0/2754004149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d800b6a0 con 0x7fd1e814b720 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1e7e00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 0x7fd1e81478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:38.280 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1ed800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000c7a0 tx=0x7fd1e000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.274+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000a640 con 0x7fd1e814b720 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.275+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e000a7a0 con 0x7fd1e814b720 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.275+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000abd0 con 0x7fd1e814b720 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.275+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e814c680 con 0x7fd1e814b720 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.275+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e8072270 con 0x7fd1e814b720 2024-01-20T08:13:38.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.276+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e814cba0 con 0x7fd1e814b720 2024-01-20T08:13:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.277+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd1e000ad30 con 0x7fd1e814b720 2024-01-20T08:13:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.278+0000 7fd1e4c00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 0x7fd1c006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.278+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1e0088bf0 con 0x7fd1e814b720 2024-01-20T08:13:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.278+0000 7fd1ece00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 0x7fd1c006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.279+0000 7fd1ece00640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 0x7fd1c006d390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8038000 tx=0x7fd1d8032000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.282+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd1e814cba0 con 0x7fd1e814b720 2024-01-20T08:13:38.480 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.477+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd1e814cba0 con 0x7fd1e814b720 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.478+0000 7fd1e4c00640 1 -- 172.21.15.100:0/2754004149 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v72) v1 ==== 84+0+209 (secure 0 0 0) 0x7fd1e814cba0 con 0x7fd1e814b720 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout:[ 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 1, 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": ".mgr" 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 12, 2024-01-20T08:13:38.481 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_metadata" 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout: }, 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout: { 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolnum": 13, 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout: "poolname": "cephfs_data" 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout: } 2024-01-20T08:13:38.482 INFO:teuthology.orchestra.run.smithi100.stdout:] 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.480+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 msgr2=0x7fd1c006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.480+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 0x7fd1c006d390 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd1d8038000 tx=0x7fd1d8032000 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.480+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 msgr2=0x7fd1e8147e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.480+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000c7a0 tx=0x7fd1e000cc60 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 shutdown_connections 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd1e814b720 0x7fd1e8147e00 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd1c006aed0 0x7fd1c006d390 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd1e80c1850 0x7fd1e81478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 --2- 172.21.15.100:0/2754004149 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd1e806c8d0 0x7fd1e8071580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 >> 172.21.15.100:0/2754004149 conn(0x7fd1e80c2940 msgr2=0x7fd1e8153ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 shutdown_connections 2024-01-20T08:13:38.484 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.481+0000 7fd1ef800640 1 -- 172.21.15.100:0/2754004149 wait complete. 2024-01-20T08:13:38.502 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs2' 2024-01-20T08:13:38.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_metadata --pg_num_min 64 2024-01-20T08:13:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.703+0000 7f2cbae00640 1 Processor -- start 2024-01-20T08:13:38.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.704+0000 7f2cbae00640 1 -- start start 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb40c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cb4070c00 0x7f2cb406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2cb40a84a0 0x7f2cb4154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb40a8ce0 con 0x7f2cb4070c00 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb4148460 con 0x7f2cb40a84a0 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.705+0000 7f2cbae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb406d1d0 con 0x7f2cb4148080 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cb4070c00 0x7f2cb406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2cb4070c00 0x7f2cb406d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42240/0 (socket says 172.21.15.100:42240) 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 -- 172.21.15.100:0/3953767815 learned_addr learned my addr 172.21.15.100:0/3953767815 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cb3e00640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb40c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cb8e00640 1 --2- 172.21.15.100:0/3953767815 >> v2:172.21.15.110:3300/0 conn(0x7f2cb40a84a0 0x7f2cb4154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 -- 172.21.15.100:0/3953767815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 msgr2=0x7f2cb40c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb40c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 -- 172.21.15.100:0/3953767815 >> v2:172.21.15.110:3300/0 conn(0x7f2cb40a84a0 msgr2=0x7f2cb4154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 --2- 172.21.15.100:0/3953767815 >> v2:172.21.15.110:3300/0 conn(0x7f2cb40a84a0 0x7f2cb4154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.710 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.706+0000 7f2cab200640 1 -- 172.21.15.100:0/3953767815 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb40c2540 con 0x7f2cb4070c00 2024-01-20T08:13:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.707+0000 7f2cab200640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb4070c00 0x7f2cb406d660 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2cb414eff0 tx=0x7f2c9c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918a633fe2ccd155 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cb3400640 1 -- 172.21.15.100:0/3953767815 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c0317e0 con 0x7f2cb4070c00 2024-01-20T08:13:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cb3400640 1 -- 172.21.15.100:0/3953767815 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c031940 con 0x7f2cb4070c00 2024-01-20T08:13:38.711 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cb3400640 1 -- 172.21.15.100:0/3953767815 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c031cd0 con 0x7f2cb4070c00 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cbae00640 1 -- 172.21.15.100:0/3953767815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb4070c00 msgr2=0x7f2cb406d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb4070c00 0x7f2cb406d660 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f2cb414eff0 tx=0x7f2c9c02b880 comp rx=0 tx=0).stop 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cbae00640 1 -- 172.21.15.100:0/3953767815 shutdown_connections 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3953767815 >> v2:172.21.15.110:3300/0 conn(0x7f2cb40a84a0 0x7f2cb4154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.708+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb4070c00 0x7f2cb406d660 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.709+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3953767815 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb40c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.709+0000 7f2cbae00640 1 -- 172.21.15.100:0/3953767815 >> 172.21.15.100:0/3953767815 conn(0x7f2cb40c2b00 msgr2=0x7f2cb40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:38.712 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.709+0000 7f2cbae00640 1 -- 172.21.15.100:0/3953767815 shutdown_connections 2024-01-20T08:13:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.709+0000 7f2cbae00640 1 -- 172.21.15.100:0/3953767815 wait complete. 2024-01-20T08:13:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.710+0000 7f2cbae00640 1 Processor -- start 2024-01-20T08:13:38.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.710+0000 7f2cbae00640 1 -- start start 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 0x7f2cb4141310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb41ed410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb40aa5e0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4153090 con 0x7f2cb4070c00 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cbae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb4141d90 con 0x7f2cb4148080 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.711+0000 7f2cab200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42256/0 (socket says 172.21.15.100:42256) 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 -- 172.21.15.100:0/3527076019 learned_addr learned my addr 172.21.15.100:0/3527076019 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cb3e00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 0x7f2cb4141310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cb8e00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb41ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.716 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 -- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 msgr2=0x7f2cb41ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb41ed410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 -- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 msgr2=0x7f2cb4141310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 0x7f2cb4141310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 -- 172.21.15.100:0/3527076019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c9c0094d0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cb3e00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 0x7f2cb4141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.712+0000 7f2cab200640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000c00 tx=0x7f2c9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.713+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c032880 con 0x7f2cb40a84a0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.713+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9c032a20 con 0x7f2cb40a84a0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.713+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb40aa300 con 0x7f2cb40a84a0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.713+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9c032dd0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.713+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb4152d20 con 0x7f2cb40a84a0 2024-01-20T08:13:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.714+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb41528a0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.715+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2c9c0453f0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.716+0000 7f2cb0c00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 0x7f2c8c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.716+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c9c0ab730 con 0x7f2cb40a84a0 2024-01-20T08:13:38.719 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.717+0000 7f2cb3e00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 0x7f2c8c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:38.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.717+0000 7f2cb3e00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 0x7f2c8c06d390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006fd0 tx=0x7f2ca4008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:38.723 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.721+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2cb41528a0 con 0x7f2cb40a84a0 2024-01-20T08:13:38.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:38.913+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2cb41528a0 con 0x7f2cb40a84a0 2024-01-20T08:13:39.097 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.094+0000 7f2cb0c00640 1 -- 172.21.15.100:0/3527076019 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_metadata", "pg_num_min": 64}]=0 pool 'cephfs2_metadata' created v73) v1 ==== 140+0+0 (secure 0 0 0) 0x7f2cb41528a0 con 0x7f2cb40a84a0 2024-01-20T08:13:39.097 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' created 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 msgr2=0x7f2c8c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 0x7f2c8c06d390 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ca4006fd0 tx=0x7f2ca4008040 comp rx=0 tx=0).stop 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 msgr2=0x7f2cb4141850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2c9c000c00 tx=0x7f2c9c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 shutdown_connections 2024-01-20T08:13:39.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2c8c06aed0 0x7f2c8c06d390 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2cb4148080 0x7f2cb41ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2cb40a84a0 0x7f2cb4141850 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 --2- 172.21.15.100:0/3527076019 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2cb4070c00 0x7f2cb4141310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 >> 172.21.15.100:0/3527076019 conn(0x7f2cb40c2b00 msgr2=0x7f2cb40c1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 shutdown_connections 2024-01-20T08:13:39.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.098+0000 7f2cbae00640 1 -- 172.21.15.100:0/3527076019 wait complete. 2024-01-20T08:13:39.126 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs2_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-01-20T08:13:39.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.314+0000 7f991a600640 1 Processor -- start 2024-01-20T08:13:39.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.314+0000 7f991a600640 1 -- start start 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9914151e60 0x7f99140aa190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 0x7f9914154ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9914157f00 0x7f99141553e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9914155920 con 0x7f9914151e60 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9914158470 con 0x7f99140aa6d0 2024-01-20T08:13:39.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f991a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9914158750 con 0x7f9914157f00 2024-01-20T08:13:39.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f9913400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9914151e60 0x7f99140aa190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f9913400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9914151e60 0x7f99140aa190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33284/0 (socket says 172.21.15.100:33284) 2024-01-20T08:13:39.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.316+0000 7f9913400640 1 -- 172.21.15.100:0/2808547567 learned_addr learned my addr 172.21.15.100:0/2808547567 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913e00640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9914157f00 0x7f99141553e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f990be00640 1 --2- 172.21.15.100:0/2808547567 >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 0x7f9914154ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913400640 1 -- 172.21.15.100:0/2808547567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9914157f00 msgr2=0x7f99141553e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913400640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9914157f00 0x7f99141553e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913400640 1 -- 172.21.15.100:0/2808547567 >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 msgr2=0x7f9914154ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913400640 1 --2- 172.21.15.100:0/2808547567 >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 0x7f9914154ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f9913400640 1 -- 172.21.15.100:0/2808547567 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9914158a30 con 0x7f9914151e60 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.317+0000 7f990be00640 1 --2- 172.21.15.100:0/2808547567 >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 0x7f9914154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:39.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.318+0000 7f9913400640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140aa190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f99140c5b10 tx=0x7f990402b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a870a84c56c7ce7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:39.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.318+0000 7f9912a00640 1 -- 172.21.15.100:0/2808547567 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99040317d0 con 0x7f9914151e60 2024-01-20T08:13:39.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.318+0000 7f9912a00640 1 -- 172.21.15.100:0/2808547567 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9904031930 con 0x7f9914151e60 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.318+0000 7f9912a00640 1 -- 172.21.15.100:0/2808547567 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9904031cc0 con 0x7f9914151e60 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 -- 172.21.15.100:0/2808547567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 msgr2=0x7f99140aa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140aa190 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f99140c5b10 tx=0x7f990402b870 comp rx=0 tx=0).stop 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 -- 172.21.15.100:0/2808547567 shutdown_connections 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9914157f00 0x7f99141553e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 --2- 172.21.15.100:0/2808547567 >> v2:172.21.15.110:3300/0 conn(0x7f99140aa6d0 0x7f9914154ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 --2- 172.21.15.100:0/2808547567 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140aa190 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 -- 172.21.15.100:0/2808547567 >> 172.21.15.100:0/2808547567 conn(0x7f9914066730 msgr2=0x7f9914066b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 -- 172.21.15.100:0/2808547567 shutdown_connections 2024-01-20T08:13:39.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.319+0000 7f991a600640 1 -- 172.21.15.100:0/2808547567 wait complete. 2024-01-20T08:13:39.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.321+0000 7f991a600640 1 Processor -- start 2024-01-20T08:13:39.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.321+0000 7f991a600640 1 -- start start 2024-01-20T08:13:39.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99140aa6d0 0x7f99141ed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 0x7f9914150070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991406e5f0 con 0x7f9914151e60 2024-01-20T08:13:39.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991406ff30 con 0x7f9914157f00 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f991a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99140c5b40 con 0x7f99140aa6d0 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f990be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f990be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33286/0 (socket says 172.21.15.100:33286) 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.322+0000 7f990be00640 1 -- 172.21.15.100:0/3617730752 learned_addr learned my addr 172.21.15.100:0/3617730752 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f9913400640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99140aa6d0 0x7f99141ed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f9913e00640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 0x7f9914150070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 -- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99140aa6d0 msgr2=0x7f99141ed2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99140aa6d0 0x7f99141ed2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 -- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 msgr2=0x7f9914150070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 0x7f9914150070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 -- 172.21.15.100:0/3617730752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99040094d0 con 0x7f9914151e60 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f9913e00640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 0x7f9914150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990be00640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c820 tx=0x7f98fc00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:39.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc007a30 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98fc007b90 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991406bbf0 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.323+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc00ce70 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.324+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991414f700 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.324+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99141514b0 con 0x7f9914151e60 2024-01-20T08:13:39.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.326+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f98fc0113f0 con 0x7f9914151e60 2024-01-20T08:13:39.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.327+0000 7f990b400640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 0x7f98ec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:39.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.327+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 6080+0+0 (secure 0 0 0) 0x7f98fc0898f0 con 0x7f9914151e60 2024-01-20T08:13:39.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.327+0000 7f9913400640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 0x7f98ec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:39.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.328+0000 7f9913400640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 0x7f98ec06d390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9904036000 tx=0x7f990403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:39.335 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.333+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f99141514b0 con 0x7f9914151e60 2024-01-20T08:13:39.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:39.529+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f99141514b0 con 0x7f9914151e60 2024-01-20T08:13:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.100+0000 7f990b400640 1 -- 172.21.15.100:0/3617730752 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs2_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs2_data' created v74) v1 ==== 172+0+0 (secure 0 0 0) 0x7f99141514b0 con 0x7f9914151e60 2024-01-20T08:13:40.103 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' created 2024-01-20T08:13:40.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 msgr2=0x7f98ec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 0x7f98ec06d390 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9904036000 tx=0x7f990403d040 comp rx=0 tx=0).stop 2024-01-20T08:13:40.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 msgr2=0x7f99140a9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00c820 tx=0x7f98fc00cc20 comp rx=0 tx=0).stop 2024-01-20T08:13:40.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 shutdown_connections 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9914157f00 0x7f9914150070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9914151e60 0x7f99140a9060 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f98ec06aed0 0x7f98ec06d390 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 --2- 172.21.15.100:0/3617730752 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99140aa6d0 0x7f99141ed2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 >> 172.21.15.100:0/3617730752 conn(0x7f9914066730 msgr2=0x7f991414b8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.104+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 shutdown_connections 2024-01-20T08:13:40.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.105+0000 7f991a600640 1 -- 172.21.15.100:0/3617730752 wait complete. 2024-01-20T08:13:40.145 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs2 cephfs2_metadata cephfs2_data 2024-01-20T08:13:40.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.323+0000 7fc32a600640 1 Processor -- start 2024-01-20T08:13:40.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.323+0000 7fc32a600640 1 -- start start 2024-01-20T08:13:40.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc32a600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 0x7fc324155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc32a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc32a600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3241559b0 con 0x7fc3240aae30 2024-01-20T08:13:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc32a600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3240c1930 con 0x7fc3240c4e20 2024-01-20T08:13:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc32a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc32406c160 con 0x7fc3240c0ed0 2024-01-20T08:13:40.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc329200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 0x7fc324155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.325+0000 7fc323e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:51616/0 (socket says 172.21.15.100:51616) 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 -- 172.21.15.100:0/2040552482 learned_addr learned my addr 172.21.15.100:0/2040552482 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 -- 172.21.15.100:0/2040552482 >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 msgr2=0x7fc324155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 --2- 172.21.15.100:0/2040552482 >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 0x7fc324155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 -- 172.21.15.100:0/2040552482 >> v1:172.21.15.110:6789/0 conn(0x7fc3240aae30 legacy=0x7fc32406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc323e00640 1 -- 172.21.15.100:0/2040552482 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3240c1b80 con 0x7fc3240c0ed0 2024-01-20T08:13:40.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.326+0000 7fc329200640 1 --2- 172.21.15.100:0/2040552482 >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 0x7fc324155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:13:40.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.328+0000 7fc323e00640 1 --2- 172.21.15.100:0/2040552482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00bb10 tx=0x7fc30c02e0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3120a1f1e650ec3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:40.331 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc323400640 1 -- 172.21.15.100:0/2040552482 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c02ee70 con 0x7fc3240c0ed0 2024-01-20T08:13:40.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc323400640 1 -- 172.21.15.100:0/2040552482 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c036440 con 0x7fc3240c0ed0 2024-01-20T08:13:40.332 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc323400640 1 -- 172.21.15.100:0/2040552482 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c0367d0 con 0x7fc3240c0ed0 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 -- 172.21.15.100:0/2040552482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 msgr2=0x7fc3240aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 --2- 172.21.15.100:0/2040552482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc30c00bb10 tx=0x7fc30c02e0c0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 -- 172.21.15.100:0/2040552482 shutdown_connections 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 --2- 172.21.15.100:0/2040552482 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240c0ed0 0x7fc3240aa8f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 --2- 172.21.15.100:0/2040552482 >> v2:172.21.15.110:3300/0 conn(0x7fc3240c4e20 0x7fc324155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 -- 172.21.15.100:0/2040552482 >> 172.21.15.100:0/2040552482 conn(0x7fc3240c5ba0 msgr2=0x7fc3240c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 -- 172.21.15.100:0/2040552482 shutdown_connections 2024-01-20T08:13:40.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.329+0000 7fc32a600640 1 -- 172.21.15.100:0/2040552482 wait complete. 2024-01-20T08:13:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.331+0000 7fc32a600640 1 Processor -- start 2024-01-20T08:13:40.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.331+0000 7fc32a600640 1 -- start start 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 0x7fc32409a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240c0ed0 0x7fc3240bf240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241ee320 con 0x7fc3240c4e20 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3240a71a0 con 0x7fc3240c0ed0 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc32a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3241edd80 con 0x7fc3240aae30 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.332+0000 7fc329c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33290/0 (socket says 172.21.15.100:33290) 2024-01-20T08:13:40.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 -- 172.21.15.100:0/608607417 learned_addr learned my addr 172.21.15.100:0/608607417 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc323e00640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240c0ed0 0x7fc3240bf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329200640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 0x7fc32409a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 -- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 msgr2=0x7fc32409a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 0x7fc32409a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 -- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240c0ed0 msgr2=0x7fc3240bf240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240c0ed0 0x7fc3240bf240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 -- 172.21.15.100:0/608607417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc314009400 con 0x7fc3240c4e20 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329200640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 0x7fc32409a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.333+0000 7fc329c00640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c7a0 tx=0x7fc31c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.334+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c003b70 con 0x7fc3240c4e20 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.334+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31c003cf0 con 0x7fc3240c4e20 2024-01-20T08:13:40.338 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.334+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c00aa90 con 0x7fc3240c4e20 2024-01-20T08:13:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.334+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30c00b770 con 0x7fc3240c4e20 2024-01-20T08:13:40.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.334+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3240a7440 con 0x7fc3240c4e20 2024-01-20T08:13:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.335+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3240a7000 con 0x7fc3240c4e20 2024-01-20T08:13:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.336+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc31c00abf0 con 0x7fc3240c4e20 2024-01-20T08:13:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.337+0000 7fc320c00640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 0x7fc2fc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.337+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6463+0+0 (secure 0 0 0) 0x7fc31c0895f0 con 0x7fc3240c4e20 2024-01-20T08:13:40.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.337+0000 7fc329200640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 0x7fc2fc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:40.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.338+0000 7fc329200640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 0x7fc2fc06d390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc314009bb0 tx=0x7fc314008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:40.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.342+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc3240a7000 con 0x7fc3240c4e20 2024-01-20T08:13:40.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:40.572+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"} v 0) v1 -- 0x7fc3240a56b0 con 0x7fc3240c4e20 2024-01-20T08:13:41.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.123+0000 7fc320c00640 1 -- 172.21.15.100:0/608607417 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs2", "metadata": "cephfs2_metadata", "data": "cephfs2_data"}]=0 new fs with metadata pool 14 and data pool 15 v49) v1 ==== 177+0+0 (secure 0 0 0) 0x7fc3240a56b0 con 0x7fc3240c4e20 2024-01-20T08:13:41.127 INFO:teuthology.orchestra.run.smithi100.stderr:new fs with metadata pool 14 and data pool 15 2024-01-20T08:13:41.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.128+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 msgr2=0x7fc2fc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.128+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 0x7fc2fc06d390 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fc314009bb0 tx=0x7fc314008040 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.128+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 msgr2=0x7fc32414e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.128+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc31c00c7a0 tx=0x7fc31c00cc60 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 shutdown_connections 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3240c4e20 0x7fc32414e070 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3240c0ed0 0x7fc3240bf240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2fc06aed0 0x7fc2fc06d390 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 --2- 172.21.15.100:0/608607417 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3240aae30 0x7fc32409a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.129+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 >> 172.21.15.100:0/608607417 conn(0x7fc3240c5ba0 msgr2=0x7fc324071dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.130+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 shutdown_connections 2024-01-20T08:13:41.133 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.130+0000 7fc32a600640 1 -- 172.21.15.100:0/608607417 wait complete. 2024-01-20T08:13:41.175 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:41.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.344+0000 7fa09fe00640 1 Processor -- start 2024-01-20T08:13:41.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.344+0000 7fa09fe00640 1 -- start start 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 0x7fa0a006d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09fe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a01523a0 con 0x7fa0a00c3e00 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09fe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a00a53f0 con 0x7fa0a006d2b0 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00706a0 con 0x7fa0a00c5570 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09e000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa0a00c3e00 0x7fa0a0159cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48514/0 (socket says 172.21.15.100:48514) 2024-01-20T08:13:41.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.345+0000 7fa09e000640 1 -- 172.21.15.100:0/4153739346 learned_addr learned my addr 172.21.15.100:0/4153739346 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:41.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09f400640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 0x7fa0a006d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114478146 0 0) 0x7fa0a01523a0 con 0x7fa0a00c3e00 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa080003520 con 0x7fa0a00c3e00 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1425154661 0 0) 0x7fa080003520 con 0x7fa0a00c3e00 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 msgr2=0x7fa0a006d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 0x7fa0a006d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 >> v1:172.21.15.110:6789/0 conn(0x7fa0a006d2b0 legacy=0x7fa0a006c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a01520c0 con 0x7fa0a00c3e00 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fa088001670 con 0x7fa0a00c3e00 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 >> v1:172.21.15.100:6789/0 conn(0x7fa0a00c3e00 legacy=0x7fa0a0159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0800039a0 0x7fa080003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800047c0 0x7fa080004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 0x7fa08000db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a00706a0 con 0x7fa0800039a0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa080005500 con 0x7fa0800047c0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08000e0d0 con 0x7fa0a00c5570 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.346+0000 7fa09ea00640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0800039a0 0x7fa080003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09e000640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800047c0 0x7fa080004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09ea00640 1 -- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 msgr2=0x7fa08000db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09ea00640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00c5570 0x7fa08000db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09ea00640 1 -- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800047c0 msgr2=0x7fa080004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09ea00640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800047c0 0x7fa080004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09ea00640 1 -- 172.21.15.100:0/4153739346 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa080003520 con 0x7fa0800039a0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.347+0000 7fa09e000640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800047c0 0x7fa080004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.348+0000 7fa09ea00640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0800039a0 0x7fa080003dc0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa090001750 tx=0x7fa0800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a7221896c2967cd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.348+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900052d0 con 0x7fa0800039a0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.348+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09002e050 con 0x7fa0800039a0 2024-01-20T08:13:41.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.348+0000 7fa09d600640 1 -- 172.21.15.100:0/4153739346 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0900035f0 con 0x7fa0800039a0 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 -- 172.21.15.100:0/4153739346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0800039a0 msgr2=0x7fa080003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 --2- 172.21.15.100:0/4153739346 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0800039a0 0x7fa080003dc0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa090001750 tx=0x7fa0800057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09f400640 1 -- 172.21.15.100:0/4153739346 reap_dead start 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 -- 172.21.15.100:0/4153739346 shutdown_connections 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 -- 172.21.15.100:0/4153739346 >> 172.21.15.100:0/4153739346 conn(0x7fa0a00c2590 msgr2=0x7fa0a00c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 -- 172.21.15.100:0/4153739346 shutdown_connections 2024-01-20T08:13:41.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.349+0000 7fa09fe00640 1 -- 172.21.15.100:0/4153739346 wait complete. 2024-01-20T08:13:41.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.350+0000 7fa09fe00640 1 Processor -- start 2024-01-20T08:13:41.356 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.350+0000 7fa09fe00640 1 -- start start 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800039a0 0x7fa0a014a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00aa4e0 0x7fa0a00a9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0151ee0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a014a850 con 0x7fa0800039a0 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09fe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a0153540 con 0x7fa0a00aa4e0 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33316/0 (socket says 172.21.15.100:33316) 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.351+0000 7fa09f400640 1 -- 172.21.15.100:0/3252228198 learned_addr learned my addr 172.21.15.100:0/3252228198 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09e000640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00aa4e0 0x7fa0a00a9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 -- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00aa4e0 msgr2=0x7fa0a00a9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.357 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09ea00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800039a0 0x7fa0a014a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00aa4e0 0x7fa0a00a9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 -- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800039a0 msgr2=0x7fa0a014a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800039a0 0x7fa0a014a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 -- 172.21.15.100:0/3252228198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a014a030 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09f400640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00c59c0 tx=0x7fa09800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098018070 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09800eb60 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a01552e0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.352+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa098003990 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.353+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a01555c0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.358 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.353+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a00749e0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.355+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa098014420 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.355+0000 7fa096a00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 0x7fa07806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.355+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fa0980896a0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.356+0000 7fa09ea00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 0x7fa07806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.359 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.356+0000 7fa09ea00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 0x7fa07806d3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa090033000 tx=0x7fa090009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.360+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa0980542a0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.537+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a01536b0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.539+0000 7fa096a00640 1 -- 172.21.15.100:0/3252228198 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fa0980097a0 con 0x7fa0a00ab5d0 2024-01-20T08:13:41.543 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:41.543 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":75,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:40.573865+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:41.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 msgr2=0x7fa07806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 0x7fa07806d3c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa090033000 tx=0x7fa090009030 comp rx=0 tx=0).stop 2024-01-20T08:13:41.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 msgr2=0x7fa0a01539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa0a00c59c0 tx=0x7fa09800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 shutdown_connections 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa0a00ab5d0 0x7fa0a01539d0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa07806af00 0x7fa07806d3c0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa0a00aa4e0 0x7fa0a00a9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 --2- 172.21.15.100:0/3252228198 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa0800039a0 0x7fa0a014a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 >> 172.21.15.100:0/3252228198 conn(0x7fa0a00c2590 msgr2=0x7fa0a00c1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 shutdown_connections 2024-01-20T08:13:41.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.542+0000 7fa09fe00640 1 -- 172.21.15.100:0/3252228198 wait complete. 2024-01-20T08:13:41.562 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.758+0000 7fc879800640 1 Processor -- start 2024-01-20T08:13:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.758+0000 7fc879800640 1 -- start start 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc879800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc874071d10 0x7fc8740720f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc879800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 0x7fc874154e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc879800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc874158560 con 0x7fc8740bd5c0 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc879800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740c5640 con 0x7fc874071d10 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc879800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8740c50a0 con 0x7fc8740c7e30 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc873e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc874071d10 0x7fc8740720f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc873400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc8740bd5c0 0x7fc874154720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48524/0 (socket says 172.21.15.100:48524) 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.760+0000 7fc873400640 1 -- 172.21.15.100:0/1809525217 learned_addr learned my addr 172.21.15.100:0/1809525217 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc873e00640 1 -- 172.21.15.100:0/1809525217 >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 msgr2=0x7fc874154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc878e00640 1 --2- 172.21.15.100:0/1809525217 >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 0x7fc874154e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc873e00640 1 --2- 172.21.15.100:0/1809525217 >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 0x7fc874154e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc873e00640 1 -- 172.21.15.100:0/1809525217 >> v1:172.21.15.100:6789/0 conn(0x7fc8740bd5c0 legacy=0x7fc874154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc872a00640 1 -- 172.21.15.100:0/1809525217 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2776429260 0 0) 0x7fc874158560 con 0x7fc8740bd5c0 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc873e00640 1 -- 172.21.15.100:0/1809525217 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87406cb90 con 0x7fc874071d10 2024-01-20T08:13:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.761+0000 7fc878e00640 1 --2- 172.21.15.100:0/1809525217 >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 0x7fc874154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.762+0000 7fc873e00640 1 --2- 172.21.15.100:0/1809525217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc874071d10 0x7fc8740720f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc8740c6840 tx=0x7fc86402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef6fd96f729cb078 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.762+0000 7fc872a00640 1 -- 172.21.15.100:0/1809525217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86402cb60 con 0x7fc874071d10 2024-01-20T08:13:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.762+0000 7fc872a00640 1 -- 172.21.15.100:0/1809525217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86402ccc0 con 0x7fc874071d10 2024-01-20T08:13:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.762+0000 7fc872a00640 1 -- 172.21.15.100:0/1809525217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864034660 con 0x7fc874071d10 2024-01-20T08:13:41.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 -- 172.21.15.100:0/1809525217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc874071d10 msgr2=0x7fc8740720f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 --2- 172.21.15.100:0/1809525217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc874071d10 0x7fc8740720f0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fc8740c6840 tx=0x7fc86402bdb0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 -- 172.21.15.100:0/1809525217 shutdown_connections 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 --2- 172.21.15.100:0/1809525217 >> v2:172.21.15.110:3300/0 conn(0x7fc8740c7e30 0x7fc874154e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 --2- 172.21.15.100:0/1809525217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc874071d10 0x7fc8740720f0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 -- 172.21.15.100:0/1809525217 >> 172.21.15.100:0/1809525217 conn(0x7fc8740c9f30 msgr2=0x7fc8740ca340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 -- 172.21.15.100:0/1809525217 shutdown_connections 2024-01-20T08:13:41.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.763+0000 7fc879800640 1 -- 172.21.15.100:0/1809525217 wait complete. 2024-01-20T08:13:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.765+0000 7fc879800640 1 Processor -- start 2024-01-20T08:13:41.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.765+0000 7fc879800640 1 -- start start 2024-01-20T08:13:41.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 0x7fc874157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8740c7e30 0x7fc8740c2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874148090 con 0x7fc8740bd5c0 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8741e99e0 con 0x7fc874071d10 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc879800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc874157fe0 con 0x7fc8740c7e30 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33334/0 (socket says 172.21.15.100:33334) 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 -- 172.21.15.100:0/2887305630 learned_addr learned my addr 172.21.15.100:0/2887305630 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873e00640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 0x7fc874157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 -- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8740c7e30 msgr2=0x7fc8740c2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8740c7e30 0x7fc8740c2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 -- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 msgr2=0x7fc874157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.766+0000 7fc873400640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 0x7fc874157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc873400640 1 -- 172.21.15.100:0/2887305630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc864009a70 con 0x7fc8740bd5c0 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc873e00640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 0x7fc874157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:41.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc873400640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c4e0 tx=0x7fc85c00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c0074e0 con 0x7fc8740bd5c0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c007660 con 0x7fc8740bd5c0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c004a20 con 0x7fc8740bd5c0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8741e9bf0 con 0x7fc8740bd5c0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.767+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8741ea1b0 con 0x7fc8740bd5c0 2024-01-20T08:13:41.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.768+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8740749e0 con 0x7fc8740bd5c0 2024-01-20T08:13:41.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.769+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc85c004b80 con 0x7fc8740bd5c0 2024-01-20T08:13:41.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.770+0000 7fc86be00640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 0x7fc84c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:41.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.770+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc85c088c20 con 0x7fc8740bd5c0 2024-01-20T08:13:41.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.770+0000 7fc873e00640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 0x7fc84c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:41.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.771+0000 7fc873e00640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 0x7fc84c06d390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc864036000 tx=0x7fc864030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:41.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.774+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc85c053850 con 0x7fc8740bd5c0 2024-01-20T08:13:41.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.953+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc87406c5d0 con 0x7fc8740bd5c0 2024-01-20T08:13:41.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.957+0000 7fc86be00640 1 -- 172.21.15.100:0/2887305630 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+20204 (secure 0 0 0) 0x7fc85c018070 con 0x7fc8740bd5c0 2024-01-20T08:13:41.960 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:41.960 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":75,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:40.573865+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 msgr2=0x7fc84c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 0x7fc84c06d390 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc864036000 tx=0x7fc864030000 comp rx=0 tx=0).stop 2024-01-20T08:13:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 msgr2=0x7fc874156fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:41.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fc85c00c4e0 tx=0x7fc85c00c9a0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 shutdown_connections 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc84c06aed0 0x7fc84c06d390 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8740c7e30 0x7fc8740c2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8740bd5c0 0x7fc874156fa0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 --2- 172.21.15.100:0/2887305630 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc874071d10 0x7fc874157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 >> 172.21.15.100:0/2887305630 conn(0x7fc8740c9f30 msgr2=0x7fc8740ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 shutdown_connections 2024-01-20T08:13:41.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:41.960+0000 7fc879800640 1 -- 172.21.15.100:0/2887305630 wait complete. 2024-01-20T08:13:41.980 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 standby_count_wanted 0 2024-01-20T08:13:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.167+0000 7f55a1c00640 1 Processor -- start 2024-01-20T08:13:42.170 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.167+0000 7f55a1c00640 1 -- start start 2024-01-20T08:13:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f55a1c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f559c0c7ff0 0x7f559c0c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f55a1c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f559c0c4fb0 0x7f559c06c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f55a1c00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c0c6c10 con 0x7f559c151e80 2024-01-20T08:13:42.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f55a1c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0c6ef0 con 0x7f559c0c4fb0 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f55a1c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0c71d0 con 0x7f559c0c7ff0 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.168+0000 7f559aa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f559c151e80 0x7f559c1588b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48526/0 (socket says 172.21.15.100:48526) 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559aa00640 1 -- 172.21.15.100:0/860072234 learned_addr learned my addr 172.21.15.100:0/860072234 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559b400640 1 --2- 172.21.15.100:0/860072234 >> v2:172.21.15.100:3300/0 conn(0x7f559c0c4fb0 0x7f559c06c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f5599600640 1 -- 172.21.15.100:0/860072234 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2293502506 0 0) 0x7f559c0c6c10 con 0x7f559c151e80 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f5599600640 1 -- 172.21.15.100:0/860072234 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f557c003520 con 0x7f559c151e80 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559a000640 1 --2- 172.21.15.100:0/860072234 >> v2:172.21.15.110:3300/0 conn(0x7f559c0c7ff0 0x7f559c0c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559b400640 1 -- 172.21.15.100:0/860072234 >> v2:172.21.15.110:3300/0 conn(0x7f559c0c7ff0 msgr2=0x7f559c0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559b400640 1 --2- 172.21.15.100:0/860072234 >> v2:172.21.15.110:3300/0 conn(0x7f559c0c7ff0 0x7f559c0c4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559b400640 1 -- 172.21.15.100:0/860072234 >> v1:172.21.15.100:6789/0 conn(0x7f559c151e80 legacy=0x7f559c1588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:42.173 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.169+0000 7f559b400640 1 -- 172.21.15.100:0/860072234 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c0c74b0 con 0x7f559c0c4fb0 2024-01-20T08:13:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.170+0000 7f559b400640 1 --2- 172.21.15.100:0/860072234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c4fb0 0x7f559c06c530 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f559c0c6a20 tx=0x7f559402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f99a748030538ff server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:42.174 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.170+0000 7f5599600640 1 -- 172.21.15.100:0/860072234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f559402cbf0 con 0x7f559c0c4fb0 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.170+0000 7f5599600640 1 -- 172.21.15.100:0/860072234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559402cd50 con 0x7f559c0c4fb0 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.170+0000 7f5599600640 1 -- 172.21.15.100:0/860072234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594034660 con 0x7f559c0c4fb0 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 -- 172.21.15.100:0/860072234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c4fb0 msgr2=0x7f559c06c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 --2- 172.21.15.100:0/860072234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c4fb0 0x7f559c06c530 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f559c0c6a20 tx=0x7f559402be40 comp rx=0 tx=0).stop 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 -- 172.21.15.100:0/860072234 shutdown_connections 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 --2- 172.21.15.100:0/860072234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c0c4fb0 0x7f559c06c530 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 --2- 172.21.15.100:0/860072234 >> v2:172.21.15.110:3300/0 conn(0x7f559c0c7ff0 0x7f559c0c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 -- 172.21.15.100:0/860072234 >> 172.21.15.100:0/860072234 conn(0x7f559c0abd20 msgr2=0x7f559c0ac130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 -- 172.21.15.100:0/860072234 shutdown_connections 2024-01-20T08:13:42.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.171+0000 7f55a1c00640 1 -- 172.21.15.100:0/860072234 wait complete. 2024-01-20T08:13:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.173+0000 7f55a1c00640 1 Processor -- start 2024-01-20T08:13:42.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.173+0000 7f55a1c00640 1 -- start start 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f559c0c4fb0 0x7f559c1eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0c7ff0 0x7f559c0bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0ad2b0 con 0x7f559c151e80 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1eafd0 con 0x7f559c0c7ff0 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f55a1c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c0c0bf0 con 0x7f559c0c4fb0 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33352/0 (socket says 172.21.15.100:33352) 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 -- 172.21.15.100:0/3188564510 learned_addr learned my addr 172.21.15.100:0/3188564510 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:42.178 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 -- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f559c0c4fb0 msgr2=0x7f559c1eaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f559c0c4fb0 0x7f559c1eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 -- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0c7ff0 msgr2=0x7f559c0bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0c7ff0 0x7f559c0bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.174+0000 7f559b400640 1 -- 172.21.15.100:0/3188564510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594009a70 con 0x7f559c151e80 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f559b400640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f559402c450 tx=0x7f5594004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594040650 con 0x7f559c151e80 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940407b0 con 0x7f559c151e80 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594040b60 con 0x7f559c151e80 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c0c8e40 con 0x7f559c151e80 2024-01-20T08:13:42.179 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.175+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c0ab600 con 0x7f559c151e80 2024-01-20T08:13:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.176+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c04e970 con 0x7f559c151e80 2024-01-20T08:13:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.177+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5594040cc0 con 0x7f559c151e80 2024-01-20T08:13:42.180 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.178+0000 7f5592a00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 0x7f557406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.178+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f55940aca20 con 0x7f559c151e80 2024-01-20T08:13:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.178+0000 7f559aa00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 0x7f557406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:42.181 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.179+0000 7f559aa00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 0x7f557406d390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f558c000f60 tx=0x7f558c0078f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:42.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.182+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5594077620 con 0x7f559c151e80 2024-01-20T08:13:42.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:42.394+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f559c0aff80 con 0x7f559c151e80 2024-01-20T08:13:43.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.168+0000 7f5592a00640 1 -- 172.21.15.100:0/3188564510 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "standby_count_wanted", "val": "0"}]=0 v52) v1 ==== 119+0+0 (secure 0 0 0) 0x7f55940390b0 con 0x7f559c151e80 2024-01-20T08:13:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.172+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 msgr2=0x7f557406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.172+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 0x7f557406d390 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f558c000f60 tx=0x7f558c0078f0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.172+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 msgr2=0x7f559c1edcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.172+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f559402c450 tx=0x7f5594004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 shutdown_connections 2024-01-20T08:13:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f559c151e80 0x7f559c1edcb0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.176 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f559c0c7ff0 0x7f559c0bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f557406aed0 0x7f557406d390 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 --2- 172.21.15.100:0/3188564510 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f559c0c4fb0 0x7f559c1eaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 >> 172.21.15.100:0/3188564510 conn(0x7f559c0abd20 msgr2=0x7f559c1510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 shutdown_connections 2024-01-20T08:13:43.177 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.173+0000 7f55a1c00640 1 -- 172.21.15.100:0/3188564510 wait complete. 2024-01-20T08:13:43.197 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-01-20T08:13:43.197 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs2 allow_standby_replay false 2024-01-20T08:13:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.403+0000 7fb7df200640 1 Processor -- start 2024-01-20T08:13:43.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.403+0000 7fb7df200640 1 -- start start 2024-01-20T08:13:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.404+0000 7fb7df200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 0x7fb7d8154810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.404+0000 7fb7df200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb7d806b520 0x7fb7d81565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.404+0000 7fb7df200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7d80c9100 con 0x7fb7d806b140 2024-01-20T08:13:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.404+0000 7fb7df200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7d806b9d0 con 0x7fb7d806b520 2024-01-20T08:13:43.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.404+0000 7fb7df200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c84f0 con 0x7fb7d80c7ff0 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb7d806b140 0x7fb7d8155eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48540/0 (socket says 172.21.15.100:48540) 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d7e00640 1 -- 172.21.15.100:0/2009090006 learned_addr learned my addr 172.21.15.100:0/2009090006 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7dd200640 1 --2- 172.21.15.100:0/2009090006 >> v2:172.21.15.110:3300/0 conn(0x7fb7d806b520 0x7fb7d81565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d7400640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 0x7fb7d8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2400294597 0 0) 0x7fb7d80c9100 con 0x7fb7d806b140 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7b8003520 con 0x7fb7d806b140 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1557880629 0 0) 0x7fb7b8003520 con 0x7fb7d806b140 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.405+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 msgr2=0x7fb7d8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 0x7fb7d8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 >> v2:172.21.15.110:3300/0 conn(0x7fb7d806b520 msgr2=0x7fb7d81565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 --2- 172.21.15.100:0/2009090006 >> v2:172.21.15.110:3300/0 conn(0x7fb7d806b520 0x7fb7d81565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d80c87d0 con 0x7fb7d806b140 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fb7c0001670 con 0x7fb7d806b140 2024-01-20T08:13:43.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 >> v1:172.21.15.100:6789/0 conn(0x7fb7d806b140 legacy=0x7fb7d8155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 0x7fb7b8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8003f40 0x7fb7b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b8004d00 0x7fb7b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d806b9d0 con 0x7fb7b8004d00 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c84f0 con 0x7fb7b8003f40 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7b800ba30 con 0x7fb7d80c7ff0 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b8004d00 0x7fb7b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 -- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 msgr2=0x7fb7b8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d80c7ff0 0x7fb7b8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 -- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8003f40 msgr2=0x7fb7b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8003f40 0x7fb7b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.406+0000 7fb7dd200640 1 -- 172.21.15.100:0/2009090006 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8003520 con 0x7fb7b8004d00 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.407+0000 7fb7dd200640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b8004d00 0x7fb7b8005180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0431942a9560ce5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d002cc60 con 0x7fb7b8004d00 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d000f040 con 0x7fb7b8004d00 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7d6a00640 1 -- 172.21.15.100:0/2009090006 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0034440 con 0x7fb7b8004d00 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 -- 172.21.15.100:0/2009090006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b8004d00 msgr2=0x7fb7b8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 --2- 172.21.15.100:0/2009090006 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7b8004d00 0x7fb7b8005180 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fb7d0009fc0 tx=0x7fb7b80057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7dd200640 1 -- 172.21.15.100:0/2009090006 reap_dead start 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 -- 172.21.15.100:0/2009090006 shutdown_connections 2024-01-20T08:13:43.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 -- 172.21.15.100:0/2009090006 >> 172.21.15.100:0/2009090006 conn(0x7fb7d80abc80 msgr2=0x7fb7d80ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 -- 172.21.15.100:0/2009090006 shutdown_connections 2024-01-20T08:13:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.408+0000 7fb7df200640 1 -- 172.21.15.100:0/2009090006 wait complete. 2024-01-20T08:13:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.410+0000 7fb7df200640 1 Processor -- start 2024-01-20T08:13:43.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.410+0000 7fb7df200640 1 -- start start 2024-01-20T08:13:43.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 0x7fb7d81ea520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d8148790 0x7fb7d81ed320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d80c3810 con 0x7fb7d80c61d0 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d8154b60 con 0x7fb7b8004d00 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7df200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d81540b0 con 0x7fb7d8148790 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33378/0 (socket says 172.21.15.100:33378) 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.411+0000 7fb7d7400640 1 -- 172.21.15.100:0/3750361192 learned_addr learned my addr 172.21.15.100:0/3750361192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7e00640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 0x7fb7d81ea520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7dd200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d8148790 0x7fb7d81ed320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 -- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d8148790 msgr2=0x7fb7d81ed320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d8148790 0x7fb7d81ed320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.416 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 -- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 msgr2=0x7fb7d81ea520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 0x7fb7d81ea520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 -- 172.21.15.100:0/3750361192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d81eaa60 con 0x7fb7d80c61d0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7e00640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 0x7fb7d81ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7d7400640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800e7b0 tx=0x7fb7c800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800eec0 con 0x7fb7d80c61d0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800c940 con 0x7fb7d80c61d0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800ccd0 con 0x7fb7d80c61d0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d8154880 con 0x7fb7d80c61d0 2024-01-20T08:13:43.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.412+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d8153d40 con 0x7fb7d80c61d0 2024-01-20T08:13:43.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.413+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d81538c0 con 0x7fb7d80c61d0 2024-01-20T08:13:43.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.415+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb7c8013470 con 0x7fb7d80c61d0 2024-01-20T08:13:43.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.415+0000 7fb7cfe00640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 0x7fb7b006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:43.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.416+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb7c80899e0 con 0x7fb7d80c61d0 2024-01-20T08:13:43.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.416+0000 7fb7d7e00640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 0x7fb7b006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:43.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.417+0000 7fb7d7e00640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 0x7fb7b006d3c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00017a0 tx=0x7fb7c0009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:43.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.420+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb7d81538c0 con 0x7fb7d80c61d0 2024-01-20T08:13:43.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:43.654+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb7d81ed040 con 0x7fb7d80c61d0 2024-01-20T08:13:44.183 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.180+0000 7fb7cfe00640 1 -- 172.21.15.100:0/3750361192 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs2", "var": "allow_standby_replay", "val": "false"}]=0 v53) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb7d81ed040 con 0x7fb7d80c61d0 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.185+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 msgr2=0x7fb7b006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.185+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 0x7fb7b006d3c0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00017a0 tx=0x7fb7c0009040 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.185+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 msgr2=0x7fb7d8148250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.185+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800e7b0 tx=0x7fb7c800ec70 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 shutdown_connections 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb7b006af00 0x7fb7b006d3c0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb7d8148790 0x7fb7d81ed320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb7d80c61d0 0x7fb7d8148250 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 --2- 172.21.15.100:0/3750361192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb7b8004d00 0x7fb7d81ea520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 >> 172.21.15.100:0/3750361192 conn(0x7fb7d80abc80 msgr2=0x7fb7d80aad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 shutdown_connections 2024-01-20T08:13:44.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.186+0000 7fb7df200640 1 -- 172.21.15.100:0/3750361192 wait complete. 2024-01-20T08:13:44.211 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs2' 2024-01-20T08:13:44.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:13:44.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.417+0000 7f632ce00640 1 Processor -- start 2024-01-20T08:13:44.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.418+0000 7f632ce00640 1 -- start start 2024-01-20T08:13:44.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f632ce00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6328147f20 0x7f63280abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f632ce00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63280c1670 con 0x7f6328070370 2024-01-20T08:13:44.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f632ce00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6328070800 con 0x7f6328151f60 2024-01-20T08:13:44.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f632ce00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63280c2210 con 0x7f6328147f20 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f6326800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6328070370 0x7f63280c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48552/0 (socket says 172.21.15.100:48552) 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f6326800640 1 -- 172.21.15.100:0/2208759012 learned_addr learned my addr 172.21.15.100:0/2208759012 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.419+0000 7f6325e00640 1 --2- 172.21.15.100:0/2208759012 >> v2:172.21.15.110:3300/0 conn(0x7f6328147f20 0x7f63280abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920889092 0 0) 0x7f63280c1670 con 0x7f6328070370 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6308003520 con 0x7f6328070370 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3476270672 0 0) 0x7f6308003520 con 0x7f6328070370 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 >> v2:172.21.15.110:3300/0 conn(0x7f6328147f20 msgr2=0x7f63280abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:44.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 --2- 172.21.15.100:0/2208759012 >> v2:172.21.15.110:3300/0 conn(0x7f6328147f20 0x7f63280abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 >> v1:172.21.15.110:6789/0 conn(0x7f6328151f60 legacy=0x7f63280c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280c0d40 con 0x7f6328070370 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6320001670 con 0x7f6328070370 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 >> v1:172.21.15.100:6789/0 conn(0x7f6328070370 legacy=0x7f63280c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f6308003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080047c0 0x7f6308004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308005180 0x7f630800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63280c2210 con 0x7f63080039c0 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630800c080 con 0x7f63080047c0 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630800c240 con 0x7f6308005180 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.420+0000 7f6325e00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f6308003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6325e00640 1 -- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308005180 msgr2=0x7f630800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:44.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6325e00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6308005180 0x7f630800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6325e00640 1 -- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080047c0 msgr2=0x7f6308004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:44.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6325e00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63080047c0 0x7f6308004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6325e00640 1 -- 172.21.15.100:0/2208759012 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6308003520 con 0x7f63080039c0 2024-01-20T08:13:44.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.421+0000 7f6326800640 1 -- 172.21.15.100:0/2208759012 reap_dead start 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.422+0000 7f6325e00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f6308003de0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6310009650 tx=0x7f63080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da28bfa069d9f629 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.422+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631002e8c0 con 0x7f63080039c0 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.422+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f631002ea20 con 0x7f63080039c0 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.422+0000 7f6324a00640 1 -- 172.21.15.100:0/2208759012 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f631002edb0 con 0x7f63080039c0 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 -- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 msgr2=0x7f6308003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f6308003de0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f6310009650 tx=0x7f63080057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 -- 172.21.15.100:0/2208759012 shutdown_connections 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 --2- 172.21.15.100:0/2208759012 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f6308003de0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 -- 172.21.15.100:0/2208759012 >> 172.21.15.100:0/2208759012 conn(0x7f632806a5e0 msgr2=0x7f632806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:44.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 -- 172.21.15.100:0/2208759012 shutdown_connections 2024-01-20T08:13:44.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.423+0000 7f632ce00640 1 -- 172.21.15.100:0/2208759012 wait complete. 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.425+0000 7f632ce00640 1 Processor -- start 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.425+0000 7f632ce00640 1 -- start start 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f632814f930 0x7f63281eab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63281ed6b0 0x7f6328070e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f632814edf0 con 0x7f63080039c0 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63281ea100 con 0x7f63281ed6b0 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f632ce00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f632814e870 con 0x7f632814f930 2024-01-20T08:13:44.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33390/0 (socket says 172.21.15.100:33390) 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 -- 172.21.15.100:0/2914972920 learned_addr learned my addr 172.21.15.100:0/2914972920 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 -- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f632814f930 msgr2=0x7f63281eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f632814f930 0x7f63281eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 -- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63281ed6b0 msgr2=0x7f6328070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63281ed6b0 0x7f6328070e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.426+0000 7f6325e00640 1 -- 172.21.15.100:0/2914972920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63281eb050 con 0x7f63080039c0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f6325e00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310003810 con 0x7f63080039c0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6310003970 con 0x7f63080039c0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f632814eb10 con 0x7f63080039c0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6310003d20 con 0x7f63080039c0 2024-01-20T08:13:44.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.427+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63281ea5f0 con 0x7f63080039c0 2024-01-20T08:13:44.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.428+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f632804e970 con 0x7f63080039c0 2024-01-20T08:13:44.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.429+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f631003d070 con 0x7f63080039c0 2024-01-20T08:13:44.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.430+0000 7f631e000640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 0x7f630006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.430+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f63100aae70 con 0x7f63080039c0 2024-01-20T08:13:44.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.430+0000 7f6325400640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 0x7f630006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.431+0000 7f6325400640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 0x7f630006d3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f63280aa390 tx=0x7f6318007d50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.436+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6310075a70 con 0x7f63080039c0 2024-01-20T08:13:44.531 INFO:tasks.ceph.mds.c.smithi100.stderr:2024-01-20T08:13:44.527+0000 7fd0eda00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:13:44.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.667+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f63280c38d0 con 0x7f63080039c0 2024-01-20T08:13:44.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.668+0000 7f631e000640 1 -- 172.21.15.100:0/2914972920 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f631003b090 con 0x7f63080039c0 2024-01-20T08:13:44.672 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:44.672 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:13:44.672 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 53 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 msgr2=0x7f630006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 0x7f630006d3c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f63280aa390 tx=0x7f6318007d50 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 msgr2=0x7f632814f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f6310000c00 tx=0x7f6310004730 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 shutdown_connections 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f63281ed6b0 0x7f6328070e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f630006af00 0x7f630006d3c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f632814f930 0x7f63281eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 --2- 172.21.15.100:0/2914972920 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f63080039c0 0x7f632814f350 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.675 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 >> 172.21.15.100:0/2914972920 conn(0x7f632806a5e0 msgr2=0x7f63280c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 shutdown_connections 2024-01-20T08:13:44.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.672+0000 7f632ce00640 1 -- 172.21.15.100:0/2914972920 wait complete. 2024-01-20T08:13:44.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:44.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.892+0000 7f6264800640 1 Processor -- start 2024-01-20T08:13:44.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.892+0000 7f6264800640 1 -- start start 2024-01-20T08:13:44.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6264800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f625c06ddc0 0x7f625c14e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6264800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f625c0c20f0 0x7f625c0c2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6264800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625c071570 con 0x7f625c0c0ba0 2024-01-20T08:13:44.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6264800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c150db0 con 0x7f625c06ddc0 2024-01-20T08:13:44.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6264800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f625c06e410 con 0x7f625c0c20f0 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f625c06ddc0 0x7f625c14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f625c06ddc0 0x7f625c14e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33406/0 (socket says 172.21.15.100:33406) 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 -- 172.21.15.100:0/3805823849 learned_addr learned my addr 172.21.15.100:0/3805823849 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6262800640 1 --2- 172.21.15.100:0/3805823849 >> v2:172.21.15.110:3300/0 conn(0x7f625c0c20f0 0x7f625c0c2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 -- 172.21.15.100:0/3805823849 >> v2:172.21.15.110:3300/0 conn(0x7f625c0c20f0 msgr2=0x7f625c0c2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 --2- 172.21.15.100:0/3805823849 >> v2:172.21.15.110:3300/0 conn(0x7f625c0c20f0 0x7f625c0c2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 -- 172.21.15.100:0/3805823849 >> v1:172.21.15.110:6789/0 conn(0x7f625c0c0ba0 legacy=0x7f625c1517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:44.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.894+0000 7f6261e00640 1 -- 172.21.15.100:0/3805823849 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625c070fb0 con 0x7f625c06ddc0 2024-01-20T08:13:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6261e00640 1 --2- 172.21.15.100:0/3805823849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c06ddc0 0x7f625c14e440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f625c06ead0 tx=0x7f624c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1d119f146c1726 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6260a00640 1 -- 172.21.15.100:0/3805823849 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c030860 con 0x7f625c06ddc0 2024-01-20T08:13:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6260a00640 1 -- 172.21.15.100:0/3805823849 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624c0309c0 con 0x7f625c06ddc0 2024-01-20T08:13:44.899 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6260a00640 1 -- 172.21.15.100:0/3805823849 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624c030d50 con 0x7f625c06ddc0 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6264800640 1 -- 172.21.15.100:0/3805823849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c06ddc0 msgr2=0x7f625c14e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.896+0000 7f6264800640 1 --2- 172.21.15.100:0/3805823849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c06ddc0 0x7f625c14e440 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f625c06ead0 tx=0x7f624c02b9a0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 -- 172.21.15.100:0/3805823849 shutdown_connections 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 --2- 172.21.15.100:0/3805823849 >> v2:172.21.15.110:3300/0 conn(0x7f625c0c20f0 0x7f625c0c2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 --2- 172.21.15.100:0/3805823849 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c06ddc0 0x7f625c14e440 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 -- 172.21.15.100:0/3805823849 >> 172.21.15.100:0/3805823849 conn(0x7f625c06a5e0 msgr2=0x7f625c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 -- 172.21.15.100:0/3805823849 shutdown_connections 2024-01-20T08:13:44.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.897+0000 7f6264800640 1 -- 172.21.15.100:0/3805823849 wait complete. 2024-01-20T08:13:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.898+0000 7f6264800640 1 Processor -- start 2024-01-20T08:13:44.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.898+0000 7f6264800640 1 -- start start 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f625c06ddc0 0x7f625c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f625c0c0ba0 0x7f625c0ab290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c154280 con 0x7f625c0c20f0 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1ed430 con 0x7f625c0c0ba0 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.899+0000 7f6264800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f625c1ead90 con 0x7f625c06ddc0 2024-01-20T08:13:44.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33422/0 (socket says 172.21.15.100:33422) 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 -- 172.21.15.100:0/2903288865 learned_addr learned my addr 172.21.15.100:0/2903288865 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6261e00640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f625c06ddc0 0x7f625c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 -- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f625c06ddc0 msgr2=0x7f625c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f625c06ddc0 0x7f625c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 -- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f625c0c0ba0 msgr2=0x7f625c0ab290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f625c0c0ba0 0x7f625c0ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 -- 172.21.15.100:0/2903288865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0094d0 con 0x7f625c0c20f0 2024-01-20T08:13:44.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.900+0000 7f6262800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f625400d5d0 tx=0x7f625400da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.901+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62540125f0 con 0x7f625c0c20f0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.901+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6254012770 con 0x7f625c0c20f0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.901+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6254012b20 con 0x7f625c0c20f0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.901+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f625c1e9fd0 con 0x7f625c0c20f0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.901+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f625c1ea590 con 0x7f625c0c20f0 2024-01-20T08:13:44.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.902+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625c0c1030 con 0x7f625c0c20f0 2024-01-20T08:13:44.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.903+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6254012c80 con 0x7f625c0c20f0 2024-01-20T08:13:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.904+0000 7f625a000640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 0x7f623406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.904+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f6254089e90 con 0x7f625c0c20f0 2024-01-20T08:13:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.904+0000 7f6261e00640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 0x7f623406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:44.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.905+0000 7f6261e00640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 0x7f623406d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f624c036000 tx=0x7f624c03b040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:44.911 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:44.908+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f625c0c1030 con 0x7f625c0c20f0 2024-01-20T08:13:45.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.102+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f625c0c1030 con 0x7f625c0c20f0 2024-01-20T08:13:45.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.105+0000 7f625a000640 1 -- 172.21.15.100:0/2903288865 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f625c0c1030 con 0x7f625c0c20f0 2024-01-20T08:13:45.108 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:45.108 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":76,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:42.144659+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.107+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 msgr2=0x7f623406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.107+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 0x7f623406d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f624c036000 tx=0x7f624c03b040 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.107+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 msgr2=0x7f625c0ab7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.107+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f625400d5d0 tx=0x7f625400da90 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 shutdown_connections 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f625c0c20f0 0x7f625c0ab7d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f625c0c0ba0 0x7f625c0ab290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f623406af00 0x7f623406d3c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 --2- 172.21.15.100:0/2903288865 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f625c06ddc0 0x7f625c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 >> 172.21.15.100:0/2903288865 conn(0x7f625c06a5e0 msgr2=0x7f625c073690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:45.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 shutdown_connections 2024-01-20T08:13:45.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.108+0000 7f6264800640 1 -- 172.21.15.100:0/2903288865 wait complete. 2024-01-20T08:13:45.131 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-01-20T08:13:45.131 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:45.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.334+0000 7fdc0ca00640 1 Processor -- start 2024-01-20T08:13:45.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.334+0000 7fdc0ca00640 1 -- start start 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc0ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040ac000 0x7fdc040721e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc0ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fdc04159760 0x7fdc04156040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc0ca00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc041592d0 con 0x7fdc040705e0 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc0ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc04158ca0 con 0x7fdc040ac000 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc0ca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc0415cd40 con 0x7fdc04159760 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc09600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040ac000 0x7fdc040721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc09600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdc040ac000 0x7fdc040721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33424/0 (socket says 172.21.15.100:33424) 2024-01-20T08:13:45.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.336+0000 7fdc09600640 1 -- 172.21.15.100:0/419615578 learned_addr learned my addr 172.21.15.100:0/419615578 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:45.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.337+0000 7fdc0aa00640 1 --2- 172.21.15.100:0/419615578 >> v2:172.21.15.110:3300/0 conn(0x7fdc04159760 0x7fdc04156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.337+0000 7fdc09600640 1 -- 172.21.15.100:0/419615578 >> v2:172.21.15.110:3300/0 conn(0x7fdc04159760 msgr2=0x7fdc04156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:45.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.337+0000 7fdc09600640 1 --2- 172.21.15.100:0/419615578 >> v2:172.21.15.110:3300/0 conn(0x7fdc04159760 0x7fdc04156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.337+0000 7fdc09600640 1 -- 172.21.15.100:0/419615578 >> v1:172.21.15.110:6789/0 conn(0x7fdc040705e0 legacy=0x7fdc0415a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:45.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.337+0000 7fdc09600640 1 -- 172.21.15.100:0/419615578 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0415d020 con 0x7fdc040ac000 2024-01-20T08:13:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.338+0000 7fdc09600640 1 --2- 172.21.15.100:0/419615578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040721e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406e5e0 tx=0x7fdbe802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04fec27dcf68433 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.338+0000 7fdc08c00640 1 -- 172.21.15.100:0/419615578 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe80317e0 con 0x7fdc040ac000 2024-01-20T08:13:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.338+0000 7fdc08c00640 1 -- 172.21.15.100:0/419615578 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe8031940 con 0x7fdc040ac000 2024-01-20T08:13:45.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.338+0000 7fdc08c00640 1 -- 172.21.15.100:0/419615578 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8031cd0 con 0x7fdc040ac000 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 -- 172.21.15.100:0/419615578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 msgr2=0x7fdc040721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/419615578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040721e0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fdc0406e5e0 tx=0x7fdbe802b880 comp rx=0 tx=0).stop 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 -- 172.21.15.100:0/419615578 shutdown_connections 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/419615578 >> v2:172.21.15.110:3300/0 conn(0x7fdc04159760 0x7fdc04156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/419615578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040721e0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 -- 172.21.15.100:0/419615578 >> 172.21.15.100:0/419615578 conn(0x7fdc0406a5e0 msgr2=0x7fdc0406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 -- 172.21.15.100:0/419615578 shutdown_connections 2024-01-20T08:13:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.339+0000 7fdc0ca00640 1 -- 172.21.15.100:0/419615578 wait complete. 2024-01-20T08:13:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.341+0000 7fdc0ca00640 1 Processor -- start 2024-01-20T08:13:45.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.341+0000 7fdc0ca00640 1 -- start start 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040705e0 0x7fdc04152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc04159760 0x7fdc0415ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041e4190 con 0x7fdc040ac000 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041f2a90 con 0x7fdc040705e0 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc0ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc041ee790 con 0x7fdc04159760 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33426/0 (socket says 172.21.15.100:33426) 2024-01-20T08:13:45.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 -- 172.21.15.100:0/3080072638 learned_addr learned my addr 172.21.15.100:0/3080072638 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:45.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 -- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc04159760 msgr2=0x7fdc0415ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc04159760 0x7fdc0415ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 -- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040705e0 msgr2=0x7fdc04152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040705e0 0x7fdc04152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.342+0000 7fdc09600640 1 -- 172.21.15.100:0/3080072638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80094d0 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc09600640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdbe802b8c0 tx=0x7fdbe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032880 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe80329e0 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8032d90 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc041eea70 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.343+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc041ef030 con 0x7fdc040ac000 2024-01-20T08:13:45.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.344+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc041ef220 con 0x7fdc040ac000 2024-01-20T08:13:45.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.345+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdbe804e450 con 0x7fdc040ac000 2024-01-20T08:13:45.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.346+0000 7fdc02000640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 0x7fdbd806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.346+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fdbe80abb90 con 0x7fdc040ac000 2024-01-20T08:13:45.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.347+0000 7fdc0a000640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 0x7fdbd806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.350 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.347+0000 7fdc0a000640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 0x7fdbd806d390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc041e4d90 tx=0x7fdbf8007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.351+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdbe8076710 con 0x7fdc040ac000 2024-01-20T08:13:45.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.539+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc040c0d50 con 0x7fdbd806aed0 2024-01-20T08:13:45.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.574+0000 7fdc02000640 1 -- 172.21.15.100:0/3080072638 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519871 (secure 0 0 0) 0x7fdbf8004060 con 0x7fdbd806aed0 2024-01-20T08:13:45.585 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:45.589 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 msgr2=0x7fdbd806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 0x7fdbd806d390 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdc041e4d90 tx=0x7fdbf8007d30 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 msgr2=0x7fdc040aa680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdbe802b8c0 tx=0x7fdbe80046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 shutdown_connections 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdbd806aed0 0x7fdbd806d390 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdc04159760 0x7fdc0415ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdc040ac000 0x7fdc040aa680 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 --2- 172.21.15.100:0/3080072638 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdc040705e0 0x7fdc04152c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 >> 172.21.15.100:0/3080072638 conn(0x7fdc0406a5e0 msgr2=0x7fdc04157e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.582+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 shutdown_connections 2024-01-20T08:13:45.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.583+0000 7fdc0ca00640 1 -- 172.21.15.100:0/3080072638 wait complete. 2024-01-20T08:13:45.605 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2024-01-20T08:13:43.956161+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8292,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8491008,"data_stored":4369324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.859622"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118584+0000","last_change":"2024-01-20T08:13:40.118584+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118584+0000","last_undegraded":"2024-01-20T08:13:40.118584+0000","last_fullsized":"2024-01-20T08:13:40.118584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111456+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:39.111456+0000","last_peered":"2024-01-20T08:13:39.111456+0000","last_clean":"2024-01-20T08:13:39.111456+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:39.111456+0000","last_undegraded":"2024-01-20T08:13:39.111456+0000","last_fullsized":"2024-01-20T08:13:39.111456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123276+0000","last_change":"2024-01-20T08:13:40.123276+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123276+0000","last_undegraded":"2024-01-20T08:13:40.123276+0000","last_fullsized":"2024-01-20T08:13:40.123276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114846+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:39.114846+0000","last_peered":"2024-01-20T08:13:39.114846+0000","last_clean":"2024-01-20T08:13:39.114846+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:39.114846+0000","last_undegraded":"2024-01-20T08:13:39.114846+0000","last_fullsized":"2024-01-20T08:13:39.114846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118942+0000","last_change":"2024-01-20T08:13:40.118942+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118942+0000","last_undegraded":"2024-01-20T08:13:40.118942+0000","last_fullsized":"2024-01-20T08:13:40.118942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103601+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:39.103601+0000","last_peered":"2024-01-20T08:13:39.103601+0000","last_clean":"2024-01-20T08:13:39.103601+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:39.103601+0000","last_undegraded":"2024-01-20T08:13:39.103601+0000","last_fullsized":"2024-01-20T08:13:39.103601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.114079+0000","last_change":"2024-01-20T08:13:40.114079+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.114079+0000","last_undegraded":"2024-01-20T08:13:40.114079+0000","last_fullsized":"2024-01-20T08:13:40.114079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112607+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:39.112607+0000","last_peered":"2024-01-20T08:13:39.112607+0000","last_clean":"2024-01-20T08:13:39.112607+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:39.112607+0000","last_undegraded":"2024-01-20T08:13:39.112607+0000","last_fullsized":"2024-01-20T08:13:39.112607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125859+0000","last_change":"2024-01-20T08:13:40.125859+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125859+0000","last_undegraded":"2024-01-20T08:13:40.125859+0000","last_fullsized":"2024-01-20T08:13:40.125859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119446+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:39.119446+0000","last_peered":"2024-01-20T08:13:39.119446+0000","last_clean":"2024-01-20T08:13:39.119446+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:39.119446+0000","last_undegraded":"2024-01-20T08:13:39.119446+0000","last_fullsized":"2024-01-20T08:13:39.119446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113241+0000","last_change":"2024-01-20T08:13:40.113241+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113241+0000","last_undegraded":"2024-01-20T08:13:40.113241+0000","last_fullsized":"2024-01-20T08:13:40.113241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.117857+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:39.117857+0000","last_peered":"2024-01-20T08:13:39.117857+0000","last_clean":"2024-01-20T08:13:39.117857+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:39.117857+0000","last_undegraded":"2024-01-20T08:13:39.117857+0000","last_fullsized":"2024-01-20T08:13:39.117857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125091+0000","last_change":"2024-01-20T08:13:40.125091+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125091+0000","last_undegraded":"2024-01-20T08:13:40.125091+0000","last_fullsized":"2024-01-20T08:13:40.125091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110212+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:39.110212+0000","last_peered":"2024-01-20T08:13:39.110212+0000","last_clean":"2024-01-20T08:13:39.110212+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:39.110212+0000","last_undegraded":"2024-01-20T08:13:39.110212+0000","last_fullsized":"2024-01-20T08:13:39.110212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.122263+0000","last_change":"2024-01-20T08:13:40.122263+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.122263+0000","last_undegraded":"2024-01-20T08:13:40.122263+0000","last_fullsized":"2024-01-20T08:13:40.122263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116243+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:39.116243+0000","last_peered":"2024-01-20T08:13:39.116243+0000","last_clean":"2024-01-20T08:13:39.116243+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:39.116243+0000","last_undegraded":"2024-01-20T08:13:39.116243+0000","last_fullsized":"2024-01-20T08:13:39.116243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128279+0000","last_change":"2024-01-20T08:13:40.128279+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128279+0000","last_undegraded":"2024-01-20T08:13:40.128279+0000","last_fullsized":"2024-01-20T08:13:40.128279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118816+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:39.118816+0000","last_peered":"2024-01-20T08:13:39.118816+0000","last_clean":"2024-01-20T08:13:39.118816+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:39.118816+0000","last_undegraded":"2024-01-20T08:13:39.118816+0000","last_fullsized":"2024-01-20T08:13:39.118816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113123+0000","last_change":"2024-01-20T08:13:40.113123+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113123+0000","last_undegraded":"2024-01-20T08:13:40.113123+0000","last_fullsized":"2024-01-20T08:13:40.113123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110889+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:39.110889+0000","last_peered":"2024-01-20T08:13:39.110889+0000","last_clean":"2024-01-20T08:13:39.110889+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:39.110889+0000","last_undegraded":"2024-01-20T08:13:39.110889+0000","last_fullsized":"2024-01-20T08:13:39.110889+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113777+0000","last_change":"2024-01-20T08:13:40.113777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113777+0000","last_undegraded":"2024-01-20T08:13:40.113777+0000","last_fullsized":"2024-01-20T08:13:40.113777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114346+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:39.114346+0000","last_peered":"2024-01-20T08:13:39.114346+0000","last_clean":"2024-01-20T08:13:39.114346+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:39.114346+0000","last_undegraded":"2024-01-20T08:13:39.114346+0000","last_fullsized":"2024-01-20T08:13:39.114346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119078+0000","last_change":"2024-01-20T08:13:40.119078+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119078+0000","last_undegraded":"2024-01-20T08:13:40.119078+0000","last_fullsized":"2024-01-20T08:13:40.119078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110189+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:39.110189+0000","last_peered":"2024-01-20T08:13:39.110189+0000","last_clean":"2024-01-20T08:13:39.110189+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:39.110189+0000","last_undegraded":"2024-01-20T08:13:39.110189+0000","last_fullsized":"2024-01-20T08:13:39.110189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123258+0000","last_change":"2024-01-20T08:13:40.123258+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123258+0000","last_undegraded":"2024-01-20T08:13:40.123258+0000","last_fullsized":"2024-01-20T08:13:40.123258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103069+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:39.103069+0000","last_peered":"2024-01-20T08:13:39.103069+0000","last_clean":"2024-01-20T08:13:39.103069+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:39.103069+0000","last_undegraded":"2024-01-20T08:13:39.103069+0000","last_fullsized":"2024-01-20T08:13:39.103069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.124661+0000","last_change":"2024-01-20T08:13:40.124661+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.124661+0000","last_undegraded":"2024-01-20T08:13:40.124661+0000","last_fullsized":"2024-01-20T08:13:40.124661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111206+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:39.111206+0000","last_peered":"2024-01-20T08:13:39.111206+0000","last_clean":"2024-01-20T08:13:39.111206+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:39.111206+0000","last_undegraded":"2024-01-20T08:13:39.111206+0000","last_fullsized":"2024-01-20T08:13:39.111206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118369+0000","last_change":"2024-01-20T08:13:40.118369+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118369+0000","last_undegraded":"2024-01-20T08:13:40.118369+0000","last_fullsized":"2024-01-20T08:13:40.118369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109905+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:39.109905+0000","last_peered":"2024-01-20T08:13:39.109905+0000","last_clean":"2024-01-20T08:13:39.109905+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:39.109905+0000","last_undegraded":"2024-01-20T08:13:39.109905+0000","last_fullsized":"2024-01-20T08:13:39.109905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120267+0000","last_change":"2024-01-20T08:13:40.120267+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120267+0000","last_undegraded":"2024-01-20T08:13:40.120267+0000","last_fullsized":"2024-01-20T08:13:40.120267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119099+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:39.119099+0000","last_peered":"2024-01-20T08:13:39.119099+0000","last_clean":"2024-01-20T08:13:39.119099+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:39.119099+0000","last_undegraded":"2024-01-20T08:13:39.119099+0000","last_fullsized":"2024-01-20T08:13:39.119099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118107+0000","last_change":"2024-01-20T08:13:40.118107+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118107+0000","last_undegraded":"2024-01-20T08:13:40.118107+0000","last_fullsized":"2024-01-20T08:13:40.118107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119911+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:39.119911+0000","last_peered":"2024-01-20T08:13:39.119911+0000","last_clean":"2024-01-20T08:13:39.119911+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:39.119911+0000","last_undegraded":"2024-01-20T08:13:39.119911+0000","last_fullsized":"2024-01-20T08:13:39.119911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112004+0000","last_change":"2024-01-20T08:13:40.112004+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112004+0000","last_undegraded":"2024-01-20T08:13:40.112004+0000","last_fullsized":"2024-01-20T08:13:40.112004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115407+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:39.115407+0000","last_peered":"2024-01-20T08:13:39.115407+0000","last_clean":"2024-01-20T08:13:39.115407+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:39.115407+0000","last_undegraded":"2024-01-20T08:13:39.115407+0000","last_fullsized":"2024-01-20T08:13:39.115407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113747+0000","last_change":"2024-01-20T08:13:40.113747+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113747+0000","last_undegraded":"2024-01-20T08:13:40.113747+0000","last_fullsized":"2024-01-20T08:13:40.113747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102437+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:39.102437+0000","last_peered":"2024-01-20T08:13:39.102437+0000","last_clean":"2024-01-20T08:13:39.102437+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:39.102437+0000","last_undegraded":"2024-01-20T08:13:39.102437+0000","last_fullsized":"2024-01-20T08:13:39.102437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118010+0000","last_change":"2024-01-20T08:13:40.118010+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118010+0000","last_undegraded":"2024-01-20T08:13:40.118010+0000","last_fullsized":"2024-01-20T08:13:40.118010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112780+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:39.112780+0000","last_peered":"2024-01-20T08:13:39.112780+0000","last_clean":"2024-01-20T08:13:39.112780+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:39.112780+0000","last_undegraded":"2024-01-20T08:13:39.112780+0000","last_fullsized":"2024-01-20T08:13:39.112780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112226+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:39.112226+0000","last_peered":"2024-01-20T08:13:39.112226+0000","last_clean":"2024-01-20T08:13:39.112226+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:39.112226+0000","last_undegraded":"2024-01-20T08:13:39.112226+0000","last_fullsized":"2024-01-20T08:13:39.112226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123643+0000","last_change":"2024-01-20T08:13:40.123643+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123643+0000","last_undegraded":"2024-01-20T08:13:40.123643+0000","last_fullsized":"2024-01-20T08:13:40.123643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114017+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:39.114017+0000","last_peered":"2024-01-20T08:13:39.114017+0000","last_clean":"2024-01-20T08:13:39.114017+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:39.114017+0000","last_undegraded":"2024-01-20T08:13:39.114017+0000","last_fullsized":"2024-01-20T08:13:39.114017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117525+0000","last_change":"2024-01-20T08:13:40.117525+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117525+0000","last_undegraded":"2024-01-20T08:13:40.117525+0000","last_fullsized":"2024-01-20T08:13:40.117525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108503+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:39.108503+0000","last_peered":"2024-01-20T08:13:39.108503+0000","last_clean":"2024-01-20T08:13:39.108503+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:39.108503+0000","last_undegraded":"2024-01-20T08:13:39.108503+0000","last_fullsized":"2024-01-20T08:13:39.108503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113839+0000","last_change":"2024-01-20T08:13:40.113839+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113839+0000","last_undegraded":"2024-01-20T08:13:40.113839+0000","last_fullsized":"2024-01-20T08:13:40.113839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109570+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:39.109570+0000","last_peered":"2024-01-20T08:13:39.109570+0000","last_clean":"2024-01-20T08:13:39.109570+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:39.109570+0000","last_undegraded":"2024-01-20T08:13:39.109570+0000","last_fullsized":"2024-01-20T08:13:39.109570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126896+0000","last_change":"2024-01-20T08:13:40.126896+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126896+0000","last_undegraded":"2024-01-20T08:13:40.126896+0000","last_fullsized":"2024-01-20T08:13:40.126896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115377+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:39.115377+0000","last_peered":"2024-01-20T08:13:39.115377+0000","last_clean":"2024-01-20T08:13:39.115377+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:39.115377+0000","last_undegraded":"2024-01-20T08:13:39.115377+0000","last_fullsized":"2024-01-20T08:13:39.115377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120314+0000","last_change":"2024-01-20T08:13:40.120314+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120314+0000","last_undegraded":"2024-01-20T08:13:40.120314+0000","last_fullsized":"2024-01-20T08:13:40.120314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105160+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:39.105160+0000","last_peered":"2024-01-20T08:13:39.105160+0000","last_clean":"2024-01-20T08:13:39.105160+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:39.105160+0000","last_undegraded":"2024-01-20T08:13:39.105160+0000","last_fullsized":"2024-01-20T08:13:39.105160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120673+0000","last_change":"2024-01-20T08:13:40.120673+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120673+0000","last_undegraded":"2024-01-20T08:13:40.120673+0000","last_fullsized":"2024-01-20T08:13:40.120673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119803+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:39.119803+0000","last_peered":"2024-01-20T08:13:39.119803+0000","last_clean":"2024-01-20T08:13:39.119803+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:39.119803+0000","last_undegraded":"2024-01-20T08:13:39.119803+0000","last_fullsized":"2024-01-20T08:13:39.119803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113518+0000","last_change":"2024-01-20T08:13:40.113518+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113518+0000","last_undegraded":"2024-01-20T08:13:40.113518+0000","last_fullsized":"2024-01-20T08:13:40.113518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110459+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:39.110459+0000","last_peered":"2024-01-20T08:13:39.110459+0000","last_clean":"2024-01-20T08:13:39.110459+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:39.110459+0000","last_undegraded":"2024-01-20T08:13:39.110459+0000","last_fullsized":"2024-01-20T08:13:39.110459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120384+0000","last_change":"2024-01-20T08:13:40.120384+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120384+0000","last_undegraded":"2024-01-20T08:13:40.120384+0000","last_fullsized":"2024-01-20T08:13:40.120384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113620+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:39.113620+0000","last_peered":"2024-01-20T08:13:39.113620+0000","last_clean":"2024-01-20T08:13:39.113620+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:39.113620+0000","last_undegraded":"2024-01-20T08:13:39.113620+0000","last_fullsized":"2024-01-20T08:13:39.113620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115829+0000","last_change":"2024-01-20T08:13:40.115829+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115829+0000","last_undegraded":"2024-01-20T08:13:40.115829+0000","last_fullsized":"2024-01-20T08:13:40.115829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113711+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:39.113711+0000","last_peered":"2024-01-20T08:13:39.113711+0000","last_clean":"2024-01-20T08:13:39.113711+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:39.113711+0000","last_undegraded":"2024-01-20T08:13:39.113711+0000","last_fullsized":"2024-01-20T08:13:39.113711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112697+0000","last_change":"2024-01-20T08:13:40.112697+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112697+0000","last_undegraded":"2024-01-20T08:13:40.112697+0000","last_fullsized":"2024-01-20T08:13:40.112697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119320+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:39.119320+0000","last_peered":"2024-01-20T08:13:39.119320+0000","last_clean":"2024-01-20T08:13:39.119320+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:39.119320+0000","last_undegraded":"2024-01-20T08:13:39.119320+0000","last_fullsized":"2024-01-20T08:13:39.119320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117245+0000","last_change":"2024-01-20T08:13:40.117245+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117245+0000","last_undegraded":"2024-01-20T08:13:40.117245+0000","last_fullsized":"2024-01-20T08:13:40.117245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.107896+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:39.107896+0000","last_peered":"2024-01-20T08:13:39.107896+0000","last_clean":"2024-01-20T08:13:39.107896+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:39.107896+0000","last_undegraded":"2024-01-20T08:13:39.107896+0000","last_fullsized":"2024-01-20T08:13:39.107896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116777+0000","last_change":"2024-01-20T08:13:40.116777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116777+0000","last_undegraded":"2024-01-20T08:13:40.116777+0000","last_fullsized":"2024-01-20T08:13:40.116777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136687+0000","last_change":"2024-01-20T08:13:40.129620+0000","last_active":"2024-01-20T08:13:40.136687+0000","last_peered":"2024-01-20T08:13:40.136687+0000","last_clean":"2024-01-20T08:13:40.136687+0000","last_became_active":"2024-01-20T08:13:40.129373+0000","last_became_peered":"2024-01-20T08:13:40.129373+0000","last_unstale":"2024-01-20T08:13:40.136687+0000","last_undegraded":"2024-01-20T08:13:40.136687+0000","last_fullsized":"2024-01-20T08:13:40.136687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120224+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:39.120224+0000","last_peered":"2024-01-20T08:13:39.120224+0000","last_clean":"2024-01-20T08:13:39.120224+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:39.120224+0000","last_undegraded":"2024-01-20T08:13:39.120224+0000","last_fullsized":"2024-01-20T08:13:39.120224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111817+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:39.111817+0000","last_peered":"2024-01-20T08:13:39.111817+0000","last_clean":"2024-01-20T08:13:39.111817+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:39.111817+0000","last_undegraded":"2024-01-20T08:13:39.111817+0000","last_fullsized":"2024-01-20T08:13:39.111817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113112+0000","last_change":"2024-01-20T08:13:40.113112+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113112+0000","last_undegraded":"2024-01-20T08:13:40.113112+0000","last_fullsized":"2024-01-20T08:13:40.113112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140960+0000","last_change":"2024-01-20T08:13:40.136955+0000","last_active":"2024-01-20T08:13:40.140960+0000","last_peered":"2024-01-20T08:13:40.140960+0000","last_clean":"2024-01-20T08:13:40.140960+0000","last_became_active":"2024-01-20T08:13:40.136627+0000","last_became_peered":"2024-01-20T08:13:40.136627+0000","last_unstale":"2024-01-20T08:13:40.140960+0000","last_undegraded":"2024-01-20T08:13:40.140960+0000","last_fullsized":"2024-01-20T08:13:40.140960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:58.292868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111524+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:39.111524+0000","last_peered":"2024-01-20T08:13:39.111524+0000","last_clean":"2024-01-20T08:13:39.111524+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:39.111524+0000","last_undegraded":"2024-01-20T08:13:39.111524+0000","last_fullsized":"2024-01-20T08:13:39.111524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120411+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:39.120411+0000","last_peered":"2024-01-20T08:13:39.120411+0000","last_clean":"2024-01-20T08:13:39.120411+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:39.120411+0000","last_undegraded":"2024-01-20T08:13:39.120411+0000","last_fullsized":"2024-01-20T08:13:39.120411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119163+0000","last_change":"2024-01-20T08:13:40.119163+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119163+0000","last_undegraded":"2024-01-20T08:13:40.119163+0000","last_fullsized":"2024-01-20T08:13:40.119163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143290+0000","last_change":"2024-01-20T08:13:40.140777+0000","last_active":"2024-01-20T08:13:40.143290+0000","last_peered":"2024-01-20T08:13:40.143290+0000","last_clean":"2024-01-20T08:13:40.143290+0000","last_became_active":"2024-01-20T08:13:40.140148+0000","last_became_peered":"2024-01-20T08:13:40.140148+0000","last_unstale":"2024-01-20T08:13:40.143290+0000","last_undegraded":"2024-01-20T08:13:40.143290+0000","last_fullsized":"2024-01-20T08:13:40.143290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110747+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:39.110747+0000","last_peered":"2024-01-20T08:13:39.110747+0000","last_clean":"2024-01-20T08:13:39.110747+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:39.110747+0000","last_undegraded":"2024-01-20T08:13:39.110747+0000","last_fullsized":"2024-01-20T08:13:39.110747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102651+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:39.102651+0000","last_peered":"2024-01-20T08:13:39.102651+0000","last_clean":"2024-01-20T08:13:39.102651+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:39.102651+0000","last_undegraded":"2024-01-20T08:13:39.102651+0000","last_fullsized":"2024-01-20T08:13:39.102651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118629+0000","last_change":"2024-01-20T08:13:40.118629+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118629+0000","last_undegraded":"2024-01-20T08:13:40.118629+0000","last_fullsized":"2024-01-20T08:13:40.118629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137159+0000","last_change":"2024-01-20T08:13:40.134139+0000","last_active":"2024-01-20T08:13:40.137159+0000","last_peered":"2024-01-20T08:13:40.137159+0000","last_clean":"2024-01-20T08:13:40.137159+0000","last_became_active":"2024-01-20T08:13:40.133632+0000","last_became_peered":"2024-01-20T08:13:40.133632+0000","last_unstale":"2024-01-20T08:13:40.137159+0000","last_undegraded":"2024-01-20T08:13:40.137159+0000","last_fullsized":"2024-01-20T08:13:40.137159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:29.810188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103924+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:39.103924+0000","last_peered":"2024-01-20T08:13:39.103924+0000","last_clean":"2024-01-20T08:13:39.103924+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:39.103924+0000","last_undegraded":"2024-01-20T08:13:39.103924+0000","last_fullsized":"2024-01-20T08:13:39.103924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102513+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:39.102513+0000","last_peered":"2024-01-20T08:13:39.102513+0000","last_clean":"2024-01-20T08:13:39.102513+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:39.102513+0000","last_undegraded":"2024-01-20T08:13:39.102513+0000","last_fullsized":"2024-01-20T08:13:39.102513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115669+0000","last_change":"2024-01-20T08:13:40.115669+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115669+0000","last_undegraded":"2024-01-20T08:13:40.115669+0000","last_fullsized":"2024-01-20T08:13:40.115669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142460+0000","last_change":"2024-01-20T08:13:40.141034+0000","last_active":"2024-01-20T08:13:40.142460+0000","last_peered":"2024-01-20T08:13:40.142460+0000","last_clean":"2024-01-20T08:13:40.142460+0000","last_became_active":"2024-01-20T08:13:40.140116+0000","last_became_peered":"2024-01-20T08:13:40.140116+0000","last_unstale":"2024-01-20T08:13:40.142460+0000","last_undegraded":"2024-01-20T08:13:40.142460+0000","last_fullsized":"2024-01-20T08:13:40.142460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:48:54.354251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113825+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:39.113825+0000","last_peered":"2024-01-20T08:13:39.113825+0000","last_clean":"2024-01-20T08:13:39.113825+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:39.113825+0000","last_undegraded":"2024-01-20T08:13:39.113825+0000","last_fullsized":"2024-01-20T08:13:39.113825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119771+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:39.119771+0000","last_peered":"2024-01-20T08:13:39.119771+0000","last_clean":"2024-01-20T08:13:39.119771+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:39.119771+0000","last_undegraded":"2024-01-20T08:13:39.119771+0000","last_fullsized":"2024-01-20T08:13:39.119771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.111329+0000","last_change":"2024-01-20T08:13:40.111329+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.111329+0000","last_undegraded":"2024-01-20T08:13:40.111329+0000","last_fullsized":"2024-01-20T08:13:40.111329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142906+0000","last_change":"2024-01-20T08:13:40.138670+0000","last_active":"2024-01-20T08:13:40.142906+0000","last_peered":"2024-01-20T08:13:40.142906+0000","last_clean":"2024-01-20T08:13:40.142906+0000","last_became_active":"2024-01-20T08:13:40.138225+0000","last_became_peered":"2024-01-20T08:13:40.138225+0000","last_unstale":"2024-01-20T08:13:40.142906+0000","last_undegraded":"2024-01-20T08:13:40.142906+0000","last_fullsized":"2024-01-20T08:13:40.142906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:31.079661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119512+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:39.119512+0000","last_peered":"2024-01-20T08:13:39.119512+0000","last_clean":"2024-01-20T08:13:39.119512+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:39.119512+0000","last_undegraded":"2024-01-20T08:13:39.119512+0000","last_fullsized":"2024-01-20T08:13:39.119512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119392+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:39.119392+0000","last_peered":"2024-01-20T08:13:39.119392+0000","last_clean":"2024-01-20T08:13:39.119392+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:39.119392+0000","last_undegraded":"2024-01-20T08:13:39.119392+0000","last_fullsized":"2024-01-20T08:13:39.119392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113950+0000","last_change":"2024-01-20T08:13:40.113950+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113950+0000","last_undegraded":"2024-01-20T08:13:40.113950+0000","last_fullsized":"2024-01-20T08:13:40.113950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142864+0000","last_change":"2024-01-20T08:13:40.138470+0000","last_active":"2024-01-20T08:13:40.142864+0000","last_peered":"2024-01-20T08:13:40.142864+0000","last_clean":"2024-01-20T08:13:40.142864+0000","last_became_active":"2024-01-20T08:13:40.138199+0000","last_became_peered":"2024-01-20T08:13:40.138199+0000","last_unstale":"2024-01-20T08:13:40.142864+0000","last_undegraded":"2024-01-20T08:13:40.142864+0000","last_fullsized":"2024-01-20T08:13:40.142864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:28.806346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102391+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:39.102391+0000","last_peered":"2024-01-20T08:13:39.102391+0000","last_clean":"2024-01-20T08:13:39.102391+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:39.102391+0000","last_undegraded":"2024-01-20T08:13:39.102391+0000","last_fullsized":"2024-01-20T08:13:39.102391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103156+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:39.103156+0000","last_peered":"2024-01-20T08:13:39.103156+0000","last_clean":"2024-01-20T08:13:39.103156+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:39.103156+0000","last_undegraded":"2024-01-20T08:13:39.103156+0000","last_fullsized":"2024-01-20T08:13:39.103156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126904+0000","last_change":"2024-01-20T08:13:40.126904+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126904+0000","last_undegraded":"2024-01-20T08:13:40.126904+0000","last_fullsized":"2024-01-20T08:13:40.126904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136784+0000","last_change":"2024-01-20T08:13:40.129368+0000","last_active":"2024-01-20T08:13:40.136784+0000","last_peered":"2024-01-20T08:13:40.136784+0000","last_clean":"2024-01-20T08:13:40.136784+0000","last_became_active":"2024-01-20T08:13:40.129051+0000","last_became_peered":"2024-01-20T08:13:40.129051+0000","last_unstale":"2024-01-20T08:13:40.136784+0000","last_undegraded":"2024-01-20T08:13:40.136784+0000","last_fullsized":"2024-01-20T08:13:40.136784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109983+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:39.109983+0000","last_peered":"2024-01-20T08:13:39.109983+0000","last_clean":"2024-01-20T08:13:39.109983+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:39.109983+0000","last_undegraded":"2024-01-20T08:13:39.109983+0000","last_fullsized":"2024-01-20T08:13:39.109983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112971+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:39.112971+0000","last_peered":"2024-01-20T08:13:39.112971+0000","last_clean":"2024-01-20T08:13:39.112971+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:39.112971+0000","last_undegraded":"2024-01-20T08:13:39.112971+0000","last_fullsized":"2024-01-20T08:13:39.112971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128740+0000","last_change":"2024-01-20T08:13:40.128740+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128740+0000","last_undegraded":"2024-01-20T08:13:40.128740+0000","last_fullsized":"2024-01-20T08:13:40.128740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142554+0000","last_change":"2024-01-20T08:13:40.141046+0000","last_active":"2024-01-20T08:13:40.142554+0000","last_peered":"2024-01-20T08:13:40.142554+0000","last_clean":"2024-01-20T08:13:40.142554+0000","last_became_active":"2024-01-20T08:13:40.140753+0000","last_became_peered":"2024-01-20T08:13:40.140753+0000","last_unstale":"2024-01-20T08:13:40.142554+0000","last_undegraded":"2024-01-20T08:13:40.142554+0000","last_fullsized":"2024-01-20T08:13:40.142554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113375+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:39.113375+0000","last_peered":"2024-01-20T08:13:39.113375+0000","last_clean":"2024-01-20T08:13:39.113375+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:39.113375+0000","last_undegraded":"2024-01-20T08:13:39.113375+0000","last_fullsized":"2024-01-20T08:13:39.113375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112006+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:39.112006+0000","last_peered":"2024-01-20T08:13:39.112006+0000","last_clean":"2024-01-20T08:13:39.112006+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:39.112006+0000","last_undegraded":"2024-01-20T08:13:39.112006+0000","last_fullsized":"2024-01-20T08:13:39.112006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127813+0000","last_change":"2024-01-20T08:13:40.127813+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127813+0000","last_undegraded":"2024-01-20T08:13:40.127813+0000","last_fullsized":"2024-01-20T08:13:40.127813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142007+0000","last_change":"2024-01-20T08:13:40.139406+0000","last_active":"2024-01-20T08:13:40.142007+0000","last_peered":"2024-01-20T08:13:40.142007+0000","last_clean":"2024-01-20T08:13:40.142007+0000","last_became_active":"2024-01-20T08:13:40.139147+0000","last_became_peered":"2024-01-20T08:13:40.139147+0000","last_unstale":"2024-01-20T08:13:40.142007+0000","last_undegraded":"2024-01-20T08:13:40.142007+0000","last_fullsized":"2024-01-20T08:13:40.142007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118859+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:39.118859+0000","last_peered":"2024-01-20T08:13:39.118859+0000","last_clean":"2024-01-20T08:13:39.118859+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:39.118859+0000","last_undegraded":"2024-01-20T08:13:39.118859+0000","last_fullsized":"2024-01-20T08:13:39.118859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111115+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:39.111115+0000","last_peered":"2024-01-20T08:13:39.111115+0000","last_clean":"2024-01-20T08:13:39.111115+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:39.111115+0000","last_undegraded":"2024-01-20T08:13:39.111115+0000","last_fullsized":"2024-01-20T08:13:39.111115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117535+0000","last_change":"2024-01-20T08:13:40.117535+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117535+0000","last_undegraded":"2024-01-20T08:13:40.117535+0000","last_fullsized":"2024-01-20T08:13:40.117535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137874+0000","last_change":"2024-01-20T08:13:40.135173+0000","last_active":"2024-01-20T08:13:40.137874+0000","last_peered":"2024-01-20T08:13:40.137874+0000","last_clean":"2024-01-20T08:13:40.137874+0000","last_became_active":"2024-01-20T08:13:40.134749+0000","last_became_peered":"2024-01-20T08:13:40.134749+0000","last_unstale":"2024-01-20T08:13:40.137874+0000","last_undegraded":"2024-01-20T08:13:40.137874+0000","last_fullsized":"2024-01-20T08:13:40.137874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:26.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102483+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:39.102483+0000","last_peered":"2024-01-20T08:13:39.102483+0000","last_clean":"2024-01-20T08:13:39.102483+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:39.102483+0000","last_undegraded":"2024-01-20T08:13:39.102483+0000","last_fullsized":"2024-01-20T08:13:39.102483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109714+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:39.109714+0000","last_peered":"2024-01-20T08:13:39.109714+0000","last_clean":"2024-01-20T08:13:39.109714+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:39.109714+0000","last_undegraded":"2024-01-20T08:13:39.109714+0000","last_fullsized":"2024-01-20T08:13:39.109714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112325+0000","last_change":"2024-01-20T08:13:40.112325+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112325+0000","last_undegraded":"2024-01-20T08:13:40.112325+0000","last_fullsized":"2024-01-20T08:13:40.112325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143620+0000","last_change":"2024-01-20T08:13:40.140385+0000","last_active":"2024-01-20T08:13:40.143620+0000","last_peered":"2024-01-20T08:13:40.143620+0000","last_clean":"2024-01-20T08:13:40.143620+0000","last_became_active":"2024-01-20T08:13:40.140136+0000","last_became_peered":"2024-01-20T08:13:40.140136+0000","last_unstale":"2024-01-20T08:13:40.143620+0000","last_undegraded":"2024-01-20T08:13:40.143620+0000","last_fullsized":"2024-01-20T08:13:40.143620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:50.287743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119990+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:39.119990+0000","last_peered":"2024-01-20T08:13:39.119990+0000","last_clean":"2024-01-20T08:13:39.119990+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:39.119990+0000","last_undegraded":"2024-01-20T08:13:39.119990+0000","last_fullsized":"2024-01-20T08:13:39.119990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"72'9","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116753+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:39.116753+0000","last_peered":"2024-01-20T08:13:39.116753+0000","last_clean":"2024-01-20T08:13:39.116753+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:39.116753+0000","last_undegraded":"2024-01-20T08:13:39.116753+0000","last_fullsized":"2024-01-20T08:13:39.116753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110828+0000","last_change":"2024-01-20T08:13:40.110828+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110828+0000","last_undegraded":"2024-01-20T08:13:40.110828+0000","last_fullsized":"2024-01-20T08:13:40.110828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141981+0000","last_change":"2024-01-20T08:13:40.138835+0000","last_active":"2024-01-20T08:13:40.141981+0000","last_peered":"2024-01-20T08:13:40.141981+0000","last_clean":"2024-01-20T08:13:40.141981+0000","last_became_active":"2024-01-20T08:13:40.138570+0000","last_became_peered":"2024-01-20T08:13:40.138570+0000","last_unstale":"2024-01-20T08:13:40.141981+0000","last_undegraded":"2024-01-20T08:13:40.141981+0000","last_fullsized":"2024-01-20T08:13:40.141981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103072+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:39.103072+0000","last_peered":"2024-01-20T08:13:39.103072+0000","last_clean":"2024-01-20T08:13:39.103072+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:39.103072+0000","last_undegraded":"2024-01-20T08:13:39.103072+0000","last_fullsized":"2024-01-20T08:13:39.103072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113766+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:39.113766+0000","last_peered":"2024-01-20T08:13:39.113766+0000","last_clean":"2024-01-20T08:13:39.113766+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:39.113766+0000","last_undegraded":"2024-01-20T08:13:39.113766+0000","last_fullsized":"2024-01-20T08:13:39.113766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119826+0000","last_change":"2024-01-20T08:13:40.119826+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119826+0000","last_undegraded":"2024-01-20T08:13:40.119826+0000","last_fullsized":"2024-01-20T08:13:40.119826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137609+0000","last_change":"2024-01-20T08:13:40.134405+0000","last_active":"2024-01-20T08:13:40.137609+0000","last_peered":"2024-01-20T08:13:40.137609+0000","last_clean":"2024-01-20T08:13:40.137609+0000","last_became_active":"2024-01-20T08:13:40.134151+0000","last_became_peered":"2024-01-20T08:13:40.134151+0000","last_unstale":"2024-01-20T08:13:40.137609+0000","last_undegraded":"2024-01-20T08:13:40.137609+0000","last_fullsized":"2024-01-20T08:13:40.137609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:15:13.377556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103139+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:39.103139+0000","last_peered":"2024-01-20T08:13:39.103139+0000","last_clean":"2024-01-20T08:13:39.103139+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:39.103139+0000","last_undegraded":"2024-01-20T08:13:39.103139+0000","last_fullsized":"2024-01-20T08:13:39.103139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109723+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:39.109723+0000","last_peered":"2024-01-20T08:13:39.109723+0000","last_clean":"2024-01-20T08:13:39.109723+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:39.109723+0000","last_undegraded":"2024-01-20T08:13:39.109723+0000","last_fullsized":"2024-01-20T08:13:39.109723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119603+0000","last_change":"2024-01-20T08:13:40.119603+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119603+0000","last_undegraded":"2024-01-20T08:13:40.119603+0000","last_fullsized":"2024-01-20T08:13:40.119603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136384+0000","last_change":"2024-01-20T08:13:40.131252+0000","last_active":"2024-01-20T08:13:40.136384+0000","last_peered":"2024-01-20T08:13:40.136384+0000","last_clean":"2024-01-20T08:13:40.136384+0000","last_became_active":"2024-01-20T08:13:40.130235+0000","last_became_peered":"2024-01-20T08:13:40.130235+0000","last_unstale":"2024-01-20T08:13:40.136384+0000","last_undegraded":"2024-01-20T08:13:40.136384+0000","last_fullsized":"2024-01-20T08:13:40.136384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:12.348000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112931+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:39.112931+0000","last_peered":"2024-01-20T08:13:39.112931+0000","last_clean":"2024-01-20T08:13:39.112931+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:39.112931+0000","last_undegraded":"2024-01-20T08:13:39.112931+0000","last_fullsized":"2024-01-20T08:13:39.112931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115255+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:39.115255+0000","last_peered":"2024-01-20T08:13:39.115255+0000","last_clean":"2024-01-20T08:13:39.115255+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:39.115255+0000","last_undegraded":"2024-01-20T08:13:39.115255+0000","last_fullsized":"2024-01-20T08:13:39.115255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116751+0000","last_change":"2024-01-20T08:13:40.116751+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116751+0000","last_undegraded":"2024-01-20T08:13:40.116751+0000","last_fullsized":"2024-01-20T08:13:40.116751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132386+0000","last_change":"2024-01-20T08:13:40.124952+0000","last_active":"2024-01-20T08:13:40.132386+0000","last_peered":"2024-01-20T08:13:40.132386+0000","last_clean":"2024-01-20T08:13:40.132386+0000","last_became_active":"2024-01-20T08:13:40.124408+0000","last_became_peered":"2024-01-20T08:13:40.124408+0000","last_unstale":"2024-01-20T08:13:40.132386+0000","last_undegraded":"2024-01-20T08:13:40.132386+0000","last_fullsized":"2024-01-20T08:13:40.132386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:24.693203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113095+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:39.113095+0000","last_peered":"2024-01-20T08:13:39.113095+0000","last_clean":"2024-01-20T08:13:39.113095+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:39.113095+0000","last_undegraded":"2024-01-20T08:13:39.113095+0000","last_fullsized":"2024-01-20T08:13:39.113095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102137+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:39.102137+0000","last_peered":"2024-01-20T08:13:39.102137+0000","last_clean":"2024-01-20T08:13:39.102137+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:39.102137+0000","last_undegraded":"2024-01-20T08:13:39.102137+0000","last_fullsized":"2024-01-20T08:13:39.102137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141565+0000","last_change":"2024-01-20T08:13:40.137508+0000","last_active":"2024-01-20T08:13:40.141565+0000","last_peered":"2024-01-20T08:13:40.141565+0000","last_clean":"2024-01-20T08:13:40.141565+0000","last_became_active":"2024-01-20T08:13:40.137164+0000","last_became_peered":"2024-01-20T08:13:40.137164+0000","last_unstale":"2024-01-20T08:13:40.141565+0000","last_undegraded":"2024-01-20T08:13:40.141565+0000","last_fullsized":"2024-01-20T08:13:40.141565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105715+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:39.105715+0000","last_peered":"2024-01-20T08:13:39.105715+0000","last_clean":"2024-01-20T08:13:39.105715+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:39.105715+0000","last_undegraded":"2024-01-20T08:13:39.105715+0000","last_fullsized":"2024-01-20T08:13:39.105715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112445+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:39.112445+0000","last_peered":"2024-01-20T08:13:39.112445+0000","last_clean":"2024-01-20T08:13:39.112445+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:39.112445+0000","last_undegraded":"2024-01-20T08:13:39.112445+0000","last_fullsized":"2024-01-20T08:13:39.112445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127354+0000","last_change":"2024-01-20T08:13:40.127354+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127354+0000","last_undegraded":"2024-01-20T08:13:40.127354+0000","last_fullsized":"2024-01-20T08:13:40.127354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139223+0000","last_change":"2024-01-20T08:13:40.132877+0000","last_active":"2024-01-20T08:13:40.139223+0000","last_peered":"2024-01-20T08:13:40.139223+0000","last_clean":"2024-01-20T08:13:40.139223+0000","last_became_active":"2024-01-20T08:13:40.132593+0000","last_became_peered":"2024-01-20T08:13:40.132593+0000","last_unstale":"2024-01-20T08:13:40.139223+0000","last_undegraded":"2024-01-20T08:13:40.139223+0000","last_fullsized":"2024-01-20T08:13:40.139223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:11.124723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111745+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:39.111745+0000","last_peered":"2024-01-20T08:13:39.111745+0000","last_clean":"2024-01-20T08:13:39.111745+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:39.111745+0000","last_undegraded":"2024-01-20T08:13:39.111745+0000","last_fullsized":"2024-01-20T08:13:39.111745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102808+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:39.102808+0000","last_peered":"2024-01-20T08:13:39.102808+0000","last_clean":"2024-01-20T08:13:39.102808+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:39.102808+0000","last_undegraded":"2024-01-20T08:13:39.102808+0000","last_fullsized":"2024-01-20T08:13:39.102808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121382+0000","last_change":"2024-01-20T08:13:40.121382+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121382+0000","last_undegraded":"2024-01-20T08:13:40.121382+0000","last_fullsized":"2024-01-20T08:13:40.121382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139974+0000","last_change":"2024-01-20T08:13:40.134188+0000","last_active":"2024-01-20T08:13:40.139974+0000","last_peered":"2024-01-20T08:13:40.139974+0000","last_clean":"2024-01-20T08:13:40.139974+0000","last_became_active":"2024-01-20T08:13:40.132998+0000","last_became_peered":"2024-01-20T08:13:40.132998+0000","last_unstale":"2024-01-20T08:13:40.139974+0000","last_undegraded":"2024-01-20T08:13:40.139974+0000","last_fullsized":"2024-01-20T08:13:40.139974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120002+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:39.120002+0000","last_peered":"2024-01-20T08:13:39.120002+0000","last_clean":"2024-01-20T08:13:39.120002+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:39.120002+0000","last_undegraded":"2024-01-20T08:13:39.120002+0000","last_fullsized":"2024-01-20T08:13:39.120002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102597+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:39.102597+0000","last_peered":"2024-01-20T08:13:39.102597+0000","last_clean":"2024-01-20T08:13:39.102597+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:39.102597+0000","last_undegraded":"2024-01-20T08:13:39.102597+0000","last_fullsized":"2024-01-20T08:13:39.102597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110820+0000","last_change":"2024-01-20T08:13:40.110820+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110820+0000","last_undegraded":"2024-01-20T08:13:40.110820+0000","last_fullsized":"2024-01-20T08:13:40.110820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140515+0000","last_change":"2024-01-20T08:13:40.136860+0000","last_active":"2024-01-20T08:13:40.140515+0000","last_peered":"2024-01-20T08:13:40.140515+0000","last_clean":"2024-01-20T08:13:40.140515+0000","last_became_active":"2024-01-20T08:13:40.136501+0000","last_became_peered":"2024-01-20T08:13:40.136501+0000","last_unstale":"2024-01-20T08:13:40.140515+0000","last_undegraded":"2024-01-20T08:13:40.140515+0000","last_fullsized":"2024-01-20T08:13:40.140515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:38.500847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111361+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:39.111361+0000","last_peered":"2024-01-20T08:13:39.111361+0000","last_clean":"2024-01-20T08:13:39.111361+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:39.111361+0000","last_undegraded":"2024-01-20T08:13:39.111361+0000","last_fullsized":"2024-01-20T08:13:39.111361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112320+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:39.112320+0000","last_peered":"2024-01-20T08:13:39.112320+0000","last_clean":"2024-01-20T08:13:39.112320+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:39.112320+0000","last_undegraded":"2024-01-20T08:13:39.112320+0000","last_fullsized":"2024-01-20T08:13:39.112320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.129421+0000","last_change":"2024-01-20T08:13:40.129421+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.129421+0000","last_undegraded":"2024-01-20T08:13:40.129421+0000","last_fullsized":"2024-01-20T08:13:40.129421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132463+0000","last_change":"2024-01-20T08:13:40.126858+0000","last_active":"2024-01-20T08:13:40.132463+0000","last_peered":"2024-01-20T08:13:40.132463+0000","last_clean":"2024-01-20T08:13:40.132463+0000","last_became_active":"2024-01-20T08:13:40.124427+0000","last_became_peered":"2024-01-20T08:13:40.124427+0000","last_unstale":"2024-01-20T08:13:40.132463+0000","last_undegraded":"2024-01-20T08:13:40.132463+0000","last_fullsized":"2024-01-20T08:13:40.132463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116307+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:39.116307+0000","last_peered":"2024-01-20T08:13:39.116307+0000","last_clean":"2024-01-20T08:13:39.116307+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:39.116307+0000","last_undegraded":"2024-01-20T08:13:39.116307+0000","last_fullsized":"2024-01-20T08:13:39.116307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113354+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:39.113354+0000","last_peered":"2024-01-20T08:13:39.113354+0000","last_clean":"2024-01-20T08:13:39.113354+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:39.113354+0000","last_undegraded":"2024-01-20T08:13:39.113354+0000","last_fullsized":"2024-01-20T08:13:39.113354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116053+0000","last_change":"2024-01-20T08:13:40.116053+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116053+0000","last_undegraded":"2024-01-20T08:13:40.116053+0000","last_fullsized":"2024-01-20T08:13:40.116053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.130723+0000","last_change":"2024-01-20T08:13:40.123835+0000","last_active":"2024-01-20T08:13:40.130723+0000","last_peered":"2024-01-20T08:13:40.130723+0000","last_clean":"2024-01-20T08:13:40.130723+0000","last_became_active":"2024-01-20T08:13:40.123558+0000","last_became_peered":"2024-01-20T08:13:40.123558+0000","last_unstale":"2024-01-20T08:13:40.130723+0000","last_undegraded":"2024-01-20T08:13:40.130723+0000","last_fullsized":"2024-01-20T08:13:40.130723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109710+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:39.109710+0000","last_peered":"2024-01-20T08:13:39.109710+0000","last_clean":"2024-01-20T08:13:39.109710+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:39.109710+0000","last_undegraded":"2024-01-20T08:13:39.109710+0000","last_fullsized":"2024-01-20T08:13:39.109710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110352+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:39.110352+0000","last_peered":"2024-01-20T08:13:39.110352+0000","last_clean":"2024-01-20T08:13:39.110352+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:39.110352+0000","last_undegraded":"2024-01-20T08:13:39.110352+0000","last_fullsized":"2024-01-20T08:13:39.110352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116227+0000","last_change":"2024-01-20T08:13:40.116227+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116227+0000","last_undegraded":"2024-01-20T08:13:40.116227+0000","last_fullsized":"2024-01-20T08:13:40.116227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.134322+0000","last_change":"2024-01-20T08:13:40.128760+0000","last_active":"2024-01-20T08:13:40.134322+0000","last_peered":"2024-01-20T08:13:40.134322+0000","last_clean":"2024-01-20T08:13:40.134322+0000","last_became_active":"2024-01-20T08:13:40.128395+0000","last_became_peered":"2024-01-20T08:13:40.128395+0000","last_unstale":"2024-01-20T08:13:40.134322+0000","last_undegraded":"2024-01-20T08:13:40.134322+0000","last_fullsized":"2024-01-20T08:13:40.134322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:04:06.168521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115047+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:39.115047+0000","last_peered":"2024-01-20T08:13:39.115047+0000","last_clean":"2024-01-20T08:13:39.115047+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:39.115047+0000","last_undegraded":"2024-01-20T08:13:39.115047+0000","last_fullsized":"2024-01-20T08:13:39.115047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110250+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:39.110250+0000","last_peered":"2024-01-20T08:13:39.110250+0000","last_clean":"2024-01-20T08:13:39.110250+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:39.110250+0000","last_undegraded":"2024-01-20T08:13:39.110250+0000","last_fullsized":"2024-01-20T08:13:39.110250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116220+0000","last_change":"2024-01-20T08:13:40.116220+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116220+0000","last_undegraded":"2024-01-20T08:13:40.116220+0000","last_fullsized":"2024-01-20T08:13:40.116220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139243+0000","last_change":"2024-01-20T08:13:40.131748+0000","last_active":"2024-01-20T08:13:40.139243+0000","last_peered":"2024-01-20T08:13:40.139243+0000","last_clean":"2024-01-20T08:13:40.139243+0000","last_became_active":"2024-01-20T08:13:40.131502+0000","last_became_peered":"2024-01-20T08:13:40.131502+0000","last_unstale":"2024-01-20T08:13:40.139243+0000","last_undegraded":"2024-01-20T08:13:40.139243+0000","last_fullsized":"2024-01-20T08:13:40.139243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120282+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:39.120282+0000","last_peered":"2024-01-20T08:13:39.120282+0000","last_clean":"2024-01-20T08:13:39.120282+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:39.120282+0000","last_undegraded":"2024-01-20T08:13:39.120282+0000","last_fullsized":"2024-01-20T08:13:39.120282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115494+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:39.115494+0000","last_peered":"2024-01-20T08:13:39.115494+0000","last_clean":"2024-01-20T08:13:39.115494+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:39.115494+0000","last_undegraded":"2024-01-20T08:13:39.115494+0000","last_fullsized":"2024-01-20T08:13:39.115494+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125586+0000","last_change":"2024-01-20T08:13:40.125586+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125586+0000","last_undegraded":"2024-01-20T08:13:40.125586+0000","last_fullsized":"2024-01-20T08:13:40.125586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139913+0000","last_change":"2024-01-20T08:13:40.136610+0000","last_active":"2024-01-20T08:13:40.139913+0000","last_peered":"2024-01-20T08:13:40.139913+0000","last_clean":"2024-01-20T08:13:40.139913+0000","last_became_active":"2024-01-20T08:13:40.135965+0000","last_became_peered":"2024-01-20T08:13:40.135965+0000","last_unstale":"2024-01-20T08:13:40.139913+0000","last_undegraded":"2024-01-20T08:13:40.139913+0000","last_fullsized":"2024-01-20T08:13:40.139913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.106130+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:39.106130+0000","last_peered":"2024-01-20T08:13:39.106130+0000","last_clean":"2024-01-20T08:13:39.106130+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:39.106130+0000","last_undegraded":"2024-01-20T08:13:39.106130+0000","last_fullsized":"2024-01-20T08:13:39.106130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114981+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:39.114981+0000","last_peered":"2024-01-20T08:13:39.114981+0000","last_clean":"2024-01-20T08:13:39.114981+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:39.114981+0000","last_undegraded":"2024-01-20T08:13:39.114981+0000","last_fullsized":"2024-01-20T08:13:39.114981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116973+0000","last_change":"2024-01-20T08:13:40.116973+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116973+0000","last_undegraded":"2024-01-20T08:13:40.116973+0000","last_fullsized":"2024-01-20T08:13:40.116973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141253+0000","last_change":"2024-01-20T08:13:40.138153+0000","last_active":"2024-01-20T08:13:40.141253+0000","last_peered":"2024-01-20T08:13:40.141253+0000","last_clean":"2024-01-20T08:13:40.141253+0000","last_became_active":"2024-01-20T08:13:40.137489+0000","last_became_peered":"2024-01-20T08:13:40.137489+0000","last_unstale":"2024-01-20T08:13:40.141253+0000","last_undegraded":"2024-01-20T08:13:40.141253+0000","last_fullsized":"2024-01-20T08:13:40.141253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:58.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111008+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:39.111008+0000","last_peered":"2024-01-20T08:13:39.111008+0000","last_clean":"2024-01-20T08:13:39.111008+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:39.111008+0000","last_undegraded":"2024-01-20T08:13:39.111008+0000","last_fullsized":"2024-01-20T08:13:39.111008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110011+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:39.110011+0000","last_peered":"2024-01-20T08:13:39.110011+0000","last_clean":"2024-01-20T08:13:39.110011+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:39.110011+0000","last_undegraded":"2024-01-20T08:13:39.110011+0000","last_fullsized":"2024-01-20T08:13:39.110011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118595+0000","last_change":"2024-01-20T08:13:40.118595+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118595+0000","last_undegraded":"2024-01-20T08:13:40.118595+0000","last_fullsized":"2024-01-20T08:13:40.118595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139284+0000","last_change":"2024-01-20T08:13:40.135004+0000","last_active":"2024-01-20T08:13:40.139284+0000","last_peered":"2024-01-20T08:13:40.139284+0000","last_clean":"2024-01-20T08:13:40.139284+0000","last_became_active":"2024-01-20T08:13:40.132993+0000","last_became_peered":"2024-01-20T08:13:40.132993+0000","last_unstale":"2024-01-20T08:13:40.139284+0000","last_undegraded":"2024-01-20T08:13:40.139284+0000","last_fullsized":"2024-01-20T08:13:40.139284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:36.525486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120149+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:39.120149+0000","last_peered":"2024-01-20T08:13:39.120149+0000","last_clean":"2024-01-20T08:13:39.120149+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:39.120149+0000","last_undegraded":"2024-01-20T08:13:39.120149+0000","last_fullsized":"2024-01-20T08:13:39.120149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111251+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:39.111251+0000","last_peered":"2024-01-20T08:13:39.111251+0000","last_clean":"2024-01-20T08:13:39.111251+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:39.111251+0000","last_undegraded":"2024-01-20T08:13:39.111251+0000","last_fullsized":"2024-01-20T08:13:39.111251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.109850+0000","last_change":"2024-01-20T08:13:40.109850+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.109850+0000","last_undegraded":"2024-01-20T08:13:40.109850+0000","last_fullsized":"2024-01-20T08:13:40.109850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143546+0000","last_change":"2024-01-20T08:13:40.138887+0000","last_active":"2024-01-20T08:13:40.143546+0000","last_peered":"2024-01-20T08:13:40.143546+0000","last_clean":"2024-01-20T08:13:40.143546+0000","last_became_active":"2024-01-20T08:13:40.138591+0000","last_became_peered":"2024-01-20T08:13:40.138591+0000","last_unstale":"2024-01-20T08:13:40.143546+0000","last_undegraded":"2024-01-20T08:13:40.143546+0000","last_fullsized":"2024-01-20T08:13:40.143546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118082+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:39.118082+0000","last_peered":"2024-01-20T08:13:39.118082+0000","last_clean":"2024-01-20T08:13:39.118082+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:39.118082+0000","last_undegraded":"2024-01-20T08:13:39.118082+0000","last_fullsized":"2024-01-20T08:13:39.118082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102627+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:39.102627+0000","last_peered":"2024-01-20T08:13:39.102627+0000","last_clean":"2024-01-20T08:13:39.102627+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:39.102627+0000","last_undegraded":"2024-01-20T08:13:39.102627+0000","last_fullsized":"2024-01-20T08:13:39.102627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121559+0000","last_change":"2024-01-20T08:13:40.121559+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121559+0000","last_undegraded":"2024-01-20T08:13:40.121559+0000","last_fullsized":"2024-01-20T08:13:40.121559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.131963+0000","last_change":"2024-01-20T08:13:40.125670+0000","last_active":"2024-01-20T08:13:40.131963+0000","last_peered":"2024-01-20T08:13:40.131963+0000","last_clean":"2024-01-20T08:13:40.131963+0000","last_became_active":"2024-01-20T08:13:40.125414+0000","last_became_peered":"2024-01-20T08:13:40.125414+0000","last_unstale":"2024-01-20T08:13:40.131963+0000","last_undegraded":"2024-01-20T08:13:40.131963+0000","last_fullsized":"2024-01-20T08:13:40.131963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:56.786851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102265+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:39.102265+0000","last_peered":"2024-01-20T08:13:39.102265+0000","last_clean":"2024-01-20T08:13:39.102265+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:39.102265+0000","last_undegraded":"2024-01-20T08:13:39.102265+0000","last_fullsized":"2024-01-20T08:13:39.102265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119588+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:39.119588+0000","last_peered":"2024-01-20T08:13:39.119588+0000","last_clean":"2024-01-20T08:13:39.119588+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:39.119588+0000","last_undegraded":"2024-01-20T08:13:39.119588+0000","last_fullsized":"2024-01-20T08:13:39.119588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113404+0000","last_change":"2024-01-20T08:13:40.113404+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113404+0000","last_undegraded":"2024-01-20T08:13:40.113404+0000","last_fullsized":"2024-01-20T08:13:40.113404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142610+0000","last_change":"2024-01-20T08:13:40.140095+0000","last_active":"2024-01-20T08:13:40.142610+0000","last_peered":"2024-01-20T08:13:40.142610+0000","last_clean":"2024-01-20T08:13:40.142610+0000","last_became_active":"2024-01-20T08:13:40.139756+0000","last_became_peered":"2024-01-20T08:13:40.139756+0000","last_unstale":"2024-01-20T08:13:40.142610+0000","last_undegraded":"2024-01-20T08:13:40.142610+0000","last_fullsized":"2024-01-20T08:13:40.142610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:03:58.663879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102633+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:39.102633+0000","last_peered":"2024-01-20T08:13:39.102633+0000","last_clean":"2024-01-20T08:13:39.102633+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:39.102633+0000","last_undegraded":"2024-01-20T08:13:39.102633+0000","last_fullsized":"2024-01-20T08:13:39.102633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108947+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:39.108947+0000","last_peered":"2024-01-20T08:13:39.108947+0000","last_clean":"2024-01-20T08:13:39.108947+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:39.108947+0000","last_undegraded":"2024-01-20T08:13:39.108947+0000","last_fullsized":"2024-01-20T08:13:39.108947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112491+0000","last_change":"2024-01-20T08:13:40.112491+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112491+0000","last_undegraded":"2024-01-20T08:13:40.112491+0000","last_fullsized":"2024-01-20T08:13:40.112491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140001+0000","last_change":"2024-01-20T08:13:40.136793+0000","last_active":"2024-01-20T08:13:40.140001+0000","last_peered":"2024-01-20T08:13:40.140001+0000","last_clean":"2024-01-20T08:13:40.140001+0000","last_became_active":"2024-01-20T08:13:40.135303+0000","last_became_peered":"2024-01-20T08:13:40.135303+0000","last_unstale":"2024-01-20T08:13:40.140001+0000","last_undegraded":"2024-01-20T08:13:40.140001+0000","last_fullsized":"2024-01-20T08:13:40.140001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108788+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:39.108788+0000","last_peered":"2024-01-20T08:13:39.108788+0000","last_clean":"2024-01-20T08:13:39.108788+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:39.108788+0000","last_undegraded":"2024-01-20T08:13:39.108788+0000","last_fullsized":"2024-01-20T08:13:39.108788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119127+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:39.119127+0000","last_peered":"2024-01-20T08:13:39.119127+0000","last_clean":"2024-01-20T08:13:39.119127+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:39.119127+0000","last_undegraded":"2024-01-20T08:13:39.119127+0000","last_fullsized":"2024-01-20T08:13:39.119127+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118570+0000","last_change":"2024-01-20T08:13:40.118570+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118570+0000","last_undegraded":"2024-01-20T08:13:40.118570+0000","last_fullsized":"2024-01-20T08:13:40.118570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142233+0000","last_change":"2024-01-20T08:13:40.138906+0000","last_active":"2024-01-20T08:13:40.142233+0000","last_peered":"2024-01-20T08:13:40.142233+0000","last_clean":"2024-01-20T08:13:40.142233+0000","last_became_active":"2024-01-20T08:13:40.138512+0000","last_became_peered":"2024-01-20T08:13:40.138512+0000","last_unstale":"2024-01-20T08:13:40.142233+0000","last_undegraded":"2024-01-20T08:13:40.142233+0000","last_fullsized":"2024-01-20T08:13:40.142233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114484+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:39.114484+0000","last_peered":"2024-01-20T08:13:39.114484+0000","last_clean":"2024-01-20T08:13:39.114484+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:39.114484+0000","last_undegraded":"2024-01-20T08:13:39.114484+0000","last_fullsized":"2024-01-20T08:13:39.114484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.104132+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:39.104132+0000","last_peered":"2024-01-20T08:13:39.104132+0000","last_clean":"2024-01-20T08:13:39.104132+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:39.104132+0000","last_undegraded":"2024-01-20T08:13:39.104132+0000","last_fullsized":"2024-01-20T08:13:39.104132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102921+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:39.102921+0000","last_peered":"2024-01-20T08:13:39.102921+0000","last_clean":"2024-01-20T08:13:39.102921+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:39.102921+0000","last_undegraded":"2024-01-20T08:13:39.102921+0000","last_fullsized":"2024-01-20T08:13:39.102921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.153}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.123},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.577}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.3600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.2130000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.427}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.748},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.3919999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.49},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":400965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":0.754}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3899999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.167},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.353}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.46}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":396270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.387}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.482}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.357},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.032}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.419}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":400271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.873},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.0980000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.47}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.02},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.534}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.238},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.401},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.738}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":396248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.313},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.752},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.042}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":400853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.167}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.018},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":1.258}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.304},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":393335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.872}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.82499999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.234}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.157},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.3220000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.29},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.163},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.2769999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.075}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.018},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.7629999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.617},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.321}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.127}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.466},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.8320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:45.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.855+0000 7f8349c00640 1 Processor -- start 2024-01-20T08:13:45.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.855+0000 7f8349c00640 1 -- start start 2024-01-20T08:13:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.856+0000 7f8349c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.856+0000 7f8349c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83440aae00 0x7f83440ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.856+0000 7f8349c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83440a9940 con 0x7f83440a93c0 2024-01-20T08:13:45.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.856+0000 7f8349c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83441500c0 con 0x7f83440aae00 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.856+0000 7f8349c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8344156810 con 0x7f834414fce0 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83440aae00 0x7f83440ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83440aae00 0x7f83440ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33436/0 (socket says 172.21.15.100:33436) 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 -- 172.21.15.100:0/3195924935 learned_addr learned my addr 172.21.15.100:0/3195924935 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8342a00640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 -- 172.21.15.100:0/3195924935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 msgr2=0x7f8344153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 -- 172.21.15.100:0/3195924935 >> v1:172.21.15.110:6789/0 conn(0x7f83440a93c0 legacy=0x7f8344152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8343400640 1 -- 172.21.15.100:0/3195924935 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8344156af0 con 0x7f83440aae00 2024-01-20T08:13:45.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.857+0000 7f8342a00640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.858+0000 7f8343400640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440ab290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e50 tx=0x7f833c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282906639a216fc1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8341600640 1 -- 172.21.15.100:0/3195924935 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c02ca70 con 0x7f83440aae00 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8341600640 1 -- 172.21.15.100:0/3195924935 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833c02cbd0 con 0x7f83440aae00 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8341600640 1 -- 172.21.15.100:0/3195924935 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833c0343f0 con 0x7f83440aae00 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 -- 172.21.15.100:0/3195924935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 msgr2=0x7f83440ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440ab290 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f833c009e50 tx=0x7f833c02bed0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 -- 172.21.15.100:0/3195924935 shutdown_connections 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440ab290 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 --2- 172.21.15.100:0/3195924935 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 -- 172.21.15.100:0/3195924935 >> 172.21.15.100:0/3195924935 conn(0x7f834406a5e0 msgr2=0x7f834406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.859+0000 7f8349c00640 1 -- 172.21.15.100:0/3195924935 shutdown_connections 2024-01-20T08:13:45.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.860+0000 7f8349c00640 1 -- 172.21.15.100:0/3195924935 wait complete. 2024-01-20T08:13:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.861+0000 7f8349c00640 1 Processor -- start 2024-01-20T08:13:45.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.861+0000 7f8349c00640 1 -- start start 2024-01-20T08:13:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 0x7f8344149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8344071bd0 con 0x7f83440aae00 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834414ade0 con 0x7f83440a93c0 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8349c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834414a3c0 con 0x7f834414fce0 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8342000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8342000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33440/0 (socket says 172.21.15.100:33440) 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.862+0000 7f8342000640 1 -- 172.21.15.100:0/4102031104 learned_addr learned my addr 172.21.15.100:0/4102031104 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342a00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 0x7f8344149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8343400640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 -- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 msgr2=0x7f8344147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 -- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 msgr2=0x7f8344149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 0x7f8344149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:45.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 -- 172.21.15.100:0/4102031104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833c009b30 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342a00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 0x7f8344149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8342000640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c430 tx=0x7f832c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c011790 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832c0118f0 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f834414a5d0 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.863+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832c011ce0 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.864+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83440c4830 con 0x7f83440aae00 2024-01-20T08:13:45.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.865+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8344066ff0 con 0x7f83440aae00 2024-01-20T08:13:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.866+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f832c01c460 con 0x7f83440aae00 2024-01-20T08:13:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.866+0000 7f833aa00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 0x7f831c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.866+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f832c0898e0 con 0x7f83440aae00 2024-01-20T08:13:45.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.867+0000 7f8342a00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 0x7f831c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:45.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.867+0000 7f8342a00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 0x7f831c06d390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8334006fd0 tx=0x7f8334008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:45.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:45.871+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f832c0544e0 con 0x7f83440aae00 2024-01-20T08:13:46.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.061+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f83440aa5f0 con 0x7f831c06aed0 2024-01-20T08:13:46.101 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.098+0000 7f833aa00640 1 -- 172.21.15.100:0/4102031104 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519871 (secure 0 0 0) 0x7f833400c040 con 0x7f831c06aed0 2024-01-20T08:13:46.108 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:46.112 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 msgr2=0x7f831c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 0x7f831c06d390 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8334006fd0 tx=0x7f8334008040 comp rx=0 tx=0).stop 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 msgr2=0x7f83440705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f832c00c430 tx=0x7f832c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 shutdown_connections 2024-01-20T08:13:46.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831c06aed0 0x7f831c06d390 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f834414fce0 0x7f8344147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83440aae00 0x7f83440705e0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 --2- 172.21.15.100:0/4102031104 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83440a93c0 0x7f8344149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 >> 172.21.15.100:0/4102031104 conn(0x7f834406a5e0 msgr2=0x7f83440c6330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 shutdown_connections 2024-01-20T08:13:46.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.106+0000 7f8349c00640 1 -- 172.21.15.100:0/4102031104 wait complete. 2024-01-20T08:13:46.132 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-01-20T08:13:45.956782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8292,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8491008,"data_stored":4369324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001921"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118584+0000","last_change":"2024-01-20T08:13:40.118584+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118584+0000","last_undegraded":"2024-01-20T08:13:40.118584+0000","last_fullsized":"2024-01-20T08:13:40.118584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111456+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:39.111456+0000","last_peered":"2024-01-20T08:13:39.111456+0000","last_clean":"2024-01-20T08:13:39.111456+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:39.111456+0000","last_undegraded":"2024-01-20T08:13:39.111456+0000","last_fullsized":"2024-01-20T08:13:39.111456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123276+0000","last_change":"2024-01-20T08:13:40.123276+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123276+0000","last_undegraded":"2024-01-20T08:13:40.123276+0000","last_fullsized":"2024-01-20T08:13:40.123276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114846+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:39.114846+0000","last_peered":"2024-01-20T08:13:39.114846+0000","last_clean":"2024-01-20T08:13:39.114846+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:39.114846+0000","last_undegraded":"2024-01-20T08:13:39.114846+0000","last_fullsized":"2024-01-20T08:13:39.114846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118942+0000","last_change":"2024-01-20T08:13:40.118942+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118942+0000","last_undegraded":"2024-01-20T08:13:40.118942+0000","last_fullsized":"2024-01-20T08:13:40.118942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103601+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:39.103601+0000","last_peered":"2024-01-20T08:13:39.103601+0000","last_clean":"2024-01-20T08:13:39.103601+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:39.103601+0000","last_undegraded":"2024-01-20T08:13:39.103601+0000","last_fullsized":"2024-01-20T08:13:39.103601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.114079+0000","last_change":"2024-01-20T08:13:40.114079+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.114079+0000","last_undegraded":"2024-01-20T08:13:40.114079+0000","last_fullsized":"2024-01-20T08:13:40.114079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112607+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:39.112607+0000","last_peered":"2024-01-20T08:13:39.112607+0000","last_clean":"2024-01-20T08:13:39.112607+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:39.112607+0000","last_undegraded":"2024-01-20T08:13:39.112607+0000","last_fullsized":"2024-01-20T08:13:39.112607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125859+0000","last_change":"2024-01-20T08:13:40.125859+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125859+0000","last_undegraded":"2024-01-20T08:13:40.125859+0000","last_fullsized":"2024-01-20T08:13:40.125859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119446+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:39.119446+0000","last_peered":"2024-01-20T08:13:39.119446+0000","last_clean":"2024-01-20T08:13:39.119446+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:39.119446+0000","last_undegraded":"2024-01-20T08:13:39.119446+0000","last_fullsized":"2024-01-20T08:13:39.119446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113241+0000","last_change":"2024-01-20T08:13:40.113241+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113241+0000","last_undegraded":"2024-01-20T08:13:40.113241+0000","last_fullsized":"2024-01-20T08:13:40.113241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.117857+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:39.117857+0000","last_peered":"2024-01-20T08:13:39.117857+0000","last_clean":"2024-01-20T08:13:39.117857+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:39.117857+0000","last_undegraded":"2024-01-20T08:13:39.117857+0000","last_fullsized":"2024-01-20T08:13:39.117857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125091+0000","last_change":"2024-01-20T08:13:40.125091+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125091+0000","last_undegraded":"2024-01-20T08:13:40.125091+0000","last_fullsized":"2024-01-20T08:13:40.125091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110212+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:39.110212+0000","last_peered":"2024-01-20T08:13:39.110212+0000","last_clean":"2024-01-20T08:13:39.110212+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:39.110212+0000","last_undegraded":"2024-01-20T08:13:39.110212+0000","last_fullsized":"2024-01-20T08:13:39.110212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.122263+0000","last_change":"2024-01-20T08:13:40.122263+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.122263+0000","last_undegraded":"2024-01-20T08:13:40.122263+0000","last_fullsized":"2024-01-20T08:13:40.122263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116243+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:39.116243+0000","last_peered":"2024-01-20T08:13:39.116243+0000","last_clean":"2024-01-20T08:13:39.116243+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:39.116243+0000","last_undegraded":"2024-01-20T08:13:39.116243+0000","last_fullsized":"2024-01-20T08:13:39.116243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128279+0000","last_change":"2024-01-20T08:13:40.128279+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128279+0000","last_undegraded":"2024-01-20T08:13:40.128279+0000","last_fullsized":"2024-01-20T08:13:40.128279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118816+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:39.118816+0000","last_peered":"2024-01-20T08:13:39.118816+0000","last_clean":"2024-01-20T08:13:39.118816+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:39.118816+0000","last_undegraded":"2024-01-20T08:13:39.118816+0000","last_fullsized":"2024-01-20T08:13:39.118816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113123+0000","last_change":"2024-01-20T08:13:40.113123+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113123+0000","last_undegraded":"2024-01-20T08:13:40.113123+0000","last_fullsized":"2024-01-20T08:13:40.113123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110889+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:39.110889+0000","last_peered":"2024-01-20T08:13:39.110889+0000","last_clean":"2024-01-20T08:13:39.110889+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:39.110889+0000","last_undegraded":"2024-01-20T08:13:39.110889+0000","last_fullsized":"2024-01-20T08:13:39.110889+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113777+0000","last_change":"2024-01-20T08:13:40.113777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113777+0000","last_undegraded":"2024-01-20T08:13:40.113777+0000","last_fullsized":"2024-01-20T08:13:40.113777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114346+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:39.114346+0000","last_peered":"2024-01-20T08:13:39.114346+0000","last_clean":"2024-01-20T08:13:39.114346+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:39.114346+0000","last_undegraded":"2024-01-20T08:13:39.114346+0000","last_fullsized":"2024-01-20T08:13:39.114346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119078+0000","last_change":"2024-01-20T08:13:40.119078+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119078+0000","last_undegraded":"2024-01-20T08:13:40.119078+0000","last_fullsized":"2024-01-20T08:13:40.119078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110189+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:39.110189+0000","last_peered":"2024-01-20T08:13:39.110189+0000","last_clean":"2024-01-20T08:13:39.110189+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:39.110189+0000","last_undegraded":"2024-01-20T08:13:39.110189+0000","last_fullsized":"2024-01-20T08:13:39.110189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123258+0000","last_change":"2024-01-20T08:13:40.123258+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123258+0000","last_undegraded":"2024-01-20T08:13:40.123258+0000","last_fullsized":"2024-01-20T08:13:40.123258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103069+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:39.103069+0000","last_peered":"2024-01-20T08:13:39.103069+0000","last_clean":"2024-01-20T08:13:39.103069+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:39.103069+0000","last_undegraded":"2024-01-20T08:13:39.103069+0000","last_fullsized":"2024-01-20T08:13:39.103069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.124661+0000","last_change":"2024-01-20T08:13:40.124661+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.124661+0000","last_undegraded":"2024-01-20T08:13:40.124661+0000","last_fullsized":"2024-01-20T08:13:40.124661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111206+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:39.111206+0000","last_peered":"2024-01-20T08:13:39.111206+0000","last_clean":"2024-01-20T08:13:39.111206+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:39.111206+0000","last_undegraded":"2024-01-20T08:13:39.111206+0000","last_fullsized":"2024-01-20T08:13:39.111206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118369+0000","last_change":"2024-01-20T08:13:40.118369+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118369+0000","last_undegraded":"2024-01-20T08:13:40.118369+0000","last_fullsized":"2024-01-20T08:13:40.118369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109905+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:39.109905+0000","last_peered":"2024-01-20T08:13:39.109905+0000","last_clean":"2024-01-20T08:13:39.109905+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:39.109905+0000","last_undegraded":"2024-01-20T08:13:39.109905+0000","last_fullsized":"2024-01-20T08:13:39.109905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120267+0000","last_change":"2024-01-20T08:13:40.120267+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120267+0000","last_undegraded":"2024-01-20T08:13:40.120267+0000","last_fullsized":"2024-01-20T08:13:40.120267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119099+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:39.119099+0000","last_peered":"2024-01-20T08:13:39.119099+0000","last_clean":"2024-01-20T08:13:39.119099+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:39.119099+0000","last_undegraded":"2024-01-20T08:13:39.119099+0000","last_fullsized":"2024-01-20T08:13:39.119099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118107+0000","last_change":"2024-01-20T08:13:40.118107+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118107+0000","last_undegraded":"2024-01-20T08:13:40.118107+0000","last_fullsized":"2024-01-20T08:13:40.118107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119911+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:39.119911+0000","last_peered":"2024-01-20T08:13:39.119911+0000","last_clean":"2024-01-20T08:13:39.119911+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:39.119911+0000","last_undegraded":"2024-01-20T08:13:39.119911+0000","last_fullsized":"2024-01-20T08:13:39.119911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112004+0000","last_change":"2024-01-20T08:13:40.112004+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112004+0000","last_undegraded":"2024-01-20T08:13:40.112004+0000","last_fullsized":"2024-01-20T08:13:40.112004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115407+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:39.115407+0000","last_peered":"2024-01-20T08:13:39.115407+0000","last_clean":"2024-01-20T08:13:39.115407+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:39.115407+0000","last_undegraded":"2024-01-20T08:13:39.115407+0000","last_fullsized":"2024-01-20T08:13:39.115407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113747+0000","last_change":"2024-01-20T08:13:40.113747+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113747+0000","last_undegraded":"2024-01-20T08:13:40.113747+0000","last_fullsized":"2024-01-20T08:13:40.113747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102437+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:39.102437+0000","last_peered":"2024-01-20T08:13:39.102437+0000","last_clean":"2024-01-20T08:13:39.102437+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:39.102437+0000","last_undegraded":"2024-01-20T08:13:39.102437+0000","last_fullsized":"2024-01-20T08:13:39.102437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118010+0000","last_change":"2024-01-20T08:13:40.118010+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118010+0000","last_undegraded":"2024-01-20T08:13:40.118010+0000","last_fullsized":"2024-01-20T08:13:40.118010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112780+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:39.112780+0000","last_peered":"2024-01-20T08:13:39.112780+0000","last_clean":"2024-01-20T08:13:39.112780+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:39.112780+0000","last_undegraded":"2024-01-20T08:13:39.112780+0000","last_fullsized":"2024-01-20T08:13:39.112780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112226+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:39.112226+0000","last_peered":"2024-01-20T08:13:39.112226+0000","last_clean":"2024-01-20T08:13:39.112226+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:39.112226+0000","last_undegraded":"2024-01-20T08:13:39.112226+0000","last_fullsized":"2024-01-20T08:13:39.112226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123643+0000","last_change":"2024-01-20T08:13:40.123643+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123643+0000","last_undegraded":"2024-01-20T08:13:40.123643+0000","last_fullsized":"2024-01-20T08:13:40.123643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114017+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:39.114017+0000","last_peered":"2024-01-20T08:13:39.114017+0000","last_clean":"2024-01-20T08:13:39.114017+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:39.114017+0000","last_undegraded":"2024-01-20T08:13:39.114017+0000","last_fullsized":"2024-01-20T08:13:39.114017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117525+0000","last_change":"2024-01-20T08:13:40.117525+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117525+0000","last_undegraded":"2024-01-20T08:13:40.117525+0000","last_fullsized":"2024-01-20T08:13:40.117525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108503+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:39.108503+0000","last_peered":"2024-01-20T08:13:39.108503+0000","last_clean":"2024-01-20T08:13:39.108503+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:39.108503+0000","last_undegraded":"2024-01-20T08:13:39.108503+0000","last_fullsized":"2024-01-20T08:13:39.108503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113839+0000","last_change":"2024-01-20T08:13:40.113839+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113839+0000","last_undegraded":"2024-01-20T08:13:40.113839+0000","last_fullsized":"2024-01-20T08:13:40.113839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109570+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:39.109570+0000","last_peered":"2024-01-20T08:13:39.109570+0000","last_clean":"2024-01-20T08:13:39.109570+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:39.109570+0000","last_undegraded":"2024-01-20T08:13:39.109570+0000","last_fullsized":"2024-01-20T08:13:39.109570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126896+0000","last_change":"2024-01-20T08:13:40.126896+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126896+0000","last_undegraded":"2024-01-20T08:13:40.126896+0000","last_fullsized":"2024-01-20T08:13:40.126896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115377+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:39.115377+0000","last_peered":"2024-01-20T08:13:39.115377+0000","last_clean":"2024-01-20T08:13:39.115377+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:39.115377+0000","last_undegraded":"2024-01-20T08:13:39.115377+0000","last_fullsized":"2024-01-20T08:13:39.115377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120314+0000","last_change":"2024-01-20T08:13:40.120314+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120314+0000","last_undegraded":"2024-01-20T08:13:40.120314+0000","last_fullsized":"2024-01-20T08:13:40.120314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105160+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:39.105160+0000","last_peered":"2024-01-20T08:13:39.105160+0000","last_clean":"2024-01-20T08:13:39.105160+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:39.105160+0000","last_undegraded":"2024-01-20T08:13:39.105160+0000","last_fullsized":"2024-01-20T08:13:39.105160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120673+0000","last_change":"2024-01-20T08:13:40.120673+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120673+0000","last_undegraded":"2024-01-20T08:13:40.120673+0000","last_fullsized":"2024-01-20T08:13:40.120673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119803+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:39.119803+0000","last_peered":"2024-01-20T08:13:39.119803+0000","last_clean":"2024-01-20T08:13:39.119803+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:39.119803+0000","last_undegraded":"2024-01-20T08:13:39.119803+0000","last_fullsized":"2024-01-20T08:13:39.119803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113518+0000","last_change":"2024-01-20T08:13:40.113518+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113518+0000","last_undegraded":"2024-01-20T08:13:40.113518+0000","last_fullsized":"2024-01-20T08:13:40.113518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110459+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:39.110459+0000","last_peered":"2024-01-20T08:13:39.110459+0000","last_clean":"2024-01-20T08:13:39.110459+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:39.110459+0000","last_undegraded":"2024-01-20T08:13:39.110459+0000","last_fullsized":"2024-01-20T08:13:39.110459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120384+0000","last_change":"2024-01-20T08:13:40.120384+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120384+0000","last_undegraded":"2024-01-20T08:13:40.120384+0000","last_fullsized":"2024-01-20T08:13:40.120384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113620+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:39.113620+0000","last_peered":"2024-01-20T08:13:39.113620+0000","last_clean":"2024-01-20T08:13:39.113620+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:39.113620+0000","last_undegraded":"2024-01-20T08:13:39.113620+0000","last_fullsized":"2024-01-20T08:13:39.113620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115829+0000","last_change":"2024-01-20T08:13:40.115829+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115829+0000","last_undegraded":"2024-01-20T08:13:40.115829+0000","last_fullsized":"2024-01-20T08:13:40.115829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113711+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:39.113711+0000","last_peered":"2024-01-20T08:13:39.113711+0000","last_clean":"2024-01-20T08:13:39.113711+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:39.113711+0000","last_undegraded":"2024-01-20T08:13:39.113711+0000","last_fullsized":"2024-01-20T08:13:39.113711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112697+0000","last_change":"2024-01-20T08:13:40.112697+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112697+0000","last_undegraded":"2024-01-20T08:13:40.112697+0000","last_fullsized":"2024-01-20T08:13:40.112697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119320+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:39.119320+0000","last_peered":"2024-01-20T08:13:39.119320+0000","last_clean":"2024-01-20T08:13:39.119320+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:39.119320+0000","last_undegraded":"2024-01-20T08:13:39.119320+0000","last_fullsized":"2024-01-20T08:13:39.119320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117245+0000","last_change":"2024-01-20T08:13:40.117245+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117245+0000","last_undegraded":"2024-01-20T08:13:40.117245+0000","last_fullsized":"2024-01-20T08:13:40.117245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.107896+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:39.107896+0000","last_peered":"2024-01-20T08:13:39.107896+0000","last_clean":"2024-01-20T08:13:39.107896+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:39.107896+0000","last_undegraded":"2024-01-20T08:13:39.107896+0000","last_fullsized":"2024-01-20T08:13:39.107896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116777+0000","last_change":"2024-01-20T08:13:40.116777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116777+0000","last_undegraded":"2024-01-20T08:13:40.116777+0000","last_fullsized":"2024-01-20T08:13:40.116777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136687+0000","last_change":"2024-01-20T08:13:40.129620+0000","last_active":"2024-01-20T08:13:40.136687+0000","last_peered":"2024-01-20T08:13:40.136687+0000","last_clean":"2024-01-20T08:13:40.136687+0000","last_became_active":"2024-01-20T08:13:40.129373+0000","last_became_peered":"2024-01-20T08:13:40.129373+0000","last_unstale":"2024-01-20T08:13:40.136687+0000","last_undegraded":"2024-01-20T08:13:40.136687+0000","last_fullsized":"2024-01-20T08:13:40.136687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120224+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:39.120224+0000","last_peered":"2024-01-20T08:13:39.120224+0000","last_clean":"2024-01-20T08:13:39.120224+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:39.120224+0000","last_undegraded":"2024-01-20T08:13:39.120224+0000","last_fullsized":"2024-01-20T08:13:39.120224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111817+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:39.111817+0000","last_peered":"2024-01-20T08:13:39.111817+0000","last_clean":"2024-01-20T08:13:39.111817+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:39.111817+0000","last_undegraded":"2024-01-20T08:13:39.111817+0000","last_fullsized":"2024-01-20T08:13:39.111817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113112+0000","last_change":"2024-01-20T08:13:40.113112+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113112+0000","last_undegraded":"2024-01-20T08:13:40.113112+0000","last_fullsized":"2024-01-20T08:13:40.113112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140960+0000","last_change":"2024-01-20T08:13:40.136955+0000","last_active":"2024-01-20T08:13:40.140960+0000","last_peered":"2024-01-20T08:13:40.140960+0000","last_clean":"2024-01-20T08:13:40.140960+0000","last_became_active":"2024-01-20T08:13:40.136627+0000","last_became_peered":"2024-01-20T08:13:40.136627+0000","last_unstale":"2024-01-20T08:13:40.140960+0000","last_undegraded":"2024-01-20T08:13:40.140960+0000","last_fullsized":"2024-01-20T08:13:40.140960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:58.292868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111524+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:39.111524+0000","last_peered":"2024-01-20T08:13:39.111524+0000","last_clean":"2024-01-20T08:13:39.111524+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:39.111524+0000","last_undegraded":"2024-01-20T08:13:39.111524+0000","last_fullsized":"2024-01-20T08:13:39.111524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120411+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:39.120411+0000","last_peered":"2024-01-20T08:13:39.120411+0000","last_clean":"2024-01-20T08:13:39.120411+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:39.120411+0000","last_undegraded":"2024-01-20T08:13:39.120411+0000","last_fullsized":"2024-01-20T08:13:39.120411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119163+0000","last_change":"2024-01-20T08:13:40.119163+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119163+0000","last_undegraded":"2024-01-20T08:13:40.119163+0000","last_fullsized":"2024-01-20T08:13:40.119163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143290+0000","last_change":"2024-01-20T08:13:40.140777+0000","last_active":"2024-01-20T08:13:40.143290+0000","last_peered":"2024-01-20T08:13:40.143290+0000","last_clean":"2024-01-20T08:13:40.143290+0000","last_became_active":"2024-01-20T08:13:40.140148+0000","last_became_peered":"2024-01-20T08:13:40.140148+0000","last_unstale":"2024-01-20T08:13:40.143290+0000","last_undegraded":"2024-01-20T08:13:40.143290+0000","last_fullsized":"2024-01-20T08:13:40.143290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110747+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:39.110747+0000","last_peered":"2024-01-20T08:13:39.110747+0000","last_clean":"2024-01-20T08:13:39.110747+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:39.110747+0000","last_undegraded":"2024-01-20T08:13:39.110747+0000","last_fullsized":"2024-01-20T08:13:39.110747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102651+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:39.102651+0000","last_peered":"2024-01-20T08:13:39.102651+0000","last_clean":"2024-01-20T08:13:39.102651+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:39.102651+0000","last_undegraded":"2024-01-20T08:13:39.102651+0000","last_fullsized":"2024-01-20T08:13:39.102651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118629+0000","last_change":"2024-01-20T08:13:40.118629+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118629+0000","last_undegraded":"2024-01-20T08:13:40.118629+0000","last_fullsized":"2024-01-20T08:13:40.118629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137159+0000","last_change":"2024-01-20T08:13:40.134139+0000","last_active":"2024-01-20T08:13:40.137159+0000","last_peered":"2024-01-20T08:13:40.137159+0000","last_clean":"2024-01-20T08:13:40.137159+0000","last_became_active":"2024-01-20T08:13:40.133632+0000","last_became_peered":"2024-01-20T08:13:40.133632+0000","last_unstale":"2024-01-20T08:13:40.137159+0000","last_undegraded":"2024-01-20T08:13:40.137159+0000","last_fullsized":"2024-01-20T08:13:40.137159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:29.810188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103924+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:39.103924+0000","last_peered":"2024-01-20T08:13:39.103924+0000","last_clean":"2024-01-20T08:13:39.103924+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:39.103924+0000","last_undegraded":"2024-01-20T08:13:39.103924+0000","last_fullsized":"2024-01-20T08:13:39.103924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102513+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:39.102513+0000","last_peered":"2024-01-20T08:13:39.102513+0000","last_clean":"2024-01-20T08:13:39.102513+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:39.102513+0000","last_undegraded":"2024-01-20T08:13:39.102513+0000","last_fullsized":"2024-01-20T08:13:39.102513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115669+0000","last_change":"2024-01-20T08:13:40.115669+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115669+0000","last_undegraded":"2024-01-20T08:13:40.115669+0000","last_fullsized":"2024-01-20T08:13:40.115669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142460+0000","last_change":"2024-01-20T08:13:40.141034+0000","last_active":"2024-01-20T08:13:40.142460+0000","last_peered":"2024-01-20T08:13:40.142460+0000","last_clean":"2024-01-20T08:13:40.142460+0000","last_became_active":"2024-01-20T08:13:40.140116+0000","last_became_peered":"2024-01-20T08:13:40.140116+0000","last_unstale":"2024-01-20T08:13:40.142460+0000","last_undegraded":"2024-01-20T08:13:40.142460+0000","last_fullsized":"2024-01-20T08:13:40.142460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:48:54.354251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113825+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:39.113825+0000","last_peered":"2024-01-20T08:13:39.113825+0000","last_clean":"2024-01-20T08:13:39.113825+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:39.113825+0000","last_undegraded":"2024-01-20T08:13:39.113825+0000","last_fullsized":"2024-01-20T08:13:39.113825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119771+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:39.119771+0000","last_peered":"2024-01-20T08:13:39.119771+0000","last_clean":"2024-01-20T08:13:39.119771+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:39.119771+0000","last_undegraded":"2024-01-20T08:13:39.119771+0000","last_fullsized":"2024-01-20T08:13:39.119771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.111329+0000","last_change":"2024-01-20T08:13:40.111329+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.111329+0000","last_undegraded":"2024-01-20T08:13:40.111329+0000","last_fullsized":"2024-01-20T08:13:40.111329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142906+0000","last_change":"2024-01-20T08:13:40.138670+0000","last_active":"2024-01-20T08:13:40.142906+0000","last_peered":"2024-01-20T08:13:40.142906+0000","last_clean":"2024-01-20T08:13:40.142906+0000","last_became_active":"2024-01-20T08:13:40.138225+0000","last_became_peered":"2024-01-20T08:13:40.138225+0000","last_unstale":"2024-01-20T08:13:40.142906+0000","last_undegraded":"2024-01-20T08:13:40.142906+0000","last_fullsized":"2024-01-20T08:13:40.142906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:31.079661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119512+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:39.119512+0000","last_peered":"2024-01-20T08:13:39.119512+0000","last_clean":"2024-01-20T08:13:39.119512+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:39.119512+0000","last_undegraded":"2024-01-20T08:13:39.119512+0000","last_fullsized":"2024-01-20T08:13:39.119512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119392+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:39.119392+0000","last_peered":"2024-01-20T08:13:39.119392+0000","last_clean":"2024-01-20T08:13:39.119392+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:39.119392+0000","last_undegraded":"2024-01-20T08:13:39.119392+0000","last_fullsized":"2024-01-20T08:13:39.119392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113950+0000","last_change":"2024-01-20T08:13:40.113950+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113950+0000","last_undegraded":"2024-01-20T08:13:40.113950+0000","last_fullsized":"2024-01-20T08:13:40.113950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142864+0000","last_change":"2024-01-20T08:13:40.138470+0000","last_active":"2024-01-20T08:13:40.142864+0000","last_peered":"2024-01-20T08:13:40.142864+0000","last_clean":"2024-01-20T08:13:40.142864+0000","last_became_active":"2024-01-20T08:13:40.138199+0000","last_became_peered":"2024-01-20T08:13:40.138199+0000","last_unstale":"2024-01-20T08:13:40.142864+0000","last_undegraded":"2024-01-20T08:13:40.142864+0000","last_fullsized":"2024-01-20T08:13:40.142864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:28.806346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102391+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:39.102391+0000","last_peered":"2024-01-20T08:13:39.102391+0000","last_clean":"2024-01-20T08:13:39.102391+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:39.102391+0000","last_undegraded":"2024-01-20T08:13:39.102391+0000","last_fullsized":"2024-01-20T08:13:39.102391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103156+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:39.103156+0000","last_peered":"2024-01-20T08:13:39.103156+0000","last_clean":"2024-01-20T08:13:39.103156+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:39.103156+0000","last_undegraded":"2024-01-20T08:13:39.103156+0000","last_fullsized":"2024-01-20T08:13:39.103156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126904+0000","last_change":"2024-01-20T08:13:40.126904+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126904+0000","last_undegraded":"2024-01-20T08:13:40.126904+0000","last_fullsized":"2024-01-20T08:13:40.126904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136784+0000","last_change":"2024-01-20T08:13:40.129368+0000","last_active":"2024-01-20T08:13:40.136784+0000","last_peered":"2024-01-20T08:13:40.136784+0000","last_clean":"2024-01-20T08:13:40.136784+0000","last_became_active":"2024-01-20T08:13:40.129051+0000","last_became_peered":"2024-01-20T08:13:40.129051+0000","last_unstale":"2024-01-20T08:13:40.136784+0000","last_undegraded":"2024-01-20T08:13:40.136784+0000","last_fullsized":"2024-01-20T08:13:40.136784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109983+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:39.109983+0000","last_peered":"2024-01-20T08:13:39.109983+0000","last_clean":"2024-01-20T08:13:39.109983+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:39.109983+0000","last_undegraded":"2024-01-20T08:13:39.109983+0000","last_fullsized":"2024-01-20T08:13:39.109983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112971+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:39.112971+0000","last_peered":"2024-01-20T08:13:39.112971+0000","last_clean":"2024-01-20T08:13:39.112971+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:39.112971+0000","last_undegraded":"2024-01-20T08:13:39.112971+0000","last_fullsized":"2024-01-20T08:13:39.112971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128740+0000","last_change":"2024-01-20T08:13:40.128740+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128740+0000","last_undegraded":"2024-01-20T08:13:40.128740+0000","last_fullsized":"2024-01-20T08:13:40.128740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142554+0000","last_change":"2024-01-20T08:13:40.141046+0000","last_active":"2024-01-20T08:13:40.142554+0000","last_peered":"2024-01-20T08:13:40.142554+0000","last_clean":"2024-01-20T08:13:40.142554+0000","last_became_active":"2024-01-20T08:13:40.140753+0000","last_became_peered":"2024-01-20T08:13:40.140753+0000","last_unstale":"2024-01-20T08:13:40.142554+0000","last_undegraded":"2024-01-20T08:13:40.142554+0000","last_fullsized":"2024-01-20T08:13:40.142554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113375+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:39.113375+0000","last_peered":"2024-01-20T08:13:39.113375+0000","last_clean":"2024-01-20T08:13:39.113375+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:39.113375+0000","last_undegraded":"2024-01-20T08:13:39.113375+0000","last_fullsized":"2024-01-20T08:13:39.113375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112006+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:39.112006+0000","last_peered":"2024-01-20T08:13:39.112006+0000","last_clean":"2024-01-20T08:13:39.112006+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:39.112006+0000","last_undegraded":"2024-01-20T08:13:39.112006+0000","last_fullsized":"2024-01-20T08:13:39.112006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127813+0000","last_change":"2024-01-20T08:13:40.127813+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127813+0000","last_undegraded":"2024-01-20T08:13:40.127813+0000","last_fullsized":"2024-01-20T08:13:40.127813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142007+0000","last_change":"2024-01-20T08:13:40.139406+0000","last_active":"2024-01-20T08:13:40.142007+0000","last_peered":"2024-01-20T08:13:40.142007+0000","last_clean":"2024-01-20T08:13:40.142007+0000","last_became_active":"2024-01-20T08:13:40.139147+0000","last_became_peered":"2024-01-20T08:13:40.139147+0000","last_unstale":"2024-01-20T08:13:40.142007+0000","last_undegraded":"2024-01-20T08:13:40.142007+0000","last_fullsized":"2024-01-20T08:13:40.142007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118859+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:39.118859+0000","last_peered":"2024-01-20T08:13:39.118859+0000","last_clean":"2024-01-20T08:13:39.118859+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:39.118859+0000","last_undegraded":"2024-01-20T08:13:39.118859+0000","last_fullsized":"2024-01-20T08:13:39.118859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111115+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:39.111115+0000","last_peered":"2024-01-20T08:13:39.111115+0000","last_clean":"2024-01-20T08:13:39.111115+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:39.111115+0000","last_undegraded":"2024-01-20T08:13:39.111115+0000","last_fullsized":"2024-01-20T08:13:39.111115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117535+0000","last_change":"2024-01-20T08:13:40.117535+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117535+0000","last_undegraded":"2024-01-20T08:13:40.117535+0000","last_fullsized":"2024-01-20T08:13:40.117535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137874+0000","last_change":"2024-01-20T08:13:40.135173+0000","last_active":"2024-01-20T08:13:40.137874+0000","last_peered":"2024-01-20T08:13:40.137874+0000","last_clean":"2024-01-20T08:13:40.137874+0000","last_became_active":"2024-01-20T08:13:40.134749+0000","last_became_peered":"2024-01-20T08:13:40.134749+0000","last_unstale":"2024-01-20T08:13:40.137874+0000","last_undegraded":"2024-01-20T08:13:40.137874+0000","last_fullsized":"2024-01-20T08:13:40.137874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:26.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102483+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:39.102483+0000","last_peered":"2024-01-20T08:13:39.102483+0000","last_clean":"2024-01-20T08:13:39.102483+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:39.102483+0000","last_undegraded":"2024-01-20T08:13:39.102483+0000","last_fullsized":"2024-01-20T08:13:39.102483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109714+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:39.109714+0000","last_peered":"2024-01-20T08:13:39.109714+0000","last_clean":"2024-01-20T08:13:39.109714+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:39.109714+0000","last_undegraded":"2024-01-20T08:13:39.109714+0000","last_fullsized":"2024-01-20T08:13:39.109714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112325+0000","last_change":"2024-01-20T08:13:40.112325+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112325+0000","last_undegraded":"2024-01-20T08:13:40.112325+0000","last_fullsized":"2024-01-20T08:13:40.112325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143620+0000","last_change":"2024-01-20T08:13:40.140385+0000","last_active":"2024-01-20T08:13:40.143620+0000","last_peered":"2024-01-20T08:13:40.143620+0000","last_clean":"2024-01-20T08:13:40.143620+0000","last_became_active":"2024-01-20T08:13:40.140136+0000","last_became_peered":"2024-01-20T08:13:40.140136+0000","last_unstale":"2024-01-20T08:13:40.143620+0000","last_undegraded":"2024-01-20T08:13:40.143620+0000","last_fullsized":"2024-01-20T08:13:40.143620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:50.287743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119990+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:39.119990+0000","last_peered":"2024-01-20T08:13:39.119990+0000","last_clean":"2024-01-20T08:13:39.119990+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:39.119990+0000","last_undegraded":"2024-01-20T08:13:39.119990+0000","last_fullsized":"2024-01-20T08:13:39.119990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"72'9","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116753+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:39.116753+0000","last_peered":"2024-01-20T08:13:39.116753+0000","last_clean":"2024-01-20T08:13:39.116753+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:39.116753+0000","last_undegraded":"2024-01-20T08:13:39.116753+0000","last_fullsized":"2024-01-20T08:13:39.116753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110828+0000","last_change":"2024-01-20T08:13:40.110828+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110828+0000","last_undegraded":"2024-01-20T08:13:40.110828+0000","last_fullsized":"2024-01-20T08:13:40.110828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141981+0000","last_change":"2024-01-20T08:13:40.138835+0000","last_active":"2024-01-20T08:13:40.141981+0000","last_peered":"2024-01-20T08:13:40.141981+0000","last_clean":"2024-01-20T08:13:40.141981+0000","last_became_active":"2024-01-20T08:13:40.138570+0000","last_became_peered":"2024-01-20T08:13:40.138570+0000","last_unstale":"2024-01-20T08:13:40.141981+0000","last_undegraded":"2024-01-20T08:13:40.141981+0000","last_fullsized":"2024-01-20T08:13:40.141981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103072+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:39.103072+0000","last_peered":"2024-01-20T08:13:39.103072+0000","last_clean":"2024-01-20T08:13:39.103072+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:39.103072+0000","last_undegraded":"2024-01-20T08:13:39.103072+0000","last_fullsized":"2024-01-20T08:13:39.103072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113766+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:39.113766+0000","last_peered":"2024-01-20T08:13:39.113766+0000","last_clean":"2024-01-20T08:13:39.113766+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:39.113766+0000","last_undegraded":"2024-01-20T08:13:39.113766+0000","last_fullsized":"2024-01-20T08:13:39.113766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119826+0000","last_change":"2024-01-20T08:13:40.119826+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119826+0000","last_undegraded":"2024-01-20T08:13:40.119826+0000","last_fullsized":"2024-01-20T08:13:40.119826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137609+0000","last_change":"2024-01-20T08:13:40.134405+0000","last_active":"2024-01-20T08:13:40.137609+0000","last_peered":"2024-01-20T08:13:40.137609+0000","last_clean":"2024-01-20T08:13:40.137609+0000","last_became_active":"2024-01-20T08:13:40.134151+0000","last_became_peered":"2024-01-20T08:13:40.134151+0000","last_unstale":"2024-01-20T08:13:40.137609+0000","last_undegraded":"2024-01-20T08:13:40.137609+0000","last_fullsized":"2024-01-20T08:13:40.137609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:15:13.377556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103139+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:39.103139+0000","last_peered":"2024-01-20T08:13:39.103139+0000","last_clean":"2024-01-20T08:13:39.103139+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:39.103139+0000","last_undegraded":"2024-01-20T08:13:39.103139+0000","last_fullsized":"2024-01-20T08:13:39.103139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109723+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:39.109723+0000","last_peered":"2024-01-20T08:13:39.109723+0000","last_clean":"2024-01-20T08:13:39.109723+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:39.109723+0000","last_undegraded":"2024-01-20T08:13:39.109723+0000","last_fullsized":"2024-01-20T08:13:39.109723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119603+0000","last_change":"2024-01-20T08:13:40.119603+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119603+0000","last_undegraded":"2024-01-20T08:13:40.119603+0000","last_fullsized":"2024-01-20T08:13:40.119603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136384+0000","last_change":"2024-01-20T08:13:40.131252+0000","last_active":"2024-01-20T08:13:40.136384+0000","last_peered":"2024-01-20T08:13:40.136384+0000","last_clean":"2024-01-20T08:13:40.136384+0000","last_became_active":"2024-01-20T08:13:40.130235+0000","last_became_peered":"2024-01-20T08:13:40.130235+0000","last_unstale":"2024-01-20T08:13:40.136384+0000","last_undegraded":"2024-01-20T08:13:40.136384+0000","last_fullsized":"2024-01-20T08:13:40.136384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:12.348000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112931+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:39.112931+0000","last_peered":"2024-01-20T08:13:39.112931+0000","last_clean":"2024-01-20T08:13:39.112931+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:39.112931+0000","last_undegraded":"2024-01-20T08:13:39.112931+0000","last_fullsized":"2024-01-20T08:13:39.112931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115255+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:39.115255+0000","last_peered":"2024-01-20T08:13:39.115255+0000","last_clean":"2024-01-20T08:13:39.115255+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:39.115255+0000","last_undegraded":"2024-01-20T08:13:39.115255+0000","last_fullsized":"2024-01-20T08:13:39.115255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116751+0000","last_change":"2024-01-20T08:13:40.116751+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116751+0000","last_undegraded":"2024-01-20T08:13:40.116751+0000","last_fullsized":"2024-01-20T08:13:40.116751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132386+0000","last_change":"2024-01-20T08:13:40.124952+0000","last_active":"2024-01-20T08:13:40.132386+0000","last_peered":"2024-01-20T08:13:40.132386+0000","last_clean":"2024-01-20T08:13:40.132386+0000","last_became_active":"2024-01-20T08:13:40.124408+0000","last_became_peered":"2024-01-20T08:13:40.124408+0000","last_unstale":"2024-01-20T08:13:40.132386+0000","last_undegraded":"2024-01-20T08:13:40.132386+0000","last_fullsized":"2024-01-20T08:13:40.132386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:24.693203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113095+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:39.113095+0000","last_peered":"2024-01-20T08:13:39.113095+0000","last_clean":"2024-01-20T08:13:39.113095+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:39.113095+0000","last_undegraded":"2024-01-20T08:13:39.113095+0000","last_fullsized":"2024-01-20T08:13:39.113095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102137+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:39.102137+0000","last_peered":"2024-01-20T08:13:39.102137+0000","last_clean":"2024-01-20T08:13:39.102137+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:39.102137+0000","last_undegraded":"2024-01-20T08:13:39.102137+0000","last_fullsized":"2024-01-20T08:13:39.102137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141565+0000","last_change":"2024-01-20T08:13:40.137508+0000","last_active":"2024-01-20T08:13:40.141565+0000","last_peered":"2024-01-20T08:13:40.141565+0000","last_clean":"2024-01-20T08:13:40.141565+0000","last_became_active":"2024-01-20T08:13:40.137164+0000","last_became_peered":"2024-01-20T08:13:40.137164+0000","last_unstale":"2024-01-20T08:13:40.141565+0000","last_undegraded":"2024-01-20T08:13:40.141565+0000","last_fullsized":"2024-01-20T08:13:40.141565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105715+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:39.105715+0000","last_peered":"2024-01-20T08:13:39.105715+0000","last_clean":"2024-01-20T08:13:39.105715+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:39.105715+0000","last_undegraded":"2024-01-20T08:13:39.105715+0000","last_fullsized":"2024-01-20T08:13:39.105715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112445+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:39.112445+0000","last_peered":"2024-01-20T08:13:39.112445+0000","last_clean":"2024-01-20T08:13:39.112445+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:39.112445+0000","last_undegraded":"2024-01-20T08:13:39.112445+0000","last_fullsized":"2024-01-20T08:13:39.112445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127354+0000","last_change":"2024-01-20T08:13:40.127354+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127354+0000","last_undegraded":"2024-01-20T08:13:40.127354+0000","last_fullsized":"2024-01-20T08:13:40.127354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139223+0000","last_change":"2024-01-20T08:13:40.132877+0000","last_active":"2024-01-20T08:13:40.139223+0000","last_peered":"2024-01-20T08:13:40.139223+0000","last_clean":"2024-01-20T08:13:40.139223+0000","last_became_active":"2024-01-20T08:13:40.132593+0000","last_became_peered":"2024-01-20T08:13:40.132593+0000","last_unstale":"2024-01-20T08:13:40.139223+0000","last_undegraded":"2024-01-20T08:13:40.139223+0000","last_fullsized":"2024-01-20T08:13:40.139223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:11.124723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111745+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:39.111745+0000","last_peered":"2024-01-20T08:13:39.111745+0000","last_clean":"2024-01-20T08:13:39.111745+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:39.111745+0000","last_undegraded":"2024-01-20T08:13:39.111745+0000","last_fullsized":"2024-01-20T08:13:39.111745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102808+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:39.102808+0000","last_peered":"2024-01-20T08:13:39.102808+0000","last_clean":"2024-01-20T08:13:39.102808+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:39.102808+0000","last_undegraded":"2024-01-20T08:13:39.102808+0000","last_fullsized":"2024-01-20T08:13:39.102808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121382+0000","last_change":"2024-01-20T08:13:40.121382+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121382+0000","last_undegraded":"2024-01-20T08:13:40.121382+0000","last_fullsized":"2024-01-20T08:13:40.121382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139974+0000","last_change":"2024-01-20T08:13:40.134188+0000","last_active":"2024-01-20T08:13:40.139974+0000","last_peered":"2024-01-20T08:13:40.139974+0000","last_clean":"2024-01-20T08:13:40.139974+0000","last_became_active":"2024-01-20T08:13:40.132998+0000","last_became_peered":"2024-01-20T08:13:40.132998+0000","last_unstale":"2024-01-20T08:13:40.139974+0000","last_undegraded":"2024-01-20T08:13:40.139974+0000","last_fullsized":"2024-01-20T08:13:40.139974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120002+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:39.120002+0000","last_peered":"2024-01-20T08:13:39.120002+0000","last_clean":"2024-01-20T08:13:39.120002+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:39.120002+0000","last_undegraded":"2024-01-20T08:13:39.120002+0000","last_fullsized":"2024-01-20T08:13:39.120002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102597+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:39.102597+0000","last_peered":"2024-01-20T08:13:39.102597+0000","last_clean":"2024-01-20T08:13:39.102597+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:39.102597+0000","last_undegraded":"2024-01-20T08:13:39.102597+0000","last_fullsized":"2024-01-20T08:13:39.102597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110820+0000","last_change":"2024-01-20T08:13:40.110820+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110820+0000","last_undegraded":"2024-01-20T08:13:40.110820+0000","last_fullsized":"2024-01-20T08:13:40.110820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140515+0000","last_change":"2024-01-20T08:13:40.136860+0000","last_active":"2024-01-20T08:13:40.140515+0000","last_peered":"2024-01-20T08:13:40.140515+0000","last_clean":"2024-01-20T08:13:40.140515+0000","last_became_active":"2024-01-20T08:13:40.136501+0000","last_became_peered":"2024-01-20T08:13:40.136501+0000","last_unstale":"2024-01-20T08:13:40.140515+0000","last_undegraded":"2024-01-20T08:13:40.140515+0000","last_fullsized":"2024-01-20T08:13:40.140515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:38.500847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111361+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:39.111361+0000","last_peered":"2024-01-20T08:13:39.111361+0000","last_clean":"2024-01-20T08:13:39.111361+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:39.111361+0000","last_undegraded":"2024-01-20T08:13:39.111361+0000","last_fullsized":"2024-01-20T08:13:39.111361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112320+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:39.112320+0000","last_peered":"2024-01-20T08:13:39.112320+0000","last_clean":"2024-01-20T08:13:39.112320+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:39.112320+0000","last_undegraded":"2024-01-20T08:13:39.112320+0000","last_fullsized":"2024-01-20T08:13:39.112320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.129421+0000","last_change":"2024-01-20T08:13:40.129421+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.129421+0000","last_undegraded":"2024-01-20T08:13:40.129421+0000","last_fullsized":"2024-01-20T08:13:40.129421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132463+0000","last_change":"2024-01-20T08:13:40.126858+0000","last_active":"2024-01-20T08:13:40.132463+0000","last_peered":"2024-01-20T08:13:40.132463+0000","last_clean":"2024-01-20T08:13:40.132463+0000","last_became_active":"2024-01-20T08:13:40.124427+0000","last_became_peered":"2024-01-20T08:13:40.124427+0000","last_unstale":"2024-01-20T08:13:40.132463+0000","last_undegraded":"2024-01-20T08:13:40.132463+0000","last_fullsized":"2024-01-20T08:13:40.132463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116307+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:39.116307+0000","last_peered":"2024-01-20T08:13:39.116307+0000","last_clean":"2024-01-20T08:13:39.116307+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:39.116307+0000","last_undegraded":"2024-01-20T08:13:39.116307+0000","last_fullsized":"2024-01-20T08:13:39.116307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113354+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:39.113354+0000","last_peered":"2024-01-20T08:13:39.113354+0000","last_clean":"2024-01-20T08:13:39.113354+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:39.113354+0000","last_undegraded":"2024-01-20T08:13:39.113354+0000","last_fullsized":"2024-01-20T08:13:39.113354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116053+0000","last_change":"2024-01-20T08:13:40.116053+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116053+0000","last_undegraded":"2024-01-20T08:13:40.116053+0000","last_fullsized":"2024-01-20T08:13:40.116053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.130723+0000","last_change":"2024-01-20T08:13:40.123835+0000","last_active":"2024-01-20T08:13:40.130723+0000","last_peered":"2024-01-20T08:13:40.130723+0000","last_clean":"2024-01-20T08:13:40.130723+0000","last_became_active":"2024-01-20T08:13:40.123558+0000","last_became_peered":"2024-01-20T08:13:40.123558+0000","last_unstale":"2024-01-20T08:13:40.130723+0000","last_undegraded":"2024-01-20T08:13:40.130723+0000","last_fullsized":"2024-01-20T08:13:40.130723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109710+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:39.109710+0000","last_peered":"2024-01-20T08:13:39.109710+0000","last_clean":"2024-01-20T08:13:39.109710+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:39.109710+0000","last_undegraded":"2024-01-20T08:13:39.109710+0000","last_fullsized":"2024-01-20T08:13:39.109710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110352+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:39.110352+0000","last_peered":"2024-01-20T08:13:39.110352+0000","last_clean":"2024-01-20T08:13:39.110352+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:39.110352+0000","last_undegraded":"2024-01-20T08:13:39.110352+0000","last_fullsized":"2024-01-20T08:13:39.110352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116227+0000","last_change":"2024-01-20T08:13:40.116227+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116227+0000","last_undegraded":"2024-01-20T08:13:40.116227+0000","last_fullsized":"2024-01-20T08:13:40.116227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.134322+0000","last_change":"2024-01-20T08:13:40.128760+0000","last_active":"2024-01-20T08:13:40.134322+0000","last_peered":"2024-01-20T08:13:40.134322+0000","last_clean":"2024-01-20T08:13:40.134322+0000","last_became_active":"2024-01-20T08:13:40.128395+0000","last_became_peered":"2024-01-20T08:13:40.128395+0000","last_unstale":"2024-01-20T08:13:40.134322+0000","last_undegraded":"2024-01-20T08:13:40.134322+0000","last_fullsized":"2024-01-20T08:13:40.134322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:04:06.168521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115047+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:39.115047+0000","last_peered":"2024-01-20T08:13:39.115047+0000","last_clean":"2024-01-20T08:13:39.115047+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:39.115047+0000","last_undegraded":"2024-01-20T08:13:39.115047+0000","last_fullsized":"2024-01-20T08:13:39.115047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110250+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:39.110250+0000","last_peered":"2024-01-20T08:13:39.110250+0000","last_clean":"2024-01-20T08:13:39.110250+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:39.110250+0000","last_undegraded":"2024-01-20T08:13:39.110250+0000","last_fullsized":"2024-01-20T08:13:39.110250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116220+0000","last_change":"2024-01-20T08:13:40.116220+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116220+0000","last_undegraded":"2024-01-20T08:13:40.116220+0000","last_fullsized":"2024-01-20T08:13:40.116220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139243+0000","last_change":"2024-01-20T08:13:40.131748+0000","last_active":"2024-01-20T08:13:40.139243+0000","last_peered":"2024-01-20T08:13:40.139243+0000","last_clean":"2024-01-20T08:13:40.139243+0000","last_became_active":"2024-01-20T08:13:40.131502+0000","last_became_peered":"2024-01-20T08:13:40.131502+0000","last_unstale":"2024-01-20T08:13:40.139243+0000","last_undegraded":"2024-01-20T08:13:40.139243+0000","last_fullsized":"2024-01-20T08:13:40.139243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120282+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:39.120282+0000","last_peered":"2024-01-20T08:13:39.120282+0000","last_clean":"2024-01-20T08:13:39.120282+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:39.120282+0000","last_undegraded":"2024-01-20T08:13:39.120282+0000","last_fullsized":"2024-01-20T08:13:39.120282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115494+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:39.115494+0000","last_peered":"2024-01-20T08:13:39.115494+0000","last_clean":"2024-01-20T08:13:39.115494+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:39.115494+0000","last_undegraded":"2024-01-20T08:13:39.115494+0000","last_fullsized":"2024-01-20T08:13:39.115494+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125586+0000","last_change":"2024-01-20T08:13:40.125586+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125586+0000","last_undegraded":"2024-01-20T08:13:40.125586+0000","last_fullsized":"2024-01-20T08:13:40.125586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139913+0000","last_change":"2024-01-20T08:13:40.136610+0000","last_active":"2024-01-20T08:13:40.139913+0000","last_peered":"2024-01-20T08:13:40.139913+0000","last_clean":"2024-01-20T08:13:40.139913+0000","last_became_active":"2024-01-20T08:13:40.135965+0000","last_became_peered":"2024-01-20T08:13:40.135965+0000","last_unstale":"2024-01-20T08:13:40.139913+0000","last_undegraded":"2024-01-20T08:13:40.139913+0000","last_fullsized":"2024-01-20T08:13:40.139913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.106130+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:39.106130+0000","last_peered":"2024-01-20T08:13:39.106130+0000","last_clean":"2024-01-20T08:13:39.106130+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:39.106130+0000","last_undegraded":"2024-01-20T08:13:39.106130+0000","last_fullsized":"2024-01-20T08:13:39.106130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114981+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:39.114981+0000","last_peered":"2024-01-20T08:13:39.114981+0000","last_clean":"2024-01-20T08:13:39.114981+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:39.114981+0000","last_undegraded":"2024-01-20T08:13:39.114981+0000","last_fullsized":"2024-01-20T08:13:39.114981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116973+0000","last_change":"2024-01-20T08:13:40.116973+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116973+0000","last_undegraded":"2024-01-20T08:13:40.116973+0000","last_fullsized":"2024-01-20T08:13:40.116973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141253+0000","last_change":"2024-01-20T08:13:40.138153+0000","last_active":"2024-01-20T08:13:40.141253+0000","last_peered":"2024-01-20T08:13:40.141253+0000","last_clean":"2024-01-20T08:13:40.141253+0000","last_became_active":"2024-01-20T08:13:40.137489+0000","last_became_peered":"2024-01-20T08:13:40.137489+0000","last_unstale":"2024-01-20T08:13:40.141253+0000","last_undegraded":"2024-01-20T08:13:40.141253+0000","last_fullsized":"2024-01-20T08:13:40.141253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:58.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111008+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:39.111008+0000","last_peered":"2024-01-20T08:13:39.111008+0000","last_clean":"2024-01-20T08:13:39.111008+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:39.111008+0000","last_undegraded":"2024-01-20T08:13:39.111008+0000","last_fullsized":"2024-01-20T08:13:39.111008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110011+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:39.110011+0000","last_peered":"2024-01-20T08:13:39.110011+0000","last_clean":"2024-01-20T08:13:39.110011+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:39.110011+0000","last_undegraded":"2024-01-20T08:13:39.110011+0000","last_fullsized":"2024-01-20T08:13:39.110011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118595+0000","last_change":"2024-01-20T08:13:40.118595+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118595+0000","last_undegraded":"2024-01-20T08:13:40.118595+0000","last_fullsized":"2024-01-20T08:13:40.118595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139284+0000","last_change":"2024-01-20T08:13:40.135004+0000","last_active":"2024-01-20T08:13:40.139284+0000","last_peered":"2024-01-20T08:13:40.139284+0000","last_clean":"2024-01-20T08:13:40.139284+0000","last_became_active":"2024-01-20T08:13:40.132993+0000","last_became_peered":"2024-01-20T08:13:40.132993+0000","last_unstale":"2024-01-20T08:13:40.139284+0000","last_undegraded":"2024-01-20T08:13:40.139284+0000","last_fullsized":"2024-01-20T08:13:40.139284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:36.525486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120149+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:39.120149+0000","last_peered":"2024-01-20T08:13:39.120149+0000","last_clean":"2024-01-20T08:13:39.120149+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:39.120149+0000","last_undegraded":"2024-01-20T08:13:39.120149+0000","last_fullsized":"2024-01-20T08:13:39.120149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111251+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:39.111251+0000","last_peered":"2024-01-20T08:13:39.111251+0000","last_clean":"2024-01-20T08:13:39.111251+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:39.111251+0000","last_undegraded":"2024-01-20T08:13:39.111251+0000","last_fullsized":"2024-01-20T08:13:39.111251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.109850+0000","last_change":"2024-01-20T08:13:40.109850+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.109850+0000","last_undegraded":"2024-01-20T08:13:40.109850+0000","last_fullsized":"2024-01-20T08:13:40.109850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143546+0000","last_change":"2024-01-20T08:13:40.138887+0000","last_active":"2024-01-20T08:13:40.143546+0000","last_peered":"2024-01-20T08:13:40.143546+0000","last_clean":"2024-01-20T08:13:40.143546+0000","last_became_active":"2024-01-20T08:13:40.138591+0000","last_became_peered":"2024-01-20T08:13:40.138591+0000","last_unstale":"2024-01-20T08:13:40.143546+0000","last_undegraded":"2024-01-20T08:13:40.143546+0000","last_fullsized":"2024-01-20T08:13:40.143546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118082+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:39.118082+0000","last_peered":"2024-01-20T08:13:39.118082+0000","last_clean":"2024-01-20T08:13:39.118082+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:39.118082+0000","last_undegraded":"2024-01-20T08:13:39.118082+0000","last_fullsized":"2024-01-20T08:13:39.118082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102627+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:39.102627+0000","last_peered":"2024-01-20T08:13:39.102627+0000","last_clean":"2024-01-20T08:13:39.102627+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:39.102627+0000","last_undegraded":"2024-01-20T08:13:39.102627+0000","last_fullsized":"2024-01-20T08:13:39.102627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121559+0000","last_change":"2024-01-20T08:13:40.121559+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121559+0000","last_undegraded":"2024-01-20T08:13:40.121559+0000","last_fullsized":"2024-01-20T08:13:40.121559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.131963+0000","last_change":"2024-01-20T08:13:40.125670+0000","last_active":"2024-01-20T08:13:40.131963+0000","last_peered":"2024-01-20T08:13:40.131963+0000","last_clean":"2024-01-20T08:13:40.131963+0000","last_became_active":"2024-01-20T08:13:40.125414+0000","last_became_peered":"2024-01-20T08:13:40.125414+0000","last_unstale":"2024-01-20T08:13:40.131963+0000","last_undegraded":"2024-01-20T08:13:40.131963+0000","last_fullsized":"2024-01-20T08:13:40.131963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:56.786851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102265+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:39.102265+0000","last_peered":"2024-01-20T08:13:39.102265+0000","last_clean":"2024-01-20T08:13:39.102265+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:39.102265+0000","last_undegraded":"2024-01-20T08:13:39.102265+0000","last_fullsized":"2024-01-20T08:13:39.102265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119588+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:39.119588+0000","last_peered":"2024-01-20T08:13:39.119588+0000","last_clean":"2024-01-20T08:13:39.119588+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:39.119588+0000","last_undegraded":"2024-01-20T08:13:39.119588+0000","last_fullsized":"2024-01-20T08:13:39.119588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113404+0000","last_change":"2024-01-20T08:13:40.113404+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113404+0000","last_undegraded":"2024-01-20T08:13:40.113404+0000","last_fullsized":"2024-01-20T08:13:40.113404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142610+0000","last_change":"2024-01-20T08:13:40.140095+0000","last_active":"2024-01-20T08:13:40.142610+0000","last_peered":"2024-01-20T08:13:40.142610+0000","last_clean":"2024-01-20T08:13:40.142610+0000","last_became_active":"2024-01-20T08:13:40.139756+0000","last_became_peered":"2024-01-20T08:13:40.139756+0000","last_unstale":"2024-01-20T08:13:40.142610+0000","last_undegraded":"2024-01-20T08:13:40.142610+0000","last_fullsized":"2024-01-20T08:13:40.142610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:03:58.663879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102633+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:39.102633+0000","last_peered":"2024-01-20T08:13:39.102633+0000","last_clean":"2024-01-20T08:13:39.102633+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:39.102633+0000","last_undegraded":"2024-01-20T08:13:39.102633+0000","last_fullsized":"2024-01-20T08:13:39.102633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108947+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:39.108947+0000","last_peered":"2024-01-20T08:13:39.108947+0000","last_clean":"2024-01-20T08:13:39.108947+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:39.108947+0000","last_undegraded":"2024-01-20T08:13:39.108947+0000","last_fullsized":"2024-01-20T08:13:39.108947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112491+0000","last_change":"2024-01-20T08:13:40.112491+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112491+0000","last_undegraded":"2024-01-20T08:13:40.112491+0000","last_fullsized":"2024-01-20T08:13:40.112491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140001+0000","last_change":"2024-01-20T08:13:40.136793+0000","last_active":"2024-01-20T08:13:40.140001+0000","last_peered":"2024-01-20T08:13:40.140001+0000","last_clean":"2024-01-20T08:13:40.140001+0000","last_became_active":"2024-01-20T08:13:40.135303+0000","last_became_peered":"2024-01-20T08:13:40.135303+0000","last_unstale":"2024-01-20T08:13:40.140001+0000","last_undegraded":"2024-01-20T08:13:40.140001+0000","last_fullsized":"2024-01-20T08:13:40.140001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108788+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:39.108788+0000","last_peered":"2024-01-20T08:13:39.108788+0000","last_clean":"2024-01-20T08:13:39.108788+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:39.108788+0000","last_undegraded":"2024-01-20T08:13:39.108788+0000","last_fullsized":"2024-01-20T08:13:39.108788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119127+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:39.119127+0000","last_peered":"2024-01-20T08:13:39.119127+0000","last_clean":"2024-01-20T08:13:39.119127+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:39.119127+0000","last_undegraded":"2024-01-20T08:13:39.119127+0000","last_fullsized":"2024-01-20T08:13:39.119127+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118570+0000","last_change":"2024-01-20T08:13:40.118570+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118570+0000","last_undegraded":"2024-01-20T08:13:40.118570+0000","last_fullsized":"2024-01-20T08:13:40.118570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142233+0000","last_change":"2024-01-20T08:13:40.138906+0000","last_active":"2024-01-20T08:13:40.142233+0000","last_peered":"2024-01-20T08:13:40.142233+0000","last_clean":"2024-01-20T08:13:40.142233+0000","last_became_active":"2024-01-20T08:13:40.138512+0000","last_became_peered":"2024-01-20T08:13:40.138512+0000","last_unstale":"2024-01-20T08:13:40.142233+0000","last_undegraded":"2024-01-20T08:13:40.142233+0000","last_fullsized":"2024-01-20T08:13:40.142233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114484+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:39.114484+0000","last_peered":"2024-01-20T08:13:39.114484+0000","last_clean":"2024-01-20T08:13:39.114484+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:39.114484+0000","last_undegraded":"2024-01-20T08:13:39.114484+0000","last_fullsized":"2024-01-20T08:13:39.114484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.104132+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:39.104132+0000","last_peered":"2024-01-20T08:13:39.104132+0000","last_clean":"2024-01-20T08:13:39.104132+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:39.104132+0000","last_undegraded":"2024-01-20T08:13:39.104132+0000","last_fullsized":"2024-01-20T08:13:39.104132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102921+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:39.102921+0000","last_peered":"2024-01-20T08:13:39.102921+0000","last_clean":"2024-01-20T08:13:39.102921+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:39.102921+0000","last_undegraded":"2024-01-20T08:13:39.102921+0000","last_fullsized":"2024-01-20T08:13:39.102921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.153}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.123},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.577}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.3600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.2130000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.427}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.748},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.3919999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.49},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":400965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":0.754}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3899999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.167},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.353}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.46}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":396270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.387}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.482}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.357},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.032}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.419}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":400271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.873},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.0980000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.47}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.02},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.534}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.238},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.401},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.738}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":396248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.313},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.752},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.042}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":400853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.167}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.018},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":1.258}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.304},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":393335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.872}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.82499999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.234}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.157},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.3220000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.29},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.163},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.2769999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.075}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.018},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.7629999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.617},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.321}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.127}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.466},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.8320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:46.140 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.380+0000 7f9c90400640 1 Processor -- start 2024-01-20T08:13:46.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.380+0000 7f9c90400640 1 -- start start 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c90400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c90400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c880aae00 0x7f9c880ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c90400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c880a9940 con 0x7f9c880a93c0 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c90400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c881500c0 con 0x7f9c880aae00 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c90400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c88156810 con 0x7f9c8814fce0 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c8e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c880aae00 0x7f9c880ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c8e400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9c880aae00 0x7f9c880ab290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33456/0 (socket says 172.21.15.100:33456) 2024-01-20T08:13:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.382+0000 7f9c8e400640 1 -- 172.21.15.100:0/2000377918 learned_addr learned my addr 172.21.15.100:0/2000377918 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.383+0000 7f9c8da00640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.383+0000 7f9c8e400640 1 -- 172.21.15.100:0/2000377918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 msgr2=0x7f9c88153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.383+0000 7f9c8e400640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.383+0000 7f9c8e400640 1 -- 172.21.15.100:0/2000377918 >> v1:172.21.15.110:6789/0 conn(0x7f9c880a93c0 legacy=0x7f9c88152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.383+0000 7f9c8e400640 1 -- 172.21.15.100:0/2000377918 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c88156af0 con 0x7f9c880aae00 2024-01-20T08:13:46.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.384+0000 7f9c8e400640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c880ab290 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e50 tx=0x7f9c8002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39cb275029d84d5a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c87e00640 1 -- 172.21.15.100:0/2000377918 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8002cb00 con 0x7f9c880aae00 2024-01-20T08:13:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c87e00640 1 -- 172.21.15.100:0/2000377918 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8002cc60 con 0x7f9c880aae00 2024-01-20T08:13:46.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c87e00640 1 -- 172.21.15.100:0/2000377918 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800343f0 con 0x7f9c880aae00 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 -- 172.21.15.100:0/2000377918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 msgr2=0x7f9c880ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c880ab290 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f9c80009e50 tx=0x7f9c8002bf60 comp rx=0 tx=0).stop 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 -- 172.21.15.100:0/2000377918 shutdown_connections 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c880ab290 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 --2- 172.21.15.100:0/2000377918 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.385+0000 7f9c90400640 1 -- 172.21.15.100:0/2000377918 >> 172.21.15.100:0/2000377918 conn(0x7f9c8806a5e0 msgr2=0x7f9c8806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.386+0000 7f9c90400640 1 -- 172.21.15.100:0/2000377918 shutdown_connections 2024-01-20T08:13:46.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.386+0000 7f9c90400640 1 -- 172.21.15.100:0/2000377918 wait complete. 2024-01-20T08:13:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.387+0000 7f9c90400640 1 Processor -- start 2024-01-20T08:13:46.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.387+0000 7f9c90400640 1 -- start start 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c880a93c0 0x7f9c880c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88143c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c880c4220 con 0x7f9c880aae00 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881eddd0 con 0x7f9c880a93c0 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.388+0000 7f9c90400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c881ee0b0 con 0x7f9c8814fce0 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33464/0 (socket says 172.21.15.100:33464) 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 -- 172.21.15.100:0/3572865712 learned_addr learned my addr 172.21.15.100:0/3572865712 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8da00640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c880a93c0 0x7f9c880c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8e400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88143c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 -- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 msgr2=0x7f9c88143c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88143c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 -- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c880a93c0 msgr2=0x7f9c880c5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c880a93c0 0x7f9c880c5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 -- 172.21.15.100:0/3572865712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c80009b30 con 0x7f9c880aae00 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.389+0000 7f9c8d000640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c400 tx=0x7f9c7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.390+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700052d0 con 0x7f9c880aae00 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.390+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70005450 con 0x7f9c880aae00 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.390+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c70007260 con 0x7f9c880aae00 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.390+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c881ee390 con 0x7f9c880aae00 2024-01-20T08:13:46.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.390+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c881ee950 con 0x7f9c880aae00 2024-01-20T08:13:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.391+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c88073df0 con 0x7f9c880aae00 2024-01-20T08:13:46.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.392+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9c700073c0 con 0x7f9c880aae00 2024-01-20T08:13:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.393+0000 7f9c85600640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 0x7f9c6006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.393+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9c70088e40 con 0x7f9c880aae00 2024-01-20T08:13:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.393+0000 7f9c8da00640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 0x7f9c6006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.394+0000 7f9c8da00640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 0x7f9c6006d390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c78006fd0 tx=0x7f9c78008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.397+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9c70053910 con 0x7f9c880aae00 2024-01-20T08:13:46.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.585+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9c88152690 con 0x7f9c6006aed0 2024-01-20T08:13:46.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.623+0000 7f9c85600640 1 -- 172.21.15.100:0/3572865712 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519871 (secure 0 0 0) 0x7f9c7800f860 con 0x7f9c6006aed0 2024-01-20T08:13:46.632 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:46.638 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 msgr2=0x7f9c6006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 0x7f9c6006d390 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f9c78006fd0 tx=0x7f9c78008040 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 msgr2=0x7f9c881497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000c400 tx=0x7f9c7000c8c0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 shutdown_connections 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9c6006aed0 0x7f9c6006d390 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9c8814fce0 0x7f9c88143c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c880aae00 0x7f9c881497d0 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 --2- 172.21.15.100:0/3572865712 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9c880a93c0 0x7f9c880c5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 >> 172.21.15.100:0/3572865712 conn(0x7f9c8806a5e0 msgr2=0x7f9c8814dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.635+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 shutdown_connections 2024-01-20T08:13:46.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.636+0000 7f9c90400640 1 -- 172.21.15.100:0/3572865712 wait complete. 2024-01-20T08:13:46.662 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-01-20T08:13:45.956782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8292,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8491008,"data_stored":4369324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001921"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118584+0000","last_change":"2024-01-20T08:13:40.118584+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118584+0000","last_undegraded":"2024-01-20T08:13:40.118584+0000","last_fullsized":"2024-01-20T08:13:40.118584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111456+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:39.111456+0000","last_peered":"2024-01-20T08:13:39.111456+0000","last_clean":"2024-01-20T08:13:39.111456+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:39.111456+0000","last_undegraded":"2024-01-20T08:13:39.111456+0000","last_fullsized":"2024-01-20T08:13:39.111456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123276+0000","last_change":"2024-01-20T08:13:40.123276+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123276+0000","last_undegraded":"2024-01-20T08:13:40.123276+0000","last_fullsized":"2024-01-20T08:13:40.123276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114846+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:39.114846+0000","last_peered":"2024-01-20T08:13:39.114846+0000","last_clean":"2024-01-20T08:13:39.114846+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:39.114846+0000","last_undegraded":"2024-01-20T08:13:39.114846+0000","last_fullsized":"2024-01-20T08:13:39.114846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118942+0000","last_change":"2024-01-20T08:13:40.118942+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118942+0000","last_undegraded":"2024-01-20T08:13:40.118942+0000","last_fullsized":"2024-01-20T08:13:40.118942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103601+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:39.103601+0000","last_peered":"2024-01-20T08:13:39.103601+0000","last_clean":"2024-01-20T08:13:39.103601+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:39.103601+0000","last_undegraded":"2024-01-20T08:13:39.103601+0000","last_fullsized":"2024-01-20T08:13:39.103601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.114079+0000","last_change":"2024-01-20T08:13:40.114079+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.114079+0000","last_undegraded":"2024-01-20T08:13:40.114079+0000","last_fullsized":"2024-01-20T08:13:40.114079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112607+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:39.112607+0000","last_peered":"2024-01-20T08:13:39.112607+0000","last_clean":"2024-01-20T08:13:39.112607+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:39.112607+0000","last_undegraded":"2024-01-20T08:13:39.112607+0000","last_fullsized":"2024-01-20T08:13:39.112607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125859+0000","last_change":"2024-01-20T08:13:40.125859+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125859+0000","last_undegraded":"2024-01-20T08:13:40.125859+0000","last_fullsized":"2024-01-20T08:13:40.125859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119446+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:39.119446+0000","last_peered":"2024-01-20T08:13:39.119446+0000","last_clean":"2024-01-20T08:13:39.119446+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:39.119446+0000","last_undegraded":"2024-01-20T08:13:39.119446+0000","last_fullsized":"2024-01-20T08:13:39.119446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113241+0000","last_change":"2024-01-20T08:13:40.113241+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113241+0000","last_undegraded":"2024-01-20T08:13:40.113241+0000","last_fullsized":"2024-01-20T08:13:40.113241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.117857+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:39.117857+0000","last_peered":"2024-01-20T08:13:39.117857+0000","last_clean":"2024-01-20T08:13:39.117857+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:39.117857+0000","last_undegraded":"2024-01-20T08:13:39.117857+0000","last_fullsized":"2024-01-20T08:13:39.117857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125091+0000","last_change":"2024-01-20T08:13:40.125091+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125091+0000","last_undegraded":"2024-01-20T08:13:40.125091+0000","last_fullsized":"2024-01-20T08:13:40.125091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110212+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:39.110212+0000","last_peered":"2024-01-20T08:13:39.110212+0000","last_clean":"2024-01-20T08:13:39.110212+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:39.110212+0000","last_undegraded":"2024-01-20T08:13:39.110212+0000","last_fullsized":"2024-01-20T08:13:39.110212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.122263+0000","last_change":"2024-01-20T08:13:40.122263+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.122263+0000","last_undegraded":"2024-01-20T08:13:40.122263+0000","last_fullsized":"2024-01-20T08:13:40.122263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116243+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:39.116243+0000","last_peered":"2024-01-20T08:13:39.116243+0000","last_clean":"2024-01-20T08:13:39.116243+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:39.116243+0000","last_undegraded":"2024-01-20T08:13:39.116243+0000","last_fullsized":"2024-01-20T08:13:39.116243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128279+0000","last_change":"2024-01-20T08:13:40.128279+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128279+0000","last_undegraded":"2024-01-20T08:13:40.128279+0000","last_fullsized":"2024-01-20T08:13:40.128279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118816+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:39.118816+0000","last_peered":"2024-01-20T08:13:39.118816+0000","last_clean":"2024-01-20T08:13:39.118816+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:39.118816+0000","last_undegraded":"2024-01-20T08:13:39.118816+0000","last_fullsized":"2024-01-20T08:13:39.118816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113123+0000","last_change":"2024-01-20T08:13:40.113123+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113123+0000","last_undegraded":"2024-01-20T08:13:40.113123+0000","last_fullsized":"2024-01-20T08:13:40.113123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110889+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:39.110889+0000","last_peered":"2024-01-20T08:13:39.110889+0000","last_clean":"2024-01-20T08:13:39.110889+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:39.110889+0000","last_undegraded":"2024-01-20T08:13:39.110889+0000","last_fullsized":"2024-01-20T08:13:39.110889+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113777+0000","last_change":"2024-01-20T08:13:40.113777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113777+0000","last_undegraded":"2024-01-20T08:13:40.113777+0000","last_fullsized":"2024-01-20T08:13:40.113777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114346+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:39.114346+0000","last_peered":"2024-01-20T08:13:39.114346+0000","last_clean":"2024-01-20T08:13:39.114346+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:39.114346+0000","last_undegraded":"2024-01-20T08:13:39.114346+0000","last_fullsized":"2024-01-20T08:13:39.114346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119078+0000","last_change":"2024-01-20T08:13:40.119078+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119078+0000","last_undegraded":"2024-01-20T08:13:40.119078+0000","last_fullsized":"2024-01-20T08:13:40.119078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110189+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:39.110189+0000","last_peered":"2024-01-20T08:13:39.110189+0000","last_clean":"2024-01-20T08:13:39.110189+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:39.110189+0000","last_undegraded":"2024-01-20T08:13:39.110189+0000","last_fullsized":"2024-01-20T08:13:39.110189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123258+0000","last_change":"2024-01-20T08:13:40.123258+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123258+0000","last_undegraded":"2024-01-20T08:13:40.123258+0000","last_fullsized":"2024-01-20T08:13:40.123258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103069+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:39.103069+0000","last_peered":"2024-01-20T08:13:39.103069+0000","last_clean":"2024-01-20T08:13:39.103069+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:39.103069+0000","last_undegraded":"2024-01-20T08:13:39.103069+0000","last_fullsized":"2024-01-20T08:13:39.103069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.124661+0000","last_change":"2024-01-20T08:13:40.124661+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.124661+0000","last_undegraded":"2024-01-20T08:13:40.124661+0000","last_fullsized":"2024-01-20T08:13:40.124661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111206+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:39.111206+0000","last_peered":"2024-01-20T08:13:39.111206+0000","last_clean":"2024-01-20T08:13:39.111206+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:39.111206+0000","last_undegraded":"2024-01-20T08:13:39.111206+0000","last_fullsized":"2024-01-20T08:13:39.111206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118369+0000","last_change":"2024-01-20T08:13:40.118369+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118369+0000","last_undegraded":"2024-01-20T08:13:40.118369+0000","last_fullsized":"2024-01-20T08:13:40.118369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109905+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:39.109905+0000","last_peered":"2024-01-20T08:13:39.109905+0000","last_clean":"2024-01-20T08:13:39.109905+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:39.109905+0000","last_undegraded":"2024-01-20T08:13:39.109905+0000","last_fullsized":"2024-01-20T08:13:39.109905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120267+0000","last_change":"2024-01-20T08:13:40.120267+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120267+0000","last_undegraded":"2024-01-20T08:13:40.120267+0000","last_fullsized":"2024-01-20T08:13:40.120267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119099+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:39.119099+0000","last_peered":"2024-01-20T08:13:39.119099+0000","last_clean":"2024-01-20T08:13:39.119099+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:39.119099+0000","last_undegraded":"2024-01-20T08:13:39.119099+0000","last_fullsized":"2024-01-20T08:13:39.119099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118107+0000","last_change":"2024-01-20T08:13:40.118107+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118107+0000","last_undegraded":"2024-01-20T08:13:40.118107+0000","last_fullsized":"2024-01-20T08:13:40.118107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119911+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:39.119911+0000","last_peered":"2024-01-20T08:13:39.119911+0000","last_clean":"2024-01-20T08:13:39.119911+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:39.119911+0000","last_undegraded":"2024-01-20T08:13:39.119911+0000","last_fullsized":"2024-01-20T08:13:39.119911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112004+0000","last_change":"2024-01-20T08:13:40.112004+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112004+0000","last_undegraded":"2024-01-20T08:13:40.112004+0000","last_fullsized":"2024-01-20T08:13:40.112004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115407+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:39.115407+0000","last_peered":"2024-01-20T08:13:39.115407+0000","last_clean":"2024-01-20T08:13:39.115407+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:39.115407+0000","last_undegraded":"2024-01-20T08:13:39.115407+0000","last_fullsized":"2024-01-20T08:13:39.115407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113747+0000","last_change":"2024-01-20T08:13:40.113747+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113747+0000","last_undegraded":"2024-01-20T08:13:40.113747+0000","last_fullsized":"2024-01-20T08:13:40.113747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102437+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:39.102437+0000","last_peered":"2024-01-20T08:13:39.102437+0000","last_clean":"2024-01-20T08:13:39.102437+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:39.102437+0000","last_undegraded":"2024-01-20T08:13:39.102437+0000","last_fullsized":"2024-01-20T08:13:39.102437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118010+0000","last_change":"2024-01-20T08:13:40.118010+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118010+0000","last_undegraded":"2024-01-20T08:13:40.118010+0000","last_fullsized":"2024-01-20T08:13:40.118010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112780+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:39.112780+0000","last_peered":"2024-01-20T08:13:39.112780+0000","last_clean":"2024-01-20T08:13:39.112780+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:39.112780+0000","last_undegraded":"2024-01-20T08:13:39.112780+0000","last_fullsized":"2024-01-20T08:13:39.112780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112226+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:39.112226+0000","last_peered":"2024-01-20T08:13:39.112226+0000","last_clean":"2024-01-20T08:13:39.112226+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:39.112226+0000","last_undegraded":"2024-01-20T08:13:39.112226+0000","last_fullsized":"2024-01-20T08:13:39.112226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123643+0000","last_change":"2024-01-20T08:13:40.123643+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123643+0000","last_undegraded":"2024-01-20T08:13:40.123643+0000","last_fullsized":"2024-01-20T08:13:40.123643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114017+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:39.114017+0000","last_peered":"2024-01-20T08:13:39.114017+0000","last_clean":"2024-01-20T08:13:39.114017+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:39.114017+0000","last_undegraded":"2024-01-20T08:13:39.114017+0000","last_fullsized":"2024-01-20T08:13:39.114017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117525+0000","last_change":"2024-01-20T08:13:40.117525+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117525+0000","last_undegraded":"2024-01-20T08:13:40.117525+0000","last_fullsized":"2024-01-20T08:13:40.117525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108503+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:39.108503+0000","last_peered":"2024-01-20T08:13:39.108503+0000","last_clean":"2024-01-20T08:13:39.108503+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:39.108503+0000","last_undegraded":"2024-01-20T08:13:39.108503+0000","last_fullsized":"2024-01-20T08:13:39.108503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113839+0000","last_change":"2024-01-20T08:13:40.113839+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113839+0000","last_undegraded":"2024-01-20T08:13:40.113839+0000","last_fullsized":"2024-01-20T08:13:40.113839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109570+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:39.109570+0000","last_peered":"2024-01-20T08:13:39.109570+0000","last_clean":"2024-01-20T08:13:39.109570+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:39.109570+0000","last_undegraded":"2024-01-20T08:13:39.109570+0000","last_fullsized":"2024-01-20T08:13:39.109570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126896+0000","last_change":"2024-01-20T08:13:40.126896+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126896+0000","last_undegraded":"2024-01-20T08:13:40.126896+0000","last_fullsized":"2024-01-20T08:13:40.126896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115377+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:39.115377+0000","last_peered":"2024-01-20T08:13:39.115377+0000","last_clean":"2024-01-20T08:13:39.115377+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:39.115377+0000","last_undegraded":"2024-01-20T08:13:39.115377+0000","last_fullsized":"2024-01-20T08:13:39.115377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120314+0000","last_change":"2024-01-20T08:13:40.120314+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120314+0000","last_undegraded":"2024-01-20T08:13:40.120314+0000","last_fullsized":"2024-01-20T08:13:40.120314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105160+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:39.105160+0000","last_peered":"2024-01-20T08:13:39.105160+0000","last_clean":"2024-01-20T08:13:39.105160+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:39.105160+0000","last_undegraded":"2024-01-20T08:13:39.105160+0000","last_fullsized":"2024-01-20T08:13:39.105160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120673+0000","last_change":"2024-01-20T08:13:40.120673+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120673+0000","last_undegraded":"2024-01-20T08:13:40.120673+0000","last_fullsized":"2024-01-20T08:13:40.120673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119803+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:39.119803+0000","last_peered":"2024-01-20T08:13:39.119803+0000","last_clean":"2024-01-20T08:13:39.119803+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:39.119803+0000","last_undegraded":"2024-01-20T08:13:39.119803+0000","last_fullsized":"2024-01-20T08:13:39.119803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113518+0000","last_change":"2024-01-20T08:13:40.113518+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113518+0000","last_undegraded":"2024-01-20T08:13:40.113518+0000","last_fullsized":"2024-01-20T08:13:40.113518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110459+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:39.110459+0000","last_peered":"2024-01-20T08:13:39.110459+0000","last_clean":"2024-01-20T08:13:39.110459+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:39.110459+0000","last_undegraded":"2024-01-20T08:13:39.110459+0000","last_fullsized":"2024-01-20T08:13:39.110459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120384+0000","last_change":"2024-01-20T08:13:40.120384+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120384+0000","last_undegraded":"2024-01-20T08:13:40.120384+0000","last_fullsized":"2024-01-20T08:13:40.120384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113620+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:39.113620+0000","last_peered":"2024-01-20T08:13:39.113620+0000","last_clean":"2024-01-20T08:13:39.113620+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:39.113620+0000","last_undegraded":"2024-01-20T08:13:39.113620+0000","last_fullsized":"2024-01-20T08:13:39.113620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115829+0000","last_change":"2024-01-20T08:13:40.115829+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115829+0000","last_undegraded":"2024-01-20T08:13:40.115829+0000","last_fullsized":"2024-01-20T08:13:40.115829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113711+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:39.113711+0000","last_peered":"2024-01-20T08:13:39.113711+0000","last_clean":"2024-01-20T08:13:39.113711+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:39.113711+0000","last_undegraded":"2024-01-20T08:13:39.113711+0000","last_fullsized":"2024-01-20T08:13:39.113711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112697+0000","last_change":"2024-01-20T08:13:40.112697+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112697+0000","last_undegraded":"2024-01-20T08:13:40.112697+0000","last_fullsized":"2024-01-20T08:13:40.112697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119320+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:39.119320+0000","last_peered":"2024-01-20T08:13:39.119320+0000","last_clean":"2024-01-20T08:13:39.119320+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:39.119320+0000","last_undegraded":"2024-01-20T08:13:39.119320+0000","last_fullsized":"2024-01-20T08:13:39.119320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117245+0000","last_change":"2024-01-20T08:13:40.117245+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117245+0000","last_undegraded":"2024-01-20T08:13:40.117245+0000","last_fullsized":"2024-01-20T08:13:40.117245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.107896+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:39.107896+0000","last_peered":"2024-01-20T08:13:39.107896+0000","last_clean":"2024-01-20T08:13:39.107896+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:39.107896+0000","last_undegraded":"2024-01-20T08:13:39.107896+0000","last_fullsized":"2024-01-20T08:13:39.107896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116777+0000","last_change":"2024-01-20T08:13:40.116777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116777+0000","last_undegraded":"2024-01-20T08:13:40.116777+0000","last_fullsized":"2024-01-20T08:13:40.116777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136687+0000","last_change":"2024-01-20T08:13:40.129620+0000","last_active":"2024-01-20T08:13:40.136687+0000","last_peered":"2024-01-20T08:13:40.136687+0000","last_clean":"2024-01-20T08:13:40.136687+0000","last_became_active":"2024-01-20T08:13:40.129373+0000","last_became_peered":"2024-01-20T08:13:40.129373+0000","last_unstale":"2024-01-20T08:13:40.136687+0000","last_undegraded":"2024-01-20T08:13:40.136687+0000","last_fullsized":"2024-01-20T08:13:40.136687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120224+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:39.120224+0000","last_peered":"2024-01-20T08:13:39.120224+0000","last_clean":"2024-01-20T08:13:39.120224+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:39.120224+0000","last_undegraded":"2024-01-20T08:13:39.120224+0000","last_fullsized":"2024-01-20T08:13:39.120224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111817+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:39.111817+0000","last_peered":"2024-01-20T08:13:39.111817+0000","last_clean":"2024-01-20T08:13:39.111817+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:39.111817+0000","last_undegraded":"2024-01-20T08:13:39.111817+0000","last_fullsized":"2024-01-20T08:13:39.111817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113112+0000","last_change":"2024-01-20T08:13:40.113112+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113112+0000","last_undegraded":"2024-01-20T08:13:40.113112+0000","last_fullsized":"2024-01-20T08:13:40.113112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140960+0000","last_change":"2024-01-20T08:13:40.136955+0000","last_active":"2024-01-20T08:13:40.140960+0000","last_peered":"2024-01-20T08:13:40.140960+0000","last_clean":"2024-01-20T08:13:40.140960+0000","last_became_active":"2024-01-20T08:13:40.136627+0000","last_became_peered":"2024-01-20T08:13:40.136627+0000","last_unstale":"2024-01-20T08:13:40.140960+0000","last_undegraded":"2024-01-20T08:13:40.140960+0000","last_fullsized":"2024-01-20T08:13:40.140960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:58.292868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111524+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:39.111524+0000","last_peered":"2024-01-20T08:13:39.111524+0000","last_clean":"2024-01-20T08:13:39.111524+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:39.111524+0000","last_undegraded":"2024-01-20T08:13:39.111524+0000","last_fullsized":"2024-01-20T08:13:39.111524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120411+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:39.120411+0000","last_peered":"2024-01-20T08:13:39.120411+0000","last_clean":"2024-01-20T08:13:39.120411+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:39.120411+0000","last_undegraded":"2024-01-20T08:13:39.120411+0000","last_fullsized":"2024-01-20T08:13:39.120411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119163+0000","last_change":"2024-01-20T08:13:40.119163+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119163+0000","last_undegraded":"2024-01-20T08:13:40.119163+0000","last_fullsized":"2024-01-20T08:13:40.119163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143290+0000","last_change":"2024-01-20T08:13:40.140777+0000","last_active":"2024-01-20T08:13:40.143290+0000","last_peered":"2024-01-20T08:13:40.143290+0000","last_clean":"2024-01-20T08:13:40.143290+0000","last_became_active":"2024-01-20T08:13:40.140148+0000","last_became_peered":"2024-01-20T08:13:40.140148+0000","last_unstale":"2024-01-20T08:13:40.143290+0000","last_undegraded":"2024-01-20T08:13:40.143290+0000","last_fullsized":"2024-01-20T08:13:40.143290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110747+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:39.110747+0000","last_peered":"2024-01-20T08:13:39.110747+0000","last_clean":"2024-01-20T08:13:39.110747+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:39.110747+0000","last_undegraded":"2024-01-20T08:13:39.110747+0000","last_fullsized":"2024-01-20T08:13:39.110747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102651+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:39.102651+0000","last_peered":"2024-01-20T08:13:39.102651+0000","last_clean":"2024-01-20T08:13:39.102651+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:39.102651+0000","last_undegraded":"2024-01-20T08:13:39.102651+0000","last_fullsized":"2024-01-20T08:13:39.102651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118629+0000","last_change":"2024-01-20T08:13:40.118629+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118629+0000","last_undegraded":"2024-01-20T08:13:40.118629+0000","last_fullsized":"2024-01-20T08:13:40.118629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137159+0000","last_change":"2024-01-20T08:13:40.134139+0000","last_active":"2024-01-20T08:13:40.137159+0000","last_peered":"2024-01-20T08:13:40.137159+0000","last_clean":"2024-01-20T08:13:40.137159+0000","last_became_active":"2024-01-20T08:13:40.133632+0000","last_became_peered":"2024-01-20T08:13:40.133632+0000","last_unstale":"2024-01-20T08:13:40.137159+0000","last_undegraded":"2024-01-20T08:13:40.137159+0000","last_fullsized":"2024-01-20T08:13:40.137159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:29.810188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103924+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:39.103924+0000","last_peered":"2024-01-20T08:13:39.103924+0000","last_clean":"2024-01-20T08:13:39.103924+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:39.103924+0000","last_undegraded":"2024-01-20T08:13:39.103924+0000","last_fullsized":"2024-01-20T08:13:39.103924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102513+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:39.102513+0000","last_peered":"2024-01-20T08:13:39.102513+0000","last_clean":"2024-01-20T08:13:39.102513+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:39.102513+0000","last_undegraded":"2024-01-20T08:13:39.102513+0000","last_fullsized":"2024-01-20T08:13:39.102513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115669+0000","last_change":"2024-01-20T08:13:40.115669+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115669+0000","last_undegraded":"2024-01-20T08:13:40.115669+0000","last_fullsized":"2024-01-20T08:13:40.115669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142460+0000","last_change":"2024-01-20T08:13:40.141034+0000","last_active":"2024-01-20T08:13:40.142460+0000","last_peered":"2024-01-20T08:13:40.142460+0000","last_clean":"2024-01-20T08:13:40.142460+0000","last_became_active":"2024-01-20T08:13:40.140116+0000","last_became_peered":"2024-01-20T08:13:40.140116+0000","last_unstale":"2024-01-20T08:13:40.142460+0000","last_undegraded":"2024-01-20T08:13:40.142460+0000","last_fullsized":"2024-01-20T08:13:40.142460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:48:54.354251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113825+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:39.113825+0000","last_peered":"2024-01-20T08:13:39.113825+0000","last_clean":"2024-01-20T08:13:39.113825+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:39.113825+0000","last_undegraded":"2024-01-20T08:13:39.113825+0000","last_fullsized":"2024-01-20T08:13:39.113825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119771+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:39.119771+0000","last_peered":"2024-01-20T08:13:39.119771+0000","last_clean":"2024-01-20T08:13:39.119771+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:39.119771+0000","last_undegraded":"2024-01-20T08:13:39.119771+0000","last_fullsized":"2024-01-20T08:13:39.119771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.111329+0000","last_change":"2024-01-20T08:13:40.111329+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.111329+0000","last_undegraded":"2024-01-20T08:13:40.111329+0000","last_fullsized":"2024-01-20T08:13:40.111329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142906+0000","last_change":"2024-01-20T08:13:40.138670+0000","last_active":"2024-01-20T08:13:40.142906+0000","last_peered":"2024-01-20T08:13:40.142906+0000","last_clean":"2024-01-20T08:13:40.142906+0000","last_became_active":"2024-01-20T08:13:40.138225+0000","last_became_peered":"2024-01-20T08:13:40.138225+0000","last_unstale":"2024-01-20T08:13:40.142906+0000","last_undegraded":"2024-01-20T08:13:40.142906+0000","last_fullsized":"2024-01-20T08:13:40.142906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:31.079661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119512+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:39.119512+0000","last_peered":"2024-01-20T08:13:39.119512+0000","last_clean":"2024-01-20T08:13:39.119512+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:39.119512+0000","last_undegraded":"2024-01-20T08:13:39.119512+0000","last_fullsized":"2024-01-20T08:13:39.119512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119392+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:39.119392+0000","last_peered":"2024-01-20T08:13:39.119392+0000","last_clean":"2024-01-20T08:13:39.119392+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:39.119392+0000","last_undegraded":"2024-01-20T08:13:39.119392+0000","last_fullsized":"2024-01-20T08:13:39.119392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113950+0000","last_change":"2024-01-20T08:13:40.113950+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113950+0000","last_undegraded":"2024-01-20T08:13:40.113950+0000","last_fullsized":"2024-01-20T08:13:40.113950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142864+0000","last_change":"2024-01-20T08:13:40.138470+0000","last_active":"2024-01-20T08:13:40.142864+0000","last_peered":"2024-01-20T08:13:40.142864+0000","last_clean":"2024-01-20T08:13:40.142864+0000","last_became_active":"2024-01-20T08:13:40.138199+0000","last_became_peered":"2024-01-20T08:13:40.138199+0000","last_unstale":"2024-01-20T08:13:40.142864+0000","last_undegraded":"2024-01-20T08:13:40.142864+0000","last_fullsized":"2024-01-20T08:13:40.142864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:28.806346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102391+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:39.102391+0000","last_peered":"2024-01-20T08:13:39.102391+0000","last_clean":"2024-01-20T08:13:39.102391+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:39.102391+0000","last_undegraded":"2024-01-20T08:13:39.102391+0000","last_fullsized":"2024-01-20T08:13:39.102391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103156+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:39.103156+0000","last_peered":"2024-01-20T08:13:39.103156+0000","last_clean":"2024-01-20T08:13:39.103156+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:39.103156+0000","last_undegraded":"2024-01-20T08:13:39.103156+0000","last_fullsized":"2024-01-20T08:13:39.103156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126904+0000","last_change":"2024-01-20T08:13:40.126904+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126904+0000","last_undegraded":"2024-01-20T08:13:40.126904+0000","last_fullsized":"2024-01-20T08:13:40.126904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136784+0000","last_change":"2024-01-20T08:13:40.129368+0000","last_active":"2024-01-20T08:13:40.136784+0000","last_peered":"2024-01-20T08:13:40.136784+0000","last_clean":"2024-01-20T08:13:40.136784+0000","last_became_active":"2024-01-20T08:13:40.129051+0000","last_became_peered":"2024-01-20T08:13:40.129051+0000","last_unstale":"2024-01-20T08:13:40.136784+0000","last_undegraded":"2024-01-20T08:13:40.136784+0000","last_fullsized":"2024-01-20T08:13:40.136784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109983+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:39.109983+0000","last_peered":"2024-01-20T08:13:39.109983+0000","last_clean":"2024-01-20T08:13:39.109983+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:39.109983+0000","last_undegraded":"2024-01-20T08:13:39.109983+0000","last_fullsized":"2024-01-20T08:13:39.109983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112971+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:39.112971+0000","last_peered":"2024-01-20T08:13:39.112971+0000","last_clean":"2024-01-20T08:13:39.112971+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:39.112971+0000","last_undegraded":"2024-01-20T08:13:39.112971+0000","last_fullsized":"2024-01-20T08:13:39.112971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128740+0000","last_change":"2024-01-20T08:13:40.128740+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128740+0000","last_undegraded":"2024-01-20T08:13:40.128740+0000","last_fullsized":"2024-01-20T08:13:40.128740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142554+0000","last_change":"2024-01-20T08:13:40.141046+0000","last_active":"2024-01-20T08:13:40.142554+0000","last_peered":"2024-01-20T08:13:40.142554+0000","last_clean":"2024-01-20T08:13:40.142554+0000","last_became_active":"2024-01-20T08:13:40.140753+0000","last_became_peered":"2024-01-20T08:13:40.140753+0000","last_unstale":"2024-01-20T08:13:40.142554+0000","last_undegraded":"2024-01-20T08:13:40.142554+0000","last_fullsized":"2024-01-20T08:13:40.142554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113375+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:39.113375+0000","last_peered":"2024-01-20T08:13:39.113375+0000","last_clean":"2024-01-20T08:13:39.113375+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:39.113375+0000","last_undegraded":"2024-01-20T08:13:39.113375+0000","last_fullsized":"2024-01-20T08:13:39.113375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112006+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:39.112006+0000","last_peered":"2024-01-20T08:13:39.112006+0000","last_clean":"2024-01-20T08:13:39.112006+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:39.112006+0000","last_undegraded":"2024-01-20T08:13:39.112006+0000","last_fullsized":"2024-01-20T08:13:39.112006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127813+0000","last_change":"2024-01-20T08:13:40.127813+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127813+0000","last_undegraded":"2024-01-20T08:13:40.127813+0000","last_fullsized":"2024-01-20T08:13:40.127813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142007+0000","last_change":"2024-01-20T08:13:40.139406+0000","last_active":"2024-01-20T08:13:40.142007+0000","last_peered":"2024-01-20T08:13:40.142007+0000","last_clean":"2024-01-20T08:13:40.142007+0000","last_became_active":"2024-01-20T08:13:40.139147+0000","last_became_peered":"2024-01-20T08:13:40.139147+0000","last_unstale":"2024-01-20T08:13:40.142007+0000","last_undegraded":"2024-01-20T08:13:40.142007+0000","last_fullsized":"2024-01-20T08:13:40.142007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118859+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:39.118859+0000","last_peered":"2024-01-20T08:13:39.118859+0000","last_clean":"2024-01-20T08:13:39.118859+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:39.118859+0000","last_undegraded":"2024-01-20T08:13:39.118859+0000","last_fullsized":"2024-01-20T08:13:39.118859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111115+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:39.111115+0000","last_peered":"2024-01-20T08:13:39.111115+0000","last_clean":"2024-01-20T08:13:39.111115+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:39.111115+0000","last_undegraded":"2024-01-20T08:13:39.111115+0000","last_fullsized":"2024-01-20T08:13:39.111115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117535+0000","last_change":"2024-01-20T08:13:40.117535+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117535+0000","last_undegraded":"2024-01-20T08:13:40.117535+0000","last_fullsized":"2024-01-20T08:13:40.117535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137874+0000","last_change":"2024-01-20T08:13:40.135173+0000","last_active":"2024-01-20T08:13:40.137874+0000","last_peered":"2024-01-20T08:13:40.137874+0000","last_clean":"2024-01-20T08:13:40.137874+0000","last_became_active":"2024-01-20T08:13:40.134749+0000","last_became_peered":"2024-01-20T08:13:40.134749+0000","last_unstale":"2024-01-20T08:13:40.137874+0000","last_undegraded":"2024-01-20T08:13:40.137874+0000","last_fullsized":"2024-01-20T08:13:40.137874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:26.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102483+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:39.102483+0000","last_peered":"2024-01-20T08:13:39.102483+0000","last_clean":"2024-01-20T08:13:39.102483+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:39.102483+0000","last_undegraded":"2024-01-20T08:13:39.102483+0000","last_fullsized":"2024-01-20T08:13:39.102483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109714+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:39.109714+0000","last_peered":"2024-01-20T08:13:39.109714+0000","last_clean":"2024-01-20T08:13:39.109714+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:39.109714+0000","last_undegraded":"2024-01-20T08:13:39.109714+0000","last_fullsized":"2024-01-20T08:13:39.109714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112325+0000","last_change":"2024-01-20T08:13:40.112325+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112325+0000","last_undegraded":"2024-01-20T08:13:40.112325+0000","last_fullsized":"2024-01-20T08:13:40.112325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143620+0000","last_change":"2024-01-20T08:13:40.140385+0000","last_active":"2024-01-20T08:13:40.143620+0000","last_peered":"2024-01-20T08:13:40.143620+0000","last_clean":"2024-01-20T08:13:40.143620+0000","last_became_active":"2024-01-20T08:13:40.140136+0000","last_became_peered":"2024-01-20T08:13:40.140136+0000","last_unstale":"2024-01-20T08:13:40.143620+0000","last_undegraded":"2024-01-20T08:13:40.143620+0000","last_fullsized":"2024-01-20T08:13:40.143620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:50.287743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119990+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:39.119990+0000","last_peered":"2024-01-20T08:13:39.119990+0000","last_clean":"2024-01-20T08:13:39.119990+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:39.119990+0000","last_undegraded":"2024-01-20T08:13:39.119990+0000","last_fullsized":"2024-01-20T08:13:39.119990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"72'9","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116753+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:39.116753+0000","last_peered":"2024-01-20T08:13:39.116753+0000","last_clean":"2024-01-20T08:13:39.116753+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:39.116753+0000","last_undegraded":"2024-01-20T08:13:39.116753+0000","last_fullsized":"2024-01-20T08:13:39.116753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110828+0000","last_change":"2024-01-20T08:13:40.110828+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110828+0000","last_undegraded":"2024-01-20T08:13:40.110828+0000","last_fullsized":"2024-01-20T08:13:40.110828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141981+0000","last_change":"2024-01-20T08:13:40.138835+0000","last_active":"2024-01-20T08:13:40.141981+0000","last_peered":"2024-01-20T08:13:40.141981+0000","last_clean":"2024-01-20T08:13:40.141981+0000","last_became_active":"2024-01-20T08:13:40.138570+0000","last_became_peered":"2024-01-20T08:13:40.138570+0000","last_unstale":"2024-01-20T08:13:40.141981+0000","last_undegraded":"2024-01-20T08:13:40.141981+0000","last_fullsized":"2024-01-20T08:13:40.141981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103072+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:39.103072+0000","last_peered":"2024-01-20T08:13:39.103072+0000","last_clean":"2024-01-20T08:13:39.103072+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:39.103072+0000","last_undegraded":"2024-01-20T08:13:39.103072+0000","last_fullsized":"2024-01-20T08:13:39.103072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113766+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:39.113766+0000","last_peered":"2024-01-20T08:13:39.113766+0000","last_clean":"2024-01-20T08:13:39.113766+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:39.113766+0000","last_undegraded":"2024-01-20T08:13:39.113766+0000","last_fullsized":"2024-01-20T08:13:39.113766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119826+0000","last_change":"2024-01-20T08:13:40.119826+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119826+0000","last_undegraded":"2024-01-20T08:13:40.119826+0000","last_fullsized":"2024-01-20T08:13:40.119826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137609+0000","last_change":"2024-01-20T08:13:40.134405+0000","last_active":"2024-01-20T08:13:40.137609+0000","last_peered":"2024-01-20T08:13:40.137609+0000","last_clean":"2024-01-20T08:13:40.137609+0000","last_became_active":"2024-01-20T08:13:40.134151+0000","last_became_peered":"2024-01-20T08:13:40.134151+0000","last_unstale":"2024-01-20T08:13:40.137609+0000","last_undegraded":"2024-01-20T08:13:40.137609+0000","last_fullsized":"2024-01-20T08:13:40.137609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:15:13.377556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103139+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:39.103139+0000","last_peered":"2024-01-20T08:13:39.103139+0000","last_clean":"2024-01-20T08:13:39.103139+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:39.103139+0000","last_undegraded":"2024-01-20T08:13:39.103139+0000","last_fullsized":"2024-01-20T08:13:39.103139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109723+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:39.109723+0000","last_peered":"2024-01-20T08:13:39.109723+0000","last_clean":"2024-01-20T08:13:39.109723+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:39.109723+0000","last_undegraded":"2024-01-20T08:13:39.109723+0000","last_fullsized":"2024-01-20T08:13:39.109723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119603+0000","last_change":"2024-01-20T08:13:40.119603+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119603+0000","last_undegraded":"2024-01-20T08:13:40.119603+0000","last_fullsized":"2024-01-20T08:13:40.119603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136384+0000","last_change":"2024-01-20T08:13:40.131252+0000","last_active":"2024-01-20T08:13:40.136384+0000","last_peered":"2024-01-20T08:13:40.136384+0000","last_clean":"2024-01-20T08:13:40.136384+0000","last_became_active":"2024-01-20T08:13:40.130235+0000","last_became_peered":"2024-01-20T08:13:40.130235+0000","last_unstale":"2024-01-20T08:13:40.136384+0000","last_undegraded":"2024-01-20T08:13:40.136384+0000","last_fullsized":"2024-01-20T08:13:40.136384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:12.348000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112931+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:39.112931+0000","last_peered":"2024-01-20T08:13:39.112931+0000","last_clean":"2024-01-20T08:13:39.112931+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:39.112931+0000","last_undegraded":"2024-01-20T08:13:39.112931+0000","last_fullsized":"2024-01-20T08:13:39.112931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115255+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:39.115255+0000","last_peered":"2024-01-20T08:13:39.115255+0000","last_clean":"2024-01-20T08:13:39.115255+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:39.115255+0000","last_undegraded":"2024-01-20T08:13:39.115255+0000","last_fullsized":"2024-01-20T08:13:39.115255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116751+0000","last_change":"2024-01-20T08:13:40.116751+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116751+0000","last_undegraded":"2024-01-20T08:13:40.116751+0000","last_fullsized":"2024-01-20T08:13:40.116751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132386+0000","last_change":"2024-01-20T08:13:40.124952+0000","last_active":"2024-01-20T08:13:40.132386+0000","last_peered":"2024-01-20T08:13:40.132386+0000","last_clean":"2024-01-20T08:13:40.132386+0000","last_became_active":"2024-01-20T08:13:40.124408+0000","last_became_peered":"2024-01-20T08:13:40.124408+0000","last_unstale":"2024-01-20T08:13:40.132386+0000","last_undegraded":"2024-01-20T08:13:40.132386+0000","last_fullsized":"2024-01-20T08:13:40.132386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:24.693203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113095+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:39.113095+0000","last_peered":"2024-01-20T08:13:39.113095+0000","last_clean":"2024-01-20T08:13:39.113095+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:39.113095+0000","last_undegraded":"2024-01-20T08:13:39.113095+0000","last_fullsized":"2024-01-20T08:13:39.113095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102137+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:39.102137+0000","last_peered":"2024-01-20T08:13:39.102137+0000","last_clean":"2024-01-20T08:13:39.102137+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:39.102137+0000","last_undegraded":"2024-01-20T08:13:39.102137+0000","last_fullsized":"2024-01-20T08:13:39.102137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141565+0000","last_change":"2024-01-20T08:13:40.137508+0000","last_active":"2024-01-20T08:13:40.141565+0000","last_peered":"2024-01-20T08:13:40.141565+0000","last_clean":"2024-01-20T08:13:40.141565+0000","last_became_active":"2024-01-20T08:13:40.137164+0000","last_became_peered":"2024-01-20T08:13:40.137164+0000","last_unstale":"2024-01-20T08:13:40.141565+0000","last_undegraded":"2024-01-20T08:13:40.141565+0000","last_fullsized":"2024-01-20T08:13:40.141565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105715+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:39.105715+0000","last_peered":"2024-01-20T08:13:39.105715+0000","last_clean":"2024-01-20T08:13:39.105715+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:39.105715+0000","last_undegraded":"2024-01-20T08:13:39.105715+0000","last_fullsized":"2024-01-20T08:13:39.105715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112445+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:39.112445+0000","last_peered":"2024-01-20T08:13:39.112445+0000","last_clean":"2024-01-20T08:13:39.112445+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:39.112445+0000","last_undegraded":"2024-01-20T08:13:39.112445+0000","last_fullsized":"2024-01-20T08:13:39.112445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127354+0000","last_change":"2024-01-20T08:13:40.127354+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127354+0000","last_undegraded":"2024-01-20T08:13:40.127354+0000","last_fullsized":"2024-01-20T08:13:40.127354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139223+0000","last_change":"2024-01-20T08:13:40.132877+0000","last_active":"2024-01-20T08:13:40.139223+0000","last_peered":"2024-01-20T08:13:40.139223+0000","last_clean":"2024-01-20T08:13:40.139223+0000","last_became_active":"2024-01-20T08:13:40.132593+0000","last_became_peered":"2024-01-20T08:13:40.132593+0000","last_unstale":"2024-01-20T08:13:40.139223+0000","last_undegraded":"2024-01-20T08:13:40.139223+0000","last_fullsized":"2024-01-20T08:13:40.139223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:11.124723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111745+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:39.111745+0000","last_peered":"2024-01-20T08:13:39.111745+0000","last_clean":"2024-01-20T08:13:39.111745+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:39.111745+0000","last_undegraded":"2024-01-20T08:13:39.111745+0000","last_fullsized":"2024-01-20T08:13:39.111745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102808+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:39.102808+0000","last_peered":"2024-01-20T08:13:39.102808+0000","last_clean":"2024-01-20T08:13:39.102808+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:39.102808+0000","last_undegraded":"2024-01-20T08:13:39.102808+0000","last_fullsized":"2024-01-20T08:13:39.102808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121382+0000","last_change":"2024-01-20T08:13:40.121382+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121382+0000","last_undegraded":"2024-01-20T08:13:40.121382+0000","last_fullsized":"2024-01-20T08:13:40.121382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139974+0000","last_change":"2024-01-20T08:13:40.134188+0000","last_active":"2024-01-20T08:13:40.139974+0000","last_peered":"2024-01-20T08:13:40.139974+0000","last_clean":"2024-01-20T08:13:40.139974+0000","last_became_active":"2024-01-20T08:13:40.132998+0000","last_became_peered":"2024-01-20T08:13:40.132998+0000","last_unstale":"2024-01-20T08:13:40.139974+0000","last_undegraded":"2024-01-20T08:13:40.139974+0000","last_fullsized":"2024-01-20T08:13:40.139974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120002+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:39.120002+0000","last_peered":"2024-01-20T08:13:39.120002+0000","last_clean":"2024-01-20T08:13:39.120002+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:39.120002+0000","last_undegraded":"2024-01-20T08:13:39.120002+0000","last_fullsized":"2024-01-20T08:13:39.120002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102597+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:39.102597+0000","last_peered":"2024-01-20T08:13:39.102597+0000","last_clean":"2024-01-20T08:13:39.102597+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:39.102597+0000","last_undegraded":"2024-01-20T08:13:39.102597+0000","last_fullsized":"2024-01-20T08:13:39.102597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110820+0000","last_change":"2024-01-20T08:13:40.110820+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110820+0000","last_undegraded":"2024-01-20T08:13:40.110820+0000","last_fullsized":"2024-01-20T08:13:40.110820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140515+0000","last_change":"2024-01-20T08:13:40.136860+0000","last_active":"2024-01-20T08:13:40.140515+0000","last_peered":"2024-01-20T08:13:40.140515+0000","last_clean":"2024-01-20T08:13:40.140515+0000","last_became_active":"2024-01-20T08:13:40.136501+0000","last_became_peered":"2024-01-20T08:13:40.136501+0000","last_unstale":"2024-01-20T08:13:40.140515+0000","last_undegraded":"2024-01-20T08:13:40.140515+0000","last_fullsized":"2024-01-20T08:13:40.140515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:38.500847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111361+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:39.111361+0000","last_peered":"2024-01-20T08:13:39.111361+0000","last_clean":"2024-01-20T08:13:39.111361+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:39.111361+0000","last_undegraded":"2024-01-20T08:13:39.111361+0000","last_fullsized":"2024-01-20T08:13:39.111361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112320+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:39.112320+0000","last_peered":"2024-01-20T08:13:39.112320+0000","last_clean":"2024-01-20T08:13:39.112320+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:39.112320+0000","last_undegraded":"2024-01-20T08:13:39.112320+0000","last_fullsized":"2024-01-20T08:13:39.112320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.129421+0000","last_change":"2024-01-20T08:13:40.129421+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.129421+0000","last_undegraded":"2024-01-20T08:13:40.129421+0000","last_fullsized":"2024-01-20T08:13:40.129421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132463+0000","last_change":"2024-01-20T08:13:40.126858+0000","last_active":"2024-01-20T08:13:40.132463+0000","last_peered":"2024-01-20T08:13:40.132463+0000","last_clean":"2024-01-20T08:13:40.132463+0000","last_became_active":"2024-01-20T08:13:40.124427+0000","last_became_peered":"2024-01-20T08:13:40.124427+0000","last_unstale":"2024-01-20T08:13:40.132463+0000","last_undegraded":"2024-01-20T08:13:40.132463+0000","last_fullsized":"2024-01-20T08:13:40.132463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116307+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:39.116307+0000","last_peered":"2024-01-20T08:13:39.116307+0000","last_clean":"2024-01-20T08:13:39.116307+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:39.116307+0000","last_undegraded":"2024-01-20T08:13:39.116307+0000","last_fullsized":"2024-01-20T08:13:39.116307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113354+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:39.113354+0000","last_peered":"2024-01-20T08:13:39.113354+0000","last_clean":"2024-01-20T08:13:39.113354+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:39.113354+0000","last_undegraded":"2024-01-20T08:13:39.113354+0000","last_fullsized":"2024-01-20T08:13:39.113354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116053+0000","last_change":"2024-01-20T08:13:40.116053+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116053+0000","last_undegraded":"2024-01-20T08:13:40.116053+0000","last_fullsized":"2024-01-20T08:13:40.116053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.130723+0000","last_change":"2024-01-20T08:13:40.123835+0000","last_active":"2024-01-20T08:13:40.130723+0000","last_peered":"2024-01-20T08:13:40.130723+0000","last_clean":"2024-01-20T08:13:40.130723+0000","last_became_active":"2024-01-20T08:13:40.123558+0000","last_became_peered":"2024-01-20T08:13:40.123558+0000","last_unstale":"2024-01-20T08:13:40.130723+0000","last_undegraded":"2024-01-20T08:13:40.130723+0000","last_fullsized":"2024-01-20T08:13:40.130723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109710+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:39.109710+0000","last_peered":"2024-01-20T08:13:39.109710+0000","last_clean":"2024-01-20T08:13:39.109710+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:39.109710+0000","last_undegraded":"2024-01-20T08:13:39.109710+0000","last_fullsized":"2024-01-20T08:13:39.109710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110352+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:39.110352+0000","last_peered":"2024-01-20T08:13:39.110352+0000","last_clean":"2024-01-20T08:13:39.110352+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:39.110352+0000","last_undegraded":"2024-01-20T08:13:39.110352+0000","last_fullsized":"2024-01-20T08:13:39.110352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116227+0000","last_change":"2024-01-20T08:13:40.116227+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116227+0000","last_undegraded":"2024-01-20T08:13:40.116227+0000","last_fullsized":"2024-01-20T08:13:40.116227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.134322+0000","last_change":"2024-01-20T08:13:40.128760+0000","last_active":"2024-01-20T08:13:40.134322+0000","last_peered":"2024-01-20T08:13:40.134322+0000","last_clean":"2024-01-20T08:13:40.134322+0000","last_became_active":"2024-01-20T08:13:40.128395+0000","last_became_peered":"2024-01-20T08:13:40.128395+0000","last_unstale":"2024-01-20T08:13:40.134322+0000","last_undegraded":"2024-01-20T08:13:40.134322+0000","last_fullsized":"2024-01-20T08:13:40.134322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:04:06.168521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115047+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:39.115047+0000","last_peered":"2024-01-20T08:13:39.115047+0000","last_clean":"2024-01-20T08:13:39.115047+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:39.115047+0000","last_undegraded":"2024-01-20T08:13:39.115047+0000","last_fullsized":"2024-01-20T08:13:39.115047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110250+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:39.110250+0000","last_peered":"2024-01-20T08:13:39.110250+0000","last_clean":"2024-01-20T08:13:39.110250+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:39.110250+0000","last_undegraded":"2024-01-20T08:13:39.110250+0000","last_fullsized":"2024-01-20T08:13:39.110250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116220+0000","last_change":"2024-01-20T08:13:40.116220+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116220+0000","last_undegraded":"2024-01-20T08:13:40.116220+0000","last_fullsized":"2024-01-20T08:13:40.116220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139243+0000","last_change":"2024-01-20T08:13:40.131748+0000","last_active":"2024-01-20T08:13:40.139243+0000","last_peered":"2024-01-20T08:13:40.139243+0000","last_clean":"2024-01-20T08:13:40.139243+0000","last_became_active":"2024-01-20T08:13:40.131502+0000","last_became_peered":"2024-01-20T08:13:40.131502+0000","last_unstale":"2024-01-20T08:13:40.139243+0000","last_undegraded":"2024-01-20T08:13:40.139243+0000","last_fullsized":"2024-01-20T08:13:40.139243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120282+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:39.120282+0000","last_peered":"2024-01-20T08:13:39.120282+0000","last_clean":"2024-01-20T08:13:39.120282+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:39.120282+0000","last_undegraded":"2024-01-20T08:13:39.120282+0000","last_fullsized":"2024-01-20T08:13:39.120282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115494+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:39.115494+0000","last_peered":"2024-01-20T08:13:39.115494+0000","last_clean":"2024-01-20T08:13:39.115494+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:39.115494+0000","last_undegraded":"2024-01-20T08:13:39.115494+0000","last_fullsized":"2024-01-20T08:13:39.115494+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125586+0000","last_change":"2024-01-20T08:13:40.125586+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125586+0000","last_undegraded":"2024-01-20T08:13:40.125586+0000","last_fullsized":"2024-01-20T08:13:40.125586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139913+0000","last_change":"2024-01-20T08:13:40.136610+0000","last_active":"2024-01-20T08:13:40.139913+0000","last_peered":"2024-01-20T08:13:40.139913+0000","last_clean":"2024-01-20T08:13:40.139913+0000","last_became_active":"2024-01-20T08:13:40.135965+0000","last_became_peered":"2024-01-20T08:13:40.135965+0000","last_unstale":"2024-01-20T08:13:40.139913+0000","last_undegraded":"2024-01-20T08:13:40.139913+0000","last_fullsized":"2024-01-20T08:13:40.139913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.106130+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:39.106130+0000","last_peered":"2024-01-20T08:13:39.106130+0000","last_clean":"2024-01-20T08:13:39.106130+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:39.106130+0000","last_undegraded":"2024-01-20T08:13:39.106130+0000","last_fullsized":"2024-01-20T08:13:39.106130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114981+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:39.114981+0000","last_peered":"2024-01-20T08:13:39.114981+0000","last_clean":"2024-01-20T08:13:39.114981+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:39.114981+0000","last_undegraded":"2024-01-20T08:13:39.114981+0000","last_fullsized":"2024-01-20T08:13:39.114981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116973+0000","last_change":"2024-01-20T08:13:40.116973+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116973+0000","last_undegraded":"2024-01-20T08:13:40.116973+0000","last_fullsized":"2024-01-20T08:13:40.116973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141253+0000","last_change":"2024-01-20T08:13:40.138153+0000","last_active":"2024-01-20T08:13:40.141253+0000","last_peered":"2024-01-20T08:13:40.141253+0000","last_clean":"2024-01-20T08:13:40.141253+0000","last_became_active":"2024-01-20T08:13:40.137489+0000","last_became_peered":"2024-01-20T08:13:40.137489+0000","last_unstale":"2024-01-20T08:13:40.141253+0000","last_undegraded":"2024-01-20T08:13:40.141253+0000","last_fullsized":"2024-01-20T08:13:40.141253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:58.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111008+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:39.111008+0000","last_peered":"2024-01-20T08:13:39.111008+0000","last_clean":"2024-01-20T08:13:39.111008+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:39.111008+0000","last_undegraded":"2024-01-20T08:13:39.111008+0000","last_fullsized":"2024-01-20T08:13:39.111008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110011+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:39.110011+0000","last_peered":"2024-01-20T08:13:39.110011+0000","last_clean":"2024-01-20T08:13:39.110011+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:39.110011+0000","last_undegraded":"2024-01-20T08:13:39.110011+0000","last_fullsized":"2024-01-20T08:13:39.110011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118595+0000","last_change":"2024-01-20T08:13:40.118595+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118595+0000","last_undegraded":"2024-01-20T08:13:40.118595+0000","last_fullsized":"2024-01-20T08:13:40.118595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139284+0000","last_change":"2024-01-20T08:13:40.135004+0000","last_active":"2024-01-20T08:13:40.139284+0000","last_peered":"2024-01-20T08:13:40.139284+0000","last_clean":"2024-01-20T08:13:40.139284+0000","last_became_active":"2024-01-20T08:13:40.132993+0000","last_became_peered":"2024-01-20T08:13:40.132993+0000","last_unstale":"2024-01-20T08:13:40.139284+0000","last_undegraded":"2024-01-20T08:13:40.139284+0000","last_fullsized":"2024-01-20T08:13:40.139284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:36.525486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120149+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:39.120149+0000","last_peered":"2024-01-20T08:13:39.120149+0000","last_clean":"2024-01-20T08:13:39.120149+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:39.120149+0000","last_undegraded":"2024-01-20T08:13:39.120149+0000","last_fullsized":"2024-01-20T08:13:39.120149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111251+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:39.111251+0000","last_peered":"2024-01-20T08:13:39.111251+0000","last_clean":"2024-01-20T08:13:39.111251+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:39.111251+0000","last_undegraded":"2024-01-20T08:13:39.111251+0000","last_fullsized":"2024-01-20T08:13:39.111251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.109850+0000","last_change":"2024-01-20T08:13:40.109850+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.109850+0000","last_undegraded":"2024-01-20T08:13:40.109850+0000","last_fullsized":"2024-01-20T08:13:40.109850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143546+0000","last_change":"2024-01-20T08:13:40.138887+0000","last_active":"2024-01-20T08:13:40.143546+0000","last_peered":"2024-01-20T08:13:40.143546+0000","last_clean":"2024-01-20T08:13:40.143546+0000","last_became_active":"2024-01-20T08:13:40.138591+0000","last_became_peered":"2024-01-20T08:13:40.138591+0000","last_unstale":"2024-01-20T08:13:40.143546+0000","last_undegraded":"2024-01-20T08:13:40.143546+0000","last_fullsized":"2024-01-20T08:13:40.143546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118082+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:39.118082+0000","last_peered":"2024-01-20T08:13:39.118082+0000","last_clean":"2024-01-20T08:13:39.118082+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:39.118082+0000","last_undegraded":"2024-01-20T08:13:39.118082+0000","last_fullsized":"2024-01-20T08:13:39.118082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102627+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:39.102627+0000","last_peered":"2024-01-20T08:13:39.102627+0000","last_clean":"2024-01-20T08:13:39.102627+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:39.102627+0000","last_undegraded":"2024-01-20T08:13:39.102627+0000","last_fullsized":"2024-01-20T08:13:39.102627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121559+0000","last_change":"2024-01-20T08:13:40.121559+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121559+0000","last_undegraded":"2024-01-20T08:13:40.121559+0000","last_fullsized":"2024-01-20T08:13:40.121559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.131963+0000","last_change":"2024-01-20T08:13:40.125670+0000","last_active":"2024-01-20T08:13:40.131963+0000","last_peered":"2024-01-20T08:13:40.131963+0000","last_clean":"2024-01-20T08:13:40.131963+0000","last_became_active":"2024-01-20T08:13:40.125414+0000","last_became_peered":"2024-01-20T08:13:40.125414+0000","last_unstale":"2024-01-20T08:13:40.131963+0000","last_undegraded":"2024-01-20T08:13:40.131963+0000","last_fullsized":"2024-01-20T08:13:40.131963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:56.786851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102265+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:39.102265+0000","last_peered":"2024-01-20T08:13:39.102265+0000","last_clean":"2024-01-20T08:13:39.102265+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:39.102265+0000","last_undegraded":"2024-01-20T08:13:39.102265+0000","last_fullsized":"2024-01-20T08:13:39.102265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119588+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:39.119588+0000","last_peered":"2024-01-20T08:13:39.119588+0000","last_clean":"2024-01-20T08:13:39.119588+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:39.119588+0000","last_undegraded":"2024-01-20T08:13:39.119588+0000","last_fullsized":"2024-01-20T08:13:39.119588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113404+0000","last_change":"2024-01-20T08:13:40.113404+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113404+0000","last_undegraded":"2024-01-20T08:13:40.113404+0000","last_fullsized":"2024-01-20T08:13:40.113404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142610+0000","last_change":"2024-01-20T08:13:40.140095+0000","last_active":"2024-01-20T08:13:40.142610+0000","last_peered":"2024-01-20T08:13:40.142610+0000","last_clean":"2024-01-20T08:13:40.142610+0000","last_became_active":"2024-01-20T08:13:40.139756+0000","last_became_peered":"2024-01-20T08:13:40.139756+0000","last_unstale":"2024-01-20T08:13:40.142610+0000","last_undegraded":"2024-01-20T08:13:40.142610+0000","last_fullsized":"2024-01-20T08:13:40.142610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:03:58.663879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102633+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:39.102633+0000","last_peered":"2024-01-20T08:13:39.102633+0000","last_clean":"2024-01-20T08:13:39.102633+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:39.102633+0000","last_undegraded":"2024-01-20T08:13:39.102633+0000","last_fullsized":"2024-01-20T08:13:39.102633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108947+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:39.108947+0000","last_peered":"2024-01-20T08:13:39.108947+0000","last_clean":"2024-01-20T08:13:39.108947+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:39.108947+0000","last_undegraded":"2024-01-20T08:13:39.108947+0000","last_fullsized":"2024-01-20T08:13:39.108947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112491+0000","last_change":"2024-01-20T08:13:40.112491+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112491+0000","last_undegraded":"2024-01-20T08:13:40.112491+0000","last_fullsized":"2024-01-20T08:13:40.112491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140001+0000","last_change":"2024-01-20T08:13:40.136793+0000","last_active":"2024-01-20T08:13:40.140001+0000","last_peered":"2024-01-20T08:13:40.140001+0000","last_clean":"2024-01-20T08:13:40.140001+0000","last_became_active":"2024-01-20T08:13:40.135303+0000","last_became_peered":"2024-01-20T08:13:40.135303+0000","last_unstale":"2024-01-20T08:13:40.140001+0000","last_undegraded":"2024-01-20T08:13:40.140001+0000","last_fullsized":"2024-01-20T08:13:40.140001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108788+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:39.108788+0000","last_peered":"2024-01-20T08:13:39.108788+0000","last_clean":"2024-01-20T08:13:39.108788+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:39.108788+0000","last_undegraded":"2024-01-20T08:13:39.108788+0000","last_fullsized":"2024-01-20T08:13:39.108788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119127+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:39.119127+0000","last_peered":"2024-01-20T08:13:39.119127+0000","last_clean":"2024-01-20T08:13:39.119127+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:39.119127+0000","last_undegraded":"2024-01-20T08:13:39.119127+0000","last_fullsized":"2024-01-20T08:13:39.119127+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118570+0000","last_change":"2024-01-20T08:13:40.118570+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118570+0000","last_undegraded":"2024-01-20T08:13:40.118570+0000","last_fullsized":"2024-01-20T08:13:40.118570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142233+0000","last_change":"2024-01-20T08:13:40.138906+0000","last_active":"2024-01-20T08:13:40.142233+0000","last_peered":"2024-01-20T08:13:40.142233+0000","last_clean":"2024-01-20T08:13:40.142233+0000","last_became_active":"2024-01-20T08:13:40.138512+0000","last_became_peered":"2024-01-20T08:13:40.138512+0000","last_unstale":"2024-01-20T08:13:40.142233+0000","last_undegraded":"2024-01-20T08:13:40.142233+0000","last_fullsized":"2024-01-20T08:13:40.142233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114484+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:39.114484+0000","last_peered":"2024-01-20T08:13:39.114484+0000","last_clean":"2024-01-20T08:13:39.114484+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:39.114484+0000","last_undegraded":"2024-01-20T08:13:39.114484+0000","last_fullsized":"2024-01-20T08:13:39.114484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.104132+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:39.104132+0000","last_peered":"2024-01-20T08:13:39.104132+0000","last_clean":"2024-01-20T08:13:39.104132+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:39.104132+0000","last_undegraded":"2024-01-20T08:13:39.104132+0000","last_fullsized":"2024-01-20T08:13:39.104132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102921+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:39.102921+0000","last_peered":"2024-01-20T08:13:39.102921+0000","last_clean":"2024-01-20T08:13:39.102921+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:39.102921+0000","last_undegraded":"2024-01-20T08:13:39.102921+0000","last_fullsized":"2024-01-20T08:13:39.102921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.153}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.123},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.577}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.3600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.2130000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.427}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.748},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.3919999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.49},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":400965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":0.754}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3899999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.167},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.353}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.46}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":396270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.387}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.482}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.357},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.032}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.419}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":400271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.873},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.0980000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.47}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.02},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.534}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.238},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.401},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.738}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":396248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.313},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.752},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.042}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":400853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.167}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.018},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":1.258}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.304},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":393335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.872}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.82499999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.234}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.157},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.3220000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.29},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.163},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.2769999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.075}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.018},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.7629999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.617},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.321}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.127}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.466},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.8320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:46.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3d is not active+clean 2024-01-20T08:13:46.674 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118584+0000', 'last_change': '2024-01-20T08:13:40.118584+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118584+0000', 'last_undegraded': '2024-01-20T08:13:40.118584+0000', 'last_fullsized': '2024-01-20T08:13:40.118584+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.674 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3c is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.123276+0000', 'last_change': '2024-01-20T08:13:40.123276+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.123276+0000', 'last_undegraded': '2024-01-20T08:13:40.123276+0000', 'last_fullsized': '2024-01-20T08:13:40.123276+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3f is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118942+0000', 'last_change': '2024-01-20T08:13:40.118942+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118942+0000', 'last_undegraded': '2024-01-20T08:13:40.118942+0000', 'last_fullsized': '2024-01-20T08:13:40.118942+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3e is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.114079+0000', 'last_change': '2024-01-20T08:13:40.114079+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.114079+0000', 'last_undegraded': '2024-01-20T08:13:40.114079+0000', 'last_fullsized': '2024-01-20T08:13:40.114079+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.39 is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.125859+0000', 'last_change': '2024-01-20T08:13:40.125859+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.125859+0000', 'last_undegraded': '2024-01-20T08:13:40.125859+0000', 'last_fullsized': '2024-01-20T08:13:40.125859+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.38 is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113241+0000', 'last_change': '2024-01-20T08:13:40.113241+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113241+0000', 'last_undegraded': '2024-01-20T08:13:40.113241+0000', 'last_fullsized': '2024-01-20T08:13:40.113241+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3b is not active+clean 2024-01-20T08:13:46.675 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.125091+0000', 'last_change': '2024-01-20T08:13:40.125091+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.125091+0000', 'last_undegraded': '2024-01-20T08:13:40.125091+0000', 'last_fullsized': '2024-01-20T08:13:40.125091+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3a is not active+clean 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.122263+0000', 'last_change': '2024-01-20T08:13:40.122263+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.122263+0000', 'last_undegraded': '2024-01-20T08:13:40.122263+0000', 'last_fullsized': '2024-01-20T08:13:40.122263+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.35 is not active+clean 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.128279+0000', 'last_change': '2024-01-20T08:13:40.128279+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.128279+0000', 'last_undegraded': '2024-01-20T08:13:40.128279+0000', 'last_fullsized': '2024-01-20T08:13:40.128279+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.34 is not active+clean 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113123+0000', 'last_change': '2024-01-20T08:13:40.113123+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113123+0000', 'last_undegraded': '2024-01-20T08:13:40.113123+0000', 'last_fullsized': '2024-01-20T08:13:40.113123+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.37 is not active+clean 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113777+0000', 'last_change': '2024-01-20T08:13:40.113777+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113777+0000', 'last_undegraded': '2024-01-20T08:13:40.113777+0000', 'last_fullsized': '2024-01-20T08:13:40.113777+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.36 is not active+clean 2024-01-20T08:13:46.676 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.119078+0000', 'last_change': '2024-01-20T08:13:40.119078+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.119078+0000', 'last_undegraded': '2024-01-20T08:13:40.119078+0000', 'last_fullsized': '2024-01-20T08:13:40.119078+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.31 is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.123258+0000', 'last_change': '2024-01-20T08:13:40.123258+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.123258+0000', 'last_undegraded': '2024-01-20T08:13:40.123258+0000', 'last_fullsized': '2024-01-20T08:13:40.123258+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.30 is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.124661+0000', 'last_change': '2024-01-20T08:13:40.124661+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.124661+0000', 'last_undegraded': '2024-01-20T08:13:40.124661+0000', 'last_fullsized': '2024-01-20T08:13:40.124661+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.33 is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118369+0000', 'last_change': '2024-01-20T08:13:40.118369+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118369+0000', 'last_undegraded': '2024-01-20T08:13:40.118369+0000', 'last_fullsized': '2024-01-20T08:13:40.118369+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.32 is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.120267+0000', 'last_change': '2024-01-20T08:13:40.120267+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.120267+0000', 'last_undegraded': '2024-01-20T08:13:40.120267+0000', 'last_fullsized': '2024-01-20T08:13:40.120267+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2d is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118107+0000', 'last_change': '2024-01-20T08:13:40.118107+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118107+0000', 'last_undegraded': '2024-01-20T08:13:40.118107+0000', 'last_fullsized': '2024-01-20T08:13:40.118107+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2c is not active+clean 2024-01-20T08:13:46.677 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112004+0000', 'last_change': '2024-01-20T08:13:40.112004+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112004+0000', 'last_undegraded': '2024-01-20T08:13:40.112004+0000', 'last_fullsized': '2024-01-20T08:13:40.112004+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2f is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113747+0000', 'last_change': '2024-01-20T08:13:40.113747+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113747+0000', 'last_undegraded': '2024-01-20T08:13:40.113747+0000', 'last_fullsized': '2024-01-20T08:13:40.113747+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2e is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118010+0000', 'last_change': '2024-01-20T08:13:40.118010+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118010+0000', 'last_undegraded': '2024-01-20T08:13:40.118010+0000', 'last_fullsized': '2024-01-20T08:13:40.118010+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.29 is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112692+0000', 'last_change': '2024-01-20T08:13:40.112692+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112692+0000', 'last_undegraded': '2024-01-20T08:13:40.112692+0000', 'last_fullsized': '2024-01-20T08:13:40.112692+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.28 is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.123643+0000', 'last_change': '2024-01-20T08:13:40.123643+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.123643+0000', 'last_undegraded': '2024-01-20T08:13:40.123643+0000', 'last_fullsized': '2024-01-20T08:13:40.123643+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2b is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.117525+0000', 'last_change': '2024-01-20T08:13:40.117525+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.117525+0000', 'last_undegraded': '2024-01-20T08:13:40.117525+0000', 'last_fullsized': '2024-01-20T08:13:40.117525+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2a is not active+clean 2024-01-20T08:13:46.678 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113839+0000', 'last_change': '2024-01-20T08:13:40.113839+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113839+0000', 'last_undegraded': '2024-01-20T08:13:40.113839+0000', 'last_fullsized': '2024-01-20T08:13:40.113839+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.25 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.126896+0000', 'last_change': '2024-01-20T08:13:40.126896+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.126896+0000', 'last_undegraded': '2024-01-20T08:13:40.126896+0000', 'last_fullsized': '2024-01-20T08:13:40.126896+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.24 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.120314+0000', 'last_change': '2024-01-20T08:13:40.120314+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.120314+0000', 'last_undegraded': '2024-01-20T08:13:40.120314+0000', 'last_fullsized': '2024-01-20T08:13:40.120314+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.27 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.120673+0000', 'last_change': '2024-01-20T08:13:40.120673+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.120673+0000', 'last_undegraded': '2024-01-20T08:13:40.120673+0000', 'last_fullsized': '2024-01-20T08:13:40.120673+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.26 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113518+0000', 'last_change': '2024-01-20T08:13:40.113518+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113518+0000', 'last_undegraded': '2024-01-20T08:13:40.113518+0000', 'last_fullsized': '2024-01-20T08:13:40.113518+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.21 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.120384+0000', 'last_change': '2024-01-20T08:13:40.120384+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.120384+0000', 'last_undegraded': '2024-01-20T08:13:40.120384+0000', 'last_fullsized': '2024-01-20T08:13:40.120384+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.20 is not active+clean 2024-01-20T08:13:46.679 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.115829+0000', 'last_change': '2024-01-20T08:13:40.115829+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.115829+0000', 'last_undegraded': '2024-01-20T08:13:40.115829+0000', 'last_fullsized': '2024-01-20T08:13:40.115829+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.23 is not active+clean 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112697+0000', 'last_change': '2024-01-20T08:13:40.112697+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112697+0000', 'last_undegraded': '2024-01-20T08:13:40.112697+0000', 'last_fullsized': '2024-01-20T08:13:40.112697+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.22 is not active+clean 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.117245+0000', 'last_change': '2024-01-20T08:13:40.117245+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.117245+0000', 'last_undegraded': '2024-01-20T08:13:40.117245+0000', 'last_fullsized': '2024-01-20T08:13:40.117245+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1c is not active+clean 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116777+0000', 'last_change': '2024-01-20T08:13:40.116777+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116777+0000', 'last_undegraded': '2024-01-20T08:13:40.116777+0000', 'last_fullsized': '2024-01-20T08:13:40.116777+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1d is not active+clean 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113112+0000', 'last_change': '2024-01-20T08:13:40.113112+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113112+0000', 'last_undegraded': '2024-01-20T08:13:40.113112+0000', 'last_fullsized': '2024-01-20T08:13:40.113112+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1e is not active+clean 2024-01-20T08:13:46.680 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.119163+0000', 'last_change': '2024-01-20T08:13:40.119163+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.119163+0000', 'last_undegraded': '2024-01-20T08:13:40.119163+0000', 'last_fullsized': '2024-01-20T08:13:40.119163+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1f is not active+clean 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118629+0000', 'last_change': '2024-01-20T08:13:40.118629+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118629+0000', 'last_undegraded': '2024-01-20T08:13:40.118629+0000', 'last_fullsized': '2024-01-20T08:13:40.118629+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.18 is not active+clean 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.115669+0000', 'last_change': '2024-01-20T08:13:40.115669+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.115669+0000', 'last_undegraded': '2024-01-20T08:13:40.115669+0000', 'last_fullsized': '2024-01-20T08:13:40.115669+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.19 is not active+clean 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.111329+0000', 'last_change': '2024-01-20T08:13:40.111329+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.111329+0000', 'last_undegraded': '2024-01-20T08:13:40.111329+0000', 'last_fullsized': '2024-01-20T08:13:40.111329+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1a is not active+clean 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113950+0000', 'last_change': '2024-01-20T08:13:40.113950+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113950+0000', 'last_undegraded': '2024-01-20T08:13:40.113950+0000', 'last_fullsized': '2024-01-20T08:13:40.113950+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1b is not active+clean 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.126904+0000', 'last_change': '2024-01-20T08:13:40.126904+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.126904+0000', 'last_undegraded': '2024-01-20T08:13:40.126904+0000', 'last_fullsized': '2024-01-20T08:13:40.126904+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.681 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.14 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.128740+0000', 'last_change': '2024-01-20T08:13:40.128740+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.128740+0000', 'last_undegraded': '2024-01-20T08:13:40.128740+0000', 'last_fullsized': '2024-01-20T08:13:40.128740+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.15 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.127813+0000', 'last_change': '2024-01-20T08:13:40.127813+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.127813+0000', 'last_undegraded': '2024-01-20T08:13:40.127813+0000', 'last_fullsized': '2024-01-20T08:13:40.127813+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.16 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.117535+0000', 'last_change': '2024-01-20T08:13:40.117535+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.117535+0000', 'last_undegraded': '2024-01-20T08:13:40.117535+0000', 'last_fullsized': '2024-01-20T08:13:40.117535+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.17 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112325+0000', 'last_change': '2024-01-20T08:13:40.112325+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112325+0000', 'last_undegraded': '2024-01-20T08:13:40.112325+0000', 'last_fullsized': '2024-01-20T08:13:40.112325+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.10 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.110828+0000', 'last_change': '2024-01-20T08:13:40.110828+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.110828+0000', 'last_undegraded': '2024-01-20T08:13:40.110828+0000', 'last_fullsized': '2024-01-20T08:13:40.110828+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.11 is not active+clean 2024-01-20T08:13:46.682 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.119826+0000', 'last_change': '2024-01-20T08:13:40.119826+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.119826+0000', 'last_undegraded': '2024-01-20T08:13:40.119826+0000', 'last_fullsized': '2024-01-20T08:13:40.119826+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.12 is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.119603+0000', 'last_change': '2024-01-20T08:13:40.119603+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.119603+0000', 'last_undegraded': '2024-01-20T08:13:40.119603+0000', 'last_fullsized': '2024-01-20T08:13:40.119603+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.13 is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116751+0000', 'last_change': '2024-01-20T08:13:40.116751+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116751+0000', 'last_undegraded': '2024-01-20T08:13:40.116751+0000', 'last_fullsized': '2024-01-20T08:13:40.116751+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.c is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112692+0000', 'last_change': '2024-01-20T08:13:40.112692+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112692+0000', 'last_undegraded': '2024-01-20T08:13:40.112692+0000', 'last_fullsized': '2024-01-20T08:13:40.112692+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.d is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.127354+0000', 'last_change': '2024-01-20T08:13:40.127354+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.127354+0000', 'last_undegraded': '2024-01-20T08:13:40.127354+0000', 'last_fullsized': '2024-01-20T08:13:40.127354+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.f is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.121382+0000', 'last_change': '2024-01-20T08:13:40.121382+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.121382+0000', 'last_undegraded': '2024-01-20T08:13:40.121382+0000', 'last_fullsized': '2024-01-20T08:13:40.121382+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.8 is not active+clean 2024-01-20T08:13:46.683 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.110820+0000', 'last_change': '2024-01-20T08:13:40.110820+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.110820+0000', 'last_undegraded': '2024-01-20T08:13:40.110820+0000', 'last_fullsized': '2024-01-20T08:13:40.110820+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.9 is not active+clean 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.129421+0000', 'last_change': '2024-01-20T08:13:40.129421+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.129421+0000', 'last_undegraded': '2024-01-20T08:13:40.129421+0000', 'last_fullsized': '2024-01-20T08:13:40.129421+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.a is not active+clean 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116053+0000', 'last_change': '2024-01-20T08:13:40.116053+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116053+0000', 'last_undegraded': '2024-01-20T08:13:40.116053+0000', 'last_fullsized': '2024-01-20T08:13:40.116053+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.b is not active+clean 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116227+0000', 'last_change': '2024-01-20T08:13:40.116227+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116227+0000', 'last_undegraded': '2024-01-20T08:13:40.116227+0000', 'last_fullsized': '2024-01-20T08:13:40.116227+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.4 is not active+clean 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116220+0000', 'last_change': '2024-01-20T08:13:40.116220+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116220+0000', 'last_undegraded': '2024-01-20T08:13:40.116220+0000', 'last_fullsized': '2024-01-20T08:13:40.116220+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.5 is not active+clean 2024-01-20T08:13:46.684 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.125586+0000', 'last_change': '2024-01-20T08:13:40.125586+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.125586+0000', 'last_undegraded': '2024-01-20T08:13:40.125586+0000', 'last_fullsized': '2024-01-20T08:13:40.125586+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.6 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.116973+0000', 'last_change': '2024-01-20T08:13:40.116973+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.116973+0000', 'last_undegraded': '2024-01-20T08:13:40.116973+0000', 'last_fullsized': '2024-01-20T08:13:40.116973+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.7 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118595+0000', 'last_change': '2024-01-20T08:13:40.118595+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118595+0000', 'last_undegraded': '2024-01-20T08:13:40.118595+0000', 'last_fullsized': '2024-01-20T08:13:40.118595+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.0 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.109850+0000', 'last_change': '2024-01-20T08:13:40.109850+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.109850+0000', 'last_undegraded': '2024-01-20T08:13:40.109850+0000', 'last_fullsized': '2024-01-20T08:13:40.109850+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.1 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.121559+0000', 'last_change': '2024-01-20T08:13:40.121559+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.121559+0000', 'last_undegraded': '2024-01-20T08:13:40.121559+0000', 'last_fullsized': '2024-01-20T08:13:40.121559+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.2 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.113404+0000', 'last_change': '2024-01-20T08:13:40.113404+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.113404+0000', 'last_undegraded': '2024-01-20T08:13:40.113404+0000', 'last_fullsized': '2024-01-20T08:13:40.113404+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.3 is not active+clean 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.112491+0000', 'last_change': '2024-01-20T08:13:40.112491+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.112491+0000', 'last_undegraded': '2024-01-20T08:13:40.112491+0000', 'last_fullsized': '2024-01-20T08:13:40.112491+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-01-20T08:13:46.685 INFO:tasks.cephfs.filesystem.ceph_manager:PG 15.e is not active+clean 2024-01-20T08:13:46.686 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '15.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 74, 'state': 'creating+peering', 'last_fresh': '2024-01-20T08:13:40.118570+0000', 'last_change': '2024-01-20T08:13:40.118570+0000', 'last_active': '2024-01-20T08:13:40.094839+0000', 'last_peered': '2024-01-20T08:13:40.094839+0000', 'last_clean': '2024-01-20T08:13:40.094839+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-01-20T08:13:40.118570+0000', 'last_undegraded': '2024-01-20T08:13:40.118570+0000', 'last_fullsized': '2024-01-20T08:13:40.118570+0000', 'mapping_epoch': 74, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 74, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'last_clean_scrub_stamp': '2024-01-20T08:13:40.094839+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-01-20T08:13:46.686 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-01-20T08:13:46.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.912+0000 7fcd07e00640 1 Processor -- start 2024-01-20T08:13:46.915 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.912+0000 7fcd07e00640 1 -- start start 2024-01-20T08:13:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcd0814e690 0x7fcd081550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd081581e0 0x7fcd08158670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd08158bb0 con 0x7fcd080c7e10 2024-01-20T08:13:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd08157d00 con 0x7fcd081581e0 2024-01-20T08:13:46.917 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd080c4890 con 0x7fcd0814e690 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd081581e0 0x7fcd08158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fcd081581e0 0x7fcd08158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33480/0 (socket says 172.21.15.100:33480) 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd07400640 1 -- 172.21.15.100:0/4026665904 learned_addr learned my addr 172.21.15.100:0/4026665904 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd06000640 1 --1- 172.21.15.100:0/4026665904 >> v1:172.21.15.100:6789/0 conn(0x7fcd080c7e10 0x7fcd080ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48560/0 (socket says 172.21.15.100:48560) 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.914+0000 7fcd06a00640 1 --2- 172.21.15.100:0/4026665904 >> v2:172.21.15.110:3300/0 conn(0x7fcd0814e690 0x7fcd081550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.915+0000 7fcd07400640 1 -- 172.21.15.100:0/4026665904 >> v2:172.21.15.110:3300/0 conn(0x7fcd0814e690 msgr2=0x7fcd081550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.915+0000 7fcd07400640 1 --2- 172.21.15.100:0/4026665904 >> v2:172.21.15.110:3300/0 conn(0x7fcd0814e690 0x7fcd081550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.915+0000 7fcd07400640 1 -- 172.21.15.100:0/4026665904 >> v1:172.21.15.100:6789/0 conn(0x7fcd080c7e10 legacy=0x7fcd080ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.915+0000 7fcd07400640 1 -- 172.21.15.100:0/4026665904 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0806cd00 con 0x7fcd081581e0 2024-01-20T08:13:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.915+0000 7fcd05600640 1 -- 172.21.15.100:0/4026665904 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511681287 0 0) 0x7fcd08158bb0 con 0x7fcd080c7e10 2024-01-20T08:13:46.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.916+0000 7fcd07400640 1 --2- 172.21.15.100:0/4026665904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd081581e0 0x7fcd08158670 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcd080acab0 tx=0x7fcd0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d8adff01abe3392 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.916+0000 7fcd05600640 1 -- 172.21.15.100:0/4026665904 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00031870 con 0x7fcd081581e0 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.916+0000 7fcd05600640 1 -- 172.21.15.100:0/4026665904 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd000319d0 con 0x7fcd081581e0 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.916+0000 7fcd05600640 1 -- 172.21.15.100:0/4026665904 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd00031d60 con 0x7fcd081581e0 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 -- 172.21.15.100:0/4026665904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd081581e0 msgr2=0x7fcd08158670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 --2- 172.21.15.100:0/4026665904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd081581e0 0x7fcd08158670 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7fcd080acab0 tx=0x7fcd0002b910 comp rx=0 tx=0).stop 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 -- 172.21.15.100:0/4026665904 shutdown_connections 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 --2- 172.21.15.100:0/4026665904 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd081581e0 0x7fcd08158670 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 --2- 172.21.15.100:0/4026665904 >> v2:172.21.15.110:3300/0 conn(0x7fcd0814e690 0x7fcd081550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 -- 172.21.15.100:0/4026665904 >> 172.21.15.100:0/4026665904 conn(0x7fcd08072130 msgr2=0x7fcd08072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 -- 172.21.15.100:0/4026665904 shutdown_connections 2024-01-20T08:13:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.917+0000 7fcd07e00640 1 -- 172.21.15.100:0/4026665904 wait complete. 2024-01-20T08:13:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.919+0000 7fcd07e00640 1 Processor -- start 2024-01-20T08:13:46.921 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.919+0000 7fcd07e00640 1 -- start start 2024-01-20T08:13:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd0814e690 0x7fcd081ea790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd081581e0 0x7fcd080aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.923 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080abe90 con 0x7fcd080c7e10 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd080ad810 con 0x7fcd0814e690 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd081eacd0 con 0x7fcd081581e0 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33482/0 (socket says 172.21.15.100:33482) 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 -- 172.21.15.100:0/3118181038 learned_addr learned my addr 172.21.15.100:0/3118181038 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd07400640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd081581e0 0x7fcd080aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 -- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd081581e0 msgr2=0x7fcd080aef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06000640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd0814e690 0x7fcd081ea790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd081581e0 0x7fcd080aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 -- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd0814e690 msgr2=0x7fcd081ea790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd0814e690 0x7fcd081ea790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.920+0000 7fcd06a00640 1 -- 172.21.15.100:0/3118181038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd000094d0 con 0x7fcd080c7e10 2024-01-20T08:13:46.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fcd06a00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e9e0 tx=0x7fccf000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf0009670 con 0x7fcd080c7e10 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf000c9d0 con 0x7fcd080c7e10 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf000cd80 con 0x7fcd080c7e10 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd080acc00 con 0x7fcd080c7e10 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.921+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd080ad1c0 con 0x7fcd080c7e10 2024-01-20T08:13:46.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.922+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd0804e970 con 0x7fcd080c7e10 2024-01-20T08:13:46.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.923+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fccf0013470 con 0x7fcd080c7e10 2024-01-20T08:13:46.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.924+0000 7fccff400640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 0x7fcce006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:46.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.924+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fccf0089f10 con 0x7fcd080c7e10 2024-01-20T08:13:46.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.924+0000 7fcd06000640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 0x7fcce006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:46.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.925+0000 7fcd06000640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 0x7fcce006d390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcd080af9e0 tx=0x7fccf8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:46.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:46.929+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fccf0054b10 con 0x7fcd080c7e10 2024-01-20T08:13:47.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.187+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fcd0806ca00 con 0x7fcd080c7e10 2024-01-20T08:13:47.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.188+0000 7fccff400640 1 -- 172.21.15.100:0/3118181038 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1428 (secure 0 0 0) 0x7fccf00175b0 con 0x7fcd080c7e10 2024-01-20T08:13:47.191 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:47.191 INFO:teuthology.orchestra.run.smithi100.stdout:{"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":238,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":76,"num_osds":8,"num_up_osds":8,"osd_up_since":1705738200,"num_in_osds":8,"osd_in_since":1705738192,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":129},{"state_name":"creating+peering","count":64}],"num_pgs":193,"num_pools":5,"num_objects":24,"data_bytes":594273,"bytes_used":259670016,"bytes_avail":772834443264,"bytes_total":773094113280,"inactive_pgs_ratio":0.33160620927810669},"fsmap":{"epoch":53,"id":6,"up":1,"in":1,"max":1,"id":7,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":7,"rank":0,"name":"c","status":"up:active","gid":6423},{"filesystem_id":6,"rank":0,"name":"a","status":"up:active","gid":6432}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-01-20T08:13:03.942863+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 msgr2=0x7fcce006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 0x7fcce006d390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fcd080af9e0 tx=0x7fccf8009040 comp rx=0 tx=0).stop 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 msgr2=0x7fcd08151e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7fccf000e9e0 tx=0x7fccf000eea0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 shutdown_connections 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcce006aed0 0x7fcce006d390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcd081581e0 0x7fcd080aef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcd0814e690 0x7fcd081ea790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 --2- 172.21.15.100:0/3118181038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcd080c7e10 0x7fcd08151e30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 >> 172.21.15.100:0/3118181038 conn(0x7fcd08072130 msgr2=0x7fcd0814d910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:47.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 shutdown_connections 2024-01-20T08:13:47.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.191+0000 7fcd07e00640 1 -- 172.21.15.100:0/3118181038 wait complete. 2024-01-20T08:13:47.211 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-01-20T08:13:47.211 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:47.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.382+0000 7fe517e00640 1 Processor -- start 2024-01-20T08:13:47.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.382+0000 7fe517e00640 1 -- start start 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe517e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 0x7fe5100abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe517e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe510070370 0x7fe5100c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe517e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100c1670 con 0x7fe510147f20 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe517e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100c2210 con 0x7fe510070370 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe517e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101524b0 con 0x7fe510151f60 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe515400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe510147f20 0x7fe5100c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:48570/0 (socket says 172.21.15.100:48570) 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe515400640 1 -- 172.21.15.100:0/317980981 learned_addr learned my addr 172.21.15.100:0/317980981 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.383+0000 7fe515e00640 1 --2- 172.21.15.100:0/317980981 >> v2:172.21.15.100:3300/0 conn(0x7fe510070370 0x7fe5100c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe514a00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 0x7fe5100abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe50fe00640 1 -- 172.21.15.100:0/317980981 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2843816014 0 0) 0x7fe5100c1670 con 0x7fe510147f20 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe50fe00640 1 -- 172.21.15.100:0/317980981 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4f0003520 con 0x7fe510147f20 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe515e00640 1 -- 172.21.15.100:0/317980981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 msgr2=0x7fe5100abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe515e00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 0x7fe5100abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe515e00640 1 -- 172.21.15.100:0/317980981 >> v1:172.21.15.100:6789/0 conn(0x7fe510147f20 legacy=0x7fe5100c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe515e00640 1 -- 172.21.15.100:0/317980981 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe510070820 con 0x7fe510070370 2024-01-20T08:13:47.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.384+0000 7fe514a00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 0x7fe5100abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.385+0000 7fe515e00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510070370 0x7fe5100c2c30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe5080097a0 tx=0x7fe50802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45ad351bc6723f5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.385+0000 7fe50fe00640 1 -- 172.21.15.100:0/317980981 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508031830 con 0x7fe510070370 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.385+0000 7fe50fe00640 1 -- 172.21.15.100:0/317980981 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe508031990 con 0x7fe510070370 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.385+0000 7fe50fe00640 1 -- 172.21.15.100:0/317980981 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe508031d20 con 0x7fe510070370 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 -- 172.21.15.100:0/317980981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510070370 msgr2=0x7fe5100c2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510070370 0x7fe5100c2c30 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7fe5080097a0 tx=0x7fe50802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 -- 172.21.15.100:0/317980981 shutdown_connections 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510070370 0x7fe5100c2c30 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 --2- 172.21.15.100:0/317980981 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510151f60 0x7fe5100abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 -- 172.21.15.100:0/317980981 >> 172.21.15.100:0/317980981 conn(0x7fe51006a5e0 msgr2=0x7fe51006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 -- 172.21.15.100:0/317980981 shutdown_connections 2024-01-20T08:13:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.386+0000 7fe517e00640 1 -- 172.21.15.100:0/317980981 wait complete. 2024-01-20T08:13:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.387+0000 7fe517e00640 1 Processor -- start 2024-01-20T08:13:47.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 -- start start 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510070370 0x7fe5100bb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe510151f60 0x7fe510155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101ebe10 con 0x7fe510147f20 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101ebb30 con 0x7fe510151f60 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.388+0000 7fe517e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101538e0 con 0x7fe510070370 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:33506/0 (socket says 172.21.15.100:33506) 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 -- 172.21.15.100:0/2194563423 learned_addr learned my addr 172.21.15.100:0/2194563423 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe515400640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510070370 0x7fe5100bb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 -- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510070370 msgr2=0x7fe5100bb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510070370 0x7fe5100bb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 -- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe510151f60 msgr2=0x7fe510155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe510151f60 0x7fe510155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 -- 172.21.15.100:0/2194563423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe508009400 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.389+0000 7fe514a00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c7f0 tx=0x7fe4f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.390+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8007820 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.390+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f8007980 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.390+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f8007d30 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.390+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe510153bc0 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.390+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5101529a0 con 0x7fe510147f20 2024-01-20T08:13:47.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.391+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe510153740 con 0x7fe510147f20 2024-01-20T08:13:47.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.392+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe4f80113f0 con 0x7fe510147f20 2024-01-20T08:13:47.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.393+0000 7fe50d600640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 0x7fe4e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:47.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.393+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fe4f80898f0 con 0x7fe510147f20 2024-01-20T08:13:47.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.393+0000 7fe515400640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 0x7fe4e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:47.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.394+0000 7fe515400640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 0x7fe4e806d3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5100c6eb0 tx=0x7fe500009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:47.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.397+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe510153740 con 0x7fe510147f20 2024-01-20T08:13:47.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.585+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe5100c1020 con 0x7fe4e806af00 2024-01-20T08:13:47.604 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.601+0000 7fe50d600640 1 -- 172.21.15.100:0/2194563423 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+519871 (secure 0 0 0) 0x7fe50000dc30 con 0x7fe4e806af00 2024-01-20T08:13:47.611 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:47.615 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 msgr2=0x7fe4e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 0x7fe4e806d3c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe5100c6eb0 tx=0x7fe500009040 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 msgr2=0x7fe5101eb2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800c7f0 tx=0x7fe4f800ccb0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 shutdown_connections 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe510151f60 0x7fe510155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe510147f20 0x7fe5101eb2f0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe4e806af00 0x7fe4e806d3c0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 --2- 172.21.15.100:0/2194563423 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe510070370 0x7fe5100bb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 >> 172.21.15.100:0/2194563423 conn(0x7fe51006a5e0 msgr2=0x7fe5101467d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 shutdown_connections 2024-01-20T08:13:47.617 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:47.611+0000 7fe517e00640 1 -- 172.21.15.100:0/2194563423 wait complete. 2024-01-20T08:13:47.631 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":182,"stamp":"2024-01-20T08:13:45.956782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594273,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":220,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253584,"kb_used_data":8292,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754721136,"statfs":{"total":773094113280,"available":772834443264,"internally_reserved":0,"allocated":8491008,"data_stored":4369324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001921"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118584+0000","last_change":"2024-01-20T08:13:40.118584+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118584+0000","last_undegraded":"2024-01-20T08:13:40.118584+0000","last_fullsized":"2024-01-20T08:13:40.118584+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111456+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:39.111456+0000","last_peered":"2024-01-20T08:13:39.111456+0000","last_clean":"2024-01-20T08:13:39.111456+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:39.111456+0000","last_undegraded":"2024-01-20T08:13:39.111456+0000","last_fullsized":"2024-01-20T08:13:39.111456+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123276+0000","last_change":"2024-01-20T08:13:40.123276+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123276+0000","last_undegraded":"2024-01-20T08:13:40.123276+0000","last_fullsized":"2024-01-20T08:13:40.123276+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114846+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:39.114846+0000","last_peered":"2024-01-20T08:13:39.114846+0000","last_clean":"2024-01-20T08:13:39.114846+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:39.114846+0000","last_undegraded":"2024-01-20T08:13:39.114846+0000","last_fullsized":"2024-01-20T08:13:39.114846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118942+0000","last_change":"2024-01-20T08:13:40.118942+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118942+0000","last_undegraded":"2024-01-20T08:13:40.118942+0000","last_fullsized":"2024-01-20T08:13:40.118942+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103601+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:39.103601+0000","last_peered":"2024-01-20T08:13:39.103601+0000","last_clean":"2024-01-20T08:13:39.103601+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:39.103601+0000","last_undegraded":"2024-01-20T08:13:39.103601+0000","last_fullsized":"2024-01-20T08:13:39.103601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.114079+0000","last_change":"2024-01-20T08:13:40.114079+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.114079+0000","last_undegraded":"2024-01-20T08:13:40.114079+0000","last_fullsized":"2024-01-20T08:13:40.114079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112607+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:39.112607+0000","last_peered":"2024-01-20T08:13:39.112607+0000","last_clean":"2024-01-20T08:13:39.112607+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:39.112607+0000","last_undegraded":"2024-01-20T08:13:39.112607+0000","last_fullsized":"2024-01-20T08:13:39.112607+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125859+0000","last_change":"2024-01-20T08:13:40.125859+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125859+0000","last_undegraded":"2024-01-20T08:13:40.125859+0000","last_fullsized":"2024-01-20T08:13:40.125859+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119446+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:39.119446+0000","last_peered":"2024-01-20T08:13:39.119446+0000","last_clean":"2024-01-20T08:13:39.119446+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:39.119446+0000","last_undegraded":"2024-01-20T08:13:39.119446+0000","last_fullsized":"2024-01-20T08:13:39.119446+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113241+0000","last_change":"2024-01-20T08:13:40.113241+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113241+0000","last_undegraded":"2024-01-20T08:13:40.113241+0000","last_fullsized":"2024-01-20T08:13:40.113241+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.117857+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:39.117857+0000","last_peered":"2024-01-20T08:13:39.117857+0000","last_clean":"2024-01-20T08:13:39.117857+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:39.117857+0000","last_undegraded":"2024-01-20T08:13:39.117857+0000","last_fullsized":"2024-01-20T08:13:39.117857+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125091+0000","last_change":"2024-01-20T08:13:40.125091+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125091+0000","last_undegraded":"2024-01-20T08:13:40.125091+0000","last_fullsized":"2024-01-20T08:13:40.125091+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110212+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:39.110212+0000","last_peered":"2024-01-20T08:13:39.110212+0000","last_clean":"2024-01-20T08:13:39.110212+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:39.110212+0000","last_undegraded":"2024-01-20T08:13:39.110212+0000","last_fullsized":"2024-01-20T08:13:39.110212+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.122263+0000","last_change":"2024-01-20T08:13:40.122263+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.122263+0000","last_undegraded":"2024-01-20T08:13:40.122263+0000","last_fullsized":"2024-01-20T08:13:40.122263+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116243+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:39.116243+0000","last_peered":"2024-01-20T08:13:39.116243+0000","last_clean":"2024-01-20T08:13:39.116243+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:39.116243+0000","last_undegraded":"2024-01-20T08:13:39.116243+0000","last_fullsized":"2024-01-20T08:13:39.116243+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128279+0000","last_change":"2024-01-20T08:13:40.128279+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128279+0000","last_undegraded":"2024-01-20T08:13:40.128279+0000","last_fullsized":"2024-01-20T08:13:40.128279+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118816+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:39.118816+0000","last_peered":"2024-01-20T08:13:39.118816+0000","last_clean":"2024-01-20T08:13:39.118816+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:39.118816+0000","last_undegraded":"2024-01-20T08:13:39.118816+0000","last_fullsized":"2024-01-20T08:13:39.118816+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113123+0000","last_change":"2024-01-20T08:13:40.113123+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113123+0000","last_undegraded":"2024-01-20T08:13:40.113123+0000","last_fullsized":"2024-01-20T08:13:40.113123+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110889+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:39.110889+0000","last_peered":"2024-01-20T08:13:39.110889+0000","last_clean":"2024-01-20T08:13:39.110889+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:39.110889+0000","last_undegraded":"2024-01-20T08:13:39.110889+0000","last_fullsized":"2024-01-20T08:13:39.110889+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113777+0000","last_change":"2024-01-20T08:13:40.113777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113777+0000","last_undegraded":"2024-01-20T08:13:40.113777+0000","last_fullsized":"2024-01-20T08:13:40.113777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114346+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:39.114346+0000","last_peered":"2024-01-20T08:13:39.114346+0000","last_clean":"2024-01-20T08:13:39.114346+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:39.114346+0000","last_undegraded":"2024-01-20T08:13:39.114346+0000","last_fullsized":"2024-01-20T08:13:39.114346+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119078+0000","last_change":"2024-01-20T08:13:40.119078+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119078+0000","last_undegraded":"2024-01-20T08:13:40.119078+0000","last_fullsized":"2024-01-20T08:13:40.119078+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110189+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:39.110189+0000","last_peered":"2024-01-20T08:13:39.110189+0000","last_clean":"2024-01-20T08:13:39.110189+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:39.110189+0000","last_undegraded":"2024-01-20T08:13:39.110189+0000","last_fullsized":"2024-01-20T08:13:39.110189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123258+0000","last_change":"2024-01-20T08:13:40.123258+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123258+0000","last_undegraded":"2024-01-20T08:13:40.123258+0000","last_fullsized":"2024-01-20T08:13:40.123258+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103069+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:39.103069+0000","last_peered":"2024-01-20T08:13:39.103069+0000","last_clean":"2024-01-20T08:13:39.103069+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:39.103069+0000","last_undegraded":"2024-01-20T08:13:39.103069+0000","last_fullsized":"2024-01-20T08:13:39.103069+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.124661+0000","last_change":"2024-01-20T08:13:40.124661+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.124661+0000","last_undegraded":"2024-01-20T08:13:40.124661+0000","last_fullsized":"2024-01-20T08:13:40.124661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111206+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:39.111206+0000","last_peered":"2024-01-20T08:13:39.111206+0000","last_clean":"2024-01-20T08:13:39.111206+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:39.111206+0000","last_undegraded":"2024-01-20T08:13:39.111206+0000","last_fullsized":"2024-01-20T08:13:39.111206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118369+0000","last_change":"2024-01-20T08:13:40.118369+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118369+0000","last_undegraded":"2024-01-20T08:13:40.118369+0000","last_fullsized":"2024-01-20T08:13:40.118369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109905+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:39.109905+0000","last_peered":"2024-01-20T08:13:39.109905+0000","last_clean":"2024-01-20T08:13:39.109905+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:39.109905+0000","last_undegraded":"2024-01-20T08:13:39.109905+0000","last_fullsized":"2024-01-20T08:13:39.109905+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120267+0000","last_change":"2024-01-20T08:13:40.120267+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120267+0000","last_undegraded":"2024-01-20T08:13:40.120267+0000","last_fullsized":"2024-01-20T08:13:40.120267+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119099+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:39.119099+0000","last_peered":"2024-01-20T08:13:39.119099+0000","last_clean":"2024-01-20T08:13:39.119099+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:39.119099+0000","last_undegraded":"2024-01-20T08:13:39.119099+0000","last_fullsized":"2024-01-20T08:13:39.119099+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118107+0000","last_change":"2024-01-20T08:13:40.118107+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118107+0000","last_undegraded":"2024-01-20T08:13:40.118107+0000","last_fullsized":"2024-01-20T08:13:40.118107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119911+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:39.119911+0000","last_peered":"2024-01-20T08:13:39.119911+0000","last_clean":"2024-01-20T08:13:39.119911+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:39.119911+0000","last_undegraded":"2024-01-20T08:13:39.119911+0000","last_fullsized":"2024-01-20T08:13:39.119911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112004+0000","last_change":"2024-01-20T08:13:40.112004+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112004+0000","last_undegraded":"2024-01-20T08:13:40.112004+0000","last_fullsized":"2024-01-20T08:13:40.112004+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115407+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:39.115407+0000","last_peered":"2024-01-20T08:13:39.115407+0000","last_clean":"2024-01-20T08:13:39.115407+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:39.115407+0000","last_undegraded":"2024-01-20T08:13:39.115407+0000","last_fullsized":"2024-01-20T08:13:39.115407+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113747+0000","last_change":"2024-01-20T08:13:40.113747+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113747+0000","last_undegraded":"2024-01-20T08:13:40.113747+0000","last_fullsized":"2024-01-20T08:13:40.113747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102437+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:39.102437+0000","last_peered":"2024-01-20T08:13:39.102437+0000","last_clean":"2024-01-20T08:13:39.102437+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:39.102437+0000","last_undegraded":"2024-01-20T08:13:39.102437+0000","last_fullsized":"2024-01-20T08:13:39.102437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118010+0000","last_change":"2024-01-20T08:13:40.118010+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118010+0000","last_undegraded":"2024-01-20T08:13:40.118010+0000","last_fullsized":"2024-01-20T08:13:40.118010+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112780+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:39.112780+0000","last_peered":"2024-01-20T08:13:39.112780+0000","last_clean":"2024-01-20T08:13:39.112780+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:39.112780+0000","last_undegraded":"2024-01-20T08:13:39.112780+0000","last_fullsized":"2024-01-20T08:13:39.112780+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112226+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:39.112226+0000","last_peered":"2024-01-20T08:13:39.112226+0000","last_clean":"2024-01-20T08:13:39.112226+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:39.112226+0000","last_undegraded":"2024-01-20T08:13:39.112226+0000","last_fullsized":"2024-01-20T08:13:39.112226+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.123643+0000","last_change":"2024-01-20T08:13:40.123643+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.123643+0000","last_undegraded":"2024-01-20T08:13:40.123643+0000","last_fullsized":"2024-01-20T08:13:40.123643+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114017+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:39.114017+0000","last_peered":"2024-01-20T08:13:39.114017+0000","last_clean":"2024-01-20T08:13:39.114017+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:39.114017+0000","last_undegraded":"2024-01-20T08:13:39.114017+0000","last_fullsized":"2024-01-20T08:13:39.114017+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117525+0000","last_change":"2024-01-20T08:13:40.117525+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117525+0000","last_undegraded":"2024-01-20T08:13:40.117525+0000","last_fullsized":"2024-01-20T08:13:40.117525+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108503+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:39.108503+0000","last_peered":"2024-01-20T08:13:39.108503+0000","last_clean":"2024-01-20T08:13:39.108503+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:39.108503+0000","last_undegraded":"2024-01-20T08:13:39.108503+0000","last_fullsized":"2024-01-20T08:13:39.108503+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113839+0000","last_change":"2024-01-20T08:13:40.113839+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113839+0000","last_undegraded":"2024-01-20T08:13:40.113839+0000","last_fullsized":"2024-01-20T08:13:40.113839+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109570+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:39.109570+0000","last_peered":"2024-01-20T08:13:39.109570+0000","last_clean":"2024-01-20T08:13:39.109570+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:39.109570+0000","last_undegraded":"2024-01-20T08:13:39.109570+0000","last_fullsized":"2024-01-20T08:13:39.109570+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126896+0000","last_change":"2024-01-20T08:13:40.126896+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126896+0000","last_undegraded":"2024-01-20T08:13:40.126896+0000","last_fullsized":"2024-01-20T08:13:40.126896+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115377+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:39.115377+0000","last_peered":"2024-01-20T08:13:39.115377+0000","last_clean":"2024-01-20T08:13:39.115377+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:39.115377+0000","last_undegraded":"2024-01-20T08:13:39.115377+0000","last_fullsized":"2024-01-20T08:13:39.115377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120314+0000","last_change":"2024-01-20T08:13:40.120314+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120314+0000","last_undegraded":"2024-01-20T08:13:40.120314+0000","last_fullsized":"2024-01-20T08:13:40.120314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105160+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:39.105160+0000","last_peered":"2024-01-20T08:13:39.105160+0000","last_clean":"2024-01-20T08:13:39.105160+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:39.105160+0000","last_undegraded":"2024-01-20T08:13:39.105160+0000","last_fullsized":"2024-01-20T08:13:39.105160+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120673+0000","last_change":"2024-01-20T08:13:40.120673+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120673+0000","last_undegraded":"2024-01-20T08:13:40.120673+0000","last_fullsized":"2024-01-20T08:13:40.120673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119803+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:39.119803+0000","last_peered":"2024-01-20T08:13:39.119803+0000","last_clean":"2024-01-20T08:13:39.119803+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:39.119803+0000","last_undegraded":"2024-01-20T08:13:39.119803+0000","last_fullsized":"2024-01-20T08:13:39.119803+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113518+0000","last_change":"2024-01-20T08:13:40.113518+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113518+0000","last_undegraded":"2024-01-20T08:13:40.113518+0000","last_fullsized":"2024-01-20T08:13:40.113518+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110459+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:39.110459+0000","last_peered":"2024-01-20T08:13:39.110459+0000","last_clean":"2024-01-20T08:13:39.110459+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:39.110459+0000","last_undegraded":"2024-01-20T08:13:39.110459+0000","last_fullsized":"2024-01-20T08:13:39.110459+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.120384+0000","last_change":"2024-01-20T08:13:40.120384+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.120384+0000","last_undegraded":"2024-01-20T08:13:40.120384+0000","last_fullsized":"2024-01-20T08:13:40.120384+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113620+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:39.113620+0000","last_peered":"2024-01-20T08:13:39.113620+0000","last_clean":"2024-01-20T08:13:39.113620+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:39.113620+0000","last_undegraded":"2024-01-20T08:13:39.113620+0000","last_fullsized":"2024-01-20T08:13:39.113620+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115829+0000","last_change":"2024-01-20T08:13:40.115829+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115829+0000","last_undegraded":"2024-01-20T08:13:40.115829+0000","last_fullsized":"2024-01-20T08:13:40.115829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113711+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:39.113711+0000","last_peered":"2024-01-20T08:13:39.113711+0000","last_clean":"2024-01-20T08:13:39.113711+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:39.113711+0000","last_undegraded":"2024-01-20T08:13:39.113711+0000","last_fullsized":"2024-01-20T08:13:39.113711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112697+0000","last_change":"2024-01-20T08:13:40.112697+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112697+0000","last_undegraded":"2024-01-20T08:13:40.112697+0000","last_fullsized":"2024-01-20T08:13:40.112697+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119320+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:39.119320+0000","last_peered":"2024-01-20T08:13:39.119320+0000","last_clean":"2024-01-20T08:13:39.119320+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:39.119320+0000","last_undegraded":"2024-01-20T08:13:39.119320+0000","last_fullsized":"2024-01-20T08:13:39.119320+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117245+0000","last_change":"2024-01-20T08:13:40.117245+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117245+0000","last_undegraded":"2024-01-20T08:13:40.117245+0000","last_fullsized":"2024-01-20T08:13:40.117245+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.107896+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:39.107896+0000","last_peered":"2024-01-20T08:13:39.107896+0000","last_clean":"2024-01-20T08:13:39.107896+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:39.107896+0000","last_undegraded":"2024-01-20T08:13:39.107896+0000","last_fullsized":"2024-01-20T08:13:39.107896+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116777+0000","last_change":"2024-01-20T08:13:40.116777+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116777+0000","last_undegraded":"2024-01-20T08:13:40.116777+0000","last_fullsized":"2024-01-20T08:13:40.116777+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136687+0000","last_change":"2024-01-20T08:13:40.129620+0000","last_active":"2024-01-20T08:13:40.136687+0000","last_peered":"2024-01-20T08:13:40.136687+0000","last_clean":"2024-01-20T08:13:40.136687+0000","last_became_active":"2024-01-20T08:13:40.129373+0000","last_became_peered":"2024-01-20T08:13:40.129373+0000","last_unstale":"2024-01-20T08:13:40.136687+0000","last_undegraded":"2024-01-20T08:13:40.136687+0000","last_fullsized":"2024-01-20T08:13:40.136687+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120224+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:39.120224+0000","last_peered":"2024-01-20T08:13:39.120224+0000","last_clean":"2024-01-20T08:13:39.120224+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:39.120224+0000","last_undegraded":"2024-01-20T08:13:39.120224+0000","last_fullsized":"2024-01-20T08:13:39.120224+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":18,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111817+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:39.111817+0000","last_peered":"2024-01-20T08:13:39.111817+0000","last_clean":"2024-01-20T08:13:39.111817+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:39.111817+0000","last_undegraded":"2024-01-20T08:13:39.111817+0000","last_fullsized":"2024-01-20T08:13:39.111817+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113112+0000","last_change":"2024-01-20T08:13:40.113112+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113112+0000","last_undegraded":"2024-01-20T08:13:40.113112+0000","last_fullsized":"2024-01-20T08:13:40.113112+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140960+0000","last_change":"2024-01-20T08:13:40.136955+0000","last_active":"2024-01-20T08:13:40.140960+0000","last_peered":"2024-01-20T08:13:40.140960+0000","last_clean":"2024-01-20T08:13:40.140960+0000","last_became_active":"2024-01-20T08:13:40.136627+0000","last_became_peered":"2024-01-20T08:13:40.136627+0000","last_unstale":"2024-01-20T08:13:40.140960+0000","last_undegraded":"2024-01-20T08:13:40.140960+0000","last_fullsized":"2024-01-20T08:13:40.140960+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:55:58.292868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111524+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:39.111524+0000","last_peered":"2024-01-20T08:13:39.111524+0000","last_clean":"2024-01-20T08:13:39.111524+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:39.111524+0000","last_undegraded":"2024-01-20T08:13:39.111524+0000","last_fullsized":"2024-01-20T08:13:39.111524+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120411+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:39.120411+0000","last_peered":"2024-01-20T08:13:39.120411+0000","last_clean":"2024-01-20T08:13:39.120411+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:39.120411+0000","last_undegraded":"2024-01-20T08:13:39.120411+0000","last_fullsized":"2024-01-20T08:13:39.120411+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119163+0000","last_change":"2024-01-20T08:13:40.119163+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119163+0000","last_undegraded":"2024-01-20T08:13:40.119163+0000","last_fullsized":"2024-01-20T08:13:40.119163+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143290+0000","last_change":"2024-01-20T08:13:40.140777+0000","last_active":"2024-01-20T08:13:40.143290+0000","last_peered":"2024-01-20T08:13:40.143290+0000","last_clean":"2024-01-20T08:13:40.143290+0000","last_became_active":"2024-01-20T08:13:40.140148+0000","last_became_peered":"2024-01-20T08:13:40.140148+0000","last_unstale":"2024-01-20T08:13:40.143290+0000","last_undegraded":"2024-01-20T08:13:40.143290+0000","last_fullsized":"2024-01-20T08:13:40.143290+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110747+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:39.110747+0000","last_peered":"2024-01-20T08:13:39.110747+0000","last_clean":"2024-01-20T08:13:39.110747+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:39.110747+0000","last_undegraded":"2024-01-20T08:13:39.110747+0000","last_fullsized":"2024-01-20T08:13:39.110747+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102651+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:39.102651+0000","last_peered":"2024-01-20T08:13:39.102651+0000","last_clean":"2024-01-20T08:13:39.102651+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:39.102651+0000","last_undegraded":"2024-01-20T08:13:39.102651+0000","last_fullsized":"2024-01-20T08:13:39.102651+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118629+0000","last_change":"2024-01-20T08:13:40.118629+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118629+0000","last_undegraded":"2024-01-20T08:13:40.118629+0000","last_fullsized":"2024-01-20T08:13:40.118629+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137159+0000","last_change":"2024-01-20T08:13:40.134139+0000","last_active":"2024-01-20T08:13:40.137159+0000","last_peered":"2024-01-20T08:13:40.137159+0000","last_clean":"2024-01-20T08:13:40.137159+0000","last_became_active":"2024-01-20T08:13:40.133632+0000","last_became_peered":"2024-01-20T08:13:40.133632+0000","last_unstale":"2024-01-20T08:13:40.137159+0000","last_undegraded":"2024-01-20T08:13:40.137159+0000","last_fullsized":"2024-01-20T08:13:40.137159+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:29.810188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103924+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:39.103924+0000","last_peered":"2024-01-20T08:13:39.103924+0000","last_clean":"2024-01-20T08:13:39.103924+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:39.103924+0000","last_undegraded":"2024-01-20T08:13:39.103924+0000","last_fullsized":"2024-01-20T08:13:39.103924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102513+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:39.102513+0000","last_peered":"2024-01-20T08:13:39.102513+0000","last_clean":"2024-01-20T08:13:39.102513+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:39.102513+0000","last_undegraded":"2024-01-20T08:13:39.102513+0000","last_fullsized":"2024-01-20T08:13:39.102513+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.115669+0000","last_change":"2024-01-20T08:13:40.115669+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.115669+0000","last_undegraded":"2024-01-20T08:13:40.115669+0000","last_fullsized":"2024-01-20T08:13:40.115669+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142460+0000","last_change":"2024-01-20T08:13:40.141034+0000","last_active":"2024-01-20T08:13:40.142460+0000","last_peered":"2024-01-20T08:13:40.142460+0000","last_clean":"2024-01-20T08:13:40.142460+0000","last_became_active":"2024-01-20T08:13:40.140116+0000","last_became_peered":"2024-01-20T08:13:40.140116+0000","last_unstale":"2024-01-20T08:13:40.142460+0000","last_undegraded":"2024-01-20T08:13:40.142460+0000","last_fullsized":"2024-01-20T08:13:40.142460+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:48:54.354251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113825+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:39.113825+0000","last_peered":"2024-01-20T08:13:39.113825+0000","last_clean":"2024-01-20T08:13:39.113825+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:39.113825+0000","last_undegraded":"2024-01-20T08:13:39.113825+0000","last_fullsized":"2024-01-20T08:13:39.113825+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119771+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:39.119771+0000","last_peered":"2024-01-20T08:13:39.119771+0000","last_clean":"2024-01-20T08:13:39.119771+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:39.119771+0000","last_undegraded":"2024-01-20T08:13:39.119771+0000","last_fullsized":"2024-01-20T08:13:39.119771+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.111329+0000","last_change":"2024-01-20T08:13:40.111329+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.111329+0000","last_undegraded":"2024-01-20T08:13:40.111329+0000","last_fullsized":"2024-01-20T08:13:40.111329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142906+0000","last_change":"2024-01-20T08:13:40.138670+0000","last_active":"2024-01-20T08:13:40.142906+0000","last_peered":"2024-01-20T08:13:40.142906+0000","last_clean":"2024-01-20T08:13:40.142906+0000","last_became_active":"2024-01-20T08:13:40.138225+0000","last_became_peered":"2024-01-20T08:13:40.138225+0000","last_unstale":"2024-01-20T08:13:40.142906+0000","last_undegraded":"2024-01-20T08:13:40.142906+0000","last_fullsized":"2024-01-20T08:13:40.142906+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:31.079661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119512+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:39.119512+0000","last_peered":"2024-01-20T08:13:39.119512+0000","last_clean":"2024-01-20T08:13:39.119512+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:39.119512+0000","last_undegraded":"2024-01-20T08:13:39.119512+0000","last_fullsized":"2024-01-20T08:13:39.119512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119392+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:39.119392+0000","last_peered":"2024-01-20T08:13:39.119392+0000","last_clean":"2024-01-20T08:13:39.119392+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:39.119392+0000","last_undegraded":"2024-01-20T08:13:39.119392+0000","last_fullsized":"2024-01-20T08:13:39.119392+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113950+0000","last_change":"2024-01-20T08:13:40.113950+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113950+0000","last_undegraded":"2024-01-20T08:13:40.113950+0000","last_fullsized":"2024-01-20T08:13:40.113950+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142864+0000","last_change":"2024-01-20T08:13:40.138470+0000","last_active":"2024-01-20T08:13:40.142864+0000","last_peered":"2024-01-20T08:13:40.142864+0000","last_clean":"2024-01-20T08:13:40.142864+0000","last_became_active":"2024-01-20T08:13:40.138199+0000","last_became_peered":"2024-01-20T08:13:40.138199+0000","last_unstale":"2024-01-20T08:13:40.142864+0000","last_undegraded":"2024-01-20T08:13:40.142864+0000","last_fullsized":"2024-01-20T08:13:40.142864+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:52:28.806346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102391+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:39.102391+0000","last_peered":"2024-01-20T08:13:39.102391+0000","last_clean":"2024-01-20T08:13:39.102391+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:39.102391+0000","last_undegraded":"2024-01-20T08:13:39.102391+0000","last_fullsized":"2024-01-20T08:13:39.102391+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103156+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:39.103156+0000","last_peered":"2024-01-20T08:13:39.103156+0000","last_clean":"2024-01-20T08:13:39.103156+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:39.103156+0000","last_undegraded":"2024-01-20T08:13:39.103156+0000","last_fullsized":"2024-01-20T08:13:39.103156+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.126904+0000","last_change":"2024-01-20T08:13:40.126904+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.126904+0000","last_undegraded":"2024-01-20T08:13:40.126904+0000","last_fullsized":"2024-01-20T08:13:40.126904+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136784+0000","last_change":"2024-01-20T08:13:40.129368+0000","last_active":"2024-01-20T08:13:40.136784+0000","last_peered":"2024-01-20T08:13:40.136784+0000","last_clean":"2024-01-20T08:13:40.136784+0000","last_became_active":"2024-01-20T08:13:40.129051+0000","last_became_peered":"2024-01-20T08:13:40.129051+0000","last_unstale":"2024-01-20T08:13:40.136784+0000","last_undegraded":"2024-01-20T08:13:40.136784+0000","last_fullsized":"2024-01-20T08:13:40.136784+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109983+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:39.109983+0000","last_peered":"2024-01-20T08:13:39.109983+0000","last_clean":"2024-01-20T08:13:39.109983+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:39.109983+0000","last_undegraded":"2024-01-20T08:13:39.109983+0000","last_fullsized":"2024-01-20T08:13:39.109983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112971+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:39.112971+0000","last_peered":"2024-01-20T08:13:39.112971+0000","last_clean":"2024-01-20T08:13:39.112971+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:39.112971+0000","last_undegraded":"2024-01-20T08:13:39.112971+0000","last_fullsized":"2024-01-20T08:13:39.112971+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.128740+0000","last_change":"2024-01-20T08:13:40.128740+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.128740+0000","last_undegraded":"2024-01-20T08:13:40.128740+0000","last_fullsized":"2024-01-20T08:13:40.128740+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142554+0000","last_change":"2024-01-20T08:13:40.141046+0000","last_active":"2024-01-20T08:13:40.142554+0000","last_peered":"2024-01-20T08:13:40.142554+0000","last_clean":"2024-01-20T08:13:40.142554+0000","last_became_active":"2024-01-20T08:13:40.140753+0000","last_became_peered":"2024-01-20T08:13:40.140753+0000","last_unstale":"2024-01-20T08:13:40.142554+0000","last_undegraded":"2024-01-20T08:13:40.142554+0000","last_fullsized":"2024-01-20T08:13:40.142554+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113375+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:39.113375+0000","last_peered":"2024-01-20T08:13:39.113375+0000","last_clean":"2024-01-20T08:13:39.113375+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:39.113375+0000","last_undegraded":"2024-01-20T08:13:39.113375+0000","last_fullsized":"2024-01-20T08:13:39.113375+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112006+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:39.112006+0000","last_peered":"2024-01-20T08:13:39.112006+0000","last_clean":"2024-01-20T08:13:39.112006+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:39.112006+0000","last_undegraded":"2024-01-20T08:13:39.112006+0000","last_fullsized":"2024-01-20T08:13:39.112006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127813+0000","last_change":"2024-01-20T08:13:40.127813+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127813+0000","last_undegraded":"2024-01-20T08:13:40.127813+0000","last_fullsized":"2024-01-20T08:13:40.127813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142007+0000","last_change":"2024-01-20T08:13:40.139406+0000","last_active":"2024-01-20T08:13:40.142007+0000","last_peered":"2024-01-20T08:13:40.142007+0000","last_clean":"2024-01-20T08:13:40.142007+0000","last_became_active":"2024-01-20T08:13:40.139147+0000","last_became_peered":"2024-01-20T08:13:40.139147+0000","last_unstale":"2024-01-20T08:13:40.142007+0000","last_undegraded":"2024-01-20T08:13:40.142007+0000","last_fullsized":"2024-01-20T08:13:40.142007+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118859+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:39.118859+0000","last_peered":"2024-01-20T08:13:39.118859+0000","last_clean":"2024-01-20T08:13:39.118859+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:39.118859+0000","last_undegraded":"2024-01-20T08:13:39.118859+0000","last_fullsized":"2024-01-20T08:13:39.118859+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111115+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:39.111115+0000","last_peered":"2024-01-20T08:13:39.111115+0000","last_clean":"2024-01-20T08:13:39.111115+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:39.111115+0000","last_undegraded":"2024-01-20T08:13:39.111115+0000","last_fullsized":"2024-01-20T08:13:39.111115+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.117535+0000","last_change":"2024-01-20T08:13:40.117535+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.117535+0000","last_undegraded":"2024-01-20T08:13:40.117535+0000","last_fullsized":"2024-01-20T08:13:40.117535+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137874+0000","last_change":"2024-01-20T08:13:40.135173+0000","last_active":"2024-01-20T08:13:40.137874+0000","last_peered":"2024-01-20T08:13:40.137874+0000","last_clean":"2024-01-20T08:13:40.137874+0000","last_became_active":"2024-01-20T08:13:40.134749+0000","last_became_peered":"2024-01-20T08:13:40.134749+0000","last_unstale":"2024-01-20T08:13:40.137874+0000","last_undegraded":"2024-01-20T08:13:40.137874+0000","last_fullsized":"2024-01-20T08:13:40.137874+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:26.623922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102483+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:39.102483+0000","last_peered":"2024-01-20T08:13:39.102483+0000","last_clean":"2024-01-20T08:13:39.102483+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:39.102483+0000","last_undegraded":"2024-01-20T08:13:39.102483+0000","last_fullsized":"2024-01-20T08:13:39.102483+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":17,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109714+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:39.109714+0000","last_peered":"2024-01-20T08:13:39.109714+0000","last_clean":"2024-01-20T08:13:39.109714+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:39.109714+0000","last_undegraded":"2024-01-20T08:13:39.109714+0000","last_fullsized":"2024-01-20T08:13:39.109714+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112325+0000","last_change":"2024-01-20T08:13:40.112325+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112325+0000","last_undegraded":"2024-01-20T08:13:40.112325+0000","last_fullsized":"2024-01-20T08:13:40.112325+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143620+0000","last_change":"2024-01-20T08:13:40.140385+0000","last_active":"2024-01-20T08:13:40.143620+0000","last_peered":"2024-01-20T08:13:40.143620+0000","last_clean":"2024-01-20T08:13:40.143620+0000","last_became_active":"2024-01-20T08:13:40.140136+0000","last_became_peered":"2024-01-20T08:13:40.140136+0000","last_unstale":"2024-01-20T08:13:40.143620+0000","last_undegraded":"2024-01-20T08:13:40.143620+0000","last_fullsized":"2024-01-20T08:13:40.143620+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:50.287743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119990+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:39.119990+0000","last_peered":"2024-01-20T08:13:39.119990+0000","last_clean":"2024-01-20T08:13:39.119990+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:39.119990+0000","last_undegraded":"2024-01-20T08:13:39.119990+0000","last_fullsized":"2024-01-20T08:13:39.119990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"72'9","reported_seq":23,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116753+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:39.116753+0000","last_peered":"2024-01-20T08:13:39.116753+0000","last_clean":"2024-01-20T08:13:39.116753+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:39.116753+0000","last_undegraded":"2024-01-20T08:13:39.116753+0000","last_fullsized":"2024-01-20T08:13:39.116753+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110828+0000","last_change":"2024-01-20T08:13:40.110828+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110828+0000","last_undegraded":"2024-01-20T08:13:40.110828+0000","last_fullsized":"2024-01-20T08:13:40.110828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141981+0000","last_change":"2024-01-20T08:13:40.138835+0000","last_active":"2024-01-20T08:13:40.141981+0000","last_peered":"2024-01-20T08:13:40.141981+0000","last_clean":"2024-01-20T08:13:40.141981+0000","last_became_active":"2024-01-20T08:13:40.138570+0000","last_became_peered":"2024-01-20T08:13:40.138570+0000","last_unstale":"2024-01-20T08:13:40.141981+0000","last_undegraded":"2024-01-20T08:13:40.141981+0000","last_fullsized":"2024-01-20T08:13:40.141981+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103072+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:39.103072+0000","last_peered":"2024-01-20T08:13:39.103072+0000","last_clean":"2024-01-20T08:13:39.103072+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:39.103072+0000","last_undegraded":"2024-01-20T08:13:39.103072+0000","last_fullsized":"2024-01-20T08:13:39.103072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113766+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:39.113766+0000","last_peered":"2024-01-20T08:13:39.113766+0000","last_clean":"2024-01-20T08:13:39.113766+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:39.113766+0000","last_undegraded":"2024-01-20T08:13:39.113766+0000","last_fullsized":"2024-01-20T08:13:39.113766+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119826+0000","last_change":"2024-01-20T08:13:40.119826+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119826+0000","last_undegraded":"2024-01-20T08:13:40.119826+0000","last_fullsized":"2024-01-20T08:13:40.119826+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.137609+0000","last_change":"2024-01-20T08:13:40.134405+0000","last_active":"2024-01-20T08:13:40.137609+0000","last_peered":"2024-01-20T08:13:40.137609+0000","last_clean":"2024-01-20T08:13:40.137609+0000","last_became_active":"2024-01-20T08:13:40.134151+0000","last_became_peered":"2024-01-20T08:13:40.134151+0000","last_unstale":"2024-01-20T08:13:40.137609+0000","last_undegraded":"2024-01-20T08:13:40.137609+0000","last_fullsized":"2024-01-20T08:13:40.137609+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:15:13.377556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.103139+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:39.103139+0000","last_peered":"2024-01-20T08:13:39.103139+0000","last_clean":"2024-01-20T08:13:39.103139+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:39.103139+0000","last_undegraded":"2024-01-20T08:13:39.103139+0000","last_fullsized":"2024-01-20T08:13:39.103139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109723+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:39.109723+0000","last_peered":"2024-01-20T08:13:39.109723+0000","last_clean":"2024-01-20T08:13:39.109723+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:39.109723+0000","last_undegraded":"2024-01-20T08:13:39.109723+0000","last_fullsized":"2024-01-20T08:13:39.109723+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.119603+0000","last_change":"2024-01-20T08:13:40.119603+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.119603+0000","last_undegraded":"2024-01-20T08:13:40.119603+0000","last_fullsized":"2024-01-20T08:13:40.119603+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.136384+0000","last_change":"2024-01-20T08:13:40.131252+0000","last_active":"2024-01-20T08:13:40.136384+0000","last_peered":"2024-01-20T08:13:40.136384+0000","last_clean":"2024-01-20T08:13:40.136384+0000","last_became_active":"2024-01-20T08:13:40.130235+0000","last_became_peered":"2024-01-20T08:13:40.130235+0000","last_unstale":"2024-01-20T08:13:40.136384+0000","last_undegraded":"2024-01-20T08:13:40.136384+0000","last_fullsized":"2024-01-20T08:13:40.136384+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:49:12.348000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112931+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:39.112931+0000","last_peered":"2024-01-20T08:13:39.112931+0000","last_clean":"2024-01-20T08:13:39.112931+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:39.112931+0000","last_undegraded":"2024-01-20T08:13:39.112931+0000","last_fullsized":"2024-01-20T08:13:39.112931+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115255+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:39.115255+0000","last_peered":"2024-01-20T08:13:39.115255+0000","last_clean":"2024-01-20T08:13:39.115255+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:39.115255+0000","last_undegraded":"2024-01-20T08:13:39.115255+0000","last_fullsized":"2024-01-20T08:13:39.115255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116751+0000","last_change":"2024-01-20T08:13:40.116751+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116751+0000","last_undegraded":"2024-01-20T08:13:40.116751+0000","last_fullsized":"2024-01-20T08:13:40.116751+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132386+0000","last_change":"2024-01-20T08:13:40.124952+0000","last_active":"2024-01-20T08:13:40.132386+0000","last_peered":"2024-01-20T08:13:40.132386+0000","last_clean":"2024-01-20T08:13:40.132386+0000","last_became_active":"2024-01-20T08:13:40.124408+0000","last_became_peered":"2024-01-20T08:13:40.124408+0000","last_unstale":"2024-01-20T08:13:40.132386+0000","last_undegraded":"2024-01-20T08:13:40.132386+0000","last_fullsized":"2024-01-20T08:13:40.132386+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:24.693203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113095+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:39.113095+0000","last_peered":"2024-01-20T08:13:39.113095+0000","last_clean":"2024-01-20T08:13:39.113095+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:39.113095+0000","last_undegraded":"2024-01-20T08:13:39.113095+0000","last_fullsized":"2024-01-20T08:13:39.113095+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":22,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102137+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:39.102137+0000","last_peered":"2024-01-20T08:13:39.102137+0000","last_clean":"2024-01-20T08:13:39.102137+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:39.102137+0000","last_undegraded":"2024-01-20T08:13:39.102137+0000","last_fullsized":"2024-01-20T08:13:39.102137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112692+0000","last_change":"2024-01-20T08:13:40.112692+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112692+0000","last_undegraded":"2024-01-20T08:13:40.112692+0000","last_fullsized":"2024-01-20T08:13:40.112692+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141565+0000","last_change":"2024-01-20T08:13:40.137508+0000","last_active":"2024-01-20T08:13:40.141565+0000","last_peered":"2024-01-20T08:13:40.141565+0000","last_clean":"2024-01-20T08:13:40.141565+0000","last_became_active":"2024-01-20T08:13:40.137164+0000","last_became_peered":"2024-01-20T08:13:40.137164+0000","last_unstale":"2024-01-20T08:13:40.141565+0000","last_undegraded":"2024-01-20T08:13:40.141565+0000","last_fullsized":"2024-01-20T08:13:40.141565+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.105715+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:39.105715+0000","last_peered":"2024-01-20T08:13:39.105715+0000","last_clean":"2024-01-20T08:13:39.105715+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:39.105715+0000","last_undegraded":"2024-01-20T08:13:39.105715+0000","last_fullsized":"2024-01-20T08:13:39.105715+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112445+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:39.112445+0000","last_peered":"2024-01-20T08:13:39.112445+0000","last_clean":"2024-01-20T08:13:39.112445+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:39.112445+0000","last_undegraded":"2024-01-20T08:13:39.112445+0000","last_fullsized":"2024-01-20T08:13:39.112445+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.127354+0000","last_change":"2024-01-20T08:13:40.127354+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.127354+0000","last_undegraded":"2024-01-20T08:13:40.127354+0000","last_fullsized":"2024-01-20T08:13:40.127354+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139223+0000","last_change":"2024-01-20T08:13:40.132877+0000","last_active":"2024-01-20T08:13:40.139223+0000","last_peered":"2024-01-20T08:13:40.139223+0000","last_clean":"2024-01-20T08:13:40.139223+0000","last_became_active":"2024-01-20T08:13:40.132593+0000","last_became_peered":"2024-01-20T08:13:40.132593+0000","last_unstale":"2024-01-20T08:13:40.139223+0000","last_undegraded":"2024-01-20T08:13:40.139223+0000","last_fullsized":"2024-01-20T08:13:40.139223+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:58:11.124723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111745+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:39.111745+0000","last_peered":"2024-01-20T08:13:39.111745+0000","last_clean":"2024-01-20T08:13:39.111745+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:39.111745+0000","last_undegraded":"2024-01-20T08:13:39.111745+0000","last_fullsized":"2024-01-20T08:13:39.111745+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102808+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:39.102808+0000","last_peered":"2024-01-20T08:13:39.102808+0000","last_clean":"2024-01-20T08:13:39.102808+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:39.102808+0000","last_undegraded":"2024-01-20T08:13:39.102808+0000","last_fullsized":"2024-01-20T08:13:39.102808+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121382+0000","last_change":"2024-01-20T08:13:40.121382+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121382+0000","last_undegraded":"2024-01-20T08:13:40.121382+0000","last_fullsized":"2024-01-20T08:13:40.121382+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139974+0000","last_change":"2024-01-20T08:13:40.134188+0000","last_active":"2024-01-20T08:13:40.139974+0000","last_peered":"2024-01-20T08:13:40.139974+0000","last_clean":"2024-01-20T08:13:40.139974+0000","last_became_active":"2024-01-20T08:13:40.132998+0000","last_became_peered":"2024-01-20T08:13:40.132998+0000","last_unstale":"2024-01-20T08:13:40.139974+0000","last_undegraded":"2024-01-20T08:13:40.139974+0000","last_fullsized":"2024-01-20T08:13:40.139974+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120002+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:39.120002+0000","last_peered":"2024-01-20T08:13:39.120002+0000","last_clean":"2024-01-20T08:13:39.120002+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:39.120002+0000","last_undegraded":"2024-01-20T08:13:39.120002+0000","last_fullsized":"2024-01-20T08:13:39.120002+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102597+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:39.102597+0000","last_peered":"2024-01-20T08:13:39.102597+0000","last_clean":"2024-01-20T08:13:39.102597+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:39.102597+0000","last_undegraded":"2024-01-20T08:13:39.102597+0000","last_fullsized":"2024-01-20T08:13:39.102597+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.110820+0000","last_change":"2024-01-20T08:13:40.110820+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.110820+0000","last_undegraded":"2024-01-20T08:13:40.110820+0000","last_fullsized":"2024-01-20T08:13:40.110820+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140515+0000","last_change":"2024-01-20T08:13:40.136860+0000","last_active":"2024-01-20T08:13:40.140515+0000","last_peered":"2024-01-20T08:13:40.140515+0000","last_clean":"2024-01-20T08:13:40.140515+0000","last_became_active":"2024-01-20T08:13:40.136501+0000","last_became_peered":"2024-01-20T08:13:40.136501+0000","last_unstale":"2024-01-20T08:13:40.140515+0000","last_undegraded":"2024-01-20T08:13:40.140515+0000","last_fullsized":"2024-01-20T08:13:40.140515+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:38.500847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111361+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:39.111361+0000","last_peered":"2024-01-20T08:13:39.111361+0000","last_clean":"2024-01-20T08:13:39.111361+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:39.111361+0000","last_undegraded":"2024-01-20T08:13:39.111361+0000","last_fullsized":"2024-01-20T08:13:39.111361+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.112320+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:39.112320+0000","last_peered":"2024-01-20T08:13:39.112320+0000","last_clean":"2024-01-20T08:13:39.112320+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:39.112320+0000","last_undegraded":"2024-01-20T08:13:39.112320+0000","last_fullsized":"2024-01-20T08:13:39.112320+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.129421+0000","last_change":"2024-01-20T08:13:40.129421+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.129421+0000","last_undegraded":"2024-01-20T08:13:40.129421+0000","last_fullsized":"2024-01-20T08:13:40.129421+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.132463+0000","last_change":"2024-01-20T08:13:40.126858+0000","last_active":"2024-01-20T08:13:40.132463+0000","last_peered":"2024-01-20T08:13:40.132463+0000","last_clean":"2024-01-20T08:13:40.132463+0000","last_became_active":"2024-01-20T08:13:40.124427+0000","last_became_peered":"2024-01-20T08:13:40.124427+0000","last_unstale":"2024-01-20T08:13:40.132463+0000","last_undegraded":"2024-01-20T08:13:40.132463+0000","last_fullsized":"2024-01-20T08:13:40.132463+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.116307+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:39.116307+0000","last_peered":"2024-01-20T08:13:39.116307+0000","last_clean":"2024-01-20T08:13:39.116307+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:39.116307+0000","last_undegraded":"2024-01-20T08:13:39.116307+0000","last_fullsized":"2024-01-20T08:13:39.116307+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.113354+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:39.113354+0000","last_peered":"2024-01-20T08:13:39.113354+0000","last_clean":"2024-01-20T08:13:39.113354+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:39.113354+0000","last_undegraded":"2024-01-20T08:13:39.113354+0000","last_fullsized":"2024-01-20T08:13:39.113354+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116053+0000","last_change":"2024-01-20T08:13:40.116053+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116053+0000","last_undegraded":"2024-01-20T08:13:40.116053+0000","last_fullsized":"2024-01-20T08:13:40.116053+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.130723+0000","last_change":"2024-01-20T08:13:40.123835+0000","last_active":"2024-01-20T08:13:40.130723+0000","last_peered":"2024-01-20T08:13:40.130723+0000","last_clean":"2024-01-20T08:13:40.130723+0000","last_became_active":"2024-01-20T08:13:40.123558+0000","last_became_peered":"2024-01-20T08:13:40.123558+0000","last_unstale":"2024-01-20T08:13:40.130723+0000","last_undegraded":"2024-01-20T08:13:40.130723+0000","last_fullsized":"2024-01-20T08:13:40.130723+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.109710+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:39.109710+0000","last_peered":"2024-01-20T08:13:39.109710+0000","last_clean":"2024-01-20T08:13:39.109710+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:39.109710+0000","last_undegraded":"2024-01-20T08:13:39.109710+0000","last_fullsized":"2024-01-20T08:13:39.109710+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110352+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:39.110352+0000","last_peered":"2024-01-20T08:13:39.110352+0000","last_clean":"2024-01-20T08:13:39.110352+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:39.110352+0000","last_undegraded":"2024-01-20T08:13:39.110352+0000","last_fullsized":"2024-01-20T08:13:39.110352+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116227+0000","last_change":"2024-01-20T08:13:40.116227+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116227+0000","last_undegraded":"2024-01-20T08:13:40.116227+0000","last_fullsized":"2024-01-20T08:13:40.116227+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.134322+0000","last_change":"2024-01-20T08:13:40.128760+0000","last_active":"2024-01-20T08:13:40.134322+0000","last_peered":"2024-01-20T08:13:40.134322+0000","last_clean":"2024-01-20T08:13:40.134322+0000","last_became_active":"2024-01-20T08:13:40.128395+0000","last_became_peered":"2024-01-20T08:13:40.128395+0000","last_unstale":"2024-01-20T08:13:40.134322+0000","last_undegraded":"2024-01-20T08:13:40.134322+0000","last_fullsized":"2024-01-20T08:13:40.134322+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:04:06.168521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115047+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:39.115047+0000","last_peered":"2024-01-20T08:13:39.115047+0000","last_clean":"2024-01-20T08:13:39.115047+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:39.115047+0000","last_undegraded":"2024-01-20T08:13:39.115047+0000","last_fullsized":"2024-01-20T08:13:39.115047+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110250+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:39.110250+0000","last_peered":"2024-01-20T08:13:39.110250+0000","last_clean":"2024-01-20T08:13:39.110250+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:39.110250+0000","last_undegraded":"2024-01-20T08:13:39.110250+0000","last_fullsized":"2024-01-20T08:13:39.110250+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116220+0000","last_change":"2024-01-20T08:13:40.116220+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116220+0000","last_undegraded":"2024-01-20T08:13:40.116220+0000","last_fullsized":"2024-01-20T08:13:40.116220+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139243+0000","last_change":"2024-01-20T08:13:40.131748+0000","last_active":"2024-01-20T08:13:40.139243+0000","last_peered":"2024-01-20T08:13:40.139243+0000","last_clean":"2024-01-20T08:13:40.139243+0000","last_became_active":"2024-01-20T08:13:40.131502+0000","last_became_peered":"2024-01-20T08:13:40.131502+0000","last_unstale":"2024-01-20T08:13:40.139243+0000","last_undegraded":"2024-01-20T08:13:40.139243+0000","last_fullsized":"2024-01-20T08:13:40.139243+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120282+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:39.120282+0000","last_peered":"2024-01-20T08:13:39.120282+0000","last_clean":"2024-01-20T08:13:39.120282+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:39.120282+0000","last_undegraded":"2024-01-20T08:13:39.120282+0000","last_fullsized":"2024-01-20T08:13:39.120282+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":16,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.115494+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:39.115494+0000","last_peered":"2024-01-20T08:13:39.115494+0000","last_clean":"2024-01-20T08:13:39.115494+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:39.115494+0000","last_undegraded":"2024-01-20T08:13:39.115494+0000","last_fullsized":"2024-01-20T08:13:39.115494+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.125586+0000","last_change":"2024-01-20T08:13:40.125586+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.125586+0000","last_undegraded":"2024-01-20T08:13:40.125586+0000","last_fullsized":"2024-01-20T08:13:40.125586+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139913+0000","last_change":"2024-01-20T08:13:40.136610+0000","last_active":"2024-01-20T08:13:40.139913+0000","last_peered":"2024-01-20T08:13:40.139913+0000","last_clean":"2024-01-20T08:13:40.139913+0000","last_became_active":"2024-01-20T08:13:40.135965+0000","last_became_peered":"2024-01-20T08:13:40.135965+0000","last_unstale":"2024-01-20T08:13:40.139913+0000","last_undegraded":"2024-01-20T08:13:40.139913+0000","last_fullsized":"2024-01-20T08:13:40.139913+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.106130+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:39.106130+0000","last_peered":"2024-01-20T08:13:39.106130+0000","last_clean":"2024-01-20T08:13:39.106130+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:39.106130+0000","last_undegraded":"2024-01-20T08:13:39.106130+0000","last_fullsized":"2024-01-20T08:13:39.106130+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114981+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:39.114981+0000","last_peered":"2024-01-20T08:13:39.114981+0000","last_clean":"2024-01-20T08:13:39.114981+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:39.114981+0000","last_undegraded":"2024-01-20T08:13:39.114981+0000","last_fullsized":"2024-01-20T08:13:39.114981+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.116973+0000","last_change":"2024-01-20T08:13:40.116973+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.116973+0000","last_undegraded":"2024-01-20T08:13:40.116973+0000","last_fullsized":"2024-01-20T08:13:40.116973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.141253+0000","last_change":"2024-01-20T08:13:40.138153+0000","last_active":"2024-01-20T08:13:40.141253+0000","last_peered":"2024-01-20T08:13:40.141253+0000","last_clean":"2024-01-20T08:13:40.141253+0000","last_became_active":"2024-01-20T08:13:40.137489+0000","last_became_peered":"2024-01-20T08:13:40.137489+0000","last_unstale":"2024-01-20T08:13:40.141253+0000","last_undegraded":"2024-01-20T08:13:40.141253+0000","last_fullsized":"2024-01-20T08:13:40.141253+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:58.035230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111008+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:39.111008+0000","last_peered":"2024-01-20T08:13:39.111008+0000","last_clean":"2024-01-20T08:13:39.111008+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:39.111008+0000","last_undegraded":"2024-01-20T08:13:39.111008+0000","last_fullsized":"2024-01-20T08:13:39.111008+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.110011+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:39.110011+0000","last_peered":"2024-01-20T08:13:39.110011+0000","last_clean":"2024-01-20T08:13:39.110011+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:39.110011+0000","last_undegraded":"2024-01-20T08:13:39.110011+0000","last_fullsized":"2024-01-20T08:13:39.110011+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118595+0000","last_change":"2024-01-20T08:13:40.118595+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118595+0000","last_undegraded":"2024-01-20T08:13:40.118595+0000","last_fullsized":"2024-01-20T08:13:40.118595+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.139284+0000","last_change":"2024-01-20T08:13:40.135004+0000","last_active":"2024-01-20T08:13:40.139284+0000","last_peered":"2024-01-20T08:13:40.139284+0000","last_clean":"2024-01-20T08:13:40.139284+0000","last_became_active":"2024-01-20T08:13:40.132993+0000","last_became_peered":"2024-01-20T08:13:40.132993+0000","last_unstale":"2024-01-20T08:13:40.139284+0000","last_undegraded":"2024-01-20T08:13:40.139284+0000","last_fullsized":"2024-01-20T08:13:40.139284+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:05:36.525486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.120149+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:39.120149+0000","last_peered":"2024-01-20T08:13:39.120149+0000","last_clean":"2024-01-20T08:13:39.120149+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:39.120149+0000","last_undegraded":"2024-01-20T08:13:39.120149+0000","last_fullsized":"2024-01-20T08:13:39.120149+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.111251+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:39.111251+0000","last_peered":"2024-01-20T08:13:39.111251+0000","last_clean":"2024-01-20T08:13:39.111251+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:39.111251+0000","last_undegraded":"2024-01-20T08:13:39.111251+0000","last_fullsized":"2024-01-20T08:13:39.111251+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.109850+0000","last_change":"2024-01-20T08:13:40.109850+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.109850+0000","last_undegraded":"2024-01-20T08:13:40.109850+0000","last_fullsized":"2024-01-20T08:13:40.109850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.143546+0000","last_change":"2024-01-20T08:13:40.138887+0000","last_active":"2024-01-20T08:13:40.143546+0000","last_peered":"2024-01-20T08:13:40.143546+0000","last_clean":"2024-01-20T08:13:40.143546+0000","last_became_active":"2024-01-20T08:13:40.138591+0000","last_became_peered":"2024-01-20T08:13:40.138591+0000","last_unstale":"2024-01-20T08:13:40.143546+0000","last_undegraded":"2024-01-20T08:13:40.143546+0000","last_fullsized":"2024-01-20T08:13:40.143546+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:44:26.247086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.118082+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:39.118082+0000","last_peered":"2024-01-20T08:13:39.118082+0000","last_clean":"2024-01-20T08:13:39.118082+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:39.118082+0000","last_undegraded":"2024-01-20T08:13:39.118082+0000","last_fullsized":"2024-01-20T08:13:39.118082+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102627+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:39.102627+0000","last_peered":"2024-01-20T08:13:39.102627+0000","last_clean":"2024-01-20T08:13:39.102627+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:39.102627+0000","last_undegraded":"2024-01-20T08:13:39.102627+0000","last_fullsized":"2024-01-20T08:13:39.102627+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.121559+0000","last_change":"2024-01-20T08:13:40.121559+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.121559+0000","last_undegraded":"2024-01-20T08:13:40.121559+0000","last_fullsized":"2024-01-20T08:13:40.121559+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.131963+0000","last_change":"2024-01-20T08:13:40.125670+0000","last_active":"2024-01-20T08:13:40.131963+0000","last_peered":"2024-01-20T08:13:40.131963+0000","last_clean":"2024-01-20T08:13:40.131963+0000","last_became_active":"2024-01-20T08:13:40.125414+0000","last_became_peered":"2024-01-20T08:13:40.125414+0000","last_unstale":"2024-01-20T08:13:40.131963+0000","last_undegraded":"2024-01-20T08:13:40.131963+0000","last_fullsized":"2024-01-20T08:13:40.131963+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:56.786851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102265+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:39.102265+0000","last_peered":"2024-01-20T08:13:39.102265+0000","last_clean":"2024-01-20T08:13:39.102265+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:39.102265+0000","last_undegraded":"2024-01-20T08:13:39.102265+0000","last_fullsized":"2024-01-20T08:13:39.102265+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119588+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:39.119588+0000","last_peered":"2024-01-20T08:13:39.119588+0000","last_clean":"2024-01-20T08:13:39.119588+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:39.119588+0000","last_undegraded":"2024-01-20T08:13:39.119588+0000","last_fullsized":"2024-01-20T08:13:39.119588+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.113404+0000","last_change":"2024-01-20T08:13:40.113404+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.113404+0000","last_undegraded":"2024-01-20T08:13:40.113404+0000","last_fullsized":"2024-01-20T08:13:40.113404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142610+0000","last_change":"2024-01-20T08:13:40.140095+0000","last_active":"2024-01-20T08:13:40.142610+0000","last_peered":"2024-01-20T08:13:40.142610+0000","last_clean":"2024-01-20T08:13:40.142610+0000","last_became_active":"2024-01-20T08:13:40.139756+0000","last_became_peered":"2024-01-20T08:13:40.139756+0000","last_unstale":"2024-01-20T08:13:40.142610+0000","last_undegraded":"2024-01-20T08:13:40.142610+0000","last_fullsized":"2024-01-20T08:13:40.142610+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:03:58.663879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102633+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:39.102633+0000","last_peered":"2024-01-20T08:13:39.102633+0000","last_clean":"2024-01-20T08:13:39.102633+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:39.102633+0000","last_undegraded":"2024-01-20T08:13:39.102633+0000","last_fullsized":"2024-01-20T08:13:39.102633+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108947+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:39.108947+0000","last_peered":"2024-01-20T08:13:39.108947+0000","last_clean":"2024-01-20T08:13:39.108947+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:39.108947+0000","last_undegraded":"2024-01-20T08:13:39.108947+0000","last_fullsized":"2024-01-20T08:13:39.108947+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.112491+0000","last_change":"2024-01-20T08:13:40.112491+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.112491+0000","last_undegraded":"2024-01-20T08:13:40.112491+0000","last_fullsized":"2024-01-20T08:13:40.112491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.140001+0000","last_change":"2024-01-20T08:13:40.136793+0000","last_active":"2024-01-20T08:13:40.140001+0000","last_peered":"2024-01-20T08:13:40.140001+0000","last_clean":"2024-01-20T08:13:40.140001+0000","last_became_active":"2024-01-20T08:13:40.135303+0000","last_became_peered":"2024-01-20T08:13:40.135303+0000","last_unstale":"2024-01-20T08:13:40.140001+0000","last_undegraded":"2024-01-20T08:13:40.140001+0000","last_fullsized":"2024-01-20T08:13:40.140001+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.108788+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:39.108788+0000","last_peered":"2024-01-20T08:13:39.108788+0000","last_clean":"2024-01-20T08:13:39.108788+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:39.108788+0000","last_undegraded":"2024-01-20T08:13:39.108788+0000","last_fullsized":"2024-01-20T08:13:39.108788+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":14,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.119127+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:39.119127+0000","last_peered":"2024-01-20T08:13:39.119127+0000","last_clean":"2024-01-20T08:13:39.119127+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:39.119127+0000","last_undegraded":"2024-01-20T08:13:39.119127+0000","last_fullsized":"2024-01-20T08:13:39.119127+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":1,"reported_epoch":74,"state":"creating+peering","last_fresh":"2024-01-20T08:13:40.118570+0000","last_change":"2024-01-20T08:13:40.118570+0000","last_active":"2024-01-20T08:13:40.094839+0000","last_peered":"2024-01-20T08:13:40.094839+0000","last_clean":"2024-01-20T08:13:40.094839+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-01-20T08:13:40.118570+0000","last_undegraded":"2024-01-20T08:13:40.118570+0000","last_fullsized":"2024-01-20T08:13:40.118570+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"0'0","reported_seq":9,"reported_epoch":74,"state":"active+clean","last_fresh":"2024-01-20T08:13:40.142233+0000","last_change":"2024-01-20T08:13:40.138906+0000","last_active":"2024-01-20T08:13:40.142233+0000","last_peered":"2024-01-20T08:13:40.142233+0000","last_clean":"2024-01-20T08:13:40.142233+0000","last_became_active":"2024-01-20T08:13:40.138512+0000","last_became_peered":"2024-01-20T08:13:40.138512+0000","last_unstale":"2024-01-20T08:13:40.142233+0000","last_undegraded":"2024-01-20T08:13:40.142233+0000","last_fullsized":"2024-01-20T08:13:40.142233+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.114484+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:39.114484+0000","last_peered":"2024-01-20T08:13:39.114484+0000","last_clean":"2024-01-20T08:13:39.114484+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:39.114484+0000","last_undegraded":"2024-01-20T08:13:39.114484+0000","last_fullsized":"2024-01-20T08:13:39.114484+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":15,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.104132+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:39.104132+0000","last_peered":"2024-01-20T08:13:39.104132+0000","last_clean":"2024-01-20T08:13:39.104132+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:39.104132+0000","last_undegraded":"2024-01-20T08:13:39.104132+0000","last_fullsized":"2024-01-20T08:13:39.104132+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":211,"reported_epoch":73,"state":"active+clean","last_fresh":"2024-01-20T08:13:39.102921+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:39.102921+0000","last_peered":"2024-01-20T08:13:39.102921+0000","last_clean":"2024-01-20T08:13:39.102921+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:39.102921+0000","last_undegraded":"2024-01-20T08:13:39.102921+0000","last_fullsized":"2024-01-20T08:13:39.102921+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.89500000000000002},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.153}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.123},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.577}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":1.3109999999999999},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.3600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.2130000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.427}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.748},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.3919999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.49},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.8}]}]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339756,"statfs":{"total":96636764160,"available":96603910144,"internally_reserved":0,"allocated":921600,"data_stored":400965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.4970000000000001},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.878}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":0.754}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.3899999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.167},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.353}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":0.90800000000000003},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.3200000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.0029999999999999},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.2210000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.4279999999999999},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.46}]}]},{"osd":5,"up_from":13,"seq":55834574894,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":913408,"data_stored":396270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.97399999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.387}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":1.115},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":0.92200000000000004}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.2290000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2709999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.482}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.357},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.032}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.419}]}]},{"osd":4,"up_from":13,"seq":55834574894,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32072,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339768,"statfs":{"total":96636764160,"available":96603922432,"internally_reserved":0,"allocated":909312,"data_stored":400271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":0.873},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":1.0980000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":0.83299999999999996},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.91500000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.4330000000000001},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.47}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.02},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.534}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.238},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.0780000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.3500000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.401},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.738}]}]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":396248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.313},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":0.48499999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.42299999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":0.51100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":0.92300000000000004}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":0.752},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.86099999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.042}]}]},{"osd":2,"up_from":13,"seq":55834574894,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":913408,"data_stored":400853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.86899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.167}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":1.1240000000000001},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.69599999999999995}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.0740000000000001},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.018},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":1.258}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.3799999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.304},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.329}]}]},{"osd":1,"up_from":13,"seq":55834574894,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":909312,"data_stored":393335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":0.72799999999999998}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.68400000000000005}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.872}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.999},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":0.82499999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":0.90700000000000003},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.234}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.157},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.3220000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.29},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32652,"kb_used_data":1472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339188,"statfs":{"total":96636764160,"available":96603328512,"internally_reserved":0,"allocated":1507328,"data_stored":990673,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.79700000000000004}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.163},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.2769999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.075}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.018},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.7629999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.617},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.321}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.3759999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.127}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.466},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.8320000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:50.639 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:13:50.854 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.851+0000 7f7d94000640 1 Processor -- start 2024-01-20T08:13:50.855 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.852+0000 7f7d94000640 1 -- start start 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d94000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d8c0ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d94000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c0a9940 con 0x7f7d8c14fce0 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d94000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d8c1500c0 con 0x7f7d8c0a93c0 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d94000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c156810 con 0x7f7d8c153b80 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d91600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7d8c14fce0 0x7f7d8c152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39428/0 (socket says 172.21.15.100:39428) 2024-01-20T08:13:50.856 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.853+0000 7f7d91600640 1 -- 172.21.15.100:0/1783331872 learned_addr learned my addr 172.21.15.100:0/1783331872 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:50.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d92000640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d8c0ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1906901072 0 0) 0x7f7d8c0a9940 con 0x7f7d8c14fce0 2024-01-20T08:13:50.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7d6c003520 con 0x7f7d8c14fce0 2024-01-20T08:13:50.858 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645611016 0 0) 0x7f7d6c003520 con 0x7f7d8c14fce0 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 msgr2=0x7f7d8c0ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d8c0ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 >> v1:172.21.15.110:6789/0 conn(0x7f7d8c0a93c0 legacy=0x7f7d8c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c156af0 con 0x7f7d8c14fce0 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f7d7c001670 con 0x7f7d8c14fce0 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 >> v1:172.21.15.100:6789/0 conn(0x7f7d8c14fce0 legacy=0x7f7d8c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c0039a0 0x7f7d6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c004d00 0x7f7d6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c156810 con 0x7f7d6c0039a0 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c00ba30 con 0x7f7d6c004d00 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c00bbf0 con 0x7f7d8c153b80 2024-01-20T08:13:50.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.854+0000 7f7d91600640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c0039a0 0x7f7d6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d92000640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c004d00 0x7f7d6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d91600640 1 -- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 msgr2=0x7f7d6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d90c00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d91600640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d91600640 1 -- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c004d00 msgr2=0x7f7d6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d91600640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c004d00 0x7f7d6c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d91600640 1 -- 172.21.15.100:0/1783331872 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c003520 con 0x7f7d6c0039a0 2024-01-20T08:13:50.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.855+0000 7f7d90c00640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c153b80 0x7f7d6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:50.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.856+0000 7f7d91600640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c0039a0 0x7f7d6c003dc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c210 tx=0x7f7d6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d8f71c352af432b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.856+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c005ad0 con 0x7f7d6c0039a0 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.856+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d7c005c30 con 0x7f7d6c0039a0 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.856+0000 7f7d8be00640 1 -- 172.21.15.100:0/1783331872 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d7c02c890 con 0x7f7d6c0039a0 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 -- 172.21.15.100:0/1783331872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c0039a0 msgr2=0x7f7d6c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 --2- 172.21.15.100:0/1783331872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d6c0039a0 0x7f7d6c003dc0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c00c210 tx=0x7f7d6c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d92000640 1 -- 172.21.15.100:0/1783331872 reap_dead start 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 -- 172.21.15.100:0/1783331872 shutdown_connections 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 -- 172.21.15.100:0/1783331872 >> 172.21.15.100:0/1783331872 conn(0x7f7d8c06a5e0 msgr2=0x7f7d8c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 -- 172.21.15.100:0/1783331872 shutdown_connections 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.857+0000 7f7d94000640 1 -- 172.21.15.100:0/1783331872 wait complete. 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.859+0000 7f7d94000640 1 Processor -- start 2024-01-20T08:13:50.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.859+0000 7f7d94000640 1 -- start start 2024-01-20T08:13:50.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.859+0000 7f7d94000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c0039a0 0x7f7d8c0c2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d94000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d94000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c14bbd0 0x7f7d8c14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d94000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c14cb00 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d94000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c1dc200 con 0x7f7d6c0039a0 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d94000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d8c152320 con 0x7f7d8c14bbd0 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38796/0 (socket says 172.21.15.100:38796) 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 -- 172.21.15.100:0/2983181044 learned_addr learned my addr 172.21.15.100:0/2983181044 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 -- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c14bbd0 msgr2=0x7f7d8c14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c14bbd0 0x7f7d8c14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 -- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c0039a0 msgr2=0x7f7d8c0c2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d91600640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c0039a0 0x7f7d8c0c2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c0039a0 0x7f7d8c0c2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.860+0000 7f7d90c00640 1 -- 172.21.15.100:0/2983181044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d8c1dc8a0 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d90c00640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d720 tx=0x7f7d7400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74017070 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d74005070 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d74005420 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d8c1dbe90 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.861+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8c14c7a0 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.862+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d8c1dbcf0 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.863+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7d74007030 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.864+0000 7f7d89600640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 0x7f7d6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.864+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f7d740891c0 con 0x7f7d8c0c6d10 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.864+0000 7f7d91600640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 0x7f7d6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:50.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.865+0000 7f7d91600640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 0x7f7d6406d390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:50.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:50.869+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7d8c1dbcf0 con 0x7f7d8c0c6d10 2024-01-20T08:13:51.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.061+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d8c153610 con 0x7f7d6406aed0 2024-01-20T08:13:51.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.077+0000 7f7d89600640 1 -- 172.21.15.100:0/2983181044 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+525364 (secure 0 0 0) 0x7f7d7c0013b0 con 0x7f7d6406aed0 2024-01-20T08:13:51.086 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:51.092 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 msgr2=0x7f7d6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 0x7f7d6406d390 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c034000 tx=0x7f7d7c009030 comp rx=0 tx=0).stop 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 msgr2=0x7f7d8c0c26d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f7d7400d720 tx=0x7f7d7400dbe0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 shutdown_connections 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7d6406aed0 0x7f7d6406d390 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7d8c14bbd0 0x7f7d8c14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7d8c0c6d10 0x7f7d8c0c26d0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 --2- 172.21.15.100:0/2983181044 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7d6c0039a0 0x7f7d8c0c2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 >> 172.21.15.100:0/2983181044 conn(0x7f7d8c06a5e0 msgr2=0x7f7d8c0bf5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:51.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 shutdown_connections 2024-01-20T08:13:51.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.088+0000 7f7d94000640 1 -- 172.21.15.100:0/2983181044 wait complete. 2024-01-20T08:13:51.110 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-01-20T08:13:49.959213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":596683,"num_objects":46,"num_object_clones":0,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":252,"num_write_kb":2447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":198,"ondisk_log_size":198,"up":386,"acting":386,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":386,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":253872,"kb_used_data":8584,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720848,"statfs":{"total":773094113280,"available":772834148352,"internally_reserved":0,"allocated":8790016,"data_stored":4513854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":251055665},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.832046"},"pg_stats":[{"pgid":"15.3d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.163514+0000","last_change":"2024-01-20T08:13:41.165603+0000","last_active":"2024-01-20T08:13:42.163514+0000","last_peered":"2024-01-20T08:13:42.163514+0000","last_clean":"2024-01-20T08:13:42.163514+0000","last_became_active":"2024-01-20T08:13:41.165252+0000","last_became_peered":"2024-01-20T08:13:41.165252+0000","last_unstale":"2024-01-20T08:13:42.163514+0000","last_undegraded":"2024-01-20T08:13:42.163514+0000","last_fullsized":"2024-01-20T08:13:42.163514+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:12.622148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3f","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161481+0000","last_change":"2024-01-20T08:13:21.220006+0000","last_active":"2024-01-20T08:13:41.161481+0000","last_peered":"2024-01-20T08:13:41.161481+0000","last_clean":"2024-01-20T08:13:41.161481+0000","last_became_active":"2024-01-20T08:13:21.219586+0000","last_became_peered":"2024-01-20T08:13:21.219586+0000","last_unstale":"2024-01-20T08:13:41.161481+0000","last_undegraded":"2024-01-20T08:13:41.161481+0000","last_fullsized":"2024-01-20T08:13:41.161481+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165454+0000","last_change":"2024-01-20T08:13:41.161707+0000","last_active":"2024-01-20T08:13:42.165454+0000","last_peered":"2024-01-20T08:13:42.165454+0000","last_clean":"2024-01-20T08:13:42.165454+0000","last_became_active":"2024-01-20T08:13:41.161188+0000","last_became_peered":"2024-01-20T08:13:41.161188+0000","last_unstale":"2024-01-20T08:13:42.165454+0000","last_undegraded":"2024-01-20T08:13:42.165454+0000","last_fullsized":"2024-01-20T08:13:42.165454+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:37:43.791879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144201+0000","last_change":"2024-01-20T08:13:21.210157+0000","last_active":"2024-01-20T08:13:41.144201+0000","last_peered":"2024-01-20T08:13:41.144201+0000","last_clean":"2024-01-20T08:13:41.144201+0000","last_became_active":"2024-01-20T08:13:21.209884+0000","last_became_peered":"2024-01-20T08:13:21.209884+0000","last_unstale":"2024-01-20T08:13:41.144201+0000","last_undegraded":"2024-01-20T08:13:41.144201+0000","last_fullsized":"2024-01-20T08:13:41.144201+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:53.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3f","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162157+0000","last_change":"2024-01-20T08:13:41.162422+0000","last_active":"2024-01-20T08:13:42.162157+0000","last_peered":"2024-01-20T08:13:42.162157+0000","last_clean":"2024-01-20T08:13:42.162157+0000","last_became_active":"2024-01-20T08:13:41.162120+0000","last_became_peered":"2024-01-20T08:13:41.162120+0000","last_unstale":"2024-01-20T08:13:42.162157+0000","last_undegraded":"2024-01-20T08:13:42.162157+0000","last_fullsized":"2024-01-20T08:13:42.162157+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:39.510920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.136724+0000","last_change":"2024-01-20T08:13:21.211024+0000","last_active":"2024-01-20T08:13:41.136724+0000","last_peered":"2024-01-20T08:13:41.136724+0000","last_clean":"2024-01-20T08:13:41.136724+0000","last_became_active":"2024-01-20T08:13:21.210722+0000","last_became_peered":"2024-01-20T08:13:21.210722+0000","last_unstale":"2024-01-20T08:13:41.136724+0000","last_undegraded":"2024-01-20T08:13:41.136724+0000","last_fullsized":"2024-01-20T08:13:41.136724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.955000+0000","last_change":"2024-01-20T08:13:41.152772+0000","last_active":"2024-01-20T08:13:42.955000+0000","last_peered":"2024-01-20T08:13:42.955000+0000","last_clean":"2024-01-20T08:13:42.955000+0000","last_became_active":"2024-01-20T08:13:41.152506+0000","last_became_peered":"2024-01-20T08:13:41.152506+0000","last_unstale":"2024-01-20T08:13:42.955000+0000","last_undegraded":"2024-01-20T08:13:42.955000+0000","last_fullsized":"2024-01-20T08:13:42.955000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:07:02.910706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.152526+0000","last_change":"2024-01-20T08:13:21.206697+0000","last_active":"2024-01-20T08:13:41.152526+0000","last_peered":"2024-01-20T08:13:41.152526+0000","last_clean":"2024-01-20T08:13:41.152526+0000","last_became_active":"2024-01-20T08:13:21.206352+0000","last_became_peered":"2024-01-20T08:13:21.206352+0000","last_unstale":"2024-01-20T08:13:41.152526+0000","last_undegraded":"2024-01-20T08:13:41.152526+0000","last_fullsized":"2024-01-20T08:13:41.152526+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:11.456407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.206807+0000","last_change":"2024-01-20T08:13:41.151796+0000","last_active":"2024-01-20T08:13:42.206807+0000","last_peered":"2024-01-20T08:13:42.206807+0000","last_clean":"2024-01-20T08:13:42.206807+0000","last_became_active":"2024-01-20T08:13:41.151195+0000","last_became_peered":"2024-01-20T08:13:41.151195+0000","last_unstale":"2024-01-20T08:13:42.206807+0000","last_undegraded":"2024-01-20T08:13:42.206807+0000","last_fullsized":"2024-01-20T08:13:42.206807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:36.914262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166520+0000","last_change":"2024-01-20T08:13:21.197804+0000","last_active":"2024-01-20T08:13:41.166520+0000","last_peered":"2024-01-20T08:13:41.166520+0000","last_clean":"2024-01-20T08:13:41.166520+0000","last_became_active":"2024-01-20T08:13:21.196908+0000","last_became_peered":"2024-01-20T08:13:21.196908+0000","last_unstale":"2024-01-20T08:13:41.166520+0000","last_undegraded":"2024-01-20T08:13:41.166520+0000","last_fullsized":"2024-01-20T08:13:41.166520+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.952973+0000","last_change":"2024-01-20T08:13:41.144516+0000","last_active":"2024-01-20T08:13:42.952973+0000","last_peered":"2024-01-20T08:13:42.952973+0000","last_clean":"2024-01-20T08:13:42.952973+0000","last_became_active":"2024-01-20T08:13:41.144186+0000","last_became_peered":"2024-01-20T08:13:41.144186+0000","last_unstale":"2024-01-20T08:13:42.952973+0000","last_undegraded":"2024-01-20T08:13:42.952973+0000","last_fullsized":"2024-01-20T08:13:42.952973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:15:34.517301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.143557+0000","last_change":"2024-01-20T08:13:21.206234+0000","last_active":"2024-01-20T08:13:41.143557+0000","last_peered":"2024-01-20T08:13:41.143557+0000","last_clean":"2024-01-20T08:13:41.143557+0000","last_became_active":"2024-01-20T08:13:21.205710+0000","last_became_peered":"2024-01-20T08:13:21.205710+0000","last_unstale":"2024-01-20T08:13:41.143557+0000","last_undegraded":"2024-01-20T08:13:41.143557+0000","last_fullsized":"2024-01-20T08:13:41.143557+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:12.124941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.452829+0000","last_change":"2024-01-20T08:13:41.164056+0000","last_active":"2024-01-20T08:13:42.452829+0000","last_peered":"2024-01-20T08:13:42.452829+0000","last_clean":"2024-01-20T08:13:42.452829+0000","last_became_active":"2024-01-20T08:13:41.163707+0000","last_became_peered":"2024-01-20T08:13:41.163707+0000","last_unstale":"2024-01-20T08:13:42.452829+0000","last_undegraded":"2024-01-20T08:13:42.452829+0000","last_fullsized":"2024-01-20T08:13:42.452829+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:36.914262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.150924+0000","last_change":"2024-01-20T08:13:21.204720+0000","last_active":"2024-01-20T08:13:41.150924+0000","last_peered":"2024-01-20T08:13:41.150924+0000","last_clean":"2024-01-20T08:13:41.150924+0000","last_became_active":"2024-01-20T08:13:21.204427+0000","last_became_peered":"2024-01-20T08:13:21.204427+0000","last_unstale":"2024-01-20T08:13:41.150924+0000","last_undegraded":"2024-01-20T08:13:41.150924+0000","last_fullsized":"2024-01-20T08:13:41.150924+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:27:30.405953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.207014+0000","last_change":"2024-01-20T08:13:41.156330+0000","last_active":"2024-01-20T08:13:42.207014+0000","last_peered":"2024-01-20T08:13:42.207014+0000","last_clean":"2024-01-20T08:13:42.207014+0000","last_became_active":"2024-01-20T08:13:41.155906+0000","last_became_peered":"2024-01-20T08:13:41.155906+0000","last_unstale":"2024-01-20T08:13:42.207014+0000","last_undegraded":"2024-01-20T08:13:42.207014+0000","last_fullsized":"2024-01-20T08:13:42.207014+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:35.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133638+0000","last_change":"2024-01-20T08:13:21.203092+0000","last_active":"2024-01-20T08:13:41.133638+0000","last_peered":"2024-01-20T08:13:41.133638+0000","last_clean":"2024-01-20T08:13:41.133638+0000","last_became_active":"2024-01-20T08:13:21.202316+0000","last_became_peered":"2024-01-20T08:13:21.202316+0000","last_unstale":"2024-01-20T08:13:41.133638+0000","last_undegraded":"2024-01-20T08:13:41.133638+0000","last_fullsized":"2024-01-20T08:13:41.133638+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.207375+0000","last_change":"2024-01-20T08:13:41.166080+0000","last_active":"2024-01-20T08:13:42.207375+0000","last_peered":"2024-01-20T08:13:42.207375+0000","last_clean":"2024-01-20T08:13:42.207375+0000","last_became_active":"2024-01-20T08:13:41.165824+0000","last_became_peered":"2024-01-20T08:13:41.165824+0000","last_unstale":"2024-01-20T08:13:42.207375+0000","last_undegraded":"2024-01-20T08:13:42.207375+0000","last_fullsized":"2024-01-20T08:13:42.207375+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:35:18.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.140757+0000","last_change":"2024-01-20T08:13:21.217850+0000","last_active":"2024-01-20T08:13:41.140757+0000","last_peered":"2024-01-20T08:13:41.140757+0000","last_clean":"2024-01-20T08:13:41.140757+0000","last_became_active":"2024-01-20T08:13:21.216861+0000","last_became_peered":"2024-01-20T08:13:21.216861+0000","last_unstale":"2024-01-20T08:13:41.140757+0000","last_undegraded":"2024-01-20T08:13:41.140757+0000","last_fullsized":"2024-01-20T08:13:41.140757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.166972+0000","last_change":"2024-01-20T08:13:41.172855+0000","last_active":"2024-01-20T08:13:42.166972+0000","last_peered":"2024-01-20T08:13:42.166972+0000","last_clean":"2024-01-20T08:13:42.166972+0000","last_became_active":"2024-01-20T08:13:41.170464+0000","last_became_peered":"2024-01-20T08:13:41.170464+0000","last_unstale":"2024-01-20T08:13:42.166972+0000","last_undegraded":"2024-01-20T08:13:42.166972+0000","last_fullsized":"2024-01-20T08:13:42.166972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:10.470066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161033+0000","last_change":"2024-01-20T08:13:21.208265+0000","last_active":"2024-01-20T08:13:41.161033+0000","last_peered":"2024-01-20T08:13:41.161033+0000","last_clean":"2024-01-20T08:13:41.161033+0000","last_became_active":"2024-01-20T08:13:21.207856+0000","last_became_peered":"2024-01-20T08:13:21.207856+0000","last_unstale":"2024-01-20T08:13:41.161033+0000","last_undegraded":"2024-01-20T08:13:41.161033+0000","last_fullsized":"2024-01-20T08:13:41.161033+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.168962+0000","last_change":"2024-01-20T08:13:41.169705+0000","last_active":"2024-01-20T08:13:42.168962+0000","last_peered":"2024-01-20T08:13:42.168962+0000","last_clean":"2024-01-20T08:13:42.168962+0000","last_became_active":"2024-01-20T08:13:41.169429+0000","last_became_peered":"2024-01-20T08:13:41.169429+0000","last_unstale":"2024-01-20T08:13:42.168962+0000","last_undegraded":"2024-01-20T08:13:42.168962+0000","last_fullsized":"2024-01-20T08:13:42.168962+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:26:50.531149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.143698+0000","last_change":"2024-01-20T08:13:21.198365+0000","last_active":"2024-01-20T08:13:41.143698+0000","last_peered":"2024-01-20T08:13:41.143698+0000","last_clean":"2024-01-20T08:13:41.143698+0000","last_became_active":"2024-01-20T08:13:21.198036+0000","last_became_peered":"2024-01-20T08:13:21.198036+0000","last_unstale":"2024-01-20T08:13:41.143698+0000","last_undegraded":"2024-01-20T08:13:41.143698+0000","last_fullsized":"2024-01-20T08:13:41.143698+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:22.402351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.452933+0000","last_change":"2024-01-20T08:13:41.168011+0000","last_active":"2024-01-20T08:13:42.452933+0000","last_peered":"2024-01-20T08:13:42.452933+0000","last_clean":"2024-01-20T08:13:42.452933+0000","last_became_active":"2024-01-20T08:13:41.166505+0000","last_became_peered":"2024-01-20T08:13:41.166505+0000","last_unstale":"2024-01-20T08:13:42.452933+0000","last_undegraded":"2024-01-20T08:13:42.452933+0000","last_fullsized":"2024-01-20T08:13:42.452933+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:08:33.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161707+0000","last_change":"2024-01-20T08:13:21.215140+0000","last_active":"2024-01-20T08:13:41.161707+0000","last_peered":"2024-01-20T08:13:41.161707+0000","last_clean":"2024-01-20T08:13:41.161707+0000","last_became_active":"2024-01-20T08:13:21.214529+0000","last_became_peered":"2024-01-20T08:13:21.214529+0000","last_unstale":"2024-01-20T08:13:41.161707+0000","last_undegraded":"2024-01-20T08:13:41.161707+0000","last_fullsized":"2024-01-20T08:13:41.161707+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.164748+0000","last_change":"2024-01-20T08:13:41.163761+0000","last_active":"2024-01-20T08:13:42.164748+0000","last_peered":"2024-01-20T08:13:42.164748+0000","last_clean":"2024-01-20T08:13:42.164748+0000","last_became_active":"2024-01-20T08:13:41.163512+0000","last_became_peered":"2024-01-20T08:13:41.163512+0000","last_unstale":"2024-01-20T08:13:42.164748+0000","last_undegraded":"2024-01-20T08:13:42.164748+0000","last_fullsized":"2024-01-20T08:13:42.164748+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:43:43.234181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.135525+0000","last_change":"2024-01-20T08:13:21.203382+0000","last_active":"2024-01-20T08:13:41.135525+0000","last_peered":"2024-01-20T08:13:41.135525+0000","last_clean":"2024-01-20T08:13:41.135525+0000","last_became_active":"2024-01-20T08:13:21.203025+0000","last_became_peered":"2024-01-20T08:13:21.203025+0000","last_unstale":"2024-01-20T08:13:41.135525+0000","last_undegraded":"2024-01-20T08:13:41.135525+0000","last_fullsized":"2024-01-20T08:13:41.135525+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.206807+0000","last_change":"2024-01-20T08:13:41.145546+0000","last_active":"2024-01-20T08:13:42.206807+0000","last_peered":"2024-01-20T08:13:42.206807+0000","last_clean":"2024-01-20T08:13:42.206807+0000","last_became_active":"2024-01-20T08:13:41.144732+0000","last_became_peered":"2024-01-20T08:13:41.144732+0000","last_unstale":"2024-01-20T08:13:42.206807+0000","last_undegraded":"2024-01-20T08:13:42.206807+0000","last_fullsized":"2024-01-20T08:13:42.206807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:08:33.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151188+0000","last_change":"2024-01-20T08:13:21.208838+0000","last_active":"2024-01-20T08:13:41.151188+0000","last_peered":"2024-01-20T08:13:41.151188+0000","last_clean":"2024-01-20T08:13:41.151188+0000","last_became_active":"2024-01-20T08:13:21.208200+0000","last_became_peered":"2024-01-20T08:13:21.208200+0000","last_unstale":"2024-01-20T08:13:41.151188+0000","last_undegraded":"2024-01-20T08:13:41.151188+0000","last_fullsized":"2024-01-20T08:13:41.151188+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:24:31.451163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165476+0000","last_change":"2024-01-20T08:13:41.171399+0000","last_active":"2024-01-20T08:13:42.165476+0000","last_peered":"2024-01-20T08:13:42.165476+0000","last_clean":"2024-01-20T08:13:42.165476+0000","last_became_active":"2024-01-20T08:13:41.171121+0000","last_became_peered":"2024-01-20T08:13:41.171121+0000","last_unstale":"2024-01-20T08:13:42.165476+0000","last_undegraded":"2024-01-20T08:13:42.165476+0000","last_fullsized":"2024-01-20T08:13:42.165476+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:50:37.342815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141469+0000","last_change":"2024-01-20T08:13:21.205832+0000","last_active":"2024-01-20T08:13:41.141469+0000","last_peered":"2024-01-20T08:13:41.141469+0000","last_clean":"2024-01-20T08:13:41.141469+0000","last_became_active":"2024-01-20T08:13:21.205507+0000","last_became_peered":"2024-01-20T08:13:21.205507+0000","last_unstale":"2024-01-20T08:13:41.141469+0000","last_undegraded":"2024-01-20T08:13:41.141469+0000","last_fullsized":"2024-01-20T08:13:41.141469+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:08.878185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162049+0000","last_change":"2024-01-20T08:13:41.173433+0000","last_active":"2024-01-20T08:13:42.162049+0000","last_peered":"2024-01-20T08:13:42.162049+0000","last_clean":"2024-01-20T08:13:42.162049+0000","last_became_active":"2024-01-20T08:13:41.169059+0000","last_became_peered":"2024-01-20T08:13:41.169059+0000","last_unstale":"2024-01-20T08:13:42.162049+0000","last_undegraded":"2024-01-20T08:13:42.162049+0000","last_fullsized":"2024-01-20T08:13:42.162049+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:39:13.573493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166773+0000","last_change":"2024-01-20T08:13:21.206635+0000","last_active":"2024-01-20T08:13:41.166773+0000","last_peered":"2024-01-20T08:13:41.166773+0000","last_clean":"2024-01-20T08:13:41.166773+0000","last_became_active":"2024-01-20T08:13:21.206301+0000","last_became_peered":"2024-01-20T08:13:21.206301+0000","last_unstale":"2024-01-20T08:13:41.166773+0000","last_undegraded":"2024-01-20T08:13:41.166773+0000","last_fullsized":"2024-01-20T08:13:41.166773+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162040+0000","last_change":"2024-01-20T08:13:41.170946+0000","last_active":"2024-01-20T08:13:42.162040+0000","last_peered":"2024-01-20T08:13:42.162040+0000","last_clean":"2024-01-20T08:13:42.162040+0000","last_became_active":"2024-01-20T08:13:41.169312+0000","last_became_peered":"2024-01-20T08:13:41.169312+0000","last_unstale":"2024-01-20T08:13:42.162040+0000","last_undegraded":"2024-01-20T08:13:42.162040+0000","last_fullsized":"2024-01-20T08:13:42.162040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:50:42.367144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.173444+0000","last_change":"2024-01-20T08:13:21.201236+0000","last_active":"2024-01-20T08:13:41.173444+0000","last_peered":"2024-01-20T08:13:41.173444+0000","last_clean":"2024-01-20T08:13:41.173444+0000","last_became_active":"2024-01-20T08:13:21.200906+0000","last_became_peered":"2024-01-20T08:13:21.200906+0000","last_unstale":"2024-01-20T08:13:41.173444+0000","last_undegraded":"2024-01-20T08:13:41.173444+0000","last_fullsized":"2024-01-20T08:13:41.173444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.167043+0000","last_change":"2024-01-20T08:13:41.173381+0000","last_active":"2024-01-20T08:13:42.167043+0000","last_peered":"2024-01-20T08:13:42.167043+0000","last_clean":"2024-01-20T08:13:42.167043+0000","last_became_active":"2024-01-20T08:13:41.168848+0000","last_became_peered":"2024-01-20T08:13:41.168848+0000","last_unstale":"2024-01-20T08:13:42.167043+0000","last_undegraded":"2024-01-20T08:13:42.167043+0000","last_fullsized":"2024-01-20T08:13:42.167043+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:10.926774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.153165+0000","last_change":"2024-01-20T08:13:21.210016+0000","last_active":"2024-01-20T08:13:41.153165+0000","last_peered":"2024-01-20T08:13:41.153165+0000","last_clean":"2024-01-20T08:13:41.153165+0000","last_became_active":"2024-01-20T08:13:21.207584+0000","last_became_peered":"2024-01-20T08:13:21.207584+0000","last_unstale":"2024-01-20T08:13:41.153165+0000","last_undegraded":"2024-01-20T08:13:41.153165+0000","last_fullsized":"2024-01-20T08:13:41.153165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:01:07.895006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.954768+0000","last_change":"2024-01-20T08:13:41.150303+0000","last_active":"2024-01-20T08:13:42.954768+0000","last_peered":"2024-01-20T08:13:42.954768+0000","last_clean":"2024-01-20T08:13:42.954768+0000","last_became_active":"2024-01-20T08:13:41.149807+0000","last_became_peered":"2024-01-20T08:13:41.149807+0000","last_unstale":"2024-01-20T08:13:42.954768+0000","last_undegraded":"2024-01-20T08:13:42.954768+0000","last_fullsized":"2024-01-20T08:13:42.954768+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:16.830064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133303+0000","last_change":"2024-01-20T08:13:21.213567+0000","last_active":"2024-01-20T08:13:41.133303+0000","last_peered":"2024-01-20T08:13:41.133303+0000","last_clean":"2024-01-20T08:13:41.133303+0000","last_became_active":"2024-01-20T08:13:21.213303+0000","last_became_peered":"2024-01-20T08:13:21.213303+0000","last_unstale":"2024-01-20T08:13:41.133303+0000","last_undegraded":"2024-01-20T08:13:41.133303+0000","last_fullsized":"2024-01-20T08:13:41.133303+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165439+0000","last_change":"2024-01-20T08:13:41.161711+0000","last_active":"2024-01-20T08:13:42.165439+0000","last_peered":"2024-01-20T08:13:42.165439+0000","last_clean":"2024-01-20T08:13:42.165439+0000","last_became_active":"2024-01-20T08:13:41.161350+0000","last_became_peered":"2024-01-20T08:13:41.161350+0000","last_unstale":"2024-01-20T08:13:42.165439+0000","last_undegraded":"2024-01-20T08:13:42.165439+0000","last_fullsized":"2024-01-20T08:13:42.165439+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:06:31.565838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.152631+0000","last_change":"2024-01-20T08:13:21.206638+0000","last_active":"2024-01-20T08:13:41.152631+0000","last_peered":"2024-01-20T08:13:41.152631+0000","last_clean":"2024-01-20T08:13:41.152631+0000","last_became_active":"2024-01-20T08:13:21.205976+0000","last_became_peered":"2024-01-20T08:13:21.205976+0000","last_unstale":"2024-01-20T08:13:41.152631+0000","last_undegraded":"2024-01-20T08:13:41.152631+0000","last_fullsized":"2024-01-20T08:13:41.152631+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:49:51.799518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.953184+0000","last_change":"2024-01-20T08:13:41.148940+0000","last_active":"2024-01-20T08:13:42.953184+0000","last_peered":"2024-01-20T08:13:42.953184+0000","last_clean":"2024-01-20T08:13:42.953184+0000","last_became_active":"2024-01-20T08:13:41.148356+0000","last_became_peered":"2024-01-20T08:13:41.148356+0000","last_unstale":"2024-01-20T08:13:42.953184+0000","last_undegraded":"2024-01-20T08:13:42.953184+0000","last_fullsized":"2024-01-20T08:13:42.953184+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:24:12.142409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151374+0000","last_change":"2024-01-20T08:13:21.216827+0000","last_active":"2024-01-20T08:13:41.151374+0000","last_peered":"2024-01-20T08:13:41.151374+0000","last_clean":"2024-01-20T08:13:41.151374+0000","last_became_active":"2024-01-20T08:13:21.215631+0000","last_became_peered":"2024-01-20T08:13:21.215631+0000","last_unstale":"2024-01-20T08:13:41.151374+0000","last_undegraded":"2024-01-20T08:13:41.151374+0000","last_fullsized":"2024-01-20T08:13:41.151374+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:19:59.199788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.207371+0000","last_change":"2024-01-20T08:13:41.156668+0000","last_active":"2024-01-20T08:13:42.207371+0000","last_peered":"2024-01-20T08:13:42.207371+0000","last_clean":"2024-01-20T08:13:42.207371+0000","last_became_active":"2024-01-20T08:13:41.156377+0000","last_became_peered":"2024-01-20T08:13:41.156377+0000","last_unstale":"2024-01-20T08:13:42.207371+0000","last_undegraded":"2024-01-20T08:13:42.207371+0000","last_fullsized":"2024-01-20T08:13:42.207371+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:16.150426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.140165+0000","last_change":"2024-01-20T08:13:21.209274+0000","last_active":"2024-01-20T08:13:41.140165+0000","last_peered":"2024-01-20T08:13:41.140165+0000","last_clean":"2024-01-20T08:13:41.140165+0000","last_became_active":"2024-01-20T08:13:21.208732+0000","last_became_peered":"2024-01-20T08:13:21.208732+0000","last_unstale":"2024-01-20T08:13:41.140165+0000","last_undegraded":"2024-01-20T08:13:41.140165+0000","last_fullsized":"2024-01-20T08:13:41.140165+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:35.161556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.163290+0000","last_change":"2024-01-20T08:13:41.164646+0000","last_active":"2024-01-20T08:13:42.163290+0000","last_peered":"2024-01-20T08:13:42.163290+0000","last_clean":"2024-01-20T08:13:42.163290+0000","last_became_active":"2024-01-20T08:13:41.164379+0000","last_became_peered":"2024-01-20T08:13:41.164379+0000","last_unstale":"2024-01-20T08:13:42.163290+0000","last_undegraded":"2024-01-20T08:13:42.163290+0000","last_fullsized":"2024-01-20T08:13:42.163290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:15:14.387629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.160094+0000","last_change":"2024-01-20T08:13:21.216395+0000","last_active":"2024-01-20T08:13:41.160094+0000","last_peered":"2024-01-20T08:13:41.160094+0000","last_clean":"2024-01-20T08:13:41.160094+0000","last_became_active":"2024-01-20T08:13:21.216015+0000","last_became_peered":"2024-01-20T08:13:21.216015+0000","last_unstale":"2024-01-20T08:13:41.160094+0000","last_undegraded":"2024-01-20T08:13:41.160094+0000","last_fullsized":"2024-01-20T08:13:41.160094+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.953330+0000","last_change":"2024-01-20T08:13:41.152250+0000","last_active":"2024-01-20T08:13:42.953330+0000","last_peered":"2024-01-20T08:13:42.953330+0000","last_clean":"2024-01-20T08:13:42.953330+0000","last_became_active":"2024-01-20T08:13:41.151931+0000","last_became_peered":"2024-01-20T08:13:41.151931+0000","last_unstale":"2024-01-20T08:13:42.953330+0000","last_undegraded":"2024-01-20T08:13:42.953330+0000","last_fullsized":"2024-01-20T08:13:42.953330+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:42:35.583464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151507+0000","last_change":"2024-01-20T08:13:21.199935+0000","last_active":"2024-01-20T08:13:41.151507+0000","last_peered":"2024-01-20T08:13:41.151507+0000","last_clean":"2024-01-20T08:13:41.151507+0000","last_became_active":"2024-01-20T08:13:21.199628+0000","last_became_peered":"2024-01-20T08:13:21.199628+0000","last_unstale":"2024-01-20T08:13:41.151507+0000","last_undegraded":"2024-01-20T08:13:41.151507+0000","last_fullsized":"2024-01-20T08:13:41.151507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:29.947787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.208244+0000","last_change":"2024-01-20T08:13:41.165482+0000","last_active":"2024-01-20T08:13:42.208244+0000","last_peered":"2024-01-20T08:13:42.208244+0000","last_clean":"2024-01-20T08:13:42.208244+0000","last_became_active":"2024-01-20T08:13:41.164329+0000","last_became_peered":"2024-01-20T08:13:41.164329+0000","last_unstale":"2024-01-20T08:13:42.208244+0000","last_undegraded":"2024-01-20T08:13:42.208244+0000","last_fullsized":"2024-01-20T08:13:42.208244+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:18.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144593+0000","last_change":"2024-01-20T08:13:21.208900+0000","last_active":"2024-01-20T08:13:41.144593+0000","last_peered":"2024-01-20T08:13:41.144593+0000","last_clean":"2024-01-20T08:13:41.144593+0000","last_became_active":"2024-01-20T08:13:21.208589+0000","last_became_peered":"2024-01-20T08:13:21.208589+0000","last_unstale":"2024-01-20T08:13:41.144593+0000","last_undegraded":"2024-01-20T08:13:41.144593+0000","last_fullsized":"2024-01-20T08:13:41.144593+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:25.552396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.453747+0000","last_change":"2024-01-20T08:13:41.165305+0000","last_active":"2024-01-20T08:13:42.453747+0000","last_peered":"2024-01-20T08:13:42.453747+0000","last_clean":"2024-01-20T08:13:42.453747+0000","last_became_active":"2024-01-20T08:13:41.164762+0000","last_became_peered":"2024-01-20T08:13:41.164762+0000","last_unstale":"2024-01-20T08:13:42.453747+0000","last_undegraded":"2024-01-20T08:13:42.453747+0000","last_fullsized":"2024-01-20T08:13:42.453747+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:16.150426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.135514+0000","last_change":"2024-01-20T08:13:21.221283+0000","last_active":"2024-01-20T08:13:41.135514+0000","last_peered":"2024-01-20T08:13:41.135514+0000","last_clean":"2024-01-20T08:13:41.135514+0000","last_became_active":"2024-01-20T08:13:21.220760+0000","last_became_peered":"2024-01-20T08:13:21.220760+0000","last_unstale":"2024-01-20T08:13:41.135514+0000","last_undegraded":"2024-01-20T08:13:41.135514+0000","last_fullsized":"2024-01-20T08:13:41.135514+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.454973+0000","last_change":"2024-01-20T08:13:41.173009+0000","last_active":"2024-01-20T08:13:42.454973+0000","last_peered":"2024-01-20T08:13:42.454973+0000","last_clean":"2024-01-20T08:13:42.454973+0000","last_became_active":"2024-01-20T08:13:41.172568+0000","last_became_peered":"2024-01-20T08:13:41.172568+0000","last_unstale":"2024-01-20T08:13:42.454973+0000","last_undegraded":"2024-01-20T08:13:42.454973+0000","last_fullsized":"2024-01-20T08:13:42.454973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:30:39.538363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.165612+0000","last_change":"2024-01-20T08:13:21.192696+0000","last_active":"2024-01-20T08:13:41.165612+0000","last_peered":"2024-01-20T08:13:41.165612+0000","last_clean":"2024-01-20T08:13:41.165612+0000","last_became_active":"2024-01-20T08:13:21.191002+0000","last_became_peered":"2024-01-20T08:13:21.191002+0000","last_unstale":"2024-01-20T08:13:41.165612+0000","last_undegraded":"2024-01-20T08:13:41.165612+0000","last_fullsized":"2024-01-20T08:13:41.165612+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.955282+0000","last_change":"2024-01-20T08:13:41.158774+0000","last_active":"2024-01-20T08:13:42.955282+0000","last_peered":"2024-01-20T08:13:42.955282+0000","last_clean":"2024-01-20T08:13:42.955282+0000","last_became_active":"2024-01-20T08:13:41.158343+0000","last_became_peered":"2024-01-20T08:13:41.158343+0000","last_unstale":"2024-01-20T08:13:42.955282+0000","last_undegraded":"2024-01-20T08:13:42.955282+0000","last_fullsized":"2024-01-20T08:13:42.955282+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:05:39.706858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161809+0000","last_change":"2024-01-20T08:13:21.214895+0000","last_active":"2024-01-20T08:13:41.161809+0000","last_peered":"2024-01-20T08:13:41.161809+0000","last_clean":"2024-01-20T08:13:41.161809+0000","last_became_active":"2024-01-20T08:13:21.214074+0000","last_became_peered":"2024-01-20T08:13:21.214074+0000","last_unstale":"2024-01-20T08:13:41.161809+0000","last_undegraded":"2024-01-20T08:13:41.161809+0000","last_fullsized":"2024-01-20T08:13:41.161809+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165001+0000","last_change":"2024-01-20T08:13:41.174415+0000","last_active":"2024-01-20T08:13:42.165001+0000","last_peered":"2024-01-20T08:13:42.165001+0000","last_clean":"2024-01-20T08:13:42.165001+0000","last_became_active":"2024-01-20T08:13:41.170268+0000","last_became_peered":"2024-01-20T08:13:41.170268+0000","last_unstale":"2024-01-20T08:13:42.165001+0000","last_undegraded":"2024-01-20T08:13:42.165001+0000","last_fullsized":"2024-01-20T08:13:42.165001+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:54:04.815527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144139+0000","last_change":"2024-01-20T08:13:21.193350+0000","last_active":"2024-01-20T08:13:41.144139+0000","last_peered":"2024-01-20T08:13:41.144139+0000","last_clean":"2024-01-20T08:13:41.144139+0000","last_became_active":"2024-01-20T08:13:21.190263+0000","last_became_peered":"2024-01-20T08:13:21.190263+0000","last_unstale":"2024-01-20T08:13:41.144139+0000","last_undegraded":"2024-01-20T08:13:41.144139+0000","last_fullsized":"2024-01-20T08:13:41.144139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:21.939248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.163034+0000","last_change":"2024-01-20T08:13:41.152676+0000","last_active":"2024-01-20T08:13:42.163034+0000","last_peered":"2024-01-20T08:13:42.163034+0000","last_clean":"2024-01-20T08:13:42.163034+0000","last_became_active":"2024-01-20T08:13:41.152414+0000","last_became_peered":"2024-01-20T08:13:41.152414+0000","last_unstale":"2024-01-20T08:13:42.163034+0000","last_undegraded":"2024-01-20T08:13:42.163034+0000","last_fullsized":"2024-01-20T08:13:42.163034+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:25.397911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.140249+0000","last_change":"2024-01-20T08:13:21.203014+0000","last_active":"2024-01-20T08:13:41.140249+0000","last_peered":"2024-01-20T08:13:41.140249+0000","last_clean":"2024-01-20T08:13:41.140249+0000","last_became_active":"2024-01-20T08:13:21.202757+0000","last_became_peered":"2024-01-20T08:13:21.202757+0000","last_unstale":"2024-01-20T08:13:41.140249+0000","last_undegraded":"2024-01-20T08:13:41.140249+0000","last_fullsized":"2024-01-20T08:13:41.140249+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:14.627656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.954298+0000","last_change":"2024-01-20T08:13:41.152017+0000","last_active":"2024-01-20T08:13:42.954298+0000","last_peered":"2024-01-20T08:13:42.954298+0000","last_clean":"2024-01-20T08:13:42.954298+0000","last_became_active":"2024-01-20T08:13:41.151742+0000","last_became_peered":"2024-01-20T08:13:41.151742+0000","last_unstale":"2024-01-20T08:13:42.954298+0000","last_undegraded":"2024-01-20T08:13:42.954298+0000","last_fullsized":"2024-01-20T08:13:42.954298+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:44:44.790087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.169136+0000","last_change":"2024-01-20T08:13:21.208493+0000","last_active":"2024-01-20T08:13:41.169136+0000","last_peered":"2024-01-20T08:13:41.169136+0000","last_clean":"2024-01-20T08:13:41.169136+0000","last_became_active":"2024-01-20T08:13:21.208222+0000","last_became_peered":"2024-01-20T08:13:21.208222+0000","last_unstale":"2024-01-20T08:13:41.169136+0000","last_undegraded":"2024-01-20T08:13:41.169136+0000","last_fullsized":"2024-01-20T08:13:41.169136+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162803+0000","last_change":"2024-01-20T08:13:41.166663+0000","last_active":"2024-01-20T08:13:42.162803+0000","last_peered":"2024-01-20T08:13:42.162803+0000","last_clean":"2024-01-20T08:13:42.162803+0000","last_became_active":"2024-01-20T08:13:41.166418+0000","last_became_peered":"2024-01-20T08:13:41.166418+0000","last_unstale":"2024-01-20T08:13:42.162803+0000","last_undegraded":"2024-01-20T08:13:42.162803+0000","last_fullsized":"2024-01-20T08:13:42.162803+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:14:44.208002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.159691+0000","last_change":"2024-01-20T08:13:21.209448+0000","last_active":"2024-01-20T08:13:41.159691+0000","last_peered":"2024-01-20T08:13:41.159691+0000","last_clean":"2024-01-20T08:13:41.159691+0000","last_became_active":"2024-01-20T08:13:21.209077+0000","last_became_peered":"2024-01-20T08:13:21.209077+0000","last_unstale":"2024-01-20T08:13:41.159691+0000","last_undegraded":"2024-01-20T08:13:41.159691+0000","last_fullsized":"2024-01-20T08:13:41.159691+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:40.932416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162063+0000","last_change":"2024-01-20T08:13:41.174526+0000","last_active":"2024-01-20T08:13:42.162063+0000","last_peered":"2024-01-20T08:13:42.162063+0000","last_clean":"2024-01-20T08:13:42.162063+0000","last_became_active":"2024-01-20T08:13:41.174106+0000","last_became_peered":"2024-01-20T08:13:41.174106+0000","last_unstale":"2024-01-20T08:13:42.162063+0000","last_undegraded":"2024-01-20T08:13:42.162063+0000","last_fullsized":"2024-01-20T08:13:42.162063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:04:07.178594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.177890+0000","last_change":"2024-01-20T08:13:40.129620+0000","last_active":"2024-01-20T08:13:41.177890+0000","last_peered":"2024-01-20T08:13:41.177890+0000","last_clean":"2024-01-20T08:13:41.177890+0000","last_became_active":"2024-01-20T08:13:40.129373+0000","last_became_peered":"2024-01-20T08:13:40.129373+0000","last_unstale":"2024-01-20T08:13:41.177890+0000","last_undegraded":"2024-01-20T08:13:41.177890+0000","last_fullsized":"2024-01-20T08:13:41.177890+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:08:32.278321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.173414+0000","last_change":"2024-01-20T08:13:21.211031+0000","last_active":"2024-01-20T08:13:41.173414+0000","last_peered":"2024-01-20T08:13:41.173414+0000","last_clean":"2024-01-20T08:13:41.173414+0000","last_became_active":"2024-01-20T08:13:21.210644+0000","last_became_peered":"2024-01-20T08:13:21.210644+0000","last_unstale":"2024-01-20T08:13:41.173414+0000","last_undegraded":"2024-01-20T08:13:41.173414+0000","last_fullsized":"2024-01-20T08:13:41.173414+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"71'4","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166097+0000","last_change":"2024-01-20T08:13:20.175031+0000","last_active":"2024-01-20T08:13:41.166097+0000","last_peered":"2024-01-20T08:13:41.166097+0000","last_clean":"2024-01-20T08:13:41.166097+0000","last_became_active":"2024-01-20T08:13:20.174631+0000","last_became_peered":"2024-01-20T08:13:20.174631+0000","last_unstale":"2024-01-20T08:13:41.166097+0000","last_undegraded":"2024-01-20T08:13:41.166097+0000","last_fullsized":"2024-01-20T08:13:41.166097+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.167900+0000","last_change":"2024-01-20T08:13:41.164487+0000","last_active":"2024-01-20T08:13:42.167900+0000","last_peered":"2024-01-20T08:13:42.167900+0000","last_clean":"2024-01-20T08:13:42.167900+0000","last_became_active":"2024-01-20T08:13:41.162254+0000","last_became_peered":"2024-01-20T08:13:41.162254+0000","last_unstale":"2024-01-20T08:13:42.167900+0000","last_undegraded":"2024-01-20T08:13:42.167900+0000","last_fullsized":"2024-01-20T08:13:42.167900+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:36.914262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.176914+0000","last_change":"2024-01-20T08:13:40.136955+0000","last_active":"2024-01-20T08:13:41.176914+0000","last_peered":"2024-01-20T08:13:41.176914+0000","last_clean":"2024-01-20T08:13:41.176914+0000","last_became_active":"2024-01-20T08:13:40.136627+0000","last_became_peered":"2024-01-20T08:13:40.136627+0000","last_unstale":"2024-01-20T08:13:41.176914+0000","last_undegraded":"2024-01-20T08:13:41.176914+0000","last_fullsized":"2024-01-20T08:13:41.176914+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:09.916701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161585+0000","last_change":"2024-01-20T08:13:21.216605+0000","last_active":"2024-01-20T08:13:41.161585+0000","last_peered":"2024-01-20T08:13:41.161585+0000","last_clean":"2024-01-20T08:13:41.161585+0000","last_became_active":"2024-01-20T08:13:21.216155+0000","last_became_peered":"2024-01-20T08:13:21.216155+0000","last_unstale":"2024-01-20T08:13:41.161585+0000","last_undegraded":"2024-01-20T08:13:41.161585+0000","last_fullsized":"2024-01-20T08:13:41.161585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:02.992098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"71'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.173522+0000","last_change":"2024-01-20T08:13:20.155511+0000","last_active":"2024-01-20T08:13:41.173522+0000","last_peered":"2024-01-20T08:13:41.173522+0000","last_clean":"2024-01-20T08:13:41.173522+0000","last_became_active":"2024-01-20T08:13:20.153691+0000","last_became_peered":"2024-01-20T08:13:20.153691+0000","last_unstale":"2024-01-20T08:13:41.173522+0000","last_undegraded":"2024-01-20T08:13:41.173522+0000","last_fullsized":"2024-01-20T08:13:41.173522+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162369+0000","last_change":"2024-01-20T08:13:41.165773+0000","last_active":"2024-01-20T08:13:42.162369+0000","last_peered":"2024-01-20T08:13:42.162369+0000","last_clean":"2024-01-20T08:13:42.162369+0000","last_became_active":"2024-01-20T08:13:41.165456+0000","last_became_peered":"2024-01-20T08:13:41.165456+0000","last_unstale":"2024-01-20T08:13:42.162369+0000","last_undegraded":"2024-01-20T08:13:42.162369+0000","last_fullsized":"2024-01-20T08:13:42.162369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:53:36.262012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"75'4","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.177894+0000","last_change":"2024-01-20T08:13:40.140777+0000","last_active":"2024-01-20T08:13:41.177894+0000","last_peered":"2024-01-20T08:13:41.177894+0000","last_clean":"2024-01-20T08:13:41.177894+0000","last_became_active":"2024-01-20T08:13:40.140148+0000","last_became_peered":"2024-01-20T08:13:40.140148+0000","last_unstale":"2024-01-20T08:13:41.177894+0000","last_undegraded":"2024-01-20T08:13:41.177894+0000","last_fullsized":"2024-01-20T08:13:41.177894+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:53:15.140353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161936+0000","last_change":"2024-01-20T08:13:21.220607+0000","last_active":"2024-01-20T08:13:41.161936+0000","last_peered":"2024-01-20T08:13:41.161936+0000","last_clean":"2024-01-20T08:13:41.161936+0000","last_became_active":"2024-01-20T08:13:21.220262+0000","last_became_peered":"2024-01-20T08:13:21.220262+0000","last_unstale":"2024-01-20T08:13:41.161936+0000","last_undegraded":"2024-01-20T08:13:41.161936+0000","last_fullsized":"2024-01-20T08:13:41.161936+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133664+0000","last_change":"2024-01-20T08:13:20.173935+0000","last_active":"2024-01-20T08:13:41.133664+0000","last_peered":"2024-01-20T08:13:41.133664+0000","last_clean":"2024-01-20T08:13:41.133664+0000","last_became_active":"2024-01-20T08:13:20.173657+0000","last_became_peered":"2024-01-20T08:13:20.173657+0000","last_unstale":"2024-01-20T08:13:41.133664+0000","last_undegraded":"2024-01-20T08:13:41.133664+0000","last_fullsized":"2024-01-20T08:13:41.133664+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:17.822653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165823+0000","last_change":"2024-01-20T08:13:41.170387+0000","last_active":"2024-01-20T08:13:42.165823+0000","last_peered":"2024-01-20T08:13:42.165823+0000","last_clean":"2024-01-20T08:13:42.165823+0000","last_became_active":"2024-01-20T08:13:41.170164+0000","last_became_peered":"2024-01-20T08:13:41.170164+0000","last_unstale":"2024-01-20T08:13:42.165823+0000","last_undegraded":"2024-01-20T08:13:42.165823+0000","last_fullsized":"2024-01-20T08:13:42.165823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:41:46.835324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"75'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.164590+0000","last_change":"2024-01-20T08:13:40.134139+0000","last_active":"2024-01-20T08:13:41.164590+0000","last_peered":"2024-01-20T08:13:41.164590+0000","last_clean":"2024-01-20T08:13:41.164590+0000","last_became_active":"2024-01-20T08:13:40.133632+0000","last_became_peered":"2024-01-20T08:13:40.133632+0000","last_unstale":"2024-01-20T08:13:41.164590+0000","last_undegraded":"2024-01-20T08:13:41.164590+0000","last_fullsized":"2024-01-20T08:13:41.164590+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.137248+0000","last_change":"2024-01-20T08:13:21.203825+0000","last_active":"2024-01-20T08:13:41.137248+0000","last_peered":"2024-01-20T08:13:41.137248+0000","last_clean":"2024-01-20T08:13:41.137248+0000","last_became_active":"2024-01-20T08:13:21.203432+0000","last_became_peered":"2024-01-20T08:13:21.203432+0000","last_unstale":"2024-01-20T08:13:41.137248+0000","last_undegraded":"2024-01-20T08:13:41.137248+0000","last_fullsized":"2024-01-20T08:13:41.137248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133978+0000","last_change":"2024-01-20T08:13:20.175591+0000","last_active":"2024-01-20T08:13:41.133978+0000","last_peered":"2024-01-20T08:13:41.133978+0000","last_clean":"2024-01-20T08:13:41.133978+0000","last_became_active":"2024-01-20T08:13:20.174885+0000","last_became_peered":"2024-01-20T08:13:20.174885+0000","last_unstale":"2024-01-20T08:13:41.133978+0000","last_undegraded":"2024-01-20T08:13:41.133978+0000","last_fullsized":"2024-01-20T08:13:41.133978+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:38.289696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.164895+0000","last_change":"2024-01-20T08:13:41.165837+0000","last_active":"2024-01-20T08:13:42.164895+0000","last_peered":"2024-01-20T08:13:42.164895+0000","last_clean":"2024-01-20T08:13:42.164895+0000","last_became_active":"2024-01-20T08:13:41.165516+0000","last_became_peered":"2024-01-20T08:13:41.165516+0000","last_unstale":"2024-01-20T08:13:42.164895+0000","last_undegraded":"2024-01-20T08:13:42.164895+0000","last_fullsized":"2024-01-20T08:13:42.164895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:20:18.105535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161173+0000","last_change":"2024-01-20T08:13:40.141034+0000","last_active":"2024-01-20T08:13:41.161173+0000","last_peered":"2024-01-20T08:13:41.161173+0000","last_clean":"2024-01-20T08:13:41.161173+0000","last_became_active":"2024-01-20T08:13:40.140116+0000","last_became_peered":"2024-01-20T08:13:40.140116+0000","last_unstale":"2024-01-20T08:13:41.161173+0000","last_undegraded":"2024-01-20T08:13:41.161173+0000","last_fullsized":"2024-01-20T08:13:41.161173+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:13.884359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.140323+0000","last_change":"2024-01-20T08:13:21.202853+0000","last_active":"2024-01-20T08:13:41.140323+0000","last_peered":"2024-01-20T08:13:41.140323+0000","last_clean":"2024-01-20T08:13:41.140323+0000","last_became_active":"2024-01-20T08:13:21.202375+0000","last_became_peered":"2024-01-20T08:13:21.202375+0000","last_unstale":"2024-01-20T08:13:41.140323+0000","last_undegraded":"2024-01-20T08:13:41.140323+0000","last_fullsized":"2024-01-20T08:13:41.140323+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:34.174268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"71'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166828+0000","last_change":"2024-01-20T08:13:20.158072+0000","last_active":"2024-01-20T08:13:41.166828+0000","last_peered":"2024-01-20T08:13:41.166828+0000","last_clean":"2024-01-20T08:13:41.166828+0000","last_became_active":"2024-01-20T08:13:20.157326+0000","last_became_peered":"2024-01-20T08:13:20.157326+0000","last_unstale":"2024-01-20T08:13:41.166828+0000","last_undegraded":"2024-01-20T08:13:41.166828+0000","last_fullsized":"2024-01-20T08:13:41.166828+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165973+0000","last_change":"2024-01-20T08:13:41.174246+0000","last_active":"2024-01-20T08:13:42.165973+0000","last_peered":"2024-01-20T08:13:42.165973+0000","last_clean":"2024-01-20T08:13:42.165973+0000","last_became_active":"2024-01-20T08:13:41.173941+0000","last_became_peered":"2024-01-20T08:13:41.173941+0000","last_unstale":"2024-01-20T08:13:42.165973+0000","last_undegraded":"2024-01-20T08:13:42.165973+0000","last_fullsized":"2024-01-20T08:13:42.165973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:45:20.476323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.142198+0000","last_change":"2024-01-20T08:13:40.138670+0000","last_active":"2024-01-20T08:13:41.142198+0000","last_peered":"2024-01-20T08:13:41.142198+0000","last_clean":"2024-01-20T08:13:41.142198+0000","last_became_active":"2024-01-20T08:13:40.138225+0000","last_became_peered":"2024-01-20T08:13:40.138225+0000","last_unstale":"2024-01-20T08:13:41.142198+0000","last_undegraded":"2024-01-20T08:13:41.142198+0000","last_fullsized":"2024-01-20T08:13:41.142198+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:58.256996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166602+0000","last_change":"2024-01-20T08:13:21.204537+0000","last_active":"2024-01-20T08:13:41.166602+0000","last_peered":"2024-01-20T08:13:41.166602+0000","last_clean":"2024-01-20T08:13:41.166602+0000","last_became_active":"2024-01-20T08:13:21.204071+0000","last_became_peered":"2024-01-20T08:13:21.204071+0000","last_unstale":"2024-01-20T08:13:41.166602+0000","last_undegraded":"2024-01-20T08:13:41.166602+0000","last_fullsized":"2024-01-20T08:13:41.166602+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"71'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.170595+0000","last_change":"2024-01-20T08:13:20.163181+0000","last_active":"2024-01-20T08:13:41.170595+0000","last_peered":"2024-01-20T08:13:41.170595+0000","last_clean":"2024-01-20T08:13:41.170595+0000","last_became_active":"2024-01-20T08:13:20.162838+0000","last_became_peered":"2024-01-20T08:13:20.162838+0000","last_unstale":"2024-01-20T08:13:41.170595+0000","last_undegraded":"2024-01-20T08:13:41.170595+0000","last_fullsized":"2024-01-20T08:13:41.170595+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.953487+0000","last_change":"2024-01-20T08:13:41.167108+0000","last_active":"2024-01-20T08:13:42.953487+0000","last_peered":"2024-01-20T08:13:42.953487+0000","last_clean":"2024-01-20T08:13:42.953487+0000","last_became_active":"2024-01-20T08:13:41.166810+0000","last_became_peered":"2024-01-20T08:13:41.166810+0000","last_unstale":"2024-01-20T08:13:42.953487+0000","last_undegraded":"2024-01-20T08:13:42.953487+0000","last_fullsized":"2024-01-20T08:13:42.953487+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:47:14.894433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"75'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.180036+0000","last_change":"2024-01-20T08:13:40.138470+0000","last_active":"2024-01-20T08:13:41.180036+0000","last_peered":"2024-01-20T08:13:41.180036+0000","last_clean":"2024-01-20T08:13:41.180036+0000","last_became_active":"2024-01-20T08:13:40.138199+0000","last_became_peered":"2024-01-20T08:13:40.138199+0000","last_unstale":"2024-01-20T08:13:41.180036+0000","last_undegraded":"2024-01-20T08:13:41.180036+0000","last_fullsized":"2024-01-20T08:13:41.180036+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:59.887136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133678+0000","last_change":"2024-01-20T08:13:21.205068+0000","last_active":"2024-01-20T08:13:41.133678+0000","last_peered":"2024-01-20T08:13:41.133678+0000","last_clean":"2024-01-20T08:13:41.133678+0000","last_became_active":"2024-01-20T08:13:21.204740+0000","last_became_peered":"2024-01-20T08:13:21.204740+0000","last_unstale":"2024-01-20T08:13:41.133678+0000","last_undegraded":"2024-01-20T08:13:41.133678+0000","last_fullsized":"2024-01-20T08:13:41.133678+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.131399+0000","last_change":"2024-01-20T08:13:20.175308+0000","last_active":"2024-01-20T08:13:41.131399+0000","last_peered":"2024-01-20T08:13:41.131399+0000","last_clean":"2024-01-20T08:13:41.131399+0000","last_became_active":"2024-01-20T08:13:20.174921+0000","last_became_peered":"2024-01-20T08:13:20.174921+0000","last_unstale":"2024-01-20T08:13:41.131399+0000","last_undegraded":"2024-01-20T08:13:41.131399+0000","last_fullsized":"2024-01-20T08:13:41.131399+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:54:39.919836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.206823+0000","last_change":"2024-01-20T08:13:41.172947+0000","last_active":"2024-01-20T08:13:42.206823+0000","last_peered":"2024-01-20T08:13:42.206823+0000","last_clean":"2024-01-20T08:13:42.206823+0000","last_became_active":"2024-01-20T08:13:41.171422+0000","last_became_peered":"2024-01-20T08:13:41.171422+0000","last_unstale":"2024-01-20T08:13:42.206823+0000","last_undegraded":"2024-01-20T08:13:42.206823+0000","last_fullsized":"2024-01-20T08:13:42.206823+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:26:50.531149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"75'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.168302+0000","last_change":"2024-01-20T08:13:40.129368+0000","last_active":"2024-01-20T08:13:41.168302+0000","last_peered":"2024-01-20T08:13:41.168302+0000","last_clean":"2024-01-20T08:13:41.168302+0000","last_became_active":"2024-01-20T08:13:40.129051+0000","last_became_peered":"2024-01-20T08:13:40.129051+0000","last_unstale":"2024-01-20T08:13:41.168302+0000","last_undegraded":"2024-01-20T08:13:41.168302+0000","last_fullsized":"2024-01-20T08:13:41.168302+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:28:42.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141634+0000","last_change":"2024-01-20T08:13:21.202158+0000","last_active":"2024-01-20T08:13:41.141634+0000","last_peered":"2024-01-20T08:13:41.141634+0000","last_clean":"2024-01-20T08:13:41.141634+0000","last_became_active":"2024-01-20T08:13:21.201766+0000","last_became_peered":"2024-01-20T08:13:21.201766+0000","last_unstale":"2024-01-20T08:13:41.141634+0000","last_undegraded":"2024-01-20T08:13:41.141634+0000","last_fullsized":"2024-01-20T08:13:41.141634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:46:54.929639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141214+0000","last_change":"2024-01-20T08:13:20.169013+0000","last_active":"2024-01-20T08:13:41.141214+0000","last_peered":"2024-01-20T08:13:41.141214+0000","last_clean":"2024-01-20T08:13:41.141214+0000","last_became_active":"2024-01-20T08:13:20.167975+0000","last_became_peered":"2024-01-20T08:13:20.167975+0000","last_unstale":"2024-01-20T08:13:41.141214+0000","last_undegraded":"2024-01-20T08:13:41.141214+0000","last_fullsized":"2024-01-20T08:13:41.141214+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:51:04.725904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.453040+0000","last_change":"2024-01-20T08:13:41.169635+0000","last_active":"2024-01-20T08:13:42.453040+0000","last_peered":"2024-01-20T08:13:42.453040+0000","last_clean":"2024-01-20T08:13:42.453040+0000","last_became_active":"2024-01-20T08:13:41.168957+0000","last_became_peered":"2024-01-20T08:13:41.168957+0000","last_unstale":"2024-01-20T08:13:42.453040+0000","last_undegraded":"2024-01-20T08:13:42.453040+0000","last_fullsized":"2024-01-20T08:13:42.453040+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:26:50.531149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"75'3","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.174634+0000","last_change":"2024-01-20T08:13:40.141046+0000","last_active":"2024-01-20T08:13:41.174634+0000","last_peered":"2024-01-20T08:13:41.174634+0000","last_clean":"2024-01-20T08:13:41.174634+0000","last_became_active":"2024-01-20T08:13:40.140753+0000","last_became_peered":"2024-01-20T08:13:40.140753+0000","last_unstale":"2024-01-20T08:13:41.174634+0000","last_undegraded":"2024-01-20T08:13:41.174634+0000","last_fullsized":"2024-01-20T08:13:41.174634+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.142624+0000","last_change":"2024-01-20T08:13:21.191705+0000","last_active":"2024-01-20T08:13:41.142624+0000","last_peered":"2024-01-20T08:13:41.142624+0000","last_clean":"2024-01-20T08:13:41.142624+0000","last_became_active":"2024-01-20T08:13:21.191122+0000","last_became_peered":"2024-01-20T08:13:21.191122+0000","last_unstale":"2024-01-20T08:13:41.142624+0000","last_undegraded":"2024-01-20T08:13:41.142624+0000","last_fullsized":"2024-01-20T08:13:41.142624+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:30.402832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.163140+0000","last_change":"2024-01-20T08:13:20.169411+0000","last_active":"2024-01-20T08:13:41.163140+0000","last_peered":"2024-01-20T08:13:41.163140+0000","last_clean":"2024-01-20T08:13:41.163140+0000","last_became_active":"2024-01-20T08:13:20.169033+0000","last_became_peered":"2024-01-20T08:13:20.169033+0000","last_unstale":"2024-01-20T08:13:41.163140+0000","last_undegraded":"2024-01-20T08:13:41.163140+0000","last_fullsized":"2024-01-20T08:13:41.163140+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:20.926669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.207519+0000","last_change":"2024-01-20T08:13:41.147736+0000","last_active":"2024-01-20T08:13:42.207519+0000","last_peered":"2024-01-20T08:13:42.207519+0000","last_clean":"2024-01-20T08:13:42.207519+0000","last_became_active":"2024-01-20T08:13:41.145932+0000","last_became_peered":"2024-01-20T08:13:41.145932+0000","last_unstale":"2024-01-20T08:13:42.207519+0000","last_undegraded":"2024-01-20T08:13:42.207519+0000","last_fullsized":"2024-01-20T08:13:42.207519+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:43:43.234181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"75'6","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.185928+0000","last_change":"2024-01-20T08:13:40.139406+0000","last_active":"2024-01-20T08:13:41.185928+0000","last_peered":"2024-01-20T08:13:41.185928+0000","last_clean":"2024-01-20T08:13:41.185928+0000","last_became_active":"2024-01-20T08:13:40.139147+0000","last_became_peered":"2024-01-20T08:13:40.139147+0000","last_unstale":"2024-01-20T08:13:41.185928+0000","last_undegraded":"2024-01-20T08:13:41.185928+0000","last_fullsized":"2024-01-20T08:13:41.185928+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141189+0000","last_change":"2024-01-20T08:13:21.202843+0000","last_active":"2024-01-20T08:13:41.141189+0000","last_peered":"2024-01-20T08:13:41.141189+0000","last_clean":"2024-01-20T08:13:41.141189+0000","last_became_active":"2024-01-20T08:13:21.202498+0000","last_became_peered":"2024-01-20T08:13:21.202498+0000","last_unstale":"2024-01-20T08:13:41.141189+0000","last_undegraded":"2024-01-20T08:13:41.141189+0000","last_fullsized":"2024-01-20T08:13:41.141189+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161154+0000","last_change":"2024-01-20T08:13:20.173971+0000","last_active":"2024-01-20T08:13:41.161154+0000","last_peered":"2024-01-20T08:13:41.161154+0000","last_clean":"2024-01-20T08:13:41.161154+0000","last_became_active":"2024-01-20T08:13:20.172483+0000","last_became_peered":"2024-01-20T08:13:20.172483+0000","last_unstale":"2024-01-20T08:13:41.161154+0000","last_undegraded":"2024-01-20T08:13:41.161154+0000","last_fullsized":"2024-01-20T08:13:41.161154+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:14:33.161688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.954512+0000","last_change":"2024-01-20T08:13:41.177424+0000","last_active":"2024-01-20T08:13:42.954512+0000","last_peered":"2024-01-20T08:13:42.954512+0000","last_clean":"2024-01-20T08:13:42.954512+0000","last_became_active":"2024-01-20T08:13:41.176846+0000","last_became_peered":"2024-01-20T08:13:41.176846+0000","last_unstale":"2024-01-20T08:13:42.954512+0000","last_undegraded":"2024-01-20T08:13:42.954512+0000","last_fullsized":"2024-01-20T08:13:42.954512+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:15:05.469986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144512+0000","last_change":"2024-01-20T08:13:40.135173+0000","last_active":"2024-01-20T08:13:41.144512+0000","last_peered":"2024-01-20T08:13:41.144512+0000","last_clean":"2024-01-20T08:13:41.144512+0000","last_became_active":"2024-01-20T08:13:40.134749+0000","last_became_peered":"2024-01-20T08:13:40.134749+0000","last_unstale":"2024-01-20T08:13:41.144512+0000","last_undegraded":"2024-01-20T08:13:41.144512+0000","last_fullsized":"2024-01-20T08:13:41.144512+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:29.535217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133885+0000","last_change":"2024-01-20T08:13:21.211141+0000","last_active":"2024-01-20T08:13:41.133885+0000","last_peered":"2024-01-20T08:13:41.133885+0000","last_clean":"2024-01-20T08:13:41.133885+0000","last_became_active":"2024-01-20T08:13:21.209022+0000","last_became_peered":"2024-01-20T08:13:21.209022+0000","last_unstale":"2024-01-20T08:13:41.133885+0000","last_undegraded":"2024-01-20T08:13:41.133885+0000","last_fullsized":"2024-01-20T08:13:41.133885+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:39.080510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"71'3","reported_seq":19,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.162381+0000","last_change":"2024-01-20T08:13:20.174011+0000","last_active":"2024-01-20T08:13:41.162381+0000","last_peered":"2024-01-20T08:13:41.162381+0000","last_clean":"2024-01-20T08:13:41.162381+0000","last_became_active":"2024-01-20T08:13:20.173550+0000","last_became_peered":"2024-01-20T08:13:20.173550+0000","last_unstale":"2024-01-20T08:13:41.162381+0000","last_undegraded":"2024-01-20T08:13:41.162381+0000","last_fullsized":"2024-01-20T08:13:41.162381+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:50.375202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.168935+0000","last_change":"2024-01-20T08:13:41.175813+0000","last_active":"2024-01-20T08:13:42.168935+0000","last_peered":"2024-01-20T08:13:42.168935+0000","last_clean":"2024-01-20T08:13:42.168935+0000","last_became_active":"2024-01-20T08:13:41.175328+0000","last_became_peered":"2024-01-20T08:13:41.175328+0000","last_unstale":"2024-01-20T08:13:42.168935+0000","last_undegraded":"2024-01-20T08:13:42.168935+0000","last_fullsized":"2024-01-20T08:13:42.168935+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:08:33.288395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.143326+0000","last_change":"2024-01-20T08:13:40.140385+0000","last_active":"2024-01-20T08:13:41.143326+0000","last_peered":"2024-01-20T08:13:41.143326+0000","last_clean":"2024-01-20T08:13:41.143326+0000","last_became_active":"2024-01-20T08:13:40.140136+0000","last_became_peered":"2024-01-20T08:13:40.140136+0000","last_unstale":"2024-01-20T08:13:41.143326+0000","last_undegraded":"2024-01-20T08:13:41.143326+0000","last_fullsized":"2024-01-20T08:13:41.143326+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:28:42.220069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.165795+0000","last_change":"2024-01-20T08:13:21.212370+0000","last_active":"2024-01-20T08:13:41.165795+0000","last_peered":"2024-01-20T08:13:41.165795+0000","last_clean":"2024-01-20T08:13:41.165795+0000","last_became_active":"2024-01-20T08:13:21.212081+0000","last_became_peered":"2024-01-20T08:13:21.212081+0000","last_unstale":"2024-01-20T08:13:41.165795+0000","last_undegraded":"2024-01-20T08:13:41.165795+0000","last_fullsized":"2024-01-20T08:13:41.165795+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"72'9","reported_seq":25,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.145892+0000","last_change":"2024-01-20T08:13:20.175292+0000","last_active":"2024-01-20T08:13:41.145892+0000","last_peered":"2024-01-20T08:13:41.145892+0000","last_clean":"2024-01-20T08:13:41.145892+0000","last_became_active":"2024-01-20T08:13:20.174814+0000","last_became_peered":"2024-01-20T08:13:20.174814+0000","last_unstale":"2024-01-20T08:13:41.145892+0000","last_undegraded":"2024-01-20T08:13:41.145892+0000","last_fullsized":"2024-01-20T08:13:41.145892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:38:52.596120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3107,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.165847+0000","last_change":"2024-01-20T08:13:41.166529+0000","last_active":"2024-01-20T08:13:42.165847+0000","last_peered":"2024-01-20T08:13:42.165847+0000","last_clean":"2024-01-20T08:13:42.165847+0000","last_became_active":"2024-01-20T08:13:41.162375+0000","last_became_peered":"2024-01-20T08:13:41.162375+0000","last_unstale":"2024-01-20T08:13:42.165847+0000","last_undegraded":"2024-01-20T08:13:42.165847+0000","last_fullsized":"2024-01-20T08:13:42.165847+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:51.297816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.169047+0000","last_change":"2024-01-20T08:13:40.138835+0000","last_active":"2024-01-20T08:13:41.169047+0000","last_peered":"2024-01-20T08:13:41.169047+0000","last_clean":"2024-01-20T08:13:41.169047+0000","last_became_active":"2024-01-20T08:13:40.138570+0000","last_became_peered":"2024-01-20T08:13:40.138570+0000","last_unstale":"2024-01-20T08:13:41.169047+0000","last_undegraded":"2024-01-20T08:13:41.169047+0000","last_fullsized":"2024-01-20T08:13:41.169047+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.132398+0000","last_change":"2024-01-20T08:13:21.211529+0000","last_active":"2024-01-20T08:13:41.132398+0000","last_peered":"2024-01-20T08:13:41.132398+0000","last_clean":"2024-01-20T08:13:41.132398+0000","last_became_active":"2024-01-20T08:13:21.211247+0000","last_became_peered":"2024-01-20T08:13:21.211247+0000","last_unstale":"2024-01-20T08:13:41.132398+0000","last_undegraded":"2024-01-20T08:13:41.132398+0000","last_fullsized":"2024-01-20T08:13:41.132398+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144324+0000","last_change":"2024-01-20T08:13:20.174257+0000","last_active":"2024-01-20T08:13:41.144324+0000","last_peered":"2024-01-20T08:13:41.144324+0000","last_clean":"2024-01-20T08:13:41.144324+0000","last_became_active":"2024-01-20T08:13:20.173981+0000","last_became_peered":"2024-01-20T08:13:20.173981+0000","last_unstale":"2024-01-20T08:13:41.144324+0000","last_undegraded":"2024-01-20T08:13:41.144324+0000","last_fullsized":"2024-01-20T08:13:41.144324+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:48:52.380700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.161731+0000","last_change":"2024-01-20T08:13:41.172884+0000","last_active":"2024-01-20T08:13:42.161731+0000","last_peered":"2024-01-20T08:13:42.161731+0000","last_clean":"2024-01-20T08:13:42.161731+0000","last_became_active":"2024-01-20T08:13:41.172635+0000","last_became_peered":"2024-01-20T08:13:41.172635+0000","last_unstale":"2024-01-20T08:13:42.161731+0000","last_undegraded":"2024-01-20T08:13:42.161731+0000","last_fullsized":"2024-01-20T08:13:42.161731+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:45.517189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"75'8","reported_seq":20,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.181224+0000","last_change":"2024-01-20T08:13:40.134405+0000","last_active":"2024-01-20T08:13:41.181224+0000","last_peered":"2024-01-20T08:13:41.181224+0000","last_clean":"2024-01-20T08:13:41.181224+0000","last_became_active":"2024-01-20T08:13:40.134151+0000","last_became_peered":"2024-01-20T08:13:40.134151+0000","last_unstale":"2024-01-20T08:13:41.181224+0000","last_undegraded":"2024-01-20T08:13:41.181224+0000","last_fullsized":"2024-01-20T08:13:41.181224+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:55.057770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.135756+0000","last_change":"2024-01-20T08:13:21.204941+0000","last_active":"2024-01-20T08:13:41.135756+0000","last_peered":"2024-01-20T08:13:41.135756+0000","last_clean":"2024-01-20T08:13:41.135756+0000","last_became_active":"2024-01-20T08:13:21.204688+0000","last_became_peered":"2024-01-20T08:13:21.204688+0000","last_unstale":"2024-01-20T08:13:41.135756+0000","last_undegraded":"2024-01-20T08:13:41.135756+0000","last_fullsized":"2024-01-20T08:13:41.135756+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:18.835232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.142812+0000","last_change":"2024-01-20T08:13:20.159308+0000","last_active":"2024-01-20T08:13:41.142812+0000","last_peered":"2024-01-20T08:13:41.142812+0000","last_clean":"2024-01-20T08:13:41.142812+0000","last_became_active":"2024-01-20T08:13:20.158423+0000","last_became_peered":"2024-01-20T08:13:20.158423+0000","last_unstale":"2024-01-20T08:13:41.142812+0000","last_undegraded":"2024-01-20T08:13:41.142812+0000","last_fullsized":"2024-01-20T08:13:41.142812+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:23:40.698811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.164974+0000","last_change":"2024-01-20T08:13:41.149578+0000","last_active":"2024-01-20T08:13:42.164974+0000","last_peered":"2024-01-20T08:13:42.164974+0000","last_clean":"2024-01-20T08:13:42.164974+0000","last_became_active":"2024-01-20T08:13:41.149327+0000","last_became_peered":"2024-01-20T08:13:41.149327+0000","last_unstale":"2024-01-20T08:13:42.164974+0000","last_undegraded":"2024-01-20T08:13:42.164974+0000","last_fullsized":"2024-01-20T08:13:42.164974+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:44:58.488828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.177868+0000","last_change":"2024-01-20T08:13:40.131252+0000","last_active":"2024-01-20T08:13:41.177868+0000","last_peered":"2024-01-20T08:13:41.177868+0000","last_clean":"2024-01-20T08:13:41.177868+0000","last_became_active":"2024-01-20T08:13:40.130235+0000","last_became_peered":"2024-01-20T08:13:40.130235+0000","last_unstale":"2024-01-20T08:13:41.177868+0000","last_undegraded":"2024-01-20T08:13:41.177868+0000","last_fullsized":"2024-01-20T08:13:41.177868+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:53:06.262120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141139+0000","last_change":"2024-01-20T08:13:21.202501+0000","last_active":"2024-01-20T08:13:41.141139+0000","last_peered":"2024-01-20T08:13:41.141139+0000","last_clean":"2024-01-20T08:13:41.141139+0000","last_became_active":"2024-01-20T08:13:21.202182+0000","last_became_peered":"2024-01-20T08:13:21.202182+0000","last_unstale":"2024-01-20T08:13:41.141139+0000","last_undegraded":"2024-01-20T08:13:41.141139+0000","last_fullsized":"2024-01-20T08:13:41.141139+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:46.482673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.134418+0000","last_change":"2024-01-20T08:13:20.177836+0000","last_active":"2024-01-20T08:13:41.134418+0000","last_peered":"2024-01-20T08:13:41.134418+0000","last_clean":"2024-01-20T08:13:41.134418+0000","last_became_active":"2024-01-20T08:13:20.177277+0000","last_became_peered":"2024-01-20T08:13:20.177277+0000","last_unstale":"2024-01-20T08:13:41.134418+0000","last_undegraded":"2024-01-20T08:13:41.134418+0000","last_fullsized":"2024-01-20T08:13:41.134418+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:38.664851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162800+0000","last_change":"2024-01-20T08:13:41.169170+0000","last_active":"2024-01-20T08:13:42.162800+0000","last_peered":"2024-01-20T08:13:42.162800+0000","last_clean":"2024-01-20T08:13:42.162800+0000","last_became_active":"2024-01-20T08:13:41.168542+0000","last_became_peered":"2024-01-20T08:13:41.168542+0000","last_unstale":"2024-01-20T08:13:42.162800+0000","last_undegraded":"2024-01-20T08:13:42.162800+0000","last_fullsized":"2024-01-20T08:13:42.162800+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:53.555143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151055+0000","last_change":"2024-01-20T08:13:40.124952+0000","last_active":"2024-01-20T08:13:41.151055+0000","last_peered":"2024-01-20T08:13:41.151055+0000","last_clean":"2024-01-20T08:13:41.151055+0000","last_became_active":"2024-01-20T08:13:40.124408+0000","last_became_peered":"2024-01-20T08:13:40.124408+0000","last_unstale":"2024-01-20T08:13:41.151055+0000","last_undegraded":"2024-01-20T08:13:41.151055+0000","last_fullsized":"2024-01-20T08:13:41.151055+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:19:05.336170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.139755+0000","last_change":"2024-01-20T08:13:21.210997+0000","last_active":"2024-01-20T08:13:41.139755+0000","last_peered":"2024-01-20T08:13:41.139755+0000","last_clean":"2024-01-20T08:13:41.139755+0000","last_became_active":"2024-01-20T08:13:21.210691+0000","last_became_peered":"2024-01-20T08:13:21.210691+0000","last_unstale":"2024-01-20T08:13:41.139755+0000","last_undegraded":"2024-01-20T08:13:41.139755+0000","last_fullsized":"2024-01-20T08:13:41.139755+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:49:51.387782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"71'8","reported_seq":24,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.130858+0000","last_change":"2024-01-20T08:13:20.177461+0000","last_active":"2024-01-20T08:13:41.130858+0000","last_peered":"2024-01-20T08:13:41.130858+0000","last_clean":"2024-01-20T08:13:41.130858+0000","last_became_active":"2024-01-20T08:13:20.177188+0000","last_became_peered":"2024-01-20T08:13:20.177188+0000","last_unstale":"2024-01-20T08:13:41.130858+0000","last_undegraded":"2024-01-20T08:13:41.130858+0000","last_fullsized":"2024-01-20T08:13:41.130858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:38:11.112361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.953546+0000","last_change":"2024-01-20T08:13:41.166608+0000","last_active":"2024-01-20T08:13:42.953546+0000","last_peered":"2024-01-20T08:13:42.953546+0000","last_clean":"2024-01-20T08:13:42.953546+0000","last_became_active":"2024-01-20T08:13:41.166320+0000","last_became_peered":"2024-01-20T08:13:41.166320+0000","last_unstale":"2024-01-20T08:13:42.953546+0000","last_undegraded":"2024-01-20T08:13:42.953546+0000","last_fullsized":"2024-01-20T08:13:42.953546+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:28.842979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"75'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.172742+0000","last_change":"2024-01-20T08:13:40.137508+0000","last_active":"2024-01-20T08:13:41.172742+0000","last_peered":"2024-01-20T08:13:41.172742+0000","last_clean":"2024-01-20T08:13:41.172742+0000","last_became_active":"2024-01-20T08:13:40.137164+0000","last_became_peered":"2024-01-20T08:13:40.137164+0000","last_unstale":"2024-01-20T08:13:41.172742+0000","last_undegraded":"2024-01-20T08:13:41.172742+0000","last_fullsized":"2024-01-20T08:13:41.172742+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:42:49.357552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.137148+0000","last_change":"2024-01-20T08:13:21.210080+0000","last_active":"2024-01-20T08:13:41.137148+0000","last_peered":"2024-01-20T08:13:41.137148+0000","last_clean":"2024-01-20T08:13:41.137148+0000","last_became_active":"2024-01-20T08:13:21.209736+0000","last_became_peered":"2024-01-20T08:13:21.209736+0000","last_unstale":"2024-01-20T08:13:41.137148+0000","last_undegraded":"2024-01-20T08:13:41.137148+0000","last_fullsized":"2024-01-20T08:13:41.137148+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:58:19.546127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"71'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.163362+0000","last_change":"2024-01-20T08:13:20.175871+0000","last_active":"2024-01-20T08:13:41.163362+0000","last_peered":"2024-01-20T08:13:41.163362+0000","last_clean":"2024-01-20T08:13:41.163362+0000","last_became_active":"2024-01-20T08:13:20.175468+0000","last_became_peered":"2024-01-20T08:13:20.175468+0000","last_unstale":"2024-01-20T08:13:41.163362+0000","last_undegraded":"2024-01-20T08:13:41.163362+0000","last_fullsized":"2024-01-20T08:13:41.163362+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:58:24.539816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.207759+0000","last_change":"2024-01-20T08:13:41.170912+0000","last_active":"2024-01-20T08:13:42.207759+0000","last_peered":"2024-01-20T08:13:42.207759+0000","last_clean":"2024-01-20T08:13:42.207759+0000","last_became_active":"2024-01-20T08:13:41.170293+0000","last_became_peered":"2024-01-20T08:13:41.170293+0000","last_unstale":"2024-01-20T08:13:42.207759+0000","last_undegraded":"2024-01-20T08:13:42.207759+0000","last_fullsized":"2024-01-20T08:13:42.207759+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:30:39.538363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.132957+0000","last_change":"2024-01-20T08:13:40.132877+0000","last_active":"2024-01-20T08:13:41.132957+0000","last_peered":"2024-01-20T08:13:41.132957+0000","last_clean":"2024-01-20T08:13:41.132957+0000","last_became_active":"2024-01-20T08:13:40.132593+0000","last_became_peered":"2024-01-20T08:13:40.132593+0000","last_unstale":"2024-01-20T08:13:41.132957+0000","last_undegraded":"2024-01-20T08:13:41.132957+0000","last_fullsized":"2024-01-20T08:13:41.132957+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:58:35.904189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161700+0000","last_change":"2024-01-20T08:13:21.212952+0000","last_active":"2024-01-20T08:13:41.161700+0000","last_peered":"2024-01-20T08:13:41.161700+0000","last_clean":"2024-01-20T08:13:41.161700+0000","last_became_active":"2024-01-20T08:13:21.212488+0000","last_became_peered":"2024-01-20T08:13:21.212488+0000","last_unstale":"2024-01-20T08:13:41.161700+0000","last_undegraded":"2024-01-20T08:13:41.161700+0000","last_fullsized":"2024-01-20T08:13:41.161700+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.134892+0000","last_change":"2024-01-20T08:13:20.173429+0000","last_active":"2024-01-20T08:13:41.134892+0000","last_peered":"2024-01-20T08:13:41.134892+0000","last_clean":"2024-01-20T08:13:41.134892+0000","last_became_active":"2024-01-20T08:13:20.173068+0000","last_became_peered":"2024-01-20T08:13:20.173068+0000","last_unstale":"2024-01-20T08:13:41.134892+0000","last_undegraded":"2024-01-20T08:13:41.134892+0000","last_fullsized":"2024-01-20T08:13:41.134892+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:58:01.979518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.454196+0000","last_change":"2024-01-20T08:13:41.178900+0000","last_active":"2024-01-20T08:13:42.454196+0000","last_peered":"2024-01-20T08:13:42.454196+0000","last_clean":"2024-01-20T08:13:42.454196+0000","last_became_active":"2024-01-20T08:13:41.178545+0000","last_became_peered":"2024-01-20T08:13:41.178545+0000","last_unstale":"2024-01-20T08:13:42.454196+0000","last_undegraded":"2024-01-20T08:13:42.454196+0000","last_fullsized":"2024-01-20T08:13:42.454196+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:35:18.689474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.183348+0000","last_change":"2024-01-20T08:13:40.134188+0000","last_active":"2024-01-20T08:13:41.183348+0000","last_peered":"2024-01-20T08:13:41.183348+0000","last_clean":"2024-01-20T08:13:41.183348+0000","last_became_active":"2024-01-20T08:13:40.132998+0000","last_became_peered":"2024-01-20T08:13:40.132998+0000","last_unstale":"2024-01-20T08:13:41.183348+0000","last_undegraded":"2024-01-20T08:13:41.183348+0000","last_fullsized":"2024-01-20T08:13:41.183348+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:54:24.000078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.165882+0000","last_change":"2024-01-20T08:13:21.198212+0000","last_active":"2024-01-20T08:13:41.165882+0000","last_peered":"2024-01-20T08:13:41.165882+0000","last_clean":"2024-01-20T08:13:41.165882+0000","last_became_active":"2024-01-20T08:13:21.197306+0000","last_became_peered":"2024-01-20T08:13:21.197306+0000","last_unstale":"2024-01-20T08:13:41.165882+0000","last_undegraded":"2024-01-20T08:13:41.165882+0000","last_fullsized":"2024-01-20T08:13:41.165882+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:00:24.049000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.134061+0000","last_change":"2024-01-20T08:13:20.175824+0000","last_active":"2024-01-20T08:13:41.134061+0000","last_peered":"2024-01-20T08:13:41.134061+0000","last_clean":"2024-01-20T08:13:41.134061+0000","last_became_active":"2024-01-20T08:13:20.175276+0000","last_became_peered":"2024-01-20T08:13:20.175276+0000","last_unstale":"2024-01-20T08:13:41.134061+0000","last_undegraded":"2024-01-20T08:13:41.134061+0000","last_fullsized":"2024-01-20T08:13:41.134061+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:35.090470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.161254+0000","last_change":"2024-01-20T08:13:41.155653+0000","last_active":"2024-01-20T08:13:42.161254+0000","last_peered":"2024-01-20T08:13:42.161254+0000","last_clean":"2024-01-20T08:13:42.161254+0000","last_became_active":"2024-01-20T08:13:41.155380+0000","last_became_peered":"2024-01-20T08:13:41.155380+0000","last_unstale":"2024-01-20T08:13:42.161254+0000","last_undegraded":"2024-01-20T08:13:42.161254+0000","last_fullsized":"2024-01-20T08:13:42.161254+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:51.040783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133832+0000","last_change":"2024-01-20T08:13:40.136860+0000","last_active":"2024-01-20T08:13:41.133832+0000","last_peered":"2024-01-20T08:13:41.133832+0000","last_clean":"2024-01-20T08:13:41.133832+0000","last_became_active":"2024-01-20T08:13:40.136501+0000","last_became_peered":"2024-01-20T08:13:40.136501+0000","last_unstale":"2024-01-20T08:13:41.133832+0000","last_undegraded":"2024-01-20T08:13:41.133832+0000","last_fullsized":"2024-01-20T08:13:41.133832+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:52.545069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151259+0000","last_change":"2024-01-20T08:13:21.209049+0000","last_active":"2024-01-20T08:13:41.151259+0000","last_peered":"2024-01-20T08:13:41.151259+0000","last_clean":"2024-01-20T08:13:41.151259+0000","last_became_active":"2024-01-20T08:13:21.207868+0000","last_became_peered":"2024-01-20T08:13:21.207868+0000","last_unstale":"2024-01-20T08:13:41.151259+0000","last_undegraded":"2024-01-20T08:13:41.151259+0000","last_fullsized":"2024-01-20T08:13:41.151259+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:39:36.578379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.139904+0000","last_change":"2024-01-20T08:13:20.173760+0000","last_active":"2024-01-20T08:13:41.139904+0000","last_peered":"2024-01-20T08:13:41.139904+0000","last_clean":"2024-01-20T08:13:41.139904+0000","last_became_active":"2024-01-20T08:13:20.173444+0000","last_became_peered":"2024-01-20T08:13:20.173444+0000","last_unstale":"2024-01-20T08:13:41.139904+0000","last_undegraded":"2024-01-20T08:13:41.139904+0000","last_fullsized":"2024-01-20T08:13:41.139904+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:38.067931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.452179+0000","last_change":"2024-01-20T08:13:41.168085+0000","last_active":"2024-01-20T08:13:42.452179+0000","last_peered":"2024-01-20T08:13:42.452179+0000","last_clean":"2024-01-20T08:13:42.452179+0000","last_became_active":"2024-01-20T08:13:41.167557+0000","last_became_peered":"2024-01-20T08:13:41.167557+0000","last_unstale":"2024-01-20T08:13:42.452179+0000","last_undegraded":"2024-01-20T08:13:42.452179+0000","last_fullsized":"2024-01-20T08:13:42.452179+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:10.470066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.130688+0000","last_change":"2024-01-20T08:13:40.126858+0000","last_active":"2024-01-20T08:13:41.130688+0000","last_peered":"2024-01-20T08:13:41.130688+0000","last_clean":"2024-01-20T08:13:41.130688+0000","last_became_active":"2024-01-20T08:13:40.124427+0000","last_became_peered":"2024-01-20T08:13:40.124427+0000","last_unstale":"2024-01-20T08:13:41.130688+0000","last_undegraded":"2024-01-20T08:13:41.130688+0000","last_fullsized":"2024-01-20T08:13:41.130688+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:20:50.287743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.138740+0000","last_change":"2024-01-20T08:13:21.202773+0000","last_active":"2024-01-20T08:13:41.138740+0000","last_peered":"2024-01-20T08:13:41.138740+0000","last_clean":"2024-01-20T08:13:41.138740+0000","last_became_active":"2024-01-20T08:13:21.202288+0000","last_became_peered":"2024-01-20T08:13:21.202288+0000","last_unstale":"2024-01-20T08:13:41.138740+0000","last_undegraded":"2024-01-20T08:13:41.138740+0000","last_fullsized":"2024-01-20T08:13:41.138740+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:17:39.302275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151325+0000","last_change":"2024-01-20T08:13:20.175306+0000","last_active":"2024-01-20T08:13:41.151325+0000","last_peered":"2024-01-20T08:13:41.151325+0000","last_clean":"2024-01-20T08:13:41.151325+0000","last_became_active":"2024-01-20T08:13:20.174835+0000","last_became_peered":"2024-01-20T08:13:20.174835+0000","last_unstale":"2024-01-20T08:13:41.151325+0000","last_undegraded":"2024-01-20T08:13:41.151325+0000","last_fullsized":"2024-01-20T08:13:41.151325+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T17:30:15.502333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162191+0000","last_change":"2024-01-20T08:13:41.157373+0000","last_active":"2024-01-20T08:13:42.162191+0000","last_peered":"2024-01-20T08:13:42.162191+0000","last_clean":"2024-01-20T08:13:42.162191+0000","last_became_active":"2024-01-20T08:13:41.156110+0000","last_became_peered":"2024-01-20T08:13:41.156110+0000","last_unstale":"2024-01-20T08:13:42.162191+0000","last_undegraded":"2024-01-20T08:13:42.162191+0000","last_fullsized":"2024-01-20T08:13:42.162191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:04:59.642224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.175891+0000","last_change":"2024-01-20T08:13:40.123835+0000","last_active":"2024-01-20T08:13:41.175891+0000","last_peered":"2024-01-20T08:13:41.175891+0000","last_clean":"2024-01-20T08:13:41.175891+0000","last_became_active":"2024-01-20T08:13:40.123558+0000","last_became_peered":"2024-01-20T08:13:40.123558+0000","last_unstale":"2024-01-20T08:13:41.175891+0000","last_undegraded":"2024-01-20T08:13:41.175891+0000","last_fullsized":"2024-01-20T08:13:41.175891+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:25:09.459993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151574+0000","last_change":"2024-01-20T08:13:21.206428+0000","last_active":"2024-01-20T08:13:41.151574+0000","last_peered":"2024-01-20T08:13:41.151574+0000","last_clean":"2024-01-20T08:13:41.151574+0000","last_became_active":"2024-01-20T08:13:21.205444+0000","last_became_peered":"2024-01-20T08:13:21.205444+0000","last_unstale":"2024-01-20T08:13:41.151574+0000","last_undegraded":"2024-01-20T08:13:41.151574+0000","last_fullsized":"2024-01-20T08:13:41.151574+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:38:02.916532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151015+0000","last_change":"2024-01-20T08:13:20.179874+0000","last_active":"2024-01-20T08:13:41.151015+0000","last_peered":"2024-01-20T08:13:41.151015+0000","last_clean":"2024-01-20T08:13:41.151015+0000","last_became_active":"2024-01-20T08:13:20.179618+0000","last_became_peered":"2024-01-20T08:13:20.179618+0000","last_unstale":"2024-01-20T08:13:41.151015+0000","last_undegraded":"2024-01-20T08:13:41.151015+0000","last_fullsized":"2024-01-20T08:13:41.151015+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T08:29:28.592735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.163401+0000","last_change":"2024-01-20T08:13:41.158781+0000","last_active":"2024-01-20T08:13:42.163401+0000","last_peered":"2024-01-20T08:13:42.163401+0000","last_clean":"2024-01-20T08:13:42.163401+0000","last_became_active":"2024-01-20T08:13:41.158538+0000","last_became_peered":"2024-01-20T08:13:41.158538+0000","last_unstale":"2024-01-20T08:13:42.163401+0000","last_undegraded":"2024-01-20T08:13:42.163401+0000","last_fullsized":"2024-01-20T08:13:42.163401+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:19:27.633996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144439+0000","last_change":"2024-01-20T08:13:40.128760+0000","last_active":"2024-01-20T08:13:41.144439+0000","last_peered":"2024-01-20T08:13:41.144439+0000","last_clean":"2024-01-20T08:13:41.144439+0000","last_became_active":"2024-01-20T08:13:40.128395+0000","last_became_peered":"2024-01-20T08:13:40.128395+0000","last_unstale":"2024-01-20T08:13:41.144439+0000","last_undegraded":"2024-01-20T08:13:41.144439+0000","last_fullsized":"2024-01-20T08:13:41.144439+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:10:11.612075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.134206+0000","last_change":"2024-01-20T08:13:21.217802+0000","last_active":"2024-01-20T08:13:41.134206+0000","last_peered":"2024-01-20T08:13:41.134206+0000","last_clean":"2024-01-20T08:13:41.134206+0000","last_became_active":"2024-01-20T08:13:21.217405+0000","last_became_peered":"2024-01-20T08:13:21.217405+0000","last_unstale":"2024-01-20T08:13:41.134206+0000","last_undegraded":"2024-01-20T08:13:41.134206+0000","last_fullsized":"2024-01-20T08:13:41.134206+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:57:36.103049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141121+0000","last_change":"2024-01-20T08:13:20.170291+0000","last_active":"2024-01-20T08:13:41.141121+0000","last_peered":"2024-01-20T08:13:41.141121+0000","last_clean":"2024-01-20T08:13:41.141121+0000","last_became_active":"2024-01-20T08:13:20.169114+0000","last_became_peered":"2024-01-20T08:13:20.169114+0000","last_unstale":"2024-01-20T08:13:41.141121+0000","last_undegraded":"2024-01-20T08:13:41.141121+0000","last_fullsized":"2024-01-20T08:13:41.141121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:59:32.577769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162186+0000","last_change":"2024-01-20T08:13:41.173818+0000","last_active":"2024-01-20T08:13:42.162186+0000","last_peered":"2024-01-20T08:13:42.162186+0000","last_clean":"2024-01-20T08:13:42.162186+0000","last_became_active":"2024-01-20T08:13:41.173529+0000","last_became_peered":"2024-01-20T08:13:41.173529+0000","last_unstale":"2024-01-20T08:13:42.162186+0000","last_undegraded":"2024-01-20T08:13:42.162186+0000","last_fullsized":"2024-01-20T08:13:42.162186+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:27:59.045304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.133436+0000","last_change":"2024-01-20T08:13:40.131748+0000","last_active":"2024-01-20T08:13:41.133436+0000","last_peered":"2024-01-20T08:13:41.133436+0000","last_clean":"2024-01-20T08:13:41.133436+0000","last_became_active":"2024-01-20T08:13:40.131502+0000","last_became_peered":"2024-01-20T08:13:40.131502+0000","last_unstale":"2024-01-20T08:13:41.133436+0000","last_undegraded":"2024-01-20T08:13:41.133436+0000","last_fullsized":"2024-01-20T08:13:41.133436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:26:49.521076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.176079+0000","last_change":"2024-01-20T08:13:21.209680+0000","last_active":"2024-01-20T08:13:41.176079+0000","last_peered":"2024-01-20T08:13:41.176079+0000","last_clean":"2024-01-20T08:13:41.176079+0000","last_became_active":"2024-01-20T08:13:21.209142+0000","last_became_peered":"2024-01-20T08:13:21.209142+0000","last_unstale":"2024-01-20T08:13:41.176079+0000","last_undegraded":"2024-01-20T08:13:41.176079+0000","last_fullsized":"2024-01-20T08:13:41.176079+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"71'2","reported_seq":18,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144674+0000","last_change":"2024-01-20T08:13:20.178156+0000","last_active":"2024-01-20T08:13:41.144674+0000","last_peered":"2024-01-20T08:13:41.144674+0000","last_clean":"2024-01-20T08:13:41.144674+0000","last_became_active":"2024-01-20T08:13:20.177245+0000","last_became_peered":"2024-01-20T08:13:20.177245+0000","last_unstale":"2024-01-20T08:13:41.144674+0000","last_undegraded":"2024-01-20T08:13:41.144674+0000","last_fullsized":"2024-01-20T08:13:41.144674+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:36:36.819552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.453329+0000","last_change":"2024-01-20T08:13:41.165636+0000","last_active":"2024-01-20T08:13:42.453329+0000","last_peered":"2024-01-20T08:13:42.453329+0000","last_clean":"2024-01-20T08:13:42.453329+0000","last_became_active":"2024-01-20T08:13:41.162884+0000","last_became_peered":"2024-01-20T08:13:41.162884+0000","last_unstale":"2024-01-20T08:13:42.453329+0000","last_undegraded":"2024-01-20T08:13:42.453329+0000","last_fullsized":"2024-01-20T08:13:42.453329+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:35.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.161514+0000","last_change":"2024-01-20T08:13:40.136610+0000","last_active":"2024-01-20T08:13:41.161514+0000","last_peered":"2024-01-20T08:13:41.161514+0000","last_clean":"2024-01-20T08:13:41.161514+0000","last_became_active":"2024-01-20T08:13:40.135965+0000","last_became_peered":"2024-01-20T08:13:40.135965+0000","last_unstale":"2024-01-20T08:13:41.161514+0000","last_undegraded":"2024-01-20T08:13:41.161514+0000","last_fullsized":"2024-01-20T08:13:41.161514+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:14:27.832906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.136806+0000","last_change":"2024-01-20T08:13:21.208816+0000","last_active":"2024-01-20T08:13:41.136806+0000","last_peered":"2024-01-20T08:13:41.136806+0000","last_clean":"2024-01-20T08:13:41.136806+0000","last_became_active":"2024-01-20T08:13:21.208542+0000","last_became_peered":"2024-01-20T08:13:21.208542+0000","last_unstale":"2024-01-20T08:13:41.136806+0000","last_undegraded":"2024-01-20T08:13:41.136806+0000","last_fullsized":"2024-01-20T08:13:41.136806+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"72'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.144294+0000","last_change":"2024-01-20T08:13:20.176107+0000","last_active":"2024-01-20T08:13:41.144294+0000","last_peered":"2024-01-20T08:13:41.144294+0000","last_clean":"2024-01-20T08:13:41.144294+0000","last_became_active":"2024-01-20T08:13:20.174531+0000","last_became_peered":"2024-01-20T08:13:20.174531+0000","last_unstale":"2024-01-20T08:13:41.144294+0000","last_undegraded":"2024-01-20T08:13:41.144294+0000","last_fullsized":"2024-01-20T08:13:41.144294+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:18:45.368870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.954634+0000","last_change":"2024-01-20T08:13:41.152676+0000","last_active":"2024-01-20T08:13:42.954634+0000","last_peered":"2024-01-20T08:13:42.954634+0000","last_clean":"2024-01-20T08:13:42.954634+0000","last_became_active":"2024-01-20T08:13:41.152412+0000","last_became_peered":"2024-01-20T08:13:41.152412+0000","last_unstale":"2024-01-20T08:13:42.954634+0000","last_undegraded":"2024-01-20T08:13:42.954634+0000","last_fullsized":"2024-01-20T08:13:42.954634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:23:20.498776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"75'2","reported_seq":14,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.174619+0000","last_change":"2024-01-20T08:13:40.138153+0000","last_active":"2024-01-20T08:13:41.174619+0000","last_peered":"2024-01-20T08:13:41.174619+0000","last_clean":"2024-01-20T08:13:41.174619+0000","last_became_active":"2024-01-20T08:13:40.137489+0000","last_became_peered":"2024-01-20T08:13:40.137489+0000","last_unstale":"2024-01-20T08:13:41.174619+0000","last_undegraded":"2024-01-20T08:13:41.174619+0000","last_fullsized":"2024-01-20T08:13:41.174619+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:06:24.387838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.162035+0000","last_change":"2024-01-20T08:13:21.222444+0000","last_active":"2024-01-20T08:13:41.162035+0000","last_peered":"2024-01-20T08:13:41.162035+0000","last_clean":"2024-01-20T08:13:41.162035+0000","last_became_active":"2024-01-20T08:13:21.222070+0000","last_became_peered":"2024-01-20T08:13:21.222070+0000","last_unstale":"2024-01-20T08:13:41.162035+0000","last_undegraded":"2024-01-20T08:13:41.162035+0000","last_fullsized":"2024-01-20T08:13:41.162035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:20:59.734421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.162558+0000","last_change":"2024-01-20T08:13:20.175304+0000","last_active":"2024-01-20T08:13:41.162558+0000","last_peered":"2024-01-20T08:13:41.162558+0000","last_clean":"2024-01-20T08:13:41.162558+0000","last_became_active":"2024-01-20T08:13:20.174211+0000","last_became_peered":"2024-01-20T08:13:20.174211+0000","last_unstale":"2024-01-20T08:13:41.162558+0000","last_undegraded":"2024-01-20T08:13:41.162558+0000","last_fullsized":"2024-01-20T08:13:41.162558+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:40:34.148976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162320+0000","last_change":"2024-01-20T08:13:41.164330+0000","last_active":"2024-01-20T08:13:42.162320+0000","last_peered":"2024-01-20T08:13:42.162320+0000","last_clean":"2024-01-20T08:13:42.162320+0000","last_became_active":"2024-01-20T08:13:41.164030+0000","last_became_peered":"2024-01-20T08:13:41.164030+0000","last_unstale":"2024-01-20T08:13:42.162320+0000","last_undegraded":"2024-01-20T08:13:42.162320+0000","last_fullsized":"2024-01-20T08:13:42.162320+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:24:01.676184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"76'1","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.954883+0000","last_change":"2024-01-20T08:13:40.135004+0000","last_active":"2024-01-20T08:13:42.954883+0000","last_peered":"2024-01-20T08:13:42.954883+0000","last_clean":"2024-01-20T08:13:42.954883+0000","last_became_active":"2024-01-20T08:13:40.132993+0000","last_became_peered":"2024-01-20T08:13:40.132993+0000","last_unstale":"2024-01-20T08:13:42.954883+0000","last_undegraded":"2024-01-20T08:13:42.954883+0000","last_fullsized":"2024-01-20T08:13:42.954883+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:43:34.609355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.165965+0000","last_change":"2024-01-20T08:13:21.216491+0000","last_active":"2024-01-20T08:13:41.165965+0000","last_peered":"2024-01-20T08:13:41.165965+0000","last_clean":"2024-01-20T08:13:41.165965+0000","last_became_active":"2024-01-20T08:13:21.215133+0000","last_became_peered":"2024-01-20T08:13:21.215133+0000","last_unstale":"2024-01-20T08:13:41.165965+0000","last_undegraded":"2024-01-20T08:13:41.165965+0000","last_fullsized":"2024-01-20T08:13:41.165965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:21:48.288391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.163312+0000","last_change":"2024-01-20T08:13:20.172082+0000","last_active":"2024-01-20T08:13:41.163312+0000","last_peered":"2024-01-20T08:13:41.163312+0000","last_clean":"2024-01-20T08:13:41.163312+0000","last_became_active":"2024-01-20T08:13:20.171741+0000","last_became_peered":"2024-01-20T08:13:20.171741+0000","last_unstale":"2024-01-20T08:13:41.163312+0000","last_undegraded":"2024-01-20T08:13:41.163312+0000","last_fullsized":"2024-01-20T08:13:41.163312+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.161269+0000","last_change":"2024-01-20T08:13:41.157481+0000","last_active":"2024-01-20T08:13:42.161269+0000","last_peered":"2024-01-20T08:13:42.161269+0000","last_clean":"2024-01-20T08:13:42.161269+0000","last_became_active":"2024-01-20T08:13:41.157226+0000","last_became_peered":"2024-01-20T08:13:41.157226+0000","last_unstale":"2024-01-20T08:13:42.161269+0000","last_undegraded":"2024-01-20T08:13:42.161269+0000","last_fullsized":"2024-01-20T08:13:42.161269+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:02:41.904042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.141277+0000","last_change":"2024-01-20T08:13:40.138887+0000","last_active":"2024-01-20T08:13:41.141277+0000","last_peered":"2024-01-20T08:13:41.141277+0000","last_clean":"2024-01-20T08:13:41.141277+0000","last_became_active":"2024-01-20T08:13:40.138591+0000","last_became_peered":"2024-01-20T08:13:40.138591+0000","last_unstale":"2024-01-20T08:13:41.141277+0000","last_undegraded":"2024-01-20T08:13:41.141277+0000","last_fullsized":"2024-01-20T08:13:41.141277+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:45:19.466250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.143815+0000","last_change":"2024-01-20T08:13:21.205675+0000","last_active":"2024-01-20T08:13:41.143815+0000","last_peered":"2024-01-20T08:13:41.143815+0000","last_clean":"2024-01-20T08:13:41.143815+0000","last_became_active":"2024-01-20T08:13:21.201503+0000","last_became_peered":"2024-01-20T08:13:21.201503+0000","last_unstale":"2024-01-20T08:13:41.143815+0000","last_undegraded":"2024-01-20T08:13:41.143815+0000","last_fullsized":"2024-01-20T08:13:41.143815+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:10.580497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.132363+0000","last_change":"2024-01-20T08:13:20.179029+0000","last_active":"2024-01-20T08:13:41.132363+0000","last_peered":"2024-01-20T08:13:41.132363+0000","last_clean":"2024-01-20T08:13:41.132363+0000","last_became_active":"2024-01-20T08:13:20.178653+0000","last_became_peered":"2024-01-20T08:13:20.178653+0000","last_unstale":"2024-01-20T08:13:41.132363+0000","last_undegraded":"2024-01-20T08:13:41.132363+0000","last_fullsized":"2024-01-20T08:13:41.132363+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T16:47:09.567917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.452414+0000","last_change":"2024-01-20T08:13:41.178108+0000","last_active":"2024-01-20T08:13:42.452414+0000","last_peered":"2024-01-20T08:13:42.452414+0000","last_clean":"2024-01-20T08:13:42.452414+0000","last_became_active":"2024-01-20T08:13:41.177504+0000","last_became_peered":"2024-01-20T08:13:41.177504+0000","last_unstale":"2024-01-20T08:13:42.452414+0000","last_undegraded":"2024-01-20T08:13:42.452414+0000","last_fullsized":"2024-01-20T08:13:42.452414+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:19:10.926774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.151367+0000","last_change":"2024-01-20T08:13:40.125670+0000","last_active":"2024-01-20T08:13:41.151367+0000","last_peered":"2024-01-20T08:13:41.151367+0000","last_clean":"2024-01-20T08:13:41.151367+0000","last_became_active":"2024-01-20T08:13:40.125414+0000","last_became_peered":"2024-01-20T08:13:40.125414+0000","last_unstale":"2024-01-20T08:13:41.151367+0000","last_undegraded":"2024-01-20T08:13:41.151367+0000","last_fullsized":"2024-01-20T08:13:41.151367+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T12:06:08.732846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.131818+0000","last_change":"2024-01-20T08:13:21.210552+0000","last_active":"2024-01-20T08:13:41.131818+0000","last_peered":"2024-01-20T08:13:41.131818+0000","last_clean":"2024-01-20T08:13:41.131818+0000","last_became_active":"2024-01-20T08:13:21.210260+0000","last_became_peered":"2024-01-20T08:13:21.210260+0000","last_unstale":"2024-01-20T08:13:41.131818+0000","last_undegraded":"2024-01-20T08:13:41.131818+0000","last_fullsized":"2024-01-20T08:13:41.131818+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T20:03:47.213801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.170701+0000","last_change":"2024-01-20T08:13:20.165195+0000","last_active":"2024-01-20T08:13:41.170701+0000","last_peered":"2024-01-20T08:13:41.170701+0000","last_clean":"2024-01-20T08:13:41.170701+0000","last_became_active":"2024-01-20T08:13:20.164889+0000","last_became_peered":"2024-01-20T08:13:20.164889+0000","last_unstale":"2024-01-20T08:13:41.170701+0000","last_undegraded":"2024-01-20T08:13:41.170701+0000","last_fullsized":"2024-01-20T08:13:41.170701+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:45.470094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162308+0000","last_change":"2024-01-20T08:13:41.173816+0000","last_active":"2024-01-20T08:13:42.162308+0000","last_peered":"2024-01-20T08:13:42.162308+0000","last_clean":"2024-01-20T08:13:42.162308+0000","last_became_active":"2024-01-20T08:13:41.173251+0000","last_became_peered":"2024-01-20T08:13:41.173251+0000","last_unstale":"2024-01-20T08:13:42.162308+0000","last_undegraded":"2024-01-20T08:13:42.162308+0000","last_fullsized":"2024-01-20T08:13:42.162308+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T13:30:58.622823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.131719+0000","last_change":"2024-01-20T08:13:40.140095+0000","last_active":"2024-01-20T08:13:41.131719+0000","last_peered":"2024-01-20T08:13:41.131719+0000","last_clean":"2024-01-20T08:13:41.131719+0000","last_became_active":"2024-01-20T08:13:40.139756+0000","last_became_peered":"2024-01-20T08:13:40.139756+0000","last_unstale":"2024-01-20T08:13:41.131719+0000","last_undegraded":"2024-01-20T08:13:41.131719+0000","last_fullsized":"2024-01-20T08:13:41.131719+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:45:19.466250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.134242+0000","last_change":"2024-01-20T08:13:21.221309+0000","last_active":"2024-01-20T08:13:41.134242+0000","last_peered":"2024-01-20T08:13:41.134242+0000","last_clean":"2024-01-20T08:13:41.134242+0000","last_became_active":"2024-01-20T08:13:21.220603+0000","last_became_peered":"2024-01-20T08:13:21.220603+0000","last_unstale":"2024-01-20T08:13:41.134242+0000","last_undegraded":"2024-01-20T08:13:41.134242+0000","last_fullsized":"2024-01-20T08:13:41.134242+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T18:43:13.814165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.160307+0000","last_change":"2024-01-20T08:13:20.165128+0000","last_active":"2024-01-20T08:13:41.160307+0000","last_peered":"2024-01-20T08:13:41.160307+0000","last_clean":"2024-01-20T08:13:41.160307+0000","last_became_active":"2024-01-20T08:13:20.164748+0000","last_became_peered":"2024-01-20T08:13:20.164748+0000","last_unstale":"2024-01-20T08:13:41.160307+0000","last_undegraded":"2024-01-20T08:13:41.160307+0000","last_fullsized":"2024-01-20T08:13:41.160307+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T11:33:13.615076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.166490+0000","last_change":"2024-01-20T08:13:41.174899+0000","last_active":"2024-01-20T08:13:42.166490+0000","last_peered":"2024-01-20T08:13:42.166490+0000","last_clean":"2024-01-20T08:13:42.166490+0000","last_became_active":"2024-01-20T08:13:41.173128+0000","last_became_peered":"2024-01-20T08:13:41.173128+0000","last_unstale":"2024-01-20T08:13:42.166490+0000","last_undegraded":"2024-01-20T08:13:42.166490+0000","last_fullsized":"2024-01-20T08:13:42.166490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T09:28:43.230143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":12,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.159605+0000","last_change":"2024-01-20T08:13:40.136793+0000","last_active":"2024-01-20T08:13:41.159605+0000","last_peered":"2024-01-20T08:13:41.159605+0000","last_clean":"2024-01-20T08:13:41.159605+0000","last_became_active":"2024-01-20T08:13:40.135303+0000","last_became_peered":"2024-01-20T08:13:40.135303+0000","last_unstale":"2024-01-20T08:13:41.159605+0000","last_undegraded":"2024-01-20T08:13:41.159605+0000","last_fullsized":"2024-01-20T08:13:41.159605+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:51:29.810188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.160202+0000","last_change":"2024-01-20T08:13:21.219544+0000","last_active":"2024-01-20T08:13:41.160202+0000","last_peered":"2024-01-20T08:13:41.160202+0000","last_clean":"2024-01-20T08:13:41.160202+0000","last_became_active":"2024-01-20T08:13:21.219008+0000","last_became_peered":"2024-01-20T08:13:21.219008+0000","last_unstale":"2024-01-20T08:13:41.160202+0000","last_undegraded":"2024-01-20T08:13:41.160202+0000","last_fullsized":"2024-01-20T08:13:41.160202+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T10:56:42.948374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":16,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.166850+0000","last_change":"2024-01-20T08:13:20.170721+0000","last_active":"2024-01-20T08:13:41.166850+0000","last_peered":"2024-01-20T08:13:41.166850+0000","last_clean":"2024-01-20T08:13:41.166850+0000","last_became_active":"2024-01-20T08:13:20.170441+0000","last_became_peered":"2024-01-20T08:13:20.170441+0000","last_unstale":"2024-01-20T08:13:41.166850+0000","last_undegraded":"2024-01-20T08:13:41.166850+0000","last_fullsized":"2024-01-20T08:13:41.166850+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:30.063410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2024-01-20T08:13:42.162520+0000","last_change":"2024-01-20T08:13:41.160408+0000","last_active":"2024-01-20T08:13:42.162520+0000","last_peered":"2024-01-20T08:13:42.162520+0000","last_clean":"2024-01-20T08:13:42.162520+0000","last_became_active":"2024-01-20T08:13:41.160005+0000","last_became_peered":"2024-01-20T08:13:41.160005+0000","last_unstale":"2024-01-20T08:13:42.162520+0000","last_undegraded":"2024-01-20T08:13:42.162520+0000","last_fullsized":"2024-01-20T08:13:42.162520+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:40.094839+0000","last_clean_scrub_stamp":"2024-01-20T08:13:40.094839+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:29:01.862030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"75'1","reported_seq":13,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.164436+0000","last_change":"2024-01-20T08:13:40.138906+0000","last_active":"2024-01-20T08:13:41.164436+0000","last_peered":"2024-01-20T08:13:41.164436+0000","last_clean":"2024-01-20T08:13:41.164436+0000","last_became_active":"2024-01-20T08:13:40.138512+0000","last_became_peered":"2024-01-20T08:13:40.138512+0000","last_unstale":"2024-01-20T08:13:41.164436+0000","last_undegraded":"2024-01-20T08:13:41.164436+0000","last_fullsized":"2024-01-20T08:13:41.164436+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":73,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:39.084766+0000","last_clean_scrub_stamp":"2024-01-20T08:13:39.084766+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:04:32.412344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":15,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.140193+0000","last_change":"2024-01-20T08:13:21.204424+0000","last_active":"2024-01-20T08:13:41.140193+0000","last_peered":"2024-01-20T08:13:41.140193+0000","last_clean":"2024-01-20T08:13:41.140193+0000","last_became_active":"2024-01-20T08:13:21.204164+0000","last_became_peered":"2024-01-20T08:13:21.204164+0000","last_unstale":"2024-01-20T08:13:41.140193+0000","last_undegraded":"2024-01-20T08:13:41.140193+0000","last_fullsized":"2024-01-20T08:13:41.140193+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:20.130046+0000","last_clean_scrub_stamp":"2024-01-20T08:13:20.130046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T15:59:31.075989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"71'1","reported_seq":17,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.137854+0000","last_change":"2024-01-20T08:13:20.177249+0000","last_active":"2024-01-20T08:13:41.137854+0000","last_peered":"2024-01-20T08:13:41.137854+0000","last_clean":"2024-01-20T08:13:41.137854+0000","last_became_active":"2024-01-20T08:13:20.176917+0000","last_became_peered":"2024-01-20T08:13:20.176917+0000","last_unstale":"2024-01-20T08:13:41.137854+0000","last_undegraded":"2024-01-20T08:13:41.137854+0000","last_fullsized":"2024-01-20T08:13:41.137854+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:13:19.117466+0000","last_clean_scrub_stamp":"2024-01-20T08:13:19.117466+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:28:40.884657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"20'117","reported_seq":213,"reported_epoch":75,"state":"active+clean","last_fresh":"2024-01-20T08:13:41.135024+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:13:41.135024+0000","last_peered":"2024-01-20T08:13:41.135024+0000","last_clean":"2024-01-20T08:13:41.135024+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:13:41.135024+0000","last_undegraded":"2024-01-20T08:13:41.135024+0000","last_fullsized":"2024-01-20T08:13:41.135024+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":3905,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7810,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339148,"statfs":{"total":96636764160,"available":96603287552,"internally_reserved":0,"allocated":1540096,"data_stored":1005611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.2190000000000001},"min":{"1min":0.66600000000000004,"5min":0.627,"15min":0.627},"max":{"1min":1.7989999999999999,"5min":3.008,"15min":3.008},"last":0.83899999999999997},{"interface":"front","average":{"1min":1.373,"5min":1.1899999999999999,"15min":1.1859999999999999},"min":{"1min":0.67100000000000004,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":6.2759999999999998,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":0.77300000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.1359999999999999,"5min":1.204,"15min":1.234},"min":{"1min":0.78600000000000003,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.391,"5min":1.843,"15min":1.843},"last":1.0600000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.2929999999999999,"15min":1.2689999999999999},"min":{"1min":0.78700000000000003,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":11.805,"5min":11.805,"15min":11.805},"last":1.1879999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.2589999999999999,"15min":1.2350000000000001},"min":{"1min":0.73099999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":5.3319999999999999,"5min":5.3319999999999999,"15min":5.3319999999999999},"last":0.93100000000000005},{"interface":"front","average":{"1min":1.375,"5min":1.405,"15min":1.4490000000000001},"min":{"1min":0.93200000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":1.9750000000000001,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":1.1559999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.7050000000000001,"5min":1.4350000000000001,"15min":1.4410000000000001},"min":{"1min":0.876,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":1.3009999999999999},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.341,"15min":1.3460000000000001},"min":{"1min":0.82899999999999996,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":8.6969999999999992,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.3819999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.456,"15min":1.546},"min":{"1min":0.83999999999999997,"5min":0.78700000000000003,"15min":0.78700000000000003},"max":{"1min":1.6579999999999999,"5min":3.3570000000000002,"15min":3.3570000000000002},"last":1.4830000000000001},{"interface":"front","average":{"1min":1.6839999999999999,"5min":1.6479999999999999,"15min":1.696},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":7.7080000000000002,"5min":7.7080000000000002,"15min":7.7080000000000002},"last":1.9199999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.651,"5min":1.532,"15min":1.5669999999999999},"min":{"1min":0.70999999999999996,"5min":0.504,"15min":0.504},"max":{"1min":7.2809999999999997,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.556},{"interface":"front","average":{"1min":1.9770000000000001,"5min":1.6180000000000001,"15min":1.6060000000000001},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":14.548999999999999,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.7170000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:13:08 2024","interfaces":[{"interface":"back","average":{"1min":1.597,"5min":1.619,"15min":1.6699999999999999},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":4.5129999999999999,"5min":4.5129999999999999,"15min":4.5129999999999999},"last":1.966},{"interface":"front","average":{"1min":1.7330000000000001,"5min":1.6850000000000001,"15min":1.7390000000000001},"min":{"1min":0.80500000000000005,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":6.1600000000000001,"5min":6.1600000000000001,"15min":6.1600000000000001},"last":1.6659999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574895,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":416407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":1.1359999999999999,"15min":1.2090000000000001},"min":{"1min":0.752,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4710000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.048},{"interface":"front","average":{"1min":1.127,"5min":1.111,"15min":1.099},"min":{"1min":0.76100000000000001,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.534,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.78300000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1060000000000001,"5min":1.242,"15min":1.298},"min":{"1min":0.78000000000000003,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.869,"5min":2.008,"15min":2.008},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.125,"5min":1.2529999999999999,"15min":1.2669999999999999},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.504,"5min":2.004,"15min":2.004},"last":1.1839999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.137,"5min":1.159,"15min":1.1679999999999999},"min":{"1min":0.74399999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.585,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":1.294,"5min":1.298,"15min":1.3300000000000001},"min":{"1min":0.91000000000000003,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.722,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.583}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2330000000000001,"5min":1.379,"15min":1.429},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.6519999999999999,"5min":2.222,"15min":2.222},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.399,"15min":1.4510000000000001},"min":{"1min":0.90600000000000003,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.823,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.278}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.54,"15min":1.5940000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.98,"5min":2.915,"15min":2.915},"last":1.3939999999999999},{"interface":"front","average":{"1min":1.484,"5min":1.615,"15min":1.6739999999999999},"min":{"1min":0.998,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.8580000000000001,"5min":2.718,"15min":2.718},"last":1.496}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.506,"5min":1.5409999999999999,"15min":1.573},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.8660000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.621,"5min":1.7,"15min":1.78},"min":{"1min":0.93700000000000006,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.077,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.732}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.5700000000000001,"5min":1.694,"15min":1.7450000000000001},"min":{"1min":0.75900000000000001,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.008,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.6180000000000001},{"interface":"front","average":{"1min":1.681,"5min":1.722,"15min":1.7729999999999999},"min":{"1min":1.0409999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.972,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.5489999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":418260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":1.0509999999999999,"15min":1.0549999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.5149999999999999,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0649999999999999,"15min":1.0640000000000001},"min":{"1min":0.80300000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0760000000000001,"5min":1.0900000000000001,"15min":1.1080000000000001},"min":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.139,"15min":1.1319999999999999},"min":{"1min":0.68700000000000006,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.1559999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.24,"5min":1.232,"15min":1.236},"min":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.704,"5min":1.806,"15min":1.806},"last":0.71499999999999997},{"interface":"front","average":{"1min":1.1879999999999999,"5min":1.2549999999999999,"15min":1.268},"min":{"1min":0.84199999999999997,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5529999999999999,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.024}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.234,"5min":1.329,"15min":1.363},"min":{"1min":0.79600000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.77,"5min":1.776,"15min":1.776},"last":0.90900000000000003},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.387,"15min":1.4059999999999999},"min":{"1min":0.91900000000000004,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":1.9159999999999999,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":0.96699999999999997}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.3819999999999999,"15min":1.3979999999999999},"min":{"1min":1.071,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":2.0139999999999998,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2969999999999999},{"interface":"front","average":{"1min":1.4419999999999999,"5min":1.4430000000000001,"15min":1.448},"min":{"1min":0.97399999999999998,"5min":0.753,"15min":0.753},"max":{"1min":1.913,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.256}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.528,"5min":1.5169999999999999,"15min":1.5309999999999999},"min":{"1min":1.0780000000000001,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.0739999999999998,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.226},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5569999999999999,"15min":1.571},"min":{"1min":1.171,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":2.2789999999999999,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.399}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.579,"15min":1.577},"min":{"1min":1.276,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":2.097,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.6539999999999999,"5min":1.7030000000000001,"15min":1.7390000000000001},"min":{"1min":1.3180000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":2.1320000000000001,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.494}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32112,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339728,"statfs":{"total":96636764160,"available":96603881472,"internally_reserved":0,"allocated":954368,"data_stored":416797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.113,"5min":1.1910000000000001,"15min":1.244},"min":{"1min":0.72199999999999998,"5min":0.378,"15min":0.378},"max":{"1min":1.706,"5min":3.165,"15min":3.165},"last":1.573},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.0429999999999999,"15min":1.0289999999999999},"min":{"1min":0.72699999999999998,"5min":0.623,"15min":0.623},"max":{"1min":1.546,"5min":1.71,"15min":1.71},"last":0.82399999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2370000000000001,"5min":1.365,"15min":1.4319999999999999},"min":{"1min":0.89600000000000002,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.6479999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.1859999999999999},{"interface":"front","average":{"1min":1.1819999999999999,"5min":1.296,"15min":1.3839999999999999},"min":{"1min":0.85099999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.589,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.1379999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.2529999999999999,"5min":1.119,"15min":1.0780000000000001},"min":{"1min":0.85099999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.266},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.587,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.4670000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":1.2649999999999999,"15min":1.28},"min":{"1min":0.92200000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4790000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.331,"5min":1.367,"15min":1.401},"min":{"1min":0.93600000000000005,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.7210000000000001,"5min":2.613,"15min":2.613},"last":1.649}]},{"osd":5,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.353,"15min":1.3460000000000001},"min":{"1min":1.012,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.71,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.4390000000000001,"5min":1.363,"15min":1.3660000000000001},"min":{"1min":0.97199999999999998,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.835,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.3879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.427,"15min":1.413},"min":{"1min":0.86499999999999999,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.8959999999999999,"5min":1.919,"15min":1.919},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.556,"5min":1.516,"15min":1.518},"min":{"1min":1.2749999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.7709999999999999,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.3460000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:13:01 2024","interfaces":[{"interface":"back","average":{"1min":1.5800000000000001,"5min":1.5429999999999999,"15min":1.5629999999999999},"min":{"1min":1.1899999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.871,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.597,"5min":1.5800000000000001,"15min":1.595},"min":{"1min":1.298,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.877,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.7110000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":962560,"data_stored":419802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.75800000000000001,"15min":0.74199999999999999},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.85699999999999998,"15min":0.83699999999999997},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.409,"5min":1.484,"15min":1.484},"last":1.0940000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.83799999999999997,"15min":0.84399999999999997},"min":{"1min":0.498,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.448,"5min":1.448,"15min":1.448},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.93799999999999994,"15min":0.93200000000000005},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.6399999999999999,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.73699999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.006,"5min":1.0820000000000001,"15min":1.0940000000000001},"min":{"1min":0.56000000000000005,"5min":0.433,"15min":0.433},"max":{"1min":1.534,"5min":3.02,"15min":3.02},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.1000000000000001,"15min":1.1060000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.871,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.0649999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":1.236,"15min":1.2490000000000001},"min":{"1min":0.78000000000000003,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.1859999999999999,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.3169999999999999,"5min":1.2370000000000001,"15min":1.218},"min":{"1min":0.96899999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.8129999999999999,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":0.95399999999999996}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.3169999999999999,"15min":1.337},"min":{"1min":0.80000000000000004,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":2.133,"5min":2.153,"15min":2.153},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.3420000000000001,"15min":1.3600000000000001},"min":{"1min":0.82699999999999996,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9239999999999999,"5min":2.359,"15min":2.359},"last":1.208}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.395,"5min":1.379,"15min":1.383},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":2.0760000000000001,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.3300000000000001,"5min":1.3380000000000001,"15min":1.337},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.8300000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.347}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.385,"5min":1.4099999999999999,"15min":1.423},"min":{"1min":0.80400000000000005,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":2.024,"5min":2.286,"15min":2.286},"last":1.2949999999999999},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4059999999999999,"15min":1.407},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.974,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.3979999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":51,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343900,"statfs":{"total":96636764160,"available":96608153600,"internally_reserved":0,"allocated":942080,"data_stored":415677,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.90200000000000002,"15min":0.93500000000000005},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.3149999999999999,"5min":1.712,"15min":1.712},"last":0.374},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.91900000000000004,"15min":0.96099999999999997},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.58699999999999997}]},{"osd":1,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":1.036,"15min":1.0800000000000001},"min":{"1min":0.51700000000000002,"5min":0.5,"15min":0.5},"max":{"1min":1.3919999999999999,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":1.014,"5min":1.0609999999999999,"15min":1.095},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.4930000000000001,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.628}]},{"osd":3,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.97599999999999998,"15min":1.077},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.087,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.496},{"interface":"front","average":{"1min":1.0569999999999999,"5min":1.2050000000000001,"15min":1.276},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.8500000000000001,"5min":2.177,"15min":2.177},"last":0.52000000000000002}]},{"osd":4,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3360000000000001,"5min":1.4530000000000001,"15min":1.5189999999999999},"min":{"1min":0.85599999999999998,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.96,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.194,"5min":1.401,"15min":1.468},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.5049999999999999,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":0.99299999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2569999999999999,"15min":1.3109999999999999},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.5920000000000001,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.26,"5min":1.4550000000000001,"15min":1.5389999999999999},"min":{"1min":0.77900000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.0979999999999999,"5min":2.29,"15min":2.29},"last":1.1759999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.484,"15min":1.554},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6559999999999999,"5min":2.734,"15min":2.734},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.2270000000000001,"5min":1.4419999999999999,"15min":1.526},"min":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"max":{"1min":1.6559999999999999,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":0.93799999999999994}]},{"osd":7,"last update":"Sat Jan 20 08:13:05 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.5189999999999999,"15min":1.605},"min":{"1min":0.94399999999999995,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.698,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.0209999999999999},{"interface":"front","average":{"1min":1.234,"5min":1.4950000000000001,"15min":1.611},"min":{"1min":0.81699999999999995,"5min":0.752,"15min":0.752},"max":{"1min":1.7050000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.98399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32104,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339736,"statfs":{"total":96636764160,"available":96603889664,"internally_reserved":0,"allocated":946176,"data_stored":415255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.80900000000000005,"15min":0.81399999999999995},"min":{"1min":0.51300000000000001,"5min":0.375,"15min":0.375},"max":{"1min":1.274,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.81000000000000005,"15min":0.79900000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1}]},{"osd":2,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.91200000000000003,"15min":0.90600000000000003},"min":{"1min":0.44900000000000001,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":1.361,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.873,"15min":0.86899999999999999},"min":{"1min":0.47999999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.3720000000000001,"5min":1.444,"15min":1.444},"last":0.76600000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.98399999999999999,"15min":0.96499999999999997},"min":{"1min":0.57599999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.885,"5min":1.885,"15min":1.885},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.96699999999999997,"15min":0.99399999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.355,"5min":1.758,"15min":1.758},"last":0.85599999999999998}]},{"osd":4,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.167,"15min":1.1659999999999999},"min":{"1min":0.78300000000000003,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.425,"5min":1.905,"15min":1.905},"last":0.95399999999999996},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.254},"min":{"1min":0.80800000000000005,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.8200000000000001,"5min":2.069,"15min":2.069},"last":1.1259999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.1930000000000001,"5min":1.2569999999999999,"15min":1.276},"min":{"1min":0.77800000000000002,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.609,"5min":2.052,"15min":2.052},"last":1.24},{"interface":"front","average":{"1min":1.2310000000000001,"5min":1.28,"15min":1.2769999999999999},"min":{"1min":0.80200000000000005,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.748,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.083}]},{"osd":6,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.319,"15min":1.319},"min":{"1min":0.90000000000000002,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.9510000000000001,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.3560000000000001,"15min":1.3899999999999999},"min":{"1min":0.81399999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.913,"5min":1.97,"15min":1.97},"last":1.1799999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:13:07 2024","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.329,"15min":1.3560000000000001},"min":{"1min":0.82199999999999995,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2,"5min":2,"15min":2},"last":1.105},{"interface":"front","average":{"1min":1.2729999999999999,"5min":1.3720000000000001,"15min":1.3919999999999999},"min":{"1min":0.79400000000000004,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.778,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.145}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32680,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339160,"statfs":{"total":96636764160,"available":96603299840,"internally_reserved":0,"allocated":1536000,"data_stored":1006045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.78500000000000003,"15min":0.79300000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.4319999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.877},{"interface":"front","average":{"1min":0.751,"5min":0.83199999999999996,"15min":0.84699999999999998},"min":{"1min":0.36799999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2909999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.1259999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":0.878,"15min":0.86299999999999999},"min":{"1min":0.439,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.722,"5min":1.722,"15min":1.722},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.97999999999999998,"15min":0.95799999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":2.0699999999999998,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.4079999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.82099999999999995,"15min":0.82499999999999996},"min":{"1min":0.46400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.554,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.75},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.96199999999999997,"15min":0.98699999999999999},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.9239999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.4730000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.143,"5min":1.119,"15min":1.095},"min":{"1min":0.70099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.611},{"interface":"front","average":{"1min":1.141,"5min":1.121,"15min":1.117},"min":{"1min":0.71399999999999997,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.6870000000000001,"5min":1.6870000000000001,"15min":1.6870000000000001},"last":1.077}]},{"osd":5,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.1599999999999999,"15min":1.167},"min":{"1min":0.74199999999999999,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.786,"5min":1.865,"15min":1.865},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.1739999999999999,"5min":1.228,"15min":1.246},"min":{"1min":0.82099999999999995,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.571,"5min":2.427,"15min":2.427},"last":1.294}]},{"osd":6,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.29,"5min":1.3160000000000001,"15min":1.325},"min":{"1min":0.92300000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.6180000000000001,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.2,"5min":1.258,"15min":1.276},"min":{"1min":0.67000000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5720000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.766}]},{"osd":7,"last update":"Sat Jan 20 08:13:09 2024","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.349,"15min":1.375},"min":{"1min":0.85999999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8660000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.9830000000000001},{"interface":"front","average":{"1min":1.266,"5min":1.3340000000000001,"15min":1.3700000000000001},"min":{"1min":0.78100000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.0219999999999998,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.355}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:13:51.118 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-01-20T08:13:51.119 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.1 mon 'allow r' osd 'allow rw pool=cephfs2_data' mds allow 2024-01-20T08:13:51.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.367+0000 7f6309c00640 1 Processor -- start 2024-01-20T08:13:51.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.368+0000 7f6309c00640 1 -- start start 2024-01-20T08:13:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f630414fce0 0x7f63040a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f63040a89e0 0x7f63040aa660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6304155cc0 0x7f63040aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63041535a0 con 0x7f630414fce0 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63041526d0 con 0x7f63040a89e0 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6309c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63040c0bb0 con 0x7f6304155cc0 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.369+0000 7f6302a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f630414fce0 0x7f63040a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f630414fce0 0x7f63040a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38808/0 (socket says 172.21.15.100:38808) 2024-01-20T08:13:51.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 -- 172.21.15.100:0/1563316708 learned_addr learned my addr 172.21.15.100:0/1563316708 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 -- 172.21.15.100:0/1563316708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6304155cc0 msgr2=0x7f63040aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 --2- 172.21.15.100:0/1563316708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6304155cc0 0x7f63040aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f62fbe00640 1 --2- 172.21.15.100:0/1563316708 >> v2:172.21.15.110:3300/0 conn(0x7f63040a89e0 0x7f63040aa660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 -- 172.21.15.100:0/1563316708 >> v2:172.21.15.110:3300/0 conn(0x7f63040a89e0 msgr2=0x7f63040aa660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 --2- 172.21.15.100:0/1563316708 >> v2:172.21.15.110:3300/0 conn(0x7f63040a89e0 0x7f63040aa660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.370+0000 7f6302a00640 1 -- 172.21.15.100:0/1563316708 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6304152990 con 0x7f630414fce0 2024-01-20T08:13:51.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.371+0000 7f6302a00640 1 --2- 172.21.15.100:0/1563316708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f63040a84a0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f63040ac050 tx=0x7f62f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e0cddd0e53ac3f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.371+0000 7f6302000640 1 -- 172.21.15.100:0/1563316708 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f40317e0 con 0x7f630414fce0 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.371+0000 7f6302000640 1 -- 172.21.15.100:0/1563316708 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f4031940 con 0x7f630414fce0 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.371+0000 7f6302000640 1 -- 172.21.15.100:0/1563316708 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f4031cd0 con 0x7f630414fce0 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 -- 172.21.15.100:0/1563316708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 msgr2=0x7f63040a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 --2- 172.21.15.100:0/1563316708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f63040a84a0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f63040ac050 tx=0x7f62f402b880 comp rx=0 tx=0).stop 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 -- 172.21.15.100:0/1563316708 shutdown_connections 2024-01-20T08:13:51.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 --2- 172.21.15.100:0/1563316708 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6304155cc0 0x7f63040aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 --2- 172.21.15.100:0/1563316708 >> v2:172.21.15.110:3300/0 conn(0x7f63040a89e0 0x7f63040aa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 --2- 172.21.15.100:0/1563316708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f63040a84a0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 -- 172.21.15.100:0/1563316708 >> 172.21.15.100:0/1563316708 conn(0x7f630406a5e0 msgr2=0x7f630406a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 -- 172.21.15.100:0/1563316708 shutdown_connections 2024-01-20T08:13:51.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.372+0000 7f6309c00640 1 -- 172.21.15.100:0/1563316708 wait complete. 2024-01-20T08:13:51.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.374+0000 7f6309c00640 1 Processor -- start 2024-01-20T08:13:51.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.374+0000 7f6309c00640 1 -- start start 2024-01-20T08:13:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63040a89e0 0x7f630414f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6304155cc0 0x7f6304146d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6304147a10 con 0x7f630414fce0 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630414df30 con 0x7f6304155cc0 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f6309c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630414e210 con 0x7f63040a89e0 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f62fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f62fbe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38812/0 (socket says 172.21.15.100:38812) 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.375+0000 7f62fbe00640 1 -- 172.21.15.100:0/660537520 learned_addr learned my addr 172.21.15.100:0/660537520 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f6302a00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63040a89e0 0x7f630414f150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 -- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63040a89e0 msgr2=0x7f630414f150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63040a89e0 0x7f630414f150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 -- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6304155cc0 msgr2=0x7f6304146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6304155cc0 0x7f6304146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 -- 172.21.15.100:0/660537520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f40094d0 con 0x7f630414fce0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62fbe00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c7f0 tx=0x7f62ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004220 con 0x7f630414fce0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62ec004380 con 0x7f630414fce0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6304154390 con 0x7f630414fce0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.376+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec007840 con 0x7f630414fce0 2024-01-20T08:13:51.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.377+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6304148110 con 0x7f630414fce0 2024-01-20T08:13:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.378+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6304067640 con 0x7f630414fce0 2024-01-20T08:13:51.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.379+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f62ec007bb0 con 0x7f630414fce0 2024-01-20T08:13:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.379+0000 7f62faa00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 0x7f62dc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.380+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f62ec089810 con 0x7f630414fce0 2024-01-20T08:13:51.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.380+0000 7f6302a00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 0x7f62dc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.380+0000 7f6302a00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 0x7f62dc06d390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62f4036000 tx=0x7f62f403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:51.386 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.384+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f62ec054410 con 0x7f630414fce0 2024-01-20T08:13:51.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.643+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]} v 0) v1 -- 0x7f63040c0990 con 0x7f630414fce0 2024-01-20T08:13:51.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.647+0000 7f62faa00640 1 -- 172.21.15.100:0/660537520 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.1", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs2_data", "mds", "allow"]}]=0 updated caps for client.1 v19) v1 ==== 185+0+142 (secure 0 0 0) 0x7f62ec01e0a0 con 0x7f630414fce0 2024-01-20T08:13:51.650 INFO:teuthology.orchestra.run.smithi100.stdout:[client.1] 2024-01-20T08:13:51.650 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQCmf6tl8HeWORAADazCdCWmLV/jpLrFW8i0rw== 2024-01-20T08:13:51.651 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow" 2024-01-20T08:13:51.651 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:13:51.651 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow rw pool=cephfs2_data" 2024-01-20T08:13:51.651 INFO:teuthology.orchestra.run.smithi100.stderr:updated caps for client.1 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 msgr2=0x7f62dc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 0x7f62dc06d390 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62f4036000 tx=0x7f62f403d040 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 msgr2=0x7f6304153e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00c7f0 tx=0x7f62ec00ccb0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 shutdown_connections 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6304155cc0 0x7f6304146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f630414fce0 0x7f6304153e50 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f62dc06aed0 0x7f62dc06d390 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 --2- 172.21.15.100:0/660537520 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f63040a89e0 0x7f630414f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.650+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 >> 172.21.15.100:0/660537520 conn(0x7f630406a5e0 msgr2=0x7f63041561b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.651+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 shutdown_connections 2024-01-20T08:13:51.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.651+0000 7f6309c00640 1 -- 172.21.15.100:0/660537520 wait complete. 2024-01-20T08:13:51.671 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:51.671 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:51.727 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:51.727 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:51.781 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.994+0000 7f507f200640 1 Processor -- start 2024-01-20T08:13:51.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.994+0000 7f507f200640 1 -- start start 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.995+0000 7f507f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5078071220 0x7f5078071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.995+0000 7f507f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780c0fb0 con 0x7f50780bfae0 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.995+0000 7f507f200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f507806def0 con 0x7f5078157eb0 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.995+0000 7f507f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780c04a0 con 0x7f5078071220 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5078071220 0x7f5078071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5078071220 0x7f5078071600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38824/0 (socket says 172.21.15.100:38824) 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f506f200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f50780bfae0 0x7f5078151ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39436/0 (socket says 172.21.15.100:39436) 2024-01-20T08:13:51.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 -- 172.21.15.100:0/461365383 learned_addr learned my addr 172.21.15.100:0/461365383 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 -- 172.21.15.100:0/461365383 >> v1:172.21.15.110:6789/0 conn(0x7f5078157eb0 legacy=0x7f5078158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:52.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 -- 172.21.15.100:0/461365383 >> v1:172.21.15.100:6789/0 conn(0x7f50780bfae0 legacy=0x7f5078151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077e00640 1 -- 172.21.15.100:0/461365383 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507806e1d0 con 0x7f5078071220 2024-01-20T08:13:52.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.996+0000 7f5077400640 1 -- 172.21.15.100:0/461365383 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3016643711 0 0) 0x7f50780c0fb0 con 0x7f50780bfae0 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.997+0000 7f5077e00640 1 --2- 172.21.15.100:0/461365383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5078071220 0x7f5078071600 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5068009870 tx=0x7f506802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2a42a8c2563f12 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.997+0000 7f5077400640 1 -- 172.21.15.100:0/461365383 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50680317e0 con 0x7f5078071220 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.997+0000 7f5077400640 1 -- 172.21.15.100:0/461365383 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068031940 con 0x7f5078071220 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.997+0000 7f5077400640 1 -- 172.21.15.100:0/461365383 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068031cd0 con 0x7f5078071220 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 -- 172.21.15.100:0/461365383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5078071220 msgr2=0x7f5078071600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 --2- 172.21.15.100:0/461365383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5078071220 0x7f5078071600 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f5068009870 tx=0x7f506802b880 comp rx=0 tx=0).stop 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 -- 172.21.15.100:0/461365383 shutdown_connections 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 --2- 172.21.15.100:0/461365383 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5078071220 0x7f5078071600 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 -- 172.21.15.100:0/461365383 >> 172.21.15.100:0/461365383 conn(0x7f507806a5e0 msgr2=0x7f507806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:52.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 -- 172.21.15.100:0/461365383 shutdown_connections 2024-01-20T08:13:52.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:51.998+0000 7f507f200640 1 -- 172.21.15.100:0/461365383 wait complete. 2024-01-20T08:13:52.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.000+0000 7f507f200640 1 Processor -- start 2024-01-20T08:13:52.002 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.000+0000 7f507f200640 1 -- start start 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5078071220 0x7f507814c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5078157eb0 0x7f5078149ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50781e9f90 con 0x7f50780bfae0 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50781536a0 con 0x7f5078071220 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50781557e0 con 0x7f5078157eb0 2024-01-20T08:13:52.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38838/0 (socket says 172.21.15.100:38838) 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 -- 172.21.15.100:0/725243832 learned_addr learned my addr 172.21.15.100:0/725243832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f507d200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5078157eb0 0x7f5078149ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f5077e00640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5078071220 0x7f507814c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 -- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5078157eb0 msgr2=0x7f5078149ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5078157eb0 0x7f5078149ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 -- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5078071220 msgr2=0x7f507814c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5078071220 0x7f507814c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.001+0000 7f506f200640 1 -- 172.21.15.100:0/725243832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50680094d0 con 0x7f50780bfae0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f506f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f506000c500 tx=0x7f506000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060007560 con 0x7f50780bfae0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600047e0 con 0x7f50780bfae0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5060004b90 con 0x7f50780bfae0 2024-01-20T08:13:52.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5078152860 con 0x7f50780bfae0 2024-01-20T08:13:52.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.002+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50781532c0 con 0x7f50780bfae0 2024-01-20T08:13:52.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.003+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507804e970 con 0x7f50780bfae0 2024-01-20T08:13:52.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.004+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5060004cf0 con 0x7f50780bfae0 2024-01-20T08:13:52.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.006+0000 7f5074c00640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 0x7f505006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.006+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f5060088dc0 con 0x7f50780bfae0 2024-01-20T08:13:52.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.006+0000 7f5077e00640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 0x7f505006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.006+0000 7f5077e00640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 0x7f505006d390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5068036000 tx=0x7f506803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.010+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f50600539c0 con 0x7f50780bfae0 2024-01-20T08:13:52.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.197+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50780c0a20 con 0x7f50780bfae0 2024-01-20T08:13:52.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.199+0000 7f5074c00640 1 -- 172.21.15.100:0/725243832 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+20191 (secure 0 0 0) 0x7f5060018020 con 0x7f50780bfae0 2024-01-20T08:13:52.203 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:52.203 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":76,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:42.144659+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 msgr2=0x7f505006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 0x7f505006d390 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f5068036000 tx=0x7f506803d040 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 msgr2=0x7f507814e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f506000c500 tx=0x7f506000c9c0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 shutdown_connections 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f505006aed0 0x7f505006d390 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5078157eb0 0x7f5078149ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50780bfae0 0x7f507814e530 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 --2- 172.21.15.100:0/725243832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5078071220 0x7f507814c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.202+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 >> 172.21.15.100:0/725243832 conn(0x7f507806a5e0 msgr2=0x7f507806d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.203+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 shutdown_connections 2024-01-20T08:13:52.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.203+0000 7f507f200640 1 -- 172.21.15.100:0/725243832 wait complete. 2024-01-20T08:13:52.224 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:13:52.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:13:52.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.428+0000 7fc918a00640 1 Processor -- start 2024-01-20T08:13:52.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.429+0000 7fc918a00640 1 -- start start 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc918a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc91014fdb0 0x7fc9100c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc918a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc918a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc910150190 con 0x7fc9100c3460 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc918a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9100a9ce0 con 0x7fc91014fdb0 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc918a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100a93b0 con 0x7fc9100c1d90 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc916000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc91014fdb0 0x7fc9100c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc916000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc91014fdb0 0x7fc9100c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38848/0 (socket says 172.21.15.100:38848) 2024-01-20T08:13:52.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.430+0000 7fc916000640 1 -- 172.21.15.100:0/1216151795 learned_addr learned my addr 172.21.15.100:0/1216151795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.431+0000 7fc916000640 1 -- 172.21.15.100:0/1216151795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 msgr2=0x7fc910152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.431+0000 7fc916000640 1 --2- 172.21.15.100:0/1216151795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.431+0000 7fc916000640 1 -- 172.21.15.100:0/1216151795 >> v1:172.21.15.110:6789/0 conn(0x7fc9100c3460 legacy=0x7fc910155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.431+0000 7fc916000640 1 -- 172.21.15.100:0/1216151795 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100a8810 con 0x7fc91014fdb0 2024-01-20T08:13:52.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.432+0000 7fc916000640 1 --2- 172.21.15.100:0/1216151795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc9100c1850 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3558f537f1334435 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.432+0000 7fc914c00640 1 -- 172.21.15.100:0/1216151795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90002ca70 con 0x7fc91014fdb0 2024-01-20T08:13:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.432+0000 7fc914c00640 1 -- 172.21.15.100:0/1216151795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90002cbd0 con 0x7fc91014fdb0 2024-01-20T08:13:52.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.432+0000 7fc914c00640 1 -- 172.21.15.100:0/1216151795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000343f0 con 0x7fc91014fdb0 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 -- 172.21.15.100:0/1216151795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 msgr2=0x7fc9100c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 --2- 172.21.15.100:0/1216151795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc9100c1850 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc900009e50 tx=0x7fc90002bed0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 -- 172.21.15.100:0/1216151795 shutdown_connections 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 --2- 172.21.15.100:0/1216151795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 --2- 172.21.15.100:0/1216151795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc9100c1850 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 -- 172.21.15.100:0/1216151795 >> 172.21.15.100:0/1216151795 conn(0x7fc9100c2940 msgr2=0x7fc9100c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:52.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 -- 172.21.15.100:0/1216151795 shutdown_connections 2024-01-20T08:13:52.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.433+0000 7fc918a00640 1 -- 172.21.15.100:0/1216151795 wait complete. 2024-01-20T08:13:52.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.435+0000 7fc918a00640 1 Processor -- start 2024-01-20T08:13:52.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.435+0000 7fc918a00640 1 -- start start 2024-01-20T08:13:52.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910070220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100c3460 0x7fc910151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9101524a0 con 0x7fc91014fdb0 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91006d060 con 0x7fc9100c3460 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc918a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91006dc00 con 0x7fc9100c1d90 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc916a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc916a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38856/0 (socket says 172.21.15.100:38856) 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.436+0000 7fc916a00640 1 -- 172.21.15.100:0/211731370 learned_addr learned my addr 172.21.15.100:0/211731370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916000640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910070220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc915600640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100c3460 0x7fc910151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 -- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 msgr2=0x7fc910070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910070220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 -- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100c3460 msgr2=0x7fc910151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100c3460 0x7fc910151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 -- 172.21.15.100:0/211731370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900009b30 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc916a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c390 tx=0x7fc90800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.437+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9080035f0 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.438+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc908003750 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.438+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908003b00 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.438+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91006dee0 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.438+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91006cd80 con 0x7fc91014fdb0 2024-01-20T08:13:52.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.439+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91006c900 con 0x7fc91014fdb0 2024-01-20T08:13:52.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.440+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc908003c60 con 0x7fc91014fdb0 2024-01-20T08:13:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.441+0000 7fc90e000640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 0x7fc8e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.441+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc908088fe0 con 0x7fc91014fdb0 2024-01-20T08:13:52.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.441+0000 7fc916000640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 0x7fc8e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.442+0000 7fc916000640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 0x7fc8e806d390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc900035000 tx=0x7fc900030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.446+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc91006c900 con 0x7fc91014fdb0 2024-01-20T08:13:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.640+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc91006c900 con 0x7fc91014fdb0 2024-01-20T08:13:52.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.640+0000 7fc90e000640 1 -- 172.21.15.100:0/211731370 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc91006c900 con 0x7fc91014fdb0 2024-01-20T08:13:52.643 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:13:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 msgr2=0x7fc8e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 0x7fc8e806d390 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fc900035000 tx=0x7fc900030000 comp rx=0 tx=0).stop 2024-01-20T08:13:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 msgr2=0x7fc910150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c390 tx=0x7fc90800c850 comp rx=0 tx=0).stop 2024-01-20T08:13:52.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 shutdown_connections 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc91014fdb0 0x7fc910150870 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100c3460 0x7fc910151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806aed0 0x7fc8e806d390 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 --2- 172.21.15.100:0/211731370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c1d90 0x7fc910070220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 >> 172.21.15.100:0/211731370 conn(0x7fc9100c2940 msgr2=0x7fc9101ded40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 shutdown_connections 2024-01-20T08:13:52.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.643+0000 7fc918a00640 1 -- 172.21.15.100:0/211731370 wait complete. 2024-01-20T08:13:52.665 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:13:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.860+0000 7f949f400640 1 Processor -- start 2024-01-20T08:13:52.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.861+0000 7f949f400640 1 -- start start 2024-01-20T08:13:52.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f949814ea50 0x7f9498071b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 0x7f949815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949f400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9498151e50 con 0x7f9498072040 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949f400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94980a9180 con 0x7f949814ea50 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949f400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f949814ee30 con 0x7f94980c2310 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f949814ea50 0x7f9498071b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949e000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f949814ea50 0x7f9498071b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38860/0 (socket says 172.21.15.100:38860) 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.862+0000 7f949e000640 1 -- 172.21.15.100:0/2294354545 learned_addr learned my addr 172.21.15.100:0/2294354545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949ea00640 1 --2- 172.21.15.100:0/2294354545 >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 0x7f949815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949e000640 1 -- 172.21.15.100:0/2294354545 >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 msgr2=0x7f949815bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949e000640 1 --2- 172.21.15.100:0/2294354545 >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 0x7f949815bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949e000640 1 -- 172.21.15.100:0/2294354545 >> v1:172.21.15.100:6789/0 conn(0x7f9498072040 legacy=0x7f94980c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949e000640 1 -- 172.21.15.100:0/2294354545 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9498152380 con 0x7f949814ea50 2024-01-20T08:13:52.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.863+0000 7f949ea00640 1 --2- 172.21.15.100:0/2294354545 >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 0x7f949815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.864+0000 7f949e000640 1 --2- 172.21.15.100:0/2294354545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f949814ea50 0x7f9498071b00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f949806c210 tx=0x7f948002da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=184f7af0b2e33741 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.864+0000 7f949cc00640 1 -- 172.21.15.100:0/2294354545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948002f850 con 0x7f949814ea50 2024-01-20T08:13:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.864+0000 7f949cc00640 1 -- 172.21.15.100:0/2294354545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f948002f9b0 con 0x7f949814ea50 2024-01-20T08:13:52.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.864+0000 7f949cc00640 1 -- 172.21.15.100:0/2294354545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948002fd40 con 0x7f949814ea50 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 -- 172.21.15.100:0/2294354545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f949814ea50 msgr2=0x7f9498071b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 --2- 172.21.15.100:0/2294354545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f949814ea50 0x7f9498071b00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f949806c210 tx=0x7f948002da90 comp rx=0 tx=0).stop 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 -- 172.21.15.100:0/2294354545 shutdown_connections 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 --2- 172.21.15.100:0/2294354545 >> v2:172.21.15.110:3300/0 conn(0x7f94980c2310 0x7f949815bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 --2- 172.21.15.100:0/2294354545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f949814ea50 0x7f9498071b00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 -- 172.21.15.100:0/2294354545 >> 172.21.15.100:0/2294354545 conn(0x7f94980c2940 msgr2=0x7f94980c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:52.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 -- 172.21.15.100:0/2294354545 shutdown_connections 2024-01-20T08:13:52.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.865+0000 7f949f400640 1 -- 172.21.15.100:0/2294354545 wait complete. 2024-01-20T08:13:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.867+0000 7f949f400640 1 Processor -- start 2024-01-20T08:13:52.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.867+0000 7f949f400640 1 -- start start 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949814ea50 0x7f94981dc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94981dd5c0 0x7f94981dcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981eb240 con 0x7f94980c2310 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94981dd1b0 con 0x7f949814ea50 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94981ea370 con 0x7f94981dd5c0 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.868+0000 7f949e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38872/0 (socket says 172.21.15.100:38872) 2024-01-20T08:13:52.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 -- 172.21.15.100:0/3491570795 learned_addr learned my addr 172.21.15.100:0/3491570795 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949d600640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949814ea50 0x7f94981dc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 -- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94981dd5c0 msgr2=0x7f94981dcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94981dd5c0 0x7f94981dcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 -- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949814ea50 msgr2=0x7f94981dc730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949814ea50 0x7f94981dc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 -- 172.21.15.100:0/3491570795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94800094d0 con 0x7f94980c2310 2024-01-20T08:13:52.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.869+0000 7f949e000640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9480009960 tx=0x7f94800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.870+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480039750 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.870+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94800398b0 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.870+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480039c60 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.870+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94980c5910 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.870+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94981ea910 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.871+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f949804e9e0 con 0x7f94980c2310 2024-01-20T08:13:52.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.872+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9480037380 con 0x7f94980c2310 2024-01-20T08:13:52.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.872+0000 7f9496000640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 0x7f947006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:52.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.873+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f9480034070 con 0x7f94980c2310 2024-01-20T08:13:52.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.873+0000 7f949d600640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 0x7f947006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:52.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.873+0000 7f949d600640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 0x7f947006d390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94980c0690 tx=0x7f9488009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:52.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:52.877+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9480075e30 con 0x7f94980c2310 2024-01-20T08:13:53.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.074+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f949806c610 con 0x7f94980c2310 2024-01-20T08:13:53.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.078+0000 7f9496000640 1 -- 172.21.15.100:0/3491570795 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v76) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9480079450 con 0x7f94980c2310 2024-01-20T08:13:53.081 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:13:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 msgr2=0x7f947006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 0x7f947006d390 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f94980c0690 tx=0x7f9488009040 comp rx=0 tx=0).stop 2024-01-20T08:13:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 msgr2=0x7f94980bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f9480009960 tx=0x7f94800046c0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 shutdown_connections 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f947006aed0 0x7f947006d390 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f94981dd5c0 0x7f94981dcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f949814ea50 0x7f94981dc730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 --2- 172.21.15.100:0/3491570795 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94980c2310 0x7f94980bf4e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.081+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 >> 172.21.15.100:0/3491570795 conn(0x7f94980c2940 msgr2=0x7f949806e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.082+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 shutdown_connections 2024-01-20T08:13:53.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.082+0000 7f949f400640 1 -- 172.21.15.100:0/3491570795 wait complete. 2024-01-20T08:13:53.103 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:13:53.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.313+0000 7fcc27400640 1 Processor -- start 2024-01-20T08:13:53.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.313+0000 7fcc27400640 1 -- start start 2024-01-20T08:13:53.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.315+0000 7fcc27400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.315+0000 7fcc27400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc20153120 0x7fcc2015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.315+0000 7fcc27400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc20150190 con 0x7fcc2014fdb0 2024-01-20T08:13:53.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.315+0000 7fcc27400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc200a9ce0 con 0x7fcc20153120 2024-01-20T08:13:53.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.315+0000 7fcc27400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc200a93b0 con 0x7fcc200c3460 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc1fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc25400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc20153120 0x7fcc2015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc25400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcc20153120 0x7fcc2015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:37744/0 (socket says 172.21.15.100:37744) 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc1fe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:53854/0 (socket says 172.21.15.100:53854) 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc24a00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fcc2014fdb0 0x7fcc200c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:37712/0 (socket says 172.21.15.100:37712) 2024-01-20T08:13:53.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc1fe00640 1 -- 172.21.15.100:0/2518140391 learned_addr learned my addr 172.21.15.100:0/2518140391 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:53.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc1f400640 1 -- 172.21.15.100:0/2518140391 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2096250915 0 0) 0x7fcc20150190 con 0x7fcc2014fdb0 2024-01-20T08:13:53.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.316+0000 7fcc1f400640 1 -- 172.21.15.100:0/2518140391 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcc00003520 con 0x7fcc2014fdb0 2024-01-20T08:13:53.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.317+0000 7fcc25400640 1 -- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 msgr2=0x7fcc20152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:53.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.317+0000 7fcc25400640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.317+0000 7fcc25400640 1 -- 172.21.15.100:0/2518140391 >> v1:172.21.15.110:6789/0 conn(0x7fcc2014fdb0 legacy=0x7fcc200c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.317+0000 7fcc25400640 1 -- 172.21.15.100:0/2518140391 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc201535b0 con 0x7fcc20153120 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.317+0000 7fcc1fe00640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.318+0000 7fcc25400640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc20153120 0x7fcc2015cfc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009d90 tx=0x7fcc1802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b4e7a62ad517e49 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.318+0000 7fcc1f400640 1 -- 172.21.15.100:0/2518140391 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1802cc60 con 0x7fcc20153120 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.318+0000 7fcc1f400640 1 -- 172.21.15.100:0/2518140391 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1802cdc0 con 0x7fcc20153120 2024-01-20T08:13:53.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc1f400640 1 -- 172.21.15.100:0/2518140391 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc18034640 con 0x7fcc20153120 2024-01-20T08:13:53.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 -- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc20153120 msgr2=0x7fcc2015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc20153120 0x7fcc2015cfc0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcc18009d90 tx=0x7fcc1802beb0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 -- 172.21.15.100:0/2518140391 shutdown_connections 2024-01-20T08:13:53.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc20153120 0x7fcc2015cfc0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 --2- 172.21.15.100:0/2518140391 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc200c3460 0x7fcc20152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 -- 172.21.15.100:0/2518140391 >> 172.21.15.100:0/2518140391 conn(0x7fcc200c2940 msgr2=0x7fcc200c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:53.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 -- 172.21.15.100:0/2518140391 shutdown_connections 2024-01-20T08:13:53.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.319+0000 7fcc27400640 1 -- 172.21.15.100:0/2518140391 wait complete. 2024-01-20T08:13:53.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.321+0000 7fcc27400640 1 Processor -- start 2024-01-20T08:13:53.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.321+0000 7fcc27400640 1 -- start start 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc200c3460 0x7fcc2014a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc20153120 0x7fcc201ed670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc2014c690 con 0x7fcc2014fdb0 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc201ed1e0 con 0x7fcc200c3460 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc27400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc20154070 con 0x7fcc20153120 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc1fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc1fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38886/0 (socket says 172.21.15.100:38886) 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.322+0000 7fcc1fe00640 1 -- 172.21.15.100:0/2592154472 learned_addr learned my addr 172.21.15.100:0/2592154472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc24a00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc200c3460 0x7fcc2014a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc25400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc20153120 0x7fcc201ed670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 -- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc20153120 msgr2=0x7fcc201ed670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc20153120 0x7fcc201ed670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 -- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc200c3460 msgr2=0x7fcc2014a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc200c3460 0x7fcc2014a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 -- 172.21.15.100:0/2592154472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080094d0 con 0x7fcc2014fdb0 2024-01-20T08:13:53.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1fe00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800e9d0 tx=0x7fcc0800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0800ca60 con 0x7fcc2014fdb0 2024-01-20T08:13:53.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0800cbc0 con 0x7fcc2014fdb0 2024-01-20T08:13:53.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.323+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08013470 con 0x7fcc2014fdb0 2024-01-20T08:13:53.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.324+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc18009a70 con 0x7fcc2014fdb0 2024-01-20T08:13:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.324+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc20154630 con 0x7fcc2014fdb0 2024-01-20T08:13:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.325+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc201ed350 con 0x7fcc2014fdb0 2024-01-20T08:13:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.326+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcc080135d0 con 0x7fcc2014fdb0 2024-01-20T08:13:53.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.326+0000 7fcc1cc00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 0x7fcbf806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.327+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fcc08089c90 con 0x7fcc2014fdb0 2024-01-20T08:13:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.327+0000 7fcc24a00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 0x7fcbf806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.327+0000 7fcc24a00640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 0x7fcbf806d390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcc100011e0 tx=0x7fcc10007b50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.334 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.331+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcc08054890 con 0x7fcc2014fdb0 2024-01-20T08:13:53.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.523+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc2004e970 con 0x7fcc2014fdb0 2024-01-20T08:13:53.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.524+0000 7fcc1cc00640 1 -- 172.21.15.100:0/2592154472 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v76) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcc08021020 con 0x7fcc2014fdb0 2024-01-20T08:13:53.527 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 msgr2=0x7fcbf806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 0x7fcbf806d390 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fcc100011e0 tx=0x7fcc10007b50 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 msgr2=0x7fcc2014bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fcc0800e9d0 tx=0x7fcc0800ee90 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 shutdown_connections 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcbf806aed0 0x7fcbf806d390 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcc20153120 0x7fcc201ed670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcc2014fdb0 0x7fcc2014bb80 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 --2- 172.21.15.100:0/2592154472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcc200c3460 0x7fcc2014a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.526+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 >> 172.21.15.100:0/2592154472 conn(0x7fcc200c2940 msgr2=0x7fcc200c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.527+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 shutdown_connections 2024-01-20T08:13:53.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.527+0000 7fcc27400640 1 -- 172.21.15.100:0/2592154472 wait complete. 2024-01-20T08:13:53.548 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:13:53.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.757+0000 7f833e200640 1 Processor -- start 2024-01-20T08:13:53.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.757+0000 7f833e200640 1 -- start start 2024-01-20T08:13:53.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.758+0000 7f833e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 0x7f833806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.758+0000 7f833e200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8338154af0 0x7f8338154f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.758+0000 7f833e200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f833806d220 con 0x7f83381481a0 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.758+0000 7f833e200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f833806dbf0 con 0x7f8338154af0 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.758+0000 7f833e200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83381557a0 con 0x7f83380c05a0 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8338154af0 0x7f8338154f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f8338154af0 0x7f8338154f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38902/0 (socket says 172.21.15.100:38902) 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 -- 172.21.15.100:0/2286651465 learned_addr learned my addr 172.21.15.100:0/2286651465 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:53.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f832e800640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 0x7f833806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 -- 172.21.15.100:0/2286651465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 msgr2=0x7f833806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 0x7f833806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 -- 172.21.15.100:0/2286651465 >> v1:172.21.15.110:6789/0 conn(0x7f83381481a0 legacy=0x7f83380701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f8337e00640 1 -- 172.21.15.100:0/2286651465 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f833806c8f0 con 0x7f8338154af0 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.759+0000 7f832e800640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 0x7f833806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:53.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.760+0000 7f8337e00640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8338154af0 0x7f8338154f60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f833002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b319f1118bde6876 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.760+0000 7f8336a00640 1 -- 172.21.15.100:0/2286651465 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833002ca70 con 0x7f8338154af0 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.760+0000 7f8336a00640 1 -- 172.21.15.100:0/2286651465 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833002cbd0 con 0x7f8338154af0 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.760+0000 7f8336a00640 1 -- 172.21.15.100:0/2286651465 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83300343f0 con 0x7f8338154af0 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 -- 172.21.15.100:0/2286651465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8338154af0 msgr2=0x7f8338154f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8338154af0 0x7f8338154f60 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f833002bed0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 -- 172.21.15.100:0/2286651465 shutdown_connections 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8338154af0 0x7f8338154f60 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 --2- 172.21.15.100:0/2286651465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83380c05a0 0x7f833806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 -- 172.21.15.100:0/2286651465 >> 172.21.15.100:0/2286651465 conn(0x7f83380c6090 msgr2=0x7f83380c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 -- 172.21.15.100:0/2286651465 shutdown_connections 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.761+0000 7f833e200640 1 -- 172.21.15.100:0/2286651465 wait complete. 2024-01-20T08:13:53.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.763+0000 7f833e200640 1 Processor -- start 2024-01-20T08:13:53.766 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.763+0000 7f833e200640 1 -- start start 2024-01-20T08:13:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8338154af0 0x7f8338071480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8338151950 0x7f8338132570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338150d60 con 0x7f833813ffc0 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8338132ff0 con 0x7f8338151950 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f833e200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f833813fb80 con 0x7f8338154af0 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f8337e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f8337e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38906/0 (socket says 172.21.15.100:38906) 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.764+0000 7f8337e00640 1 -- 172.21.15.100:0/1438454324 learned_addr learned my addr 172.21.15.100:0/1438454324 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f832e800640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8338151950 0x7f8338132570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337400640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8338154af0 0x7f8338071480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 -- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8338154af0 msgr2=0x7f8338071480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8338154af0 0x7f8338071480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 -- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8338151950 msgr2=0x7f8338132570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8338151950 0x7f8338132570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 -- 172.21.15.100:0/1438454324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8330009b30 con 0x7f833813ffc0 2024-01-20T08:13:53.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f8337e00640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f8330004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8330009510 con 0x7f833813ffc0 2024-01-20T08:13:53.769 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833003e450 con 0x7f833813ffc0 2024-01-20T08:13:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833003e800 con 0x7f833813ffc0 2024-01-20T08:13:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83380c45b0 con 0x7f833813ffc0 2024-01-20T08:13:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.765+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83380719c0 con 0x7f833813ffc0 2024-01-20T08:13:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.766+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83380a9540 con 0x7f833813ffc0 2024-01-20T08:13:53.770 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.767+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f833003e960 con 0x7f833813ffc0 2024-01-20T08:13:53.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.768+0000 7f832fe00640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:53.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.768+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7f83300ac790 con 0x7f833813ffc0 2024-01-20T08:13:53.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.769+0000 7f8337400640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:53.772 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.769+0000 7f8337400640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 0x7f831006d390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f83280015d0 tx=0x7f8328009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:53.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.773+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8330077440 con 0x7f833813ffc0 2024-01-20T08:13:53.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.964+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83381e8d00 con 0x7f833813ffc0 2024-01-20T08:13:53.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.965+0000 7f832fe00640 1 -- 172.21.15.100:0/1438454324 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v76) v1 ==== 105+0+11 (secure 0 0 0) 0x7f83381e8d00 con 0x7f833813ffc0 2024-01-20T08:13:53.968 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.967+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 msgr2=0x7f831006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.967+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 0x7f831006d390 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f83280015d0 tx=0x7f8328009040 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.967+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 msgr2=0x7f8338132ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.967+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f8330009e50 tx=0x7f8330004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 shutdown_connections 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f833813ffc0 0x7f8338132ab0 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f8338151950 0x7f8338132570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f831006aed0 0x7f831006d390 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 --2- 172.21.15.100:0/1438454324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f8338154af0 0x7f8338071480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:53.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 >> 172.21.15.100:0/1438454324 conn(0x7f83380c6090 msgr2=0x7f83381418d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 shutdown_connections 2024-01-20T08:13:53.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:53.968+0000 7f833e200640 1 -- 172.21.15.100:0/1438454324 wait complete. 2024-01-20T08:13:53.990 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:13:54.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.193+0000 7fb91cc00640 1 Processor -- start 2024-01-20T08:13:54.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.193+0000 7fb91cc00640 1 -- start start 2024-01-20T08:13:54.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb91814fdb0 0x7fb9180c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb9180c1d90 0x7fb918152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.198 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c3460 0x7fb918153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180a9ce0 con 0x7fb91814fdb0 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9180a93b0 con 0x7fb9180c1d90 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb91cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb918152790 con 0x7fb9180c3460 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb915e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb91814fdb0 0x7fb9180c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb915e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb91814fdb0 0x7fb9180c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38912/0 (socket says 172.21.15.100:38912) 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb915e00640 1 -- 172.21.15.100:0/311713234 learned_addr learned my addr 172.21.15.100:0/311713234 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb916800640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c3460 0x7fb918153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb915400640 1 --2- 172.21.15.100:0/311713234 >> v2:172.21.15.110:3300/0 conn(0x7fb9180c1d90 0x7fb918152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.195+0000 7fb915e00640 1 -- 172.21.15.100:0/311713234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c3460 msgr2=0x7fb918153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.196+0000 7fb915e00640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c3460 0x7fb918153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.196+0000 7fb915e00640 1 -- 172.21.15.100:0/311713234 >> v2:172.21.15.110:3300/0 conn(0x7fb9180c1d90 msgr2=0x7fb918152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.196+0000 7fb915e00640 1 --2- 172.21.15.100:0/311713234 >> v2:172.21.15.110:3300/0 conn(0x7fb9180c1d90 0x7fb918152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.199 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.196+0000 7fb915e00640 1 -- 172.21.15.100:0/311713234 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb918150190 con 0x7fb91814fdb0 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.197+0000 7fb915e00640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91814fdb0 0x7fb9180c1850 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb91806be40 tx=0x7fb90802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d989e62af2a7f90f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.197+0000 7fb914a00640 1 -- 172.21.15.100:0/311713234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908031870 con 0x7fb91814fdb0 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.197+0000 7fb914a00640 1 -- 172.21.15.100:0/311713234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9080319d0 con 0x7fb91814fdb0 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.197+0000 7fb914a00640 1 -- 172.21.15.100:0/311713234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908031d60 con 0x7fb91814fdb0 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 -- 172.21.15.100:0/311713234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91814fdb0 msgr2=0x7fb9180c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91814fdb0 0x7fb9180c1850 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb91806be40 tx=0x7fb90802b910 comp rx=0 tx=0).stop 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 -- 172.21.15.100:0/311713234 shutdown_connections 2024-01-20T08:13:54.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c3460 0x7fb918153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 --2- 172.21.15.100:0/311713234 >> v2:172.21.15.110:3300/0 conn(0x7fb9180c1d90 0x7fb918152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 --2- 172.21.15.100:0/311713234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb91814fdb0 0x7fb9180c1850 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 -- 172.21.15.100:0/311713234 >> 172.21.15.100:0/311713234 conn(0x7fb9180c2940 msgr2=0x7fb9180c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:54.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 -- 172.21.15.100:0/311713234 shutdown_connections 2024-01-20T08:13:54.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.198+0000 7fb91cc00640 1 -- 172.21.15.100:0/311713234 wait complete. 2024-01-20T08:13:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.200+0000 7fb91cc00640 1 Processor -- start 2024-01-20T08:13:54.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.200+0000 7fb91cc00640 1 -- start start 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c1d90 0x7fb918153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 0x7fb918154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9181eb390 con 0x7fb9180c3460 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb91813ff40 con 0x7fb91814fdb0 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb91cc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb91813fc60 con 0x7fb9180c1d90 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.201+0000 7fb915400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38928/0 (socket says 172.21.15.100:38928) 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 -- 172.21.15.100:0/161907071 learned_addr learned my addr 172.21.15.100:0/161907071 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915e00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c1d90 0x7fb918153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb916800640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 0x7fb918154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 -- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c1d90 msgr2=0x7fb918153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c1d90 0x7fb918153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 -- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 msgr2=0x7fb918154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 0x7fb918154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 -- 172.21.15.100:0/161907071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9080094d0 con 0x7fb9180c3460 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb916800640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 0x7fb918154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:54.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.202+0000 7fb915400640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c7f0 tx=0x7fb90000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.203+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900004220 con 0x7fb9180c3460 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.203+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb900004380 con 0x7fb9180c3460 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.203+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb918152380 con 0x7fb9180c3460 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.203+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb900003850 con 0x7fb9180c3460 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.203+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb918154240 con 0x7fb9180c3460 2024-01-20T08:13:54.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.204+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb91804e970 con 0x7fb9180c3460 2024-01-20T08:13:54.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.205+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb900003bc0 con 0x7fb9180c3460 2024-01-20T08:13:54.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.206+0000 7fb90e000640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 0x7fb8f006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.206+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fb900089860 con 0x7fb9180c3460 2024-01-20T08:13:54.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.206+0000 7fb915e00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 0x7fb8f006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.207+0000 7fb915e00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 0x7fb8f006d390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb908036000 tx=0x7fb90803c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.211+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb9000543d0 con 0x7fb9180c3460 2024-01-20T08:13:54.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.404+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fb9180c2260 con 0x7fb9180c3460 2024-01-20T08:13:54.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.405+0000 7fb90e000640 1 -- 172.21.15.100:0/161907071 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v76) v1 ==== 101+0+11 (secure 0 0 0) 0x7fb90001e020 con 0x7fb9180c3460 2024-01-20T08:13:54.408 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 msgr2=0x7fb8f006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 0x7fb8f006d390 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fb908036000 tx=0x7fb90803c040 comp rx=0 tx=0).stop 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 msgr2=0x7fb918154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fb90000c7f0 tx=0x7fb90000ccb0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 shutdown_connections 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb91814fdb0 0x7fb918154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb9180c3460 0x7fb918154980 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb8f006aed0 0x7fb8f006d390 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 --2- 172.21.15.100:0/161907071 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb9180c1d90 0x7fb918153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 >> 172.21.15.100:0/161907071 conn(0x7fb9180c2940 msgr2=0x7fb918070c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 shutdown_connections 2024-01-20T08:13:54.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.408+0000 7fb91cc00640 1 -- 172.21.15.100:0/161907071 wait complete. 2024-01-20T08:13:54.430 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:13:54.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.638+0000 7fc35f400640 1 Processor -- start 2024-01-20T08:13:54.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.639+0000 7fc35f400640 1 -- start start 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc358152010 0x7fc3580c1690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3581589f0 0x7fc358157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3580c1bd0 0x7fc3580c2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3580c53a0 con 0x7fc3581589f0 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3581523f0 con 0x7fc358152010 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc35f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3580c4b00 con 0x7fc3580c1bd0 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc357e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3581589f0 0x7fc358157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc357e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc3581589f0 0x7fc358157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38936/0 (socket says 172.21.15.100:38936) 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.640+0000 7fc357e00640 1 -- 172.21.15.100:0/3595530565 learned_addr learned my addr 172.21.15.100:0/3595530565 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc35ca00640 1 --2- 172.21.15.100:0/3595530565 >> v2:172.21.15.110:3300/0 conn(0x7fc358152010 0x7fc3580c1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc35d400640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3580c1bd0 0x7fc3580c2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc357e00640 1 -- 172.21.15.100:0/3595530565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3580c1bd0 msgr2=0x7fc3580c2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:54.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc357e00640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3580c1bd0 0x7fc3580c2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc357e00640 1 -- 172.21.15.100:0/3595530565 >> v2:172.21.15.110:3300/0 conn(0x7fc358152010 msgr2=0x7fc3580c1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:54.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc357e00640 1 --2- 172.21.15.100:0/3595530565 >> v2:172.21.15.110:3300/0 conn(0x7fc358152010 0x7fc3580c1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.641+0000 7fc357e00640 1 -- 172.21.15.100:0/3595530565 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3580c4de0 con 0x7fc3581589f0 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.642+0000 7fc357e00640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3581589f0 0x7fc358157ee0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc3580c5920 tx=0x7fc34002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee713014d86fcf0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.642+0000 7fc357400640 1 -- 172.21.15.100:0/3595530565 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc34002c9e0 con 0x7fc3581589f0 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.642+0000 7fc357400640 1 -- 172.21.15.100:0/3595530565 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc34002cb40 con 0x7fc3581589f0 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.642+0000 7fc357400640 1 -- 172.21.15.100:0/3595530565 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3400343f0 con 0x7fc3581589f0 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 -- 172.21.15.100:0/3595530565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3581589f0 msgr2=0x7fc358157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3581589f0 0x7fc358157ee0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fc3580c5920 tx=0x7fc34002be40 comp rx=0 tx=0).stop 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 -- 172.21.15.100:0/3595530565 shutdown_connections 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc3580c1bd0 0x7fc3580c2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 --2- 172.21.15.100:0/3595530565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3581589f0 0x7fc358157ee0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 --2- 172.21.15.100:0/3595530565 >> v2:172.21.15.110:3300/0 conn(0x7fc358152010 0x7fc3580c1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 -- 172.21.15.100:0/3595530565 >> 172.21.15.100:0/3595530565 conn(0x7fc358066340 msgr2=0x7fc358066750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 -- 172.21.15.100:0/3595530565 shutdown_connections 2024-01-20T08:13:54.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.643+0000 7fc35f400640 1 -- 172.21.15.100:0/3595530565 wait complete. 2024-01-20T08:13:54.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.645+0000 7fc35f400640 1 Processor -- start 2024-01-20T08:13:54.648 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.645+0000 7fc35f400640 1 -- start start 2024-01-20T08:13:54.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc358152010 0x7fc358155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3581589f0 0x7fc35814a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581eea40 con 0x7fc3580c1bd0 2024-01-20T08:13:54.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581ede30 con 0x7fc3581589f0 2024-01-20T08:13:54.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35f400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3581ee110 con 0x7fc358152010 2024-01-20T08:13:54.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.646+0000 7fc35ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38946/0 (socket says 172.21.15.100:38946) 2024-01-20T08:13:54.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 -- 172.21.15.100:0/4212613445 learned_addr learned my addr 172.21.15.100:0/4212613445 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:54.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35d400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3581589f0 0x7fc35814a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc357e00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc358152010 0x7fc358155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 -- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc358152010 msgr2=0x7fc358155060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc358152010 0x7fc358155060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 -- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3581589f0 msgr2=0x7fc35814a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3581589f0 0x7fc35814a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 -- 172.21.15.100:0/4212613445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc340009b30 con 0x7fc3580c1bd0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.647+0000 7fc35ca00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d5f0 tx=0x7fc34800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.648+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3480125f0 con 0x7fc3580c1bd0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.648+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc348012750 con 0x7fc3580c1bd0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.648+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc348012b00 con 0x7fc3580c1bd0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.648+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3581ee3f0 con 0x7fc3580c1bd0 2024-01-20T08:13:54.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.648+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc35814ce50 con 0x7fc3580c1bd0 2024-01-20T08:13:54.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.649+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc35804e970 con 0x7fc3580c1bd0 2024-01-20T08:13:54.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.650+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc348012c60 con 0x7fc3580c1bd0 2024-01-20T08:13:54.653 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.651+0000 7fc354c00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 0x7fc33006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:54.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.651+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc348089e30 con 0x7fc3580c1bd0 2024-01-20T08:13:54.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.651+0000 7fc357e00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 0x7fc33006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:54.654 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.652+0000 7fc357e00640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 0x7fc33006d3c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc340035000 tx=0x7fc340030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:54.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.655+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc348054990 con 0x7fc3580c1bd0 2024-01-20T08:13:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.866+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc358067e50 con 0x7fc3580c1bd0 2024-01-20T08:13:54.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.866+0000 7fc354c00640 1 -- 172.21.15.100:0/4212613445 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v76) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc348057fb0 con 0x7fc3580c1bd0 2024-01-20T08:13:54.870 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:13:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 msgr2=0x7fc33006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 0x7fc33006d3c0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc340035000 tx=0x7fc340030000 comp rx=0 tx=0).stop 2024-01-20T08:13:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 msgr2=0x7fc35814c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:54.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fc34800d5f0 tx=0x7fc34800dab0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 shutdown_connections 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc3581589f0 0x7fc35814a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc33006af00 0x7fc33006d3c0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc358152010 0x7fc358155060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 --2- 172.21.15.100:0/4212613445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc3580c1bd0 0x7fc35814c910 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 >> 172.21.15.100:0/4212613445 conn(0x7fc358066340 msgr2=0x7fc35806f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 shutdown_connections 2024-01-20T08:13:54.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:54.869+0000 7fc35f400640 1 -- 172.21.15.100:0/4212613445 wait complete. 2024-01-20T08:13:54.889 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:13:54.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:54.890 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:55.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:13:55.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.001 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:13:55.052 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:55.052 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:55.100 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:13:55.100 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:13:55.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.314+0000 7fc04de00640 1 Processor -- start 2024-01-20T08:13:55.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.314+0000 7fc04de00640 1 -- start start 2024-01-20T08:13:55.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc04de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 0x7fc048152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc04de00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc048153120 0x7fc04815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc04de00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc048150190 con 0x7fc04814fdb0 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc04de00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480a9ce0 con 0x7fc048153120 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc04de00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0480a93b0 con 0x7fc0480c3460 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc046a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc04814fdb0 0x7fc0480c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39466/0 (socket says 172.21.15.100:39466) 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc046a00640 1 -- 172.21.15.100:0/677677789 learned_addr learned my addr 172.21.15.100:0/677677789 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc047400640 1 --2- 172.21.15.100:0/677677789 >> v2:172.21.15.100:3300/0 conn(0x7fc048153120 0x7fc04815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc046000640 1 --2- 172.21.15.100:0/677677789 >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 0x7fc048152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.316+0000 7fc047400640 1 -- 172.21.15.100:0/677677789 >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 msgr2=0x7fc048152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.317+0000 7fc047400640 1 --2- 172.21.15.100:0/677677789 >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 0x7fc048152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.317+0000 7fc047400640 1 -- 172.21.15.100:0/677677789 >> v1:172.21.15.100:6789/0 conn(0x7fc04814fdb0 legacy=0x7fc0480c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.317+0000 7fc047400640 1 -- 172.21.15.100:0/677677789 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0481535b0 con 0x7fc048153120 2024-01-20T08:13:55.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.317+0000 7fc046000640 1 --2- 172.21.15.100:0/677677789 >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 0x7fc048152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:55.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.317+0000 7fc045600640 1 -- 172.21.15.100:0/677677789 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 682442083 0 0) 0x7fc048150190 con 0x7fc04814fdb0 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.318+0000 7fc047400640 1 --2- 172.21.15.100:0/677677789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc04815cfc0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc04806be40 tx=0x7fc04002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a080b58c425d6a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.318+0000 7fc045600640 1 -- 172.21.15.100:0/677677789 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04002cc80 con 0x7fc048153120 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.318+0000 7fc045600640 1 -- 172.21.15.100:0/677677789 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04002cde0 con 0x7fc048153120 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.318+0000 7fc045600640 1 -- 172.21.15.100:0/677677789 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc040034660 con 0x7fc048153120 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 -- 172.21.15.100:0/677677789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 msgr2=0x7fc04815cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 --2- 172.21.15.100:0/677677789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc04815cfc0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fc04806be40 tx=0x7fc04002bed0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 -- 172.21.15.100:0/677677789 shutdown_connections 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 --2- 172.21.15.100:0/677677789 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc04815cfc0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 --2- 172.21.15.100:0/677677789 >> v2:172.21.15.110:3300/0 conn(0x7fc0480c3460 0x7fc048152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 -- 172.21.15.100:0/677677789 >> 172.21.15.100:0/677677789 conn(0x7fc0480c2940 msgr2=0x7fc0480c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 -- 172.21.15.100:0/677677789 shutdown_connections 2024-01-20T08:13:55.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.319+0000 7fc04de00640 1 -- 172.21.15.100:0/677677789 wait complete. 2024-01-20T08:13:55.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.320+0000 7fc04de00640 1 Processor -- start 2024-01-20T08:13:55.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 -- start start 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 0x7fc0481e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc04814fdb0 0x7fc048070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0481e8780 con 0x7fc048153120 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc048153b30 con 0x7fc0480c3460 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.321+0000 7fc04de00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc048153e10 con 0x7fc04814fdb0 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38962/0 (socket says 172.21.15.100:38962) 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 -- 172.21.15.100:0/1171902289 learned_addr learned my addr 172.21.15.100:0/1171902289 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc046a00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 0x7fc0481e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 -- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc04814fdb0 msgr2=0x7fc048070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc046000640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc04814fdb0 0x7fc048070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc04814fdb0 0x7fc048070c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 -- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 msgr2=0x7fc0481e8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 0x7fc0481e8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc047400640 1 -- 172.21.15.100:0/1171902289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009a70 con 0x7fc048153120 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.322+0000 7fc046a00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 0x7fc0481e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc047400640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc040009e80 tx=0x7fc040004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04003e610 con 0x7fc048153120 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04003e770 con 0x7fc048153120 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04003eb60 con 0x7fc048153120 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc048149a30 con 0x7fc048153120 2024-01-20T08:13:55.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.323+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0480711d0 con 0x7fc048153120 2024-01-20T08:13:55.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.324+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc048149f50 con 0x7fc048153120 2024-01-20T08:13:55.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.325+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc04003b050 con 0x7fc048153120 2024-01-20T08:13:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.326+0000 7fc03f400640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 0x7fc02006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.326+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6565+0+0 (secure 0 0 0) 0x7fc0400ac3b0 con 0x7fc048153120 2024-01-20T08:13:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.326+0000 7fc046a00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 0x7fc02006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.327+0000 7fc046a00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 0x7fc02006d390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:55.333 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.330+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc048149f50 con 0x7fc048153120 2024-01-20T08:13:55.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.561+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc048149f50 con 0x7fc048153120 2024-01-20T08:13:55.564 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.562+0000 7fc03f400640 1 -- 172.21.15.100:0/1171902289 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fc048149f50 con 0x7fc048153120 2024-01-20T08:13:55.564 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:13:55.565 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:13:55.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 msgr2=0x7fc02006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 0x7fc02006d390 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc038000f60 tx=0x7fc038009040 comp rx=0 tx=0).stop 2024-01-20T08:13:55.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 msgr2=0x7fc048148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:55.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7fc040009e80 tx=0x7fc040004a40 comp rx=0 tx=0).stop 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 shutdown_connections 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc048153120 0x7fc048148bc0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc02006aed0 0x7fc02006d390 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc04814fdb0 0x7fc048070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 --2- 172.21.15.100:0/1171902289 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0480c3460 0x7fc0481e8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.564+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 >> 172.21.15.100:0/1171902289 conn(0x7fc0480c2940 msgr2=0x7fc0480c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.565+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 shutdown_connections 2024-01-20T08:13:55.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:55.565+0000 7fc04de00640 1 -- 172.21.15.100:0/1171902289 wait complete. 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-01-20T08:13:55.586 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:55.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.587 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:13:55.644 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:13:55.644 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:13:55.644 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:13:55.644 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:55.645 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42412sec preferred_lft 42412sec 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:13:55.646 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:13:55.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.648 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:13:55.741 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:13:55.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.746 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:13:55.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.798 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:13:55.799 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:13:55.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:13:55.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:13:55.799 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:13:55.799 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:13:55.974 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:55.975 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:13:56.025 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:13:56.026 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:56.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:13:56.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:56.120 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:56.170 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:13:56.170 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:13:56.170 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:56.218 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs2=/ 2024-01-20T08:13:56.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.218 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:56.351 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:56.351 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:56.389 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:13:56.389 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:13:56.389 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:13:56.389 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: 1@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:13:56.389 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:13:56.393 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:13:56.393 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:13:56.393 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:13:56.393 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:13:56.393 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:13:56.399 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:13:56.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.400 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:56.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.490 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:13:56.565 INFO:teuthology.orchestra.run.smithi110.stdout:client6837 2024-01-20T08:13:56.565 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:56.565 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:56.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.614 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir /home/ubuntu/cephtest/mnt.0/testdir) 2024-01-20T08:13:56.682 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:56.682 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/home/ubuntu/cephtest/mnt.0/testdir/testfile 2024-01-20T08:13:56.747 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs" at path "/home/ubuntu/cephtest/mnt.0/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:13:56.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:13:56.747 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec mkdir /home/ubuntu/cephtest/mnt.1/testdir) 2024-01-20T08:13:56.821 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:13:56.821 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/home/ubuntu/cephtest/mnt.1/testdir/testfile 2024-01-20T08:13:56.884 INFO:tasks.cephfs.caps_helper:Test file has been created on FS "cephfs2" at path "/home/ubuntu/cephtest/mnt.1/testdir/testfile" with the following data - self.path = /home/ubuntu/cephtest/mnt.1/testdir/testfile cephfs_name = cephfs2 cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:13:56.884 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth add client.testuser mon 'allow r' osd 'allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2' mds 'allow r fsname=cephfs, allow r fsname=cephfs2' 2024-01-20T08:13:57.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.102+0000 7f81a1400640 1 Processor -- start 2024-01-20T08:13:57.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.102+0000 7f81a1400640 1 -- start start 2024-01-20T08:13:57.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.104+0000 7f81a1400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f819c14e830 0x7f819c154980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.104+0000 7f81a1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.104+0000 7f81a1400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f819c06b4c0 con 0x7f819c0c7120 2024-01-20T08:13:57.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.104+0000 7f81a1400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f819c06b220 con 0x7f819c14e830 2024-01-20T08:13:57.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.104+0000 7f81a1400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c154ec0 con 0x7f819c06cb50 2024-01-20T08:13:57.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.105+0000 7f819a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f819c14e830 0x7f819c154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.105+0000 7f819a800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f819c14e830 0x7f819c154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:37804/0 (socket says 172.21.15.100:37804) 2024-01-20T08:13:57.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.105+0000 7f819a800640 1 -- 172.21.15.100:0/1478850007 learned_addr learned my addr 172.21.15.100:0/1478850007 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:57.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.105+0000 7f8199e00640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.105+0000 7f819a800640 1 -- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 msgr2=0x7f819c0c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.106+0000 7f819a800640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.106+0000 7f819a800640 1 -- 172.21.15.100:0/1478850007 >> v1:172.21.15.110:6789/0 conn(0x7f819c0c7120 legacy=0x7f819c06b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.106+0000 7f819a800640 1 -- 172.21.15.100:0/1478850007 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c155120 con 0x7f819c14e830 2024-01-20T08:13:57.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.108+0000 7f819a800640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c154980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f818c009870 tx=0x7f818c02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0bb39acc4a5aa04 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.109+0000 7f8199400640 1 -- 172.21.15.100:0/1478850007 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c031640 con 0x7f819c14e830 2024-01-20T08:13:57.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.109+0000 7f8199400640 1 -- 172.21.15.100:0/1478850007 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818c0317a0 con 0x7f819c14e830 2024-01-20T08:13:57.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.109+0000 7f8199400640 1 -- 172.21.15.100:0/1478850007 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818c031b30 con 0x7f819c14e830 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 -- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 msgr2=0x7f819c154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c154980 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f818c009870 tx=0x7f818c02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 -- 172.21.15.100:0/1478850007 shutdown_connections 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 --2- 172.21.15.100:0/1478850007 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c154980 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 -- 172.21.15.100:0/1478850007 >> 172.21.15.100:0/1478850007 conn(0x7f819c0abd20 msgr2=0x7f819c0ac100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:57.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 -- 172.21.15.100:0/1478850007 shutdown_connections 2024-01-20T08:13:57.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.110+0000 7f81a1400640 1 -- 172.21.15.100:0/1478850007 wait complete. 2024-01-20T08:13:57.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.112+0000 7f81a1400640 1 Processor -- start 2024-01-20T08:13:57.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.113+0000 7f81a1400640 1 -- start start 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c0bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c1ee2f0 con 0x7f819c0c7120 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0acd00 con 0x7f819c14e830 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.114+0000 7f81a1400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819c0be780 con 0x7f819c06cb50 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.115+0000 7f8199e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.115+0000 7f8199e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38964/0 (socket says 172.21.15.100:38964) 2024-01-20T08:13:57.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.115+0000 7f8199e00640 1 -- 172.21.15.100:0/3186286370 learned_addr learned my addr 172.21.15.100:0/3186286370 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:57.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.115+0000 7f819a800640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.115+0000 7f819b200640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c0bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 -- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 msgr2=0x7f819c0bdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0bdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 -- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 msgr2=0x7f819c0bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c0bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 -- 172.21.15.100:0/3186286370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f818c0094d0 con 0x7f819c0c7120 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8199e00640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f818400e9b0 tx=0x7f818400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8184009670 con 0x7f819c0c7120 2024-01-20T08:13:57.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f818400c9a0 con 0x7f819c0c7120 2024-01-20T08:13:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f818400cd50 con 0x7f819c0c7120 2024-01-20T08:13:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.116+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f819c0af920 con 0x7f819c0c7120 2024-01-20T08:13:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.117+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f819c0be480 con 0x7f819c0c7120 2024-01-20T08:13:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.118+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f819c067d50 con 0x7f819c0c7120 2024-01-20T08:13:57.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.119+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8184013470 con 0x7f819c0c7120 2024-01-20T08:13:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.120+0000 7f8192a00640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.120+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f8184089b00 con 0x7f819c0c7120 2024-01-20T08:13:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.120+0000 7f819a800640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.120+0000 7f819a800640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 0x7f817406d390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f818c036000 tx=0x7f818c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.124+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f818408be60 con 0x7f819c0c7120 2024-01-20T08:13:57.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.391+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]} v 0) v1 -- 0x7f819c0c80d0 con 0x7f819c0c7120 2024-01-20T08:13:57.398 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.395+0000 7f8192a00640 1 -- 172.21.15.100:0/3186286370 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth add", "entity": "client.testuser", "caps": ["mon", "allow r", "osd", "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2", "mds", "allow r fsname=cephfs, allow r fsname=cephfs2"]}]=0 added key for client.testuser v20) v1 ==== 272+0+0 (secure 0 0 0) 0x7f8184017130 con 0x7f819c0c7120 2024-01-20T08:13:57.399 INFO:teuthology.orchestra.run.smithi100.stderr:added key for client.testuser 2024-01-20T08:13:57.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 msgr2=0x7f817406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 0x7f817406d390 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f818c036000 tx=0x7f818c03c040 comp rx=0 tx=0).stop 2024-01-20T08:13:57.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 msgr2=0x7f819c0c1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f818400e9b0 tx=0x7f818400ee70 comp rx=0 tx=0).stop 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 shutdown_connections 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f819c14e830 0x7f819c0bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f819c0c7120 0x7f819c0c1460 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f817406aed0 0x7f817406d390 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 --2- 172.21.15.100:0/3186286370 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f819c06cb50 0x7f819c0bdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 >> 172.21.15.100:0/3186286370 conn(0x7f819c0abd20 msgr2=0x7f819c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 shutdown_connections 2024-01-20T08:13:57.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.399+0000 7f81a1400640 1 -- 172.21.15.100:0/3186286370 wait complete. 2024-01-20T08:13:57.422 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.testuser 2024-01-20T08:13:57.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.622+0000 7f9869e00640 1 Processor -- start 2024-01-20T08:13:57.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.622+0000 7f9869e00640 1 -- start start 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9869e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98640c3460 0x7f9864152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9869e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f986415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9869e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9864150190 con 0x7f986414fdb0 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9869e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98640a9ce0 con 0x7f98640c3460 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9869e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98640a93b0 con 0x7f9864153120 2024-01-20T08:13:57.627 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9862a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f986414fdb0 0x7f98640c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39472/0 (socket says 172.21.15.100:39472) 2024-01-20T08:13:57.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.624+0000 7f9862a00640 1 -- 172.21.15.100:0/1829146887 learned_addr learned my addr 172.21.15.100:0/1829146887 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:57.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9859e00640 1 --2- 172.21.15.100:0/1829146887 >> v2:172.21.15.110:3300/0 conn(0x7f98640c3460 0x7f9864152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029824016 0 0) 0x7f9864150190 con 0x7f986414fdb0 2024-01-20T08:13:57.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9863400640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f986415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9844003520 con 0x7f986414fdb0 2024-01-20T08:13:57.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3774887120 0 0) 0x7f9844003520 con 0x7f986414fdb0 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 msgr2=0x7f986415cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f986415cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 >> v2:172.21.15.110:3300/0 conn(0x7f98640c3460 msgr2=0x7f9864152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 --2- 172.21.15.100:0/1829146887 >> v2:172.21.15.110:3300/0 conn(0x7f98640c3460 0x7f9864152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98641535b0 con 0x7f986414fdb0 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f9854001670 con 0x7f986414fdb0 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 >> v1:172.21.15.100:6789/0 conn(0x7f986414fdb0 legacy=0x7f98640c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f9844003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9844003ef0 0x7f98440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9844004d00 0x7f9844005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98640a93b0 con 0x7f9844003ef0 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984400b980 con 0x7f9844004d00 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.625+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984400bb10 con 0x7f9864153120 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9844003ef0 0x7f98440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9862a00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f9844003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9863400640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9844004d00 0x7f9844005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 -- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 msgr2=0x7f9844003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f9844003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 -- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9844004d00 msgr2=0x7f9844005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9844004d00 0x7f9844005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9859e00640 1 -- 172.21.15.100:0/1829146887 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9844003520 con 0x7f9844003ef0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9862a00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9864153120 0x7f9844003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.626+0000 7f9863400640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9844004d00 0x7f9844005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.627+0000 7f9859e00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9844003ef0 0x7f98440047c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f984c009ac0 tx=0x7f98440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9707ca1aa4ebed4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.627+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c02c710 con 0x7f9844003ef0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.627+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c02c870 con 0x7f9844003ef0 2024-01-20T08:13:57.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.627+0000 7f9862000640 1 -- 172.21.15.100:0/1829146887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c02cc00 con 0x7f9844003ef0 2024-01-20T08:13:57.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 -- 172.21.15.100:0/1829146887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9844003ef0 msgr2=0x7f98440047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 --2- 172.21.15.100:0/1829146887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9844003ef0 0x7f98440047c0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f984c009ac0 tx=0x7f98440057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9863400640 1 -- 172.21.15.100:0/1829146887 reap_dead start 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 -- 172.21.15.100:0/1829146887 shutdown_connections 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 -- 172.21.15.100:0/1829146887 >> 172.21.15.100:0/1829146887 conn(0x7f98640c2940 msgr2=0x7f98640c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 -- 172.21.15.100:0/1829146887 shutdown_connections 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.628+0000 7f9869e00640 1 -- 172.21.15.100:0/1829146887 wait complete. 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.630+0000 7f9869e00640 1 Processor -- start 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.630+0000 7f9869e00640 1 -- start start 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9844003ef0 0x7f986414b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986414b710 0x7f98641eb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986414ad40 con 0x7f98641541d0 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986414aa30 con 0x7f986414b710 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9869e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98641ec420 con 0x7f9844003ef0 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9863400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9863400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:38980/0 (socket says 172.21.15.100:38980) 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9863400640 1 -- 172.21.15.100:0/1249875192 learned_addr learned my addr 172.21.15.100:0/1249875192 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9859e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986414b710 0x7f98641eb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.631+0000 7f9862a00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9844003ef0 0x7f986414b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 -- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9844003ef0 msgr2=0x7f986414b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.637 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9844003ef0 0x7f986414b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 -- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986414b710 msgr2=0x7f98641eb9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986414b710 0x7f98641eb9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 -- 172.21.15.100:0/1249875192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986414c900 con 0x7f98641541d0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9863400640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f986406fe10 tx=0x7f985c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c007d20 con 0x7f98641541d0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c014400 con 0x7f98641541d0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985c007ea0 con 0x7f98641541d0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986414cbe0 con 0x7f98641541d0 2024-01-20T08:13:57.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.632+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986414bc40 con 0x7f98641541d0 2024-01-20T08:13:57.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.634+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f986414aeb0 con 0x7f98641541d0 2024-01-20T08:13:57.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.634+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f985c01d3b0 con 0x7f98641541d0 2024-01-20T08:13:57.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.636+0000 7f985be00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 0x7f983c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:57.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.636+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f985c089490 con 0x7f98641541d0 2024-01-20T08:13:57.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.636+0000 7f9862a00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 0x7f983c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:57.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.637+0000 7f9862a00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 0x7f983c06d3c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9854001eb0 tx=0x7f9854009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:57.643 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.640+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f985c054070 con 0x7f98641541d0 2024-01-20T08:13:57.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.900+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.testuser"} v 0) v1 -- 0x7f986404e970 con 0x7f98641541d0 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.901+0000 7f985be00640 1 -- 172.21.15.100:0/1249875192 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.testuser"}]=0 v20) v1 ==== 85+0+226 (secure 0 0 0) 0x7f985c057690 con 0x7f98641541d0 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stdout:[client.testuser] 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stdout: key = AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg== 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stdout: caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stdout: caps mon = "allow r" 2024-01-20T08:13:57.904 INFO:teuthology.orchestra.run.smithi100.stdout: caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-20T08:13:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 msgr2=0x7f983c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 0x7f983c06d3c0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9854001eb0 tx=0x7f9854009040 comp rx=0 tx=0).stop 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 msgr2=0x7f98641ebee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f986406fe10 tx=0x7f985c009cd0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 shutdown_connections 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98641541d0 0x7f98641ebee0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f986414b710 0x7f98641eb9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f983c06af00 0x7f983c06d3c0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 --2- 172.21.15.100:0/1249875192 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9844003ef0 0x7f986414b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 >> 172.21.15.100:0/1249875192 conn(0x7f98640c2940 msgr2=0x7f9864141d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 shutdown_connections 2024-01-20T08:13:57.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:57.904+0000 7f9869e00640 1 -- 172.21.15.100:0/1249875192 wait complete. 2024-01-20T08:13:57.926 INFO:tasks.cephfs.test_multifs_auth:keyring generated for testing is - [client.testuser] key = AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-20T08:13:57.926 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:13:57.975 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.kfx9ED9Cia 2024-01-20T08:13:57.975 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:57.975 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/tmp/tmp.kfx9ED9Cia 2024-01-20T08:13:58.069 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:58.069 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:58.164 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:13:58.164 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:13:58.210 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:13:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.463+0000 7f5a94800640 1 Processor -- start 2024-01-20T08:13:58.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.463+0000 7f5a94800640 1 -- start start 2024-01-20T08:13:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.464+0000 7f5a94800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a8c147f20 0x7f5a8c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.464+0000 7f5a94800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c0c1670 con 0x7f5a8c070370 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.464+0000 7f5a94800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a8c070800 con 0x7f5a8c151f60 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.464+0000 7f5a94800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8c0c2210 con 0x7f5a8c147f20 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a91e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5a8c147f20 0x7f5a8c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a92800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5a8c070370 0x7f5a8c0c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39474/0 (socket says 172.21.15.100:39474) 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a92800640 1 -- 172.21.15.100:0/1922261875 learned_addr learned my addr 172.21.15.100:0/1922261875 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:58.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a91e00640 1 -- 172.21.15.100:0/1922261875 >> v1:172.21.15.110:6789/0 conn(0x7f5a8c151f60 legacy=0x7f5a8c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a90a00640 1 -- 172.21.15.100:0/1922261875 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900393950 0 0) 0x7f5a8c0c1670 con 0x7f5a8c070370 2024-01-20T08:13:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a91e00640 1 -- 172.21.15.100:0/1922261875 >> v1:172.21.15.100:6789/0 conn(0x7f5a8c070370 legacy=0x7f5a8c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.465+0000 7f5a91e00640 1 -- 172.21.15.100:0/1922261875 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8c0c0d40 con 0x7f5a8c147f20 2024-01-20T08:13:58.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a91e00640 1 --2- 172.21.15.100:0/1922261875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c0abfd0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009d90 tx=0x7f5a7c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b061bbdeff7a2e3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a90a00640 1 -- 172.21.15.100:0/1922261875 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c02cc60 con 0x7f5a8c147f20 2024-01-20T08:13:58.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a90a00640 1 -- 172.21.15.100:0/1922261875 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c02cdc0 con 0x7f5a8c147f20 2024-01-20T08:13:58.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a90a00640 1 -- 172.21.15.100:0/1922261875 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c034660 con 0x7f5a8c147f20 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a94800640 1 -- 172.21.15.100:0/1922261875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 msgr2=0x7f5a8c0abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.467+0000 7f5a94800640 1 --2- 172.21.15.100:0/1922261875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c0abfd0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c009d90 tx=0x7f5a7c02beb0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.468+0000 7f5a94800640 1 -- 172.21.15.100:0/1922261875 shutdown_connections 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.468+0000 7f5a94800640 1 --2- 172.21.15.100:0/1922261875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c0abfd0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.468+0000 7f5a94800640 1 -- 172.21.15.100:0/1922261875 >> 172.21.15.100:0/1922261875 conn(0x7f5a8c06a5e0 msgr2=0x7f5a8c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.468+0000 7f5a94800640 1 -- 172.21.15.100:0/1922261875 shutdown_connections 2024-01-20T08:13:58.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.468+0000 7f5a94800640 1 -- 172.21.15.100:0/1922261875 wait complete. 2024-01-20T08:13:58.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.469+0000 7f5a94800640 1 Processor -- start 2024-01-20T08:13:58.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.469+0000 7f5a94800640 1 -- start start 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 0x7f5a8c1eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c151f60 0x7f5a8c142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1eaa60 con 0x7f5a8c147f20 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c14b910 con 0x7f5a8c070370 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.470+0000 7f5a94800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8c1ebfd0 con 0x7f5a8c151f60 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39002/0 (socket says 172.21.15.100:39002) 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 -- 172.21.15.100:0/2294637506 learned_addr learned my addr 172.21.15.100:0/2294637506 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91e00640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 0x7f5a8c1eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 -- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c151f60 msgr2=0x7f5a8c142550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a92800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c151f60 0x7f5a8c142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c151f60 0x7f5a8c142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.475 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 -- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 msgr2=0x7f5a8c1eb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 0x7f5a8c1eb0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 -- 172.21.15.100:0/2294637506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a7c009a70 con 0x7f5a8c147f20 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91e00640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 0x7f5a8c1eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.471+0000 7f5a91400640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400b3f0 tx=0x7f5a7400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.472+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011830 con 0x7f5a8c147f20 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.472+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a74011990 con 0x7f5a8c147f20 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.472+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a74011d40 con 0x7f5a8c147f20 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.472+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8c1eacb0 con 0x7f5a8c147f20 2024-01-20T08:13:58.476 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.472+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8c14c3a0 con 0x7f5a8c147f20 2024-01-20T08:13:58.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.473+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8c1ebb50 con 0x7f5a8c147f20 2024-01-20T08:13:58.477 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.474+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5a7401a400 con 0x7f5a8c147f20 2024-01-20T08:13:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.475+0000 7f5a8a000640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.475+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f5a74089740 con 0x7f5a8c147f20 2024-01-20T08:13:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.475+0000 7f5a91e00640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.478 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.476+0000 7f5a91e00640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c036000 tx=0x7f5a7c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.482 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.479+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5a8c1ebb50 con 0x7f5a8c147f20 2024-01-20T08:13:58.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.678+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5a8c1ebb50 con 0x7f5a8c147f20 2024-01-20T08:13:58.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.680+0000 7f5a8a000640 1 -- 172.21.15.100:0/2294637506 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f5a8c1ebb50 con 0x7f5a8c147f20 2024-01-20T08:13:58.683 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:13:58.684 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 msgr2=0x7f5a6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c036000 tx=0x7f5a7c030000 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 msgr2=0x7f5a8c1eb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f5a7400b3f0 tx=0x7f5a7400b8b0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 shutdown_connections 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5a6406aed0 0x7f5a6406d390 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a8c151f60 0x7f5a8c142550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a8c147f20 0x7f5a8c1eb610 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 --2- 172.21.15.100:0/2294637506 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a8c070370 0x7f5a8c1eb0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 >> 172.21.15.100:0/2294637506 conn(0x7f5a8c06a5e0 msgr2=0x7f5a8c0c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 shutdown_connections 2024-01-20T08:13:58.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.683+0000 7f5a94800640 1 -- 172.21.15.100:0/2294637506 wait complete. 2024-01-20T08:13:58.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:13:58.706 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:13:58.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.911+0000 7f0c91600640 1 Processor -- start 2024-01-20T08:13:58.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.911+0000 7f0c91600640 1 -- start start 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c91600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0c8c151e40 0x7f0c8c0c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c91600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c8c06b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c91600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0c9f30 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c91600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c8c06c5a0 con 0x7f0c8c151e40 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c91600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0c87a0 con 0x7f0c8c155290 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c83e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0c8c0c4a50 0x7f0c8c155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:39476/0 (socket says 172.21.15.100:39476) 2024-01-20T08:13:58.916 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c83e00640 1 -- 172.21.15.100:0/1201014097 learned_addr learned my addr 172.21.15.100:0/1201014097 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c8b400640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c8c06b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.918 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1201014097 >> v2:172.21.15.110:3300/0 conn(0x7f0c8c151e40 0x7f0c8c0c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.913+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144380331 0 0) 0x7f0c74001110 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c6c003520 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1318423163 0 0) 0x7f0c6c003520 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 msgr2=0x7f0c8c06b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c8c06b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 >> v2:172.21.15.110:3300/0 conn(0x7f0c8c151e40 msgr2=0x7f0c8c0c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 --2- 172.21.15.100:0/1201014097 >> v2:172.21.15.110:3300/0 conn(0x7f0c8c151e40 0x7f0c8c0c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c156410 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f0c74001800 con 0x7f0c8c0c4a50 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 >> v1:172.21.15.100:6789/0 conn(0x7f0c8c0c4a50 legacy=0x7f0c8c155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c003970 0x7f0c6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6c004d00 0x7f0c6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.919 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c06c5a0 con 0x7f0c6c003970 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0c87a0 con 0x7f0c6c004d00 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c00b9b0 con 0x7f0c8c155290 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.914+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c003970 0x7f0c6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c83e00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c8aa00640 1 -- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 msgr2=0x7f0c6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c8aa00640 1 -- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6c004d00 msgr2=0x7f0c6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c6c004d00 0x7f0c6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c8aa00640 1 -- 172.21.15.100:0/1201014097 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c003520 con 0x7f0c6c003970 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.915+0000 7f0c83e00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c8c155290 0x7f0c6c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:58.920 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.916+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c003970 0x7f0c6c003d90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009ac0 tx=0x7f0c6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4626aeee12b3a95a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.916+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c02c710 con 0x7f0c6c003970 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.916+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7c02c870 con 0x7f0c6c003970 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.916+0000 7f0c8a000640 1 -- 172.21.15.100:0/1201014097 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c02cc00 con 0x7f0c6c003970 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 -- 172.21.15.100:0/1201014097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c003970 msgr2=0x7f0c6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 --2- 172.21.15.100:0/1201014097 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c6c003970 0x7f0c6c003d90 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c009ac0 tx=0x7f0c6c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c8b400640 1 -- 172.21.15.100:0/1201014097 reap_dead start 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 -- 172.21.15.100:0/1201014097 shutdown_connections 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 -- 172.21.15.100:0/1201014097 >> 172.21.15.100:0/1201014097 conn(0x7f0c8c0abde0 msgr2=0x7f0c8c0ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 -- 172.21.15.100:0/1201014097 shutdown_connections 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.917+0000 7f0c91600640 1 -- 172.21.15.100:0/1201014097 wait complete. 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.919+0000 7f0c91600640 1 Processor -- start 2024-01-20T08:13:58.922 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.919+0000 7f0c91600640 1 -- start start 2024-01-20T08:13:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c6c003970 0x7f0c8c14e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.924 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c8c14b610 0x7f0c8c1ed790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c1eaf40 con 0x7f0c8c1542d0 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c14ba90 con 0x7f0c8c14b610 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c91600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c14f9e0 con 0x7f0c6c003970 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:39026/0 (socket says 172.21.15.100:39026) 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 -- 172.21.15.100:0/1936155590 learned_addr learned my addr 172.21.15.100:0/1936155590 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c6c003970 0x7f0c8c14e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 -- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c6c003970 msgr2=0x7f0c8c14e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c6c003970 0x7f0c8c14e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 -- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c8c14b610 msgr2=0x7f0c8c1ed790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c8c14b610 0x7f0c8c1ed790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.920+0000 7f0c83e00640 1 -- 172.21.15.100:0/1936155590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c1eac60 con 0x7f0c8c1542d0 2024-01-20T08:13:58.925 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c83e00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400d820 tx=0x7f0c7400dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740074e0 con 0x7f0c8c1542d0 2024-01-20T08:13:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c74007640 con 0x7f0c8c1542d0 2024-01-20T08:13:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740049e0 con 0x7f0c8c1542d0 2024-01-20T08:13:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c1533b0 con 0x7f0c8c1542d0 2024-01-20T08:13:58.926 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.921+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c153970 con 0x7f0c8c1542d0 2024-01-20T08:13:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.922+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c153210 con 0x7f0c8c1542d0 2024-01-20T08:13:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.923+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0c74004b40 con 0x7f0c8c1542d0 2024-01-20T08:13:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.924+0000 7f0c82a00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 0x7f0c6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.924+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f0c74089400 con 0x7f0c8c1542d0 2024-01-20T08:13:58.927 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.924+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 0x7f0c6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:58.928 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.925+0000 7f0c8aa00640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 0x7f0c6406d390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c036000 tx=0x7f0c7c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:58.931 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:58.929+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0c8c153210 con 0x7f0c8c1542d0 2024-01-20T08:13:59.132 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.129+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0c8c0c9f30 con 0x7f0c8c1542d0 2024-01-20T08:13:59.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.132+0000 7f0c82a00640 1 -- 172.21.15.100:0/1936155590 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0c8c0c9f30 con 0x7f0c8c1542d0 2024-01-20T08:13:59.135 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:13:59.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 msgr2=0x7f0c6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 0x7f0c6406d390 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c036000 tx=0x7f0c7c030000 comp rx=0 tx=0).stop 2024-01-20T08:13:59.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 msgr2=0x7f0c8c14b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f0c7400d820 tx=0x7f0c7400dce0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 shutdown_connections 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0c8c14b610 0x7f0c8c1ed790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0c8c1542d0 0x7f0c8c14b0d0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0c6406aed0 0x7f0c6406d390 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 --2- 172.21.15.100:0/1936155590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0c6c003970 0x7f0c8c14e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 >> 172.21.15.100:0/1936155590 conn(0x7f0c8c0abde0 msgr2=0x7f0c8c150ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.135+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 shutdown_connections 2024-01-20T08:13:59.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.136+0000 7f0c91600640 1 -- 172.21.15.100:0/1936155590 wait complete. 2024-01-20T08:13:59.157 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:13:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.366+0000 7fcf44a00640 1 Processor -- start 2024-01-20T08:13:59.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.366+0000 7fcf44a00640 1 -- start start 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.367+0000 7fcf44a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 0x7fcf3c153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf44a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0ab620 con 0x7fcf3c0ab0b0 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf44a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c0ab900 con 0x7fcf3c0715a0 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf44a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c14cb30 con 0x7fcf3c14c750 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf41600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcf3c0ab0b0 0x7fcf3c0a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40320/0 (socket says 172.21.15.100:40320) 2024-01-20T08:13:59.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf41600640 1 -- 172.21.15.100:0/3774645859 learned_addr learned my addr 172.21.15.100:0/3774645859 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.368+0000 7fcf42000640 1 --2- 172.21.15.100:0/3774645859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 0x7fcf3c153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4096780352 0 0) 0x7fcf3c0ab620 con 0x7fcf3c0ab0b0 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf1c003520 con 0x7fcf3c0ab0b0 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1206802291 0 0) 0x7fcf1c003520 con 0x7fcf3c0ab0b0 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf42000640 1 -- 172.21.15.100:0/3774645859 >> v1:172.21.15.110:6789/0 conn(0x7fcf3c0715a0 legacy=0x7fcf3c071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf42000640 1 -- 172.21.15.100:0/3774645859 >> v1:172.21.15.100:6789/0 conn(0x7fcf3c0ab0b0 legacy=0x7fcf3c0a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.369+0000 7fcf42000640 1 -- 172.21.15.100:0/3774645859 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0abbe0 con 0x7fcf3c14c750 2024-01-20T08:13:59.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.370+0000 7fcf42000640 1 --2- 172.21.15.100:0/3774645859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 0x7fcf3c153190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097d0 tx=0x7fcf2c02b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f0f8e79b0686140 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.371+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24001670 con 0x7fcf3c14c750 2024-01-20T08:13:59.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.371+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c02e050 con 0x7fcf3c14c750 2024-01-20T08:13:59.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.371+0000 7fcf40c00640 1 -- 172.21.15.100:0/3774645859 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c030730 con 0x7fcf3c14c750 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 -- 172.21.15.100:0/3774645859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 msgr2=0x7fcf3c153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 --2- 172.21.15.100:0/3774645859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 0x7fcf3c153190 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0097d0 tx=0x7fcf2c02b800 comp rx=0 tx=0).stop 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 -- 172.21.15.100:0/3774645859 shutdown_connections 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 --2- 172.21.15.100:0/3774645859 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c14c750 0x7fcf3c153190 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 -- 172.21.15.100:0/3774645859 >> 172.21.15.100:0/3774645859 conn(0x7fcf3c0c6090 msgr2=0x7fcf3c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 -- 172.21.15.100:0/3774645859 shutdown_connections 2024-01-20T08:13:59.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.372+0000 7fcf44a00640 1 -- 172.21.15.100:0/3774645859 wait complete. 2024-01-20T08:13:59.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.374+0000 7fcf44a00640 1 Processor -- start 2024-01-20T08:13:59.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.374+0000 7fcf44a00640 1 -- start start 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.374+0000 7fcf44a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf3c0715a0 0x7fcf3c151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf44a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c0ab0b0 0x7fcf3c06d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf44a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf44a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c06df00 con 0x7fcf3c14c750 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf44a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c147c60 con 0x7fcf3c0715a0 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf44a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c147980 con 0x7fcf3c0ab0b0 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42550/0 (socket says 172.21.15.100:42550) 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 -- 172.21.15.100:0/2958471145 learned_addr learned my addr 172.21.15.100:0/2958471145 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:59.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf41600640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c0ab0b0 0x7fcf3c06d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42000640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf3c0715a0 0x7fcf3c151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 -- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c0ab0b0 msgr2=0x7fcf3c06d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c0ab0b0 0x7fcf3c06d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 -- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf3c0715a0 msgr2=0x7fcf3c151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf3c0715a0 0x7fcf3c151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.375+0000 7fcf42a00640 1 -- 172.21.15.100:0/2958471145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009400 con 0x7fcf3c14c750 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf42a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c6b0 tx=0x7fcf3400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34003b70 con 0x7fcf3c14c750 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf34003cf0 con 0x7fcf3c14c750 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34003ea0 con 0x7fcf3c14c750 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c1494a0 con 0x7fcf3c14c750 2024-01-20T08:13:59.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.376+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c149a60 con 0x7fcf3c14c750 2024-01-20T08:13:59.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.378+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0c4df0 con 0x7fcf3c14c750 2024-01-20T08:13:59.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.379+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fcf34005310 con 0x7fcf3c14c750 2024-01-20T08:13:59.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.380+0000 7fcf3a000640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 0x7fcf1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.382 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.380+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fcf340896a0 con 0x7fcf3c14c750 2024-01-20T08:13:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.380+0000 7fcf42000640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 0x7fcf1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.381+0000 7fcf42000640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 0x7fcf1406d390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c034000 tx=0x7fcf2c008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.384+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fcf34054280 con 0x7fcf3c14c750 2024-01-20T08:13:59.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.577+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf3c04ea50 con 0x7fcf3c14c750 2024-01-20T08:13:59.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.577+0000 7fcf3a000640 1 -- 172.21.15.100:0/2958471145 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf340578a0 con 0x7fcf3c14c750 2024-01-20T08:13:59.580 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:13:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 msgr2=0x7fcf1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 0x7fcf1406d390 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c034000 tx=0x7fcf2c008030 comp rx=0 tx=0).stop 2024-01-20T08:13:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 msgr2=0x7fcf3c06d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400c6b0 tx=0x7fcf3400cb70 comp rx=0 tx=0).stop 2024-01-20T08:13:59.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 shutdown_connections 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcf3c14c750 0x7fcf3c06d8f0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcf1406aed0 0x7fcf1406d390 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcf3c0ab0b0 0x7fcf3c06d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 --2- 172.21.15.100:0/2958471145 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcf3c0715a0 0x7fcf3c151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 >> 172.21.15.100:0/2958471145 conn(0x7fcf3c0c6090 msgr2=0x7fcf3c0c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 shutdown_connections 2024-01-20T08:13:59.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.580+0000 7fcf44a00640 1 -- 172.21.15.100:0/2958471145 wait complete. 2024-01-20T08:13:59.602 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:13:59.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.801+0000 7f83c7800640 1 Processor -- start 2024-01-20T08:13:59.804 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.801+0000 7f83c7800640 1 -- start start 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.802+0000 7f83c7800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f83c014fdb0 0x7f83c00c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.802+0000 7f83c7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c1d90 0x7f83c0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c7800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83c00c3460 0x7f83c0153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c7800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00a9ce0 con 0x7f83c00c3460 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c7800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83c00a93b0 con 0x7f83c014fdb0 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0152790 con 0x7f83c00c1d90 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83c00c3460 0x7f83c0153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c5800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f83c00c3460 0x7f83c0153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42564/0 (socket says 172.21.15.100:42564) 2024-01-20T08:13:59.806 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c5800640 1 -- 172.21.15.100:0/314188526 learned_addr learned my addr 172.21.15.100:0/314188526 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83c4e00640 1 --2- 172.21.15.100:0/314188526 >> v2:172.21.15.110:3300/0 conn(0x7f83c014fdb0 0x7f83c00c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.803+0000 7f83b7c00640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c1d90 0x7f83c0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.804+0000 7f83c5800640 1 -- 172.21.15.100:0/314188526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c1d90 msgr2=0x7f83c0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.804+0000 7f83c5800640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c1d90 0x7f83c0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.804+0000 7f83c5800640 1 -- 172.21.15.100:0/314188526 >> v2:172.21.15.110:3300/0 conn(0x7f83c014fdb0 msgr2=0x7f83c00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.804+0000 7f83c5800640 1 --2- 172.21.15.100:0/314188526 >> v2:172.21.15.110:3300/0 conn(0x7f83c014fdb0 0x7f83c00c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.807 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.804+0000 7f83c5800640 1 -- 172.21.15.100:0/314188526 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c0150190 con 0x7f83c00c3460 2024-01-20T08:13:59.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.805+0000 7f83c5800640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c00c3460 0x7f83c0153120 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f83c006e580 tx=0x7f83b80302f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115a073595b6c96a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.805+0000 7f83bfe00640 1 -- 172.21.15.100:0/314188526 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8030e90 con 0x7f83c00c3460 2024-01-20T08:13:59.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.805+0000 7f83bfe00640 1 -- 172.21.15.100:0/314188526 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b80383f0 con 0x7f83c00c3460 2024-01-20T08:13:59.808 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.805+0000 7f83bfe00640 1 -- 172.21.15.100:0/314188526 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8038780 con 0x7f83c00c3460 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 -- 172.21.15.100:0/314188526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c00c3460 msgr2=0x7f83c0153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c00c3460 0x7f83c0153120 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f83c006e580 tx=0x7f83b80302f0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 -- 172.21.15.100:0/314188526 shutdown_connections 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c00c3460 0x7f83c0153120 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 --2- 172.21.15.100:0/314188526 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c1d90 0x7f83c0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 --2- 172.21.15.100:0/314188526 >> v2:172.21.15.110:3300/0 conn(0x7f83c014fdb0 0x7f83c00c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.809 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 -- 172.21.15.100:0/314188526 >> 172.21.15.100:0/314188526 conn(0x7f83c00c2940 msgr2=0x7f83c00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:13:59.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 -- 172.21.15.100:0/314188526 shutdown_connections 2024-01-20T08:13:59.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.806+0000 7f83c7800640 1 -- 172.21.15.100:0/314188526 wait complete. 2024-01-20T08:13:59.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 Processor -- start 2024-01-20T08:13:59.810 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 -- start start 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 0x7f83c006da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 0x7f83c00c40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c0150590 con 0x7f83c014fdb0 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c00c1ad0 con 0x7f83c00c1d90 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c7800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83c01507e0 con 0x7f83c00c3460 2024-01-20T08:13:59.813 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c5800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42578/0 (socket says 172.21.15.100:42578) 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c5800640 1 -- 172.21.15.100:0/1899622472 learned_addr learned my addr 172.21.15.100:0/1899622472 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83b7c00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 0x7f83c00c40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.809+0000 7f83c4e00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 0x7f83c006da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 -- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 msgr2=0x7f83c00c40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 0x7f83c00c40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 -- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 msgr2=0x7f83c006da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 0x7f83c006da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 -- 172.21.15.100:0/1899622472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8009b30 con 0x7f83c014fdb0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83b7c00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 0x7f83c00c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c4e00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 0x7f83c006da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c5800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f83b803a040 tx=0x7f83b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8009510 con 0x7f83c014fdb0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83b8038e20 con 0x7f83c014fdb0 2024-01-20T08:13:59.814 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83b8007bd0 con 0x7f83c014fdb0 2024-01-20T08:13:59.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c0150ac0 con 0x7f83c014fdb0 2024-01-20T08:13:59.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.810+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c0151080 con 0x7f83c014fdb0 2024-01-20T08:13:59.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.812+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c0072160 con 0x7f83c014fdb0 2024-01-20T08:13:59.815 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.813+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f83b8007d30 con 0x7f83c014fdb0 2024-01-20T08:13:59.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.813+0000 7f83bd600640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 0x7f839806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:13:59.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.814+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f83b80b0be0 con 0x7f83c014fdb0 2024-01-20T08:13:59.816 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.814+0000 7f83c4e00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 0x7f839806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:13:59.817 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.814+0000 7f83c4e00640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 0x7f839806d390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f83b0006fd0 tx=0x7f83b0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:13:59.821 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:13:59.819+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f83b807b730 con 0x7f83c014fdb0 2024-01-20T08:14:00.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.011+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83c004e970 con 0x7f83c014fdb0 2024-01-20T08:14:00.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.012+0000 7f83bd600640 1 -- 172.21.15.100:0/1899622472 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83b8047020 con 0x7f83c014fdb0 2024-01-20T08:14:00.015 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.014+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 msgr2=0x7f839806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.014+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 0x7f839806d390 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f83b0006fd0 tx=0x7f83b0008040 comp rx=0 tx=0).stop 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.014+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 msgr2=0x7f83c00c4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.014+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f83b803a040 tx=0x7f83b8004a40 comp rx=0 tx=0).stop 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 shutdown_connections 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f83c014fdb0 0x7f83c00c4600 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f839806aed0 0x7f839806d390 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f83c00c3460 0x7f83c00c40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 --2- 172.21.15.100:0/1899622472 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f83c00c1d90 0x7f83c006da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 >> 172.21.15.100:0/1899622472 conn(0x7f83c00c2940 msgr2=0x7f83c013f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:00.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 shutdown_connections 2024-01-20T08:14:00.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.016+0000 7f83c7800640 1 -- 172.21.15.100:0/1899622472 wait complete. 2024-01-20T08:14:00.036 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:00.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.251+0000 7f5a1ea00640 1 Processor -- start 2024-01-20T08:14:00.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.252+0000 7f5a1ea00640 1 -- start start 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a180c05a0 0x7f5a1806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a1ea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1806d220 con 0x7f5a181481a0 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a1ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a181557a0 con 0x7f5a18154af0 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a1ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1806dbf0 con 0x7f5a180c05a0 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a17e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5a181481a0 0x7f5a180701e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40326/0 (socket says 172.21.15.100:40326) 2024-01-20T08:14:00.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a17e00640 1 -- 172.21.15.100:0/1667798561 learned_addr learned my addr 172.21.15.100:0/1667798561 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:00.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a17400640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a180c05a0 0x7f5a1806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.253+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550338465 0 0) 0x7f5a1806d220 con 0x7f5a181481a0 2024-01-20T08:14:00.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59f8005730 con 0x7f5a181481a0 2024-01-20T08:14:00.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1596559161 0 0) 0x7f59f8005730 con 0x7f5a181481a0 2024-01-20T08:14:00.257 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a180c05a0 msgr2=0x7f5a1806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5a180c05a0 0x7f5a1806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 >> v1:172.21.15.110:6789/0 conn(0x7f5a18154af0 legacy=0x7f5a18154f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1806c8f0 con 0x7f5a181481a0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f5a08001670 con 0x7f5a181481a0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 >> v1:172.21.15.100:6789/0 conn(0x7f5a181481a0 legacy=0x7f5a180701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8005bb0 0x7f59f8005f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f8006510 0x7f59f80069f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59f80071f0 0x7f59f800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1806dbf0 con 0x7f59f8006510 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f800e100 con 0x7f59f80071f0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f800e2c0 con 0x7f59f8005bb0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.254+0000 7f5a17400640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f8006510 0x7f59f80069f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17e00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8005bb0 0x7f59f8005f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17400640 1 -- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8005bb0 msgr2=0x7f59f8005f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17400640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8005bb0 0x7f59f8005f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a1ca00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59f80071f0 0x7f59f800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17400640 1 -- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59f80071f0 msgr2=0x7f59f800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17400640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f59f80071f0 0x7f59f800db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17400640 1 -- 172.21.15.100:0/1667798561 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f8005730 con 0x7f59f8006510 2024-01-20T08:14:00.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.255+0000 7f5a17e00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8005bb0 0x7f59f8005f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.256+0000 7f5a17400640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f8006510 0x7f59f80069f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009fc0 tx=0x7f59f8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989f4b8921b59a58 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.256+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0002cc20 con 0x7f59f8006510 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.256+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0000f040 con 0x7f59f8006510 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.256+0000 7f5a16a00640 1 -- 172.21.15.100:0/1667798561 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a00034440 con 0x7f59f8006510 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1667798561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f8006510 msgr2=0x7f59f80069f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1667798561 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f59f8006510 0x7f59f80069f0 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009fc0 tx=0x7f59f8007a00 comp rx=0 tx=0).stop 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ca00640 1 -- 172.21.15.100:0/1667798561 reap_dead start 2024-01-20T08:14:00.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1667798561 shutdown_connections 2024-01-20T08:14:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1667798561 >> 172.21.15.100:0/1667798561 conn(0x7f5a180c6090 msgr2=0x7f5a180c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1667798561 shutdown_connections 2024-01-20T08:14:00.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.257+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1667798561 wait complete. 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.259+0000 7f5a1ea00640 1 Processor -- start 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.259+0000 7f5a1ea00640 1 -- start start 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8006510 0x7f5a180abc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18152020 0x7f5a180bf320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180c5cf0 con 0x7f5a180bf860 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180ac300 con 0x7f5a18152020 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a180aa840 con 0x7f59f8006510 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42598/0 (socket says 172.21.15.100:42598) 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a1ca00640 1 -- 172.21.15.100:0/1621073273 learned_addr learned my addr 172.21.15.100:0/1621073273 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a17e00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8006510 0x7f5a180abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.260+0000 7f5a17400640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18152020 0x7f5a180bf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 -- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8006510 msgr2=0x7f5a180abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8006510 0x7f5a180abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 -- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18152020 msgr2=0x7f5a180bf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18152020 0x7f5a180bf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 -- 172.21.15.100:0/1621073273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a180aab20 con 0x7f5a180bf860 2024-01-20T08:14:00.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ca00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5a18154ed0 tx=0x7f5a1000d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a1000b070 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a100054e0 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a10003810 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a180aae00 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.261+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a180c5210 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.263+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a180a9540 con 0x7f5a180bf860 2024-01-20T08:14:00.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.263+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5a10003970 con 0x7f5a180bf860 2024-01-20T08:14:00.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.264+0000 7f5a0fe00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 0x7f59f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.264+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f5a10088f90 con 0x7f5a180bf860 2024-01-20T08:14:00.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.265+0000 7f5a17e00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 0x7f59f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.265+0000 7f5a17e00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 0x7f59f006d3c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5a08001eb0 tx=0x7f5a08001570 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.269+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5a10053ad0 con 0x7f5a180bf860 2024-01-20T08:14:00.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.461+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a180ab320 con 0x7f5a180bf860 2024-01-20T08:14:00.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.462+0000 7f5a0fe00640 1 -- 172.21.15.100:0/1621073273 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7f5a180ab320 con 0x7f5a180bf860 2024-01-20T08:14:00.464 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 msgr2=0x7f59f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 0x7f59f006d3c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f5a08001eb0 tx=0x7f5a08001570 comp rx=0 tx=0).stop 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 msgr2=0x7f5a180c4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f5a18154ed0 tx=0x7f5a1000d890 comp rx=0 tx=0).stop 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 shutdown_connections 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5a180bf860 0x7f5a180c4cd0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5a18152020 0x7f5a180bf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f59f006af00 0x7f59f006d3c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.467 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 --2- 172.21.15.100:0/1621073273 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f59f8006510 0x7f5a180abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 >> 172.21.15.100:0/1621073273 conn(0x7f5a180c6090 msgr2=0x7f5a1806be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:00.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 shutdown_connections 2024-01-20T08:14:00.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.465+0000 7f5a1ea00640 1 -- 172.21.15.100:0/1621073273 wait complete. 2024-01-20T08:14:00.484 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:00.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.693+0000 7f9816000640 1 Processor -- start 2024-01-20T08:14:00.695 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.693+0000 7f9816000640 1 -- start start 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f981014fc10 0x7f98100a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f98100c3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f98100a5240 0x7f98100c3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f981014fff0 con 0x7f981014fc10 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9810072d10 con 0x7f98100a5240 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9816000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9810156710 con 0x7f98100c4ed0 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9814c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f981014fc10 0x7f98100a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9814c00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f981014fc10 0x7f98100a4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42614/0 (socket says 172.21.15.100:42614) 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9814c00640 1 -- 172.21.15.100:0/3071516086 learned_addr learned my addr 172.21.15.100:0/3071516086 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.695+0000 7f9815600640 1 --2- 172.21.15.100:0/3071516086 >> v2:172.21.15.110:3300/0 conn(0x7f98100a5240 0x7f98100c3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9807c00640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f98100c3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9814c00640 1 -- 172.21.15.100:0/3071516086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 msgr2=0x7f98100c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9814c00640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f98100c3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9814c00640 1 -- 172.21.15.100:0/3071516086 >> v2:172.21.15.110:3300/0 conn(0x7f98100a5240 msgr2=0x7f98100c3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9814c00640 1 --2- 172.21.15.100:0/3071516086 >> v2:172.21.15.110:3300/0 conn(0x7f98100a5240 0x7f98100c3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.696+0000 7f9814c00640 1 -- 172.21.15.100:0/3071516086 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9810155b00 con 0x7f981014fc10 2024-01-20T08:14:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.697+0000 7f9814c00640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981014fc10 0x7f98100a4d00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f98100ab300 tx=0x7f980002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cca200fe0d72c76 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.697+0000 7f980fe00640 1 -- 172.21.15.100:0/3071516086 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000317e0 con 0x7f981014fc10 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.697+0000 7f980fe00640 1 -- 172.21.15.100:0/3071516086 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800031940 con 0x7f981014fc10 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.697+0000 7f980fe00640 1 -- 172.21.15.100:0/3071516086 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800031cd0 con 0x7f981014fc10 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 -- 172.21.15.100:0/3071516086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981014fc10 msgr2=0x7f98100a4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981014fc10 0x7f98100a4d00 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f98100ab300 tx=0x7f980002b880 comp rx=0 tx=0).stop 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 -- 172.21.15.100:0/3071516086 shutdown_connections 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 --2- 172.21.15.100:0/3071516086 >> v2:172.21.15.110:3300/0 conn(0x7f98100a5240 0x7f98100c3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f98100c3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 --2- 172.21.15.100:0/3071516086 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f981014fc10 0x7f98100a4d00 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 -- 172.21.15.100:0/3071516086 >> 172.21.15.100:0/3071516086 conn(0x7f98100c5ba0 msgr2=0x7f98100c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 -- 172.21.15.100:0/3071516086 shutdown_connections 2024-01-20T08:14:00.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.698+0000 7f9816000640 1 -- 172.21.15.100:0/3071516086 wait complete. 2024-01-20T08:14:00.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.700+0000 7f9816000640 1 Processor -- start 2024-01-20T08:14:00.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.701+0000 7f9816000640 1 -- start start 2024-01-20T08:14:00.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.704 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f981006dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 0x7f9810154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98100bd6e0 con 0x7f98100a5240 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f981006e1f0 con 0x7f981014fc10 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9816000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98101ee8f0 con 0x7f98100c4ed0 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9814c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9814c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42622/0 (socket says 172.21.15.100:42622) 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.702+0000 7f9814c00640 1 -- 172.21.15.100:0/3124970003 learned_addr learned my addr 172.21.15.100:0/3124970003 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9815600640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 0x7f9810154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 -- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 msgr2=0x7f981006dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f981006dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 -- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 msgr2=0x7f9810154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.705 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 0x7f9810154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 -- 172.21.15.100:0/3124970003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094d0 con 0x7f98100a5240 2024-01-20T08:14:00.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9815600640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 0x7f9810154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9814c00640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9800000c00 tx=0x7f98000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800032880 con 0x7f98100a5240 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800032a20 con 0x7f98100a5240 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9800032dd0 con 0x7f98100a5240 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.703+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981006c300 con 0x7f98100a5240 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.704+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981006c5a0 con 0x7f98100a5240 2024-01-20T08:14:00.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.705+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981006c160 con 0x7f98100a5240 2024-01-20T08:14:00.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.705+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f98000453f0 con 0x7f98100a5240 2024-01-20T08:14:00.708 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.706+0000 7f980d600640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 0x7f97e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:00.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.707+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f98000abb80 con 0x7f98100a5240 2024-01-20T08:14:00.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.707+0000 7f9807c00640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 0x7f97e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:00.709 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.707+0000 7f9807c00640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 0x7f97e806d390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f98100a4d80 tx=0x7f97f8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:00.713 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.711+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f981006c160 con 0x7f98100a5240 2024-01-20T08:14:00.909 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.907+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f981006c160 con 0x7f98100a5240 2024-01-20T08:14:00.910 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.908+0000 7f980d600640 1 -- 172.21.15.100:0/3124970003 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7f981006c160 con 0x7f98100a5240 2024-01-20T08:14:00.910 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 msgr2=0x7f97e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 0x7f97e806d390 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f98100a4d80 tx=0x7f97f8008040 comp rx=0 tx=0).stop 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 msgr2=0x7f981006cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f9800000c00 tx=0x7f98000046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 shutdown_connections 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f981014fc10 0x7f9810154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f97e806aed0 0x7f97e806d390 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.913 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f98100c4ed0 0x7f981006dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 --2- 172.21.15.100:0/3124970003 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f98100a5240 0x7f981006cda0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 >> 172.21.15.100:0/3124970003 conn(0x7f98100c5ba0 msgr2=0x7f981006ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 shutdown_connections 2024-01-20T08:14:00.914 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:00.911+0000 7f9816000640 1 -- 172.21.15.100:0/3124970003 wait complete. 2024-01-20T08:14:00.931 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:14:01.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.137+0000 7f1282a00640 1 Processor -- start 2024-01-20T08:14:01.140 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.138+0000 7f1282a00640 1 -- start start 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f127c14fdb0 0x7f127c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c0c1d90 0x7f127c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f127c0c3460 0x7f127c153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0a9ce0 con 0x7f127c0c3460 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f127c0a93b0 con 0x7f127c14fdb0 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.139+0000 7f1282a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c152790 con 0x7f127c0c1d90 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f127c0c3460 0x7f127c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f127c0c3460 0x7f127c153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42626/0 (socket says 172.21.15.100:42626) 2024-01-20T08:14:01.142 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 -- 172.21.15.100:0/3846696532 learned_addr learned my addr 172.21.15.100:0/3846696532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f127be00640 1 --2- 172.21.15.100:0/3846696532 >> v2:172.21.15.110:3300/0 conn(0x7f127c14fdb0 0x7f127c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1273e00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c0c1d90 0x7f127c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 -- 172.21.15.100:0/3846696532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c0c1d90 msgr2=0x7f127c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c0c1d90 0x7f127c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 -- 172.21.15.100:0/3846696532 >> v2:172.21.15.110:3300/0 conn(0x7f127c14fdb0 msgr2=0x7f127c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 --2- 172.21.15.100:0/3846696532 >> v2:172.21.15.110:3300/0 conn(0x7f127c14fdb0 0x7f127c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.140+0000 7f1280a00640 1 -- 172.21.15.100:0/3846696532 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c150190 con 0x7f127c0c3460 2024-01-20T08:14:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.141+0000 7f1280a00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c3460 0x7f127c153120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f127c06e580 tx=0x7f127402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e79b03d1c5c70ec3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.142+0000 7f127b400640 1 -- 172.21.15.100:0/3846696532 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127402ca70 con 0x7f127c0c3460 2024-01-20T08:14:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.142+0000 7f127b400640 1 -- 172.21.15.100:0/3846696532 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f127402cbd0 con 0x7f127c0c3460 2024-01-20T08:14:01.144 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.142+0000 7f127b400640 1 -- 172.21.15.100:0/3846696532 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12740343f0 con 0x7f127c0c3460 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 -- 172.21.15.100:0/3846696532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c3460 msgr2=0x7f127c153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c3460 0x7f127c153120 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f127c06e580 tx=0x7f127402bed0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 -- 172.21.15.100:0/3846696532 shutdown_connections 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c3460 0x7f127c153120 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 --2- 172.21.15.100:0/3846696532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c0c1d90 0x7f127c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 --2- 172.21.15.100:0/3846696532 >> v2:172.21.15.110:3300/0 conn(0x7f127c14fdb0 0x7f127c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 -- 172.21.15.100:0/3846696532 >> 172.21.15.100:0/3846696532 conn(0x7f127c0c2940 msgr2=0x7f127c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 -- 172.21.15.100:0/3846696532 shutdown_connections 2024-01-20T08:14:01.145 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.143+0000 7f1282a00640 1 -- 172.21.15.100:0/3846696532 wait complete. 2024-01-20T08:14:01.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.145+0000 7f1282a00640 1 Processor -- start 2024-01-20T08:14:01.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.145+0000 7f1282a00640 1 -- start start 2024-01-20T08:14:01.148 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f127c0c3460 0x7f127c156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c14fdb0 0x7f127c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c1543c0 con 0x7f127c0c1d90 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f127c06de30 con 0x7f127c0c3460 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f1282a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f127c155230 con 0x7f127c14fdb0 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f127be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f127be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42642/0 (socket says 172.21.15.100:42642) 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.146+0000 7f127be00640 1 -- 172.21.15.100:0/2537382889 learned_addr learned my addr 172.21.15.100:0/2537382889 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 -- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c14fdb0 msgr2=0x7f127c1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c14fdb0 0x7f127c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 -- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f127c0c3460 msgr2=0x7f127c156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f127c0c3460 0x7f127c156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.149 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 -- 172.21.15.100:0/2537382889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1274009b30 con 0x7f127c0c1d90 2024-01-20T08:14:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f127be00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f126c00d650 tx=0x7f126c00db10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00b6c0 con 0x7f127c0c1d90 2024-01-20T08:14:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f126c00b820 con 0x7f127c0c1d90 2024-01-20T08:14:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.147+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f126c00bbd0 con 0x7f127c0c1d90 2024-01-20T08:14:01.150 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.148+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127c14b650 con 0x7f127c0c1d90 2024-01-20T08:14:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.148+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f127c14bc10 con 0x7f127c0c1d90 2024-01-20T08:14:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.149+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127c155400 con 0x7f127c0c1d90 2024-01-20T08:14:01.151 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.150+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f126c00bd30 con 0x7f127c0c1d90 2024-01-20T08:14:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.151+0000 7f1278c00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 0x7f125406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.152 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.151+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f126c089e80 con 0x7f127c0c1d90 2024-01-20T08:14:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.151+0000 7f1273e00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 0x7f125406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.153 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.152+0000 7f1273e00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 0x7f125406d390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1264006b10 tx=0x7f1264008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.157 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.155+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f127c155400 con 0x7f127c0c1d90 2024-01-20T08:14:01.361 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.359+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f127c155400 con 0x7f127c0c1d90 2024-01-20T08:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.360+0000 7f1278c00640 1 -- 172.21.15.100:0/2537382889 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7f127c155400 con 0x7f127c0c1d90 2024-01-20T08:14:01.362 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.362+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 msgr2=0x7f125406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.362+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 0x7f125406d390 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1264006b10 tx=0x7f1264008040 comp rx=0 tx=0).stop 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.362+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 msgr2=0x7f127c1ea2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f126c00d650 tx=0x7f126c00db10 comp rx=0 tx=0).stop 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 shutdown_connections 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f125406aed0 0x7f125406d390 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f127c14fdb0 0x7f127c1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f127c0c3460 0x7f127c156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 --2- 172.21.15.100:0/2537382889 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f127c0c1d90 0x7f127c1ea2a0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 >> 172.21.15.100:0/2537382889 conn(0x7f127c0c2940 msgr2=0x7f127c070ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 shutdown_connections 2024-01-20T08:14:01.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.363+0000 7f1282a00640 1 -- 172.21.15.100:0/2537382889 wait complete. 2024-01-20T08:14:01.385 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-01-20T08:14:01.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:01.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:01.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:14:01.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:01.527 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T08:14:01.569 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:01.569 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:01.645 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:14:01.645 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:14:01.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.874+0000 7fdf0da00640 1 Processor -- start 2024-01-20T08:14:01.876 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.874+0000 7fdf0da00640 1 -- start start 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.875+0000 7fdf0da00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf08158af0 0x7fdf08157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf0da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf081550c0 0x7fdf080c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf0da00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf08071d00 con 0x7fdf080c24f0 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf0da00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf08154ca0 con 0x7fdf08158af0 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf0da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08071fa0 con 0x7fdf081550c0 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf08158af0 0x7fdf08157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fdf08158af0 0x7fdf08157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42654/0 (socket says 172.21.15.100:42654) 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 -- 172.21.15.100:0/3590112268 learned_addr learned my addr 172.21.15.100:0/3590112268 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 -- 172.21.15.100:0/3590112268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf081550c0 msgr2=0x7fdf080c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 --2- 172.21.15.100:0/3590112268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf081550c0 0x7fdf080c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 -- 172.21.15.100:0/3590112268 >> v1:172.21.15.110:6789/0 conn(0x7fdf080c24f0 legacy=0x7fdf0806e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.876+0000 7fdf06a00640 1 -- 172.21.15.100:0/3590112268 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf08072280 con 0x7fdf08158af0 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.877+0000 7fdf06a00640 1 --2- 172.21.15.100:0/3590112268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf08158af0 0x7fdf08157da0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef802b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503ecae2d3fa2787 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf06000640 1 -- 172.21.15.100:0/3590112268 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8031740 con 0x7fdf08158af0 2024-01-20T08:14:01.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf06000640 1 -- 172.21.15.100:0/3590112268 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef80318a0 con 0x7fdf08158af0 2024-01-20T08:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf06000640 1 -- 172.21.15.100:0/3590112268 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef8031c30 con 0x7fdf08158af0 2024-01-20T08:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 -- 172.21.15.100:0/3590112268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf08158af0 msgr2=0x7fdf08157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 --2- 172.21.15.100:0/3590112268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf08158af0 0x7fdf08157da0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009870 tx=0x7fdef802b7e0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 -- 172.21.15.100:0/3590112268 shutdown_connections 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 --2- 172.21.15.100:0/3590112268 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf081550c0 0x7fdf080c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 --2- 172.21.15.100:0/3590112268 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf08158af0 0x7fdf08157da0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 -- 172.21.15.100:0/3590112268 >> 172.21.15.100:0/3590112268 conn(0x7fdf080c2940 msgr2=0x7fdf080c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 -- 172.21.15.100:0/3590112268 shutdown_connections 2024-01-20T08:14:01.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.878+0000 7fdf0da00640 1 -- 172.21.15.100:0/3590112268 wait complete. 2024-01-20T08:14:01.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.880+0000 7fdf0da00640 1 Processor -- start 2024-01-20T08:14:01.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.880+0000 7fdf0da00640 1 -- start start 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf080c24f0 0x7fdf081435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf08158af0 0x7fdf081ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf08144040 con 0x7fdf081550c0 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0814f710 con 0x7fdf08158af0 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdf0da00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf081ee810 con 0x7fdf080c24f0 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42668/0 (socket says 172.21.15.100:42668) 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 -- 172.21.15.100:0/1383842000 learned_addr learned my addr 172.21.15.100:0/1383842000 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:01.884 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 -- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf080c24f0 msgr2=0x7fdf081435f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf080c24f0 0x7fdf081435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 -- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf08158af0 msgr2=0x7fdf081ea3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf08158af0 0x7fdf081ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.881+0000 7fdeffe00640 1 -- 172.21.15.100:0/1383842000 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef80094d0 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdeffe00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fdef000b3e0 tx=0x7fdef000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011830 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdef00119b0 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdef0011d60 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf081ee530 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.882+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0814f1f0 con 0x7fdf081550c0 2024-01-20T08:14:01.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.883+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf08073de0 con 0x7fdf081550c0 2024-01-20T08:14:01.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.884+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fdef001a400 con 0x7fdf081550c0 2024-01-20T08:14:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.885+0000 7fdefea00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 0x7fdee006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.885+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fdef0089bc0 con 0x7fdf081550c0 2024-01-20T08:14:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.885+0000 7fdf06a00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 0x7fdee006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:01.887 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.886+0000 7fdf06a00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 0x7fdee006d390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdef8035000 tx=0x7fdef8030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:01.891 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:01.889+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fdef0054670 con 0x7fdf081550c0 2024-01-20T08:14:02.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.123+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdf0814f410 con 0x7fdf081550c0 2024-01-20T08:14:02.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.123+0000 7fdefea00640 1 -- 172.21.15.100:0/1383842000 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fdef0015020 con 0x7fdf081550c0 2024-01-20T08:14:02.125 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:14:02.125 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:14:02.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 msgr2=0x7fdee006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:02.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 0x7fdee006d390 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdef8035000 tx=0x7fdef8030000 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 msgr2=0x7fdf0814d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fdef000b3e0 tx=0x7fdef000b8a0 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 shutdown_connections 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fdf08158af0 0x7fdf081ea3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf081550c0 0x7fdf0814d3f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fdee006aed0 0x7fdee006d390 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.126+0000 7fdf0da00640 1 --2- 172.21.15.100:0/1383842000 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fdf080c24f0 0x7fdf081435f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.127+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 >> 172.21.15.100:0/1383842000 conn(0x7fdf080c2940 msgr2=0x7fdf08070e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:02.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.127+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 shutdown_connections 2024-01-20T08:14:02.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:02.127+0000 7fdf0da00640 1 -- 172.21.15.100:0/1383842000 wait complete. 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi100.front.sepia.ceph.com 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:14:02.149 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.kfx9ED9Cia 2024-01-20T08:14:02.149 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:14:02.196 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.U3mEh4nPK5 2024-01-20T08:14:02.196 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /tmp/tmp.kfx9ED9Cia /tmp/tmp.U3mEh4nPK5 2024-01-20T08:14:02.273 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.U3mEh4nPK5 2024-01-20T08:14:02.418 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.U3mEh4nPK5 is 226B 2024-01-20T08:14:02.477 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.U3mEh4nPK5 2024-01-20T08:14:02.528 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-20T08:14:02.528 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:14:02.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.529 DEBUG:teuthology.orchestra.run.smithi100:> ip addr 2024-01-20T08:14:02.576 INFO:teuthology.orchestra.run.smithi100.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:14:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:14:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:14:02.576 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 ::1/128 scope host 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:28 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f0 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:d8:a1:29 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: altname enp7s0f1 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 0c:c4:7a:8f:d7:33 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: inet 172.21.15.100/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft 42431sec preferred_lft 42431sec 2024-01-20T08:14:02.577 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::ec4:7aff:fe8f:d733/64 scope link 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::4496:2cff:fedc:bbb4/64 scope link 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: link/ether 82:c5:0a:91:41:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: inet6 fe80::80c5:aff:fe91:4132/64 scope link 2024-01-20T08:14:02.578 INFO:teuthology.orchestra.run.smithi100.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:02.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.579 DEBUG:teuthology.orchestra.run.smithi100:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:14:02.660 INFO:teuthology.orchestra.run.smithi100.stdout:1 2024-01-20T08:14:02.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.664 DEBUG:teuthology.orchestra.run.smithi100:> route 2024-01-20T08:14:02.712 INFO:teuthology.orchestra.run.smithi100.stdout:Kernel IP routing table 2024-01-20T08:14:02.712 INFO:teuthology.orchestra.run.smithi100.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:14:02.712 INFO:teuthology.orchestra.run.smithi100.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:14:02.712 INFO:teuthology.orchestra.run.smithi100.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:14:02.713 INFO:teuthology.orchestra.run.smithi100.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:14:02.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> (cd / && exec bash -c ' 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> set -e 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:14:02.713 DEBUG:teuthology.orchestra.run.smithi100:> ') 2024-01-20T08:14:02.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.935 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:14:02.986 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:14:02.987 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:14:02.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:02.988 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link set brx.0 up 2024-01-20T08:14:03.080 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:14:03.080 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:03.131 INFO:teuthology.orchestra.run.smithi100.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-01-20T08:14:03.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:14:03.131 DEBUG:teuthology.orchestra.run.smithi100:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:03.182 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:03.182 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/tmp/tmp.kfx9ED9Cia of=/dev/stdout 2024-01-20T08:14:03.232 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs=/ 2024-01-20T08:14:03.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:03.233 DEBUG:teuthology.orchestra.run.smithi100:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:03.368 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:03.368 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:14:03.369 INFO:teuthology.orchestra.run.smithi100.stdout:keyring.get_secret failed 2024-01-20T08:14:03.402 INFO:teuthology.orchestra.run.smithi100.stdout:parsing options: rw,norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:03.402 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:14:03.402 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:14:03.402 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: trying mount with new device syntax: testuser@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs=/ 2024-01-20T08:14:03.402 INFO:teuthology.orchestra.run.smithi100.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:14:03.404 INFO:teuthology.orchestra.run.smithi100.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-01-20T08:14:03.404 INFO:teuthology.orchestra.run.smithi100.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:14:03.404 INFO:teuthology.orchestra.run.smithi100.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:14:03.404 INFO:teuthology.orchestra.run.smithi100.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:14:03.404 INFO:teuthology.orchestra.run.smithi100.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:14:03.407 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:14:03.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:03.407 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:03.484 INFO:teuthology.orchestra.run.smithi100.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.0': Permission denied 2024-01-20T08:14:03.487 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:14:03.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:03.488 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:14:03.543 INFO:teuthology.orchestra.run.smithi100.stdout:client5533 2024-01-20T08:14:03.544 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:03.544 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:03.595 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-20T08:14:03.653 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.i6mLTrpIFw 2024-01-20T08:14:03.653 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:03.653 DEBUG:teuthology.orchestra.run.smithi110:> dd of=/tmp/tmp.i6mLTrpIFw 2024-01-20T08:14:03.708 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:03.708 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:03.805 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:03.806 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:03.859 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:04.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.075+0000 7f752be00640 1 Processor -- start 2024-01-20T08:14:04.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.075+0000 7f752be00640 1 -- start start 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.076+0000 7f752be00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f752c06d2b0 0x7f752c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.076+0000 7f752be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c06cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.076+0000 7f752be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f752c1523a0 con 0x7f752c0c3e00 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752be00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f752c0706a0 con 0x7f752c06d2b0 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752be00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c151ee0 con 0x7f752c0c5570 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f752c06d2b0 0x7f752c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f752c06d2b0 0x7f752c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42682/0 (socket says 172.21.15.100:42682) 2024-01-20T08:14:04.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 -- 172.21.15.100:0/1757303877 learned_addr learned my addr 172.21.15.100:0/1757303877 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752b400640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c06cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 -- 172.21.15.100:0/1757303877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 msgr2=0x7f752c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c06cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 -- 172.21.15.100:0/1757303877 >> v1:172.21.15.100:6789/0 conn(0x7f752c0c3e00 legacy=0x7f752c06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f7529600640 1 -- 172.21.15.100:0/1757303877 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715596900 0 0) 0x7f752c1523a0 con 0x7f752c0c3e00 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752aa00640 1 -- 172.21.15.100:0/1757303877 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f752c0a53f0 con 0x7f752c06d2b0 2024-01-20T08:14:04.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.077+0000 7f752b400640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f752aa00640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c06d690 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353f56bdcdb306d7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f7529600640 1 -- 172.21.15.100:0/1757303877 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0317c0 con 0x7f752c06d2b0 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f7529600640 1 -- 172.21.15.100:0/1757303877 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c031920 con 0x7f752c06d2b0 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f7529600640 1 -- 172.21.15.100:0/1757303877 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c031cb0 con 0x7f752c06d2b0 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f752be00640 1 -- 172.21.15.100:0/1757303877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 msgr2=0x7f752c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.079+0000 7f752be00640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c06d690 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f751c009870 tx=0x7f751c02b860 comp rx=0 tx=0).stop 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 -- 172.21.15.100:0/1757303877 shutdown_connections 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c06cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 --2- 172.21.15.100:0/1757303877 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c06d690 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 -- 172.21.15.100:0/1757303877 >> 172.21.15.100:0/1757303877 conn(0x7f752c0c2590 msgr2=0x7f752c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 -- 172.21.15.100:0/1757303877 shutdown_connections 2024-01-20T08:14:04.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.080+0000 7f752be00640 1 -- 172.21.15.100:0/1757303877 wait complete. 2024-01-20T08:14:04.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.081+0000 7f752be00640 1 Processor -- start 2024-01-20T08:14:04.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.082+0000 7f752be00640 1 -- start start 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.082+0000 7f752be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.082+0000 7f752be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f752c0c3e00 0x7f752c144160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.082+0000 7f752be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c1446a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1557a0 con 0x7f752c06d2b0 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f752c1eadc0 con 0x7f752c0c3e00 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752be00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f752c0aa870 con 0x7f752c0c5570 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42694/0 (socket says 172.21.15.100:42694) 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 -- 172.21.15.100:0/1281385307 learned_addr learned my addr 172.21.15.100:0/1281385307 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 -- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 msgr2=0x7f752c1446a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c1446a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 -- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f752c0c3e00 msgr2=0x7f752c144160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f752c0c3e00 0x7f752c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 -- 172.21.15.100:0/1281385307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f751c0094d0 con 0x7f752c06d2b0 2024-01-20T08:14:04.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.083+0000 7f752aa00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.084+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0329a0 con 0x7f752c06d2b0 2024-01-20T08:14:04.086 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.084+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f751c032b40 con 0x7f752c06d2b0 2024-01-20T08:14:04.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.084+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f752c0aa1e0 con 0x7f752c06d2b0 2024-01-20T08:14:04.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.084+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f751c0453f0 con 0x7f752c06d2b0 2024-01-20T08:14:04.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.084+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f752c1eafb0 con 0x7f752c06d2b0 2024-01-20T08:14:04.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.085+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f752c0749e0 con 0x7f752c06d2b0 2024-01-20T08:14:04.087 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.086+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f751c04e450 con 0x7f752c06d2b0 2024-01-20T08:14:04.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.087+0000 7f7522a00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.087+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f751c0abc80 con 0x7f752c06d2b0 2024-01-20T08:14:04.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.087+0000 7f752a000640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.087+0000 7f752a000640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 0x7f750406d3c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f60 tx=0x7f75140079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.091+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f751c076860 con 0x7f752c06d2b0 2024-01-20T08:14:04.293 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.291+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f752c0c1ff0 con 0x7f752c06d2b0 2024-01-20T08:14:04.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.295+0000 7f7522a00640 1 -- 172.21.15.100:0/1281385307 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f751c079e80 con 0x7f752c06d2b0 2024-01-20T08:14:04.297 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:04.297 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 msgr2=0x7f750406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 0x7f750406d3c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7514000f60 tx=0x7f75140079b0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 msgr2=0x7f752c0a8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f751c000c00 tx=0x7f751c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 shutdown_connections 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f750406af00 0x7f750406d3c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f752c0c5570 0x7f752c1446a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f752c0c3e00 0x7f752c144160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 --2- 172.21.15.100:0/1281385307 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f752c06d2b0 0x7f752c0a8b60 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 >> 172.21.15.100:0/1281385307 conn(0x7f752c0c2590 msgr2=0x7f752c070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 shutdown_connections 2024-01-20T08:14:04.300 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.297+0000 7f752be00640 1 -- 172.21.15.100:0/1281385307 wait complete. 2024-01-20T08:14:04.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:14:04.320 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:14:04.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.528+0000 7f902ca00640 1 Processor -- start 2024-01-20T08:14:04.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.528+0000 7f902ca00640 1 -- start start 2024-01-20T08:14:04.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.529+0000 7f902ca00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f902414b720 0x7f90241515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.529+0000 7f902ca00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90240c1d00 0x7f902406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.529+0000 7f902ca00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9024154ba0 con 0x7f90240c1850 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.529+0000 7f902ca00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902414bb00 con 0x7f90240c1d00 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.529+0000 7f902ca00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9024155a00 con 0x7f902414b720 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90240c1d00 0x7f902406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f90240c1d00 0x7f902406cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42706/0 (socket says 172.21.15.100:42706) 2024-01-20T08:14:04.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 -- 172.21.15.100:0/1648083232 learned_addr learned my addr 172.21.15.100:0/1648083232 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902a000640 1 --2- 172.21.15.100:0/1648083232 >> v2:172.21.15.110:3300/0 conn(0x7f902414b720 0x7f90241515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 -- 172.21.15.100:0/1648083232 >> v2:172.21.15.110:3300/0 conn(0x7f902414b720 msgr2=0x7f90241515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 --2- 172.21.15.100:0/1648083232 >> v2:172.21.15.110:3300/0 conn(0x7f902414b720 0x7f90241515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 -- 172.21.15.100:0/1648083232 >> v1:172.21.15.110:6789/0 conn(0x7f90240c1850 legacy=0x7f902406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.530+0000 7f902aa00640 1 -- 172.21.15.100:0/1648083232 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9024154df0 con 0x7f90240c1d00 2024-01-20T08:14:04.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.531+0000 7f902aa00640 1 --2- 172.21.15.100:0/1648083232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f902406cfe0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f902406be40 tx=0x7f901c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5f99bee952a1c6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f9028c00640 1 -- 172.21.15.100:0/1648083232 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c02c9f0 con 0x7f90240c1d00 2024-01-20T08:14:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f9028c00640 1 -- 172.21.15.100:0/1648083232 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c02cb50 con 0x7f90240c1d00 2024-01-20T08:14:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f9028c00640 1 -- 172.21.15.100:0/1648083232 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c0343f0 con 0x7f90240c1d00 2024-01-20T08:14:04.534 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 -- 172.21.15.100:0/1648083232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 msgr2=0x7f902406cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 --2- 172.21.15.100:0/1648083232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f902406cfe0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f902406be40 tx=0x7f901c02be50 comp rx=0 tx=0).stop 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 -- 172.21.15.100:0/1648083232 shutdown_connections 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 --2- 172.21.15.100:0/1648083232 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f902406cfe0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 --2- 172.21.15.100:0/1648083232 >> v2:172.21.15.110:3300/0 conn(0x7f902414b720 0x7f90241515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.532+0000 7f902ca00640 1 -- 172.21.15.100:0/1648083232 >> 172.21.15.100:0/1648083232 conn(0x7f90240c2940 msgr2=0x7f90240c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.533+0000 7f902ca00640 1 -- 172.21.15.100:0/1648083232 shutdown_connections 2024-01-20T08:14:04.535 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.533+0000 7f902ca00640 1 -- 172.21.15.100:0/1648083232 wait complete. 2024-01-20T08:14:04.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.534+0000 7f902ca00640 1 Processor -- start 2024-01-20T08:14:04.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.534+0000 7f902ca00640 1 -- start start 2024-01-20T08:14:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 0x7f9024070c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.538 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f902414b720 0x7f9024144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024151640 con 0x7f90240c1d00 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9024144d50 con 0x7f902414b720 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f902ca00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90241eadb0 con 0x7f90240c1850 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f9029600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.535+0000 7f9029600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42712/0 (socket says 172.21.15.100:42712) 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 -- 172.21.15.100:0/2545867340 learned_addr learned my addr 172.21.15.100:0/2545867340 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f902a000640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 0x7f9024070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f902aa00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f902414b720 0x7f9024144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 -- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 msgr2=0x7f9024070c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 0x7f9024070c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 -- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f902414b720 msgr2=0x7f9024144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f902414b720 0x7f9024144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 -- 172.21.15.100:0/2545867340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c009b30 con 0x7f90240c1d00 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f902a000640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 0x7f9024070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9029600640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c430 tx=0x7f900c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.539 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011790 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c0118f0 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c011ce0 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.536+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90240711d0 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.537+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90240714c0 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.538+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902404e970 con 0x7f90240c1d00 2024-01-20T08:14:04.540 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.539+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f900c01c460 con 0x7f90240c1d00 2024-01-20T08:14:04.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.539+0000 7f9022000640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 0x7f8ffc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.540+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f900c089990 con 0x7f90240c1d00 2024-01-20T08:14:04.541 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.540+0000 7f902a000640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 0x7f8ffc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.542 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.541+0000 7f902a000640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 0x7f8ffc06d390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9014006fd0 tx=0x7f9014008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.545+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f900c0544c0 con 0x7f90240c1d00 2024-01-20T08:14:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.738+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90240c37e0 con 0x7f90240c1d00 2024-01-20T08:14:04.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.738+0000 7f9022000640 1 -- 172.21.15.100:0/2545867340 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f900c057ae0 con 0x7f90240c1d00 2024-01-20T08:14:04.742 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.741+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 msgr2=0x7f8ffc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.741+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 0x7f8ffc06d390 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f9014006fd0 tx=0x7f9014008040 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.741+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 msgr2=0x7f9024144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.741+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c430 tx=0x7f900c00c8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 shutdown_connections 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f902414b720 0x7f9024144750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90240c1d00 0x7f9024144210 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f8ffc06aed0 0x7f8ffc06d390 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 --2- 172.21.15.100:0/2545867340 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f90240c1850 0x7f9024070c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 >> 172.21.15.100:0/2545867340 conn(0x7f90240c2940 msgr2=0x7f902406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 shutdown_connections 2024-01-20T08:14:04.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.742+0000 7f902ca00640 1 -- 172.21.15.100:0/2545867340 wait complete. 2024-01-20T08:14:04.762 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:14:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.970+0000 7f2ea4400640 1 Processor -- start 2024-01-20T08:14:04.974 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.971+0000 7f2ea4400640 1 -- start start 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea4400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2e9c0c60d0 0x7f2e9c06bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea4400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9c155500 0x7f2e9c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c06b640 con 0x7f2e9c0c5180 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea4400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c06c600 con 0x7f2e9c155500 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea4400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0c69e0 con 0x7f2e9c0c60d0 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea2400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9c155500 0x7f2e9c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea2400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f2e9c155500 0x7f2e9c151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42720/0 (socket says 172.21.15.100:42720) 2024-01-20T08:14:04.975 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.972+0000 7f2ea2400640 1 -- 172.21.15.100:0/3832304575 learned_addr learned my addr 172.21.15.100:0/3832304575 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.973+0000 7f2ea1000640 1 --2- 172.21.15.100:0/3832304575 >> v2:172.21.15.110:3300/0 conn(0x7f2e9c0c60d0 0x7f2e9c06bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.973+0000 7f2ea2400640 1 -- 172.21.15.100:0/3832304575 >> v2:172.21.15.110:3300/0 conn(0x7f2e9c0c60d0 msgr2=0x7f2e9c06bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.973+0000 7f2ea2400640 1 --2- 172.21.15.100:0/3832304575 >> v2:172.21.15.110:3300/0 conn(0x7f2e9c0c60d0 0x7f2e9c06bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.973+0000 7f2ea2400640 1 -- 172.21.15.100:0/3832304575 >> v1:172.21.15.110:6789/0 conn(0x7f2e9c0c5180 legacy=0x7f2e9c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:04.976 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.973+0000 7f2ea2400640 1 -- 172.21.15.100:0/3832304575 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0c8af0 con 0x7f2e9c155500 2024-01-20T08:14:04.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.974+0000 7f2ea2400640 1 --2- 172.21.15.100:0/3832304575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c155500 0x7f2e9c151da0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c08b4d0 tx=0x7f2e9402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c20a160b40562ac server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.974+0000 7f2e9be00640 1 -- 172.21.15.100:0/3832304575 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94031800 con 0x7f2e9c155500 2024-01-20T08:14:04.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.974+0000 7f2e9be00640 1 -- 172.21.15.100:0/3832304575 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e94031960 con 0x7f2e9c155500 2024-01-20T08:14:04.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.974+0000 7f2e9be00640 1 -- 172.21.15.100:0/3832304575 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e94031cf0 con 0x7f2e9c155500 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 -- 172.21.15.100:0/3832304575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c155500 msgr2=0x7f2e9c151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3832304575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c155500 0x7f2e9c151da0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c08b4d0 tx=0x7f2e9402b8a0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 -- 172.21.15.100:0/3832304575 shutdown_connections 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3832304575 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c155500 0x7f2e9c151da0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3832304575 >> v2:172.21.15.110:3300/0 conn(0x7f2e9c0c60d0 0x7f2e9c06bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 -- 172.21.15.100:0/3832304575 >> 172.21.15.100:0/3832304575 conn(0x7f2e9c0ca5a0 msgr2=0x7f2e9c0ca9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 -- 172.21.15.100:0/3832304575 shutdown_connections 2024-01-20T08:14:04.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.975+0000 7f2ea4400640 1 -- 172.21.15.100:0/3832304575 wait complete. 2024-01-20T08:14:04.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.977+0000 7f2ea4400640 1 Processor -- start 2024-01-20T08:14:04.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.977+0000 7f2ea4400640 1 -- start start 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9c0c60d0 0x7f2e9c0c0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e9c155500 0x7f2e9c0c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c158af0 con 0x7f2e9c0c5180 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c157210 con 0x7f2e9c155500 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea4400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c1574f0 con 0x7f2e9c0c60d0 2024-01-20T08:14:04.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42734/0 (socket says 172.21.15.100:42734) 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 -- 172.21.15.100:0/3778961116 learned_addr learned my addr 172.21.15.100:0/3778961116 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 -- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9c0c60d0 msgr2=0x7f2e9c0c0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea2400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e9c155500 0x7f2e9c0c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9c0c60d0 0x7f2e9c0c0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 -- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e9c155500 msgr2=0x7f2e9c0c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e9c155500 0x7f2e9c0c0b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.978+0000 7f2ea1a00640 1 -- 172.21.15.100:0/3778961116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940094d0 con 0x7f2e9c0c5180 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2ea1a00640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c430 tx=0x7f2e8400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84011790 con 0x7f2e9c0c5180 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840118f0 con 0x7f2e9c0c5180 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c1eb850 con 0x7f2e9c0c5180 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84011ca0 con 0x7f2e9c0c5180 2024-01-20T08:14:04.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.979+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c158790 con 0x7f2e9c0c5180 2024-01-20T08:14:04.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.980+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c074300 con 0x7f2e9c0c5180 2024-01-20T08:14:04.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.981+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2e8401c460 con 0x7f2e9c0c5180 2024-01-20T08:14:04.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.982+0000 7f2e99600640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 0x7f2e7406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:04.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.982+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f2e840899f0 con 0x7f2e9c0c5180 2024-01-20T08:14:04.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.982+0000 7f2ea1000640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 0x7f2e7406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:04.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.983+0000 7f2ea1000640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 0x7f2e7406d390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1543a0 tx=0x7f2e8c007390 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:04.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:04.986+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2e840544a0 con 0x7f2e9c0c5180 2024-01-20T08:14:05.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.185+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2e9c04ea50 con 0x7f2e9c0c5180 2024-01-20T08:14:05.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.186+0000 7f2e99600640 1 -- 172.21.15.100:0/3778961116 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2e84057ac0 con 0x7f2e9c0c5180 2024-01-20T08:14:05.190 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 msgr2=0x7f2e7406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 0x7f2e7406d390 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c1543a0 tx=0x7f2e8c007390 comp rx=0 tx=0).stop 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 msgr2=0x7f2e9c158250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400c430 tx=0x7f2e8400c8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 shutdown_connections 2024-01-20T08:14:05.192 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2e9c155500 0x7f2e9c0c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2e7406aed0 0x7f2e7406d390 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2e9c0c60d0 0x7f2e9c0c0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 --2- 172.21.15.100:0/3778961116 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2e9c0c5180 0x7f2e9c158250 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 >> 172.21.15.100:0/3778961116 conn(0x7f2e9c0ca5a0 msgr2=0x7f2e9c0ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 shutdown_connections 2024-01-20T08:14:05.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.189+0000 7f2ea4400640 1 -- 172.21.15.100:0/3778961116 wait complete. 2024-01-20T08:14:05.209 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:14:05.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.414+0000 7f2738e00640 1 Processor -- start 2024-01-20T08:14:05.417 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.414+0000 7f2738e00640 1 -- start start 2024-01-20T08:14:05.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.415+0000 7f2738e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 0x7f273415cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.418 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2738e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2734154ba0 con 0x7f27341515b0 2024-01-20T08:14:05.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2738e00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2734155a00 con 0x7f273414b720 2024-01-20T08:14:05.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2738e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273414bb00 con 0x7f273406cfe0 2024-01-20T08:14:05.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2729200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f27341515b0 0x7f273406c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40344/0 (socket says 172.21.15.100:40344) 2024-01-20T08:14:05.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2729200640 1 -- 172.21.15.100:0/1382410600 learned_addr learned my addr 172.21.15.100:0/1382410600 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:05.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3374636969 0 0) 0x7f2734154ba0 con 0x7f27341515b0 2024-01-20T08:14:05.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714005730 con 0x7f27341515b0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.416+0000 7f2732800640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 0x7f273415cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 60235688 0 0) 0x7f2714005730 con 0x7f27341515b0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 msgr2=0x7f273415cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 0x7f273415cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 >> v1:172.21.15.110:6789/0 conn(0x7f273414b720 legacy=0x7f27340c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734154df0 con 0x7f27341515b0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f271c001670 con 0x7f27341515b0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 >> v1:172.21.15.100:6789/0 conn(0x7f27341515b0 legacy=0x7f273406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2714005bb0 0x7f2714005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f2714006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 0x7f271400db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273414bb00 con 0x7f27140069d0 2024-01-20T08:14:05.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27140076f0 con 0x7f2714005bb0 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2714007860 con 0x7f273406cfe0 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f2714006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 -- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 msgr2=0x7f271400db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f273406cfe0 0x7f271400db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 -- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2714005bb0 msgr2=0x7f2714005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2714005bb0 0x7f2714005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.417+0000 7f2729200640 1 -- 172.21.15.100:0/1382410600 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714005730 con 0x7f27140069d0 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.418+0000 7f2729200640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f2714006e50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c1c0 tx=0x7f2714007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc40ba9aaa366229 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c005ad0 con 0x7f27140069d0 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c005c30 con 0x7f27140069d0 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2731400640 1 -- 172.21.15.100:0/1382410600 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02c810 con 0x7f27140069d0 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2738e00640 1 -- 172.21.15.100:0/1382410600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 msgr2=0x7f2714006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2738e00640 1 --2- 172.21.15.100:0/1382410600 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f2714006e50 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f271c00c1c0 tx=0x7f2714007a00 comp rx=0 tx=0).stop 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2732800640 1 -- 172.21.15.100:0/1382410600 reap_dead start 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2738e00640 1 -- 172.21.15.100:0/1382410600 shutdown_connections 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2738e00640 1 -- 172.21.15.100:0/1382410600 >> 172.21.15.100:0/1382410600 conn(0x7f27340c2940 msgr2=0x7f27340c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.419+0000 7f2738e00640 1 -- 172.21.15.100:0/1382410600 shutdown_connections 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.420+0000 7f2738e00640 1 -- 172.21.15.100:0/1382410600 wait complete. 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.421+0000 7f2738e00640 1 Processor -- start 2024-01-20T08:14:05.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.421+0000 7f2738e00640 1 -- start start 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27341ed560 0x7f27341456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2734154650 0x7f2734145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734146160 con 0x7f27140069d0 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2734153770 con 0x7f27341ed560 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.422+0000 7f2738e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2734152b60 con 0x7f2734154650 2024-01-20T08:14:05.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42748/0 (socket says 172.21.15.100:42748) 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 -- 172.21.15.100:0/39473545 learned_addr learned my addr 172.21.15.100:0/39473545 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 -- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2734154650 msgr2=0x7f2734145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2734154650 0x7f2734145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 -- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27341ed560 msgr2=0x7f27341456e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2729200640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27341ed560 0x7f27341456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27341ed560 0x7f27341456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 -- 172.21.15.100:0/39473545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2734152e40 con 0x7f27140069d0 2024-01-20T08:14:05.427 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.423+0000 7f2731e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f272400c4b0 tx=0x7f272400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.424+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724012830 con 0x7f27140069d0 2024-01-20T08:14:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.424+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2724012990 con 0x7f27140069d0 2024-01-20T08:14:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.424+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2734153120 con 0x7f27140069d0 2024-01-20T08:14:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.424+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724012d40 con 0x7f27140069d0 2024-01-20T08:14:05.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.424+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27340bfa20 con 0x7f27140069d0 2024-01-20T08:14:05.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.425+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273404e970 con 0x7f27140069d0 2024-01-20T08:14:05.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.426+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f272401b400 con 0x7f27140069d0 2024-01-20T08:14:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.427+0000 7f272aa00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 0x7f270c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.427+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f27240898a0 con 0x7f27140069d0 2024-01-20T08:14:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.427+0000 7f2729200640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 0x7f270c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.428+0000 7f2729200640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 0x7f270c06d3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.431+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2724054350 con 0x7f27140069d0 2024-01-20T08:14:05.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.622+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27340c37e0 con 0x7f27140069d0 2024-01-20T08:14:05.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.623+0000 7f272aa00640 1 -- 172.21.15.100:0/39473545 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2724057970 con 0x7f27140069d0 2024-01-20T08:14:05.626 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 msgr2=0x7f270c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 0x7f270c06d3c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f271c034000 tx=0x7f271c009030 comp rx=0 tx=0).stop 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 msgr2=0x7f27340bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f272400c4b0 tx=0x7f272400c970 comp rx=0 tx=0).stop 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 shutdown_connections 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f270c06af00 0x7f270c06d3c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2734154650 0x7f2734145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f27341ed560 0x7f27341456e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 --2- 172.21.15.100:0/39473545 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f27140069d0 0x7f27340bf4e0 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 >> 172.21.15.100:0/39473545 conn(0x7f27340c2940 msgr2=0x7f273406c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:05.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 shutdown_connections 2024-01-20T08:14:05.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.626+0000 7f2738e00640 1 -- 172.21.15.100:0/39473545 wait complete. 2024-01-20T08:14:05.647 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.854+0000 7f0e37200640 1 Processor -- start 2024-01-20T08:14:05.857 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.854+0000 7f0e37200640 1 -- start start 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.855+0000 7f0e37200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e3014c750 0x7f0e30153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.855+0000 7f0e37200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0e300715a0 0x7f0e30071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.855+0000 7f0e37200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e300ab620 con 0x7f0e300ab0b0 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e37200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3014cb30 con 0x7f0e300715a0 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e37200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e300ab900 con 0x7f0e3014c750 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e2f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f0e300ab0b0 0x7f0e300a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40352/0 (socket says 172.21.15.100:40352) 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e2f400640 1 -- 172.21.15.100:0/2357964141 learned_addr learned my addr 172.21.15.100:0/2357964141 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:05.859 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e35200640 1 --2- 172.21.15.100:0/2357964141 >> v2:172.21.15.100:3300/0 conn(0x7f0e300715a0 0x7f0e30071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e2fe00640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e3014c750 0x7f0e30153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2872826042 0 0) 0x7f0e300ab620 con 0x7f0e300ab0b0 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.856+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e10003520 con 0x7f0e300ab0b0 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.857+0000 7f0e35200640 1 -- 172.21.15.100:0/2357964141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e3014c750 msgr2=0x7f0e30153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.857+0000 7f0e35200640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e3014c750 0x7f0e30153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.857+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3825687034 0 0) 0x7f0e10003520 con 0x7f0e300ab0b0 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.857+0000 7f0e35200640 1 -- 172.21.15.100:0/2357964141 >> v1:172.21.15.100:6789/0 conn(0x7f0e300ab0b0 legacy=0x7f0e300a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.860 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.857+0000 7f0e35200640 1 -- 172.21.15.100:0/2357964141 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300abbe0 con 0x7f0e300715a0 2024-01-20T08:14:05.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.858+0000 7f0e35200640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e300715a0 0x7f0e30071a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3665ec71e3d948 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.858+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18001670 con 0x7f0e300715a0 2024-01-20T08:14:05.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.858+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2802c8a0 con 0x7f0e300715a0 2024-01-20T08:14:05.861 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.858+0000 7f0e2ea00640 1 -- 172.21.15.100:0/2357964141 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2802cc30 con 0x7f0e300715a0 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 -- 172.21.15.100:0/2357964141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e300715a0 msgr2=0x7f0e30071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e300715a0 0x7f0e30071a30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e2802bd70 comp rx=0 tx=0).stop 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 -- 172.21.15.100:0/2357964141 shutdown_connections 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e300715a0 0x7f0e30071a30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 --2- 172.21.15.100:0/2357964141 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e3014c750 0x7f0e30153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 -- 172.21.15.100:0/2357964141 >> 172.21.15.100:0/2357964141 conn(0x7f0e300c6090 msgr2=0x7f0e300c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 -- 172.21.15.100:0/2357964141 shutdown_connections 2024-01-20T08:14:05.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.859+0000 7f0e37200640 1 -- 172.21.15.100:0/2357964141 wait complete. 2024-01-20T08:14:05.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.860+0000 7f0e37200640 1 Processor -- start 2024-01-20T08:14:05.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.861+0000 7f0e37200640 1 -- start start 2024-01-20T08:14:05.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.861+0000 7f0e37200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e300715a0 0x7f0e300bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.864 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.861+0000 7f0e37200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e300ab0b0 0x7f0e3013f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.861+0000 7f0e37200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e37200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301402e0 con 0x7f0e3014c750 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e37200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301ea620 con 0x7f0e300ab0b0 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e37200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e301ea900 con 0x7f0e300715a0 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42756/0 (socket says 172.21.15.100:42756) 2024-01-20T08:14:05.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 -- 172.21.15.100:0/2567107330 learned_addr learned my addr 172.21.15.100:0/2567107330 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 -- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e300715a0 msgr2=0x7f0e300bf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e300715a0 0x7f0e300bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 -- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e300ab0b0 msgr2=0x7f0e3013f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e300ab0b0 0x7f0e3013f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.862+0000 7f0e35200640 1 -- 172.21.15.100:0/2567107330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e28009a70 con 0x7f0e3014c750 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e35200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28034e50 con 0x7f0e3014c750 2024-01-20T08:14:05.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2802ce90 con 0x7f0e3014c750 2024-01-20T08:14:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e301eabe0 con 0x7f0e3014c750 2024-01-20T08:14:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28040690 con 0x7f0e3014c750 2024-01-20T08:14:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.863+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e301eb1a0 con 0x7f0e3014c750 2024-01-20T08:14:05.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.864+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3014dd00 con 0x7f0e3014c750 2024-01-20T08:14:05.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.865+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0e280407f0 con 0x7f0e3014c750 2024-01-20T08:14:05.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.866+0000 7f0e27e00640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 0x7f0e0806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:05.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.866+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f0e280ac3b0 con 0x7f0e3014c750 2024-01-20T08:14:05.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.866+0000 7f0e2fe00640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 0x7f0e0806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:05.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.867+0000 7f0e2fe00640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 0x7f0e0806d390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006a90 tx=0x7f0e20006a20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:05.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:05.870+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0e28076f90 con 0x7f0e3014c750 2024-01-20T08:14:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.063+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0e3004ea50 con 0x7f0e3014c750 2024-01-20T08:14:06.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.063+0000 7f0e27e00640 1 -- 172.21.15.100:0/2567107330 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7f0e28009450 con 0x7f0e3014c750 2024-01-20T08:14:06.066 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 msgr2=0x7f0e0806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 0x7f0e0806d390 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f0e20006a90 tx=0x7f0e20006a20 comp rx=0 tx=0).stop 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 msgr2=0x7f0e3013fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f0e28009d90 tx=0x7f0e28004a40 comp rx=0 tx=0).stop 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 shutdown_connections 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0e3014c750 0x7f0e3013fda0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0e300ab0b0 0x7f0e3013f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0e0806aed0 0x7f0e0806d390 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 --2- 172.21.15.100:0/2567107330 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0e300715a0 0x7f0e300bf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 >> 172.21.15.100:0/2567107330 conn(0x7f0e300c6090 msgr2=0x7f0e3014a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 shutdown_connections 2024-01-20T08:14:06.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.066+0000 7f0e37200640 1 -- 172.21.15.100:0/2567107330 wait complete. 2024-01-20T08:14:06.089 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:06.296 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.293+0000 7fbf5a400640 1 Processor -- start 2024-01-20T08:14:06.297 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.294+0000 7fbf5a400640 1 -- start start 2024-01-20T08:14:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.295+0000 7fbf5a400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbf54158a10 0x7fbf541547c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.295+0000 7fbf5a400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5414ecd0 con 0x7fbf5406d970 2024-01-20T08:14:06.298 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.295+0000 7fbf5a400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf54157e70 con 0x7fbf5414e8f0 2024-01-20T08:14:06.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.295+0000 7fbf5a400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf54154e10 con 0x7fbf54158a10 2024-01-20T08:14:06.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fbf5406d970 0x7fbf54158300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40364/0 (socket says 172.21.15.100:40364) 2024-01-20T08:14:06.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52a00640 1 -- 172.21.15.100:0/2578151466 learned_addr learned my addr 172.21.15.100:0/2578151466 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:06.299 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf53e00640 1 --2- 172.21.15.100:0/2578151466 >> v2:172.21.15.110:3300/0 conn(0x7fbf54158a10 0x7fbf541547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474110850 0 0) 0x7fbf5414ecd0 con 0x7fbf5406d970 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf34003520 con 0x7fbf5406d970 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1098925222 0 0) 0x7fbf34003520 con 0x7fbf5406d970 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 >> v2:172.21.15.110:3300/0 conn(0x7fbf54158a10 msgr2=0x7fbf541547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 --2- 172.21.15.100:0/2578151466 >> v2:172.21.15.110:3300/0 conn(0x7fbf54158a10 0x7fbf541547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 >> v1:172.21.15.110:6789/0 conn(0x7fbf5414e8f0 legacy=0x7fbf5406b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf541550f0 con 0x7fbf5406d970 2024-01-20T08:14:06.301 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fbf3c001670 con 0x7fbf5406d970 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.296+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 >> v1:172.21.15.100:6789/0 conn(0x7fbf5406d970 legacy=0x7fbf54158300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 0x7fbf34003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf340047c0 0x7fbf34004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34005180 0x7fbf3400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf54154e10 con 0x7fbf34003970 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3400c120 con 0x7fbf34005180 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf3400c2e0 con 0x7fbf340047c0 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 0x7fbf34003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 -- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf340047c0 msgr2=0x7fbf34004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf340047c0 0x7fbf34004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53e00640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34005180 0x7fbf3400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 -- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34005180 msgr2=0x7fbf3400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf34005180 0x7fbf3400b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53400640 1 -- 172.21.15.100:0/2578151466 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf34003520 con 0x7fbf34003970 2024-01-20T08:14:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.297+0000 7fbf53e00640 1 -- 172.21.15.100:0/2578151466 reap_dead start 2024-01-20T08:14:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.298+0000 7fbf53400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 0x7fbf34003d90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbf44001750 tx=0x7fbf340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d8e62bf67b68e2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf440052d0 con 0x7fbf34003970 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf4402e050 con 0x7fbf34003970 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf52000640 1 -- 172.21.15.100:0/2578151466 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf44003830 con 0x7fbf34003970 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 -- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 msgr2=0x7fbf34003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 0x7fbf34003d90 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7fbf44001750 tx=0x7fbf340057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 -- 172.21.15.100:0/2578151466 shutdown_connections 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2578151466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf34003970 0x7fbf34003d90 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 -- 172.21.15.100:0/2578151466 >> 172.21.15.100:0/2578151466 conn(0x7fbf540c3170 msgr2=0x7fbf540c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 -- 172.21.15.100:0/2578151466 shutdown_connections 2024-01-20T08:14:06.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.299+0000 7fbf5a400640 1 -- 172.21.15.100:0/2578151466 wait complete. 2024-01-20T08:14:06.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.301+0000 7fbf5a400640 1 Processor -- start 2024-01-20T08:14:06.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.301+0000 7fbf5a400640 1 -- start start 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf34003970 0x7fbf541ea500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf54156e70 0x7fbf541ecff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c4890 con 0x7fbf540c4d20 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf541eaa40 con 0x7fbf54156e70 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf5a400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf540c4260 con 0x7fbf34003970 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf52a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf52a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42766/0 (socket says 172.21.15.100:42766) 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.302+0000 7fbf52a00640 1 -- 172.21.15.100:0/2814308488 learned_addr learned my addr 172.21.15.100:0/2814308488 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf53400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf34003970 0x7fbf541ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf53e00640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf54156e70 0x7fbf541ecff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 -- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf34003970 msgr2=0x7fbf541ea500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf34003970 0x7fbf541ea500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 -- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf54156e70 msgr2=0x7fbf541ecff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf54156e70 0x7fbf541ecff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 -- 172.21.15.100:0/2814308488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf540c5a70 con 0x7fbf540c4d20 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf52a00640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c700 tx=0x7fbf3c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0072d0 con 0x7fbf540c4d20 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf3c007450 con 0x7fbf540c4d20 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf540c5d50 con 0x7fbf540c4d20 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c0047e0 con 0x7fbf540c4d20 2024-01-20T08:14:06.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.303+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf540a9e00 con 0x7fbf540c4d20 2024-01-20T08:14:06.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.305+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5404e970 con 0x7fbf540c4d20 2024-01-20T08:14:06.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.306+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbf3c004960 con 0x7fbf540c4d20 2024-01-20T08:14:06.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.306+0000 7fbf4b400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 0x7fbf2c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.307+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fbf3c089110 con 0x7fbf540c4d20 2024-01-20T08:14:06.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.307+0000 7fbf53400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 0x7fbf2c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.307+0000 7fbf53400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 0x7fbf2c06d390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbf44033000 tx=0x7fbf44009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.311+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbf3c053bc0 con 0x7fbf540c4d20 2024-01-20T08:14:06.505 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.502+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fbf54066750 con 0x7fbf540c4d20 2024-01-20T08:14:06.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.503+0000 7fbf4b400640 1 -- 172.21.15.100:0/2814308488 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7fbf3c0180a0 con 0x7fbf540c4d20 2024-01-20T08:14:06.506 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.505+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 msgr2=0x7fbf2c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.505+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 0x7fbf2c06d390 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fbf44033000 tx=0x7fbf44009030 comp rx=0 tx=0).stop 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 msgr2=0x7fbf540a98c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00c700 tx=0x7fbf3c00cbc0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 shutdown_connections 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbf54156e70 0x7fbf541ecff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbf540c4d20 0x7fbf540a98c0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbf2c06aed0 0x7fbf2c06d390 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 --2- 172.21.15.100:0/2814308488 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbf34003970 0x7fbf541ea500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 >> 172.21.15.100:0/2814308488 conn(0x7fbf540c3170 msgr2=0x7fbf540c3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 shutdown_connections 2024-01-20T08:14:06.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.506+0000 7fbf5a400640 1 -- 172.21.15.100:0/2814308488 wait complete. 2024-01-20T08:14:06.527 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:14:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.735+0000 7fc2e7600640 1 Processor -- start 2024-01-20T08:14:06.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.735+0000 7fc2e7600640 1 -- start start 2024-01-20T08:14:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e006c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e7600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc2e006ce10 0x7fc2e015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e7600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e0154ba0 con 0x7fc2e014b720 2024-01-20T08:14:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e7600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e014bb00 con 0x7fc2e006ce10 2024-01-20T08:14:06.739 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0155a00 con 0x7fc2e01515b0 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e4c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc2e014b720 0x7fc2e00c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40368/0 (socket says 172.21.15.100:40368) 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.736+0000 7fc2e4c00640 1 -- 172.21.15.100:0/1086191754 learned_addr learned my addr 172.21.15.100:0/1086191754 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2e5600640 1 --2- 172.21.15.100:0/1086191754 >> v2:172.21.15.100:3300/0 conn(0x7fc2e006ce10 0x7fc2e015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2d7e00640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e006c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2dfe00640 1 -- 172.21.15.100:0/1086191754 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2958095177 0 0) 0x7fc2e0154ba0 con 0x7fc2e014b720 2024-01-20T08:14:06.740 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2dfe00640 1 -- 172.21.15.100:0/1086191754 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc2c0003520 con 0x7fc2e014b720 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2e5600640 1 -- 172.21.15.100:0/1086191754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 msgr2=0x7fc2e006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2e5600640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e006c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2e5600640 1 -- 172.21.15.100:0/1086191754 >> v1:172.21.15.100:6789/0 conn(0x7fc2e014b720 legacy=0x7fc2e00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.737+0000 7fc2e5600640 1 -- 172.21.15.100:0/1086191754 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e0154df0 con 0x7fc2e006ce10 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.738+0000 7fc2e5600640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e006ce10 0x7fc2e015bf30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=848fe501f3ca8c19 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.738+0000 7fc2dfe00640 1 -- 172.21.15.100:0/1086191754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d802cbd0 con 0x7fc2e006ce10 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.738+0000 7fc2dfe00640 1 -- 172.21.15.100:0/1086191754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d802cd30 con 0x7fc2e006ce10 2024-01-20T08:14:06.741 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.738+0000 7fc2dfe00640 1 -- 172.21.15.100:0/1086191754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d802cea0 con 0x7fc2e006ce10 2024-01-20T08:14:06.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 -- 172.21.15.100:0/1086191754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e006ce10 msgr2=0x7fc2e015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e006ce10 0x7fc2e015bf30 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009d90 tx=0x7fc2d802be20 comp rx=0 tx=0).stop 2024-01-20T08:14:06.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 -- 172.21.15.100:0/1086191754 shutdown_connections 2024-01-20T08:14:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e006ce10 0x7fc2e015bf30 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 --2- 172.21.15.100:0/1086191754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e006c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 -- 172.21.15.100:0/1086191754 >> 172.21.15.100:0/1086191754 conn(0x7fc2e00c2940 msgr2=0x7fc2e00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 -- 172.21.15.100:0/1086191754 shutdown_connections 2024-01-20T08:14:06.743 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.739+0000 7fc2e7600640 1 -- 172.21.15.100:0/1086191754 wait complete. 2024-01-20T08:14:06.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.741+0000 7fc2e7600640 1 Processor -- start 2024-01-20T08:14:06.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.741+0000 7fc2e7600640 1 -- start start 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e006ce10 0x7fc2e0145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e01ea120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e00aa3b0 con 0x7fc2e014b720 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0146350 con 0x7fc2e006ce10 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2e7600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0145b30 con 0x7fc2e01515b0 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42786/0 (socket says 172.21.15.100:42786) 2024-01-20T08:14:06.745 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 -- 172.21.15.100:0/3678910811 learned_addr learned my addr 172.21.15.100:0/3678910811 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 -- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 msgr2=0x7fc2e01ea120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e01ea120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 -- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e006ce10 msgr2=0x7fc2e0145e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.742+0000 7fc2d7e00640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e006ce10 0x7fc2e0145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2d7e00640 1 -- 172.21.15.100:0/3678910811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d8009a70 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2d7e00640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d5f0 tx=0x7fc2c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80125f0 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8012750 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8012b00 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e00c5530 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.743+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e00bfa20 con 0x7fc2e014b720 2024-01-20T08:14:06.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.744+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e004e970 con 0x7fc2e014b720 2024-01-20T08:14:06.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.745+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc2c8012c60 con 0x7fc2e014b720 2024-01-20T08:14:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.746+0000 7fc2dd600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 0x7fc2b806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.747+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fc2c8089ea0 con 0x7fc2e014b720 2024-01-20T08:14:06.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.747+0000 7fc2e4c00640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 0x7fc2b806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:06.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.747+0000 7fc2e4c00640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 0x7fc2b806d390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0000f60 tx=0x7fc2d00078f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:06.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.751+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc2c80549e0 con 0x7fc2e014b720 2024-01-20T08:14:06.817 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:14:06.824 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:14:06.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.962+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2e00aa560 con 0x7fc2e014b720 2024-01-20T08:14:06.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.963+0000 7fc2dd600640 1 -- 172.21.15.100:0/3678910811 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2e00aa560 con 0x7fc2e014b720 2024-01-20T08:14:06.966 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 msgr2=0x7fc2b806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 0x7fc2b806d390 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0000f60 tx=0x7fc2d00078f0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 msgr2=0x7fc2e00bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800d5f0 tx=0x7fc2c800dab0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 shutdown_connections 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc2b806aed0 0x7fc2b806d390 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc2e01515b0 0x7fc2e01ea120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc2e014b720 0x7fc2e00bf4e0 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 --2- 172.21.15.100:0/3678910811 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc2e006ce10 0x7fc2e0145e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:06.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 >> 172.21.15.100:0/3678910811 conn(0x7fc2e00c2940 msgr2=0x7fc2e0150db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:06.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 shutdown_connections 2024-01-20T08:14:06.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:06.966+0000 7fc2e7600640 1 -- 172.21.15.100:0/3678910811 wait complete. 2024-01-20T08:14:06.985 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-01-20T08:14:06.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:06.985 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:07.131 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:14:07.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:07.131 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:14:07.178 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:07.178 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:07.259 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:14:07.259 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-01-20T08:14:07.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.448+0000 7fc3a3600640 1 Processor -- start 2024-01-20T08:14:07.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.449+0000 7fc3a3600640 1 -- start start 2024-01-20T08:14:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.450+0000 7fc3a3600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc39c15cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.450+0000 7fc3a3600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c154ba0 con 0x7fc39c1515b0 2024-01-20T08:14:07.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.450+0000 7fc3a3600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc39c155a00 con 0x7fc39c14b720 2024-01-20T08:14:07.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.450+0000 7fc3a3600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c14bb00 con 0x7fc39c06cfe0 2024-01-20T08:14:07.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc393c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc39c1515b0 0x7fc39c06c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:40380/0 (socket says 172.21.15.100:40380) 2024-01-20T08:14:07.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc393c00640 1 -- 172.21.15.100:0/2152516529 learned_addr learned my addr 172.21.15.100:0/2152516529 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc3a1600640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc39c15cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857233775 0 0) 0x7fc39c154ba0 con 0x7fc39c1515b0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc37c003520 con 0x7fc39c1515b0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3277764770 0 0) 0x7fc37c003520 con 0x7fc39c1515b0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 msgr2=0x7fc39c15cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc39c15cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 >> v1:172.21.15.110:6789/0 conn(0x7fc39c14b720 legacy=0x7fc39c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c154df0 con 0x7fc39c1515b0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fc384001670 con 0x7fc39c1515b0 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 >> v1:172.21.15.100:6789/0 conn(0x7fc39c1515b0 legacy=0x7fc39c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc37c0039a0 0x7fc37c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc37c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004d00 0x7fc37c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c14bb00 con 0x7fc37c0039a0 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c00dd70 con 0x7fc37c004d00 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.451+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc37c00df30 con 0x7fc39c06cfe0 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc37c0039a0 0x7fc37c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc393c00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc37c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a1600640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004d00 0x7fc37c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 -- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 msgr2=0x7fc37c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc39c06cfe0 0x7fc37c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 -- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004d00 msgr2=0x7fc37c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004d00 0x7fc37c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a0c00640 1 -- 172.21.15.100:0/2152516529 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc37c003520 con 0x7fc37c0039a0 2024-01-20T08:14:07.458 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.452+0000 7fc3a1600640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc37c004d00 0x7fc37c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:07.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc37c0039a0 0x7fc37c003dc0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc38c001750 tx=0x7fc37c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2630157fa51d3bb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:07.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0052d0 con 0x7fc37c0039a0 2024-01-20T08:14:07.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38c02e050 con 0x7fc37c0039a0 2024-01-20T08:14:07.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc39be00640 1 -- 172.21.15.100:0/2152516529 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c0035f0 con 0x7fc37c0039a0 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc3a3600640 1 -- 172.21.15.100:0/2152516529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc37c0039a0 msgr2=0x7fc37c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc3a3600640 1 --2- 172.21.15.100:0/2152516529 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc37c0039a0 0x7fc37c003dc0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc38c001750 tx=0x7fc37c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.454+0000 7fc3a1600640 1 -- 172.21.15.100:0/2152516529 reap_dead start 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.455+0000 7fc3a3600640 1 -- 172.21.15.100:0/2152516529 shutdown_connections 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.455+0000 7fc3a3600640 1 -- 172.21.15.100:0/2152516529 >> 172.21.15.100:0/2152516529 conn(0x7fc39c0c2940 msgr2=0x7fc39c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.455+0000 7fc3a3600640 1 -- 172.21.15.100:0/2152516529 shutdown_connections 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.455+0000 7fc3a3600640 1 -- 172.21.15.100:0/2152516529 wait complete. 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.456+0000 7fc3a3600640 1 Processor -- start 2024-01-20T08:14:07.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.456+0000 7fc3a3600640 1 -- start start 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 0x7fc39c0c5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c145c90 0x7fc39c14da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c1e9410 con 0x7fc39c1465f0 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c146110 con 0x7fc39c145c90 2024-01-20T08:14:07.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc3a3600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc39c153ad0 con 0x7fc37c0039a0 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.457+0000 7fc393c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:42798/0 (socket says 172.21.15.100:42798) 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 -- 172.21.15.100:0/1914584005 learned_addr learned my addr 172.21.15.100:0/1914584005 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc3a1600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c145c90 0x7fc39c14da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 0x7fc39c0c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 -- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 msgr2=0x7fc39c0c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 0x7fc39c0c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 -- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c145c90 msgr2=0x7fc39c14da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c145c90 0x7fc39c14da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 -- 172.21.15.100:0/1914584005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc39c1e9130 con 0x7fc39c1465f0 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 0x7fc39c0c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:07.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc393c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc38400e780 tx=0x7fc38400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:07.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.458+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400ee90 con 0x7fc39c1465f0 2024-01-20T08:14:07.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.459+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc38400c870 con 0x7fc39c1465f0 2024-01-20T08:14:07.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.459+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38400cc20 con 0x7fc39c1465f0 2024-01-20T08:14:07.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.459+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39c14cf50 con 0x7fc39c1465f0 2024-01-20T08:14:07.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.459+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39c14d510 con 0x7fc39c1465f0 2024-01-20T08:14:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.460+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc39c14cd90 con 0x7fc39c1465f0 2024-01-20T08:14:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.461+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc384013420 con 0x7fc39c1465f0 2024-01-20T08:14:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.462+0000 7fc399600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 0x7fc37406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.462+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fc3840896e0 con 0x7fc39c1465f0 2024-01-20T08:14:07.465 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.462+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 0x7fc37406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:07.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.463+0000 7fc3a0c00640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 0x7fc37406d3c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc38c033000 tx=0x7fc38c009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:07.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.466+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc384054210 con 0x7fc39c1465f0 2024-01-20T08:14:07.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.699+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc39c04e970 con 0x7fc39c1465f0 2024-01-20T08:14:07.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.700+0000 7fc399600640 1 -- 172.21.15.100:0/1914584005 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v53) v1 ==== 53+0+149 (secure 0 0 0) 0x7fc384057830 con 0x7fc39c1465f0 2024-01-20T08:14:07.703 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-01-20T08:14:07.703 INFO:teuthology.orchestra.run.smithi100.stdout:name: cephfs2, metadata pool: cephfs2_metadata, data pools: [cephfs2_data ] 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.702+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 msgr2=0x7fc37406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.702+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 0x7fc37406d3c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc38c033000 tx=0x7fc38c009030 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.702+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 msgr2=0x7fc39c145750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.702+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7fc38400e780 tx=0x7fc38400ec40 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 shutdown_connections 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc39c145c90 0x7fc39c14da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc39c1465f0 0x7fc39c145750 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc37406af00 0x7fc37406d3c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 --2- 172.21.15.100:0/1914584005 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc37c0039a0 0x7fc39c0c5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 >> 172.21.15.100:0/1914584005 conn(0x7fc39c0c2940 msgr2=0x7fc39c070200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:07.706 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 shutdown_connections 2024-01-20T08:14:07.707 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:07.703+0000 7fc3a3600640 1 -- 172.21.15.100:0/1914584005 wait complete. 2024-01-20T08:14:07.724 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs2; just confirmed its presence on cluster 2024-01-20T08:14:07.724 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-01-20T08:14:07.724 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi110.front.sepia.ceph.com 2024-01-20T08:14:07.724 INFO:tasks.cephfs.mount:self.client.name = client.testuser 2024-01-20T08:14:07.725 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:07.725 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs2 2024-01-20T08:14:07.725 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-01-20T08:14:07.725 INFO:tasks.cephfs.mount:self.client_keyring_path = /tmp/tmp.i6mLTrpIFw 2024-01-20T08:14:07.725 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-20T08:14:07.783 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.iGUy8h7BDZ 2024-01-20T08:14:07.784 DEBUG:teuthology.orchestra.run.smithi110:> sudo cp /tmp/tmp.i6mLTrpIFw /tmp/tmp.iGUy8h7BDZ 2024-01-20T08:14:07.875 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.iGUy8h7BDZ 2024-01-20T08:14:08.023 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.iGUy8h7BDZ is 226B 2024-01-20T08:14:08.082 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.iGUy8h7BDZ 2024-01-20T08:14:08.131 INFO:tasks.cephfs.mount:keyring content - [client.testuser] key = AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg== caps mds = "allow r fsname=cephfs, allow r fsname=cephfs2" caps mon = "allow r" caps osd = "allow r tag cephfs data=cephfs, allow r tag cephfs data=cephfs2" 2024-01-20T08:14:08.131 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:14:08.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.132 DEBUG:teuthology.orchestra.run.smithi110:> ip addr 2024-01-20T08:14:08.181 INFO:teuthology.orchestra.run.smithi110.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: inet 127.0.0.1/8 scope host lo 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 ::1/128 scope host 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:14 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f0 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:d8:db:15 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: altname enp7s0f1 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:34 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-01-20T08:14:08.182 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 0c:c4:7a:8f:cc:35 brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: inet 172.21.15.110/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft 42399sec preferred_lft 42399sec 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::ec4:7aff:fe8f:cc35/64 scope link 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::405e:2eff:feea:2416/64 scope link 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: link/ether 2e:5b:04:d1:7f:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: inet6 fe80::2c5b:4ff:fed1:7f1c/64 scope link 2024-01-20T08:14:08.183 INFO:teuthology.orchestra.run.smithi110.stdout: valid_lft forever preferred_lft forever 2024-01-20T08:14:08.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.185 DEBUG:teuthology.orchestra.run.smithi110:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-01-20T08:14:08.271 INFO:teuthology.orchestra.run.smithi110.stdout:1 2024-01-20T08:14:08.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.275 DEBUG:teuthology.orchestra.run.smithi110:> route 2024-01-20T08:14:08.327 INFO:teuthology.orchestra.run.smithi110.stdout:Kernel IP routing table 2024-01-20T08:14:08.327 INFO:teuthology.orchestra.run.smithi110.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-01-20T08:14:08.328 INFO:teuthology.orchestra.run.smithi110.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-01-20T08:14:08.328 INFO:teuthology.orchestra.run.smithi110.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-01-20T08:14:08.328 INFO:teuthology.orchestra.run.smithi110.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-01-20T08:14:08.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> (cd / && exec bash -c ' 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> set -e 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-01-20T08:14:08.328 DEBUG:teuthology.orchestra.run.smithi110:> ') 2024-01-20T08:14:08.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.502 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:14:08.553 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:14:08.553 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:14:08.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.554 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link set brx.0 up 2024-01-20T08:14:08.647 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:14:08.647 DEBUG:teuthology.orchestra.run.smithi110:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:08.700 INFO:teuthology.orchestra.run.smithi110.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-01-20T08:14:08.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-01-20T08:14:08.701 DEBUG:teuthology.orchestra.run.smithi110:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:08.747 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:08.747 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/tmp/tmp.i6mLTrpIFw of=/dev/stdout 2024-01-20T08:14:08.842 INFO:tasks.cephfs.kernel_mount:mounting using device: testuser@.cephfs2=/ 2024-01-20T08:14:08.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:08.843 DEBUG:teuthology.orchestra.run.smithi110:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs2=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:08.984 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:08.984 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:14:08.984 INFO:teuthology.orchestra.run.smithi110.stdout:keyring.get_secret failed 2024-01-20T08:14:09.018 INFO:teuthology.orchestra.run.smithi110.stdout:parsing options: rw,norequire_active_mds,secret=AQDFgKtlYR1zFxAAUYS05iGdIZ50Y1ljxAGlrg==,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-01-20T08:14:09.019 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-01-20T08:14:09.019 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: resolved to: "172.21.15.100:3300,172.21.15.110:3300,172.21.15.110:3301" 2024-01-20T08:14:09.019 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: trying mount with new device syntax: testuser@10ce7bd0-b73e-4b66-b126-32ffded4722e.cephfs2=/ 2024-01-20T08:14:09.019 INFO:teuthology.orchestra.run.smithi110.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=testuser,ms_mode=prefer-crc,key=testuser,mon_addr=172.21.15.100:3300/172.21.15.110:3300/172.21.15.110:3301" will pass to kernel 2024-01-20T08:14:09.020 INFO:teuthology.orchestra.run.smithi110.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-01-20T08:14:09.020 INFO:teuthology.orchestra.run.smithi110.stdout: You just mounted a file system that supports labels which does not 2024-01-20T08:14:09.020 INFO:teuthology.orchestra.run.smithi110.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-01-20T08:14:09.020 INFO:teuthology.orchestra.run.smithi110.stdout: applications will generate AVC messages and not be allowed access to 2024-01-20T08:14:09.020 INFO:teuthology.orchestra.run.smithi110.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-01-20T08:14:09.026 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-01-20T08:14:09.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:09.026 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:09.107 INFO:teuthology.orchestra.run.smithi110.stderr:chmod: changing permissions of '/home/ubuntu/cephtest/mnt.1': Permission denied 2024-01-20T08:14:09.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:14:09.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:09.112 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2024-01-20T08:14:09.169 INFO:teuthology.orchestra.run.smithi110.stdout:client5548 2024-01-20T08:14:09.169 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:09.169 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:09.215 INFO:tasks.cephfs.caps_helper:test read perm: read file /home/ubuntu/cephtest/mnt.0/testdir/testfile and expect data "self.path = /home/ubuntu/cephtest/mnt.0/testdir/testfile cephfs_name = cephfs cephfs_mntpt = / hostfs_mntpt = /home/ubuntu/cephtest/mnt.0" 2024-01-20T08:14:09.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:09.215 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile) 2024-01-20T08:14:09.272 INFO:teuthology.orchestra.run.smithi100.stderr:cat: /home/ubuntu/cephtest/mnt.0/testdir/testfile: Permission denied 2024-01-20T08:14:09.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:14:09.273 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:09.273 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:09.322 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:09.323 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:09.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:09.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.626+0000 7fecbf200640 1 Processor -- start 2024-01-20T08:14:09.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.626+0000 7fecbf200640 1 -- start start 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.627+0000 7fecbf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 0x7fecb80abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecbf200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fecb8151f60 0x7fecb8070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecbf200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80c1670 con 0x7fecb80c1b00 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecbf200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb81524b0 con 0x7fecb8151f60 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecbf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80c0d40 con 0x7fecb8147f20 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fecb8151f60 0x7fecb8070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fecb8151f60 0x7fecb8070370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36082/0 (socket says 172.21.15.100:36082) 2024-01-20T08:14:09.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 -- 172.21.15.100:0/4219461685 learned_addr learned my addr 172.21.15.100:0/4219461685 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7e00640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 0x7fecb80abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 -- 172.21.15.100:0/4219461685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 msgr2=0x7fecb80abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 0x7fecb80abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 -- 172.21.15.100:0/4219461685 >> v1:172.21.15.110:6789/0 conn(0x7fecb80c1b00 legacy=0x7fecb80c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7400640 1 -- 172.21.15.100:0/4219461685 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb80c1020 con 0x7fecb8151f60 2024-01-20T08:14:09.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.628+0000 7fecb7e00640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 0x7fecb80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:09.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.630+0000 7fecb7400640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8070370 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feca0009870 tx=0x7feca002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8dd3d50465707a6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:09.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.630+0000 7fecb6a00640 1 -- 172.21.15.100:0/4219461685 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0031640 con 0x7fecb8151f60 2024-01-20T08:14:09.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.630+0000 7fecb6a00640 1 -- 172.21.15.100:0/4219461685 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca00317a0 con 0x7fecb8151f60 2024-01-20T08:14:09.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.630+0000 7fecb6a00640 1 -- 172.21.15.100:0/4219461685 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca0031b30 con 0x7fecb8151f60 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 -- 172.21.15.100:0/4219461685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 msgr2=0x7fecb8070370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8070370 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feca0009870 tx=0x7feca002b8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 -- 172.21.15.100:0/4219461685 shutdown_connections 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8070370 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 --2- 172.21.15.100:0/4219461685 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb8147f20 0x7fecb80abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 -- 172.21.15.100:0/4219461685 >> 172.21.15.100:0/4219461685 conn(0x7fecb806a5e0 msgr2=0x7fecb806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 -- 172.21.15.100:0/4219461685 shutdown_connections 2024-01-20T08:14:09.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.631+0000 7fecbf200640 1 -- 172.21.15.100:0/4219461685 wait complete. 2024-01-20T08:14:09.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.632+0000 7fecbf200640 1 Processor -- start 2024-01-20T08:14:09.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.633+0000 7fecbf200640 1 -- start start 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.633+0000 7fecbf200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb80c1b00 0x7fecb80bf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.633+0000 7fecbf200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb8147f20 0x7fecb81ea330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbf200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbf200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb814f300 con 0x7fecb8151f60 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbf200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8152a20 con 0x7fecb8147f20 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbf200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb814b7e0 con 0x7fecb80c1b00 2024-01-20T08:14:09.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36088/0 (socket says 172.21.15.100:36088) 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 -- 172.21.15.100:0/1968724832 learned_addr learned my addr 172.21.15.100:0/1968724832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecb7e00640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb80c1b00 0x7fecb80bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecb7400640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb8147f20 0x7fecb81ea330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 -- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb80c1b00 msgr2=0x7fecb80bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb80c1b00 0x7fecb80bf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 -- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb8147f20 msgr2=0x7fecb81ea330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb8147f20 0x7fecb81ea330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.634+0000 7fecbd200640 1 -- 172.21.15.100:0/1968724832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca00094d0 con 0x7fecb8151f60 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecbd200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fecb000b410 tx=0x7fecb000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0004020 con 0x7fecb8151f60 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb0004180 con 0x7fecb8151f60 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb81ee6a0 con 0x7fecb8151f60 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb0011630 con 0x7fecb8151f60 2024-01-20T08:14:09.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.635+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb814f7f0 con 0x7fecb8151f60 2024-01-20T08:14:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.636+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb8155a70 con 0x7fecb8151f60 2024-01-20T08:14:09.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.637+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fecb0011790 con 0x7fecb8151f60 2024-01-20T08:14:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.638+0000 7fecafe00640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 0x7fec9006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.638+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fecb0089640 con 0x7fecb8151f60 2024-01-20T08:14:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.638+0000 7fecb7e00640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 0x7fec9006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:09.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.639+0000 7fecb7e00640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 0x7fec9006d390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7feca8008f80 tx=0x7feca80084d0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:09.645 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.642+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fecb0054190 con 0x7fecb8151f60 2024-01-20T08:14:09.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.834+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecb8147a60 con 0x7fecb8151f60 2024-01-20T08:14:09.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.838+0000 7fecafe00640 1 -- 172.21.15.100:0/1968724832 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7fecb00577b0 con 0x7fecb8151f60 2024-01-20T08:14:09.841 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:09.841 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 msgr2=0x7fec9006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 0x7fec9006d390 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7feca8008f80 tx=0x7feca80084d0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 msgr2=0x7fecb8140dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7fecb000b410 tx=0x7fecb000b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 shutdown_connections 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fecb8151f60 0x7fecb8140dd0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.844 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fecb8147f20 0x7fecb81ea330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fec9006aed0 0x7fec9006d390 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 --2- 172.21.15.100:0/1968724832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fecb80c1b00 0x7fecb80bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 >> 172.21.15.100:0/1968724832 conn(0x7fecb806a5e0 msgr2=0x7fecb806ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 shutdown_connections 2024-01-20T08:14:09.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:09.841+0000 7fecbf200640 1 -- 172.21.15.100:0/1968724832 wait complete. 2024-01-20T08:14:09.864 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:14:09.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:14:10.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.069+0000 7f80ba200640 1 Processor -- start 2024-01-20T08:14:10.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.069+0000 7f80ba200640 1 -- start start 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80ba200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80b414b720 0x7f80b41515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80ba200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f80b40c1d00 0x7f80b406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80ba200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b4154ba0 con 0x7f80b40c1850 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80ba200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b414bb00 con 0x7f80b414b720 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80ba200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b4155a00 con 0x7f80b40c1d00 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80b3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80b414b720 0x7f80b41515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80b3400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f80b414b720 0x7f80b41515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36094/0 (socket says 172.21.15.100:36094) 2024-01-20T08:14:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.071+0000 7f80b3400640 1 -- 172.21.15.100:0/689711973 learned_addr learned my addr 172.21.15.100:0/689711973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:10.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.072+0000 7f80b3400640 1 -- 172.21.15.100:0/689711973 >> v2:172.21.15.110:3300/0 conn(0x7f80b40c1d00 msgr2=0x7f80b406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.072+0000 7f80b3400640 1 --2- 172.21.15.100:0/689711973 >> v2:172.21.15.110:3300/0 conn(0x7f80b40c1d00 0x7f80b406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.072+0000 7f80b3400640 1 -- 172.21.15.100:0/689711973 >> v1:172.21.15.110:6789/0 conn(0x7f80b40c1850 legacy=0x7f80b406c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.072+0000 7f80b3400640 1 -- 172.21.15.100:0/689711973 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b4154df0 con 0x7f80b414b720 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80b3400640 1 --2- 172.21.15.100:0/689711973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b414b720 0x7f80b41515b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f80b4074650 tx=0x7f80a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=423bcceebf2892fa server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80b2a00640 1 -- 172.21.15.100:0/689711973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a40317e0 con 0x7f80b414b720 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80b2a00640 1 -- 172.21.15.100:0/689711973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80a4031940 con 0x7f80b414b720 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80b2a00640 1 -- 172.21.15.100:0/689711973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80a4031cd0 con 0x7f80b414b720 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80ba200640 1 -- 172.21.15.100:0/689711973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b414b720 msgr2=0x7f80b41515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.073+0000 7f80ba200640 1 --2- 172.21.15.100:0/689711973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b414b720 0x7f80b41515b0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f80b4074650 tx=0x7f80a402b880 comp rx=0 tx=0).stop 2024-01-20T08:14:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 -- 172.21.15.100:0/689711973 shutdown_connections 2024-01-20T08:14:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 --2- 172.21.15.100:0/689711973 >> v2:172.21.15.110:3300/0 conn(0x7f80b40c1d00 0x7f80b406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 --2- 172.21.15.100:0/689711973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b414b720 0x7f80b41515b0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 -- 172.21.15.100:0/689711973 >> 172.21.15.100:0/689711973 conn(0x7f80b40c2940 msgr2=0x7f80b40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 -- 172.21.15.100:0/689711973 shutdown_connections 2024-01-20T08:14:10.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.074+0000 7f80ba200640 1 -- 172.21.15.100:0/689711973 wait complete. 2024-01-20T08:14:10.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.075+0000 7f80ba200640 1 Processor -- start 2024-01-20T08:14:10.078 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.075+0000 7f80ba200640 1 -- start start 2024-01-20T08:14:10.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b40c1850 0x7f80b41dd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.079 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 0x7f80b4153a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41dc460 con 0x7f80b40c1d00 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41dd590 con 0x7f80b414b720 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.076+0000 7f80ba200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b41535d0 con 0x7f80b40c1850 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36110/0 (socket says 172.21.15.100:36110) 2024-01-20T08:14:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 -- 172.21.15.100:0/2151698199 learned_addr learned my addr 172.21.15.100:0/2151698199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:10.081 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80b3400640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b40c1850 0x7f80b41dd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 -- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b40c1850 msgr2=0x7f80b41dd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b40c1850 0x7f80b41dd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 -- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 msgr2=0x7f80b4153a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80b3e00640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 0x7f80b4153a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 0x7f80b4153a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80aa800640 1 -- 172.21.15.100:0/2151698199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a40094d0 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.077+0000 7f80b3e00640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 0x7f80b4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80aa800640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c7c0 tx=0x7f809c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c00aa50 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c00abb0 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b40aa280 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c012420 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.078+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b40bfa20 con 0x7f80b40c1d00 2024-01-20T08:14:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.079+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b404e970 con 0x7f80b40c1d00 2024-01-20T08:14:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.080+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f809c012580 con 0x7f80b40c1d00 2024-01-20T08:14:10.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.081+0000 7f80abe00640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 0x7f808c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.081+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f809c089cf0 con 0x7f80b40c1d00 2024-01-20T08:14:10.084 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.081+0000 7f80b3400640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 0x7f808c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.085 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.082+0000 7f80b3400640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 0x7f808c06d390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f80a4036000 tx=0x7f80a403d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.088 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.085+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f809c054830 con 0x7f80b40c1d00 2024-01-20T08:14:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.282+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80b40c37e0 con 0x7f80b40c1d00 2024-01-20T08:14:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.283+0000 7f80abe00640 1 -- 172.21.15.100:0/2151698199 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f809c0160a0 con 0x7f80b40c1d00 2024-01-20T08:14:10.286 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 msgr2=0x7f808c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 0x7f808c06d390 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f80a4036000 tx=0x7f80a403d040 comp rx=0 tx=0).stop 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 msgr2=0x7f80b40bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f809c00c7c0 tx=0x7f809c00cc80 comp rx=0 tx=0).stop 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 shutdown_connections 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f80b414b720 0x7f80b4153a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80b40c1d00 0x7f80b40bf4e0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f808c06aed0 0x7f808c06d390 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 --2- 172.21.15.100:0/2151698199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f80b40c1850 0x7f80b41dd050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 >> 172.21.15.100:0/2151698199 conn(0x7f80b40c2940 msgr2=0x7f80b40c4f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 shutdown_connections 2024-01-20T08:14:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.286+0000 7f80ba200640 1 -- 172.21.15.100:0/2151698199 wait complete. 2024-01-20T08:14:10.309 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:14:10.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.518+0000 7fa701000640 1 Processor -- start 2024-01-20T08:14:10.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.518+0000 7fa701000640 1 -- start start 2024-01-20T08:14:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.519+0000 7fa701000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa6fc0ab0b0 0x7fa6fc153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.519+0000 7fa701000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0ab620 con 0x7fa6fc0715a0 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.519+0000 7fa701000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6fc0ab900 con 0x7fa6fc14c750 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.519+0000 7fa701000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6fc14cb30 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6f3e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fa6fc0ab0b0 0x7fa6fc153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6fa800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fa6fc0715a0 0x7fa6fc071a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41968/0 (socket says 172.21.15.100:41968) 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6fa800640 1 -- 172.21.15.100:0/4013980459 learned_addr learned my addr 172.21.15.100:0/4013980459 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4013980459 >> v1:172.21.15.110:6789/0 conn(0x7fa6fc14c750 legacy=0x7fa6fc0a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4013980459 >> v1:172.21.15.100:6789/0 conn(0x7fa6fc0715a0 legacy=0x7fa6fc071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.520+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4013980459 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc0abbe0 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.521+0000 7fa6f3e00640 1 --2- 172.21.15.100:0/4013980459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc153190 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097a0 tx=0x7fa6e402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c8ead45e411172 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.521+0000 7fa6f9400640 1 -- 172.21.15.100:0/4013980459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4031830 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.521+0000 7fa6f9400640 1 -- 172.21.15.100:0/4013980459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e4031990 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.521+0000 7fa6f9400640 1 -- 172.21.15.100:0/4013980459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e4031d20 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 -- 172.21.15.100:0/4013980459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 msgr2=0x7fa6fc153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 --2- 172.21.15.100:0/4013980459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc153190 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fa6e40097a0 tx=0x7fa6e402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 -- 172.21.15.100:0/4013980459 shutdown_connections 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 --2- 172.21.15.100:0/4013980459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc153190 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 -- 172.21.15.100:0/4013980459 >> 172.21.15.100:0/4013980459 conn(0x7fa6fc0c6090 msgr2=0x7fa6fc0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:10.525 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 -- 172.21.15.100:0/4013980459 shutdown_connections 2024-01-20T08:14:10.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.522+0000 7fa701000640 1 -- 172.21.15.100:0/4013980459 wait complete. 2024-01-20T08:14:10.526 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.524+0000 7fa701000640 1 Processor -- start 2024-01-20T08:14:10.527 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.524+0000 7fa701000640 1 -- start start 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 0x7fa6fc1edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6fc14c750 0x7fa6fc147ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc06cf40 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc147620 con 0x7fa6fc0715a0 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa701000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc0bf6a0 con 0x7fa6fc14c750 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6f3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36134/0 (socket says 172.21.15.100:36134) 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4166115053 learned_addr learned my addr 172.21.15.100:0/4166115053 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6f9e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 0x7fa6fc1edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6fc14c750 msgr2=0x7fa6fc147ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.525+0000 7fa6fa800640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6fc14c750 0x7fa6fc147ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f3e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6fc14c750 0x7fa6fc147ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 msgr2=0x7fa6fc1edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f3e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 0x7fa6fc1edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f3e00640 1 -- 172.21.15.100:0/4166115053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4009400 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f9e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 0x7fa6fc1edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f3e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000c00 tx=0x7fa6e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e403aa60 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6e403abc0 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc06c380 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e40443f0 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.526+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc1472b0 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.528+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc147790 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.531 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.528+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fa6e404d450 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.529+0000 7fa6f2000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 0x7fa6d406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.529+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fa6e40abb90 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.529+0000 7fa6f9e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 0x7fa6d406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.533 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.530+0000 7fa6f9e00640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 0x7fa6d406d3c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec003eb0 tx=0x7fa6ec009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.536 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.534+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fa6e40766d0 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.723+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa6fc04ea50 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.726 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.724+0000 7fa6f2000640 1 -- 172.21.15.100:0/4166115053 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa6e4035020 con 0x7fa6fc0ab0b0 2024-01-20T08:14:10.727 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 msgr2=0x7fa6d406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 0x7fa6d406d3c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec003eb0 tx=0x7fa6ec009040 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 msgr2=0x7fa6fc1df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4000c00 tx=0x7fa6e40046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 shutdown_connections 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fa6d406af00 0x7fa6d406d3c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fa6fc14c750 0x7fa6fc147ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa6fc0ab0b0 0x7fa6fc1df600 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 --2- 172.21.15.100:0/4166115053 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fa6fc0715a0 0x7fa6fc1edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.726+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 >> 172.21.15.100:0/4166115053 conn(0x7fa6fc0c6090 msgr2=0x7fa6fc0a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.727+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 shutdown_connections 2024-01-20T08:14:10.730 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.727+0000 7fa701000640 1 -- 172.21.15.100:0/4166115053 wait complete. 2024-01-20T08:14:10.749 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:14:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.957+0000 7f2ae7200640 1 Processor -- start 2024-01-20T08:14:10.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.957+0000 7f2ae7200640 1 -- start start 2024-01-20T08:14:10.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ae00a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae7200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae0156710 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae7200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ae0155b00 con 0x7f2ae00a5240 2024-01-20T08:14:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae014fff0 con 0x7f2ae014fc10 2024-01-20T08:14:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae5400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2ae00c4ed0 0x7f2ae00c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41980/0 (socket says 172.21.15.100:41980) 2024-01-20T08:14:10.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae5400640 1 -- 172.21.15.100:0/3157869420 learned_addr learned my addr 172.21.15.100:0/3157869420 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1699409431 0 0) 0x7f2ae0156710 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae5e00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ae00a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.959+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ac0003520 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3660526745 0 0) 0x7f2ac0003520 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 msgr2=0x7f2ae00a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ae00a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 >> v1:172.21.15.110:6789/0 conn(0x7f2ae00a5240 legacy=0x7f2ae00c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae0155de0 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f2ac8001670 con 0x7f2ae00c4ed0 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 >> v1:172.21.15.100:6789/0 conn(0x7f2ae00c4ed0 legacy=0x7f2ae00c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac00039a0 0x7f2ac0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ac00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0004d00 0x7f2ac0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae014fff0 con 0x7f2ac0004d00 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bb40 con 0x7f2ac00039a0 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ac000bd00 con 0x7f2ae014fc10 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0004d00 0x7f2ac0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.960+0000 7f2ae5400640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ac00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae5e00640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac00039a0 0x7f2ac0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae6800640 1 -- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 msgr2=0x7f2ac00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae014fc10 0x7f2ac00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae6800640 1 -- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac00039a0 msgr2=0x7f2ac0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac00039a0 0x7f2ac0003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.961+0000 7f2ae6800640 1 -- 172.21.15.100:0/3157869420 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ac0003520 con 0x7f2ac0004d00 2024-01-20T08:14:10.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.962+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0004d00 0x7f2ac0005180 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8001e50 tx=0x7f2ac00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d45b05a5f6d88d server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.962+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8003b70 con 0x7f2ac0004d00 2024-01-20T08:14:10.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.962+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8003cd0 con 0x7f2ac0004d00 2024-01-20T08:14:10.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.962+0000 7f2ae4a00640 1 -- 172.21.15.100:0/3157869420 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8005310 con 0x7f2ac0004d00 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 -- 172.21.15.100:0/3157869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0004d00 msgr2=0x7f2ac0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3157869420 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ac0004d00 0x7f2ac0005180 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f2ad8001e50 tx=0x7f2ac00057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae6800640 1 -- 172.21.15.100:0/3157869420 reap_dead start 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 -- 172.21.15.100:0/3157869420 shutdown_connections 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 -- 172.21.15.100:0/3157869420 >> 172.21.15.100:0/3157869420 conn(0x7f2ae00c5ba0 msgr2=0x7f2ae00c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 -- 172.21.15.100:0/3157869420 shutdown_connections 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.963+0000 7f2ae7200640 1 -- 172.21.15.100:0/3157869420 wait complete. 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.964+0000 7f2ae7200640 1 Processor -- start 2024-01-20T08:14:10.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 -- start start 2024-01-20T08:14:10.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac0004d00 0x7f2ae014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae0149e00 0x7f2ae014a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0150c20 con 0x7f2ae014d540 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae01527b0 con 0x7f2ac0004d00 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.965+0000 7f2ae7200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ae0153050 con 0x7f2ae0149e00 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36152/0 (socket says 172.21.15.100:36152) 2024-01-20T08:14:10.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 -- 172.21.15.100:0/3454361178 learned_addr learned my addr 172.21.15.100:0/3454361178 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 -- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae0149e00 msgr2=0x7f2ae014a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae0149e00 0x7f2ae014a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 -- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac0004d00 msgr2=0x7f2ae014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac0004d00 0x7f2ae014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 -- 172.21.15.100:0/3454361178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae01534e0 con 0x7f2ae014d540 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.966+0000 7f2ae6800640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2ad802c060 tx=0x7f2ad80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.967+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad803e070 con 0x7f2ae014d540 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.967+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ad8003e40 con 0x7f2ae014d540 2024-01-20T08:14:10.970 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.967+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad8006d90 con 0x7f2ae014d540 2024-01-20T08:14:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.967+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ae0150340 con 0x7f2ae014d540 2024-01-20T08:14:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.967+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae0152a00 con 0x7f2ae014d540 2024-01-20T08:14:10.971 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.968+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ae0067b60 con 0x7f2ae014d540 2024-01-20T08:14:10.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.969+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2ad8007030 con 0x7f2ae014d540 2024-01-20T08:14:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.970+0000 7f2ade000640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 0x7f2ab806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.970+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f2ad80aaba0 con 0x7f2ae014d540 2024-01-20T08:14:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.970+0000 7f2ae5e00640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 0x7f2ab806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:10.973 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.971+0000 7f2ae5e00640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 0x7f2ab806d390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009950 tx=0x7f2ad0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:10.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:10.974+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f2ad8075780 con 0x7f2ae014d540 2024-01-20T08:14:11.171 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.168+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ae004e970 con 0x7f2ae014d540 2024-01-20T08:14:11.172 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.169+0000 7f2ade000640 1 -- 172.21.15.100:0/3454361178 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2ad8048070 con 0x7f2ae014d540 2024-01-20T08:14:11.172 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 msgr2=0x7f2ab806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 0x7f2ab806d390 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f2ad0009950 tx=0x7f2ad0008040 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 msgr2=0x7f2ae014d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f2ad802c060 tx=0x7f2ad80014a0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 shutdown_connections 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2ae014d540 0x7f2ae014d9c0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2ab806aed0 0x7f2ab806d390 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2ae0149e00 0x7f2ae014a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 --2- 172.21.15.100:0/3454361178 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2ac0004d00 0x7f2ae014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 >> 172.21.15.100:0/3454361178 conn(0x7f2ae00c5ba0 msgr2=0x7f2ae00a8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 shutdown_connections 2024-01-20T08:14:11.175 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.172+0000 7f2ae7200640 1 -- 172.21.15.100:0/3454361178 wait complete. 2024-01-20T08:14:11.193 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.398+0000 7f3246600640 1 Processor -- start 2024-01-20T08:14:11.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.398+0000 7f3246600640 1 -- start start 2024-01-20T08:14:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.399+0000 7f3246600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f324006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.402 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.399+0000 7f3246600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f324006d220 con 0x7f32400c05a0 2024-01-20T08:14:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.399+0000 7f3246600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32401557a0 con 0x7f32401481a0 2024-01-20T08:14:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.399+0000 7f3246600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324006dbf0 con 0x7f3240155200 2024-01-20T08:14:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.400+0000 7f3236800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f32400c05a0 0x7f3240154af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:41996/0 (socket says 172.21.15.100:41996) 2024-01-20T08:14:11.403 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.400+0000 7f3236800640 1 -- 172.21.15.100:0/3695057326 learned_addr learned my addr 172.21.15.100:0/3695057326 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.400+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236879042 0 0) 0x7f324006d220 con 0x7f32400c05a0 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.400+0000 7f323fe00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f324006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.400+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3220003520 con 0x7f32400c05a0 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3757138515 0 0) 0x7f3220003520 con 0x7f32400c05a0 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 msgr2=0x7f324006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f324006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 >> v1:172.21.15.110:6789/0 conn(0x7f32401481a0 legacy=0x7f32400701e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f324006c8f0 con 0x7f32400c05a0 2024-01-20T08:14:11.405 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3228001670 con 0x7f32400c05a0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 >> v1:172.21.15.100:6789/0 conn(0x7f32400c05a0 legacy=0x7f3240154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3220003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32200047c0 0x7f3220004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f32200051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324006dbf0 con 0x7f32200039a0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f322000bab0 con 0x7f32200047c0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f322000bc70 con 0x7f3240155200 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323f400640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3220003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f323fe00640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f32200051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.401+0000 7f3236800640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32200047c0 0x7f3220004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f323f400640 1 -- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 msgr2=0x7f32200051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f323f400640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240155200 0x7f32200051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f323f400640 1 -- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32200047c0 msgr2=0x7f3220004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f323f400640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32200047c0 0x7f3220004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.406 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f323f400640 1 -- 172.21.15.100:0/3695057326 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3220003520 con 0x7f32200039a0 2024-01-20T08:14:11.407 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.402+0000 7f3236800640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32200047c0 0x7f3220004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.403+0000 7f323f400640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3220003dc0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3230001750 tx=0x7f32200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdbf16b5a21a00e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.403+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300052d0 con 0x7f32200039a0 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.403+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323002e050 con 0x7f32200039a0 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.403+0000 7f323ea00640 1 -- 172.21.15.100:0/3695057326 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300035f0 con 0x7f32200039a0 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 -- 172.21.15.100:0/3695057326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 msgr2=0x7f3220003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 --2- 172.21.15.100:0/3695057326 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3220003dc0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f3230001750 tx=0x7f32200057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f323fe00640 1 -- 172.21.15.100:0/3695057326 reap_dead start 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 -- 172.21.15.100:0/3695057326 shutdown_connections 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 -- 172.21.15.100:0/3695057326 >> 172.21.15.100:0/3695057326 conn(0x7f32400c6090 msgr2=0x7f32400c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 -- 172.21.15.100:0/3695057326 shutdown_connections 2024-01-20T08:14:11.408 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.404+0000 7f3246600640 1 -- 172.21.15.100:0/3695057326 wait complete. 2024-01-20T08:14:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.406+0000 7f3246600640 1 Processor -- start 2024-01-20T08:14:11.409 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.406+0000 7f3246600640 1 -- start start 2024-01-20T08:14:11.410 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32401423e0 0x7f3240153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240150b90 0x7f3240153e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32401514c0 con 0x7f32200039a0 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3240149090 con 0x7f32401423e0 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3246600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32401419f0 con 0x7f3240150b90 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36180/0 (socket says 172.21.15.100:36180) 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 -- 172.21.15.100:0/2259390468 learned_addr learned my addr 172.21.15.100:0/2259390468 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323fe00640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240150b90 0x7f3240153e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f3236800640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32401423e0 0x7f3240153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 -- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240150b90 msgr2=0x7f3240153e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240150b90 0x7f3240153e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 -- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32401423e0 msgr2=0x7f3240153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.407+0000 7f323f400640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32401423e0 0x7f3240153920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.411 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f323f400640 1 -- 172.21.15.100:0/2259390468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3240154c50 con 0x7f32200039a0 2024-01-20T08:14:11.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f323f400640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3230008fd0 tx=0x7f3230001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230007a30 con 0x7f32200039a0 2024-01-20T08:14:11.412 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32300067d0 con 0x7f32200039a0 2024-01-20T08:14:11.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230006b80 con 0x7f32200039a0 2024-01-20T08:14:11.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3240154f30 con 0x7f32200039a0 2024-01-20T08:14:11.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.408+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32401432b0 con 0x7f32200039a0 2024-01-20T08:14:11.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.409+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32400a9540 con 0x7f32200039a0 2024-01-20T08:14:11.413 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.410+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3230006ce0 con 0x7f32200039a0 2024-01-20T08:14:11.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.411+0000 7f3237e00640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 0x7f321806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.411+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f32300ab590 con 0x7f32200039a0 2024-01-20T08:14:11.414 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.412+0000 7f3236800640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 0x7f321806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.415 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.412+0000 7f3236800640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 0x7f321806d3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3228001010 tx=0x7f3228001b40 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.419 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.416+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f32300760d0 con 0x7f32200039a0 2024-01-20T08:14:11.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.593+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f324004ea50 con 0x7f32200039a0 2024-01-20T08:14:11.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.594+0000 7f3237e00640 1 -- 172.21.15.100:0/2259390468 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7f32300796f0 con 0x7f32200039a0 2024-01-20T08:14:11.597 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 msgr2=0x7f321806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 0x7f321806d3c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3228001010 tx=0x7f3228001b40 comp rx=0 tx=0).stop 2024-01-20T08:14:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 msgr2=0x7f3240142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.600 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f3230008fd0 tx=0x7f3230001120 comp rx=0 tx=0).stop 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 shutdown_connections 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f321806af00 0x7f321806d3c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3240150b90 0x7f3240153e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f32401423e0 0x7f3240153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 --2- 172.21.15.100:0/2259390468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f32200039a0 0x7f3240142d70 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.596+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 >> 172.21.15.100:0/2259390468 conn(0x7f32400c6090 msgr2=0x7f32401471d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.597+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 shutdown_connections 2024-01-20T08:14:11.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.597+0000 7f3246600640 1 -- 172.21.15.100:0/2259390468 wait complete. 2024-01-20T08:14:11.617 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:11.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.820+0000 7f3907800640 1 Processor -- start 2024-01-20T08:14:11.823 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.820+0000 7f3907800640 1 -- start start 2024-01-20T08:14:11.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.821+0000 7f3907800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f390006d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.821+0000 7f3907800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f39000c2430 0x7f390006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.821+0000 7f3907800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39000ab2f0 con 0x7f39001542d0 2024-01-20T08:14:11.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.821+0000 7f3907800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390006e1e0 con 0x7f39000c2430 2024-01-20T08:14:11.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.821+0000 7f3907800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39000ab5d0 con 0x7f390014e4e0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f3905800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f39001542d0 0x7f3900154780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42000/0 (socket says 172.21.15.100:42000) 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f3905800640 1 -- 172.21.15.100:0/2949044899 learned_addr learned my addr 172.21.15.100:0/2949044899 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ffe00640 1 --2- 172.21.15.100:0/2949044899 >> v2:172.21.15.100:3300/0 conn(0x7f39000c2430 0x7f390006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f3904e00640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f390006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ff400640 1 -- 172.21.15.100:0/2949044899 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153765674 0 0) 0x7f39000ab2f0 con 0x7f39001542d0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ff400640 1 -- 172.21.15.100:0/2949044899 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38e0005730 con 0x7f39001542d0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ffe00640 1 -- 172.21.15.100:0/2949044899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 msgr2=0x7f390006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ffe00640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f390006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ffe00640 1 -- 172.21.15.100:0/2949044899 >> v1:172.21.15.100:6789/0 conn(0x7f39001542d0 legacy=0x7f3900154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f38ffe00640 1 -- 172.21.15.100:0/2949044899 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39000ab8b0 con 0x7f39000c2430 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.822+0000 7f3904e00640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f390006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.824+0000 7f38ffe00640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f390006d8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097a0 tx=0x7f38e802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fa77531b774458 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.824+0000 7f38ff400640 1 -- 172.21.15.100:0/2949044899 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8031780 con 0x7f39000c2430 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.824+0000 7f38ff400640 1 -- 172.21.15.100:0/2949044899 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e80318e0 con 0x7f39000c2430 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.824+0000 7f38ff400640 1 -- 172.21.15.100:0/2949044899 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e8031c70 con 0x7f39000c2430 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 -- 172.21.15.100:0/2949044899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 msgr2=0x7f390006d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f390006d8d0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f38e80097a0 tx=0x7f38e802b820 comp rx=0 tx=0).stop 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 -- 172.21.15.100:0/2949044899 shutdown_connections 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f390006d8d0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 --2- 172.21.15.100:0/2949044899 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f390006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 -- 172.21.15.100:0/2949044899 >> 172.21.15.100:0/2949044899 conn(0x7f39000c2940 msgr2=0x7f39000c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 -- 172.21.15.100:0/2949044899 shutdown_connections 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.825+0000 7f3907800640 1 -- 172.21.15.100:0/2949044899 wait complete. 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.826+0000 7f3907800640 1 Processor -- start 2024-01-20T08:14:11.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.826+0000 7f3907800640 1 -- start start 2024-01-20T08:14:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f3900148240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39001542d0 0x7f3900148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900148cc0 con 0x7f39000c2430 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900149370 con 0x7f39001542d0 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.827+0000 7f3907800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39001edff0 con 0x7f390014e4e0 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36194/0 (socket says 172.21.15.100:36194) 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 -- 172.21.15.100:0/3361463847 learned_addr learned my addr 172.21.15.100:0/3361463847 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 -- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 msgr2=0x7f3900148240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f38ffe00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f3900148240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f3900148240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 -- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39001542d0 msgr2=0x7f3900148780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39001542d0 0x7f3900148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:11.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 -- 172.21.15.100:0/3361463847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38e8009400 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.828+0000 7f3904e00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f38f000d7d0 tx=0x7f38f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.829+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0004030 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.829+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f0004190 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.829+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f0004520 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.829+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3900149610 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.829+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3900073db0 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.830+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39001497a0 con 0x7f39000c2430 2024-01-20T08:14:11.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.831+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f38f00096a0 con 0x7f39000c2430 2024-01-20T08:14:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.832+0000 7f38fcc00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 0x7f38d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.832+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f38f0089b10 con 0x7f39000c2430 2024-01-20T08:14:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.832+0000 7f38ffe00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 0x7f38d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:11.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.833+0000 7f38ffe00640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 0x7f38d806d390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f38e8036000 tx=0x7f38e803d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:11.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:11.837+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f38f00546f0 con 0x7f39000c2430 2024-01-20T08:14:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.032+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7f3900154e60 con 0x7f39000c2430 2024-01-20T08:14:12.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.033+0000 7f38fcc00640 1 -- 172.21.15.100:0/3361463847 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7f38f0057d10 con 0x7f39000c2430 2024-01-20T08:14:12.037 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 msgr2=0x7f38d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 0x7f38d806d390 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f38e8036000 tx=0x7f38e803d040 comp rx=0 tx=0).stop 2024-01-20T08:14:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 msgr2=0x7f3900073870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f38f000d7d0 tx=0x7f38f000dc90 comp rx=0 tx=0).stop 2024-01-20T08:14:12.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 shutdown_connections 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f39001542d0 0x7f3900148780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f38d806aed0 0x7f38d806d390 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.035+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f390014e4e0 0x7f3900148240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.036+0000 7f3907800640 1 --2- 172.21.15.100:0/3361463847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f39000c2430 0x7f3900073870 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.036+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 >> 172.21.15.100:0/3361463847 conn(0x7f39000c2940 msgr2=0x7f3900070430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:12.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.036+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 shutdown_connections 2024-01-20T08:14:12.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.036+0000 7f3907800640 1 -- 172.21.15.100:0/3361463847 wait complete. 2024-01-20T08:14:12.058 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:14:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.259+0000 7feecf400640 1 Processor -- start 2024-01-20T08:14:12.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.259+0000 7feecf400640 1 -- start start 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feecf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7feec806b780 0x7feec80c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feecf400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec806c620 con 0x7feec806b270 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feecf400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec8158a10 con 0x7feec80c4a80 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feecf400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec81523e0 con 0x7feec806b780 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feec7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7feec806b270 0x7feec806cab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42010/0 (socket says 172.21.15.100:42010) 2024-01-20T08:14:12.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.261+0000 7feec7e00640 1 -- 172.21.15.100:0/1750088248 learned_addr learned my addr 172.21.15.100:0/1750088248 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3531641224 0 0) 0x7feec806c620 con 0x7feec806b270 2024-01-20T08:14:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feea8003520 con 0x7feec806b270 2024-01-20T08:14:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feecd400640 1 --2- 172.21.15.100:0/1750088248 >> v2:172.21.15.110:3300/0 conn(0x7feec806b780 0x7feec80c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3758128823 0 0) 0x7feea8003520 con 0x7feec806b270 2024-01-20T08:14:12.266 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 >> v2:172.21.15.110:3300/0 conn(0x7feec806b780 msgr2=0x7feec80c4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 --2- 172.21.15.100:0/1750088248 >> v2:172.21.15.110:3300/0 conn(0x7feec806b780 0x7feec80c4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 >> v1:172.21.15.110:6789/0 conn(0x7feec80c4a80 legacy=0x7feec80c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8158cb0 con 0x7feec806b270 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7feeb0001670 con 0x7feec806b270 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 >> v1:172.21.15.100:6789/0 conn(0x7feec806b270 legacy=0x7feec806cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea80047c0 0x7feea8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 0x7feea800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea800c1e0 con 0x7feea8005380 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea800c350 con 0x7feea80047c0 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea800c510 con 0x7feea8003970 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.262+0000 7feecd400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 0x7feea800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecca00640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecd400640 1 -- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8003970 msgr2=0x7feea8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecd400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feec7e00640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea80047c0 0x7feea8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecd400640 1 -- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea80047c0 msgr2=0x7feea8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecd400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feea80047c0 0x7feea8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecd400640 1 -- 172.21.15.100:0/1750088248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea8003520 con 0x7feea8005380 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.263+0000 7feecca00640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8003970 0x7feea8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feecd400640 1 -- 172.21.15.100:0/1750088248 reap_dead start 2024-01-20T08:14:12.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feecd400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 0x7feea800b980 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7feec0007360 tx=0x7feea80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba6242902879fba5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec002ccf0 con 0x7feea8005380 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec002ce90 con 0x7feea8005380 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feec7400640 1 -- 172.21.15.100:0/1750088248 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0003bd0 con 0x7feea8005380 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feecf400640 1 -- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 msgr2=0x7feea800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.264+0000 7feecf400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 0x7feea800b980 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7feec0007360 tx=0x7feea80057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.265+0000 7feecf400640 1 -- 172.21.15.100:0/1750088248 shutdown_connections 2024-01-20T08:14:12.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.265+0000 7feecf400640 1 --2- 172.21.15.100:0/1750088248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feea8005380 0x7feea800b980 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.265+0000 7feecf400640 1 -- 172.21.15.100:0/1750088248 >> 172.21.15.100:0/1750088248 conn(0x7feec80ca100 msgr2=0x7feec80ca510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.265+0000 7feecf400640 1 -- 172.21.15.100:0/1750088248 shutdown_connections 2024-01-20T08:14:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.265+0000 7feecf400640 1 -- 172.21.15.100:0/1750088248 wait complete. 2024-01-20T08:14:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.266+0000 7feecf400640 1 Processor -- start 2024-01-20T08:14:12.270 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.266+0000 7feecf400640 1 -- start start 2024-01-20T08:14:12.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 0x7feec81ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec80c33e0 0x7feec814c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec8152ce0 con 0x7feec814f090 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80c3840 con 0x7feec80c33e0 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feecf400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec81551f0 con 0x7feea8005380 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feec7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feec7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36208/0 (socket says 172.21.15.100:36208) 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.267+0000 7feec7e00640 1 -- 172.21.15.100:0/2599623364 learned_addr learned my addr 172.21.15.100:0/2599623364 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feecca00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 0x7feec81ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 -- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 msgr2=0x7feec81ea5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 0x7feec81ea5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 -- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec80c33e0 msgr2=0x7feec814c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec80c33e0 0x7feec814c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 -- 172.21.15.100:0/2599623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec80c1830 con 0x7feec814f090 2024-01-20T08:14:12.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feecca00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 0x7feec81ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec7e00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d7a0 tx=0x7feeb000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00072d0 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb0007430 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00047e0 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.268+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec81eab10 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.269+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80c1270 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.270+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8067b60 con 0x7feec814f090 2024-01-20T08:14:12.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.270+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feeb0004940 con 0x7feec814f090 2024-01-20T08:14:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.271+0000 7feec4c00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.271+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7feeb00895f0 con 0x7feec814f090 2024-01-20T08:14:12.274 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.272+0000 7feecca00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.272+0000 7feecca00640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feec8157d00 tx=0x7feeb8009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.278 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.275+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feeb00540a0 con 0x7feec814f090 2024-01-20T08:14:12.468 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.465+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7feec814c680 con 0x7feec814f090 2024-01-20T08:14:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.466+0000 7feec4c00640 1 -- 172.21.15.100:0/2599623364 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7feec814c680 con 0x7feec814f090 2024-01-20T08:14:12.469 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:14:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 msgr2=0x7feea006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7feec8157d00 tx=0x7feeb8009040 comp rx=0 tx=0).stop 2024-01-20T08:14:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 msgr2=0x7feec80c2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.471 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7feeb000d7a0 tx=0x7feeb000dc60 comp rx=0 tx=0).stop 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 shutdown_connections 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feec80c33e0 0x7feec814c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feec814f090 0x7feec80c2ea0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feea006af00 0x7feea006d3c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 --2- 172.21.15.100:0/2599623364 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feea8005380 0x7feec81ea5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 >> 172.21.15.100:0/2599623364 conn(0x7feec80ca100 msgr2=0x7feec80ab3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 shutdown_connections 2024-01-20T08:14:12.472 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.468+0000 7feecf400640 1 -- 172.21.15.100:0/2599623364 wait complete. 2024-01-20T08:14:12.489 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-01-20T08:14:12.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:12.489 DEBUG:teuthology.orchestra.run.smithi100:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-01-20T08:14:12.580 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:14:12.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:12.580 DEBUG:teuthology.orchestra.run.smithi100:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-01-20T08:14:12.626 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:12.627 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:12.680 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:12.680 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:12.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.940+0000 7f144ae00640 1 Processor -- start 2024-01-20T08:14:12.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.940+0000 7f144ae00640 1 -- start start 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f144ae00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f14440c2e00 0x7f14440c3260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f144ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1444157df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f144ae00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14440c2970 con 0x7f14440709e0 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f144ae00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14440c1fc0 con 0x7f14440c2e00 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f144ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c5f70 con 0x7f14440c37a0 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f1443e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f14440709e0 0x7f14440c17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42020/0 (socket says 172.21.15.100:42020) 2024-01-20T08:14:12.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.942+0000 7f1443e00640 1 -- 172.21.15.100:0/3282510324 learned_addr learned my addr 172.21.15.100:0/3282510324 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1443400640 1 --2- 172.21.15.100:0/3282510324 >> v2:172.21.15.110:3300/0 conn(0x7f14440c2e00 0x7f14440c3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1448e00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1444157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287602378 0 0) 0x7f14440c2970 con 0x7f14440709e0 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1424003520 con 0x7f14440709e0 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2492190160 0 0) 0x7f1424003520 con 0x7f14440709e0 2024-01-20T08:14:12.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 msgr2=0x7f1444157df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1444157df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 >> v2:172.21.15.110:3300/0 conn(0x7f14440c2e00 msgr2=0x7f14440c3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 --2- 172.21.15.100:0/3282510324 >> v2:172.21.15.110:3300/0 conn(0x7f14440c2e00 0x7f14440c3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1444070dc0 con 0x7f14440709e0 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f14340019f0 con 0x7f14440709e0 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 >> v1:172.21.15.100:6789/0 conn(0x7f14440709e0 legacy=0x7f14440c17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1424003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1424003fa0 0x7f14240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1424004d00 0x7f1424005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c1fc0 con 0x7f1424003fa0 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440c5f70 con 0x7f1424004d00 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.943+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142400ba80 con 0x7f14440c37a0 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1424003fa0 0x7f14240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1448e00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1424004d00 0x7f1424005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443e00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1424003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 -- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 msgr2=0x7f1424003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14440c37a0 0x7f1424003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 -- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1424004d00 msgr2=0x7f1424005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1424004d00 0x7f1424005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.944+0000 7f1443400640 1 -- 172.21.15.100:0/3282510324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1424003520 con 0x7f1424003fa0 2024-01-20T08:14:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.945+0000 7f1443400640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1424003fa0 0x7f14240047c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f142c00ba30 tx=0x7f14240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d0a9950b1b0abb server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.945+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c032680 con 0x7f1424003fa0 2024-01-20T08:14:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.945+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c0327e0 con 0x7f1424003fa0 2024-01-20T08:14:12.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.945+0000 7f1442a00640 1 -- 172.21.15.100:0/3282510324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c032b70 con 0x7f1424003fa0 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 -- 172.21.15.100:0/3282510324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1424003fa0 msgr2=0x7f14240047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 --2- 172.21.15.100:0/3282510324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1424003fa0 0x7f14240047c0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f142c00ba30 tx=0x7f14240057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f1448e00640 1 -- 172.21.15.100:0/3282510324 reap_dead start 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 -- 172.21.15.100:0/3282510324 shutdown_connections 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 -- 172.21.15.100:0/3282510324 >> 172.21.15.100:0/3282510324 conn(0x7f144406e770 msgr2=0x7f1444066340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 -- 172.21.15.100:0/3282510324 shutdown_connections 2024-01-20T08:14:12.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.946+0000 7f144ae00640 1 -- 172.21.15.100:0/3282510324 wait complete. 2024-01-20T08:14:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.948+0000 7f144ae00640 1 Processor -- start 2024-01-20T08:14:12.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.948+0000 7f144ae00640 1 -- start start 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1424003fa0 0x7f144414bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f144414af30 0x7f144414b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14440aa490 con 0x7f14441ea770 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f144414b900 con 0x7f144414af30 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f144ae00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1444152670 con 0x7f1424003fa0 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f1443400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f1443400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36236/0 (socket says 172.21.15.100:36236) 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f1443400640 1 -- 172.21.15.100:0/1471682696 learned_addr learned my addr 172.21.15.100:0/1471682696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f1443400640 1 -- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1424003fa0 msgr2=0x7f144414bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.949+0000 7f1443400640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1424003fa0 0x7f144414bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f1443400640 1 -- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f144414af30 msgr2=0x7f144414b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:12.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f1443400640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f144414af30 0x7f144414b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f1443400640 1 -- 172.21.15.100:0/1471682696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14441eaf50 con 0x7f14441ea770 2024-01-20T08:14:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f1443400640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f142c035040 tx=0x7f142c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c004220 con 0x7f14441ea770 2024-01-20T08:14:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c004380 con 0x7f14441ea770 2024-01-20T08:14:12.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14441eb230 con 0x7f14441ea770 2024-01-20T08:14:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c030ae0 con 0x7f14441ea770 2024-01-20T08:14:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.950+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14441528c0 con 0x7f14441ea770 2024-01-20T08:14:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.951+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144404e970 con 0x7f14441ea770 2024-01-20T08:14:12.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.952+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f142c030c40 con 0x7f14441ea770 2024-01-20T08:14:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.953+0000 7f143be00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 0x7f141c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.953+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f142c0ac3a0 con 0x7f14441ea770 2024-01-20T08:14:12.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.953+0000 7f1443e00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 0x7f141c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:12.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.954+0000 7f1443e00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 0x7f141c06d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1434002230 tx=0x7f14340020e0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:12.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:12.957+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f142c076f90 con 0x7f14441ea770 2024-01-20T08:14:13.156 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.153+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f144404e970 con 0x7f14441ea770 2024-01-20T08:14:13.158 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.155+0000 7f143be00640 1 -- 172.21.15.100:0/1471682696 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f142c07a5b0 con 0x7f14441ea770 2024-01-20T08:14:13.159 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:13.159 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 msgr2=0x7f141c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 0x7f141c06d3c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f1434002230 tx=0x7f14340020e0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 msgr2=0x7f1444151960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.161 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f142c035040 tx=0x7f142c004730 comp rx=0 tx=0).stop 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 shutdown_connections 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f144414af30 0x7f144414b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14441ea770 0x7f1444151960 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f141c06af00 0x7f141c06d3c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 --2- 172.21.15.100:0/1471682696 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1424003fa0 0x7f144414bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 >> 172.21.15.100:0/1471682696 conn(0x7f144406e770 msgr2=0x7f14440c17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.158+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 shutdown_connections 2024-01-20T08:14:13.162 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.159+0000 7f144ae00640 1 -- 172.21.15.100:0/1471682696 wait complete. 2024-01-20T08:14:13.182 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:14:13.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:14:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.380+0000 7febb7e00640 1 Processor -- start 2024-01-20T08:14:13.383 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.380+0000 7febb7e00640 1 -- start start 2024-01-20T08:14:13.384 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.381+0000 7febb7e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7febb014b720 0x7febb01515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 0x7febb00c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb7e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb0154ba0 con 0x7febb006c8d0 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb7e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb014bb00 con 0x7febb014b720 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb0155a00 con 0x7febb00c1850 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb5e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7febb006c8d0 0x7febb006cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42036/0 (socket says 172.21.15.100:42036) 2024-01-20T08:14:13.385 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb5e00640 1 -- 172.21.15.100:0/2730421962 learned_addr learned my addr 172.21.15.100:0/2730421962 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb4a00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 0x7febb00c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febb5400640 1 --2- 172.21.15.100:0/2730421962 >> v2:172.21.15.110:3300/0 conn(0x7febb014b720 0x7febb01515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.382+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582341155 0 0) 0x7febb0154ba0 con 0x7febb006c8d0 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb90005730 con 0x7febb006c8d0 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 314748924 0 0) 0x7feb90005730 con 0x7febb006c8d0 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 msgr2=0x7febb00c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 0x7febb00c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.387 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 >> v2:172.21.15.110:3300/0 conn(0x7febb014b720 msgr2=0x7febb01515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 --2- 172.21.15.100:0/2730421962 >> v2:172.21.15.110:3300/0 conn(0x7febb014b720 0x7febb01515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb0154df0 con 0x7febb006c8d0 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7feba80019f0 con 0x7febb006c8d0 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 >> v1:172.21.15.100:6789/0 conn(0x7febb006c8d0 legacy=0x7febb006cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb90005b80 0x7feb90005fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb900069d0 0x7feb90006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 0x7feb90007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb014bb00 con 0x7feb90005b80 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb0155a00 con 0x7feb900069d0 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb9000dbe0 con 0x7febb00c1850 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.383+0000 7febb5400640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb90005b80 0x7feb90005fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb4a00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb900069d0 0x7feb90006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.388 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb5400640 1 -- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 msgr2=0x7feb90007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb5400640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7febb00c1850 0x7feb90007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb5400640 1 -- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb900069d0 msgr2=0x7feb90006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb5400640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7feb900069d0 0x7feb90006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.389 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.384+0000 7febb5400640 1 -- 172.21.15.100:0/2730421962 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb90005730 con 0x7feb90005b80 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.385+0000 7febb5400640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb90005b80 0x7feb90005fa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feba0009af0 tx=0x7feb90007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c896698bf38084b6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.385+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba002c710 con 0x7feb90005b80 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.385+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba002c870 con 0x7feb90005b80 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.385+0000 7febafe00640 1 -- 172.21.15.100:0/2730421962 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba002cc00 con 0x7feb90005b80 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 -- 172.21.15.100:0/2730421962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb90005b80 msgr2=0x7feb90005fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 --2- 172.21.15.100:0/2730421962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb90005b80 0x7feb90005fa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feba0009af0 tx=0x7feb90007a00 comp rx=0 tx=0).stop 2024-01-20T08:14:13.390 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb5e00640 1 -- 172.21.15.100:0/2730421962 reap_dead start 2024-01-20T08:14:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 -- 172.21.15.100:0/2730421962 shutdown_connections 2024-01-20T08:14:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 -- 172.21.15.100:0/2730421962 >> 172.21.15.100:0/2730421962 conn(0x7febb00c2940 msgr2=0x7febb00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 -- 172.21.15.100:0/2730421962 shutdown_connections 2024-01-20T08:14:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.386+0000 7febb7e00640 1 -- 172.21.15.100:0/2730421962 wait complete. 2024-01-20T08:14:13.391 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.387+0000 7febb7e00640 1 Processor -- start 2024-01-20T08:14:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 -- start start 2024-01-20T08:14:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb90005b80 0x7febb00aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb00ab210 0x7febb01e63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb00bfeb0 con 0x7febb00bf9b0 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb01ea330 con 0x7febb00ab210 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.388+0000 7febb7e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb01e9570 con 0x7feb90005b80 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36254/0 (socket says 172.21.15.100:36254) 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 -- 172.21.15.100:0/4276337744 learned_addr learned my addr 172.21.15.100:0/4276337744 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:13.394 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 -- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb90005b80 msgr2=0x7febb00aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb90005b80 0x7febb00aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 -- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb00ab210 msgr2=0x7febb01e63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb00ab210 0x7febb01e63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 -- 172.21.15.100:0/4276337744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb01e9850 con 0x7febb00bf9b0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.389+0000 7febb4a00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7feb98010860 tx=0x7feb98010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.390+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb98009610 con 0x7febb00bf9b0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.390+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb9800eb60 con 0x7febb00bf9b0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.390+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb9801c400 con 0x7febb00bf9b0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.390+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb01e9b30 con 0x7febb00bf9b0 2024-01-20T08:14:13.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.390+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb01e68f0 con 0x7febb00bf9b0 2024-01-20T08:14:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.391+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb004e970 con 0x7febb00bf9b0 2024-01-20T08:14:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.392+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7feb9801c560 con 0x7febb00bf9b0 2024-01-20T08:14:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.393+0000 7febad600640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.393+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7feb98089ee0 con 0x7febb00bf9b0 2024-01-20T08:14:13.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.393+0000 7febb5400640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.394+0000 7febb5400640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba002e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.397+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7feb98054b70 con 0x7febb00bf9b0 2024-01-20T08:14:13.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.589+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7febb00c37e0 con 0x7febb00bf9b0 2024-01-20T08:14:13.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.590+0000 7febad600640 1 -- 172.21.15.100:0/4276337744 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7feb98058190 con 0x7febb00bf9b0 2024-01-20T08:14:13.593 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:14:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 msgr2=0x7feb8806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 0x7feb8806d3c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7feba0036000 tx=0x7feba002e000 comp rx=0 tx=0).stop 2024-01-20T08:14:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 msgr2=0x7febb01e5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7feb98010860 tx=0x7feb98010d20 comp rx=0 tx=0).stop 2024-01-20T08:14:13.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 shutdown_connections 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7febb00ab210 0x7febb01e63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7febb00bf9b0 0x7febb01e5e70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7feb8806af00 0x7feb8806d3c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 --2- 172.21.15.100:0/4276337744 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7feb90005b80 0x7febb00aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 >> 172.21.15.100:0/4276337744 conn(0x7febb00c2940 msgr2=0x7febb00713f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 shutdown_connections 2024-01-20T08:14:13.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.593+0000 7febb7e00640 1 -- 172.21.15.100:0/4276337744 wait complete. 2024-01-20T08:14:13.614 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:14:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.824+0000 7f755de00640 1 Processor -- start 2024-01-20T08:14:13.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.824+0000 7f755de00640 1 -- start start 2024-01-20T08:14:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.825+0000 7f755de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.828 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f755de00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 0x7f75580716a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f755de00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7558158830 con 0x7f7558071280 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f755de00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75581558d0 con 0x7f75580c0be0 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f755de00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f755806e9a0 con 0x7f75580c4180 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f7556a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f7557400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 0x7f75580716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f7556a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:35734/0 (socket says 172.21.15.100:35734) 2024-01-20T08:14:13.829 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f7556a00640 1 -- 172.21.15.100:0/2925066698 learned_addr learned my addr 172.21.15.100:0/2925066698 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.826+0000 7f7557400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 0x7f75580716a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:41454/0 (socket says 172.21.15.100:41454) 2024-01-20T08:14:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.827+0000 7f7556a00640 1 -- 172.21.15.100:0/2925066698 >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 msgr2=0x7f75580716a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.827+0000 7f7556a00640 1 --2- 172.21.15.100:0/2925066698 >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 0x7f75580716a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.827+0000 7f7556a00640 1 -- 172.21.15.100:0/2925066698 >> v1:172.21.15.110:6789/0 conn(0x7f7558071280 legacy=0x7f75580c04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.830 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.827+0000 7f7556a00640 1 -- 172.21.15.100:0/2925066698 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7558157f00 con 0x7f75580c4180 2024-01-20T08:14:13.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.829+0000 7f7556a00640 1 --2- 172.21.15.100:0/2925066698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f754802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7e20a1a729683e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.829+0000 7f7556000640 1 -- 172.21.15.100:0/2925066698 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548030840 con 0x7f75580c4180 2024-01-20T08:14:13.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.829+0000 7f7556000640 1 -- 172.21.15.100:0/2925066698 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75480309a0 con 0x7f75580c4180 2024-01-20T08:14:13.832 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.829+0000 7f7556000640 1 -- 172.21.15.100:0/2925066698 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548030d30 con 0x7f75580c4180 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 -- 172.21.15.100:0/2925066698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 msgr2=0x7f7558155390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 --2- 172.21.15.100:0/2925066698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7548009870 tx=0x7f754802b980 comp rx=0 tx=0).stop 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 -- 172.21.15.100:0/2925066698 shutdown_connections 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 --2- 172.21.15.100:0/2925066698 >> v2:172.21.15.110:3300/0 conn(0x7f75580c0be0 0x7f75580716a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 --2- 172.21.15.100:0/2925066698 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c4180 0x7f7558155390 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 -- 172.21.15.100:0/2925066698 >> 172.21.15.100:0/2925066698 conn(0x7f755806b6f0 msgr2=0x7f755806bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 -- 172.21.15.100:0/2925066698 shutdown_connections 2024-01-20T08:14:13.833 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.830+0000 7f755de00640 1 -- 172.21.15.100:0/2925066698 wait complete. 2024-01-20T08:14:13.834 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.832+0000 7f755de00640 1 Processor -- start 2024-01-20T08:14:13.835 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.832+0000 7f755de00640 1 -- start start 2024-01-20T08:14:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c0be0 0x7f75580c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75580c4180 0x7f75580c7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75580c6ac0 con 0x7f7558071280 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f755814d100 con 0x7f75580c4180 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f755de00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75581eb1c0 con 0x7f75580c0be0 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f7556a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f7556a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36270/0 (socket says 172.21.15.100:36270) 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f7556a00640 1 -- 172.21.15.100:0/1539720199 learned_addr learned my addr 172.21.15.100:0/1539720199 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f754fe00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c0be0 0x7f75580c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.833+0000 7f7557400640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75580c4180 0x7f75580c7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 -- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c0be0 msgr2=0x7f75580c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c0be0 0x7f75580c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 -- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75580c4180 msgr2=0x7f75580c7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75580c4180 0x7f75580c7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:13.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 -- 172.21.15.100:0/1539720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75480094d0 con 0x7f7558071280 2024-01-20T08:14:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f7556a00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f754802b9c0 tx=0x7f75480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f754803e070 con 0x7f7558071280 2024-01-20T08:14:13.838 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7548039a10 con 0x7f7558071280 2024-01-20T08:14:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7548039de0 con 0x7f7558071280 2024-01-20T08:14:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755814ba40 con 0x7f7558071280 2024-01-20T08:14:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.834+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75580c5e40 con 0x7f7558071280 2024-01-20T08:14:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.836+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75580722e0 con 0x7f7558071280 2024-01-20T08:14:13.839 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.836+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f754804b400 con 0x7f7558071280 2024-01-20T08:14:13.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.837+0000 7f754f400640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 0x7f753006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:13.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.837+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f75480abe80 con 0x7f7558071280 2024-01-20T08:14:13.840 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.837+0000 7f754fe00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 0x7f753006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:13.841 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.838+0000 7f754fe00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 0x7f753006d390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7558071bf0 tx=0x7f7540009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:13.845 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:13.842+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7548076a60 con 0x7f7558071280 2024-01-20T08:14:14.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.031+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f75580c6890 con 0x7f7558071280 2024-01-20T08:14:14.035 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.032+0000 7f754f400640 1 -- 172.21.15.100:0/1539720199 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f75480340a0 con 0x7f7558071280 2024-01-20T08:14:14.035 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 msgr2=0x7f753006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 0x7f753006d390 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7558071bf0 tx=0x7f7540009040 comp rx=0 tx=0).stop 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 msgr2=0x7f75580c5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f754802b9c0 tx=0x7f75480046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 shutdown_connections 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f75580c4180 0x7f75580c7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f753006aed0 0x7f753006d390 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f75580c0be0 0x7f75580c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 --2- 172.21.15.100:0/1539720199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7558071280 0x7f75580c5900 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 >> 172.21.15.100:0/1539720199 conn(0x7f755806b6f0 msgr2=0x7f75580c04d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:14.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 shutdown_connections 2024-01-20T08:14:14.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.035+0000 7f755de00640 1 -- 172.21.15.100:0/1539720199 wait complete. 2024-01-20T08:14:14.056 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:14:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.255+0000 7f6945600640 1 Processor -- start 2024-01-20T08:14:14.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.255+0000 7f6945600640 1 -- start start 2024-01-20T08:14:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.256+0000 7f6945600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 0x7f6940152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.259 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.256+0000 7f6945600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6940150190 con 0x7f694014fdb0 2024-01-20T08:14:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.256+0000 7f6945600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69401535b0 con 0x7f6940153120 2024-01-20T08:14:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.256+0000 7f6945600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69400a9ce0 con 0x7f69400c3460 2024-01-20T08:14:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693ea00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f694014fdb0 0x7f69400c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42050/0 (socket says 172.21.15.100:42050) 2024-01-20T08:14:14.260 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693ea00640 1 -- 172.21.15.100:0/3707789422 learned_addr learned my addr 172.21.15.100:0/3707789422 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235579146 0 0) 0x7f6940150190 con 0x7f694014fdb0 2024-01-20T08:14:14.261 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6920003520 con 0x7f694014fdb0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693e000640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 0x7f6940152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 948973276 0 0) 0x7f6920003520 con 0x7f694014fdb0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 msgr2=0x7f6940152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 0x7f6940152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 >> v1:172.21.15.110:6789/0 conn(0x7f6940153120 legacy=0x7f694015cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69400a8810 con 0x7f694014fdb0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6938001670 con 0x7f694014fdb0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.257+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 >> v1:172.21.15.100:6789/0 conn(0x7f694014fdb0 legacy=0x7f69400c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200039a0 0x7f6920003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200047c0 0x7f6920004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 0x7f692000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200054b0 con 0x7f69200047c0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6920005620 con 0x7f69200039a0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692000bec0 con 0x7f69400c3460 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200047c0 0x7f6920004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.262 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693ea00640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200039a0 0x7f6920003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 -- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 msgr2=0x7f692000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f69400c3460 0x7f692000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 -- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200039a0 msgr2=0x7f6920003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200039a0 0x7f6920003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.263 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.258+0000 7f693e000640 1 -- 172.21.15.100:0/3707789422 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6920003520 con 0x7f69200047c0 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.259+0000 7f693e000640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200047c0 0x7f6920004c40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6928007f90 tx=0x7f69200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4424455c4232d13 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.259+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928033600 con 0x7f69200047c0 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692802f050 con 0x7f69200047c0 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f693d600640 1 -- 172.21.15.100:0/3707789422 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6928033960 con 0x7f69200047c0 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 -- 172.21.15.100:0/3707789422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200047c0 msgr2=0x7f6920004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 --2- 172.21.15.100:0/3707789422 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69200047c0 0x7f6920004c40 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f6928007f90 tx=0x7f69200057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f693f400640 1 -- 172.21.15.100:0/3707789422 reap_dead start 2024-01-20T08:14:14.264 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 -- 172.21.15.100:0/3707789422 shutdown_connections 2024-01-20T08:14:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 -- 172.21.15.100:0/3707789422 >> 172.21.15.100:0/3707789422 conn(0x7f69400c2940 msgr2=0x7f69400c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 -- 172.21.15.100:0/3707789422 shutdown_connections 2024-01-20T08:14:14.265 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.260+0000 7f6945600640 1 -- 172.21.15.100:0/3707789422 wait complete. 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.262+0000 7f6945600640 1 Processor -- start 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.262+0000 7f6945600640 1 -- start start 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200047c0 0x7f6940155270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6940153a90 0x7f6940151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6940154470 con 0x7f694014a9f0 2024-01-20T08:14:14.267 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6940150fa0 con 0x7f69200047c0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f6945600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69401557b0 con 0x7f6940153a90 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36286/0 (socket says 172.21.15.100:36286) 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 -- 172.21.15.100:0/3579215250 learned_addr learned my addr 172.21.15.100:0/3579215250 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693f400640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6940153a90 0x7f6940151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693ea00640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200047c0 0x7f6940155270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 -- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6940153a90 msgr2=0x7f6940151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6940153a90 0x7f6940151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 -- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200047c0 msgr2=0x7f6940155270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200047c0 0x7f6940155270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.263+0000 7f693e000640 1 -- 172.21.15.100:0/3579215250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69401ebae0 con 0x7f694014a9f0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f693e000640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6928007f90 tx=0x7f6928004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692803e830 con 0x7f694014a9f0 2024-01-20T08:14:14.268 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f692803e990 con 0x7f694014a9f0 2024-01-20T08:14:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692803ed00 con 0x7f694014a9f0 2024-01-20T08:14:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69401520f0 con 0x7f694014a9f0 2024-01-20T08:14:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.264+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69401ebd80 con 0x7f694014a9f0 2024-01-20T08:14:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.265+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f694004e970 con 0x7f694014a9f0 2024-01-20T08:14:14.269 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.266+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6928046400 con 0x7f694014a9f0 2024-01-20T08:14:14.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.267+0000 7f6936a00640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 0x7f691806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.267+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f69280acf90 con 0x7f694014a9f0 2024-01-20T08:14:14.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.267+0000 7f693ea00640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 0x7f691806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.272 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.268+0000 7f693ea00640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 0x7f691806d390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6938000fd0 tx=0x7f6938009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.275 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.272+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6928077ad0 con 0x7f694014a9f0 2024-01-20T08:14:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.449+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f69400a93b0 con 0x7f694014a9f0 2024-01-20T08:14:14.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.450+0000 7f6936a00640 1 -- 172.21.15.100:0/3579215250 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f692803ee60 con 0x7f694014a9f0 2024-01-20T08:14:14.453 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 msgr2=0x7f691806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 0x7f691806d390 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6938000fd0 tx=0x7f6938009040 comp rx=0 tx=0).stop 2024-01-20T08:14:14.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 msgr2=0x7f69401eb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f6928007f90 tx=0x7f6928004ab0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 shutdown_connections 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f691806aed0 0x7f691806d390 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6940153a90 0x7f6940151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f694014a9f0 0x7f69401eb5a0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 --2- 172.21.15.100:0/3579215250 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f69200047c0 0x7f6940155270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 >> 172.21.15.100:0/3579215250 conn(0x7f69400c2940 msgr2=0x7f6940072020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 shutdown_connections 2024-01-20T08:14:14.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.452+0000 7f6945600640 1 -- 172.21.15.100:0/3579215250 wait complete. 2024-01-20T08:14:14.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:14.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.674+0000 7f977b400640 1 Processor -- start 2024-01-20T08:14:14.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.674+0000 7f977b400640 1 -- start start 2024-01-20T08:14:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f977b400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f97740ab0b0 0x7f9774153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f977b400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97740715a0 0x7f9774071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f977b400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97740ab620 con 0x7f977414c750 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f977b400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977414cb30 con 0x7f97740715a0 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f977b400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97740ab900 con 0x7f97740ab0b0 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.676+0000 7f9779400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97740715a0 0x7f9774071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f97740715a0 0x7f9774071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36292/0 (socket says 172.21.15.100:36292) 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 -- 172.21.15.100:0/202457913 learned_addr learned my addr 172.21.15.100:0/202457913 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9778a00640 1 --1- 172.21.15.100:0/202457913 >> v1:172.21.15.100:6789/0 conn(0x7f977414c750 0x7f97740a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42062/0 (socket says 172.21.15.100:42062) 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9773e00640 1 --2- 172.21.15.100:0/202457913 >> v2:172.21.15.110:3300/0 conn(0x7f97740ab0b0 0x7f9774153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 -- 172.21.15.100:0/202457913 >> v2:172.21.15.110:3300/0 conn(0x7f97740ab0b0 msgr2=0x7f9774153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 --2- 172.21.15.100:0/202457913 >> v2:172.21.15.110:3300/0 conn(0x7f97740ab0b0 0x7f9774153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 -- 172.21.15.100:0/202457913 >> v1:172.21.15.100:6789/0 conn(0x7f977414c750 legacy=0x7f97740a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.677+0000 7f9779400640 1 -- 172.21.15.100:0/202457913 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97740abbe0 con 0x7f97740715a0 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.678+0000 7f9779400640 1 --2- 172.21.15.100:0/202457913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774071a30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f977406e380 tx=0x7f976c02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0b25ae5b83eb8e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.678+0000 7f9773400640 1 -- 172.21.15.100:0/202457913 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c02cb10 con 0x7f97740715a0 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.678+0000 7f9773400640 1 -- 172.21.15.100:0/202457913 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976c02cc70 con 0x7f97740715a0 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.678+0000 7f9773400640 1 -- 172.21.15.100:0/202457913 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c0343f0 con 0x7f97740715a0 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 -- 172.21.15.100:0/202457913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 msgr2=0x7f9774071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 --2- 172.21.15.100:0/202457913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774071a30 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f977406e380 tx=0x7f976c02bf70 comp rx=0 tx=0).stop 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 -- 172.21.15.100:0/202457913 shutdown_connections 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 --2- 172.21.15.100:0/202457913 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774071a30 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 --2- 172.21.15.100:0/202457913 >> v2:172.21.15.110:3300/0 conn(0x7f97740ab0b0 0x7f9774153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.684 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 -- 172.21.15.100:0/202457913 >> 172.21.15.100:0/202457913 conn(0x7f97740c6090 msgr2=0x7f97740c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:14.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 -- 172.21.15.100:0/202457913 shutdown_connections 2024-01-20T08:14:14.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.679+0000 7f977b400640 1 -- 172.21.15.100:0/202457913 wait complete. 2024-01-20T08:14:14.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.681+0000 7f977b400640 1 Processor -- start 2024-01-20T08:14:14.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.682+0000 7f977b400640 1 -- start start 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 0x7f977414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 0x7f97740c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740bb980 con 0x7f97740715a0 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740bf260 con 0x7f97740ab0b0 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f977b400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740bb620 con 0x7f977414c750 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36302/0 (socket says 172.21.15.100:36302) 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 -- 172.21.15.100:0/2205993525 learned_addr learned my addr 172.21.15.100:0/2205993525 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9779400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 0x7f97740c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9773e00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 0x7f977414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 -- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 msgr2=0x7f97740c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 0x7f97740c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 -- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 msgr2=0x7f977414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 0x7f977414f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.683+0000 7f9778a00640 1 -- 172.21.15.100:0/2205993525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009b30 con 0x7f97740715a0 2024-01-20T08:14:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9779400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 0x7f97740c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9773e00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 0x7f977414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:14.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9778a00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f976400c430 tx=0x7f976400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97640074e0 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9764007640 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97741f2950 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9764004a00 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.684+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97740bee80 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.685+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f977414f370 con 0x7f97740715a0 2024-01-20T08:14:14.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.687+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9764004b60 con 0x7f97740715a0 2024-01-20T08:14:14.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.688+0000 7f9770c00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 0x7f974c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:14.690 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.688+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f97640893a0 con 0x7f97740715a0 2024-01-20T08:14:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.688+0000 7f9773e00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 0x7f974c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:14.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.688+0000 7f9773e00640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 0x7f974c06d3c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f975c006fd0 tx=0x7f975c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:14.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.694+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9764053ee0 con 0x7f97740715a0 2024-01-20T08:14:14.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.885+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7f977404ea50 con 0x7f97740715a0 2024-01-20T08:14:14.888 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.886+0000 7f9770c00640 1 -- 172.21.15.100:0/2205993525 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7f9764057500 con 0x7f97740715a0 2024-01-20T08:14:14.889 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.888+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 msgr2=0x7f974c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.888+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 0x7f974c06d3c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f975c006fd0 tx=0x7f975c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 msgr2=0x7f9774153a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f976400c430 tx=0x7f976400c8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 shutdown_connections 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f974c06af00 0x7f974c06d3c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f977414c750 0x7f97740c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f97740ab0b0 0x7f977414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 --2- 172.21.15.100:0/2205993525 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f97740715a0 0x7f9774153a70 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 >> 172.21.15.100:0/2205993525 conn(0x7f97740c6090 msgr2=0x7f97740a91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 shutdown_connections 2024-01-20T08:14:14.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:14.889+0000 7f977b400640 1 -- 172.21.15.100:0/2205993525 wait complete. 2024-01-20T08:14:14.909 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:15.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.106+0000 7fae76000640 1 Processor -- start 2024-01-20T08:14:15.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.107+0000 7fae76000640 1 -- start start 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae76000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae701551e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae76000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700c5880 con 0x7fae7006b140 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae76000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae700c9a40 con 0x7fae7006b5a0 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae76000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c4a60 con 0x7fae70151d50 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae67e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fae7006b140 0x7fae700c5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42076/0 (socket says 172.21.15.100:42076) 2024-01-20T08:14:15.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.108+0000 7fae67e00640 1 -- 172.21.15.100:0/2421139465 learned_addr learned my addr 172.21.15.100:0/2421139465 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1492199781 0 0) 0x7fae700c5880 con 0x7fae7006b140 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae50003520 con 0x7fae7006b140 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6f400640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae701551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1468537347 0 0) 0x7fae50003520 con 0x7fae7006b140 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 msgr2=0x7fae701551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae701551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 >> v1:172.21.15.110:6789/0 conn(0x7fae7006b5a0 legacy=0x7fae7015f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae700c9f10 con 0x7fae7006b140 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fae58001670 con 0x7fae7006b140 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 >> v1:172.21.15.100:6789/0 conn(0x7fae7006b140 legacy=0x7fae700c5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae500039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50003fd0 0x7fae500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae50004d00 0x7fae50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700c4a60 con 0x7fae50004d00 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae5000bbc0 con 0x7fae50003fd0 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.109+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5000bd80 con 0x7fae70151d50 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae50004d00 0x7fae50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6f400640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae500039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae67e00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50003fd0 0x7fae500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 -- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 msgr2=0x7fae500039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae70151d50 0x7fae500039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 -- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50003fd0 msgr2=0x7fae500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae50003fd0 0x7fae500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.110+0000 7fae6fe00640 1 -- 172.21.15.100:0/2421139465 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae50003520 con 0x7fae50004d00 2024-01-20T08:14:15.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.111+0000 7fae6fe00640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae50004d00 0x7fae50005180 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fae68001e50 tx=0x7fae500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac61c23ddad5b2e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.111+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68003b70 con 0x7fae50004d00 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.111+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68003cd0 con 0x7fae50004d00 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.111+0000 7fae6ea00640 1 -- 172.21.15.100:0/2421139465 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae68005310 con 0x7fae50004d00 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 -- 172.21.15.100:0/2421139465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae50004d00 msgr2=0x7fae50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 --2- 172.21.15.100:0/2421139465 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae50004d00 0x7fae50005180 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fae68001e50 tx=0x7fae500057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae6fe00640 1 -- 172.21.15.100:0/2421139465 reap_dead start 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 -- 172.21.15.100:0/2421139465 shutdown_connections 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 -- 172.21.15.100:0/2421139465 >> 172.21.15.100:0/2421139465 conn(0x7fae700ca0e0 msgr2=0x7fae700ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:15.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 -- 172.21.15.100:0/2421139465 shutdown_connections 2024-01-20T08:14:15.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.112+0000 7fae76000640 1 -- 172.21.15.100:0/2421139465 wait complete. 2024-01-20T08:14:15.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.114+0000 7fae76000640 1 Processor -- start 2024-01-20T08:14:15.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.114+0000 7fae76000640 1 -- start start 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50004d00 0x7fae70150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae700bf0a0 0x7fae700bf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae700bea10 con 0x7fae701ed9c0 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae701561b0 con 0x7fae700bf0a0 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae76000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae70156490 con 0x7fae50004d00 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36310/0 (socket says 172.21.15.100:36310) 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 -- 172.21.15.100:0/4191804042 learned_addr learned my addr 172.21.15.100:0/4191804042 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:15.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6f400640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50004d00 0x7fae70150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae67e00640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae700bf0a0 0x7fae700bf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 -- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50004d00 msgr2=0x7fae70150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50004d00 0x7fae70150a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 -- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae700bf0a0 msgr2=0x7fae700bf520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae700bf0a0 0x7fae700bf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.115+0000 7fae6fe00640 1 -- 172.21.15.100:0/4191804042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7014ff80 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae6fe00640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fae68001f70 tx=0x7fae680014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6803e070 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae68003e40 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae70150260 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae6802f6a0 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.116+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae701ee380 con 0x7fae701ed9c0 2024-01-20T08:14:15.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.117+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae70150780 con 0x7fae701ed9c0 2024-01-20T08:14:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.118+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fae6802f800 con 0x7fae701ed9c0 2024-01-20T08:14:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.119+0000 7fae67400640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 0x7fae4806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.119+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fae680ab130 con 0x7fae701ed9c0 2024-01-20T08:14:15.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.119+0000 7fae6f400640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 0x7fae4806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.123 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.120+0000 7fae6f400640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 0x7fae4806d3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae60006fd0 tx=0x7fae60008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.124+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fae70150780 con 0x7fae701ed9c0 2024-01-20T08:14:15.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.316+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fae7004e970 con 0x7fae701ed9c0 2024-01-20T08:14:15.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.317+0000 7fae67400640 1 -- 172.21.15.100:0/4191804042 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7fae6803b0a0 con 0x7fae701ed9c0 2024-01-20T08:14:15.320 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 msgr2=0x7fae4806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 0x7fae4806d3c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fae60006fd0 tx=0x7fae60008040 comp rx=0 tx=0).stop 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 msgr2=0x7fae701ede40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7fae68001f70 tx=0x7fae680014a0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 shutdown_connections 2024-01-20T08:14:15.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fae701ed9c0 0x7fae701ede40 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fae700bf0a0 0x7fae700bf520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fae4806af00 0x7fae4806d3c0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 --2- 172.21.15.100:0/4191804042 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fae50004d00 0x7fae70150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 >> 172.21.15.100:0/4191804042 conn(0x7fae700ca0e0 msgr2=0x7fae700c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 shutdown_connections 2024-01-20T08:14:15.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.320+0000 7fae76000640 1 -- 172.21.15.100:0/4191804042 wait complete. 2024-01-20T08:14:15.342 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-01-20T08:14:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.541+0000 7ff605e00640 1 Processor -- start 2024-01-20T08:14:15.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.541+0000 7ff605e00640 1 -- start start 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.542+0000 7ff605e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff60014b720 0x7ff6001515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.542+0000 7ff605e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1d00 0x7ff60006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.542+0000 7ff605e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff600154ba0 con 0x7ff6000c1850 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.542+0000 7ff605e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60014bb00 con 0x7ff60014b720 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.542+0000 7ff605e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600155a00 con 0x7ff6000c1d00 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7ff60014b720 0x7ff6001515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.546 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5f5e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7ff6000c1850 0x7ff60006c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42086/0 (socket says 172.21.15.100:42086) 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5f5e00640 1 -- 172.21.15.100:0/3410399557 learned_addr learned my addr 172.21.15.100:0/3410399557 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5ff400640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1d00 0x7ff60006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fea00640 1 -- 172.21.15.100:0/3410399557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1d00 msgr2=0x7ff60006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fea00640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1d00 0x7ff60006cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fea00640 1 -- 172.21.15.100:0/3410399557 >> v1:172.21.15.100:6789/0 conn(0x7ff6000c1850 legacy=0x7ff60006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fea00640 1 -- 172.21.15.100:0/3410399557 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff600154df0 con 0x7ff60014b720 2024-01-20T08:14:15.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.543+0000 7ff5fe000640 1 -- 172.21.15.100:0/3410399557 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2465177533 0 0) 0x7ff600154ba0 con 0x7ff6000c1850 2024-01-20T08:14:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.544+0000 7ff5fea00640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff60014b720 0x7ff6001515b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097a0 tx=0x7ff5f002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3526441bf222a55 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.545+0000 7ff5fe000640 1 -- 172.21.15.100:0/3410399557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f002e070 con 0x7ff60014b720 2024-01-20T08:14:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.545+0000 7ff5fe000640 1 -- 172.21.15.100:0/3410399557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f00315a0 con 0x7ff60014b720 2024-01-20T08:14:15.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.545+0000 7ff5fe000640 1 -- 172.21.15.100:0/3410399557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0031930 con 0x7ff60014b720 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.545+0000 7ff605e00640 1 -- 172.21.15.100:0/3410399557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff60014b720 msgr2=0x7ff6001515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.545+0000 7ff605e00640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff60014b720 0x7ff6001515b0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7ff5f00097a0 tx=0x7ff5f002b840 comp rx=0 tx=0).stop 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 -- 172.21.15.100:0/3410399557 shutdown_connections 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1d00 0x7ff60006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 --2- 172.21.15.100:0/3410399557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff60014b720 0x7ff6001515b0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 -- 172.21.15.100:0/3410399557 >> 172.21.15.100:0/3410399557 conn(0x7ff6000c2940 msgr2=0x7ff6000c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 -- 172.21.15.100:0/3410399557 shutdown_connections 2024-01-20T08:14:15.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.546+0000 7ff605e00640 1 -- 172.21.15.100:0/3410399557 wait complete. 2024-01-20T08:14:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.547+0000 7ff605e00640 1 Processor -- start 2024-01-20T08:14:15.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.547+0000 7ff605e00640 1 -- start start 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1850 0x7ff6001df290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff60014b720 0x7ff6001464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff600146a00 con 0x7ff6000c1d00 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6000be930 con 0x7ff60014b720 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff605e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff600154710 con 0x7ff6000c1850 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.548+0000 7ff5f5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36322/0 (socket says 172.21.15.100:36322) 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 -- 172.21.15.100:0/2272815732 learned_addr learned my addr 172.21.15.100:0/2272815732 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 -- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1850 msgr2=0x7ff6001df290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.555 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1850 0x7ff6001df290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 -- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff60014b720 msgr2=0x7ff6001464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5ff400640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff60014b720 0x7ff6001464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff60014b720 0x7ff6001464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 -- 172.21.15.100:0/2272815732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f0009400 con 0x7ff6000c1d00 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f5e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.549+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e80074e0 con 0x7ff6000c1d00 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.550+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5e8007660 con 0x7ff6000c1d00 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.550+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6001ea720 con 0x7ff6000c1d00 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.550+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5e8004a20 con 0x7ff6000c1d00 2024-01-20T08:14:15.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.550+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6001df7d0 con 0x7ff6000c1d00 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.551+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6000beaa0 con 0x7ff6000c1d00 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.552+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7ff5e8004b80 con 0x7ff6000c1d00 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.552+0000 7ff5f7e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 0x7ff5d806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.553+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7ff5e8088fb0 con 0x7ff6000c1d00 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.553+0000 7ff5fea00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 0x7ff5d806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:15.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.554+0000 7ff5fea00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 0x7ff5d806d390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0036000 tx=0x7ff5f0030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:15.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.557+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7ff6000beaa0 con 0x7ff6000c1d00 2024-01-20T08:14:15.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.745+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff6000beaa0 con 0x7ff6000c1d00 2024-01-20T08:14:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.746+0000 7ff5f7e00640 1 -- 172.21.15.100:0/2272815732 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v78) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff6000beaa0 con 0x7ff6000c1d00 2024-01-20T08:14:15.749 INFO:teuthology.orchestra.run.smithi100.stderr:listed 0 entries 2024-01-20T08:14:15.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 msgr2=0x7ff5d806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 0x7ff5d806d390 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0036000 tx=0x7ff5f0030000 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 msgr2=0x7ff600145f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800c4d0 tx=0x7ff5e800c990 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 shutdown_connections 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7ff60014b720 0x7ff6001464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff6000c1d00 0x7ff600145f80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7ff5d806aed0 0x7ff5d806d390 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 --2- 172.21.15.100:0/2272815732 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7ff6000c1850 0x7ff6001df290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.748+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 >> 172.21.15.100:0/2272815732 conn(0x7ff6000c2940 msgr2=0x7ff600070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.749+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 shutdown_connections 2024-01-20T08:14:15.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:15.749+0000 7ff605e00640 1 -- 172.21.15.100:0/2272815732 wait complete. 2024-01-20T08:14:15.767 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.testuser... 2024-01-20T08:14:15.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:15.768 DEBUG:teuthology.orchestra.run.smithi110:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-01-20T08:14:15.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:14:15.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:15.863 DEBUG:teuthology.orchestra.run.smithi110:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-01-20T08:14:15.913 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-01-20T08:14:15.913 DEBUG:teuthology.orchestra.run.smithi100:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:14:16.056 DEBUG:teuthology.orchestra.run.smithi110:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-01-20T08:14:16.177 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-01-20T08:14:16.177 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:16.178 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:16.231 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:14:16.232 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:16.232 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:16.286 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:14:16.286 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:16.496 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.494+0000 7f649c400640 1 Processor -- start 2024-01-20T08:14:16.497 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.494+0000 7f649c400640 1 -- start start 2024-01-20T08:14:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f649c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 0x7f64940c2540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f649c400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649414e820 con 0x7f649414e440 2024-01-20T08:14:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f649c400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6494071570 con 0x7f649406ddc0 2024-01-20T08:14:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f649c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6494150db0 con 0x7f64940c20f0 2024-01-20T08:14:16.498 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f6499a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f649414e440 0x7f64940c0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42088/0 (socket says 172.21.15.100:42088) 2024-01-20T08:14:16.499 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.495+0000 7f6499a00640 1 -- 172.21.15.100:0/1299880754 learned_addr learned my addr 172.21.15.100:0/1299880754 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f649a400640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 0x7f64940c2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235378940 0 0) 0x7f649414e820 con 0x7f649414e440 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6474003520 con 0x7f649414e440 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2696133590 0 0) 0x7f6474003520 con 0x7f649414e440 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 msgr2=0x7f64940c2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 0x7f64940c2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 >> v1:172.21.15.110:6789/0 conn(0x7f649406ddc0 legacy=0x7f64941517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f649406e410 con 0x7f649414e440 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f6484001670 con 0x7f649414e440 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 >> v1:172.21.15.100:6789/0 conn(0x7f649414e440 legacy=0x7f64940c0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.501 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64740039a0 0x7f6474003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.496+0000 7f6493e00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6493e00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 0x7f64740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647400bb10 con 0x7f64740039a0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f647400bc80 con 0x7f64740047c0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f647400e050 con 0x7f64940c20f0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64740039a0 0x7f6474003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 -- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 msgr2=0x7f64740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64940c20f0 0x7f64740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499000640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 -- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740047c0 msgr2=0x7f6474004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740047c0 0x7f6474004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.497+0000 7f6499a00640 1 -- 172.21.15.100:0/1299880754 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6474003520 con 0x7f64740039a0 2024-01-20T08:14:16.502 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.498+0000 7f6499a00640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64740039a0 0x7f6474003dc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f648400c240 tx=0x7f64740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17a6c30bac03df62 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.498+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484005ad0 con 0x7f64740039a0 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.498+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6484005c30 con 0x7f64740039a0 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.498+0000 7f6493e00640 1 -- 172.21.15.100:0/1299880754 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648402c8b0 con 0x7f64740039a0 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 -- 172.21.15.100:0/1299880754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64740039a0 msgr2=0x7f6474003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 --2- 172.21.15.100:0/1299880754 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64740039a0 0x7f6474003dc0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f648400c240 tx=0x7f64740057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649a400640 1 -- 172.21.15.100:0/1299880754 reap_dead start 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 -- 172.21.15.100:0/1299880754 shutdown_connections 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 -- 172.21.15.100:0/1299880754 >> 172.21.15.100:0/1299880754 conn(0x7f649406a5e0 msgr2=0x7f649406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 -- 172.21.15.100:0/1299880754 shutdown_connections 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.499+0000 7f649c400640 1 -- 172.21.15.100:0/1299880754 wait complete. 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.501+0000 7f649c400640 1 Processor -- start 2024-01-20T08:14:16.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.501+0000 7f649c400640 1 -- start start 2024-01-20T08:14:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740039a0 0x7f64940bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64941edd80 0x7f64941ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940c6160 con 0x7f64941db6d0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64941eab30 con 0x7f64740039a0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649c400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940bfc20 con 0x7f64941edd80 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649a400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36342/0 (socket says 172.21.15.100:36342) 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.502+0000 7f649a400640 1 -- 172.21.15.100:0/1169212241 learned_addr learned my addr 172.21.15.100:0/1169212241 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f6499a00640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740039a0 0x7f64940bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f6499000640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64941edd80 0x7f64941ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 -- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64941edd80 msgr2=0x7f64941ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64941edd80 0x7f64941ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 -- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740039a0 msgr2=0x7f64940bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740039a0 0x7f64940bf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 -- 172.21.15.100:0/1169212241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64941ed2a0 con 0x7f64941db6d0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649a400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f64940721a0 tx=0x7f648c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c018070 con 0x7f64941db6d0 2024-01-20T08:14:16.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f648c00eb30 con 0x7f64941db6d0 2024-01-20T08:14:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648c00eec0 con 0x7f64941db6d0 2024-01-20T08:14:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.503+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64941ed580 con 0x7f64941db6d0 2024-01-20T08:14:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.504+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64941dbb50 con 0x7f64941db6d0 2024-01-20T08:14:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.505+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64941edaa0 con 0x7f64941db6d0 2024-01-20T08:14:16.508 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.506+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f648c014420 con 0x7f64941db6d0 2024-01-20T08:14:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.506+0000 7f6491600640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 0x7f646c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.506+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f648c0895d0 con 0x7f64941db6d0 2024-01-20T08:14:16.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.507+0000 7f6499a00640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 0x7f646c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.507+0000 7f6499a00640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 0x7f646c06d390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f6484009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.511+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f64941edaa0 con 0x7f64941db6d0 2024-01-20T08:14:16.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.741+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64941edaa0 con 0x7f64941db6d0 2024-01-20T08:14:16.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.741+0000 7f6491600640 1 -- 172.21.15.100:0/1169212241 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f64941edaa0 con 0x7f64941db6d0 2024-01-20T08:14:16.745 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:16.745 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:16.745 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 53 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 msgr2=0x7f646c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 0x7f646c06d390 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f6484009030 comp rx=0 tx=0).stop 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 msgr2=0x7f64940c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f64940721a0 tx=0x7f648c00e4b0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 shutdown_connections 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64941db6d0 0x7f64940c3fa0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f646c06aed0 0x7f646c06d390 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f64941edd80 0x7f64941ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 --2- 172.21.15.100:0/1169212241 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f64740039a0 0x7f64940bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 >> 172.21.15.100:0/1169212241 conn(0x7f649406a5e0 msgr2=0x7f64940c2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:16.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.744+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 shutdown_connections 2024-01-20T08:14:16.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.745+0000 7f649c400640 1 -- 172.21.15.100:0/1169212241 wait complete. 2024-01-20T08:14:16.767 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:16.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.973+0000 7f7c0fa00640 1 Processor -- start 2024-01-20T08:14:16.977 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.974+0000 7f7c0fa00640 1 -- start start 2024-01-20T08:14:16.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.975+0000 7f7c0fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c0814fce0 0x7f7c08153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.975+0000 7f7c0fa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f7c080a93c0 0x7f7c08152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.975+0000 7f7c0fa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c080a9940 con 0x7f7c08153440 2024-01-20T08:14:16.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.975+0000 7f7c0fa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c081500c0 con 0x7f7c080a93c0 2024-01-20T08:14:16.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.975+0000 7f7c0fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08156810 con 0x7f7c0814fce0 2024-01-20T08:14:16.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7c0da00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f7c08153440 0x7f7c080aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42098/0 (socket says 172.21.15.100:42098) 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7c0da00640 1 -- 172.21.15.100:0/846785960 learned_addr learned my addr 172.21.15.100:0/846785960 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7bffc00640 1 --2- 172.21.15.100:0/846785960 >> v2:172.21.15.100:3300/0 conn(0x7f7c080a93c0 0x7f7c08152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7c0d000640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c0814fce0 0x7f7c08153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7c07e00640 1 -- 172.21.15.100:0/846785960 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715371680 0 0) 0x7f7c080a9940 con 0x7f7c08153440 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7c07e00640 1 -- 172.21.15.100:0/846785960 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7be8003520 con 0x7f7c08153440 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7bffc00640 1 -- 172.21.15.100:0/846785960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c0814fce0 msgr2=0x7f7c08153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7bffc00640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c0814fce0 0x7f7c08153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7bffc00640 1 -- 172.21.15.100:0/846785960 >> v1:172.21.15.100:6789/0 conn(0x7f7c08153440 legacy=0x7f7c080aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.980 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.976+0000 7f7bffc00640 1 -- 172.21.15.100:0/846785960 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08156af0 con 0x7f7c080a93c0 2024-01-20T08:14:16.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.978+0000 7f7bffc00640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c080a93c0 0x7f7c08152f00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00097a0 tx=0x7f7bf002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82c0d1d27745b13 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.978+0000 7f7c07e00640 1 -- 172.21.15.100:0/846785960 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0031830 con 0x7f7c080a93c0 2024-01-20T08:14:16.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.978+0000 7f7c07e00640 1 -- 172.21.15.100:0/846785960 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf0031990 con 0x7f7c080a93c0 2024-01-20T08:14:16.981 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.978+0000 7f7c07e00640 1 -- 172.21.15.100:0/846785960 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf0031d00 con 0x7f7c080a93c0 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 -- 172.21.15.100:0/846785960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c080a93c0 msgr2=0x7f7c08152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c080a93c0 0x7f7c08152f00 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f7bf00097a0 tx=0x7f7bf002b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 -- 172.21.15.100:0/846785960 shutdown_connections 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c080a93c0 0x7f7c08152f00 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/846785960 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c0814fce0 0x7f7c08153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 -- 172.21.15.100:0/846785960 >> 172.21.15.100:0/846785960 conn(0x7f7c0806a5e0 msgr2=0x7f7c0806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 -- 172.21.15.100:0/846785960 shutdown_connections 2024-01-20T08:14:16.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.979+0000 7f7c0fa00640 1 -- 172.21.15.100:0/846785960 wait complete. 2024-01-20T08:14:16.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.981+0000 7f7c0fa00640 1 Processor -- start 2024-01-20T08:14:16.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.981+0000 7f7c0fa00640 1 -- start start 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c080a93c0 0x7f7c08153ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c08153440 0x7f7c08149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c081547b0 con 0x7f7c0814fce0 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08148b90 con 0x7f7c080a93c0 2024-01-20T08:14:16.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0fa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c08149150 con 0x7f7c08153440 2024-01-20T08:14:16.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7bffc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36362/0 (socket says 172.21.15.100:36362) 2024-01-20T08:14:16.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7bffc00640 1 -- 172.21.15.100:0/3392975421 learned_addr learned my addr 172.21.15.100:0/3392975421 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:16.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.982+0000 7f7c0da00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c08153440 0x7f7c08149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7c0d000640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c080a93c0 0x7f7c08153ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 -- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c08153440 msgr2=0x7f7c08149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c08153440 0x7f7c08149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 -- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c080a93c0 msgr2=0x7f7c08153ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c080a93c0 0x7f7c08153ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 -- 172.21.15.100:0/3392975421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf0009400 con 0x7f7c0814fce0 2024-01-20T08:14:16.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7bffc00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7bf002bee0 tx=0x7f7bf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.983+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf003a8f0 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.984+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bf003aa50 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.984+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bf003ae00 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.984+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c081e8fb0 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.984+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c08148de0 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.985+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c0804e970 con 0x7f7c0814fce0 2024-01-20T08:14:16.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.986+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7bf004d440 con 0x7f7c0814fce0 2024-01-20T08:14:16.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.987+0000 7f7c05600640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 0x7f7be006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:16.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.987+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f7bf00abc90 con 0x7f7c0814fce0 2024-01-20T08:14:16.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.987+0000 7f7c0d000640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 0x7f7be006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:16.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.988+0000 7f7c0d000640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 0x7f7be006d3c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009ad0 tx=0x7f7bf8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:16.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:16.991+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7bf0076740 con 0x7f7c0814fce0 2024-01-20T08:14:17.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.184+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c08149290 con 0x7f7c0814fce0 2024-01-20T08:14:17.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.188+0000 7f7c05600640 1 -- 172.21.15.100:0/3392975421 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f7bf0035090 con 0x7f7c0814fce0 2024-01-20T08:14:17.192 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:17.192 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 msgr2=0x7f7be006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 0x7f7be006d3c0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f7bf8009ad0 tx=0x7f7bf8008040 comp rx=0 tx=0).stop 2024-01-20T08:14:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 msgr2=0x7f7c081495e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f7bf002bee0 tx=0x7f7bf00046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 shutdown_connections 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f7be006af00 0x7f7be006d3c0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f7c08153440 0x7f7c08149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7c0814fce0 0x7f7c081495e0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 --2- 172.21.15.100:0/3392975421 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f7c080a93c0 0x7f7c08153ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.191+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 >> 172.21.15.100:0/3392975421 conn(0x7f7c0806a5e0 msgr2=0x7f7c080ab660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.192+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 shutdown_connections 2024-01-20T08:14:17.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.192+0000 7f7c0fa00640 1 -- 172.21.15.100:0/3392975421 wait complete. 2024-01-20T08:14:17.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-01-20T08:13:18.880025+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-01-20T08:13:19.625716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:14:17.216 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:14:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.421+0000 7f5dabe00640 1 Processor -- start 2024-01-20T08:14:17.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.421+0000 7f5dabe00640 1 -- start start 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5dabe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5dac1588f0 0x7f5dac1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5dabe00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac157d00 con 0x7f5dac14e690 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5dabe00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dac0c4890 con 0x7f5dac0c7e10 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5dabe00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dac06cd00 con 0x7f5dac1588f0 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5daaa00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5dac14e690 0x7f5dac0ca460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42102/0 (socket says 172.21.15.100:42102) 2024-01-20T08:14:17.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5daaa00640 1 -- 172.21.15.100:0/492088755 learned_addr learned my addr 172.21.15.100:0/492088755 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5dab400640 1 --2- 172.21.15.100:0/492088755 >> v2:172.21.15.110:3300/0 conn(0x7f5dac1588f0 0x7f5dac1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3158876940 0 0) 0x7f5dac157d00 con 0x7f5dac14e690 2024-01-20T08:14:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.423+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d8c003520 con 0x7f5dac14e690 2024-01-20T08:14:17.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4193142173 0 0) 0x7f5d8c003520 con 0x7f5dac14e690 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 >> v2:172.21.15.110:3300/0 conn(0x7f5dac1588f0 msgr2=0x7f5dac1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 --2- 172.21.15.100:0/492088755 >> v2:172.21.15.110:3300/0 conn(0x7f5dac1588f0 0x7f5dac1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 >> v1:172.21.15.110:6789/0 conn(0x7f5dac0c7e10 legacy=0x7f5dac1581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0c4b50 con 0x7f5dac14e690 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f5d9c001670 con 0x7f5dac14e690 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 >> v1:172.21.15.100:6789/0 conn(0x7f5dac14e690 legacy=0x7f5dac0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d8c0039c0 0x7f5d8c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5d8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d8c0051d0 0x7f5d8c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac06cd00 con 0x7f5d8c0047c0 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c00c120 con 0x7f5d8c0051d0 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d8c00c2e0 con 0x7f5d8c0039c0 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.424+0000 7f5daa000640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5d8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daaa00640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d8c0039c0 0x7f5d8c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5dab400640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d8c0051d0 0x7f5d8c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daa000640 1 -- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d8c0039c0 msgr2=0x7f5d8c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daa000640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d8c0039c0 0x7f5d8c003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daa000640 1 -- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d8c0051d0 msgr2=0x7f5d8c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daa000640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d8c0051d0 0x7f5d8c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5daa000640 1 -- 172.21.15.100:0/492088755 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c003520 con 0x7f5d8c0047c0 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.425+0000 7f5dab400640 1 -- 172.21.15.100:0/492088755 reap_dead start 2024-01-20T08:14:17.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5daa000640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5d8c004c40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06aa20 tx=0x7f5d8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31aacc62c1f673dd server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d940052d0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9402e050 con 0x7f5d8c0047c0 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5da9600640 1 -- 172.21.15.100:0/492088755 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94003830 con 0x7f5d8c0047c0 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5dabe00640 1 -- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 msgr2=0x7f5d8c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.426+0000 7f5dabe00640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5d8c004c40 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f5dac06aa20 tx=0x7f5d8c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.427+0000 7f5dabe00640 1 -- 172.21.15.100:0/492088755 shutdown_connections 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.427+0000 7f5dabe00640 1 --2- 172.21.15.100:0/492088755 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5d8c004c40 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.427+0000 7f5dabe00640 1 -- 172.21.15.100:0/492088755 >> 172.21.15.100:0/492088755 conn(0x7f5dac072130 msgr2=0x7f5dac072540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.427+0000 7f5dabe00640 1 -- 172.21.15.100:0/492088755 shutdown_connections 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.427+0000 7f5dabe00640 1 -- 172.21.15.100:0/492088755 wait complete. 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.428+0000 7f5dabe00640 1 Processor -- start 2024-01-20T08:14:17.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.428+0000 7f5dabe00640 1 -- start start 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac0ad9c0 0x7f5dac0ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 0x7f5dac1ecc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac1ea190 con 0x7f5d8c0047c0 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0ae380 con 0x7f5dac0ad9c0 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5dabe00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dac0acc00 con 0x7f5dac1ec790 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5daaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36376/0 (socket says 172.21.15.100:36376) 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.429+0000 7f5daaa00640 1 -- 172.21.15.100:0/1630191616 learned_addr learned my addr 172.21.15.100:0/1630191616 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daa000640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac0ad9c0 0x7f5dac0ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5dab400640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 0x7f5dac1ecc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 -- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 msgr2=0x7f5dac1ecc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 0x7f5dac1ecc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 -- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac0ad9c0 msgr2=0x7f5dac0ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac0ad9c0 0x7f5dac0ade40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 -- 172.21.15.100:0/1630191616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dac0acee0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5dab400640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 0x7f5dac1ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5daaa00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00d6f0 tx=0x7f5d9c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0072e0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d9c007440 con 0x7f5d8c0047c0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d9c0047e0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.430+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dac0ad1c0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.431+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dac0af670 con 0x7f5d8c0047c0 2024-01-20T08:14:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.432+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dac04e970 con 0x7f5d8c0047c0 2024-01-20T08:14:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.433+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5d9c004940 con 0x7f5d8c0047c0 2024-01-20T08:14:17.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.433+0000 7f5da2a00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 0x7f5d8406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.434+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f5d9c0894a0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.434+0000 7f5daa000640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 0x7f5d8406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.434+0000 7f5daa000640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 0x7f5d8406d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d94033000 tx=0x7f5d94009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.438+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5d9c057bd0 con 0x7f5d8c0047c0 2024-01-20T08:14:17.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.628+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5dac14bb40 con 0x7f5d8c0047c0 2024-01-20T08:14:17.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.629+0000 7f5da2a00640 1 -- 172.21.15.100:0/1630191616 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d9c057760 con 0x7f5d8c0047c0 2024-01-20T08:14:17.632 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 msgr2=0x7f5d8406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 0x7f5d8406d3c0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d94033000 tx=0x7f5d94009030 comp rx=0 tx=0).stop 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 msgr2=0x7f5dac0af130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f5d9c00d6f0 tx=0x7f5d9c00dbb0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 shutdown_connections 2024-01-20T08:14:17.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d8406af00 0x7f5d8406d3c0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5dac1ec790 0x7f5dac1ecc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5dac0ad9c0 0x7f5dac0ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 --2- 172.21.15.100:0/1630191616 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d8c0047c0 0x7f5dac0af130 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 >> 172.21.15.100:0/1630191616 conn(0x7f5dac072130 msgr2=0x7f5dac072510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 shutdown_connections 2024-01-20T08:14:17.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.632+0000 7f5dabe00640 1 -- 172.21.15.100:0/1630191616 wait complete. 2024-01-20T08:14:17.653 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-01-20T08:14:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.858+0000 7f238be00640 1 Processor -- start 2024-01-20T08:14:17.862 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.859+0000 7f238be00640 1 -- start start 2024-01-20T08:14:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.860+0000 7f238be00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2384151e00 0x7f238406e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.860+0000 7f238be00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f238406dd10 con 0x7f23840c2eb0 2024-01-20T08:14:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.860+0000 7f238be00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23841521e0 con 0x7f23840ac8b0 2024-01-20T08:14:17.863 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.860+0000 7f238be00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f238406eaf0 con 0x7f2384151e00 2024-01-20T08:14:17.865 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2388a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f23840c2eb0 0x7f23841547d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42114/0 (socket says 172.21.15.100:42114) 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2388a00640 1 -- 172.21.15.100:0/2880641530 learned_addr learned my addr 172.21.15.100:0/2880641530 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2389400640 1 --2- 172.21.15.100:0/2880641530 >> v2:172.21.15.110:3300/0 conn(0x7f2384151e00 0x7f238406e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2337545151 0 0) 0x7f238406dd10 con 0x7f23840c2eb0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2364003520 con 0x7f23840c2eb0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1677485659 0 0) 0x7f2364003520 con 0x7f23840c2eb0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 >> v2:172.21.15.110:3300/0 conn(0x7f2384151e00 msgr2=0x7f238406e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 --2- 172.21.15.100:0/2880641530 >> v2:172.21.15.110:3300/0 conn(0x7f2384151e00 0x7f238406e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 >> v1:172.21.15.110:6789/0 conn(0x7f23840ac8b0 legacy=0x7f238415f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.861+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840c3810 con 0x7f23840c2eb0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f236c001670 con 0x7f23840c2eb0 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 >> v1:172.21.15.100:6789/0 conn(0x7f23840c2eb0 legacy=0x7f23841547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f2364003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23640047c0 0x7f2364004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23640052a0 0x7f236400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.866 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236400c140 con 0x7f2364003970 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f236400c2b0 con 0x7f23640052a0 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f236400c470 con 0x7f23640047c0 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f2364003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2388a00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23640047c0 0x7f2364004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389e00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23640052a0 0x7f236400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 -- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23640047c0 msgr2=0x7f2364004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23640047c0 0x7f2364004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 -- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23640052a0 msgr2=0x7f236400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23640052a0 0x7f236400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2389400640 1 -- 172.21.15.100:0/2880641530 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364003520 con 0x7f2364003970 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.862+0000 7f2388a00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f23640047c0 0x7f2364004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.863+0000 7f2389e00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f23640052a0 0x7f236400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:17.867 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.863+0000 7f2389e00640 1 -- 172.21.15.100:0/2880641530 reap_dead start 2024-01-20T08:14:17.868 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f2389400640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f2364003d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2374009a90 tx=0x7f23640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed6de321dd324c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237402c680 con 0x7f2364003970 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237402c7e0 con 0x7f2364003970 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f2383e00640 1 -- 172.21.15.100:0/2880641530 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237402cb70 con 0x7f2364003970 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f238be00640 1 -- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 msgr2=0x7f2364003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.864+0000 7f238be00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f2364003d90 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f2374009a90 tx=0x7f23640057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.865+0000 7f238be00640 1 -- 172.21.15.100:0/2880641530 shutdown_connections 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.865+0000 7f238be00640 1 --2- 172.21.15.100:0/2880641530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f2364003d90 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.865+0000 7f238be00640 1 -- 172.21.15.100:0/2880641530 >> 172.21.15.100:0/2880641530 conn(0x7f23840c3b10 msgr2=0x7f23840c3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.865+0000 7f238be00640 1 -- 172.21.15.100:0/2880641530 shutdown_connections 2024-01-20T08:14:17.869 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.865+0000 7f238be00640 1 -- 172.21.15.100:0/2880641530 wait complete. 2024-01-20T08:14:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.866+0000 7f238be00640 1 Processor -- start 2024-01-20T08:14:17.870 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.867+0000 7f238be00640 1 -- start start 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.867+0000 7f238be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.867+0000 7f238be00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 0x7f2384143710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.867+0000 7f238be00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2384143c50 0x7f2384157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.867+0000 7f238be00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2384156bf0 con 0x7f2364003970 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f238be00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841eeb90 con 0x7f2384144e20 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f238be00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2384146ca0 con 0x7f2384143c50 2024-01-20T08:14:17.871 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36386/0 (socket says 172.21.15.100:36386) 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 -- 172.21.15.100:0/2981971291 learned_addr learned my addr 172.21.15.100:0/2981971291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 -- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2384143c50 msgr2=0x7f2384157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2384143c50 0x7f2384157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 -- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 msgr2=0x7f2384143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2388a00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 0x7f2384143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 0x7f2384143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2389400640 1 -- 172.21.15.100:0/2981971291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384146f80 con 0x7f2364003970 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.868+0000 7f2388a00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 0x7f2384143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:17.872 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f2389400640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2374009a90 tx=0x7f2374004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374003810 con 0x7f2364003970 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374003970 con 0x7f2364003970 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374003d00 con 0x7f2364003970 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2384147260 con 0x7f2364003970 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.869+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23841440d0 con 0x7f2364003970 2024-01-20T08:14:17.873 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.870+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2384067230 con 0x7f2364003970 2024-01-20T08:14:17.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.871+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2374040450 con 0x7f2364003970 2024-01-20T08:14:17.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.872+0000 7f2381600640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 0x7f235c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:17.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.872+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f23740ab850 con 0x7f2364003970 2024-01-20T08:14:17.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.872+0000 7f2388a00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 0x7f235c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:17.875 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.873+0000 7f2388a00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 0x7f235c06d3c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f236c001eb0 tx=0x7f236c001b20 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:17.879 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:17.876+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f23740763a0 con 0x7f2364003970 2024-01-20T08:14:18.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.068+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f23840c1160 con 0x7f2364003970 2024-01-20T08:14:18.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.068+0000 7f2381600640 1 -- 172.21.15.100:0/2981971291 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v78) v1 ==== 104+0+11 (secure 0 0 0) 0x7f23740044e0 con 0x7f2364003970 2024-01-20T08:14:18.071 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 msgr2=0x7f235c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 0x7f235c06d3c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f236c001eb0 tx=0x7f236c001b20 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 msgr2=0x7f23841ee650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f2374009a90 tx=0x7f2374004730 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 shutdown_connections 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f235c06af00 0x7f235c06d3c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2384143c50 0x7f2384157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2384144e20 0x7f2384143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 --2- 172.21.15.100:0/2981971291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2364003970 0x7f23841ee650 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 >> 172.21.15.100:0/2981971291 conn(0x7f23840c3b10 msgr2=0x7f23840c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:18.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 shutdown_connections 2024-01-20T08:14:18.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.071+0000 7f238be00640 1 -- 172.21.15.100:0/2981971291 wait complete. 2024-01-20T08:14:18.093 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-01-20T08:14:18.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.300+0000 7f76c8e00640 1 Processor -- start 2024-01-20T08:14:18.303 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.300+0000 7f76c8e00640 1 -- start start 2024-01-20T08:14:18.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c8e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76c414fdb0 0x7f76c40c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c8e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 0x7f76c4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c8e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76c4150190 con 0x7f76c40c3460 2024-01-20T08:14:18.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c8e00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c40a9ce0 con 0x7f76c414fdb0 2024-01-20T08:14:18.305 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c8e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c40a93b0 con 0x7f76c40c1d90 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76c414fdb0 0x7f76c40c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c2800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f76c40c3460 0x7f76c4155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42130/0 (socket says 172.21.15.100:42130) 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c1e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f76c414fdb0 0x7f76c40c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36392/0 (socket says 172.21.15.100:36392) 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c2800640 1 -- 172.21.15.100:0/2003156459 learned_addr learned my addr 172.21.15.100:0/2003156459 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.302+0000 7f76c1400640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 0x7f76c4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.303+0000 7f76c1e00640 1 -- 172.21.15.100:0/2003156459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 msgr2=0x7f76c4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.303+0000 7f76c1e00640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 0x7f76c4152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.306 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.303+0000 7f76c1e00640 1 -- 172.21.15.100:0/2003156459 >> v1:172.21.15.100:6789/0 conn(0x7f76c40c3460 legacy=0x7f76c4155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.303+0000 7f76c1e00640 1 -- 172.21.15.100:0/2003156459 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40a8810 con 0x7f76c414fdb0 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.303+0000 7f76c1400640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 0x7f76c4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.304+0000 7f76c1e00640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c414fdb0 0x7f76c40c1850 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097a0 tx=0x7f76b402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bcc03ad2efd72f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.304+0000 7f76c0a00640 1 -- 172.21.15.100:0/2003156459 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b402d040 con 0x7f76c414fdb0 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.304+0000 7f76c0a00640 1 -- 172.21.15.100:0/2003156459 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b4031810 con 0x7f76c414fdb0 2024-01-20T08:14:18.307 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.304+0000 7f76c0a00640 1 -- 172.21.15.100:0/2003156459 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4031ba0 con 0x7f76c414fdb0 2024-01-20T08:14:18.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 -- 172.21.15.100:0/2003156459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c414fdb0 msgr2=0x7f76c40c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c414fdb0 0x7f76c40c1850 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f76b40097a0 tx=0x7f76b402b8b0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 -- 172.21.15.100:0/2003156459 shutdown_connections 2024-01-20T08:14:18.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c40c1d90 0x7f76c4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2003156459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c414fdb0 0x7f76c40c1850 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 -- 172.21.15.100:0/2003156459 >> 172.21.15.100:0/2003156459 conn(0x7f76c40c2940 msgr2=0x7f76c40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:18.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 -- 172.21.15.100:0/2003156459 shutdown_connections 2024-01-20T08:14:18.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.305+0000 7f76c8e00640 1 -- 172.21.15.100:0/2003156459 wait complete. 2024-01-20T08:14:18.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.307+0000 7f76c8e00640 1 Processor -- start 2024-01-20T08:14:18.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.307+0000 7f76c8e00640 1 -- start start 2024-01-20T08:14:18.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c40c1d90 0x7f76c41564d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c414fdb0 0x7f76c41ed9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4154940 con 0x7f76c40c3460 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c4154180 con 0x7f76c40c1d90 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c8e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c41ee2c0 con 0x7f76c414fdb0 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.308+0000 7f76c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36394/0 (socket says 172.21.15.100:36394) 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 -- 172.21.15.100:0/2359110062 learned_addr learned my addr 172.21.15.100:0/2359110062 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c40c1d90 0x7f76c41564d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c2800640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c414fdb0 0x7f76c41ed9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 -- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c414fdb0 msgr2=0x7f76c41ed9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c414fdb0 0x7f76c41ed9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 -- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c40c1d90 msgr2=0x7f76c41564d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c40c1d90 0x7f76c41564d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 -- 172.21.15.100:0/2359110062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b4009400 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.309+0000 7f76c1400640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e7e0 tx=0x7f76ac00eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.310+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004030 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.310+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac004190 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.310+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004520 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.310+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c41ee5a0 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.310+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c4153e10 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.311+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c414aab0 con 0x7f76c40c3460 2024-01-20T08:14:18.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.312+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f76ac00c6d0 con 0x7f76c40c3460 2024-01-20T08:14:18.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.313+0000 7f76ba000640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 0x7f769c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.313+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f76ac089620 con 0x7f76c40c3460 2024-01-20T08:14:18.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.313+0000 7f76c1e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 0x7f769c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.316 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.313+0000 7f76c1e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 0x7f769c06d3c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f76b4036000 tx=0x7f76b403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.317+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f76ac054200 con 0x7f76c40c3460 2024-01-20T08:14:18.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.510+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76c41561f0 con 0x7f76c40c3460 2024-01-20T08:14:18.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.511+0000 7f76ba000640 1 -- 172.21.15.100:0/2359110062 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v78) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76c41561f0 con 0x7f76c40c3460 2024-01-20T08:14:18.514 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 msgr2=0x7f769c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 0x7f769c06d3c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f76b4036000 tx=0x7f76b403c040 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 msgr2=0x7f76c414ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00e7e0 tx=0x7f76ac00eca0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 shutdown_connections 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f769c06af00 0x7f769c06d3c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f76c414fdb0 0x7f76c41ed9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f76c40c3460 0x7f76c414ac60 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 --2- 172.21.15.100:0/2359110062 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f76c40c1d90 0x7f76c41564d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 >> 172.21.15.100:0/2359110062 conn(0x7f76c40c2940 msgr2=0x7f76c4070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 shutdown_connections 2024-01-20T08:14:18.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.514+0000 7f76c8e00640 1 -- 172.21.15.100:0/2359110062 wait complete. 2024-01-20T08:14:18.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.739+0000 7fccd4200640 1 Processor -- start 2024-01-20T08:14:18.742 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.739+0000 7fccd4200640 1 -- start start 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fcccc153190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd4200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fcccc0715a0 0x7fcccc071a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd4200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcccc0ab620 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd4200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcccc14cb30 con 0x7fcccc0715a0 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc0ab900 con 0x7fcccc14c750 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd0e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fcccc0ab0b0 0x7fcccc0a91b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:42132/0 (socket says 172.21.15.100:42132) 2024-01-20T08:14:18.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd0e00640 1 -- 172.21.15.100:0/4169162906 learned_addr learned my addr 172.21.15.100:0/4169162906 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fccd1800640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fcccc153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.741+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1333855101 0 0) 0x7fcccc0ab620 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fccd2200640 1 --2- 172.21.15.100:0/4169162906 >> v2:172.21.15.110:3300/0 conn(0x7fcccc0715a0 0x7fcccc071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccac003520 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3112347998 0 0) 0x7fccac003520 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.746 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 msgr2=0x7fcccc153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fcccc153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 >> v2:172.21.15.110:3300/0 conn(0x7fcccc0715a0 msgr2=0x7fcccc071a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 --2- 172.21.15.100:0/4169162906 >> v2:172.21.15.110:3300/0 conn(0x7fcccc0715a0 0x7fcccc071a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0abbe0 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fccb4001670 con 0x7fcccc0ab0b0 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 >> v1:172.21.15.100:6789/0 conn(0x7fcccc0ab0b0 legacy=0x7fcccc0a91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fccac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccac003ef0 0x7fccac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fccac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc14cb30 con 0x7fccac004d00 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc0ab900 con 0x7fccac003ef0 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccac00b980 con 0x7fcccc14c750 2024-01-20T08:14:18.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.742+0000 7fccd2200640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fccac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd0e00640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccac003ef0 0x7fccac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd1800640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fccac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd2200640 1 -- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 msgr2=0x7fccac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd2200640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc14c750 0x7fccac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd2200640 1 -- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccac003ef0 msgr2=0x7fccac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd2200640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fccac003ef0 0x7fccac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.748 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.743+0000 7fccd2200640 1 -- 172.21.15.100:0/4169162906 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccac003520 con 0x7fccac004d00 2024-01-20T08:14:18.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.744+0000 7fccd2200640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fccac005180 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009fc0 tx=0x7fccac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e413f66424e383a server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.744+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc402cc40 con 0x7fccac004d00 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.744+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400f040 con 0x7fccac004d00 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.744+0000 7fcccbe00640 1 -- 172.21.15.100:0/4169162906 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4034440 con 0x7fccac004d00 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 -- 172.21.15.100:0/4169162906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 msgr2=0x7fccac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 --2- 172.21.15.100:0/4169162906 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fccac005180 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fccc4009fc0 tx=0x7fccac0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd2200640 1 -- 172.21.15.100:0/4169162906 reap_dead start 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 -- 172.21.15.100:0/4169162906 shutdown_connections 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 -- 172.21.15.100:0/4169162906 >> 172.21.15.100:0/4169162906 conn(0x7fcccc0c6090 msgr2=0x7fcccc0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 -- 172.21.15.100:0/4169162906 shutdown_connections 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.745+0000 7fccd4200640 1 -- 172.21.15.100:0/4169162906 wait complete. 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.746+0000 7fccd4200640 1 Processor -- start 2024-01-20T08:14:18.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.747+0000 7fccd4200640 1 -- start start 2024-01-20T08:14:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.747+0000 7fccd4200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.747+0000 7fccd4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc156940 0x7fcccc140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.747+0000 7fccd4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcccc14d050 0x7fcccc140eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd4200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc14fd90 con 0x7fccac004d00 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc1ea0f0 con 0x7fcccc14d050 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc1eb0c0 con 0x7fcccc156940 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36414/0 (socket says 172.21.15.100:36414) 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 -- 172.21.15.100:0/1727537128 learned_addr learned my addr 172.21.15.100:0/1727537128 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 -- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc156940 msgr2=0x7fcccc140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc156940 0x7fcccc140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 -- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcccc14d050 msgr2=0x7fcccc140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcccc14d050 0x7fcccc140eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 -- 172.21.15.100:0/1727537128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc1ea300 con 0x7fccac004d00 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.748+0000 7fccd1800640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fccbc011630 tx=0x7fccbc011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.749+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00f920 con 0x7fccac004d00 2024-01-20T08:14:18.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.749+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00fa80 con 0x7fccac004d00 2024-01-20T08:14:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.749+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc1ea5e0 con 0x7fccac004d00 2024-01-20T08:14:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.749+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00fdf0 con 0x7fccac004d00 2024-01-20T08:14:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.749+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcccc1eaba0 con 0x7fccac004d00 2024-01-20T08:14:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.750+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcccc04ea50 con 0x7fccac004d00 2024-01-20T08:14:18.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.751+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fccbc015460 con 0x7fccac004d00 2024-01-20T08:14:18.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.752+0000 7fccc9600640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 0x7fcca406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:18.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.752+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fccbc08a140 con 0x7fccac004d00 2024-01-20T08:14:18.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.753+0000 7fccd0e00640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 0x7fcca406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:18.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.753+0000 7fccd0e00640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 0x7fcca406d3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001050 tx=0x7fccb4001c50 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:18.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.757+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fccbc054d20 con 0x7fccac004d00 2024-01-20T08:14:18.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.947+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcccc0702b0 con 0x7fccac004d00 2024-01-20T08:14:18.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.948+0000 7fccc9600640 1 -- 172.21.15.100:0/1727537128 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v78) v1 ==== 105+0+11 (secure 0 0 0) 0x7fccbc058340 con 0x7fccac004d00 2024-01-20T08:14:18.951 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 msgr2=0x7fcca406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 0x7fcca406d3c0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fccb4001050 tx=0x7fccb4001c50 comp rx=0 tx=0).stop 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 msgr2=0x7fcccc0bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fccbc011630 tx=0x7fccbc011af0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 shutdown_connections 2024-01-20T08:14:18.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fcccc14d050 0x7fcccc140eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fcca406af00 0x7fcca406d3c0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fcccc156940 0x7fcccc140970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 --2- 172.21.15.100:0/1727537128 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fccac004d00 0x7fcccc0bf730 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 >> 172.21.15.100:0/1727537128 conn(0x7fcccc0c6090 msgr2=0x7fcccc14a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 shutdown_connections 2024-01-20T08:14:18.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:18.951+0000 7fccd4200640 1 -- 172.21.15.100:0/1727537128 wait complete. 2024-01-20T08:14:18.973 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.179+0000 7fabdcc00640 1 Processor -- start 2024-01-20T08:14:19.182 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.179+0000 7fabdcc00640 1 -- start start 2024-01-20T08:14:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabdcc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fabd814fdb0 0x7fabd80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabdcc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd80c1d90 0x7fabd8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabdcc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabd8150190 con 0x7fabd80c3460 2024-01-20T08:14:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabdcc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabd80a9ce0 con 0x7fabd814fdb0 2024-01-20T08:14:19.184 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabdcc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80a93b0 con 0x7fabd80c1d90 2024-01-20T08:14:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabd6800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fabd80c3460 0x7fabd8155c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47602/0 (socket says 172.21.15.100:47602) 2024-01-20T08:14:19.185 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.181+0000 7fabd6800640 1 -- 172.21.15.100:0/1565441322 learned_addr learned my addr 172.21.15.100:0/1565441322 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976583366 0 0) 0x7fabd8150190 con 0x7fabd80c3460 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> v2:172.21.15.110:3300/0 conn(0x7fabd814fdb0 0x7fabd80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabb8003520 con 0x7fabd80c3460 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabcfe00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd80c1d90 0x7fabd8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3984833574 0 0) 0x7fabb8003520 con 0x7fabd80c3460 2024-01-20T08:14:19.186 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd80c1d90 msgr2=0x7fabd8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd80c1d90 0x7fabd8152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 >> v2:172.21.15.110:3300/0 conn(0x7fabd814fdb0 msgr2=0x7fabd80c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 --2- 172.21.15.100:0/1565441322 >> v2:172.21.15.110:3300/0 conn(0x7fabd814fdb0 0x7fabd80c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd80a8810 con 0x7fabd80c3460 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fabd00019f0 con 0x7fabd80c3460 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 >> v1:172.21.15.100:6789/0 conn(0x7fabd80c3460 legacy=0x7fabd8155c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb80047c0 0x7fabb8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8005180 0x7fabb800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd80a93b0 con 0x7fabb8003970 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800bf70 con 0x7fabb80047c0 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb800c100 con 0x7fabb8005180 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabcfe00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd80c1d90 0x7fabd8152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.182+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> v2:172.21.15.110:3300/0 conn(0x7fabd814fdb0 0x7fabd80c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:19.187 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd6800640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8005180 0x7fabb800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabcfe00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb80047c0 0x7fabb8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 -- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8005180 msgr2=0x7fabb800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8005180 0x7fabb800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 -- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb80047c0 msgr2=0x7fabb8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabb80047c0 0x7fabb8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd5e00640 1 -- 172.21.15.100:0/1565441322 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb8003520 con 0x7fabb8003970 2024-01-20T08:14:19.188 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.183+0000 7fabd6800640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabb8005180 0x7fabb800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.184+0000 7fabd5e00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabb8003d90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098d0 tx=0x7fabb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c752a614e8e41e04 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8030680 con 0x7fabb8003970 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc80307e0 con 0x7fabb8003970 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabd5400640 1 -- 172.21.15.100:0/1565441322 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8030b50 con 0x7fabb8003970 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabdcc00640 1 -- 172.21.15.100:0/1565441322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 msgr2=0x7fabb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.189 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabdcc00640 1 --2- 172.21.15.100:0/1565441322 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabb8003d90 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fabc80098d0 tx=0x7fabb80057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.185+0000 7fabd6800640 1 -- 172.21.15.100:0/1565441322 reap_dead start 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.186+0000 7fabdcc00640 1 -- 172.21.15.100:0/1565441322 shutdown_connections 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.186+0000 7fabdcc00640 1 -- 172.21.15.100:0/1565441322 >> 172.21.15.100:0/1565441322 conn(0x7fabd80c2940 msgr2=0x7fabd80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.186+0000 7fabdcc00640 1 -- 172.21.15.100:0/1565441322 shutdown_connections 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.186+0000 7fabdcc00640 1 -- 172.21.15.100:0/1565441322 wait complete. 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.188+0000 7fabdcc00640 1 Processor -- start 2024-01-20T08:14:19.190 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.188+0000 7fabdcc00640 1 -- start start 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabd80c58a0 0x7fabd81e4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd8070190 0x7fabd81e5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81551a0 con 0x7fabb8003970 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd81e57b0 con 0x7fabd80c58a0 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabdcc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabd8146250 con 0x7fabd8070190 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49202/0 (socket says 172.21.15.100:49202) 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 -- 172.21.15.100:0/4195317240 learned_addr learned my addr 172.21.15.100:0/4195317240 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 -- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd8070190 msgr2=0x7fabd81e5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd8070190 0x7fabd81e5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 -- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabd80c58a0 msgr2=0x7fabd81e4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabcfe00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabd80c58a0 0x7fabd81e4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabd80c58a0 0x7fabd81e4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.189+0000 7fabd5e00640 1 -- 172.21.15.100:0/4195317240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabd8153ea0 con 0x7fabb8003970 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabd5e00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fabc802bfe0 tx=0x7fabc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc80399a0 con 0x7fabb8003970 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabc803f040 con 0x7fabb8003970 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc8039d80 con 0x7fabb8003970 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd8145f70 con 0x7fabb8003970 2024-01-20T08:14:19.194 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.190+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd81e8970 con 0x7fabb8003970 2024-01-20T08:14:19.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.191+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd804e970 con 0x7fabb8003970 2024-01-20T08:14:19.195 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.192+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fabc804d460 con 0x7fabb8003970 2024-01-20T08:14:19.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.193+0000 7fabce000640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 0x7fabb006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.193+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fabc80ac210 con 0x7fabb8003970 2024-01-20T08:14:19.196 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.193+0000 7fabcfe00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 0x7fabb006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.197 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.194+0000 7fabcfe00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 0x7fabb006d3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fabc0006fd0 tx=0x7fabc0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.198+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fabc8076d60 con 0x7fabb8003970 2024-01-20T08:14:19.392 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.389+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fabd81551a0 con 0x7fabb8003970 2024-01-20T08:14:19.393 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.390+0000 7fabce000640 1 -- 172.21.15.100:0/4195317240 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v78) v1 ==== 101+0+11 (secure 0 0 0) 0x7fabc807a380 con 0x7fabb8003970 2024-01-20T08:14:19.393 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 msgr2=0x7fabb006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 0x7fabb006d3c0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fabc0006fd0 tx=0x7fabc0008040 comp rx=0 tx=0).stop 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 msgr2=0x7fabd814f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7fabc802bfe0 tx=0x7fabc8004730 comp rx=0 tx=0).stop 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 shutdown_connections 2024-01-20T08:14:19.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fabb006af00 0x7fabb006d3c0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fabd8070190 0x7fabd81e5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fabd80c58a0 0x7fabd81e4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 --2- 172.21.15.100:0/4195317240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fabb8003970 0x7fabd814f310 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 >> 172.21.15.100:0/4195317240 conn(0x7fabd80c2940 msgr2=0x7fabd80c10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 shutdown_connections 2024-01-20T08:14:19.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.393+0000 7fabdcc00640 1 -- 172.21.15.100:0/4195317240 wait complete. 2024-01-20T08:14:19.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:19.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.625+0000 7fb4f7400640 1 Processor -- start 2024-01-20T08:14:19.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.626+0000 7fb4f7400640 1 -- start start 2024-01-20T08:14:19.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.627+0000 7fb4f7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.627+0000 7fb4f7400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4f00a93c0 0x7fb4f0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.627+0000 7fb4f7400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4f00a9940 con 0x7fb4f0153440 2024-01-20T08:14:19.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.627+0000 7fb4f7400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f01500c0 con 0x7fb4f00a93c0 2024-01-20T08:14:19.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.627+0000 7fb4f7400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0156810 con 0x7fb4f014fce0 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4f00a93c0 0x7fb4f0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4f4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4f4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:52122/0 (socket says 172.21.15.100:52122) 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb4f00a93c0 0x7fb4f0152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:41428/0 (socket says 172.21.15.100:41428) 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4f4a00640 1 -- 172.21.15.100:0/579452832 learned_addr learned my addr 172.21.15.100:0/579452832 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:19.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 -- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 msgr2=0x7fb4f0153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:19.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 -- 172.21.15.100:0/579452832 >> v1:172.21.15.110:6789/0 conn(0x7fb4f0153440 legacy=0x7fb4f00aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4e7c00640 1 -- 172.21.15.100:0/579452832 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f0156af0 con 0x7fb4f00a93c0 2024-01-20T08:14:19.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.628+0000 7fb4f4a00640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:14:19.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.630+0000 7fb4e7c00640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f00a93c0 0x7fb4f0152f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097a0 tx=0x7fb4d802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7147205ca4206cad server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.630+0000 7fb4efe00640 1 -- 172.21.15.100:0/579452832 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d802d040 con 0x7fb4f00a93c0 2024-01-20T08:14:19.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4efe00640 1 -- 172.21.15.100:0/579452832 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d8031810 con 0x7fb4f00a93c0 2024-01-20T08:14:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4efe00640 1 -- 172.21.15.100:0/579452832 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8031ba0 con 0x7fb4f00a93c0 2024-01-20T08:14:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 -- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f00a93c0 msgr2=0x7fb4f0152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f00a93c0 0x7fb4f0152f00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb4d80097a0 tx=0x7fb4d802b8b0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 -- 172.21.15.100:0/579452832 shutdown_connections 2024-01-20T08:14:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f00a93c0 0x7fb4f0152f00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 --2- 172.21.15.100:0/579452832 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f014fce0 0x7fb4f0153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 -- 172.21.15.100:0/579452832 >> 172.21.15.100:0/579452832 conn(0x7fb4f006a5e0 msgr2=0x7fb4f006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 -- 172.21.15.100:0/579452832 shutdown_connections 2024-01-20T08:14:19.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.631+0000 7fb4f7400640 1 -- 172.21.15.100:0/579452832 wait complete. 2024-01-20T08:14:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.633+0000 7fb4f7400640 1 Processor -- start 2024-01-20T08:14:19.636 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.633+0000 7fb4f7400640 1 -- start start 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f014fce0 0x7fb4f00c2270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f00c2d90 0x7fb4f01ebde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0146cc0 con 0x7fb4f0153440 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0146a70 con 0x7fb4f014fce0 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4f7400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f0146f30 con 0x7fb4f00c2d90 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.634+0000 7fb4e7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49214/0 (socket says 172.21.15.100:49214) 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 -- 172.21.15.100:0/2810999866 learned_addr learned my addr 172.21.15.100:0/2810999866 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4f4a00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f014fce0 0x7fb4f00c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4f5400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f00c2d90 0x7fb4f01ebde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 -- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f00c2d90 msgr2=0x7fb4f01ebde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f00c2d90 0x7fb4f01ebde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 -- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f014fce0 msgr2=0x7fb4f00c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f014fce0 0x7fb4f00c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 -- 172.21.15.100:0/2810999866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e00094d0 con 0x7fb4f0153440 2024-01-20T08:14:19.639 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.635+0000 7fb4e7c00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb4d802be40 tx=0x7fb4d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.636+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8006e10 con 0x7fb4f0153440 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.636+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4d803ad60 con 0x7fb4f0153440 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.636+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8044640 con 0x7fb4f0153440 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.636+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d8009400 con 0x7fb4f0153440 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.636+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f01eb380 con 0x7fb4f0153440 2024-01-20T08:14:19.640 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.637+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0155a60 con 0x7fb4f0153440 2024-01-20T08:14:19.641 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.638+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb4d804d440 con 0x7fb4f0153440 2024-01-20T08:14:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.639+0000 7fb4ed600640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 0x7fb4c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.639+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fb4d80abcc0 con 0x7fb4f0153440 2024-01-20T08:14:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.639+0000 7fb4f4a00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 0x7fb4c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:19.642 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.640+0000 7fb4f4a00640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 0x7fb4c806d390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01dfbe0 tx=0x7fb4e0008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:19.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.644+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb4d80b2080 con 0x7fb4f0153440 2024-01-20T08:14:19.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.874+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f004e970 con 0x7fb4f0153440 2024-01-20T08:14:19.878 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.875+0000 7fb4ed600640 1 -- 172.21.15.100:0/2810999866 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6197 (secure 0 0 0) 0x7fb4d8035090 con 0x7fb4f0153440 2024-01-20T08:14:19.878 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:19.878 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:19.878 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 53 2024-01-20T08:14:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 msgr2=0x7fb4c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 0x7fb4c806d390 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01dfbe0 tx=0x7fb4e0008040 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 msgr2=0x7fb4f01eb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7fb4d802be40 tx=0x7fb4d80046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 shutdown_connections 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb4c806aed0 0x7fb4c806d390 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb4f00c2d90 0x7fb4f01ebde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb4f0153440 0x7fb4f01eb8a0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 --2- 172.21.15.100:0/2810999866 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb4f014fce0 0x7fb4f00c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 >> 172.21.15.100:0/2810999866 conn(0x7fb4f006a5e0 msgr2=0x7fb4f0153850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 shutdown_connections 2024-01-20T08:14:19.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:19.878+0000 7fb4f7400640 1 -- 172.21.15.100:0/2810999866 wait complete. 2024-01-20T08:14:19.900 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.102+0000 7f8243a00640 1 Processor -- start 2024-01-20T08:14:20.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.102+0000 7f8243a00640 1 -- start start 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.103+0000 7f8243a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f823c071220 0x7f823c071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.103+0000 7f8243a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c0c0fb0 con 0x7f823c157eb0 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.103+0000 7f8243a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f823c06def0 con 0x7f823c0bfae0 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.103+0000 7f8243a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f823c0c04a0 con 0x7f823c071220 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.104+0000 7f8241a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f823c157eb0 0x7f823c158320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47610/0 (socket says 172.21.15.100:47610) 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.104+0000 7f8241a00640 1 -- 172.21.15.100:0/2454566212 learned_addr learned my addr 172.21.15.100:0/2454566212 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:20.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.104+0000 7f8241000640 1 --2- 172.21.15.100:0/2454566212 >> v2:172.21.15.110:3300/0 conn(0x7f823c071220 0x7f823c071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.104+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063103793 0 0) 0x7f823c0c0fb0 con 0x7f823c157eb0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.104+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f821c003520 con 0x7f823c157eb0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3176103727 0 0) 0x7f821c003520 con 0x7f823c157eb0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 >> v2:172.21.15.110:3300/0 conn(0x7f823c071220 msgr2=0x7f823c071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 --2- 172.21.15.100:0/2454566212 >> v2:172.21.15.110:3300/0 conn(0x7f823c071220 0x7f823c071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 >> v1:172.21.15.110:6789/0 conn(0x7f823c0bfae0 legacy=0x7f823c151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c06e1d0 con 0x7f823c157eb0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f82340019f0 con 0x7f823c157eb0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 >> v1:172.21.15.100:6789/0 conn(0x7f823c157eb0 legacy=0x7f823c158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 0x7f821c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0052a0 0x7f821c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c0c04a0 con 0x7f821c0039c0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c1a0 con 0x7f821c0047c0 2024-01-20T08:14:20.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c00c360 con 0x7f821c0052a0 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.105+0000 7f8241000640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 0x7f821c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8233c00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241a00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0052a0 0x7f821c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241000640 1 -- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0052a0 msgr2=0x7f821c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241000640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0052a0 0x7f821c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241000640 1 -- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f821c0047c0 msgr2=0x7f821c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241000640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241000640 1 -- 172.21.15.100:0/2454566212 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c003520 con 0x7f821c0039c0 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8241a00640 1 -- 172.21.15.100:0/2454566212 reap_dead start 2024-01-20T08:14:20.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.106+0000 7f8233c00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f821c0047c0 0x7f821c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:20.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.107+0000 7f8241000640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 0x7f821c003de0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f822c009ac0 tx=0x7f821c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4babfe10e4074e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c02c6b0 con 0x7f821c0039c0 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f822c02c810 con 0x7f821c0039c0 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f823be00640 1 -- 172.21.15.100:0/2454566212 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f822c02cba0 con 0x7f821c0039c0 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 -- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 msgr2=0x7f821c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 0x7f821c003de0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f822c009ac0 tx=0x7f821c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 -- 172.21.15.100:0/2454566212 shutdown_connections 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 --2- 172.21.15.100:0/2454566212 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f821c0039c0 0x7f821c003de0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 -- 172.21.15.100:0/2454566212 >> 172.21.15.100:0/2454566212 conn(0x7f823c06a5e0 msgr2=0x7f823c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 -- 172.21.15.100:0/2454566212 shutdown_connections 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.108+0000 7f8243a00640 1 -- 172.21.15.100:0/2454566212 wait complete. 2024-01-20T08:14:20.113 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.110+0000 7f8243a00640 1 Processor -- start 2024-01-20T08:14:20.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.110+0000 7f8243a00640 1 -- start start 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0039c0 0x7f823c1ee510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f823c1eac50 0x7f823c1eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1eea50 con 0x7f823c0a93c0 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c1574f0 con 0x7f823c1eac50 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8243a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f823c156c50 con 0x7f821c0039c0 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8233c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8233c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49242/0 (socket says 172.21.15.100:49242) 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.111+0000 7f8233c00640 1 -- 172.21.15.100:0/4152525365 learned_addr learned my addr 172.21.15.100:0/4152525365 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8241000640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0039c0 0x7f823c1ee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8241a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f823c1eac50 0x7f823c1eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 -- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0039c0 msgr2=0x7f823c1ee510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0039c0 0x7f823c1ee510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 -- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f823c1eac50 msgr2=0x7f823c1eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f823c1eac50 0x7f823c1eb0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 -- 172.21.15.100:0/4152525365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f823c156f30 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8233c00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f822400e480 tx=0x7f822400e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82240052e0 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8224005440 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c157210 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.112+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8224003810 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.113+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c0c5e70 con 0x7f823c0a93c0 2024-01-20T08:14:20.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.114+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c1ea590 con 0x7f823c0a93c0 2024-01-20T08:14:20.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.114+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8224003970 con 0x7f823c0a93c0 2024-01-20T08:14:20.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.115+0000 7f8239600640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 0x7f821406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.115+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f8224089700 con 0x7f823c0a93c0 2024-01-20T08:14:20.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.116+0000 7f8241000640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 0x7f821406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.116+0000 7f8241000640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 0x7f821406d390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f822c036000 tx=0x7f822c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.122 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.120+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f823c1ea590 con 0x7f823c0a93c0 2024-01-20T08:14:20.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.317+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f823c1ea590 con 0x7f823c0a93c0 2024-01-20T08:14:20.323 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.320+0000 7f8239600640 1 -- 172.21.15.100:0/4152525365 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f823c1ea590 con 0x7f823c0a93c0 2024-01-20T08:14:20.323 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:20.323 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 msgr2=0x7f821406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 0x7f821406d390 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f822c036000 tx=0x7f822c030000 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 msgr2=0x7f823c0c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f822400e480 tx=0x7f822400e940 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 shutdown_connections 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f823c1eac50 0x7f823c1eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f823c0a93c0 0x7f823c0c5260 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f821406aed0 0x7f821406d390 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 --2- 172.21.15.100:0/4152525365 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f821c0039c0 0x7f823c1ee510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.326 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 >> 172.21.15.100:0/4152525365 conn(0x7f823c06a5e0 msgr2=0x7f823c0c1340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 shutdown_connections 2024-01-20T08:14:20.327 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.323+0000 7f8243a00640 1 -- 172.21.15.100:0/4152525365 wait complete. 2024-01-20T08:14:20.345 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T08:14:20.345 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:20.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.544+0000 7f56f3200640 1 Processor -- start 2024-01-20T08:14:20.547 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.544+0000 7f56f3200640 1 -- start start 2024-01-20T08:14:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.545+0000 7f56f3200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56f40c3e00 0x7f56f406d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.545+0000 7f56f3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f40c5570 0x7f56f406cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.545+0000 7f56f3200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f41523a0 con 0x7f56f406d2b0 2024-01-20T08:14:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.545+0000 7f56f3200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f40706a0 con 0x7f56f40c3e00 2024-01-20T08:14:20.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.545+0000 7f56f3200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4151ee0 con 0x7f56f40c5570 2024-01-20T08:14:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.546+0000 7f56ebe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56f40c3e00 0x7f56f406d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.546+0000 7f56f2800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f40c5570 0x7f56f406cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.546+0000 7f56ebe00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f56f40c3e00 0x7f56f406d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:41486/0 (socket says 172.21.15.100:41486) 2024-01-20T08:14:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.546+0000 7f56ebe00640 1 -- 172.21.15.100:0/3913494117 learned_addr learned my addr 172.21.15.100:0/3913494117 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:20.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.547+0000 7f56ebe00640 1 -- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f40c5570 msgr2=0x7f56f406cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.547+0000 7f56ebe00640 1 --2- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f40c5570 0x7f56f406cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.547+0000 7f56ebe00640 1 -- 172.21.15.100:0/3913494117 >> v1:172.21.15.110:6789/0 conn(0x7f56f406d2b0 legacy=0x7f56f406c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.547+0000 7f56ebe00640 1 -- 172.21.15.100:0/3913494117 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f40a53f0 con 0x7f56f40c3e00 2024-01-20T08:14:20.550 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.548+0000 7f56ebe00640 1 --2- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c3e00 0x7f56f406d690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f469f00adc9e836 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.548+0000 7f56f1400640 1 -- 172.21.15.100:0/3913494117 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0317c0 con 0x7f56f40c3e00 2024-01-20T08:14:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f1400640 1 -- 172.21.15.100:0/3913494117 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc031920 con 0x7f56f40c3e00 2024-01-20T08:14:20.551 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f1400640 1 -- 172.21.15.100:0/3913494117 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc031cb0 con 0x7f56f40c3e00 2024-01-20T08:14:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 -- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c3e00 msgr2=0x7f56f406d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 --2- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c3e00 0x7f56f406d690 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f56dc009870 tx=0x7f56dc02b860 comp rx=0 tx=0).stop 2024-01-20T08:14:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 -- 172.21.15.100:0/3913494117 shutdown_connections 2024-01-20T08:14:20.552 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 --2- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f40c5570 0x7f56f406cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 --2- 172.21.15.100:0/3913494117 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c3e00 0x7f56f406d690 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 -- 172.21.15.100:0/3913494117 >> 172.21.15.100:0/3913494117 conn(0x7f56f40c2590 msgr2=0x7f56f40c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.549+0000 7f56f3200640 1 -- 172.21.15.100:0/3913494117 shutdown_connections 2024-01-20T08:14:20.553 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.550+0000 7f56f3200640 1 -- 172.21.15.100:0/3913494117 wait complete. 2024-01-20T08:14:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.551+0000 7f56f3200640 1 Processor -- start 2024-01-20T08:14:20.554 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.551+0000 7f56f3200640 1 -- start start 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f406d2b0 0x7f56f41df060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 0x7f56f41eab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41eea50 con 0x7f56f40c3e00 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41edc90 con 0x7f56f40c5570 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.552+0000 7f56f3200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f41edf70 con 0x7f56f406d2b0 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.556 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49248/0 (socket says 172.21.15.100:49248) 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 -- 172.21.15.100:0/454831895 learned_addr learned my addr 172.21.15.100:0/454831895 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56f1e00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f406d2b0 0x7f56f41df060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56f2800640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 0x7f56f41eab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 -- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f406d2b0 msgr2=0x7f56f41df060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f406d2b0 0x7f56f41df060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 -- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 msgr2=0x7f56f41eab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 0x7f56f41eab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 -- 172.21.15.100:0/454831895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56dc0094d0 con 0x7f56f40c3e00 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56f2800640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 0x7f56f41eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:20.557 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.553+0000 7f56ebe00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f56dc02b8a0 tx=0x7f56dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.554+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc032860 con 0x7f56f40c3e00 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.554+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56dc032a00 con 0x7f56f40c3e00 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.554+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56dc032db0 con 0x7f56f40c3e00 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.554+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f41ee250 con 0x7f56f40c3e00 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.554+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f41df5a0 con 0x7f56f40c3e00 2024-01-20T08:14:20.558 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.555+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f40749e0 con 0x7f56f40c3e00 2024-01-20T08:14:20.559 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.556+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f56dc04e450 con 0x7f56f40c3e00 2024-01-20T08:14:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.557+0000 7f56ea000640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 0x7f56cc06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.557+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f56dc0abb40 con 0x7f56f40c3e00 2024-01-20T08:14:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.557+0000 7f56f1e00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 0x7f56cc06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:20.560 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.558+0000 7f56f1e00640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 0x7f56cc06d3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56e4007fd0 tx=0x7f56e4009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:20.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.563+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f56dc0767a0 con 0x7f56f40c3e00 2024-01-20T08:14:20.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.795+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f56f414dfc0 con 0x7f56f40c3e00 2024-01-20T08:14:20.799 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.796+0000 7f56ea000640 1 -- 172.21.15.100:0/454831895 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6197 (secure 0 0 0) 0x7f56dc079dc0 con 0x7f56f40c3e00 2024-01-20T08:14:20.799 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:20.799 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:20.799 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 53 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 msgr2=0x7f56cc06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 0x7f56cc06d3c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f56e4007fd0 tx=0x7f56e4009040 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 msgr2=0x7f56f41ea610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f56dc02b8a0 tx=0x7f56dc0046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 shutdown_connections 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f56f40c5570 0x7f56f41eab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f56f40c3e00 0x7f56f41ea610 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f56cc06af00 0x7f56cc06d3c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 --2- 172.21.15.100:0/454831895 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f56f406d2b0 0x7f56f41df060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.798+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 >> 172.21.15.100:0/454831895 conn(0x7f56f40c2590 msgr2=0x7f56f406c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.799+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 shutdown_connections 2024-01-20T08:14:20.802 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:20.799+0000 7f56f3200640 1 -- 172.21.15.100:0/454831895 wait complete. 2024-01-20T08:14:20.820 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:21.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.024+0000 7fd77b200640 1 Processor -- start 2024-01-20T08:14:21.027 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.025+0000 7fd77b200640 1 -- start start 2024-01-20T08:14:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd77b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd77414fce0 0x7fd774153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd77b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fd7740aae00 0x7fd7740ab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd77b200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7740a9940 con 0x7fd7740a93c0 2024-01-20T08:14:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd77b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7741500c0 con 0x7fd7740aae00 2024-01-20T08:14:21.030 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd77b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd774156810 con 0x7fd77414fce0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd76b200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd7740a93c0 0x7fd774152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47624/0 (socket says 172.21.15.100:47624) 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.026+0000 7fd76b200640 1 -- 172.21.15.100:0/3458395846 learned_addr learned my addr 172.21.15.100:0/3458395846 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd779200640 1 --2- 172.21.15.100:0/3458395846 >> v2:172.21.15.100:3300/0 conn(0x7fd7740aae00 0x7fd7740ab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd773e00640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd77414fce0 0x7fd774153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187615049 0 0) 0x7fd7740a9940 con 0x7fd7740a93c0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd754003520 con 0x7fd7740a93c0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd779200640 1 -- 172.21.15.100:0/3458395846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd77414fce0 msgr2=0x7fd774153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd779200640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd77414fce0 0x7fd774153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd779200640 1 -- 172.21.15.100:0/3458395846 >> v1:172.21.15.100:6789/0 conn(0x7fd7740a93c0 legacy=0x7fd774152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2763363901 0 0) 0x7fd754003520 con 0x7fd7740a93c0 2024-01-20T08:14:21.031 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.027+0000 7fd779200640 1 -- 172.21.15.100:0/3458395846 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd774156af0 con 0x7fd7740aae00 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.028+0000 7fd779200640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7740aae00 0x7fd7740ab290 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009d90 tx=0x7fd76c02bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c284851f8a70f19f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c001670 con 0x7fd7740aae00 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c02c8a0 con 0x7fd7740aae00 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd773400640 1 -- 172.21.15.100:0/3458395846 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c02cc30 con 0x7fd7740aae00 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 -- 172.21.15.100:0/3458395846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7740aae00 msgr2=0x7fd7740ab290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7740aae00 0x7fd7740ab290 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009d90 tx=0x7fd76c02bd70 comp rx=0 tx=0).stop 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 -- 172.21.15.100:0/3458395846 shutdown_connections 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7740aae00 0x7fd7740ab290 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 --2- 172.21.15.100:0/3458395846 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd77414fce0 0x7fd774153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.029+0000 7fd77b200640 1 -- 172.21.15.100:0/3458395846 >> 172.21.15.100:0/3458395846 conn(0x7fd77406a5e0 msgr2=0x7fd77406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:21.033 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.030+0000 7fd77b200640 1 -- 172.21.15.100:0/3458395846 shutdown_connections 2024-01-20T08:14:21.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.030+0000 7fd77b200640 1 -- 172.21.15.100:0/3458395846 wait complete. 2024-01-20T08:14:21.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.031+0000 7fd77b200640 1 Processor -- start 2024-01-20T08:14:21.034 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.031+0000 7fd77b200640 1 -- start start 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 0x7fd7740bd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7740aae00 0x7fd7740c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd774143940 con 0x7fd77414fce0 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740c19a0 con 0x7fd7740a93c0 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.032+0000 7fd77b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7740c2170 con 0x7fd7740aae00 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.036 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49262/0 (socket says 172.21.15.100:49262) 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 -- 172.21.15.100:0/2637063855 learned_addr learned my addr 172.21.15.100:0/2637063855 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd773e00640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 0x7fd7740bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 -- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7740aae00 msgr2=0x7fd7740c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd76b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7740aae00 0x7fd7740c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7740aae00 0x7fd7740c63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 -- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 msgr2=0x7fd7740bd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 0x7fd7740bd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 -- 172.21.15.100:0/2637063855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76c009a70 con 0x7fd77414fce0 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd773e00640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 0x7fd7740bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:21.037 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.033+0000 7fd779200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009d90 tx=0x7fd76c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.034+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c02ce90 con 0x7fd77414fce0 2024-01-20T08:14:21.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.034+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd76c009450 con 0x7fd77414fce0 2024-01-20T08:14:21.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.034+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd76c040690 con 0x7fd77414fce0 2024-01-20T08:14:21.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.034+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7740bdb60 con 0x7fd77414fce0 2024-01-20T08:14:21.038 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.034+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7740c1bb0 con 0x7fd77414fce0 2024-01-20T08:14:21.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.035+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7741eb1a0 con 0x7fd77414fce0 2024-01-20T08:14:21.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.036+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd76c0407f0 con 0x7fd77414fce0 2024-01-20T08:14:21.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.036+0000 7fd770c00640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 0x7fd74c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.039 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.037+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7fd76c0ac270 con 0x7fd77414fce0 2024-01-20T08:14:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.037+0000 7fd773e00640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 0x7fd74c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.037+0000 7fd773e00640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 0x7fd74c06d3c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd764006fd0 tx=0x7fd764008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.041+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd7741eb1a0 con 0x7fd77414fce0 2024-01-20T08:14:21.281 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.279+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7741eb1a0 con 0x7fd77414fce0 2024-01-20T08:14:21.282 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.280+0000 7fd770c00640 1 -- 172.21.15.100:0/2637063855 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+6197 (secure 0 0 0) 0x7fd7741eb1a0 con 0x7fd77414fce0 2024-01-20T08:14:21.283 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:21.283 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":53,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:20.610416+0000","modified":"2024-01-20T08:13:23.677549+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6432},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6432":{"gid":6432,"name":"a","rank":0,"incarnation":44,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6837/1016959198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":1016959198},{"type":"v1","addr":"172.21.15.100:6837","nonce":1016959198}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6},{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:21.283 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 53 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.282+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 msgr2=0x7fd74c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.282+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 0x7fd74c06d3c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd764006fd0 tx=0x7fd764008040 comp rx=0 tx=0).stop 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 msgr2=0x7fd7741e4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c009d90 tx=0x7fd76c004a40 comp rx=0 tx=0).stop 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 shutdown_connections 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd77414fce0 0x7fd7741e4fb0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd74c06af00 0x7fd74c06d3c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.286 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7740aae00 0x7fd7740c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 --2- 172.21.15.100:0/2637063855 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7740a93c0 0x7fd7740bd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 >> 172.21.15.100:0/2637063855 conn(0x7fd77406a5e0 msgr2=0x7fd774150500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:21.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 shutdown_connections 2024-01-20T08:14:21.287 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.283+0000 7fd77b200640 1 -- 172.21.15.100:0/2637063855 wait complete. 2024-01-20T08:14:21.303 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.504+0000 7f854b200640 1 Processor -- start 2024-01-20T08:14:21.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.504+0000 7f854b200640 1 -- start start 2024-01-20T08:14:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.505+0000 7f854b200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f854c06d2b0 0x7f854c06d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.505+0000 7f854b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c06c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.505+0000 7f854b200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f854c1523a0 con 0x7f854c0c5570 2024-01-20T08:14:21.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.505+0000 7f854b200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f854c0706a0 con 0x7f854c06d2b0 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.505+0000 7f854b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c151ee0 con 0x7f854c0c3e00 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f854c06d2b0 0x7f854c06d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f854c06d2b0 0x7f854c06d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49278/0 (socket says 172.21.15.100:49278) 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 -- 172.21.15.100:0/541624659 learned_addr learned my addr 172.21.15.100:0/541624659 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8543e00640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c06c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 -- 172.21.15.100:0/541624659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 msgr2=0x7f854c06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c06c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 -- 172.21.15.100:0/541624659 >> v1:172.21.15.110:6789/0 conn(0x7f854c0c5570 legacy=0x7f854c06c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8549e00640 1 -- 172.21.15.100:0/541624659 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f854c0a53f0 con 0x7f854c06d2b0 2024-01-20T08:14:21.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.506+0000 7f8543e00640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:21.511 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.507+0000 7f8549e00640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c06d2b0 0x7f854c06d690 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f853c00bb10 tx=0x7f853c02dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a93d6f525bbc2023 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f8549400640 1 -- 172.21.15.100:0/541624659 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c02ed50 con 0x7f854c06d2b0 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f8549400640 1 -- 172.21.15.100:0/541624659 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853c036440 con 0x7f854c06d2b0 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f8549400640 1 -- 172.21.15.100:0/541624659 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853c0367d0 con 0x7f854c06d2b0 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 -- 172.21.15.100:0/541624659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c06d2b0 msgr2=0x7f854c06d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c06d2b0 0x7f854c06d690 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f853c00bb10 tx=0x7f853c02dfa0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 -- 172.21.15.100:0/541624659 shutdown_connections 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c06c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 --2- 172.21.15.100:0/541624659 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c06d2b0 0x7f854c06d690 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.508+0000 7f854b200640 1 -- 172.21.15.100:0/541624659 >> 172.21.15.100:0/541624659 conn(0x7f854c0c2590 msgr2=0x7f854c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.509+0000 7f854b200640 1 -- 172.21.15.100:0/541624659 shutdown_connections 2024-01-20T08:14:21.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.509+0000 7f854b200640 1 -- 172.21.15.100:0/541624659 wait complete. 2024-01-20T08:14:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.511+0000 7f854b200640 1 Processor -- start 2024-01-20T08:14:21.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.511+0000 7f854b200640 1 -- start start 2024-01-20T08:14:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f854c06d2b0 0x7f854c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c14a130 con 0x7f854c0c5570 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f854c1492d0 con 0x7f854c06d2b0 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854b200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f854c153730 con 0x7f854c0c3e00 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854a800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49292/0 (socket says 172.21.15.100:49292) 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.512+0000 7f854a800640 1 -- 172.21.15.100:0/321265312 learned_addr learned my addr 172.21.15.100:0/321265312 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8549e00640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f854c06d2b0 0x7f854c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8543e00640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 -- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 msgr2=0x7f854c144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 -- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f854c06d2b0 msgr2=0x7f854c14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f854c06d2b0 0x7f854c14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 -- 172.21.15.100:0/321265312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853c00b770 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8543e00640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854a800640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f854400c700 tx=0x7f854400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400aa50 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854400abb0 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f854c149520 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.513+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854400ce10 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.514+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f854c149ae0 con 0x7f854c0c5570 2024-01-20T08:14:21.518 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.515+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f854c0749e0 con 0x7f854c0c5570 2024-01-20T08:14:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.516+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f8544012420 con 0x7f854c0c5570 2024-01-20T08:14:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.516+0000 7f8542000640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 0x7f852406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.519 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.517+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f8544089eb0 con 0x7f854c0c5570 2024-01-20T08:14:21.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.517+0000 7f8549e00640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 0x7f852406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.517+0000 7f8549e00640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 0x7f852406d3c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f853c038000 tx=0x7f853c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.523 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.521+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f85440549f0 con 0x7f854c0c5570 2024-01-20T08:14:21.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.712+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f854c0c5350 con 0x7f854c0c5570 2024-01-20T08:14:21.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.714+0000 7f8542000640 1 -- 172.21.15.100:0/321265312 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+20241 (secure 0 0 0) 0x7f8544016020 con 0x7f854c0c5570 2024-01-20T08:14:21.717 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:21.718 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":78,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:13:58.110738+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-01-20T08:13:18.880025+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-01-20T08:13:19.625716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.38","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 msgr2=0x7f852406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 0x7f852406d3c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f853c038000 tx=0x7f853c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 msgr2=0x7f854c1441f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f854400c700 tx=0x7f854400cbc0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 shutdown_connections 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f854c0c5570 0x7f854c1441f0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f852406af00 0x7f852406d3c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f854c0c3e00 0x7f854c144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.720 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 --2- 172.21.15.100:0/321265312 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f854c06d2b0 0x7f854c14b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 >> 172.21.15.100:0/321265312 conn(0x7f854c0c2590 msgr2=0x7f854c0bf1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 shutdown_connections 2024-01-20T08:14:21.721 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.717+0000 7f854b200640 1 -- 172.21.15.100:0/321265312 wait complete. 2024-01-20T08:14:21.738 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-01-20T08:14:21.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.943+0000 7f50cfc00640 1 Processor -- start 2024-01-20T08:14:21.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.943+0000 7f50cfc00640 1 -- start start 2024-01-20T08:14:21.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cfc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f50c814fdb0 0x7f50c80c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cfc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f50c81532f0 0x7f50c815cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cfc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c8150190 con 0x7f50c80c1d90 2024-01-20T08:14:21.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cfc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c80a9ce0 con 0x7f50c814fdb0 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cfc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c80a93b0 con 0x7f50c81532f0 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50cd200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f50c814fdb0 0x7f50c80c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50c7e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f50c80c1d90 0x7f50c8152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47634/0 (socket says 172.21.15.100:47634) 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.945+0000 7f50c7e00640 1 -- 172.21.15.100:0/2493433391 learned_addr learned my addr 172.21.15.100:0/2493433391 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50cdc00640 1 --2- 172.21.15.100:0/2493433391 >> v2:172.21.15.110:3300/0 conn(0x7f50c81532f0 0x7f50c815cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50cd200640 1 -- 172.21.15.100:0/2493433391 >> v2:172.21.15.110:3300/0 conn(0x7f50c81532f0 msgr2=0x7f50c815cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:21.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50cd200640 1 --2- 172.21.15.100:0/2493433391 >> v2:172.21.15.110:3300/0 conn(0x7f50c81532f0 0x7f50c815cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50cd200640 1 -- 172.21.15.100:0/2493433391 >> v1:172.21.15.100:6789/0 conn(0x7f50c80c1d90 legacy=0x7f50c8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50cd200640 1 -- 172.21.15.100:0/2493433391 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c80a8810 con 0x7f50c814fdb0 2024-01-20T08:14:21.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.946+0000 7f50c7400640 1 -- 172.21.15.100:0/2493433391 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938235412 0 0) 0x7f50c8150190 con 0x7f50c80c1d90 2024-01-20T08:14:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.947+0000 7f50cd200640 1 --2- 172.21.15.100:0/2493433391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c80c1850 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f50c806bdd0 tx=0x7f50b802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6cbc2091b46745 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50c7400640 1 -- 172.21.15.100:0/2493433391 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8031830 con 0x7f50c814fdb0 2024-01-20T08:14:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50c7400640 1 -- 172.21.15.100:0/2493433391 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b8031990 con 0x7f50c814fdb0 2024-01-20T08:14:21.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50c7400640 1 -- 172.21.15.100:0/2493433391 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8031d20 con 0x7f50c814fdb0 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 -- 172.21.15.100:0/2493433391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 msgr2=0x7f50c80c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2493433391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c80c1850 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f50c806bdd0 tx=0x7f50b802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 -- 172.21.15.100:0/2493433391 shutdown_connections 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2493433391 >> v2:172.21.15.110:3300/0 conn(0x7f50c81532f0 0x7f50c815cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2493433391 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c80c1850 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.948+0000 7f50cfc00640 1 -- 172.21.15.100:0/2493433391 >> 172.21.15.100:0/2493433391 conn(0x7f50c80c2940 msgr2=0x7f50c80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.949+0000 7f50cfc00640 1 -- 172.21.15.100:0/2493433391 shutdown_connections 2024-01-20T08:14:21.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.949+0000 7f50cfc00640 1 -- 172.21.15.100:0/2493433391 wait complete. 2024-01-20T08:14:21.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.950+0000 7f50cfc00640 1 Processor -- start 2024-01-20T08:14:21.953 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.950+0000 7f50cfc00640 1 -- start start 2024-01-20T08:14:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c80c1d90 0x7f50c81459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c81532f0 0x7f50c8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8156a80 con 0x7f50c814fdb0 2024-01-20T08:14:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c8145f00 con 0x7f50c81532f0 2024-01-20T08:14:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50cfc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81567a0 con 0x7f50c80c1d90 2024-01-20T08:14:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50c7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49322/0 (socket says 172.21.15.100:49322) 2024-01-20T08:14:21.955 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.951+0000 7f50c7e00640 1 -- 172.21.15.100:0/2673138970 learned_addr learned my addr 172.21.15.100:0/2673138970 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 -- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c80c1d90 msgr2=0x7f50c81459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50cd200640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c80c1d90 0x7f50c81459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50cdc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c81532f0 0x7f50c8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c80c1d90 0x7f50c81459c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 -- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c81532f0 msgr2=0x7f50c8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:21.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c81532f0 0x7f50c8152030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 -- 172.21.15.100:0/2673138970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009400 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c7e00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c4d0 tx=0x7f50b000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.952+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00074e0 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.953+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b0007660 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.953+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0004a20 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.953+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c81ead20 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.953+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c81455e0 con 0x7f50c814fdb0 2024-01-20T08:14:21.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.954+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c81eab60 con 0x7f50c814fdb0 2024-01-20T08:14:21.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.955+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f50b0004b80 con 0x7f50c814fdb0 2024-01-20T08:14:21.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.955+0000 7f50c4c00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 0x7f50a006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:21.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.956+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6594+0+0 (secure 0 0 0) 0x7f50b0088b60 con 0x7f50c814fdb0 2024-01-20T08:14:21.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.956+0000 7f50cd200640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 0x7f50a006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:21.959 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.957+0000 7f50cd200640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 0x7f50a006d390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50b8036000 tx=0x7f50b8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:21.963 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:21.960+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f50b00536a0 con 0x7f50c814fdb0 2024-01-20T08:14:22.200 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.197+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f50c804e970 con 0x7f50c814fdb0 2024-01-20T08:14:22.201 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:14:22.199+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:14:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.202+0000 7f50c4c00640 1 -- 172.21.15.100:0/2673138970 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) v1 ==== 161+0+0 (secure 0 0 0) 0x7f50b0018020 con 0x7f50c814fdb0 2024-01-20T08:14:22.206 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.205+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 msgr2=0x7f50a006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.205+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 0x7f50a006d390 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f50b8036000 tx=0x7f50b8008030 comp rx=0 tx=0).stop 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.205+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 msgr2=0x7f50c8155e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.205+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f50b000c4d0 tx=0x7f50b000c990 comp rx=0 tx=0).stop 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 shutdown_connections 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f50c81532f0 0x7f50c8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c814fdb0 0x7f50c8155e60 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f50a006aed0 0x7f50a006d390 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 --2- 172.21.15.100:0/2673138970 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f50c80c1d90 0x7f50c81459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 >> 172.21.15.100:0/2673138970 conn(0x7f50c80c2940 msgr2=0x7f50c80c1370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 shutdown_connections 2024-01-20T08:14:22.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.206+0000 7f50cfc00640 1 -- 172.21.15.100:0/2673138970 wait complete. 2024-01-20T08:14:22.223 INFO:tasks.ceph.mds.a.smithi100.stderr: -5988> 2024-01-20T08:13:25.103+0000 7f9b23200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:14:22.230 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-01-20T08:14:22.289 INFO:tasks.ceph.mds.a.smithi100.stdout:starting mds.a at 2024-01-20T08:14:22.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.417+0000 7f33f4a00640 1 Processor -- start 2024-01-20T08:14:22.420 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.417+0000 7f33f4a00640 1 -- start start 2024-01-20T08:14:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f4a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33ec14fdb0 0x7f33ec0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f4a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec150190 con 0x7f33ec0c1d90 2024-01-20T08:14:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f4a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33ec0a8810 con 0x7f33ec1532f0 2024-01-20T08:14:22.421 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f4a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33ec0a9ce0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f2000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f33ec14fdb0 0x7f33ec0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f1600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f33ec0c1d90 0x7f33ec152be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47638/0 (socket says 172.21.15.100:47638) 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.418+0000 7f33f1600640 1 -- 172.21.15.100:0/3650052302 learned_addr learned my addr 172.21.15.100:0/3650052302 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.419+0000 7f33f2000640 1 -- 172.21.15.100:0/3650052302 >> v1:172.21.15.110:6789/0 conn(0x7f33ec1532f0 legacy=0x7f33ec15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.419+0000 7f33f2000640 1 -- 172.21.15.100:0/3650052302 >> v1:172.21.15.100:6789/0 conn(0x7f33ec0c1d90 legacy=0x7f33ec152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.419+0000 7f33f2000640 1 -- 172.21.15.100:0/3650052302 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec0a8df0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.422 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.419+0000 7f33f0c00640 1 -- 172.21.15.100:0/3650052302 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268090233 0 0) 0x7f33ec150190 con 0x7f33ec0c1d90 2024-01-20T08:14:22.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.420+0000 7f33f2000640 1 --2- 172.21.15.100:0/3650052302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec0c1850 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df6ee8be574f5b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:22.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.420+0000 7f33f0c00640 1 -- 172.21.15.100:0/3650052302 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc02cc60 con 0x7f33ec14fdb0 2024-01-20T08:14:22.423 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.420+0000 7f33f0c00640 1 -- 172.21.15.100:0/3650052302 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc02cdc0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.420+0000 7f33f0c00640 1 -- 172.21.15.100:0/3650052302 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc034660 con 0x7f33ec14fdb0 2024-01-20T08:14:22.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 -- 172.21.15.100:0/3650052302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 msgr2=0x7f33ec0c1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.424 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 --2- 172.21.15.100:0/3650052302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec0c1850 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009d90 tx=0x7f33dc02beb0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 -- 172.21.15.100:0/3650052302 shutdown_connections 2024-01-20T08:14:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 --2- 172.21.15.100:0/3650052302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec0c1850 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 -- 172.21.15.100:0/3650052302 >> 172.21.15.100:0/3650052302 conn(0x7f33ec0c2940 msgr2=0x7f33ec0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 -- 172.21.15.100:0/3650052302 shutdown_connections 2024-01-20T08:14:22.425 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.421+0000 7f33f4a00640 1 -- 172.21.15.100:0/3650052302 wait complete. 2024-01-20T08:14:22.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.423+0000 7f33f4a00640 1 Processor -- start 2024-01-20T08:14:22.426 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.423+0000 7f33f4a00640 1 -- start start 2024-01-20T08:14:22.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ec0c1d90 0x7f33ec13be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:22.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:22.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 0x7f33ec0c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:22.428 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec154880 con 0x7f33ec14fdb0 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec13c3d0 con 0x7f33ec1532f0 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f4a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33ec154200 con 0x7f33ec0c1d90 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f1600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49364/0 (socket says 172.21.15.100:49364) 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f1600640 1 -- 172.21.15.100:0/890382707 learned_addr learned my addr 172.21.15.100:0/890382707 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.424+0000 7f33f2000640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ec0c1d90 0x7f33ec13be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f2a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 0x7f33ec0c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 -- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ec0c1d90 msgr2=0x7f33ec13be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ec0c1d90 0x7f33ec13be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 -- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 msgr2=0x7f33ec0c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 0x7f33ec0c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:22.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 -- 172.21.15.100:0/890382707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a70 con 0x7f33ec14fdb0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f2a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 0x7f33ec0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f1600640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c500 tx=0x7f33d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4007560 con 0x7f33ec14fdb0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d40047e0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d4004b90 con 0x7f33ec14fdb0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33ec153f20 con 0x7f33ec14fdb0 2024-01-20T08:14:22.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.425+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33ec1eb8c0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.426+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33ec1eb440 con 0x7f33ec14fdb0 2024-01-20T08:14:22.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.427+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f33d4004cf0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.428+0000 7f33ea000640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 0x7f33c406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:22.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.428+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f33d4088eb0 con 0x7f33ec14fdb0 2024-01-20T08:14:22.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.429+0000 7f33f2000640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 0x7f33c406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:22.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.429+0000 7f33f2000640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 0x7f33c406d390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f33dc036000 tx=0x7f33dc030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:22.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.433+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f33ec1eb440 con 0x7f33ec14fdb0 2024-01-20T08:14:22.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:22.655+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33ec1eb440 con 0x7f33ec14fdb0 2024-01-20T08:14:23.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.206+0000 7f33ea000640 1 -- 172.21.15.100:0/890382707 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v55) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33ec1eb440 con 0x7f33ec14fdb0 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 msgr2=0x7f33c406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 0x7f33c406d390 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f33dc036000 tx=0x7f33dc030000 comp rx=0 tx=0).stop 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 msgr2=0x7f33ec13fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f33d400c500 tx=0x7f33d400c9c0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 shutdown_connections 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.209+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f33ec1532f0 0x7f33ec0c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f33ec14fdb0 0x7f33ec13fe20 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f33c406aed0 0x7f33c406d390 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 --2- 172.21.15.100:0/890382707 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f33ec0c1d90 0x7f33ec13be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 >> 172.21.15.100:0/890382707 conn(0x7f33ec0c2940 msgr2=0x7f33ec070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 shutdown_connections 2024-01-20T08:14:23.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.210+0000 7f33f4a00640 1 -- 172.21.15.100:0/890382707 wait complete. 2024-01-20T08:14:23.234 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-01-20T08:14:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.437+0000 7f14a6a00640 1 Processor -- start 2024-01-20T08:14:23.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.437+0000 7f14a6a00640 1 -- start start 2024-01-20T08:14:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a6a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14a0151fe0 0x7f14a0155300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a6a00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a0155840 con 0x7f14a00c70b0 2024-01-20T08:14:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a6a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14a00c9e90 con 0x7f14a0155d70 2024-01-20T08:14:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a6a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14a006b6a0 con 0x7f14a0151fe0 2024-01-20T08:14:23.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a4a00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f14a00c70b0 0x7f14a015f200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47642/0 (socket says 172.21.15.100:47642) 2024-01-20T08:14:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f149fe00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f14a0151fe0 0x7f14a0155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.438+0000 7f14a4a00640 1 -- 172.21.15.100:0/940599360 learned_addr learned my addr 172.21.15.100:0/940599360 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.439+0000 7f149fe00640 1 -- 172.21.15.100:0/940599360 >> v1:172.21.15.110:6789/0 conn(0x7f14a0155d70 legacy=0x7f14a00c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.439+0000 7f149fe00640 1 -- 172.21.15.100:0/940599360 >> v1:172.21.15.100:6789/0 conn(0x7f14a00c70b0 legacy=0x7f14a015f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.439+0000 7f149fe00640 1 -- 172.21.15.100:0/940599360 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a006b980 con 0x7f14a0151fe0 2024-01-20T08:14:23.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.440+0000 7f149fe00640 1 --2- 172.21.15.100:0/940599360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a0151fe0 0x7f14a0155300 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f14900097a0 tx=0x7f149002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2f1e8dd643ecd9 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:23.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.440+0000 7f149f400640 1 -- 172.21.15.100:0/940599360 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149002e070 con 0x7f14a0151fe0 2024-01-20T08:14:23.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.440+0000 7f149f400640 1 -- 172.21.15.100:0/940599360 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14900315a0 con 0x7f14a0151fe0 2024-01-20T08:14:23.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.440+0000 7f149f400640 1 -- 172.21.15.100:0/940599360 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490031930 con 0x7f14a0151fe0 2024-01-20T08:14:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 -- 172.21.15.100:0/940599360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a0151fe0 msgr2=0x7f14a0155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 --2- 172.21.15.100:0/940599360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a0151fe0 0x7f14a0155300 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f14900097a0 tx=0x7f149002b840 comp rx=0 tx=0).stop 2024-01-20T08:14:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 -- 172.21.15.100:0/940599360 shutdown_connections 2024-01-20T08:14:23.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 --2- 172.21.15.100:0/940599360 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a0151fe0 0x7f14a0155300 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 -- 172.21.15.100:0/940599360 >> 172.21.15.100:0/940599360 conn(0x7f14a00ac010 msgr2=0x7f14a00ac420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 -- 172.21.15.100:0/940599360 shutdown_connections 2024-01-20T08:14:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.441+0000 7f14a6a00640 1 -- 172.21.15.100:0/940599360 wait complete. 2024-01-20T08:14:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.443+0000 7f14a6a00640 1 Processor -- start 2024-01-20T08:14:23.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.443+0000 7f14a6a00640 1 -- start start 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.443+0000 7f14a6a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.443+0000 7f14a6a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14a0151fe0 0x7f14a0145080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f14a6a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14a0155d70 0x7f14a01455c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f14a6a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a0145b00 con 0x7f14a00c70b0 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f14a6a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14a014f2e0 con 0x7f14a0155d70 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f14a6a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14a00c1480 con 0x7f14a0151fe0 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:23.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49378/0 (socket says 172.21.15.100:49378) 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 -- 172.21.15.100:0/3075937713 learned_addr learned my addr 172.21.15.100:0/3075937713 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 -- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14a0151fe0 msgr2=0x7f14a0145080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14a0151fe0 0x7f14a0145080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 -- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14a0155d70 msgr2=0x7f14a01455c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14a0155d70 0x7f14a01455c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 -- 172.21.15.100:0/3075937713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1490009400 con 0x7f14a00c70b0 2024-01-20T08:14:23.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.444+0000 7f149fe00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f14900098c0 tx=0x7f14900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.445+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490032900 con 0x7f14a00c70b0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.445+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1490032aa0 con 0x7f14a00c70b0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.445+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14a0147ef0 con 0x7f14a00c70b0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.445+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1490032e50 con 0x7f14a00c70b0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.445+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14a0146cd0 con 0x7f14a00c70b0 2024-01-20T08:14:23.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.446+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14a00c1610 con 0x7f14a00c70b0 2024-01-20T08:14:23.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.447+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f149003b3f0 con 0x7f14a00c70b0 2024-01-20T08:14:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.448+0000 7f149cc00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 0x7f147806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.448+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6680+0+0 (secure 0 0 0) 0x7f14900ab9f0 con 0x7f14a00c70b0 2024-01-20T08:14:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.448+0000 7f1497200640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 0x7f147806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:23.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.449+0000 7f1497200640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 0x7f147806d390 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f14a01eb350 tx=0x7f14880079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:23.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.452+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f14900764e0 con 0x7f14a00c70b0 2024-01-20T08:14:23.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:23.633+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f14a0074300 con 0x7f14a00c70b0 2024-01-20T08:14:24.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.215+0000 7f149cc00640 1 -- 172.21.15.100:0/3075937713 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v80) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1490079b00 con 0x7f14a00c70b0 2024-01-20T08:14:24.218 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_metadata' removed 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 msgr2=0x7f147806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 0x7f147806d390 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f14a01eb350 tx=0x7f14880079b0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 msgr2=0x7f14a00c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f14900098c0 tx=0x7f14900046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 shutdown_connections 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f14a0155d70 0x7f14a01455c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f147806aed0 0x7f147806d390 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f14a0151fe0 0x7f14a0145080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 --2- 172.21.15.100:0/3075937713 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14a00c70b0 0x7f14a00c5c20 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 >> 172.21.15.100:0/3075937713 conn(0x7f14a00ac010 msgr2=0x7f14a00c8880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.219+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 shutdown_connections 2024-01-20T08:14:24.223 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.220+0000 7f14a6a00640 1 -- 172.21.15.100:0/3075937713 wait complete. 2024-01-20T08:14:24.247 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-01-20T08:14:24.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.438+0000 7f87afa00640 1 Processor -- start 2024-01-20T08:14:24.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.439+0000 7f87afa00640 1 -- start start 2024-01-20T08:14:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.440+0000 7f87afa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f87a80c4ae0 0x7f87a8154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.440+0000 7f87afa00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a80c8f50 con 0x7f87a806b520 2024-01-20T08:14:24.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.440+0000 7f87afa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a80c5320 con 0x7f87a80c4ec0 2024-01-20T08:14:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.440+0000 7f87afa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a80c9af0 con 0x7f87a80c4ae0 2024-01-20T08:14:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87ada00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f87a806b520 0x7f87a815f1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47646/0 (socket says 172.21.15.100:47646) 2024-01-20T08:14:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87ada00640 1 -- 172.21.15.100:0/3136642590 learned_addr learned my addr 172.21.15.100:0/3136642590 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:24.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87ad000640 1 --2- 172.21.15.100:0/3136642590 >> v2:172.21.15.110:3300/0 conn(0x7f87a80c4ae0 0x7f87a8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000493653 0 0) 0x7f87a80c8f50 con 0x7f87a806b520 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8788003520 con 0x7f87a806b520 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2960680728 0 0) 0x7f8788003520 con 0x7f87a806b520 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 >> v2:172.21.15.110:3300/0 conn(0x7f87a80c4ae0 msgr2=0x7f87a8154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 --2- 172.21.15.100:0/3136642590 >> v2:172.21.15.110:3300/0 conn(0x7f87a80c4ae0 0x7f87a8154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 >> v1:172.21.15.110:6789/0 conn(0x7f87a80c4ec0 legacy=0x7f87a80c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a806b9b0 con 0x7f87a806b520 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f87a00019f0 con 0x7f87a806b520 2024-01-20T08:14:24.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.441+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 >> v1:172.21.15.100:6789/0 conn(0x7f87a806b520 legacy=0x7f87a815f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a80c9af0 con 0x7f87880047c0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f878800c120 con 0x7f87880039c0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f878800c2e0 con 0x7f87880051d0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87ad000640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 -- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880051d0 msgr2=0x7f878800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87ada00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 -- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87880039c0 msgr2=0x7f8788003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87a7e00640 1 -- 172.21.15.100:0/3136642590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8788003520 con 0x7f87880047c0 2024-01-20T08:14:24.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87ad000640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87880039c0 0x7f8788003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:24.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87ada00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880051d0 0x7f878800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:24.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.442+0000 7f87ada00640 1 -- 172.21.15.100:0/3136642590 reap_dead start 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 0x7f8788004c40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8790001720 tx=0x7f87880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf09eb294c384ff server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900052d0 con 0x7f87880047c0 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879002e050 con 0x7f87880047c0 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87a7400640 1 -- 172.21.15.100:0/3136642590 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790003830 con 0x7f87880047c0 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 -- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 msgr2=0x7f8788004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 0x7f8788004c40 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8790001720 tx=0x7f87880057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 -- 172.21.15.100:0/3136642590 shutdown_connections 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 --2- 172.21.15.100:0/3136642590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87880047c0 0x7f8788004c40 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 -- 172.21.15.100:0/3136642590 >> 172.21.15.100:0/3136642590 conn(0x7f87a80ca160 msgr2=0x7f87a80ca570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.444+0000 7f87afa00640 1 -- 172.21.15.100:0/3136642590 shutdown_connections 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.445+0000 7f87afa00640 1 -- 172.21.15.100:0/3136642590 wait complete. 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.446+0000 7f87afa00640 1 Processor -- start 2024-01-20T08:14:24.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.446+0000 7f87afa00640 1 -- start start 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880047c0 0x7f87a814aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a8148df0 0x7f87a81571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8158850 con 0x7f87a81488a0 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a8158500 con 0x7f87a8148df0 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87afa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a81526c0 con 0x7f87880047c0 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.447+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49402/0 (socket says 172.21.15.100:49402) 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 -- 172.21.15.100:0/3207339147 learned_addr learned my addr 172.21.15.100:0/3207339147 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87ad000640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880047c0 0x7f87a814aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87ada00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a8148df0 0x7f87a81571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 -- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880047c0 msgr2=0x7f87a814aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880047c0 0x7f87a814aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 -- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a8148df0 msgr2=0x7f87a81571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a8148df0 0x7f87a81571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 -- 172.21.15.100:0/3207339147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a81529a0 con 0x7f87a81488a0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.448+0000 7f87a7e00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8790001840 tx=0x7f8790001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.449+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8790003e80 con 0x7f87a81488a0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.449+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8790007a30 con 0x7f87a81488a0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.449+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879003d670 con 0x7f87a81488a0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.449+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a81eb090 con 0x7f87a81488a0 2024-01-20T08:14:24.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.449+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a814af50 con 0x7f87a81488a0 2024-01-20T08:14:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.450+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a8074290 con 0x7f87a81488a0 2024-01-20T08:14:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.451+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f879003d7d0 con 0x7f87a81488a0 2024-01-20T08:14:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.451+0000 7f87a4c00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 0x7f878006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.452+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6242+0+0 (secure 0 0 0) 0x7f87900ab6b0 con 0x7f87a81488a0 2024-01-20T08:14:24.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.452+0000 7f87ad000640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 0x7f878006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:24.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.452+0000 7f87ad000640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 0x7f878006d3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8798009a40 tx=0x7f8798008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:24.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.456+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f8790076510 con 0x7f87a81488a0 2024-01-20T08:14:24.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:24.654+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87a8158d70 con 0x7f87a81488a0 2024-01-20T08:14:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.219+0000 7f87a4c00640 1 -- 172.21.15.100:0/3207339147 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v81) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8790079b30 con 0x7f87a81488a0 2024-01-20T08:14:25.222 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs_data' removed 2024-01-20T08:14:25.230 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.224+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 msgr2=0x7f878006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.224+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 0x7f878006d3c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f8798009a40 tx=0x7f8798008040 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.224+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 msgr2=0x7f87a8156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.224+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f8790001840 tx=0x7f8790001120 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 shutdown_connections 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f87a8148df0 0x7f87a81571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f87a81488a0 0x7f87a8156c90 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f878006af00 0x7f878006d3c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 --2- 172.21.15.100:0/3207339147 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f87880047c0 0x7f87a814aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.231 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.228+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 >> 172.21.15.100:0/3207339147 conn(0x7f87a80ca160 msgr2=0x7f87a814cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.230+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 shutdown_connections 2024-01-20T08:14:25.233 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.231+0000 7f87afa00640 1 -- 172.21.15.100:0/3207339147 wait complete. 2024-01-20T08:14:25.258 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:25.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.433+0000 7fc916400640 1 Processor -- start 2024-01-20T08:14:25.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.434+0000 7fc916400640 1 -- start start 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc916400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 0x7fc910156210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc916400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100c1720 con 0x7fc91006dd90 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc916400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9100a4f30 con 0x7fc910072320 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc916400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100c20a0 con 0x7fc9100c3240 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc907c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc91006dd90 0x7fc910155b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47652/0 (socket says 172.21.15.100:47652) 2024-01-20T08:14:25.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.435+0000 7fc907c00640 1 -- 172.21.15.100:0/3686401194 learned_addr learned my addr 172.21.15.100:0/3686401194 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc915a00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 0x7fc910156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2239469687 0 0) 0x7fc9100c1720 con 0x7fc91006dd90 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8f0003520 con 0x7fc91006dd90 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3668324415 0 0) 0x7fc8f0003520 con 0x7fc91006dd90 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 msgr2=0x7fc910156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 0x7fc910156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 >> v1:172.21.15.110:6789/0 conn(0x7fc910072320 legacy=0x7fc91014f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100c19e0 con 0x7fc91006dd90 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fc8f8001670 con 0x7fc91006dd90 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 >> v1:172.21.15.100:6789/0 conn(0x7fc91006dd90 legacy=0x7fc910155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8f00039a0 0x7fc8f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f00047c0 0x7fc8f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 0x7fc8f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100c20a0 con 0x7fc8f00039a0 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f000bab0 con 0x7fc8f00047c0 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.436+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8f000bc70 con 0x7fc9100c3240 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8f00039a0 0x7fc8f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc907c00640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f00047c0 0x7fc8f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 -- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 msgr2=0x7fc8f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc9100c3240 0x7fc8f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 -- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f00047c0 msgr2=0x7fc8f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc8f00047c0 0x7fc8f0004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.437+0000 7fc915000640 1 -- 172.21.15.100:0/3686401194 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f0003520 con 0x7fc8f00039a0 2024-01-20T08:14:25.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.438+0000 7fc915000640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8f00039a0 0x7fc8f0003dc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc900001750 tx=0x7fc8f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81de046da673a0e8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.438+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000052d0 con 0x7fc8f00039a0 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.438+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90002e050 con 0x7fc8f00039a0 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.438+0000 7fc90fe00640 1 -- 172.21.15.100:0/3686401194 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9000035f0 con 0x7fc8f00039a0 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 -- 172.21.15.100:0/3686401194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8f00039a0 msgr2=0x7fc8f0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 --2- 172.21.15.100:0/3686401194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc8f00039a0 0x7fc8f0003dc0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc900001750 tx=0x7fc8f00057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc915a00640 1 -- 172.21.15.100:0/3686401194 reap_dead start 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 -- 172.21.15.100:0/3686401194 shutdown_connections 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 -- 172.21.15.100:0/3686401194 >> 172.21.15.100:0/3686401194 conn(0x7fc9100c2590 msgr2=0x7fc9100c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 -- 172.21.15.100:0/3686401194 shutdown_connections 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.439+0000 7fc916400640 1 -- 172.21.15.100:0/3686401194 wait complete. 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.441+0000 7fc916400640 1 Processor -- start 2024-01-20T08:14:25.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.441+0000 7fc916400640 1 -- start start 2024-01-20T08:14:25.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8f00039a0 0x7fc910145d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 0x7fc9100bf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9100a6190 con 0x7fc9101420d0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc910071910 con 0x7fc9100a5300 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc916400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc910071e90 con 0x7fc8f00039a0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49426/0 (socket says 172.21.15.100:49426) 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 -- 172.21.15.100:0/1954433259 learned_addr learned my addr 172.21.15.100:0/1954433259 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915000640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8f00039a0 0x7fc910145d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc907c00640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 0x7fc9100bf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 -- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8f00039a0 msgr2=0x7fc910145d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8f00039a0 0x7fc910145d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 -- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 msgr2=0x7fc9100bf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 0x7fc9100bf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc915a00640 1 -- 172.21.15.100:0/1954433259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9101ee3e0 con 0x7fc9101420d0 2024-01-20T08:14:25.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.442+0000 7fc907c00640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 0x7fc9100bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc915a00640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc9100c3650 tx=0x7fc90800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908018070 con 0x7fc9101420d0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90800eb90 con 0x7fc9101420d0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc908003990 con 0x7fc9101420d0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc910071bb0 con 0x7fc9101420d0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.443+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc910142a90 con 0x7fc9101420d0 2024-01-20T08:14:25.448 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.444+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9100749e0 con 0x7fc9101420d0 2024-01-20T08:14:25.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.445+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc908014420 con 0x7fc9101420d0 2024-01-20T08:14:25.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.446+0000 7fc90d600640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 0x7fc8e806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.446+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc908089420 con 0x7fc9101420d0 2024-01-20T08:14:25.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.446+0000 7fc915000640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 0x7fc8e806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.447+0000 7fc915000640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 0x7fc8e806d3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc900033000 tx=0x7fc900009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.451+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc908054280 con 0x7fc9101420d0 2024-01-20T08:14:25.662 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.659+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc9100a62d0 con 0x7fc9101420d0 2024-01-20T08:14:25.664 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.660+0000 7fc90d600640 1 -- 172.21.15.100:0/1954433259 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16620 (secure 0 0 0) 0x7fc9100a62d0 con 0x7fc9101420d0 2024-01-20T08:14:25.664 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:25.664 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:14:25.215888+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/1016959198":"2024-01-21T08:14:22.199588+0000","172.21.15.100:6836/1016959198":"2024-01-21T08:14:22.199588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 msgr2=0x7fc8e806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 0x7fc8e806d3c0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc900033000 tx=0x7fc900009030 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 msgr2=0x7fc910142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc9100c3650 tx=0x7fc90800e4b0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 shutdown_connections 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc9101420d0 0x7fc910142550 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc9100a5300 0x7fc9100bf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc8e806af00 0x7fc8e806d3c0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.663+0000 7fc916400640 1 --2- 172.21.15.100:0/1954433259 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc8f00039a0 0x7fc910145d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.664+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 >> 172.21.15.100:0/1954433259 conn(0x7fc9100c2590 msgr2=0x7fc91014f580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:25.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.664+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 shutdown_connections 2024-01-20T08:14:25.668 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.664+0000 7fc916400640 1 -- 172.21.15.100:0/1954433259 wait complete. 2024-01-20T08:14:25.685 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-01-20T08:10:01.957260+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs2_metadata', 'create_time': '2024-01-20T08:13:38.963660+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '75', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs2'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs2_data', 'create_time': '2024-01-20T08:13:39.582726+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs2'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-01-20T08:14:25.685 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-01-20T08:14:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.889+0000 7f79a7400640 1 Processor -- start 2024-01-20T08:14:25.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.889+0000 7f79a7400640 1 -- start start 2024-01-20T08:14:25.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a00c3460 0x7f79a0152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a7400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79a0153120 0x7f79a015cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a7400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a0150190 con 0x7f79a014fdb0 2024-01-20T08:14:25.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a7400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00a9ce0 con 0x7f79a0153120 2024-01-20T08:14:25.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a7400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00a93b0 con 0x7f79a00c3460 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79a0153120 0x7f79a015cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a5400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f79a0153120 0x7f79a015cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49434/0 (socket says 172.21.15.100:49434) 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f79a5400640 1 -- 172.21.15.100:0/4118665110 learned_addr learned my addr 172.21.15.100:0/4118665110 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.891+0000 7f799fe00640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a00c3460 0x7f79a0152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.892+0000 7f79a5400640 1 -- 172.21.15.100:0/4118665110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a00c3460 msgr2=0x7f79a0152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.892+0000 7f79a5400640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a00c3460 0x7f79a0152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.892+0000 7f79a5400640 1 -- 172.21.15.100:0/4118665110 >> v1:172.21.15.110:6789/0 conn(0x7f79a014fdb0 legacy=0x7f79a00c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:25.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.892+0000 7f79a5400640 1 -- 172.21.15.100:0/4118665110 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a01535b0 con 0x7f79a0153120 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.893+0000 7f79a5400640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a015cfc0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7998009e50 tx=0x7f799802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173473f00c7dacd4 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.893+0000 7f799f400640 1 -- 172.21.15.100:0/4118665110 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799802ca70 con 0x7f79a0153120 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.893+0000 7f799f400640 1 -- 172.21.15.100:0/4118665110 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799802cbd0 con 0x7f79a0153120 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.893+0000 7f799f400640 1 -- 172.21.15.100:0/4118665110 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980343f0 con 0x7f79a0153120 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 -- 172.21.15.100:0/4118665110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 msgr2=0x7f79a015cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a015cfc0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f7998009e50 tx=0x7f799802bed0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 -- 172.21.15.100:0/4118665110 shutdown_connections 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a015cfc0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 --2- 172.21.15.100:0/4118665110 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a00c3460 0x7f79a0152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 -- 172.21.15.100:0/4118665110 >> 172.21.15.100:0/4118665110 conn(0x7f79a00c2940 msgr2=0x7f79a00c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 -- 172.21.15.100:0/4118665110 shutdown_connections 2024-01-20T08:14:25.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.894+0000 7f79a7400640 1 -- 172.21.15.100:0/4118665110 wait complete. 2024-01-20T08:14:25.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.896+0000 7f79a7400640 1 Processor -- start 2024-01-20T08:14:25.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.896+0000 7f79a7400640 1 -- start start 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.896+0000 7f79a7400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a00c3460 0x7f79a00bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.896+0000 7f79a7400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a014fdb0 0x7f79a01ed710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a7400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0156440 con 0x7f79a0153120 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a7400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0156140 con 0x7f79a00c3460 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a7400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a006c5a0 con 0x7f79a014fdb0 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49442/0 (socket says 172.21.15.100:49442) 2024-01-20T08:14:25.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 -- 172.21.15.100:0/4029790557 learned_addr learned my addr 172.21.15.100:0/4029790557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:25.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f799fe00640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a014fdb0 0x7f79a01ed710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 -- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a014fdb0 msgr2=0x7f79a01ed710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a014fdb0 0x7f79a01ed710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 -- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a00c3460 msgr2=0x7f79a00bf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a4a00640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a00c3460 0x7f79a00bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a00c3460 0x7f79a00bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.897+0000 7f79a5400640 1 -- 172.21.15.100:0/4029790557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7998009b30 con 0x7f79a0153120 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f79a5400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7998036040 tx=0x7f7998004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998040670 con 0x7f79a0153120 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980407f0 con 0x7f79a0153120 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998040ba0 con 0x7f79a0153120 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a014b140 con 0x7f79a0153120 2024-01-20T08:14:25.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.898+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00bfa20 con 0x7f79a0153120 2024-01-20T08:14:25.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.899+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a01565b0 con 0x7f79a0153120 2024-01-20T08:14:25.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.900+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f7998040d00 con 0x7f79a0153120 2024-01-20T08:14:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.901+0000 7f799cc00640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 0x7f797806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.901+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f79980ac810 con 0x7f79a0153120 2024-01-20T08:14:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.901+0000 7f79a4a00640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 0x7f797806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:25.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.902+0000 7f79a4a00640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 0x7f797806d390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7990003d90 tx=0x7f7990009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:25.908 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:25.905+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f7998077700 con 0x7f79a0153120 2024-01-20T08:14:26.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.100+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79a004e970 con 0x7f79a0153120 2024-01-20T08:14:26.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.101+0000 7f799cc00640 1 -- 172.21.15.100:0/4029790557 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7998009510 con 0x7f79a0153120 2024-01-20T08:14:26.104 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 1 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.103+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 msgr2=0x7f797806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.103+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 0x7f797806d390 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7990003d90 tx=0x7f7990009040 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.103+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 msgr2=0x7f79a01425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.103+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f7998036040 tx=0x7f7998004a40 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 shutdown_connections 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0153120 0x7f79a01425b0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f797806aed0 0x7f797806d390 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f79a014fdb0 0x7f79a01ed710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 --2- 172.21.15.100:0/4029790557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f79a00c3460 0x7f79a00bf4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 >> 172.21.15.100:0/4029790557 conn(0x7f79a00c2940 msgr2=0x7f79a0070190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 shutdown_connections 2024-01-20T08:14:26.107 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.104+0000 7f79a7400640 1 -- 172.21.15.100:0/4029790557 wait complete. 2024-01-20T08:14:26.124 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_metadata pg_num 2024-01-20T08:14:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.334+0000 7fe96f200640 1 Processor -- start 2024-01-20T08:14:26.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.334+0000 7fe96f200640 1 -- start start 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9700c1ac0 0x7fe970070a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe970072130 0x7fe970070f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96f200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe970159420 con 0x7fe970155990 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96f200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe970159670 con 0x7fe970072130 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe970070240 con 0x7fe9700c1ac0 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe967e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fe970072130 0x7fe970070f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96e800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe970155990 0x7fe970155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47654/0 (socket says 172.21.15.100:47654) 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.336+0000 7fe96e800640 1 -- 172.21.15.100:0/3018610234 learned_addr learned my addr 172.21.15.100:0/3018610234 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe96de00640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9700c1ac0 0x7fe970070a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe967e00640 1 -- 172.21.15.100:0/3018610234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9700c1ac0 msgr2=0x7fe970070a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe967e00640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9700c1ac0 0x7fe970070a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe967e00640 1 -- 172.21.15.100:0/3018610234 >> v1:172.21.15.100:6789/0 conn(0x7fe970155990 legacy=0x7fe970155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe967e00640 1 -- 172.21.15.100:0/3018610234 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe970070520 con 0x7fe970072130 2024-01-20T08:14:26.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.337+0000 7fe96d400640 1 -- 172.21.15.100:0/3018610234 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480059079 0 0) 0x7fe970159420 con 0x7fe970155990 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.338+0000 7fe967e00640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe970072130 0x7fe970070f80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d638a65ae98f5c1 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.338+0000 7fe96d400640 1 -- 172.21.15.100:0/3018610234 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958031830 con 0x7fe970072130 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.338+0000 7fe96d400640 1 -- 172.21.15.100:0/3018610234 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe958031990 con 0x7fe970072130 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.338+0000 7fe96d400640 1 -- 172.21.15.100:0/3018610234 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958031d20 con 0x7fe970072130 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 -- 172.21.15.100:0/3018610234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe970072130 msgr2=0x7fe970070f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe970072130 0x7fe970070f80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fe9580097a0 tx=0x7fe95802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 -- 172.21.15.100:0/3018610234 shutdown_connections 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe970072130 0x7fe970070f80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 --2- 172.21.15.100:0/3018610234 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe9700c1ac0 0x7fe970070a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 -- 172.21.15.100:0/3018610234 >> 172.21.15.100:0/3018610234 conn(0x7fe9700c2940 msgr2=0x7fe9700c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:26.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 -- 172.21.15.100:0/3018610234 shutdown_connections 2024-01-20T08:14:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.339+0000 7fe96f200640 1 -- 172.21.15.100:0/3018610234 wait complete. 2024-01-20T08:14:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.341+0000 7fe96f200640 1 Processor -- start 2024-01-20T08:14:26.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.341+0000 7fe96f200640 1 -- start start 2024-01-20T08:14:26.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.341+0000 7fe96f200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe970072130 0x7fe97015c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96f200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96f200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe970155990 0x7fe970158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96f200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015c510 con 0x7fe9700c1ac0 2024-01-20T08:14:26.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96f200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9701503b0 con 0x7fe970155990 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96f200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97015bf00 con 0x7fe970072130 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49452/0 (socket says 172.21.15.100:49452) 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 -- 172.21.15.100:0/2953929862 learned_addr learned my addr 172.21.15.100:0/2953929862 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe96de00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe970072130 0x7fe97015c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 -- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe970072130 msgr2=0x7fe97015c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe970072130 0x7fe97015c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 -- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe970155990 msgr2=0x7fe970158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe970155990 0x7fe970158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.342+0000 7fe967e00640 1 -- 172.21.15.100:0/2953929862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009400 con 0x7fe9700c1ac0 2024-01-20T08:14:26.346 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe967e00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe958034040 tx=0x7fe9580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95803aa60 con 0x7fe9700c1ac0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95803abe0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe958044400 con 0x7fe9700c1ac0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9701f23f0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.343+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9701f26d0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.344+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe970067e50 con 0x7fe9700c1ac0 2024-01-20T08:14:26.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.345+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe95804d440 con 0x7fe9700c1ac0 2024-01-20T08:14:26.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.346+0000 7fe966000640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 0x7fe94806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.346+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fe9580ab7f0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.346+0000 7fe96de00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 0x7fe94806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.347+0000 7fe96de00640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 0x7fe94806d3c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe960006fd0 tx=0x7fe960008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.353 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.350+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe958076650 con 0x7fe9700c1ac0 2024-01-20T08:14:26.544 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.542+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe97004e9e0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.545 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.542+0000 7fe966000640 1 -- 172.21.15.100:0/2953929862 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_metadata", "var": "pg_num"}]=0 v81) v1 ==== 105+0+11 (secure 0 0 0) 0x7fe9580350b0 con 0x7fe9700c1ac0 2024-01-20T08:14:26.545 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 32 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 msgr2=0x7fe94806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 0x7fe94806d3c0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fe960006fd0 tx=0x7fe960008040 comp rx=0 tx=0).stop 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 msgr2=0x7fe97015a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fe958034040 tx=0x7fe9580046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 shutdown_connections 2024-01-20T08:14:26.548 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe970155990 0x7fe970158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9700c1ac0 0x7fe97015a4c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe94806af00 0x7fe94806d3c0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 --2- 172.21.15.100:0/2953929862 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe970072130 0x7fe97015c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 >> 172.21.15.100:0/2953929862 conn(0x7fe9700c2940 msgr2=0x7fe970070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 shutdown_connections 2024-01-20T08:14:26.549 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.545+0000 7fe96f200640 1 -- 172.21.15.100:0/2953929862 wait complete. 2024-01-20T08:14:26.566 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs2_data pg_num 2024-01-20T08:14:26.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.768+0000 7fc182200640 1 Processor -- start 2024-01-20T08:14:26.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.768+0000 7fc182200640 1 -- start start 2024-01-20T08:14:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 0x7fc17c0c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc17c0c1d90 0x7fc17c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.773 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0a9ce0 con 0x7fc17c0c1d90 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc17c0a93b0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc182200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c152790 con 0x7fc17c0c3460 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc173e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc17c0c1d90 0x7fc17c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc173e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc17c0c1d90 0x7fc17c152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49460/0 (socket says 172.21.15.100:49460) 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.770+0000 7fc173e00640 1 -- 172.21.15.100:0/318727824 learned_addr learned my addr 172.21.15.100:0/318727824 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc17be00640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc17b400640 1 --2- 172.21.15.100:0/318727824 >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 0x7fc17c0c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc173e00640 1 -- 172.21.15.100:0/318727824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 msgr2=0x7fc17c153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc173e00640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.775 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc173e00640 1 -- 172.21.15.100:0/318727824 >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 msgr2=0x7fc17c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc173e00640 1 --2- 172.21.15.100:0/318727824 >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 0x7fc17c0c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc173e00640 1 -- 172.21.15.100:0/318727824 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc17c150190 con 0x7fc17c0c1d90 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.771+0000 7fc17b400640 1 --2- 172.21.15.100:0/318727824 >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 0x7fc17c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.772+0000 7fc173e00640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c0c1d90 0x7fc17c152be0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06e580 tx=0x7fc16402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ade6942d427c9b93 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.772+0000 7fc17aa00640 1 -- 172.21.15.100:0/318727824 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164031860 con 0x7fc17c0c1d90 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.772+0000 7fc17aa00640 1 -- 172.21.15.100:0/318727824 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1640319c0 con 0x7fc17c0c1d90 2024-01-20T08:14:26.776 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.772+0000 7fc17aa00640 1 -- 172.21.15.100:0/318727824 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc164031d50 con 0x7fc17c0c1d90 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 -- 172.21.15.100:0/318727824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c0c1d90 msgr2=0x7fc17c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c0c1d90 0x7fc17c152be0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fc17c06e580 tx=0x7fc16402b900 comp rx=0 tx=0).stop 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 -- 172.21.15.100:0/318727824 shutdown_connections 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 --2- 172.21.15.100:0/318727824 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c0c1d90 0x7fc17c152be0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 --2- 172.21.15.100:0/318727824 >> v2:172.21.15.110:3300/0 conn(0x7fc17c14fdb0 0x7fc17c0c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 -- 172.21.15.100:0/318727824 >> 172.21.15.100:0/318727824 conn(0x7fc17c0c2940 msgr2=0x7fc17c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:26.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 -- 172.21.15.100:0/318727824 shutdown_connections 2024-01-20T08:14:26.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.773+0000 7fc182200640 1 -- 172.21.15.100:0/318727824 wait complete. 2024-01-20T08:14:26.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.775+0000 7fc182200640 1 Processor -- start 2024-01-20T08:14:26.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.775+0000 7fc182200640 1 -- start start 2024-01-20T08:14:26.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c0c1d90 0x7fc17c0c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c144bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c147f30 con 0x7fc17c14fdb0 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c1468a0 con 0x7fc17c0c1d90 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc182200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc17c146cf0 con 0x7fc17c0c3460 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc17be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc17be00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49470/0 (socket says 172.21.15.100:49470) 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc17be00640 1 -- 172.21.15.100:0/3366325217 learned_addr learned my addr 172.21.15.100:0/3366325217 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.776+0000 7fc173e00640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c144bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 -- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 msgr2=0x7fc17c144bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c144bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 -- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c0c1d90 msgr2=0x7fc17c0c4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c0c1d90 0x7fc17c0c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 -- 172.21.15.100:0/3366325217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1640094d0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc17be00640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc174007e60 tx=0x7fc17400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc174014620 con 0x7fc17c14fdb0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc17400ee90 con 0x7fc17c14fdb0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1740149e0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17c1521d0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.777+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc17c149430 con 0x7fc17c14fdb0 2024-01-20T08:14:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.779+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc17c146a10 con 0x7fc17c14fdb0 2024-01-20T08:14:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.780+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc174014b40 con 0x7fc17c14fdb0 2024-01-20T08:14:26.783 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.780+0000 7fc173400640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 0x7fc15406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.780+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fc174089ff0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.781+0000 7fc17b400640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 0x7fc15406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:26.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.781+0000 7fc17b400640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 0x7fc15406d390 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:26.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.785+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc1740bd0d0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.978 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.975+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"} v 0) v1 -- 0x7fc17c0ac1c0 con 0x7fc17c14fdb0 2024-01-20T08:14:26.979 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.976+0000 7fc173400640 1 -- 172.21.15.100:0/3366325217 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs2_data", "var": "pg_num"}]=0 v81) v1 ==== 101+0+11 (secure 0 0 0) 0x7fc17c146a10 con 0x7fc17c14fdb0 2024-01-20T08:14:26.979 INFO:teuthology.orchestra.run.smithi100.stdout:pg_num: 64 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 msgr2=0x7fc15406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 0x7fc15406d390 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 msgr2=0x7fc17c1450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fc174007e60 tx=0x7fc17400e4b0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 shutdown_connections 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc17c14fdb0 0x7fc17c1450f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc15406aed0 0x7fc15406d390 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc17c0c3460 0x7fc17c144bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 --2- 172.21.15.100:0/3366325217 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc17c0c1d90 0x7fc17c0c4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:26.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 >> 172.21.15.100:0/3366325217 conn(0x7fc17c0c2940 msgr2=0x7fc17c0c2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:26.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 shutdown_connections 2024-01-20T08:14:26.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:26.979+0000 7fc182200640 1 -- 172.21.15.100:0/3366325217 wait complete. 2024-01-20T08:14:26.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.204+0000 7f17bf400640 1 Processor -- start 2024-01-20T08:14:27.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.204+0000 7f17bf400640 1 -- start start 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bf400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f17b80bfae0 0x7f17b8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bf400640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80c0fb0 con 0x7f17b8071220 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bf400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b806def0 con 0x7f17b81521e0 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bf400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80c04a0 con 0x7f17b80bfae0 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bca00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f17b8071220 0x7f17b8071600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47656/0 (socket says 172.21.15.100:47656) 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17bca00640 1 -- 172.21.15.100:0/2289456658 learned_addr learned my addr 172.21.15.100:0/2289456658 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17afc00640 1 --2- 172.21.15.100:0/2289456658 >> v2:172.21.15.110:3300/0 conn(0x7f17b80bfae0 0x7f17b8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882408704 0 0) 0x7f17b80c0fb0 con 0x7f17b8071220 2024-01-20T08:14:27.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.206+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1798003520 con 0x7f17b8071220 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1741011578 0 0) 0x7f1798003520 con 0x7f17b8071220 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 >> v2:172.21.15.110:3300/0 conn(0x7f17b80bfae0 msgr2=0x7f17b8151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 --2- 172.21.15.100:0/2289456658 >> v2:172.21.15.110:3300/0 conn(0x7f17b80bfae0 0x7f17b8151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 >> v1:172.21.15.110:6789/0 conn(0x7f17b81521e0 legacy=0x7f17b8157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b806e1d0 con 0x7f17b8071220 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f17a8001670 con 0x7f17b8071220 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 >> v1:172.21.15.100:6789/0 conn(0x7f17b8071220 legacy=0x7f17b8071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980039c0 0x7f1798003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 0x7f1798004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17980052a0 0x7f179800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c04a0 con 0x7f17980047c0 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f179800c1a0 con 0x7f17980052a0 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f179800c360 con 0x7f17980039c0 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17afc00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 0x7f1798004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.207+0000 7f17bca00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980039c0 0x7f1798003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17bd400640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17980052a0 0x7f179800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17afc00640 1 -- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980039c0 msgr2=0x7f1798003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17afc00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980039c0 0x7f1798003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17afc00640 1 -- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17980052a0 msgr2=0x7f179800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17afc00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17980052a0 0x7f179800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17afc00640 1 -- 172.21.15.100:0/2289456658 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1798003520 con 0x7f17980047c0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17bd400640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17980052a0 0x7f179800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.208+0000 7f17bd400640 1 -- 172.21.15.100:0/2289456658 reap_dead start 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.209+0000 7f17afc00640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 0x7f1798004c40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009f90 tx=0x7f17980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68530b88a6e9e236 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.209+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a002cbd0 con 0x7f17980047c0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.209+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000f040 con 0x7f17980047c0 2024-01-20T08:14:27.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.209+0000 7f17b7e00640 1 -- 172.21.15.100:0/2289456658 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0034440 con 0x7f17980047c0 2024-01-20T08:14:27.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 -- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 msgr2=0x7f1798004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 0x7f1798004c40 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009f90 tx=0x7f17980057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 -- 172.21.15.100:0/2289456658 shutdown_connections 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 --2- 172.21.15.100:0/2289456658 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17980047c0 0x7f1798004c40 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 -- 172.21.15.100:0/2289456658 >> 172.21.15.100:0/2289456658 conn(0x7f17b806a5e0 msgr2=0x7f17b806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 -- 172.21.15.100:0/2289456658 shutdown_connections 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.210+0000 7f17bf400640 1 -- 172.21.15.100:0/2289456658 wait complete. 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.212+0000 7f17bf400640 1 Processor -- start 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.212+0000 7f17bf400640 1 -- start start 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980047c0 0x7f17b80abf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b80aaf70 0x7f17b8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8149180 con 0x7f17b8148d40 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b81ee2c0 con 0x7f17b80aaf70 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bf400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80aa1b0 con 0x7f17980047c0 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49480/0 (socket says 172.21.15.100:49480) 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 -- 172.21.15.100:0/3023647220 learned_addr learned my addr 172.21.15.100:0/3023647220 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 -- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980047c0 msgr2=0x7f17b80abf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bca00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980047c0 0x7f17b80abf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980047c0 0x7f17b80abf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 -- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b80aaf70 msgr2=0x7f17b8147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17bd400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b80aaf70 0x7f17b8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b80aaf70 0x7f17b8147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.219 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.213+0000 7f17afc00640 1 -- 172.21.15.100:0/3023647220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80aa490 con 0x7f17b8148d40 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17afc00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009f90 tx=0x7f17a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0040450 con 0x7f17b8148d40 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a00405d0 con 0x7f17b8148d40 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80aa770 con 0x7f17b8148d40 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0040980 con 0x7f17b8148d40 2024-01-20T08:14:27.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.214+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b81534c0 con 0x7f17b8148d40 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.215+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b804e970 con 0x7f17b8148d40 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.216+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f17a0040ae0 con 0x7f17b8148d40 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.217+0000 7f17b5600640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 0x7f179006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.217+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f17a00abf40 con 0x7f17b8148d40 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.217+0000 7f17bca00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 0x7f179006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.218+0000 7f17bca00640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 0x7f179006d3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001eb0 tx=0x7f17a8000fb0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.222+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f17a0076d10 con 0x7f17b8148d40 2024-01-20T08:14:27.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.449+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17b8072190 con 0x7f17b8148d40 2024-01-20T08:14:27.453 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.450+0000 7f17b5600640 1 -- 172.21.15.100:0/3023647220 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4955 (secure 0 0 0) 0x7f17a0044090 con 0x7f17b8148d40 2024-01-20T08:14:27.454 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:27.454 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3606692265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3606692265},{"type":"v1","addr":"172.21.15.100:6837","nonce":3606692265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:27.454 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 55 2024-01-20T08:14:27.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 msgr2=0x7f179006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 0x7f179006d3c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001eb0 tx=0x7f17a8000fb0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 msgr2=0x7f17b8152c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f17a0009f90 tx=0x7f17a0009750 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 shutdown_connections 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f17b80aaf70 0x7f17b8147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f17b8148d40 0x7f17b8152c40 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f179006af00 0x7f179006d3c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 --2- 172.21.15.100:0/3023647220 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f17980047c0 0x7f17b80abf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 >> 172.21.15.100:0/3023647220 conn(0x7f17b806a5e0 msgr2=0x7f17b814ba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 shutdown_connections 2024-01-20T08:14:27.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.453+0000 7f17bf400640 1 -- 172.21.15.100:0/3023647220 wait complete. 2024-01-20T08:14:27.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:27.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.664+0000 7efdaaa00640 1 Processor -- start 2024-01-20T08:14:27.667 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.664+0000 7efdaaa00640 1 -- start start 2024-01-20T08:14:27.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.665+0000 7efdaaa00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efda4072320 0x7efda414f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efdaaa00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7efda40c3240 0x7efda414fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.669 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efdaaa00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efda40c1720 con 0x7efda406dd90 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efdaaa00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda40c20a0 con 0x7efda4072320 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efdaaa00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efda406c7c0 con 0x7efda40c3240 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efda4072320 0x7efda414f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7efda4072320 0x7efda414f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49496/0 (socket says 172.21.15.100:49496) 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 -- 172.21.15.100:0/1517020989 learned_addr learned my addr 172.21.15.100:0/1517020989 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efdaa000640 1 --2- 172.21.15.100:0/1517020989 >> v2:172.21.15.110:3300/0 conn(0x7efda40c3240 0x7efda414fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 -- 172.21.15.100:0/1517020989 >> v2:172.21.15.110:3300/0 conn(0x7efda40c3240 msgr2=0x7efda414fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 --2- 172.21.15.100:0/1517020989 >> v2:172.21.15.110:3300/0 conn(0x7efda40c3240 0x7efda414fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 -- 172.21.15.100:0/1517020989 >> v1:172.21.15.110:6789/0 conn(0x7efda406dd90 legacy=0x7efda4155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:27.670 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.666+0000 7efda9600640 1 -- 172.21.15.100:0/1517020989 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda40a4f30 con 0x7efda4072320 2024-01-20T08:14:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.668+0000 7efda9600640 1 --2- 172.21.15.100:0/1517020989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda4072320 0x7efda414f5d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7efda4074570 tx=0x7efd9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89718a5c54a16b1e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.668+0000 7efda3e00640 1 -- 172.21.15.100:0/1517020989 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94031870 con 0x7efda4072320 2024-01-20T08:14:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.668+0000 7efda3e00640 1 -- 172.21.15.100:0/1517020989 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd940319d0 con 0x7efda4072320 2024-01-20T08:14:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.668+0000 7efda3e00640 1 -- 172.21.15.100:0/1517020989 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd94031d60 con 0x7efda4072320 2024-01-20T08:14:27.671 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 -- 172.21.15.100:0/1517020989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda4072320 msgr2=0x7efda414f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 --2- 172.21.15.100:0/1517020989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda4072320 0x7efda414f5d0 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7efda4074570 tx=0x7efd9402b910 comp rx=0 tx=0).stop 2024-01-20T08:14:27.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 -- 172.21.15.100:0/1517020989 shutdown_connections 2024-01-20T08:14:27.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 --2- 172.21.15.100:0/1517020989 >> v2:172.21.15.110:3300/0 conn(0x7efda40c3240 0x7efda414fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.672 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 --2- 172.21.15.100:0/1517020989 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda4072320 0x7efda414f5d0 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 -- 172.21.15.100:0/1517020989 >> 172.21.15.100:0/1517020989 conn(0x7efda40c2590 msgr2=0x7efda40c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 -- 172.21.15.100:0/1517020989 shutdown_connections 2024-01-20T08:14:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.669+0000 7efdaaa00640 1 -- 172.21.15.100:0/1517020989 wait complete. 2024-01-20T08:14:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.671+0000 7efdaaa00640 1 Processor -- start 2024-01-20T08:14:27.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.671+0000 7efdaaa00640 1 -- start start 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda406dd90 0x7efda41dd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda4072320 0x7efda4154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41ddc20 con 0x7efda40c3240 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efda41de4a0 con 0x7efda406dd90 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaaa00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efda41dc750 con 0x7efda4072320 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49500/0 (socket says 172.21.15.100:49500) 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 -- 172.21.15.100:0/3942550474 learned_addr learned my addr 172.21.15.100:0/3942550474 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 -- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda4072320 msgr2=0x7efda4154f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda4072320 0x7efda4154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 -- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda406dd90 msgr2=0x7efda41dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efda9600640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda406dd90 0x7efda41dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda406dd90 0x7efda41dd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.672+0000 7efdaa000640 1 -- 172.21.15.100:0/3942550474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd940094d0 con 0x7efda40c3240 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efdaa000640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00cd90 tx=0x7efd9c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c003b90 con 0x7efda40c3240 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd9c003d10 con 0x7efda40c3240 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efda41dc470 con 0x7efda40c3240 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd9c004260 con 0x7efda40c3240 2024-01-20T08:14:27.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.673+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efda41de130 con 0x7efda40c3240 2024-01-20T08:14:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.674+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efda404e970 con 0x7efda40c3240 2024-01-20T08:14:27.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.675+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7efd9c0043c0 con 0x7efda40c3240 2024-01-20T08:14:27.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.676+0000 7efda1600640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 0x7efd7c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:27.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.676+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7efd9c012070 con 0x7efda40c3240 2024-01-20T08:14:27.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.676+0000 7efda9600640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 0x7efd7c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:27.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.677+0000 7efda9600640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 0x7efd7c06d390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efd94036000 tx=0x7efd9403c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:27.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.680+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7efd9c054ec0 con 0x7efda40c3240 2024-01-20T08:14:27.874 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.871+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efda414ffd0 con 0x7efda40c3240 2024-01-20T08:14:27.877 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.874+0000 7efda1600640 1 -- 172.21.15.100:0/3942550474 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16620 (secure 0 0 0) 0x7efd9c003e80 con 0x7efda40c3240 2024-01-20T08:14:27.877 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:27.878 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:14:25.215888+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/1016959198":"2024-01-21T08:14:22.199588+0000","172.21.15.100:6836/1016959198":"2024-01-21T08:14:22.199588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.876+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 msgr2=0x7efd7c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.876+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 0x7efd7c06d390 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7efd94036000 tx=0x7efd9403c040 comp rx=0 tx=0).stop 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.876+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 msgr2=0x7efda40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.876+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7efd9c00cd90 tx=0x7efd9c00a660 comp rx=0 tx=0).stop 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 shutdown_connections 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efda40c3240 0x7efda40a5300 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7efd7c06aed0 0x7efd7c06d390 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.880 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7efda4072320 0x7efda4154f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 --2- 172.21.15.100:0/3942550474 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7efda406dd90 0x7efda41dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 >> 172.21.15.100:0/3942550474 conn(0x7efda40c2590 msgr2=0x7efda414f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 shutdown_connections 2024-01-20T08:14:27.881 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:27.877+0000 7efdaaa00640 1 -- 172.21.15.100:0/3942550474 wait complete. 2024-01-20T08:14:27.897 INFO:tasks.cephfs.filesystem:Destroying file system cephfs2 and related pools 2024-01-20T08:14:27.897 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.097+0000 7f9b15800640 1 Processor -- start 2024-01-20T08:14:28.100 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.097+0000 7f9b15800640 1 -- start start 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.098+0000 7f9b15800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f9b1014fce0 0x7f9b10153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.098+0000 7f9b15800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b100a93c0 0x7f9b10152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.098+0000 7f9b15800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b100a9940 con 0x7f9b10153440 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b15800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b101500c0 con 0x7f9b100a93c0 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b15800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b10156810 con 0x7f9b1014fce0 2024-01-20T08:14:28.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b05e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f9b100a93c0 0x7f9b10152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b0f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f9b10153440 0x7f9b100aae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47670/0 (socket says 172.21.15.100:47670) 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b0f400640 1 -- 172.21.15.100:0/1780703472 learned_addr learned my addr 172.21.15.100:0/1780703472 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b0ea00640 1 --2- 172.21.15.100:0/1780703472 >> v2:172.21.15.110:3300/0 conn(0x7f9b1014fce0 0x7f9b10153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b05e00640 1 -- 172.21.15.100:0/1780703472 >> v2:172.21.15.110:3300/0 conn(0x7f9b1014fce0 msgr2=0x7f9b10153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b05e00640 1 --2- 172.21.15.100:0/1780703472 >> v2:172.21.15.110:3300/0 conn(0x7f9b1014fce0 0x7f9b10153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b05e00640 1 -- 172.21.15.100:0/1780703472 >> v1:172.21.15.100:6789/0 conn(0x7f9b10153440 legacy=0x7f9b100aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b05e00640 1 -- 172.21.15.100:0/1780703472 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b10156af0 con 0x7f9b100a93c0 2024-01-20T08:14:28.103 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.099+0000 7f9b0e000640 1 -- 172.21.15.100:0/1780703472 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3310393365 0 0) 0x7f9b100a9940 con 0x7f9b10153440 2024-01-20T08:14:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.100+0000 7f9b05e00640 1 --2- 172.21.15.100:0/1780703472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b10152f00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f9b1006f970 tx=0x7f9af802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c21885bb2788b0a3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b0e000640 1 -- 172.21.15.100:0/1780703472 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8031830 con 0x7f9b100a93c0 2024-01-20T08:14:28.104 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b0e000640 1 -- 172.21.15.100:0/1780703472 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9af8031990 con 0x7f9b100a93c0 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b0e000640 1 -- 172.21.15.100:0/1780703472 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9af8031d20 con 0x7f9b100a93c0 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 -- 172.21.15.100:0/1780703472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 msgr2=0x7f9b10152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 --2- 172.21.15.100:0/1780703472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b10152f00 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f9b1006f970 tx=0x7f9af802b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 -- 172.21.15.100:0/1780703472 shutdown_connections 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 --2- 172.21.15.100:0/1780703472 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b10152f00 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 --2- 172.21.15.100:0/1780703472 >> v2:172.21.15.110:3300/0 conn(0x7f9b1014fce0 0x7f9b10153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 -- 172.21.15.100:0/1780703472 >> 172.21.15.100:0/1780703472 conn(0x7f9b1006a5e0 msgr2=0x7f9b1006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 -- 172.21.15.100:0/1780703472 shutdown_connections 2024-01-20T08:14:28.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.101+0000 7f9b15800640 1 -- 172.21.15.100:0/1780703472 wait complete. 2024-01-20T08:14:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.103+0000 7f9b15800640 1 Processor -- start 2024-01-20T08:14:28.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.103+0000 7f9b15800640 1 -- start start 2024-01-20T08:14:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1014fce0 0x7f9b10143be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b10153440 0x7f9b10144120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101eddc0 con 0x7f9b100a93c0 2024-01-20T08:14:28.108 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b101ee2f0 con 0x7f9b1014fce0 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b15800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b100c1ef0 con 0x7f9b10153440 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b0ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b0ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49510/0 (socket says 172.21.15.100:49510) 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.104+0000 7f9b0ea00640 1 -- 172.21.15.100:0/3707359300 learned_addr learned my addr 172.21.15.100:0/3707359300 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 -- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b10153440 msgr2=0x7f9b10144120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b10153440 0x7f9b10144120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b05e00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1014fce0 0x7f9b10143be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 -- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1014fce0 msgr2=0x7f9b10143be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1014fce0 0x7f9b10143be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 -- 172.21.15.100:0/3707359300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9af8009400 con 0x7f9b100a93c0 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b0ea00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000d800 tx=0x7f9b0000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.109 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000b6c0 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0000b820 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0000bbb0 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b101ee010 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.105+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b100c1b80 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.107+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b100c1d10 con 0x7f9b100a93c0 2024-01-20T08:14:28.110 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.108+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9b0000bd10 con 0x7f9b100a93c0 2024-01-20T08:14:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.108+0000 7f9b07400640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 0x7f9ae806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.108+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7f9b00089bb0 con 0x7f9b100a93c0 2024-01-20T08:14:28.111 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.109+0000 7f9b05e00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 0x7f9ae806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.112 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.109+0000 7f9b05e00640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 0x7f9ae806d390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af8008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.113+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f9b00054ab0 con 0x7f9b100a93c0 2024-01-20T08:14:28.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.348+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b1004e970 con 0x7f9b100a93c0 2024-01-20T08:14:28.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.349+0000 7f9b07400640 1 -- 172.21.15.100:0/3707359300 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4955 (secure 0 0 0) 0x7f9b000580d0 con 0x7f9b100a93c0 2024-01-20T08:14:28.352 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:28.352 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3606692265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3606692265},{"type":"v1","addr":"172.21.15.100:6837","nonce":3606692265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:28.352 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 55 2024-01-20T08:14:28.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 msgr2=0x7f9ae806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 0x7f9ae806d390 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9af8036000 tx=0x7f9af8008030 comp rx=0 tx=0).stop 2024-01-20T08:14:28.354 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 msgr2=0x7f9b100c5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f9b0000d800 tx=0x7f9b0000dcc0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 shutdown_connections 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f9ae806aed0 0x7f9ae806d390 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f9b10153440 0x7f9b10144120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9b1014fce0 0x7f9b10143be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 --2- 172.21.15.100:0/3707359300 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9b100a93c0 0x7f9b100c5260 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 >> 172.21.15.100:0/3707359300 conn(0x7f9b1006a5e0 msgr2=0x7f9b101502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 shutdown_connections 2024-01-20T08:14:28.355 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.351+0000 7f9b15800640 1 -- 172.21.15.100:0/3707359300 wait complete. 2024-01-20T08:14:28.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:14:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.575+0000 7fee6d400640 1 Processor -- start 2024-01-20T08:14:28.578 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.575+0000 7fee6d400640 1 -- start start 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.576+0000 7fee6d400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 0x7fee6806d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.576+0000 7fee6d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee680c3e00 0x7fee6806c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.576+0000 7fee6d400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee681523a0 con 0x7fee680c5570 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.576+0000 7fee6d400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee680706a0 con 0x7fee680c3e00 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.576+0000 7fee6d400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee68151ee0 con 0x7fee6806d2b0 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee680c3e00 0x7fee6806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fee680c3e00 0x7fee6806c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49520/0 (socket says 172.21.15.100:49520) 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 -- 172.21.15.100:0/2793677700 learned_addr learned my addr 172.21.15.100:0/2793677700 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee67e00640 1 --2- 172.21.15.100:0/2793677700 >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 0x7fee6806d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 -- 172.21.15.100:0/2793677700 >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 msgr2=0x7fee6806d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 --2- 172.21.15.100:0/2793677700 >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 0x7fee6806d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 -- 172.21.15.100:0/2793677700 >> v1:172.21.15.110:6789/0 conn(0x7fee680c5570 legacy=0x7fee6806c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee5f200640 1 -- 172.21.15.100:0/2793677700 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee680a53f0 con 0x7fee680c3e00 2024-01-20T08:14:28.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.577+0000 7fee67e00640 1 --2- 172.21.15.100:0/2793677700 >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 0x7fee6806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.578+0000 7fee5f200640 1 --2- 172.21.15.100:0/2793677700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c3e00 0x7fee6806c460 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fee680c5a80 tx=0x7fee5002b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd9e183f36280f3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee67400640 1 -- 172.21.15.100:0/2793677700 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031740 con 0x7fee680c3e00 2024-01-20T08:14:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee67400640 1 -- 172.21.15.100:0/2793677700 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee500318a0 con 0x7fee680c3e00 2024-01-20T08:14:28.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee67400640 1 -- 172.21.15.100:0/2793677700 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee50031c30 con 0x7fee680c3e00 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 -- 172.21.15.100:0/2793677700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c3e00 msgr2=0x7fee6806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 --2- 172.21.15.100:0/2793677700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c3e00 0x7fee6806c460 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7fee680c5a80 tx=0x7fee5002b7e0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 -- 172.21.15.100:0/2793677700 shutdown_connections 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 --2- 172.21.15.100:0/2793677700 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c3e00 0x7fee6806c460 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 --2- 172.21.15.100:0/2793677700 >> v2:172.21.15.110:3300/0 conn(0x7fee6806d2b0 0x7fee6806d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.579+0000 7fee6d400640 1 -- 172.21.15.100:0/2793677700 >> 172.21.15.100:0/2793677700 conn(0x7fee680c2590 msgr2=0x7fee680c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.580+0000 7fee6d400640 1 -- 172.21.15.100:0/2793677700 shutdown_connections 2024-01-20T08:14:28.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.580+0000 7fee6d400640 1 -- 172.21.15.100:0/2793677700 wait complete. 2024-01-20T08:14:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.582+0000 7fee6d400640 1 Processor -- start 2024-01-20T08:14:28.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.582+0000 7fee6d400640 1 -- start start 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee6806d2b0 0x7fee6815c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee680c3e00 0x7fee68144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee68145a60 con 0x7fee680c5570 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee681544d0 con 0x7fee680c3e00 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6d400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee680ab1f0 con 0x7fee6806d2b0 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6ca00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:49534/0 (socket says 172.21.15.100:49534) 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee6ca00640 1 -- 172.21.15.100:0/2756294291 learned_addr learned my addr 172.21.15.100:0/2756294291 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee5f200640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee680c3e00 0x7fee68144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.583+0000 7fee67e00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee6806d2b0 0x7fee6815c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 -- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee6806d2b0 msgr2=0x7fee6815c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee6806d2b0 0x7fee6815c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 -- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee680c3e00 msgr2=0x7fee68144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee680c3e00 0x7fee68144fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 -- 172.21.15.100:0/2756294291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee500094d0 con 0x7fee680c5570 2024-01-20T08:14:28.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6ca00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ba10 tx=0x7fee6000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee6000cba0 con 0x7fee680c5570 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee6000cd00 con 0x7fee680c5570 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee680ab4d0 con 0x7fee680c5570 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.584+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee60014680 con 0x7fee680c5570 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.585+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee681e8d90 con 0x7fee680c5570 2024-01-20T08:14:28.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.586+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee680749e0 con 0x7fee680c5570 2024-01-20T08:14:28.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.587+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fee6001d3b0 con 0x7fee680c5570 2024-01-20T08:14:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.588+0000 7fee64c00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 0x7fee4006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.588+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fee60089620 con 0x7fee680c5570 2024-01-20T08:14:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.588+0000 7fee67e00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 0x7fee4006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:28.591 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.589+0000 7fee67e00640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 0x7fee4006d390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fee5800a930 tx=0x7fee58008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:28.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.592+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fee600543f0 con 0x7fee680c5570 2024-01-20T08:14:28.826 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.823+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee680c5350 con 0x7fee680c5570 2024-01-20T08:14:28.827 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.824+0000 7fee64c00640 1 -- 172.21.15.100:0/2756294291 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 55 v55) v1 ==== 94+0+4955 (secure 0 0 0) 0x7fee60057a10 con 0x7fee680c5570 2024-01-20T08:14:28.828 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:28.828 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":55,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3606692265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3606692265},{"type":"v1","addr":"172.21.15.100:6837","nonce":3606692265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":53,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-01-20T08:13:40.574364+0000","modified":"2024-01-20T08:13:43.656648+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":6423},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6423":{"gid":6423,"name":"c","rank":0,"incarnation":49,"state":"up:active","state_seq":10,"addr":"172.21.15.100:6835/2268195390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2268195390},{"type":"v1","addr":"172.21.15.100:6835","nonce":2268195390}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs2","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-01-20T08:14:28.828 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 55 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 msgr2=0x7fee4006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 0x7fee4006d390 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fee5800a930 tx=0x7fee58008040 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 msgr2=0x7fee68145520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7fee6000ba10 tx=0x7fee6000bed0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 shutdown_connections 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fee680c5570 0x7fee68145520 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fee680c3e00 0x7fee68144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fee4006aed0 0x7fee4006d390 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.827+0000 7fee6d400640 1 --2- 172.21.15.100:0/2756294291 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fee6806d2b0 0x7fee6815c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.828+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 >> 172.21.15.100:0/2756294291 conn(0x7fee680c2590 msgr2=0x7fee680a7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.828+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 shutdown_connections 2024-01-20T08:14:28.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:28.828+0000 7fee6d400640 1 -- 172.21.15.100:0/2756294291 wait complete. 2024-01-20T08:14:28.849 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:29.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.052+0000 7fbe64200640 1 Processor -- start 2024-01-20T08:14:29.055 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.052+0000 7fbe64200640 1 -- start start 2024-01-20T08:14:29.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe64200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fbe5c147f20 0x7fbe5c0abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe64200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c070370 0x7fbe5c0c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe64200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe5c0c1670 con 0x7fbe5c151f60 2024-01-20T08:14:29.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe64200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe5c0c2210 con 0x7fbe5c147f20 2024-01-20T08:14:29.057 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe64200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c1524b0 con 0x7fbe5c070370 2024-01-20T08:14:29.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe60e00640 1 --1- >> v1:172.21.15.110:6789/0 conn(0x7fbe5c151f60 0x7fbe5c0c1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.110:6789/0 says I am v1:172.21.15.100:49028/0 (socket says 172.21.15.100:49028) 2024-01-20T08:14:29.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.054+0000 7fbe60e00640 1 -- 172.21.15.100:0/1793985786 learned_addr learned my addr 172.21.15.100:0/1793985786 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:29.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe61800640 1 --2- 172.21.15.100:0/1793985786 >> v2:172.21.15.110:3300/0 conn(0x7fbe5c147f20 0x7fbe5c0abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe62200640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c070370 0x7fbe5c0c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe5be00640 1 -- 172.21.15.100:0/1793985786 <== mon.1 v1:172.21.15.110:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416660354 0 0) 0x7fbe5c0c1670 con 0x7fbe5c151f60 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe5be00640 1 -- 172.21.15.100:0/1793985786 --> v1:172.21.15.110:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe3c003520 con 0x7fbe5c151f60 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe61800640 1 -- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c070370 msgr2=0x7fbe5c0c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe61800640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c070370 0x7fbe5c0c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe61800640 1 -- 172.21.15.100:0/1793985786 >> v1:172.21.15.110:6789/0 conn(0x7fbe5c151f60 legacy=0x7fbe5c0c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.055+0000 7fbe61800640 1 -- 172.21.15.100:0/1793985786 --> v2:172.21.15.110:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe5c070820 con 0x7fbe5c147f20 2024-01-20T08:14:29.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.057+0000 7fbe61800640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c147f20 0x7fbe5c0abfd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0097a0 tx=0x7fbe4c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b65845e26149e334 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.057+0000 7fbe5be00640 1 -- 172.21.15.100:0/1793985786 <== mon.1 v2:172.21.15.110:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c031830 con 0x7fbe5c147f20 2024-01-20T08:14:29.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe5be00640 1 -- 172.21.15.100:0/1793985786 <== mon.1 v2:172.21.15.110:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c031990 con 0x7fbe5c147f20 2024-01-20T08:14:29.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe5be00640 1 -- 172.21.15.100:0/1793985786 <== mon.1 v2:172.21.15.110:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c031d20 con 0x7fbe5c147f20 2024-01-20T08:14:29.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 -- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c147f20 msgr2=0x7fbe5c0abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c147f20 0x7fbe5c0abfd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c0097a0 tx=0x7fbe4c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 -- 172.21.15.100:0/1793985786 shutdown_connections 2024-01-20T08:14:29.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c070370 0x7fbe5c0c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 --2- 172.21.15.100:0/1793985786 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c147f20 0x7fbe5c0abfd0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 -- 172.21.15.100:0/1793985786 >> 172.21.15.100:0/1793985786 conn(0x7fbe5c06a5e0 msgr2=0x7fbe5c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:29.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 -- 172.21.15.100:0/1793985786 shutdown_connections 2024-01-20T08:14:29.062 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.058+0000 7fbe64200640 1 -- 172.21.15.100:0/1793985786 wait complete. 2024-01-20T08:14:29.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.060+0000 7fbe64200640 1 Processor -- start 2024-01-20T08:14:29.063 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.060+0000 7fbe64200640 1 -- start start 2024-01-20T08:14:29.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c147f20 0x7fbe5c1ed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c151f60 0x7fbe5c1edb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c14ac40 con 0x7fbe5c070370 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c141660 con 0x7fbe5c151f60 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe64200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe5c14a5f0 con 0x7fbe5c147f20 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.061+0000 7fbe61800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55622/0 (socket says 172.21.15.100:55622) 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 -- 172.21.15.100:0/2192517973 learned_addr learned my addr 172.21.15.100:0/2192517973 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe62200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c151f60 0x7fbe5c1edb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe60e00640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c147f20 0x7fbe5c1ed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 -- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c147f20 msgr2=0x7fbe5c1ed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c147f20 0x7fbe5c1ed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 -- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c151f60 msgr2=0x7fbe5c1edb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c151f60 0x7fbe5c1edb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 -- 172.21.15.100:0/2192517973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe4c009400 con 0x7fbe5c070370 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.062+0000 7fbe61800640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c02bee0 tx=0x7fbe4c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.063+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c03a630 con 0x7fbe5c070370 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.063+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe4c03a7b0 con 0x7fbe5c070370 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.063+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe4c03ab60 con 0x7fbe5c070370 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.063+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe5c14a8d0 con 0x7fbe5c070370 2024-01-20T08:14:29.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.063+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5c0ab670 con 0x7fbe5c070370 2024-01-20T08:14:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.064+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe5c04e970 con 0x7fbe5c070370 2024-01-20T08:14:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.065+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fbe4c03acc0 con 0x7fbe5c070370 2024-01-20T08:14:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.066+0000 7fbe59600640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 0x7fbe3406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.068 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.066+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fbe4c0aaff0 con 0x7fbe5c070370 2024-01-20T08:14:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.066+0000 7fbe60e00640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 0x7fbe3406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.069 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.067+0000 7fbe60e00640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 0x7fbe3406d390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c1ee680 tx=0x7fbe44009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.070+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fbe4c0de0d0 con 0x7fbe5c070370 2024-01-20T08:14:29.271 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.268+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5c0c38d0 con 0x7fbe5c070370 2024-01-20T08:14:29.273 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.270+0000 7fbe59600640 1 -- 172.21.15.100:0/2192517973 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16620 (secure 0 0 0) 0x7fbe4c075e10 con 0x7fbe5c070370 2024-01-20T08:14:29.273 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:29.274 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":81,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:14:25.215888+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs2_metadata","create_time":"2024-01-20T08:13:38.963660+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"75","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs2"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs2_data","create_time":"2024-01-20T08:13:39.582726+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs2"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6837/1016959198":"2024-01-21T08:14:22.199588+0000","172.21.15.100:6836/1016959198":"2024-01-21T08:14:22.199588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 msgr2=0x7fbe3406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 0x7fbe3406d390 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c1ee680 tx=0x7fbe44009040 comp rx=0 tx=0).stop 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 msgr2=0x7fbe5c1487e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fbe4c02bee0 tx=0x7fbe4c0046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 shutdown_connections 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fbe5c151f60 0x7fbe5c1edb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fbe3406aed0 0x7fbe3406d390 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fbe5c147f20 0x7fbe5c1ed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.276 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 --2- 172.21.15.100:0/2192517973 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbe5c070370 0x7fbe5c1487e0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 >> 172.21.15.100:0/2192517973 conn(0x7fbe5c06a5e0 msgr2=0x7fbe5c0c1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:29.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 shutdown_connections 2024-01-20T08:14:29.277 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.273+0000 7fbe64200640 1 -- 172.21.15.100:0/2192517973 wait complete. 2024-01-20T08:14:29.294 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs2 2024-01-20T08:14:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.501+0000 7fb318000640 1 Processor -- start 2024-01-20T08:14:29.504 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.501+0000 7fb318000640 1 -- start start 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb318000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb31014b720 0x7fb3101515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb318000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fb3100c1d00 0x7fb31006cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb318000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb310154ba0 con 0x7fb3100c1850 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb318000640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb31014bb00 con 0x7fb31014b720 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb318000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb310155a00 con 0x7fb3100c1d00 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb315600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fb31014b720 0x7fb3101515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb314c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fb3100c1850 0x7fb31006c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44338/0 (socket says 172.21.15.100:44338) 2024-01-20T08:14:29.506 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.503+0000 7fb314c00640 1 -- 172.21.15.100:0/2104783673 learned_addr learned my addr 172.21.15.100:0/2104783673 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb316000640 1 --2- 172.21.15.100:0/2104783673 >> v2:172.21.15.110:3300/0 conn(0x7fb3100c1d00 0x7fb31006cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb315600640 1 -- 172.21.15.100:0/2104783673 >> v2:172.21.15.110:3300/0 conn(0x7fb3100c1d00 msgr2=0x7fb31006cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb315600640 1 --2- 172.21.15.100:0/2104783673 >> v2:172.21.15.110:3300/0 conn(0x7fb3100c1d00 0x7fb31006cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb315600640 1 -- 172.21.15.100:0/2104783673 >> v1:172.21.15.100:6789/0 conn(0x7fb3100c1850 legacy=0x7fb31006c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb30fe00640 1 -- 172.21.15.100:0/2104783673 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1770317746 0 0) 0x7fb310154ba0 con 0x7fb3100c1850 2024-01-20T08:14:29.507 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.504+0000 7fb315600640 1 -- 172.21.15.100:0/2104783673 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb310154df0 con 0x7fb31014b720 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.505+0000 7fb315600640 1 --2- 172.21.15.100:0/2104783673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb31014b720 0x7fb3101515b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb310074650 tx=0x7fb30002e010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=546087644930edb3 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.505+0000 7fb30fe00640 1 -- 172.21.15.100:0/2104783673 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30002edc0 con 0x7fb31014b720 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.505+0000 7fb30fe00640 1 -- 172.21.15.100:0/2104783673 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb300036440 con 0x7fb31014b720 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.505+0000 7fb30fe00640 1 -- 172.21.15.100:0/2104783673 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3000367d0 con 0x7fb31014b720 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 -- 172.21.15.100:0/2104783673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb31014b720 msgr2=0x7fb3101515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 --2- 172.21.15.100:0/2104783673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb31014b720 0x7fb3101515b0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fb310074650 tx=0x7fb30002e010 comp rx=0 tx=0).stop 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 -- 172.21.15.100:0/2104783673 shutdown_connections 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 --2- 172.21.15.100:0/2104783673 >> v2:172.21.15.110:3300/0 conn(0x7fb3100c1d00 0x7fb31006cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 --2- 172.21.15.100:0/2104783673 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb31014b720 0x7fb3101515b0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 -- 172.21.15.100:0/2104783673 >> 172.21.15.100:0/2104783673 conn(0x7fb3100c2940 msgr2=0x7fb3100c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 -- 172.21.15.100:0/2104783673 shutdown_connections 2024-01-20T08:14:29.509 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.506+0000 7fb318000640 1 -- 172.21.15.100:0/2104783673 wait complete. 2024-01-20T08:14:29.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.507+0000 7fb318000640 1 Processor -- start 2024-01-20T08:14:29.510 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 -- start start 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3100c1850 0x7fb3101ea7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb31014b720 0x7fb3100a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb31014deb0 con 0x7fb3100c1d00 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100a96e0 con 0x7fb3100c1850 2024-01-20T08:14:29.512 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.508+0000 7fb318000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3100a99c0 con 0x7fb31014b720 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55642/0 (socket says 172.21.15.100:55642) 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 -- 172.21.15.100:0/1834763925 learned_addr learned my addr 172.21.15.100:0/1834763925 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb315600640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3100c1850 0x7fb3101ea7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 -- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb31014b720 msgr2=0x7fb3100a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb31014b720 0x7fb3100a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 -- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3100c1850 msgr2=0x7fb3101ea7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3100c1850 0x7fb3101ea7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 -- 172.21.15.100:0/1834763925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30000b6a0 con 0x7fb3100c1d00 2024-01-20T08:14:29.513 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.509+0000 7fb314c00640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c500 tx=0x7fb2f800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.510+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8007560 con 0x7fb3100c1d00 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.510+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f80047e0 con 0x7fb3100c1d00 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.510+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f8004b90 con 0x7fb3100c1d00 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.510+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3101ead10 con 0x7fb3100c1d00 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.510+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3100aabe0 con 0x7fb3100c1d00 2024-01-20T08:14:29.514 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.511+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3100a9b50 con 0x7fb3100c1d00 2024-01-20T08:14:29.515 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.512+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fb2f8004cf0 con 0x7fb3100c1d00 2024-01-20T08:14:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.513+0000 7fb30d600640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 0x7fb2e806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.513+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5799+0+0 (secure 0 0 0) 0x7fb2f8088780 con 0x7fb3100c1d00 2024-01-20T08:14:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.513+0000 7fb315600640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 0x7fb2e806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.516 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.514+0000 7fb315600640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 0x7fb2e806d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb300038000 tx=0x7fb300032000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.517+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fb2f8053680 con 0x7fb3100c1d00 2024-01-20T08:14:29.744 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.741+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs2"} v 0) v1 -- 0x7fb310070ef0 con 0x7fb3100c1d00 2024-01-20T08:14:29.745 INFO:tasks.ceph.mon.a.smithi100.stderr:2024-01-20T08:14:29.743+0000 7fb22c800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-01-20T08:14:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.747+0000 7fb30d600640 1 -- 172.21.15.100:0/1834763925 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs2"}]=0 cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v56) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb2f8018090 con 0x7fb3100c1d00 2024-01-20T08:14:29.750 INFO:teuthology.orchestra.run.smithi100.stderr:cephfs2 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 msgr2=0x7fb2e806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 0x7fb2e806d390 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb300038000 tx=0x7fb300032000 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 msgr2=0x7fb3100bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fb2f800c500 tx=0x7fb2f800c9c0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 shutdown_connections 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fb2e806aed0 0x7fb2e806d390 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fb31014b720 0x7fb3100a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb3100c1d00 0x7fb3100bf4e0 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.750+0000 7fb318000640 1 --2- 172.21.15.100:0/1834763925 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fb3100c1850 0x7fb3101ea7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.751+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 >> 172.21.15.100:0/1834763925 conn(0x7fb3100c2940 msgr2=0x7fb3100c5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.751+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 shutdown_connections 2024-01-20T08:14:29.755 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.751+0000 7fb318000640 1 -- 172.21.15.100:0/1834763925 wait complete. 2024-01-20T08:14:29.764 INFO:tasks.ceph.mds.c.smithi100.stderr: -4977> 2024-01-20T08:13:44.527+0000 7fd0eda00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-01-20T08:14:29.772 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs2 --yes-i-really-mean-it 2024-01-20T08:14:29.823 INFO:tasks.ceph.mds.c.smithi100.stdout:starting mds.c at 2024-01-20T08:14:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.953+0000 7fd7d3000640 1 Processor -- start 2024-01-20T08:14:29.956 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.953+0000 7fd7d3000640 1 -- start start 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d3000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fd7cc14fd30 0x7fd7cc0722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d3000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7cc152c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d3000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7cc06a950 con 0x7fd7cc072830 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d3000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7cc152580 con 0x7fd7cc14fd30 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d3000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc06ac30 con 0x7fd7cc155b30 2024-01-20T08:14:29.957 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d2600640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fd7cc072830 0x7fd7cc0c2bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44360/0 (socket says 172.21.15.100:44360) 2024-01-20T08:14:29.958 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.954+0000 7fd7d2600640 1 -- 172.21.15.100:0/1888351038 learned_addr learned my addr 172.21.15.100:0/1888351038 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7d1200640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7cc152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/1888351038 >> v2:172.21.15.110:3300/0 conn(0x7fd7cc14fd30 0x7fd7cc0722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 486765351 0 0) 0x7fd7cc06a950 con 0x7fd7cc072830 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ac003520 con 0x7fd7cc072830 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1279212875 0 0) 0x7fd7ac003520 con 0x7fd7cc072830 2024-01-20T08:14:29.960 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 msgr2=0x7fd7cc152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7cc152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 >> v2:172.21.15.110:3300/0 conn(0x7fd7cc14fd30 msgr2=0x7fd7cc0722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 --2- 172.21.15.100:0/1888351038 >> v2:172.21.15.110:3300/0 conn(0x7fd7cc14fd30 0x7fd7cc0722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc06af10 con 0x7fd7cc072830 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fd7c4001670 con 0x7fd7cc072830 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 >> v1:172.21.15.100:6789/0 conn(0x7fd7cc072830 legacy=0x7fd7cc0c2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac003970 0x7fd7ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7ac0047c0 0x7fd7ac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc06ac30 con 0x7fd7ac003970 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac00b980 con 0x7fd7ac0047c0 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.955+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7ac00bb40 con 0x7fd7cc155b30 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac003970 0x7fd7ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.961 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d2600640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1200640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7ac0047c0 0x7fd7ac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 -- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 msgr2=0x7fd7ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7cc155b30 0x7fd7ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 -- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7ac0047c0 msgr2=0x7fd7ac004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7ac0047c0 0x7fd7ac004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.956+0000 7fd7d1c00640 1 -- 172.21.15.100:0/1888351038 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ac003520 con 0x7fd7ac003970 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.957+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac003970 0x7fd7ac003d90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009fc0 tx=0x7fd7ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd1aaa086ebae2d5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.957+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc02cc60 con 0x7fd7ac003970 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.957+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7bc00f040 con 0x7fd7ac003970 2024-01-20T08:14:29.962 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.957+0000 7fd7cbe00640 1 -- 172.21.15.100:0/1888351038 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7bc034440 con 0x7fd7ac003970 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 -- 172.21.15.100:0/1888351038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac003970 msgr2=0x7fd7ac003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 --2- 172.21.15.100:0/1888351038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7ac003970 0x7fd7ac003d90 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc009fc0 tx=0x7fd7ac0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d2600640 1 -- 172.21.15.100:0/1888351038 reap_dead start 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 -- 172.21.15.100:0/1888351038 shutdown_connections 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 -- 172.21.15.100:0/1888351038 >> 172.21.15.100:0/1888351038 conn(0x7fd7cc0a8a60 msgr2=0x7fd7cc0a8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 -- 172.21.15.100:0/1888351038 shutdown_connections 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.958+0000 7fd7d3000640 1 -- 172.21.15.100:0/1888351038 wait complete. 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.960+0000 7fd7d3000640 1 Processor -- start 2024-01-20T08:14:29.964 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.960+0000 7fd7d3000640 1 -- start start 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7ac003970 0x7fd7cc1edb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1e73c0 0x7fd7cc1ea190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1ee070 con 0x7fd7cc1561f0 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1e7840 con 0x7fd7cc1e73c0 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d3000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7cc1549a0 con 0x7fd7ac003970 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55680/0 (socket says 172.21.15.100:55680) 2024-01-20T08:14:29.965 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 -- 172.21.15.100:0/469224045 learned_addr learned my addr 172.21.15.100:0/469224045 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:29.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d2600640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1e73c0 0x7fd7cc1ea190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.966 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7ac003970 0x7fd7cc1edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 -- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7ac003970 msgr2=0x7fd7cc1edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7ac003970 0x7fd7cc1edb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 -- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1e73c0 msgr2=0x7fd7cc1ea190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1e73c0 0x7fd7cc1ea190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.961+0000 7fd7d1200640 1 -- 172.21.15.100:0/469224045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7cc154c40 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7d1200640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4011560 tx=0x7fd7b4011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4004220 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7b4004380 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc154f20 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b4015870 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.962+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7cc06d010 con 0x7fd7cc1561f0 2024-01-20T08:14:29.967 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.963+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7cc04e970 con 0x7fd7cc1561f0 2024-01-20T08:14:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.964+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fd7b40159d0 con 0x7fd7cc1561f0 2024-01-20T08:14:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.965+0000 7fd7c9600640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 0x7fd7a406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.965+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5885+0+0 (secure 0 0 0) 0x7fd7b4089800 con 0x7fd7cc1561f0 2024-01-20T08:14:29.968 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.965+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 0x7fd7a406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:29.969 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.966+0000 7fd7d1c00640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 0x7fd7a406d3c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc036000 tx=0x7fd7bc02e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:29.972 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:29.970+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fd7b40546b0 con 0x7fd7cc1561f0 2024-01-20T08:14:30.214 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.210+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd7cc072040 con 0x7fd7cc1561f0 2024-01-20T08:14:30.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.757+0000 7fd7c9600640 1 -- 172.21.15.100:0/469224045 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs2", "yes_i_really_mean_it": true}]=0 v57) v1 ==== 105+0+0 (secure 0 0 0) 0x7fd7b40220b0 con 0x7fd7cc1561f0 2024-01-20T08:14:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 msgr2=0x7fd7a406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 0x7fd7a406d3c0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fd7bc036000 tx=0x7fd7bc02e000 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 msgr2=0x7fd7cc1e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fd7b4011560 tx=0x7fd7b4011a20 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 shutdown_connections 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fd7cc1e73c0 0x7fd7cc1ea190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd7cc1561f0 0x7fd7cc1e6e80 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fd7a406af00 0x7fd7a406d3c0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 --2- 172.21.15.100:0/469224045 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fd7ac003970 0x7fd7cc1edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 >> 172.21.15.100:0/469224045 conn(0x7fd7cc0a8a60 msgr2=0x7fd7cc152b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 shutdown_connections 2024-01-20T08:14:30.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.760+0000 7fd7d3000640 1 -- 172.21.15.100:0/469224045 wait complete. 2024-01-20T08:14:30.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_metadata cephfs2_metadata --yes-i-really-really-mean-it 2024-01-20T08:14:30.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.986+0000 7f1d19200640 1 Processor -- start 2024-01-20T08:14:30.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.986+0000 7f1d19200640 1 -- start start 2024-01-20T08:14:30.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.987+0000 7f1d19200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f1d1414c5a0 0x7f1d14153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:30.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.987+0000 7f1d19200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f1d1406d570 0x7f1d1406d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.987+0000 7f1d19200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d1406d0e0 con 0x7f1d1406bdb0 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.987+0000 7f1d19200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d14153560 con 0x7f1d1414c5a0 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.987+0000 7f1d19200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d140aaf10 con 0x7f1d1406d570 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d09200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f1d1406bdb0 0x7f1d140c1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44368/0 (socket says 172.21.15.100:44368) 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d09200640 1 -- 172.21.15.100:0/3929795174 learned_addr learned my addr 172.21.15.100:0/3929795174 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:30.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11e00640 1 --2- 172.21.15.100:0/3929795174 >> v2:172.21.15.100:3300/0 conn(0x7f1d1414c5a0 0x7f1d14153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d12800640 1 --2- 172.21.15.100:0/3929795174 >> v2:172.21.15.110:3300/0 conn(0x7f1d1406d570 0x7f1d1406d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11400640 1 -- 172.21.15.100:0/3929795174 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2248502211 0 0) 0x7f1d1406d0e0 con 0x7f1d1406bdb0 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11400640 1 -- 172.21.15.100:0/3929795174 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cf4003520 con 0x7f1d1406bdb0 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11e00640 1 -- 172.21.15.100:0/3929795174 >> v2:172.21.15.110:3300/0 conn(0x7f1d1406d570 msgr2=0x7f1d1406d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11e00640 1 --2- 172.21.15.100:0/3929795174 >> v2:172.21.15.110:3300/0 conn(0x7f1d1406d570 0x7f1d1406d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11e00640 1 -- 172.21.15.100:0/3929795174 >> v1:172.21.15.100:6789/0 conn(0x7f1d1406bdb0 legacy=0x7f1d140c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.988+0000 7f1d11e00640 1 -- 172.21.15.100:0/3929795174 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1414c980 con 0x7f1d1414c5a0 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.989+0000 7f1d11e00640 1 --2- 172.21.15.100:0/3929795174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1414c5a0 0x7f1d14153020 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1d140729f0 tx=0x7f1d0402bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9cd362af82dec6 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d11400640 1 -- 172.21.15.100:0/3929795174 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d0402cb60 con 0x7f1d1414c5a0 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d11400640 1 -- 172.21.15.100:0/3929795174 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d0402ccc0 con 0x7f1d1414c5a0 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d11400640 1 -- 172.21.15.100:0/3929795174 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04034660 con 0x7f1d1414c5a0 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 -- 172.21.15.100:0/3929795174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1414c5a0 msgr2=0x7f1d14153020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 --2- 172.21.15.100:0/3929795174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1414c5a0 0x7f1d14153020 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f1d140729f0 tx=0x7f1d0402bdb0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 -- 172.21.15.100:0/3929795174 shutdown_connections 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 --2- 172.21.15.100:0/3929795174 >> v2:172.21.15.110:3300/0 conn(0x7f1d1406d570 0x7f1d1406d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 --2- 172.21.15.100:0/3929795174 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1414c5a0 0x7f1d14153020 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 -- 172.21.15.100:0/3929795174 >> 172.21.15.100:0/3929795174 conn(0x7f1d140c2b00 msgr2=0x7f1d140c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:30.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 -- 172.21.15.100:0/3929795174 shutdown_connections 2024-01-20T08:14:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.990+0000 7f1d19200640 1 -- 172.21.15.100:0/3929795174 wait complete. 2024-01-20T08:14:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.992+0000 7f1d19200640 1 Processor -- start 2024-01-20T08:14:30.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.992+0000 7f1d19200640 1 -- start start 2024-01-20T08:14:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d1406d570 0x7f1d141ed930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d1414c5a0 0x7f1d14150c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:30.997 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d140716e0 con 0x7f1d1406bdb0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14070df0 con 0x7f1d1414c5a0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d19200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d14070b10 con 0x7f1d1406d570 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d11e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55694/0 (socket says 172.21.15.100:55694) 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.993+0000 7f1d11e00640 1 -- 172.21.15.100:0/2837941324 learned_addr learned my addr 172.21.15.100:0/2837941324 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 -- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d1406d570 msgr2=0x7f1d141ed930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d1406d570 0x7f1d141ed930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 -- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d1414c5a0 msgr2=0x7f1d14150c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d1414c5a0 0x7f1d14150c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 -- 172.21.15.100:0/2837941324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d04009a70 con 0x7f1d1406bdb0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d11e00640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1d04037040 tx=0x7f1d04004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04040650 con 0x7f1d1406bdb0 2024-01-20T08:14:30.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d040407f0 con 0x7f1d1406bdb0 2024-01-20T08:14:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d141ee170 con 0x7f1d1406bdb0 2024-01-20T08:14:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04040ba0 con 0x7f1d1406bdb0 2024-01-20T08:14:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.994+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d141ede70 con 0x7f1d1406bdb0 2024-01-20T08:14:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.996+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d14071850 con 0x7f1d1406bdb0 2024-01-20T08:14:30.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.997+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f1d04040d00 con 0x7f1d1406bdb0 2024-01-20T08:14:31.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.997+0000 7f1d0aa00640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 0x7f1cec06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.998+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5885+0+0 (secure 0 0 0) 0x7f1d040ac590 con 0x7f1d1406bdb0 2024-01-20T08:14:31.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.998+0000 7f1d09200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 0x7f1cec06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:30.998+0000 7f1d09200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 0x7f1cec06d390 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc0078f0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:31.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.002+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f1d040773a0 con 0x7f1d1406bdb0 2024-01-20T08:14:31.191 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.188+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d14074450 con 0x7f1d1406bdb0 2024-01-20T08:14:31.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.760+0000 7f1d0aa00640 1 -- 172.21.15.100:0/2837941324 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_metadata", "pool2": "cephfs2_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_metadata' removed v83) v1 ==== 184+0+0 (secure 0 0 0) 0x7f1d0407a9c0 con 0x7f1d1406bdb0 2024-01-20T08:14:31.764 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_metadata' removed 2024-01-20T08:14:31.767 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.764+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 msgr2=0x7f1cec06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.764+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 0x7f1cec06d390 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc000f60 tx=0x7f1cfc0078f0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.764+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 msgr2=0x7f1d14071b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.764+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f1d04037040 tx=0x7f1d04004a40 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 shutdown_connections 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f1d1414c5a0 0x7f1d14150c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f1cec06aed0 0x7f1cec06d390 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f1d1406d570 0x7f1d141ed930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 --2- 172.21.15.100:0/2837941324 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1406bdb0 0x7f1d14071b70 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.768 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.765+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 >> 172.21.15.100:0/2837941324 conn(0x7f1d140c2b00 msgr2=0x7f1d14148aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:31.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.766+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 shutdown_connections 2024-01-20T08:14:31.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.767+0000 7f1d19200640 1 -- 172.21.15.100:0/2837941324 wait complete. 2024-01-20T08:14:31.795 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs2_data cephfs2_data --yes-i-really-really-mean-it 2024-01-20T08:14:31.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.979+0000 7f5409c00640 1 Processor -- start 2024-01-20T08:14:31.982 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.979+0000 7f5409c00640 1 -- start start 2024-01-20T08:14:31.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.980+0000 7f5409c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.980+0000 7f5409c00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 0x7f54040c35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.980+0000 7f5409c00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5404070e00 con 0x7f540406ec40 2024-01-20T08:14:31.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.980+0000 7f5409c00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540406fd40 con 0x7f54040c5e00 2024-01-20T08:14:31.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.980+0000 7f5409c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54040add30 con 0x7f540414ff90 2024-01-20T08:14:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 0x7f54040c35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:48066/0 (socket says 172.21.15.100:48066) 2024-01-20T08:14:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 0x7f54040c35f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:54994/0 (socket says 172.21.15.100:54994) 2024-01-20T08:14:31.984 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 -- 172.21.15.100:0/1849950853 learned_addr learned my addr 172.21.15.100:0/1849950853 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 -- 172.21.15.100:0/1849950853 >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 msgr2=0x7f54040c35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 --2- 172.21.15.100:0/1849950853 >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 0x7f54040c35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.981+0000 7f5402a00640 1 -- 172.21.15.100:0/1849950853 >> v1:172.21.15.110:6789/0 conn(0x7f540406ec40 legacy=0x7f5404155c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.985 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.982+0000 7f5402a00640 1 -- 172.21.15.100:0/1849950853 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5404150370 con 0x7f540414ff90 2024-01-20T08:14:31.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.983+0000 7f5402a00640 1 --2- 172.21.15.100:0/1849950853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=71cabb91a2976986 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:31.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.983+0000 7f5401600640 1 -- 172.21.15.100:0/1849950853 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f40317c0 con 0x7f540414ff90 2024-01-20T08:14:31.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.983+0000 7f5401600640 1 -- 172.21.15.100:0/1849950853 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4031920 con 0x7f540414ff90 2024-01-20T08:14:31.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.983+0000 7f5401600640 1 -- 172.21.15.100:0/1849950853 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4031cb0 con 0x7f540414ff90 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 -- 172.21.15.100:0/1849950853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 msgr2=0x7f54040c4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 --2- 172.21.15.100:0/1849950853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53f4009870 tx=0x7f53f402b860 comp rx=0 tx=0).stop 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 -- 172.21.15.100:0/1849950853 shutdown_connections 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 --2- 172.21.15.100:0/1849950853 >> v2:172.21.15.110:3300/0 conn(0x7f54040c5e00 0x7f54040c35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 --2- 172.21.15.100:0/1849950853 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f540414ff90 0x7f54040c4430 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.987 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 -- 172.21.15.100:0/1849950853 >> 172.21.15.100:0/1849950853 conn(0x7f54040a9cb0 msgr2=0x7f54040aa0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 -- 172.21.15.100:0/1849950853 shutdown_connections 2024-01-20T08:14:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.984+0000 7f5409c00640 1 -- 172.21.15.100:0/1849950853 wait complete. 2024-01-20T08:14:31.988 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.986+0000 7f5409c00640 1 Processor -- start 2024-01-20T08:14:31.989 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.986+0000 7f5409c00640 1 -- start start 2024-01-20T08:14:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54040c5e00 0x7f540414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540414ff90 0x7f5404152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54041eb9d0 con 0x7f540406ec40 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54040bd0c0 con 0x7f540414ff90 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5409c00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54040bd360 con 0x7f54040c5e00 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55710/0 (socket says 172.21.15.100:55710) 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 -- 172.21.15.100:0/3801020995 learned_addr learned my addr 172.21.15.100:0/3801020995 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402000640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54040c5e00 0x7f540414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 -- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54040c5e00 msgr2=0x7f540414d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54040c5e00 0x7f540414d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 -- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540414ff90 msgr2=0x7f5404152d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:31.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540414ff90 0x7f5404152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:31.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.987+0000 7f5402a00640 1 -- 172.21.15.100:0/3801020995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f40094d0 con 0x7f540406ec40 2024-01-20T08:14:31.992 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f5402a00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f53f402b8a0 tx=0x7f53f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4032860 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53f4032a00 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53f4032db0 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54041eb380 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.988+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54041532b0 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.989+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54040ae0d0 con 0x7f540406ec40 2024-01-20T08:14:31.993 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.990+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f53f404e450 con 0x7f540406ec40 2024-01-20T08:14:31.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.991+0000 7f53faa00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 0x7f53dc06d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:31.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.991+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 5445+0+0 (secure 0 0 0) 0x7f53f40ab590 con 0x7f540406ec40 2024-01-20T08:14:31.994 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.991+0000 7f5402000640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 0x7f53dc06d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:31.995 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.992+0000 7f5402000640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 0x7f53dc06d410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f540414d900 tx=0x7f53ec008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:31.998 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:31.995+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f53f40766f0 con 0x7f540406ec40 2024-01-20T08:14:32.193 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.190+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f540406b3f0 con 0x7f540406ec40 2024-01-20T08:14:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.770+0000 7f53faa00640 1 -- 172.21.15.100:0/3801020995 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs2_data", "pool2": "cephfs2_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs2_data' removed v84) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53f4079d10 con 0x7f540406ec40 2024-01-20T08:14:32.774 INFO:teuthology.orchestra.run.smithi100.stderr:pool 'cephfs2_data' removed 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 msgr2=0x7f53dc06d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 0x7f53dc06d410 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f540414d900 tx=0x7f53ec008040 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 msgr2=0x7f54041ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f53f402b8a0 tx=0x7f53f40046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 shutdown_connections 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f540414ff90 0x7f5404152d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f53dc06af50 0x7f53dc06d410 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f54040c5e00 0x7f540414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 --2- 172.21.15.100:0/3801020995 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f540406ec40 0x7f54041ebe60 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:32.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.775+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 >> 172.21.15.100:0/3801020995 conn(0x7f54040a9cb0 msgr2=0x7f54040ab490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.777+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 shutdown_connections 2024-01-20T08:14:32.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:32.777+0000 7f5409c00640 1 -- 172.21.15.100:0/3801020995 wait complete. 2024-01-20T08:14:32.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-01-20T08:14:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.002+0000 7f0d10800640 1 Processor -- start 2024-01-20T08:14:33.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.002+0000 7f0d10800640 1 -- start start 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0814fdb0 0x7f0d080c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d080c1d90 0x7f0d08152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 0x7f0d08153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080a9ce0 con 0x7f0d080c1d90 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d080a93b0 con 0x7f0d080c3460 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d10800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d08152790 con 0x7f0d0814fdb0 2024-01-20T08:14:33.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d0d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d080c1d90 0x7f0d08152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d0d400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f0d080c1d90 0x7f0d08152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55726/0 (socket says 172.21.15.100:55726) 2024-01-20T08:14:33.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.004+0000 7f0d0d400640 1 -- 172.21.15.100:0/1956243941 learned_addr learned my addr 172.21.15.100:0/1956243941 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0d400640 1 -- 172.21.15.100:0/1956243941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0814fdb0 msgr2=0x7f0d080c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0e800640 1 --2- 172.21.15.100:0/1956243941 >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 0x7f0d08153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0de00640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0814fdb0 0x7f0d080c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0d400640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0814fdb0 0x7f0d080c1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0d400640 1 -- 172.21.15.100:0/1956243941 >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 msgr2=0x7f0d08153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0d400640 1 --2- 172.21.15.100:0/1956243941 >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 0x7f0d08153120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0d400640 1 -- 172.21.15.100:0/1956243941 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d08150190 con 0x7f0d080c1d90 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.005+0000 7f0d0e800640 1 --2- 172.21.15.100:0/1956243941 >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 0x7f0d08153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.006+0000 7f0d0d400640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d080c1d90 0x7f0d08152be0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0d08074670 tx=0x7f0cf002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be654e50e05ee6e7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.006+0000 7f0d0ca00640 1 -- 172.21.15.100:0/1956243941 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0031870 con 0x7f0d080c1d90 2024-01-20T08:14:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.006+0000 7f0d0ca00640 1 -- 172.21.15.100:0/1956243941 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf00319d0 con 0x7f0d080c1d90 2024-01-20T08:14:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.006+0000 7f0d0ca00640 1 -- 172.21.15.100:0/1956243941 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0031d60 con 0x7f0d080c1d90 2024-01-20T08:14:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 -- 172.21.15.100:0/1956243941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d080c1d90 msgr2=0x7f0d08152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d080c1d90 0x7f0d08152be0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f0d08074670 tx=0x7f0cf002b910 comp rx=0 tx=0).stop 2024-01-20T08:14:33.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 -- 172.21.15.100:0/1956243941 shutdown_connections 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 --2- 172.21.15.100:0/1956243941 >> v2:172.21.15.110:3300/0 conn(0x7f0d080c3460 0x7f0d08153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d080c1d90 0x7f0d08152be0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 --2- 172.21.15.100:0/1956243941 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d0814fdb0 0x7f0d080c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 -- 172.21.15.100:0/1956243941 >> 172.21.15.100:0/1956243941 conn(0x7f0d080c2940 msgr2=0x7f0d080c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 -- 172.21.15.100:0/1956243941 shutdown_connections 2024-01-20T08:14:33.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.007+0000 7f0d10800640 1 -- 172.21.15.100:0/1956243941 wait complete. 2024-01-20T08:14:33.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.009+0000 7f0d10800640 1 Processor -- start 2024-01-20T08:14:33.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.009+0000 7f0d10800640 1 -- start start 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 0x7f0d08140de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d080c3460 0x7f0d0806d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081ee1a0 con 0x7f0d0814fdb0 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d0814af50 con 0x7f0d080c1d90 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.010+0000 7f0d10800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d081ed620 con 0x7f0d080c3460 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55734/0 (socket says 172.21.15.100:55734) 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 -- 172.21.15.100:0/1767791766 learned_addr learned my addr 172.21.15.100:0/1767791766 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:33.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0de00640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 0x7f0d08140de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0d400640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d080c3460 0x7f0d0806d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 -- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d080c3460 msgr2=0x7f0d0806d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d080c3460 0x7f0d0806d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 -- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 msgr2=0x7f0d08140de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 0x7f0d08140de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 -- 172.21.15.100:0/1767791766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00094d0 con 0x7f0d0814fdb0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0de00640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 0x7f0d08140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.011+0000 7f0d0e800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c7f0 tx=0x7f0cf800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.012+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8007820 con 0x7f0d0814fdb0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.012+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cf8007980 con 0x7f0d0814fdb0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.012+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cf8007d30 con 0x7f0d0814fdb0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.012+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d081ed900 con 0x7f0d0814fdb0 2024-01-20T08:14:33.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.012+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d081edec0 con 0x7f0d0814fdb0 2024-01-20T08:14:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.013+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d0804e970 con 0x7f0d0814fdb0 2024-01-20T08:14:33.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.014+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f0cf80113f0 con 0x7f0d0814fdb0 2024-01-20T08:14:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.015+0000 7f0d06000640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 0x7f0ce006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.015+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f0cf8089660 con 0x7f0d0814fdb0 2024-01-20T08:14:33.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.016+0000 7f0d0de00640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 0x7f0ce006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.016+0000 7f0d0de00640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 0x7f0ce006d390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d080bf2e0 tx=0x7f0d00007420 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.020+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f0cf8054920 con 0x7f0d0814fdb0 2024-01-20T08:14:33.215 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.212+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f0d080c6ce0 con 0x7f0d0814fdb0 2024-01-20T08:14:33.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.218+0000 7f0d06000640 1 -- 172.21.15.100:0/1767791766 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0cf8057f40 con 0x7f0d0814fdb0 2024-01-20T08:14:33.224 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 msgr2=0x7f0ce006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 0x7f0ce006d390 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0d080bf2e0 tx=0x7f0d00007420 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 msgr2=0x7f0d0806ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f0cf800c7f0 tx=0x7f0cf800ccb0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 shutdown_connections 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d0814fdb0 0x7f0d0806ddc0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f0ce006aed0 0x7f0ce006d390 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f0d080c3460 0x7f0d0806d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 --2- 172.21.15.100:0/1767791766 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f0d080c1d90 0x7f0d08140de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.221+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 >> 172.21.15.100:0/1767791766 conn(0x7f0d080c2940 msgr2=0x7f0d081416a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.222+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 shutdown_connections 2024-01-20T08:14:33.225 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.222+0000 7f0d10800640 1 -- 172.21.15.100:0/1767791766 wait complete. 2024-01-20T08:14:33.243 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap' 2024-01-20T08:14:33.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.451+0000 7f43eb200640 1 Processor -- start 2024-01-20T08:14:33.454 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.451+0000 7f43eb200640 1 -- start start 2024-01-20T08:14:33.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43eb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e4152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43eb200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43e4153120 0x7f43e415cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43eb200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e4150190 con 0x7f43e414fdb0 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43eb200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e40a9ce0 con 0x7f43e4153120 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43eb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40a93b0 con 0x7f43e40c3460 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43e9200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43e4153120 0x7f43e415cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43e9200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f43e4153120 0x7f43e415cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55736/0 (socket says 172.21.15.100:55736) 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.453+0000 7f43e9200640 1 -- 172.21.15.100:0/3200425535 learned_addr learned my addr 172.21.15.100:0/3200425535 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.454+0000 7f43db200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e4152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.454+0000 7f43e9200640 1 -- 172.21.15.100:0/3200425535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 msgr2=0x7f43e4152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.454+0000 7f43e9200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e4152be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.454+0000 7f43e9200640 1 -- 172.21.15.100:0/3200425535 >> v1:172.21.15.110:6789/0 conn(0x7f43e414fdb0 legacy=0x7f43e40c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:33.457 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.454+0000 7f43e9200640 1 -- 172.21.15.100:0/3200425535 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e41535b0 con 0x7f43e4153120 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.455+0000 7f43e9200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e415cfc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182fa56a5f6baabf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.455+0000 7f43e3400640 1 -- 172.21.15.100:0/3200425535 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc031640 con 0x7f43e4153120 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.455+0000 7f43e3400640 1 -- 172.21.15.100:0/3200425535 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc0317a0 con 0x7f43e4153120 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.455+0000 7f43e3400640 1 -- 172.21.15.100:0/3200425535 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc031b30 con 0x7f43e4153120 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 -- 172.21.15.100:0/3200425535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 msgr2=0x7f43e415cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e415cfc0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f43dc009870 tx=0x7f43dc02b8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 -- 172.21.15.100:0/3200425535 shutdown_connections 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e415cfc0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 --2- 172.21.15.100:0/3200425535 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e4152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 -- 172.21.15.100:0/3200425535 >> 172.21.15.100:0/3200425535 conn(0x7f43e40c2940 msgr2=0x7f43e40c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 -- 172.21.15.100:0/3200425535 shutdown_connections 2024-01-20T08:14:33.459 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.456+0000 7f43eb200640 1 -- 172.21.15.100:0/3200425535 wait complete. 2024-01-20T08:14:33.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.457+0000 7f43eb200640 1 Processor -- start 2024-01-20T08:14:33.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 -- start start 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e40711e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43e414fdb0 0x7f43e40bf270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e41eb350 con 0x7f43e4153120 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e4072590 con 0x7f43e414fdb0 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.458+0000 7f43eb200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e40718c0 con 0x7f43e40c3460 2024-01-20T08:14:33.462 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55744/0 (socket says 172.21.15.100:55744) 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 -- 172.21.15.100:0/2053879308 learned_addr learned my addr 172.21.15.100:0/2053879308 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 -- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 msgr2=0x7f43e40711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e40711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 -- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43e414fdb0 msgr2=0x7f43e40bf270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43e414fdb0 0x7f43e40bf270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 -- 172.21.15.100:0/2053879308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43dc0094d0 con 0x7f43e4153120 2024-01-20T08:14:33.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.459+0000 7f43e9200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc02b930 tx=0x7f43dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.460+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc03ac60 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.460+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43dc03ade0 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.460+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43dc044630 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.460+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e4071ba0 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.460+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e41eda70 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.461+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e40720c0 con 0x7f43e4153120 2024-01-20T08:14:33.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.462+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f43dc02f050 con 0x7f43e4153120 2024-01-20T08:14:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.463+0000 7f43e0c00640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 0x7f43bc06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.463+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f43dc0ab430 con 0x7f43e4153120 2024-01-20T08:14:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.463+0000 7f43e3e00640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 0x7f43bc06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:33.466 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.464+0000 7f43e3e00640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 0x7f43bc06d390 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f43e40c33e0 tx=0x7f43d4007d30 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:33.470 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.467+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f43e40720c0 con 0x7f43e4153120 2024-01-20T08:14:33.738 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.735+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]} v 0) v1 -- 0x7f43e40720c0 con 0x7f43e4153120 2024-01-20T08:14:33.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.774+0000 7f43e0c00640 1 -- 172.21.15.100:0/2053879308 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_multifs_auth.TestMDSCaps.test_r_with_fsname_and_no_path_in_cap"]}]=0 v263) v1 ==== 159+0+0 (secure 0 0 0) 0x7f43e40720c0 con 0x7f43e4153120 2024-01-20T08:14:33.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.776+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 msgr2=0x7f43bc06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.776+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 0x7f43bc06d390 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f43e40c33e0 tx=0x7f43d4007d30 comp rx=0 tx=0).stop 2024-01-20T08:14:33.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.776+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 msgr2=0x7f43e41edf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:33.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.776+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f43dc02b930 tx=0x7f43dc0046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 shutdown_connections 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f43e4153120 0x7f43e41edf90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f43e414fdb0 0x7f43e40bf270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f43bc06aed0 0x7f43bc06d390 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 --2- 172.21.15.100:0/2053879308 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f43e40c3460 0x7f43e40711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:33.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 >> 172.21.15.100:0/2053879308 conn(0x7f43e40c2940 msgr2=0x7f43e414efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:33.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 shutdown_connections 2024-01-20T08:14:33.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:33.777+0000 7f43eb200640 1 -- 172.21.15.100:0/2053879308 wait complete. 2024-01-20T08:14:33.800 INFO:tasks.cephfs_test_runner:test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) ... ERROR 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-20T08:14:33.801 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:Ran 3 tests in 234.429s 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:====================================================================== 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:ERROR: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-01-20T08:14:33.802 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/test_multifs_auth.py", line 95, in test_r_with_fsname_and_no_path_in_cap 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: self.captesters[0].run_mds_cap_tests(PERM) 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/caps_helper.py", line 262, in run_mds_cap_tests 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: self.conduct_pos_test_for_read_caps() 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/caps_helper.py", line 274, in conduct_pos_test_for_read_caps 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: contents = self.mount.read_file(self.path, sudo_read) 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/mount.py", line 749, in read_file 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: return self.run_shell(args=args, omit_sudo=False).stdout.getvalue().strip() 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs/mount.py", line 784, in run_shell 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/remote.py", line 523, in run 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 455, in run 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: r.wait() 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 161, in wait 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi100 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec cat /home/ubuntu/cephtest/mnt.0/testdir/testfile)' 2024-01-20T08:14:33.803 INFO:tasks.cephfs_test_runner: 2024-01-20T08:14:33.804 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-20T08:14:33.998 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d0094e5e521b41b3a0c442752d7e9d09 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_cd45576300487d997e5a85abed65500b9f5d143b/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_a00c9940991c5e1e9ab595faa3f6e1281d8ae167/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps) 2024-01-20T08:14:34.000 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-01-20T08:14:34.009 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-01-20T08:14:34.029 INFO:tasks.kclient:Unmounting kernel clients... 2024-01-20T08:14:34.029 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2024-01-20T08:14:34.030 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:34.092 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053818,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249372k,nr_inodes=812343,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498748k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 2024-01-20T08:14:34.092 DEBUG:teuthology.orchestra.run.smithi110:> set -ex 2024-01-20T08:14:34.092 DEBUG:teuthology.orchestra.run.smithi110:> dd if=/proc/self/mounts of=/dev/stdout 2024-01-20T08:14:34.147 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4053843,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249392k,nr_inodes=812348,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498788k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 2024-01-20T08:14:34.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.147 DEBUG:teuthology.orchestra.run.smithi100:> ip netns list 2024-01-20T08:14:34.203 INFO:teuthology.orchestra.run.smithi100.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-01-20T08:14:34.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.204 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-01-20T08:14:34.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.299 DEBUG:teuthology.orchestra.run.smithi100:> sudo ip link delete ceph-brx 2024-01-20T08:14:34.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.439 DEBUG:teuthology.orchestra.run.smithi110:> ip netns list 2024-01-20T08:14:34.497 INFO:teuthology.orchestra.run.smithi110.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-01-20T08:14:34.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.498 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-01-20T08:14:34.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-01-20T08:14:34.594 DEBUG:teuthology.orchestra.run.smithi110:> sudo ip link delete ceph-brx 2024-01-20T08:14:34.708 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-01-20T08:14:34.716 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-01-20T08:14:34.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:14:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.933+0000 7fe988e00640 1 Processor -- start 2024-01-20T08:14:34.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.933+0000 7fe988e00640 1 -- start start 2024-01-20T08:14:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.934+0000 7fe988e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 0x7fe984071600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.934+0000 7fe988e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fe9840bfae0 0x7fe984151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.934+0000 7fe988e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9840c0fb0 con 0x7fe9841521e0 2024-01-20T08:14:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.934+0000 7fe988e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9840c04a0 con 0x7fe9840bfae0 2024-01-20T08:14:34.938 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.934+0000 7fe988e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406def0 con 0x7fe984071220 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe982800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fe9841521e0 0x7fe984157eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44372/0 (socket says 172.21.15.100:44372) 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe982800640 1 -- 172.21.15.100:0/2706272668 learned_addr learned my addr 172.21.15.100:0/2706272668 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe981e00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 0x7fe984071600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe97be00640 1 --2- 172.21.15.100:0/2706272668 >> v2:172.21.15.110:3300/0 conn(0x7fe9840bfae0 0x7fe984151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980709077 0 0) 0x7fe9840c0fb0 con 0x7fe9841521e0 2024-01-20T08:14:34.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.935+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe964003520 con 0x7fe9841521e0 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 53490076 0 0) 0x7fe964003520 con 0x7fe9841521e0 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 msgr2=0x7fe984071600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 0x7fe984071600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 >> v2:172.21.15.110:3300/0 conn(0x7fe9840bfae0 msgr2=0x7fe984151ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 --2- 172.21.15.100:0/2706272668 >> v2:172.21.15.110:3300/0 conn(0x7fe9840bfae0 0x7fe984151ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.942 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98406e1d0 con 0x7fe9841521e0 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fe97c0019f0 con 0x7fe9841521e0 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 >> v1:172.21.15.100:6789/0 conn(0x7fe9841521e0 legacy=0x7fe984157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe964003970 0x7fe964003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe964004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 0x7fe964005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840c04a0 con 0x7fe9640047c0 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98406def0 con 0x7fe964003970 2024-01-20T08:14:34.943 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96400ba00 con 0x7fe984071220 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.936+0000 7fe97be00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe964004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe981e00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe964003970 0x7fe964003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe97be00640 1 -- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 msgr2=0x7fe964005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe97be00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe984071220 0x7fe964005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe97be00640 1 -- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe964003970 msgr2=0x7fe964003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe97be00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe964003970 0x7fe964003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe97be00640 1 -- 172.21.15.100:0/2706272668 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe964003520 con 0x7fe9640047c0 2024-01-20T08:14:34.944 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.937+0000 7fe981e00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe964003970 0x7fe964003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe97be00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe964004c40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009ac0 tx=0x7fe9640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a011ed6171ac82f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c02c710 con 0x7fe9640047c0 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c02c870 con 0x7fe9640047c0 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe981400640 1 -- 172.21.15.100:0/2706272668 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c02cc00 con 0x7fe9640047c0 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe988e00640 1 -- 172.21.15.100:0/2706272668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 msgr2=0x7fe964004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe988e00640 1 --2- 172.21.15.100:0/2706272668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe964004c40 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7fe96c009ac0 tx=0x7fe9640057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.938+0000 7fe982800640 1 -- 172.21.15.100:0/2706272668 reap_dead start 2024-01-20T08:14:34.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.939+0000 7fe988e00640 1 -- 172.21.15.100:0/2706272668 shutdown_connections 2024-01-20T08:14:34.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.939+0000 7fe988e00640 1 -- 172.21.15.100:0/2706272668 >> 172.21.15.100:0/2706272668 conn(0x7fe98406a5e0 msgr2=0x7fe98406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:34.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.939+0000 7fe988e00640 1 -- 172.21.15.100:0/2706272668 shutdown_connections 2024-01-20T08:14:34.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.939+0000 7fe988e00640 1 -- 172.21.15.100:0/2706272668 wait complete. 2024-01-20T08:14:34.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.940+0000 7fe988e00640 1 Processor -- start 2024-01-20T08:14:34.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 -- start start 2024-01-20T08:14:34.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe98414c1b0 0x7fe9841492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe98414df70 0x7fe98414e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe98414ee70 con 0x7fe9640047c0 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840abd80 con 0x7fe98414c1b0 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.941+0000 7fe988e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9840ac300 con 0x7fe98414df70 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55758/0 (socket says 172.21.15.100:55758) 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 -- 172.21.15.100:0/1494002160 learned_addr learned my addr 172.21.15.100:0/1494002160 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 -- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe98414df70 msgr2=0x7fe98414e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:34.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe98414df70 0x7fe98414e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe97be00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe98414c1b0 0x7fe9841492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 -- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe98414c1b0 msgr2=0x7fe9841492a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe98414c1b0 0x7fe9841492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 -- 172.21.15.100:0/1494002160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9841eaca0 con 0x7fe9640047c0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.942+0000 7fe981e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe9740108b0 tx=0x7fe974010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.943+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97400eb60 con 0x7fe9640047c0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.943+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97400ecc0 con 0x7fe9640047c0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.943+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97401c400 con 0x7fe9640047c0 2024-01-20T08:14:34.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.943+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe984157b50 con 0x7fe9640047c0 2024-01-20T08:14:34.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.943+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9840abf90 con 0x7fe9640047c0 2024-01-20T08:14:34.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.944+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe98404e970 con 0x7fe9640047c0 2024-01-20T08:14:34.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.945+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fe97401c560 con 0x7fe9640047c0 2024-01-20T08:14:34.951 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.946+0000 7fe97a000640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 0x7fe95c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:34.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.946+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fe974089870 con 0x7fe9640047c0 2024-01-20T08:14:34.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.946+0000 7fe97be00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 0x7fe95c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:34.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.947+0000 7fe97be00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 0x7fe95c06d3c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:34.954 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:34.951+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fe974054a80 con 0x7fe9640047c0 2024-01-20T08:14:35.141 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.138+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe984158070 con 0x7fe95c06af00 2024-01-20T08:14:35.143 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.140+0000 7fe97a000640 1 -- 172.21.15.100:0/1494002160 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47952 (secure 0 0 0) 0x7fe984158070 con 0x7fe95c06af00 2024-01-20T08:14:35.144 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:35.144 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 msgr2=0x7fe95c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 0x7fe95c06d3c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fe96c036000 tx=0x7fe96c030000 comp rx=0 tx=0).stop 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 msgr2=0x7fe9841ea760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7fe9740108b0 tx=0x7fe974010d70 comp rx=0 tx=0).stop 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 shutdown_connections 2024-01-20T08:14:35.146 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fe95c06af00 0x7fe95c06d3c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fe98414df70 0x7fe98414e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fe98414c1b0 0x7fe9841492a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 --2- 172.21.15.100:0/1494002160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe9640047c0 0x7fe9841ea760 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 >> 172.21.15.100:0/1494002160 conn(0x7fe98406a5e0 msgr2=0x7fe98406d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 shutdown_connections 2024-01-20T08:14:35.147 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.143+0000 7fe988e00640 1 -- 172.21.15.100:0/1494002160 wait complete. 2024-01-20T08:14:35.164 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-01-20T08:14:33.975351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258616,"kb_used_data":9172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716104,"statfs":{"total":773094113280,"available":772829290496,"internally_reserved":0,"allocated":9392128,"data_stored":4840525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001284"},"pg_stats":[{"pgid":"1.0","version":"20'117","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-01-20T08:14:25.541341+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:14:25.541341+0000","last_peered":"2024-01-20T08:14:25.541341+0000","last_clean":"2024-01-20T08:14:25.541341+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:14:25.541341+0000","last_undegraded":"2024-01-20T08:14:25.541341+0000","last_fullsized":"2024-01-20T08:14:25.541341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1617920,"data_stored":1045629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.2410000000000001,"15min":1.244},"min":{"1min":0.63700000000000001,"5min":0.627,"15min":0.627},"max":{"1min":10.865,"5min":10.865,"15min":10.865},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1759999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4930000000000001,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.327}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.2729999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.577,"5min":11.805,"15min":11.805},"last":1.135}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3169999999999999,"15min":1.2549999999999999},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4059999999999999,"15min":1.4490000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5030000000000001,"5min":6.5030000000000001,"15min":6.5030000000000001},"last":1.2829999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4950000000000001,"15min":1.4610000000000001},"min":{"1min":0.79000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.503,"5min":11.972,"15min":11.972},"last":1.425},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.361,"15min":1.353},"min":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.1900000000000004,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":0.89100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.4990000000000001,"15min":1.5609999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.73,"15min":1.724},"min":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.502,"15min":1.5569999999999999},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":3.6960000000000002,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.625,"15min":1.609},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.1909999999999998,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.248}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.90700000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":1.089},{"interface":"front","average":{"1min":3.0259999999999998,"5min":1.9370000000000001,"15min":1.823},"min":{"1min":1.044,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":28.498000000000001,"5min":28.498000000000001,"15min":28.498000000000001},"last":1.492}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0940000000000001,"15min":1.1950000000000001},"min":{"1min":0.628,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4970000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.698,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.94299999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2829999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":2.008,"15min":2.008},"last":1.216},{"interface":"front","average":{"1min":1.278,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.754,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":2.004,"15min":2.004},"last":0.82299999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.163,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.532,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.94399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8899999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.085}]},{"osd":3,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3460000000000001,"15min":1.4179999999999999},"min":{"1min":0.83499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7010000000000001,"5min":2.222,"15min":2.222},"last":1.28},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.369,"15min":1.4410000000000001},"min":{"1min":0.98899999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8129999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.8320000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.476,"15min":1.573},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6419999999999999,"5min":2.915,"15min":2.915},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.554,"15min":1.6539999999999999},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.778,"5min":2.718,"15min":2.718},"last":1.401}]},{"osd":5,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.498,"15min":1.5589999999999999},"min":{"1min":1.0029999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6870000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.9370000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7529999999999999},"min":{"1min":0.91000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.845,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.4990000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.6499999999999999,"15min":1.73},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.847,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.554},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.673,"15min":1.7569999999999999},"min":{"1min":1.1639999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.1429999999999998,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":2.1070000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.409,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1419999999999999,"15min":1.133},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.569,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.995}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2010000000000001,"15min":1.226},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7390000000000001,"5min":1.806,"15min":1.806},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2150000000000001,"15min":1.2549999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5600000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0920000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.292,"15min":1.351},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.569,"5min":1.776,"15min":1.776},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5920000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.131}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.347,"15min":1.3859999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5549999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.423,"15min":1.4410000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8149999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.5940000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.472,"15min":1.516},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8460000000000001,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.51,"15min":1.556},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8340000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.552,"15min":1.5680000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8819999999999999,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.645,"15min":1.72},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.911,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.5449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":466721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.147,"15min":1.2290000000000001},"min":{"1min":0.59499999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.573,"5min":3.165,"15min":3.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0329999999999999},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.619,"5min":1.71,"15min":1.71},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7709999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.042},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.224,"15min":1.3600000000000001},"min":{"1min":0.83499999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.139,"15min":1.085},"min":{"1min":0.78000000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.48,"5min":1.667,"15min":1.667},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.256,"15min":1.264},"min":{"1min":0.93200000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.643,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2430000000000001,"15min":1.2729999999999999},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.484,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.26,"5min":1.335,"15min":1.391},"min":{"1min":0.85299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.649,"5min":2.613,"15min":2.613},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.3109999999999999,"15min":1.3320000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6559999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.47},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.996}]},{"osd":6,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4139999999999999,"15min":1.409},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7370000000000001,"5min":1.919,"15min":1.919},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.478,"15min":1.5049999999999999},"min":{"1min":0.73599999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.752,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.389}]},{"osd":7,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.5,"15min":1.548},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.736,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5860000000000001},"min":{"1min":0.76500000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.825,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.1180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1028096,"data_stored":460448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.79600000000000004,"15min":0.754},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.83899999999999997},"min":{"1min":0.48499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.752}]},{"osd":1,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3169999999999999,"5min":1.448,"15min":1.448},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.93400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.506,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.089,"15min":1.097},"min":{"1min":0.54300000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.7430000000000001,"5min":3.02,"15min":3.02},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2250000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.21,"15min":1.24},"min":{"1min":0.85499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.603,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.621,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.9379999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.294,"15min":1.329},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":2.153,"15min":2.153},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.548,"5min":2.359,"15min":2.359},"last":1.532}]},{"osd":6,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8069999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.343,"15min":1.339},"min":{"1min":0.86099999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.696,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.6839999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3979999999999999,"15min":1.419},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8280000000000001,"5min":2.286,"15min":2.286},"last":1.637},{"interface":"front","average":{"1min":1.379,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.98599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.679,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.583}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84799999999999998,"15min":0.91700000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3049999999999999,"5min":1.712,"15min":1.712},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.879,"15min":0.94699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.601,"15min":1.601},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97399999999999998,"15min":1.0600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4450000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.248},{"interface":"front","average":{"1min":0.90200000000000002,"5min":1.0189999999999999,"15min":1.081},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.091}]},{"osd":3,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.91300000000000003,"15min":1.056},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.131,"15min":1.2509999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.522,"5min":2.177,"15min":2.177},"last":1.3069999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.3819999999999999,"15min":1.4950000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.696,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4490000000000001},"min":{"1min":0.69799999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.752,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1990000000000001,"15min":1.292},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.327},{"interface":"front","average":{"1min":1.208,"5min":1.3799999999999999,"15min":1.514},"min":{"1min":0.79600000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.538,"5min":2.29,"15min":2.29},"last":1.359}]},{"osd":6,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.429,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.6519999999999999,"5min":2.734,"15min":2.734},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.371,"15min":1.5029999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.762,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.4570000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4470000000000001,"15min":1.581},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.417,"15min":1.585},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8360000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.2010000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93999999999999995,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.101},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.546,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.478}]},{"osd":2,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.542,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.86799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3899999999999999,"5min":1.444,"15min":1.444},"last":1.248}]},{"osd":3,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":0.96099999999999997},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":1.885,"15min":1.885},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94399999999999995,"15min":0.98599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.5980000000000001,"5min":1.758,"15min":1.758},"last":1.3759999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.75800000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.631,"5min":1.905,"15min":1.905},"last":1.222},{"interface":"front","average":{"1min":1.194,"5min":1.248,"15min":1.25},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5449999999999999,"5min":2.069,"15min":2.069},"last":1.4219999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.508,"5min":2.052,"15min":2.052},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.266,"15min":1.272},"min":{"1min":0.79300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.613,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2989999999999999,"15min":1.3129999999999999},"min":{"1min":0.74099999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6279999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.3240000000000001,"15min":1.379},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.784,"5min":1.97,"15min":1.97},"last":1.702}]},{"osd":7,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.349},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2,"15min":2},"last":1.605},{"interface":"front","average":{"1min":1.25,"5min":1.341,"15min":1.3819999999999999},"min":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6759999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1613824,"data_stored":1046099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4470000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2689999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.86699999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.663,"5min":1.722,"15min":1.722},"last":1.329},{"interface":"front","average":{"1min":1.018,"5min":0.995,"15min":0.96299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4079999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.4099999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4119999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":1.8149999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.863}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1299999999999999,"15min":1.099},"min":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.611,"5min":1.968,"15min":1.968},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.139,"15min":1.123},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.71799999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.617,"5min":1.865,"15min":1.865},"last":1.514},{"interface":"front","average":{"1min":1.304,"5min":1.238,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8839999999999999,"5min":2.427,"15min":2.427},"last":2.052}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.323,"15min":1.327},"min":{"1min":0.84799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.802,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.952},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2629999999999999,"15min":1.278},"min":{"1min":0.67200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.175}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.349,"15min":1.375},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9830000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.669},{"interface":"front","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.776}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:14:35.165 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:14:35.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.360+0000 7f4d1ea00640 1 Processor -- start 2024-01-20T08:14:35.362 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.360+0000 7f4d1ea00640 1 -- start start 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d1ea00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d180abfd0 0x7f4d18070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d1ea00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d180c1670 con 0x7f4d18151f60 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d1ea00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d180c0d40 con 0x7f4d18147f20 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d1ea00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180c2210 con 0x7f4d180abfd0 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d17400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4d18151f60 0x7f4d180c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44388/0 (socket says 172.21.15.100:44388) 2024-01-20T08:14:35.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d17400640 1 -- 172.21.15.100:0/4187974267 learned_addr learned my addr 172.21.15.100:0/4187974267 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d1ca00640 1 --2- 172.21.15.100:0/4187974267 >> v2:172.21.15.110:3300/0 conn(0x7f4d180abfd0 0x7f4d18070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1813737805 0 0) 0x7f4d180c1670 con 0x7f4d18151f60 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.361+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf8003520 con 0x7f4d18151f60 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1910346483 0 0) 0x7f4cf8003520 con 0x7f4d18151f60 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 >> v2:172.21.15.110:3300/0 conn(0x7f4d180abfd0 msgr2=0x7f4d18070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 --2- 172.21.15.100:0/4187974267 >> v2:172.21.15.110:3300/0 conn(0x7f4d180abfd0 0x7f4d18070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 >> v1:172.21.15.110:6789/0 conn(0x7f4d18147f20 legacy=0x7f4d180c1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180c1020 con 0x7f4d18151f60 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f4d00001670 con 0x7f4d18151f60 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 >> v1:172.21.15.100:6789/0 conn(0x7f4d18151f60 legacy=0x7f4d180c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf8003970 0x7f4cf8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf80047c0 0x7f4cf8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4cf800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180c2210 con 0x7f4cf8005180 2024-01-20T08:14:35.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf800c020 con 0x7f4cf80047c0 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf800c1e0 con 0x7f4cf8003970 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.362+0000 7f4d1ca00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4cf800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d17400640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf80047c0 0x7f4cf8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d17e00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf8003970 0x7f4cf8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d1ca00640 1 -- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf8003970 msgr2=0x7f4cf8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d1ca00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf8003970 0x7f4cf8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d1ca00640 1 -- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf80047c0 msgr2=0x7f4cf8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d1ca00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4cf80047c0 0x7f4cf8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d1ca00640 1 -- 172.21.15.100:0/4187974267 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf8003520 con 0x7f4cf8005180 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.363+0000 7f4d17e00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4cf8003970 0x7f4cf8003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.364+0000 7f4d1ca00640 1 -- 172.21.15.100:0/4187974267 reap_dead start 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.364+0000 7f4d1ca00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4cf800b980 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009ac0 tx=0x7f4cf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a4c44c3017b4cc server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.364+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d10004020 con 0x7f4cf8005180 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.364+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d10004180 con 0x7f4cf8005180 2024-01-20T08:14:35.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.364+0000 7f4d16a00640 1 -- 172.21.15.100:0/4187974267 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1002c710 con 0x7f4cf8005180 2024-01-20T08:14:35.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 -- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 msgr2=0x7f4cf800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4cf800b980 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f4d10009ac0 tx=0x7f4cf80057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 -- 172.21.15.100:0/4187974267 shutdown_connections 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/4187974267 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4cf800b980 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 -- 172.21.15.100:0/4187974267 >> 172.21.15.100:0/4187974267 conn(0x7f4d1806a5e0 msgr2=0x7f4d1806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 -- 172.21.15.100:0/4187974267 shutdown_connections 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.365+0000 7f4d1ea00640 1 -- 172.21.15.100:0/4187974267 wait complete. 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.366+0000 7f4d1ea00640 1 Processor -- start 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.367+0000 7f4d1ea00640 1 -- start start 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.367+0000 7f4d1ea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.367+0000 7f4d1ea00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d181609d0 0x7f4d181ed5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.367+0000 7f4d1ea00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d18153a40 0x7f4d180bfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.367+0000 7f4d1ea00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180bf920 con 0x7f4cf8005180 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d1ea00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d18160e50 con 0x7f4d181609d0 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d1ea00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180bf5d0 con 0x7f4d18153a40 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55772/0 (socket says 172.21.15.100:55772) 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 -- 172.21.15.100:0/2205386860 learned_addr learned my addr 172.21.15.100:0/2205386860 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17400640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d181609d0 0x7f4d181ed5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 -- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d18153a40 msgr2=0x7f4d180bfd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d18153a40 0x7f4d180bfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 -- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d181609d0 msgr2=0x7f4d181ed5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d181609d0 0x7f4d181ed5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 -- 172.21.15.100:0/2205386860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d181551b0 con 0x7f4cf8005180 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.368+0000 7f4d17e00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800dae0 tx=0x7f4d08002070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.369+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08003da0 con 0x7f4cf8005180 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.369+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800b710 con 0x7f4cf8005180 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.369+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800bac0 con 0x7f4cf8005180 2024-01-20T08:14:35.375 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.369+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1815f8f0 con 0x7f4cf8005180 2024-01-20T08:14:35.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.369+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1815feb0 con 0x7f4cf8005180 2024-01-20T08:14:35.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.370+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d18160070 con 0x7f4cf8005180 2024-01-20T08:14:35.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.371+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4d0800bc20 con 0x7f4cf8005180 2024-01-20T08:14:35.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.371+0000 7f4d0fe00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 0x7f4cf006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.372+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4d080895a0 con 0x7f4cf8005180 2024-01-20T08:14:35.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.372+0000 7f4d17400640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 0x7f4cf006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.372+0000 7f4d17400640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 0x7f4cf006d3c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001200 tx=0x7f4d00001110 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.376+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4d08054710 con 0x7f4cf8005180 2024-01-20T08:14:35.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.563+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d1806e860 con 0x7f4cf006af00 2024-01-20T08:14:35.570 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.567+0000 7f4d0fe00640 1 -- 172.21.15.100:0/2205386860 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47952 (secure 0 0 0) 0x7f4d00005e00 con 0x7f4cf006af00 2024-01-20T08:14:35.571 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:35.571 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 msgr2=0x7f4cf006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 0x7f4cf006d3c0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f4d00001200 tx=0x7f4d00001110 comp rx=0 tx=0).stop 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 msgr2=0x7f4d181555d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800dae0 tx=0x7f4d08002070 comp rx=0 tx=0).stop 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 shutdown_connections 2024-01-20T08:14:35.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf006af00 0x7f4cf006d3c0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d18153a40 0x7f4d180bfd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d181609d0 0x7f4d181ed5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 --2- 172.21.15.100:0/2205386860 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4cf8005180 0x7f4d181555d0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 >> 172.21.15.100:0/2205386860 conn(0x7f4d1806a5e0 msgr2=0x7f4d181465b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 shutdown_connections 2024-01-20T08:14:35.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.570+0000 7f4d1ea00640 1 -- 172.21.15.100:0/2205386860 wait complete. 2024-01-20T08:14:35.590 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-01-20T08:14:33.975351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258616,"kb_used_data":9172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716104,"statfs":{"total":773094113280,"available":772829290496,"internally_reserved":0,"allocated":9392128,"data_stored":4840525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001284"},"pg_stats":[{"pgid":"1.0","version":"20'117","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-01-20T08:14:25.541341+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:14:25.541341+0000","last_peered":"2024-01-20T08:14:25.541341+0000","last_clean":"2024-01-20T08:14:25.541341+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:14:25.541341+0000","last_undegraded":"2024-01-20T08:14:25.541341+0000","last_fullsized":"2024-01-20T08:14:25.541341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1617920,"data_stored":1045629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.2410000000000001,"15min":1.244},"min":{"1min":0.63700000000000001,"5min":0.627,"15min":0.627},"max":{"1min":10.865,"5min":10.865,"15min":10.865},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1759999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4930000000000001,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.327}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.2729999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.577,"5min":11.805,"15min":11.805},"last":1.135}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3169999999999999,"15min":1.2549999999999999},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4059999999999999,"15min":1.4490000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5030000000000001,"5min":6.5030000000000001,"15min":6.5030000000000001},"last":1.2829999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4950000000000001,"15min":1.4610000000000001},"min":{"1min":0.79000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.503,"5min":11.972,"15min":11.972},"last":1.425},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.361,"15min":1.353},"min":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.1900000000000004,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":0.89100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.4990000000000001,"15min":1.5609999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.73,"15min":1.724},"min":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.502,"15min":1.5569999999999999},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":3.6960000000000002,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.625,"15min":1.609},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.1909999999999998,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.248}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.90700000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":1.089},{"interface":"front","average":{"1min":3.0259999999999998,"5min":1.9370000000000001,"15min":1.823},"min":{"1min":1.044,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":28.498000000000001,"5min":28.498000000000001,"15min":28.498000000000001},"last":1.492}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0940000000000001,"15min":1.1950000000000001},"min":{"1min":0.628,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4970000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.698,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.94299999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2829999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":2.008,"15min":2.008},"last":1.216},{"interface":"front","average":{"1min":1.278,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.754,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":2.004,"15min":2.004},"last":0.82299999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.163,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.532,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.94399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8899999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.085}]},{"osd":3,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3460000000000001,"15min":1.4179999999999999},"min":{"1min":0.83499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7010000000000001,"5min":2.222,"15min":2.222},"last":1.28},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.369,"15min":1.4410000000000001},"min":{"1min":0.98899999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8129999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.8320000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.476,"15min":1.573},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6419999999999999,"5min":2.915,"15min":2.915},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.554,"15min":1.6539999999999999},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.778,"5min":2.718,"15min":2.718},"last":1.401}]},{"osd":5,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.498,"15min":1.5589999999999999},"min":{"1min":1.0029999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6870000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.9370000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7529999999999999},"min":{"1min":0.91000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.845,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.4990000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.6499999999999999,"15min":1.73},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.847,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.554},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.673,"15min":1.7569999999999999},"min":{"1min":1.1639999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.1429999999999998,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":2.1070000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.409,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1419999999999999,"15min":1.133},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.569,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.995}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2010000000000001,"15min":1.226},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7390000000000001,"5min":1.806,"15min":1.806},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2150000000000001,"15min":1.2549999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5600000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0920000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.292,"15min":1.351},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.569,"5min":1.776,"15min":1.776},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5920000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.131}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.347,"15min":1.3859999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5549999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.423,"15min":1.4410000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8149999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.5940000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.472,"15min":1.516},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8460000000000001,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.51,"15min":1.556},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8340000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.552,"15min":1.5680000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8819999999999999,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.645,"15min":1.72},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.911,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.5449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":466721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.147,"15min":1.2290000000000001},"min":{"1min":0.59499999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.573,"5min":3.165,"15min":3.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0329999999999999},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.619,"5min":1.71,"15min":1.71},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7709999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.042},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.224,"15min":1.3600000000000001},"min":{"1min":0.83499999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.139,"15min":1.085},"min":{"1min":0.78000000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.48,"5min":1.667,"15min":1.667},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.256,"15min":1.264},"min":{"1min":0.93200000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.643,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2430000000000001,"15min":1.2729999999999999},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.484,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.26,"5min":1.335,"15min":1.391},"min":{"1min":0.85299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.649,"5min":2.613,"15min":2.613},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.3109999999999999,"15min":1.3320000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6559999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.47},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.996}]},{"osd":6,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4139999999999999,"15min":1.409},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7370000000000001,"5min":1.919,"15min":1.919},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.478,"15min":1.5049999999999999},"min":{"1min":0.73599999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.752,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.389}]},{"osd":7,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.5,"15min":1.548},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.736,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5860000000000001},"min":{"1min":0.76500000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.825,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.1180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1028096,"data_stored":460448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.79600000000000004,"15min":0.754},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.83899999999999997},"min":{"1min":0.48499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.752}]},{"osd":1,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3169999999999999,"5min":1.448,"15min":1.448},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.93400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.506,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.089,"15min":1.097},"min":{"1min":0.54300000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.7430000000000001,"5min":3.02,"15min":3.02},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2250000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.21,"15min":1.24},"min":{"1min":0.85499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.603,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.621,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.9379999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.294,"15min":1.329},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":2.153,"15min":2.153},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.548,"5min":2.359,"15min":2.359},"last":1.532}]},{"osd":6,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8069999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.343,"15min":1.339},"min":{"1min":0.86099999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.696,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.6839999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3979999999999999,"15min":1.419},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8280000000000001,"5min":2.286,"15min":2.286},"last":1.637},{"interface":"front","average":{"1min":1.379,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.98599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.679,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.583}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84799999999999998,"15min":0.91700000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3049999999999999,"5min":1.712,"15min":1.712},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.879,"15min":0.94699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.601,"15min":1.601},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97399999999999998,"15min":1.0600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4450000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.248},{"interface":"front","average":{"1min":0.90200000000000002,"5min":1.0189999999999999,"15min":1.081},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.091}]},{"osd":3,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.91300000000000003,"15min":1.056},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.131,"15min":1.2509999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.522,"5min":2.177,"15min":2.177},"last":1.3069999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.3819999999999999,"15min":1.4950000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.696,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4490000000000001},"min":{"1min":0.69799999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.752,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1990000000000001,"15min":1.292},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.327},{"interface":"front","average":{"1min":1.208,"5min":1.3799999999999999,"15min":1.514},"min":{"1min":0.79600000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.538,"5min":2.29,"15min":2.29},"last":1.359}]},{"osd":6,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.429,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.6519999999999999,"5min":2.734,"15min":2.734},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.371,"15min":1.5029999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.762,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.4570000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4470000000000001,"15min":1.581},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.417,"15min":1.585},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8360000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.2010000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93999999999999995,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.101},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.546,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.478}]},{"osd":2,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.542,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.86799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3899999999999999,"5min":1.444,"15min":1.444},"last":1.248}]},{"osd":3,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":0.96099999999999997},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":1.885,"15min":1.885},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94399999999999995,"15min":0.98599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.5980000000000001,"5min":1.758,"15min":1.758},"last":1.3759999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.75800000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.631,"5min":1.905,"15min":1.905},"last":1.222},{"interface":"front","average":{"1min":1.194,"5min":1.248,"15min":1.25},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5449999999999999,"5min":2.069,"15min":2.069},"last":1.4219999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.508,"5min":2.052,"15min":2.052},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.266,"15min":1.272},"min":{"1min":0.79300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.613,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2989999999999999,"15min":1.3129999999999999},"min":{"1min":0.74099999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6279999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.3240000000000001,"15min":1.379},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.784,"5min":1.97,"15min":1.97},"last":1.702}]},{"osd":7,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.349},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2,"15min":2},"last":1.605},{"interface":"front","average":{"1min":1.25,"5min":1.341,"15min":1.3819999999999999},"min":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6759999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1613824,"data_stored":1046099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4470000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2689999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.86699999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.663,"5min":1.722,"15min":1.722},"last":1.329},{"interface":"front","average":{"1min":1.018,"5min":0.995,"15min":0.96299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4079999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.4099999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4119999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":1.8149999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.863}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1299999999999999,"15min":1.099},"min":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.611,"5min":1.968,"15min":1.968},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.139,"15min":1.123},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.71799999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.617,"5min":1.865,"15min":1.865},"last":1.514},{"interface":"front","average":{"1min":1.304,"5min":1.238,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8839999999999999,"5min":2.427,"15min":2.427},"last":2.052}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.323,"15min":1.327},"min":{"1min":0.84799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.802,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.952},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2629999999999999,"15min":1.278},"min":{"1min":0.67200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.175}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.349,"15min":1.375},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9830000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.669},{"interface":"front","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.776}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:14:35.591 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-01-20T08:14:35.591 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:14:35.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.778+0000 7f4766800640 1 Processor -- start 2024-01-20T08:14:35.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.778+0000 7f4766800640 1 -- start start 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.778+0000 7f4766800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47600ab510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.778+0000 7f4766800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47600a9940 con 0x7f476014fce0 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f4766800640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47601500c0 con 0x7f47600a93c0 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f4766800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4760156810 con 0x7f4760153b80 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f475f400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f476014fce0 0x7f4760152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44398/0 (socket says 172.21.15.100:44398) 2024-01-20T08:14:35.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f475f400640 1 -- 172.21.15.100:0/2835552683 learned_addr learned my addr 172.21.15.100:0/2835552683 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:35.784 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 618698091 0 0) 0x7f47600a9940 con 0x7f476014fce0 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f475fe00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47600ab510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.779+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4740003520 con 0x7f476014fce0 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 801025922 0 0) 0x7f4740003520 con 0x7f476014fce0 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 msgr2=0x7f47600ab510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47600ab510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.785 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 >> v1:172.21.15.110:6789/0 conn(0x7f47600a93c0 legacy=0x7f47600aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4760156af0 con 0x7f476014fce0 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f4750001670 con 0x7f476014fce0 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 >> v1:172.21.15.100:6789/0 conn(0x7f476014fce0 legacy=0x7f4760152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47400039a0 0x7f4740003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47400047c0 0x7f4740004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760156810 con 0x7f47400039a0 2024-01-20T08:14:35.786 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474000bab0 con 0x7f47400047c0 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474000bc70 con 0x7f4760153b80 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47400039a0 0x7f4740003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 -- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 msgr2=0x7f47400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475fe00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f4757e00640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47400047c0 0x7f4740004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4760153b80 0x7f47400051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 -- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47400047c0 msgr2=0x7f4740004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:35.787 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47400047c0 0x7f4740004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.780+0000 7f475f400640 1 -- 172.21.15.100:0/2835552683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4740003520 con 0x7f47400039a0 2024-01-20T08:14:35.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f475f400640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47400039a0 0x7f4740003dc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f475000c240 tx=0x7f47400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5d1eddedb6a5518 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750005ad0 con 0x7f47400039a0 2024-01-20T08:14:35.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750005c30 con 0x7f47400039a0 2024-01-20T08:14:35.788 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f475ea00640 1 -- 172.21.15.100:0/2835552683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475002c8b0 con 0x7f47400039a0 2024-01-20T08:14:35.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f4766800640 1 -- 172.21.15.100:0/2835552683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47400039a0 msgr2=0x7f4740003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f4766800640 1 --2- 172.21.15.100:0/2835552683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f47400039a0 0x7f4740003dc0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f475000c240 tx=0x7f47400057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f475fe00640 1 -- 172.21.15.100:0/2835552683 reap_dead start 2024-01-20T08:14:35.791 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f4766800640 1 -- 172.21.15.100:0/2835552683 shutdown_connections 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f4766800640 1 -- 172.21.15.100:0/2835552683 >> 172.21.15.100:0/2835552683 conn(0x7f476006a5e0 msgr2=0x7f476006a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.782+0000 7f4766800640 1 -- 172.21.15.100:0/2835552683 shutdown_connections 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.783+0000 7f4766800640 1 -- 172.21.15.100:0/2835552683 wait complete. 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.784+0000 7f4766800640 1 Processor -- start 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.784+0000 7f4766800640 1 -- start start 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 0x7f4760143560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 0x7f4760146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.792 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600c2880 con 0x7f4760146bd0 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600c2da0 con 0x7f4760143aa0 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f4766800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47601e9fb0 con 0x7f47400039a0 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f475fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f475fe00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55792/0 (socket says 172.21.15.100:55792) 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.785+0000 7f475fe00640 1 -- 172.21.15.100:0/2802736937 learned_addr learned my addr 172.21.15.100:0/2802736937 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:35.793 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475f400640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 0x7f4760143560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4757e00640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 0x7f4760146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 -- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 msgr2=0x7f4760143560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 0x7f4760143560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 -- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 msgr2=0x7f4760146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 0x7f4760146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 -- 172.21.15.100:0/2802736937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600c2ff0 con 0x7f4760146bd0 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475f400640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 0x7f4760143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4757e00640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 0x7f4760146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:35.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f475fe00640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f47580098a0 tx=0x7f4758009d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758007d20 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4758014400 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47600c25a0 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.786+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4758007ea0 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.787+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4760143fe0 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.788+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47601e9d80 con 0x7f4760146bd0 2024-01-20T08:14:35.795 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.788+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f475801e440 con 0x7f4760146bd0 2024-01-20T08:14:35.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.789+0000 7f4757400640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 0x7f473806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:35.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.789+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4758088f30 con 0x7f4760146bd0 2024-01-20T08:14:35.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.789+0000 7f475f400640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 0x7f473806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:35.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.790+0000 7f475f400640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 0x7f473806d3c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4750034000 tx=0x7f4750009030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:35.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.794+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f47601e9d80 con 0x7f4760146bd0 2024-01-20T08:14:35.983 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.980+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4760153610 con 0x7f473806af00 2024-01-20T08:14:35.986 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.983+0000 7f4757400640 1 -- 172.21.15.100:0/2802736937 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47952 (secure 0 0 0) 0x7f4750005da0 con 0x7f473806af00 2024-01-20T08:14:35.987 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:35.988 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 msgr2=0x7f473806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 0x7f473806d3c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f4750034000 tx=0x7f4750009030 comp rx=0 tx=0).stop 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 msgr2=0x7f47601e5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f47580098a0 tx=0x7f4758009d60 comp rx=0 tx=0).stop 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 shutdown_connections 2024-01-20T08:14:35.990 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4760146bd0 0x7f47601e5e00 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4760143aa0 0x7f4760146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f473806af00 0x7f473806d3c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 --2- 172.21.15.100:0/2802736937 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47400039a0 0x7f4760143560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 >> 172.21.15.100:0/2802736937 conn(0x7f476006a5e0 msgr2=0x7f4760151570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 shutdown_connections 2024-01-20T08:14:35.991 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:35.988+0000 7f4766800640 1 -- 172.21.15.100:0/2802736937 wait complete. 2024-01-20T08:14:36.007 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-01-20T08:14:35.975857+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258616,"kb_used_data":9172,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754716104,"statfs":{"total":773094113280,"available":772829290496,"internally_reserved":0,"allocated":9392128,"data_stored":4840525,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12384,"num_objects":-23,"num_object_clones":0,"num_object_copies":-46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-64,"num_write_kb":-35,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.226123"},"pg_stats":[{"pgid":"1.0","version":"20'117","reported_seq":219,"reported_epoch":81,"state":"active+clean","last_fresh":"2024-01-20T08:14:25.541341+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:14:25.541341+0000","last_peered":"2024-01-20T08:14:25.541341+0000","last_clean":"2024-01-20T08:14:25.541341+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:14:25.541341+0000","last_undegraded":"2024-01-20T08:14:25.541341+0000","last_fullsized":"2024-01-20T08:14:25.541341+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1580,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1617920,"data_stored":1045629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.2410000000000001,"15min":1.244},"min":{"1min":0.63700000000000001,"5min":0.627,"15min":0.627},"max":{"1min":10.865,"5min":10.865,"15min":10.865},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1759999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4930000000000001,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":1.327}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.155,"5min":1.2729999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.577,"5min":11.805,"15min":11.805},"last":1.135}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3169999999999999,"15min":1.2549999999999999},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":0.999},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4059999999999999,"15min":1.4490000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5030000000000001,"5min":6.5030000000000001,"15min":6.5030000000000001},"last":1.2829999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4950000000000001,"15min":1.4610000000000001},"min":{"1min":0.79000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.503,"5min":11.972,"15min":11.972},"last":1.425},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.361,"15min":1.353},"min":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.1900000000000004,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":0.89100000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.4990000000000001,"15min":1.5609999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":0.97099999999999997},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.73,"15min":1.724},"min":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":1.1619999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.502,"15min":1.5569999999999999},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":3.6960000000000002,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.625,"15min":1.609},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.1909999999999998,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.248}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.90700000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":1.089},{"interface":"front","average":{"1min":3.0259999999999998,"5min":1.9370000000000001,"15min":1.823},"min":{"1min":1.044,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":28.498000000000001,"5min":28.498000000000001,"15min":28.498000000000001},"last":1.492}]}]},{"osd":6,"up_from":13,"seq":55834574904,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0940000000000001,"15min":1.1950000000000001},"min":{"1min":0.628,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4970000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.698,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.94299999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2829999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":2.008,"15min":2.008},"last":1.216},{"interface":"front","average":{"1min":1.278,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.754,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":2.004,"15min":2.004},"last":0.82299999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.163,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.532,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.94399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8899999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.085}]},{"osd":3,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3460000000000001,"15min":1.4179999999999999},"min":{"1min":0.83499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7010000000000001,"5min":2.222,"15min":2.222},"last":1.28},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.369,"15min":1.4410000000000001},"min":{"1min":0.98899999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8129999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.8320000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.476,"15min":1.573},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6419999999999999,"5min":2.915,"15min":2.915},"last":1.3400000000000001},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.554,"15min":1.6539999999999999},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.778,"5min":2.718,"15min":2.718},"last":1.401}]},{"osd":5,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.498,"15min":1.5589999999999999},"min":{"1min":1.0029999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6870000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.9370000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7529999999999999},"min":{"1min":0.91000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.845,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.4990000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.6499999999999999,"15min":1.73},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.847,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.554},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.673,"15min":1.7569999999999999},"min":{"1min":1.1639999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.1429999999999998,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":2.1070000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.82599999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.409,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.145,"5min":1.1419999999999999,"15min":1.133},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.569,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.995}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2010000000000001,"15min":1.226},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7390000000000001,"5min":1.806,"15min":1.806},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2150000000000001,"15min":1.2549999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5600000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.0920000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.292,"15min":1.351},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.569,"5min":1.776,"15min":1.776},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.232,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5920000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.131}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.347,"15min":1.3859999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5549999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.423,"15min":1.4410000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8149999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.5940000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.472,"15min":1.516},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8460000000000001,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.2849999999999999},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.51,"15min":1.556},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8340000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.6739999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.552,"15min":1.5680000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8819999999999999,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.7110000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.645,"15min":1.72},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.911,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.5449999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574904,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32200,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339640,"statfs":{"total":96636764160,"available":96603791360,"internally_reserved":0,"allocated":1044480,"data_stored":466721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.147,"15min":1.2290000000000001},"min":{"1min":0.59499999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.573,"5min":3.165,"15min":3.165},"last":0.84499999999999997},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0329999999999999},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.619,"5min":1.71,"15min":1.71},"last":1.1859999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7709999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.042},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.224,"15min":1.3600000000000001},"min":{"1min":0.83499999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":0.78800000000000003}]},{"osd":2,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.139,"15min":1.085},"min":{"1min":0.78000000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.48,"5min":1.667,"15min":1.667},"last":0.67200000000000004},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.256,"15min":1.264},"min":{"1min":0.93200000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.643,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.3009999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2430000000000001,"15min":1.2729999999999999},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.484,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.26,"5min":1.335,"15min":1.391},"min":{"1min":0.85299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.649,"5min":2.613,"15min":2.613},"last":0.93899999999999995}]},{"osd":5,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.3109999999999999,"15min":1.3320000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6559999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.47},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":0.996}]},{"osd":6,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4139999999999999,"15min":1.409},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7370000000000001,"5min":1.919,"15min":1.919},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.478,"15min":1.5049999999999999},"min":{"1min":0.73599999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.752,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.389}]},{"osd":7,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.5,"15min":1.548},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.736,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5860000000000001},"min":{"1min":0.76500000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.825,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.1180000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574904,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1028096,"data_stored":460448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.79600000000000004,"15min":0.754},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":1.3979999999999999},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.83899999999999997},"min":{"1min":0.48499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.752}]},{"osd":1,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3169999999999999,"5min":1.448,"15min":1.448},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.93400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.506,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.80200000000000005}]},{"osd":2,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.089,"15min":1.097},"min":{"1min":0.54300000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.7430000000000001,"5min":3.02,"15min":3.02},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2250000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.21,"15min":1.24},"min":{"1min":0.85499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.603,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.621,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.9379999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.294,"15min":1.329},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":2.153,"15min":2.153},"last":1.7609999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.548,"5min":2.359,"15min":2.359},"last":1.532}]},{"osd":6,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8069999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.343,"15min":1.339},"min":{"1min":0.86099999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.696,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.6839999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3979999999999999,"15min":1.419},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8280000000000001,"5min":2.286,"15min":2.286},"last":1.637},{"interface":"front","average":{"1min":1.379,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.98599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.679,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.583}]}]},{"osd":2,"up_from":13,"seq":55834574904,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1024000,"data_stored":455321,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84799999999999998,"15min":0.91700000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3049999999999999,"5min":1.712,"15min":1.712},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.879,"15min":0.94699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.601,"15min":1.601},"last":0.61399999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97399999999999998,"15min":1.0600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4450000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.248},{"interface":"front","average":{"1min":0.90200000000000002,"5min":1.0189999999999999,"15min":1.081},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.091}]},{"osd":3,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.91300000000000003,"15min":1.056},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.96799999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.131,"15min":1.2509999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.522,"5min":2.177,"15min":2.177},"last":1.3069999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.3819999999999999,"15min":1.4950000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.696,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4490000000000001},"min":{"1min":0.69799999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.752,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.4079999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1990000000000001,"15min":1.292},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.327},{"interface":"front","average":{"1min":1.208,"5min":1.3799999999999999,"15min":1.514},"min":{"1min":0.79600000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.538,"5min":2.29,"15min":2.29},"last":1.359}]},{"osd":6,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.429,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.6519999999999999,"5min":2.734,"15min":2.734},"last":1.5329999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.371,"15min":1.5029999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.762,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.4570000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4470000000000001,"15min":1.581},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.278,"5min":1.417,"15min":1.585},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8360000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.2010000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32176,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339664,"statfs":{"total":96636764160,"available":96603815936,"internally_reserved":0,"allocated":1019904,"data_stored":455287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93999999999999995,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":1.101},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.546,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.478}]},{"osd":2,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.542,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.86799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3899999999999999,"5min":1.444,"15min":1.444},"last":1.248}]},{"osd":3,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":0.96099999999999997},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":1.885,"15min":1.885},"last":1.3540000000000001},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94399999999999995,"15min":0.98599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.5980000000000001,"5min":1.758,"15min":1.758},"last":1.3759999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.75800000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.631,"5min":1.905,"15min":1.905},"last":1.222},{"interface":"front","average":{"1min":1.194,"5min":1.248,"15min":1.25},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5449999999999999,"5min":2.069,"15min":2.069},"last":1.4219999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.508,"5min":2.052,"15min":2.052},"last":1.1579999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.266,"15min":1.272},"min":{"1min":0.79300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.613,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2989999999999999,"15min":1.3129999999999999},"min":{"1min":0.74099999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6279999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.3240000000000001,"15min":1.379},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.784,"5min":1.97,"15min":1.97},"last":1.702}]},{"osd":7,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.349},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2,"15min":2},"last":1.605},{"interface":"front","average":{"1min":1.25,"5min":1.341,"15min":1.3819999999999999},"min":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6759999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.4399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32756,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339084,"statfs":{"total":96636764160,"available":96603222016,"internally_reserved":0,"allocated":1613824,"data_stored":1046099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4470000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2689999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.0449999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.86699999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.663,"5min":1.722,"15min":1.722},"last":1.329},{"interface":"front","average":{"1min":1.018,"5min":0.995,"15min":0.96299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4079999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.4099999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4119999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.006},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":1.8149999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.863}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1299999999999999,"15min":1.099},"min":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.611,"5min":1.968,"15min":1.968},"last":1.5589999999999999},{"interface":"front","average":{"1min":1.204,"5min":1.139,"15min":1.123},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.2869999999999999}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.71799999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.617,"5min":1.865,"15min":1.865},"last":1.514},{"interface":"front","average":{"1min":1.304,"5min":1.238,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8839999999999999,"5min":2.427,"15min":2.427},"last":2.052}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.323,"15min":1.327},"min":{"1min":0.84799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.802,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.952},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2629999999999999,"15min":1.278},"min":{"1min":0.67200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.175}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.349,"15min":1.375},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9830000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.669},{"interface":"front","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.776}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:14:36.008 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-01-20T08:14:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.199+0000 7f5e94a00640 1 Processor -- start 2024-01-20T08:14:36.201 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.199+0000 7f5e94a00640 1 -- start start 2024-01-20T08:14:36.202 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e8c14fce0 0x7f5e8c153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c152f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5e8c153440 0x7f5e8c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c0a9940 con 0x7f5e8c14fce0 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e8c1500c0 con 0x7f5e8c153440 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.200+0000 7f5e94a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c156810 con 0x7f5e8c0a93c0 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e8c14fce0 0x7f5e8c153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5e8c14fce0 0x7f5e8c153b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55804/0 (socket says 172.21.15.100:55804) 2024-01-20T08:14:36.203 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 -- 172.21.15.100:0/2391650680 learned_addr learned my addr 172.21.15.100:0/2391650680 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 -- 172.21.15.100:0/2391650680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 msgr2=0x7f5e8c152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 --2- 172.21.15.100:0/2391650680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 -- 172.21.15.100:0/2391650680 >> v2:172.21.15.110:3300/0 conn(0x7f5e8c153440 msgr2=0x7f5e8c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 --2- 172.21.15.100:0/2391650680 >> v2:172.21.15.110:3300/0 conn(0x7f5e8c153440 0x7f5e8c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.201+0000 7f5e92000640 1 -- 172.21.15.100:0/2391650680 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c156af0 con 0x7f5e8c14fce0 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.202+0000 7f5e92000640 1 --2- 172.21.15.100:0/2391650680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c153b80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0c3ae0 tx=0x7f5e7c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec316c4b90ccbbf server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.202+0000 7f5e90c00640 1 -- 172.21.15.100:0/2391650680 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c031860 con 0x7f5e8c14fce0 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.202+0000 7f5e90c00640 1 -- 172.21.15.100:0/2391650680 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e7c0319c0 con 0x7f5e8c14fce0 2024-01-20T08:14:36.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.202+0000 7f5e90c00640 1 -- 172.21.15.100:0/2391650680 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c031d50 con 0x7f5e8c14fce0 2024-01-20T08:14:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 -- 172.21.15.100:0/2391650680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c14fce0 msgr2=0x7f5e8c153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 --2- 172.21.15.100:0/2391650680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c153b80 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0c3ae0 tx=0x7f5e7c02b900 comp rx=0 tx=0).stop 2024-01-20T08:14:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 -- 172.21.15.100:0/2391650680 shutdown_connections 2024-01-20T08:14:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 --2- 172.21.15.100:0/2391650680 >> v2:172.21.15.110:3300/0 conn(0x7f5e8c153440 0x7f5e8c0aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.206 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 --2- 172.21.15.100:0/2391650680 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 --2- 172.21.15.100:0/2391650680 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c153b80 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 -- 172.21.15.100:0/2391650680 >> 172.21.15.100:0/2391650680 conn(0x7f5e8c06a5e0 msgr2=0x7f5e8c06a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 -- 172.21.15.100:0/2391650680 shutdown_connections 2024-01-20T08:14:36.207 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.203+0000 7f5e94a00640 1 -- 172.21.15.100:0/2391650680 wait complete. 2024-01-20T08:14:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.205+0000 7f5e94a00640 1 Processor -- start 2024-01-20T08:14:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.205+0000 7f5e94a00640 1 -- start start 2024-01-20T08:14:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c14dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c03e0 con 0x7f5e8c153440 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0bfdb0 con 0x7f5e8c14fce0 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e94a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e8c0c1090 con 0x7f5e8c0a93c0 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e92a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e92a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55818/0 (socket says 172.21.15.100:55818) 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e92a00640 1 -- 172.21.15.100:0/1324887938 learned_addr learned my addr 172.21.15.100:0/1324887938 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e91600640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c14dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.206+0000 7f5e92000640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:36.210 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 -- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 msgr2=0x7f5e8c0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c0c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 -- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 msgr2=0x7f5e8c14dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c14dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 -- 172.21.15.100:0/1324887938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e7c0094d0 con 0x7f5e8c153440 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e91600640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e92a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400b970 tx=0x7f5e8400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400cb40 con 0x7f5e8c153440 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8400ccc0 con 0x7f5e8c153440 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84014680 con 0x7f5e8c153440 2024-01-20T08:14:36.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e8c0c1370 con 0x7f5e8c153440 2024-01-20T08:14:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.207+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e8c14e400 con 0x7f5e8c153440 2024-01-20T08:14:36.212 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.208+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e8c0c0520 con 0x7f5e8c153440 2024-01-20T08:14:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.209+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5e8401d3b0 con 0x7f5e8c153440 2024-01-20T08:14:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.210+0000 7f5e8a000640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 0x7f5e6406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.210+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5e84089340 con 0x7f5e8c153440 2024-01-20T08:14:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.211+0000 7f5e92000640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 0x7f5e6406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:36.213 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.211+0000 7f5e92000640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 0x7f5e6406d390 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c036000 tx=0x7f5e7c03c040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:36.217 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.215+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5e8c0c0520 con 0x7f5e8c153440 2024-01-20T08:14:36.395 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.393+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e8c0c0520 con 0x7f5e8c153440 2024-01-20T08:14:36.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.395+0000 7f5e8a000640 1 -- 172.21.15.100:0/1324887938 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+13098 (secure 0 0 0) 0x7f5e8c0c0520 con 0x7f5e8c153440 2024-01-20T08:14:36.397 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:36.397 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":84,"fsid":"10ce7bd0-b73e-4b66-b126-32ffded4722e","created":"2024-01-20T08:09:48.893226+0000","modified":"2024-01-20T08:14:32.762038+0000","last_up_change":"2024-01-20T08:10:00.643994+0000","last_in_change":"2024-01-20T08:09:52.311489+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-01-20T08:10:01.957260+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"45a7d8b8-6221-4bc2-8530-fc57c333c2bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6817","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6820","nonce":9037251}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6823","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6825","nonce":9037251}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6831","nonce":9037251}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":9037251},{"type":"v1","addr":"172.21.15.100:6829","nonce":9037251}]},"public_addr":"172.21.15.100:6820/9037251","cluster_addr":"172.21.15.100:6825/9037251","heartbeat_back_addr":"172.21.15.100:6831/9037251","heartbeat_front_addr":"172.21.15.100:6829/9037251","state":["exists","up"]},{"osd":1,"uuid":"f97f7eb3-6d69-48a2-9d79-04d22d7207a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6801","nonce":1719666364}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6803","nonce":1719666364}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6807","nonce":1719666364}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":1719666364},{"type":"v1","addr":"172.21.15.100:6805","nonce":1719666364}]},"public_addr":"172.21.15.100:6801/1719666364","cluster_addr":"172.21.15.100:6803/1719666364","heartbeat_back_addr":"172.21.15.100:6807/1719666364","heartbeat_front_addr":"172.21.15.100:6805/1719666364","state":["exists","up"]},{"osd":2,"uuid":"16394a8b-fa50-4339-8c92-559e237186f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6812","nonce":194905097}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6816","nonce":194905097}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6826","nonce":194905097}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":194905097},{"type":"v1","addr":"172.21.15.100:6821","nonce":194905097}]},"public_addr":"172.21.15.100:6812/194905097","cluster_addr":"172.21.15.100:6816/194905097","heartbeat_back_addr":"172.21.15.100:6826/194905097","heartbeat_front_addr":"172.21.15.100:6821/194905097","state":["exists","up"]},{"osd":3,"uuid":"d606a683-b901-4652-bd41-93926fee5710","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6809","nonce":37037686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6811","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6813","nonce":37037686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6827","nonce":37037686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6815","nonce":37037686},{"type":"v1","addr":"172.21.15.100:6819","nonce":37037686}]},"public_addr":"172.21.15.100:6809/37037686","cluster_addr":"172.21.15.100:6813/37037686","heartbeat_back_addr":"172.21.15.100:6827/37037686","heartbeat_front_addr":"172.21.15.100:6819/37037686","state":["exists","up"]},{"osd":4,"uuid":"8da735fb-0b76-4a5c-957e-b9a5b40f8ea4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6824","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6825","nonce":1116990208}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6826","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6827","nonce":1116990208}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6830","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6831","nonce":1116990208}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6828","nonce":1116990208},{"type":"v1","addr":"172.21.15.110:6829","nonce":1116990208}]},"public_addr":"172.21.15.110:6825/1116990208","cluster_addr":"172.21.15.110:6827/1116990208","heartbeat_back_addr":"172.21.15.110:6831/1116990208","heartbeat_front_addr":"172.21.15.110:6829/1116990208","state":["exists","up"]},{"osd":5,"uuid":"d1a24abc-b22b-4a3d-8889-ec81f6a54726","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6808","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6809","nonce":3843611847}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6810","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6811","nonce":3843611847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6814","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6815","nonce":3843611847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6812","nonce":3843611847},{"type":"v1","addr":"172.21.15.110:6813","nonce":3843611847}]},"public_addr":"172.21.15.110:6809/3843611847","cluster_addr":"172.21.15.110:6811/3843611847","heartbeat_back_addr":"172.21.15.110:6815/3843611847","heartbeat_front_addr":"172.21.15.110:6813/3843611847","state":["exists","up"]},{"osd":6,"uuid":"447ecde1-4bfa-4ec0-b93c-6b1f197bfb0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6800","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6801","nonce":2895430222}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6802","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6803","nonce":2895430222}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6806","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6807","nonce":2895430222}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6804","nonce":2895430222},{"type":"v1","addr":"172.21.15.110:6805","nonce":2895430222}]},"public_addr":"172.21.15.110:6801/2895430222","cluster_addr":"172.21.15.110:6803/2895430222","heartbeat_back_addr":"172.21.15.110:6807/2895430222","heartbeat_front_addr":"172.21.15.110:6805/2895430222","state":["exists","up"]},{"osd":7,"uuid":"48a0b0ee-c9c6-4e78-8012-ae89b737cc41","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6816","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6817","nonce":419165616}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6818","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6819","nonce":419165616}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6822","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6823","nonce":419165616}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6820","nonce":419165616},{"type":"v1","addr":"172.21.15.110:6821","nonce":419165616}]},"public_addr":"172.21.15.110:6817/419165616","cluster_addr":"172.21.15.110:6819/419165616","heartbeat_back_addr":"172.21.15.110:6823/419165616","heartbeat_front_addr":"172.21.15.110:6821/419165616","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.640516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.824732+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.695233+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.728592+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.643551+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.588602+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.580763+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701272860131327,"old_weight":0,"last_purged_snaps_scrub":"2024-01-20T08:09:57.691643+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.100:6835/2268195390":"2024-01-21T08:14:29.743744+0000","172.21.15.100:6834/2268195390":"2024-01-21T08:14:29.743744+0000","172.21.15.100:6837/1016959198":"2024-01-21T08:14:22.199588+0000","172.21.15.100:6836/1016959198":"2024-01-21T08:14:22.199588+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 msgr2=0x7f5e6406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 0x7f5e6406d390 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c036000 tx=0x7f5e7c03c040 comp rx=0 tx=0).stop 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 msgr2=0x7f5e8c147260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400b970 tx=0x7f5e8400be30 comp rx=0 tx=0).stop 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 shutdown_connections 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5e8c153440 0x7f5e8c147260 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5e8c14fce0 0x7f5e8c14dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5e6406aed0 0x7f5e6406d390 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 --2- 172.21.15.100:0/1324887938 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5e8c0a93c0 0x7f5e8c0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:36.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.397+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 >> 172.21.15.100:0/1324887938 conn(0x7f5e8c06a5e0 msgr2=0x7f5e8c1502d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:36.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.398+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 shutdown_connections 2024-01-20T08:14:36.401 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:36.398+0000 7f5e94a00640 1 -- 172.21.15.100:0/1324887938 wait complete. 2024-01-20T08:14:36.958 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:14:36.965 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:14:37.418 INFO:tasks.ceph:Scrubbing osd.0 2024-01-20T08:14:37.418 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:37.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.642+0000 7f2a3c000640 1 Processor -- start 2024-01-20T08:14:37.644 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.642+0000 7f2a3c000640 1 -- start start 2024-01-20T08:14:37.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a3406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3c000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a3406d1d0 con 0x7f2a340a84a0 2024-01-20T08:14:37.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3c000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a340c2540 con 0x7f2a34148080 2024-01-20T08:14:37.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340a8ce0 con 0x7f2a34070c00 2024-01-20T08:14:37.646 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3a000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f2a340a84a0 0x7f2a3415be30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44414/0 (socket says 172.21.15.100:44414) 2024-01-20T08:14:37.647 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.644+0000 7f2a3a000640 1 -- 172.21.15.100:0/1592897037 learned_addr learned my addr 172.21.15.100:0/1592897037 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a38c00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a3406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549327150 0 0) 0x7f2a3406d1d0 con 0x7f2a340a84a0 2024-01-20T08:14:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a14003520 con 0x7f2a340a84a0 2024-01-20T08:14:37.649 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224743407 0 0) 0x7f2a14003520 con 0x7f2a340a84a0 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 msgr2=0x7f2a3406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a3406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 >> v1:172.21.15.110:6789/0 conn(0x7f2a34148080 legacy=0x7f2a340c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a34072390 con 0x7f2a340a84a0 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f2a2c0019f0 con 0x7f2a340a84a0 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 >> v1:172.21.15.100:6789/0 conn(0x7f2a340a84a0 legacy=0x7f2a3415be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.650 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a14004d00 0x7f2a14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a340a8ce0 con 0x7f2a140039a0 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1400bb40 con 0x7f2a14004d00 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.645+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1400bd00 con 0x7f2a34070c00 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a3a000640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a14004d00 0x7f2a14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a38c00640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 -- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 msgr2=0x7f2a140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a34070c00 0x7f2a140047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.651 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 -- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a14004d00 msgr2=0x7f2a14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a14004d00 0x7f2a14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a39600640 1 -- 172.21.15.100:0/1592897037 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a14003520 con 0x7f2a140039a0 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.646+0000 7f2a3a000640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a14004d00 0x7f2a14005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.647+0000 7f2a39600640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a14003dc0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001750 tx=0x7f2a140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93c38ba0c6fc22a7 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.647+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240052d0 con 0x7f2a140039a0 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.647+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2402e050 con 0x7f2a140039a0 2024-01-20T08:14:37.652 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.647+0000 7f2a33e00640 1 -- 172.21.15.100:0/1592897037 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240035f0 con 0x7f2a140039a0 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 -- 172.21.15.100:0/1592897037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 msgr2=0x7f2a14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 --2- 172.21.15.100:0/1592897037 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a14003dc0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f2a24001750 tx=0x7f2a140057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3a000640 1 -- 172.21.15.100:0/1592897037 reap_dead start 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 -- 172.21.15.100:0/1592897037 shutdown_connections 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 -- 172.21.15.100:0/1592897037 >> 172.21.15.100:0/1592897037 conn(0x7f2a340c2b00 msgr2=0x7f2a340c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 -- 172.21.15.100:0/1592897037 shutdown_connections 2024-01-20T08:14:37.655 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.648+0000 7f2a3c000640 1 -- 172.21.15.100:0/1592897037 wait complete. 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.650+0000 7f2a3c000640 1 Processor -- start 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.650+0000 7f2a3c000640 1 -- start start 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a341db500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a34150430 0x7f2a341eabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a341eb130 0x7f2a341e9b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a341db290 con 0x7f2a140039a0 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34155a40 con 0x7f2a34150430 2024-01-20T08:14:37.656 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3c000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a34155760 con 0x7f2a341eb130 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a39600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a341db500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a39600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a341db500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55832/0 (socket says 172.21.15.100:55832) 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a39600640 1 -- 172.21.15.100:0/1758757813 learned_addr learned my addr 172.21.15.100:0/1758757813 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a38c00640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a34150430 0x7f2a341eabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a3a000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a341eb130 0x7f2a341e9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a39600640 1 -- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a341eb130 msgr2=0x7f2a341e9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.651+0000 7f2a39600640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2a341eb130 0x7f2a341e9b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.657 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a39600640 1 -- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a34150430 msgr2=0x7f2a341eabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a39600640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2a34150430 0x7f2a341eabf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a39600640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a341e8f70 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a39600640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a341db500 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005040 tx=0x7f2a24001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a240076c0 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a24007a30 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24006c20 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a341e9250 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.652+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a341dc840 con 0x7f2a140039a0 2024-01-20T08:14:37.658 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.653+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2a341522f0 con 0x7f2a140039a0 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.654+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2a240035f0 con 0x7f2a140039a0 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.655+0000 7f2a31600640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2a0c06af00 0x7f2a0c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.655+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2a240ab560 con 0x7f2a140039a0 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a38c00640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2a0c06af00 0x7f2a0c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a31600640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f2a0c070e00 0x7f2a0c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2a0c0738d0 con 0x7f2a0c070e00 2024-01-20T08:14:37.660 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a240ab910 con 0x7f2a140039a0 2024-01-20T08:14:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a3a000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f2a0c070e00 0x7f2a0c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.656+0000 7f2a38c00640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2a0c06af00 0x7f2a0c06d3c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a34147d70 tx=0x7f2a1c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.657+0000 7f2a3a000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f2a0c070e00 0x7f2a0c073220 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.661 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.657+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== osd.0 v2:172.21.15.100:6817/9037251 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f2a0c0738d0 con 0x7f2a0c070e00 2024-01-20T08:14:37.673 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.672+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 --> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f2a34142520 con 0x7f2a0c070e00 2024-01-20T08:14:37.674 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.672+0000 7f2a31600640 1 -- 172.21.15.100:0/1758757813 <== osd.0 v2:172.21.15.100:6817/9037251 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f2a34142520 con 0x7f2a0c070e00 2024-01-20T08:14:37.674 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:37.674 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:37.675 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.672+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f2a0c070e00 msgr2=0x7f2a0c073220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.672+0000 7f2a3c000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6817/9037251,v1:172.21.15.100:6820/9037251] conn(0x7f2a0c070e00 0x7f2a0c073220 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2a0c06af00 msgr2=0x7f2a0c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f2a0c06af00 0x7f2a0c06d3c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2a34147d70 tx=0x7f2a1c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 msgr2=0x7f2a341db500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 --2- 172.21.15.100:0/1758757813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2a140039a0 0x7f2a341db500 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f2a24005040 tx=0x7f2a24001120 comp rx=0 tx=0).stop 2024-01-20T08:14:37.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3a000640 1 -- 172.21.15.100:0/1758757813 reap_dead start 2024-01-20T08:14:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 shutdown_connections 2024-01-20T08:14:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 >> 172.21.15.100:0/1758757813 conn(0x7f2a340c2b00 msgr2=0x7f2a34143010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 shutdown_connections 2024-01-20T08:14:37.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.673+0000 7f2a3c000640 1 -- 172.21.15.100:0/1758757813 wait complete. 2024-01-20T08:14:37.692 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-01-20T08:14:37.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.889+0000 7f42a4200640 1 Processor -- start 2024-01-20T08:14:37.892 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.890+0000 7f42a4200640 1 -- start start 2024-01-20T08:14:37.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.891+0000 7f42a4200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f429c0c3460 0x7f429c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.891+0000 7f42a4200640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f429c153120 0x7f429c15cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.891+0000 7f42a4200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f429c150190 con 0x7f429c14fdb0 2024-01-20T08:14:37.893 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.891+0000 7f42a4200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0a9ce0 con 0x7f429c0c3460 2024-01-20T08:14:37.894 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.891+0000 7f42a4200640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f429c0a93b0 con 0x7f429c153120 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a0e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f429c0c3460 0x7f429c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a1800640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f429c14fdb0 0x7f429c0c1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44424/0 (socket says 172.21.15.100:44424) 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a1800640 1 -- 172.21.15.100:0/373626130 learned_addr learned my addr 172.21.15.100:0/373626130 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a2200640 1 --2- 172.21.15.100:0/373626130 >> v2:172.21.15.110:3300/0 conn(0x7f429c153120 0x7f429c15cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a0e00640 1 -- 172.21.15.100:0/373626130 >> v2:172.21.15.110:3300/0 conn(0x7f429c153120 msgr2=0x7f429c15cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a0e00640 1 --2- 172.21.15.100:0/373626130 >> v2:172.21.15.110:3300/0 conn(0x7f429c153120 0x7f429c15cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a0e00640 1 -- 172.21.15.100:0/373626130 >> v1:172.21.15.100:6789/0 conn(0x7f429c14fdb0 legacy=0x7f429c0c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.895 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f42a0e00640 1 -- 172.21.15.100:0/373626130 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f429c1535b0 con 0x7f429c0c3460 2024-01-20T08:14:37.896 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.892+0000 7f429be00640 1 -- 172.21.15.100:0/373626130 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849013106 0 0) 0x7f429c150190 con 0x7f429c14fdb0 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.893+0000 7f42a0e00640 1 --2- 172.21.15.100:0/373626130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c152be0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f429c06bdd0 tx=0x7f428402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93e8c428ddd5ded server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f429be00640 1 -- 172.21.15.100:0/373626130 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284031830 con 0x7f429c0c3460 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f429be00640 1 -- 172.21.15.100:0/373626130 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4284031990 con 0x7f429c0c3460 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f429be00640 1 -- 172.21.15.100:0/373626130 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284031d20 con 0x7f429c0c3460 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 -- 172.21.15.100:0/373626130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 msgr2=0x7f429c152be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.897 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 --2- 172.21.15.100:0/373626130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c152be0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f429c06bdd0 tx=0x7f428402b8d0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 -- 172.21.15.100:0/373626130 shutdown_connections 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 --2- 172.21.15.100:0/373626130 >> v2:172.21.15.110:3300/0 conn(0x7f429c153120 0x7f429c15cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 --2- 172.21.15.100:0/373626130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c152be0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 -- 172.21.15.100:0/373626130 >> 172.21.15.100:0/373626130 conn(0x7f429c0c2940 msgr2=0x7f429c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 -- 172.21.15.100:0/373626130 shutdown_connections 2024-01-20T08:14:37.898 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.894+0000 7f42a4200640 1 -- 172.21.15.100:0/373626130 wait complete. 2024-01-20T08:14:37.900 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.896+0000 7f42a4200640 1 Processor -- start 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.896+0000 7f42a4200640 1 -- start start 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f429c14fdb0 0x7f429c144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 0x7f429c144da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1ed460 con 0x7f429c0c3460 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1ed180 con 0x7f429c153120 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a4200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f429c1e9d10 con 0x7f429c14fdb0 2024-01-20T08:14:37.901 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a1800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55862/0 (socket says 172.21.15.100:55862) 2024-01-20T08:14:37.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.897+0000 7f42a1800640 1 -- 172.21.15.100:0/1204967590 learned_addr learned my addr 172.21.15.100:0/1204967590 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:37.902 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a2200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 0x7f429c144da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a0e00640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f429c14fdb0 0x7f429c144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 -- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f429c14fdb0 msgr2=0x7f429c144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f429c14fdb0 0x7f429c144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 -- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 msgr2=0x7f429c144da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 0x7f429c144da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 -- 172.21.15.100:0/1204967590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4284009400 con 0x7f429c0c3460 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a2200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 0x7f429c144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:37.903 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a1800640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c4d0 tx=0x7f428c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0074e0 con 0x7f429c0c3460 2024-01-20T08:14:37.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428c007660 con 0x7f429c0c3460 2024-01-20T08:14:37.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c004a20 con 0x7f429c0c3460 2024-01-20T08:14:37.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.898+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429c1e9ff0 con 0x7f429c0c3460 2024-01-20T08:14:37.904 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.899+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429c150ec0 con 0x7f429c0c3460 2024-01-20T08:14:37.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.900+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429c1e9b70 con 0x7f429c0c3460 2024-01-20T08:14:37.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.901+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f428c004b80 con 0x7f429c0c3460 2024-01-20T08:14:37.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.901+0000 7f4299600640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 0x7f427406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:37.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.902+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f428c088990 con 0x7f429c0c3460 2024-01-20T08:14:37.905 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.902+0000 7f42a0e00640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 0x7f427406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:37.906 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.902+0000 7f42a0e00640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 0x7f427406d390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4284036000 tx=0x7f4284008030 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:37.907 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:37.906+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f429c1e9b70 con 0x7f429c0c3460 2024-01-20T08:14:38.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.100+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f429c0a90d0 con 0x7f427406aed0 2024-01-20T08:14:38.102 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.100+0000 7f4299600640 1 -- 172.21.15.100:0/1204967590 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4284031b00 con 0x7f427406aed0 2024-01-20T08:14:38.102 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 0 to deep-scrub 2024-01-20T08:14:38.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 msgr2=0x7f427406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 0x7f427406d390 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4284036000 tx=0x7f4284008030 comp rx=0 tx=0).stop 2024-01-20T08:14:38.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 msgr2=0x7f429c0bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f428c00c4d0 tx=0x7f428c00c990 comp rx=0 tx=0).stop 2024-01-20T08:14:38.105 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 shutdown_connections 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f429c153120 0x7f429c144da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f427406aed0 0x7f427406d390 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f429c14fdb0 0x7f429c144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 --2- 172.21.15.100:0/1204967590 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f429c0c3460 0x7f429c0bf4e0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 >> 172.21.15.100:0/1204967590 conn(0x7f429c0c2940 msgr2=0x7f429c0c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 shutdown_connections 2024-01-20T08:14:38.106 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.103+0000 7f42a4200640 1 -- 172.21.15.100:0/1204967590 wait complete. 2024-01-20T08:14:38.123 INFO:tasks.ceph:Scrubbing osd.1 2024-01-20T08:14:38.123 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:38.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.335+0000 7f465b800640 1 Processor -- start 2024-01-20T08:14:38.337 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.335+0000 7f465b800640 1 -- start start 2024-01-20T08:14:38.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f465b800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4654070c00 0x7f465406d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f465b800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f46540a84a0 0x7f465415be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f465b800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465406d1d0 con 0x7f4654148080 2024-01-20T08:14:38.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f465b800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540a8ce0 con 0x7f46540a84a0 2024-01-20T08:14:38.339 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f465b800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4654148460 con 0x7f4654070c00 2024-01-20T08:14:38.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f4658e00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f4654148080 0x7f46540c1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:44426/0 (socket says 172.21.15.100:44426) 2024-01-20T08:14:38.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f4658e00640 1 -- 172.21.15.100:0/2103995323 learned_addr learned my addr 172.21.15.100:0/2103995323 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:38.340 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.337+0000 7f4659800640 1 --2- 172.21.15.100:0/2103995323 >> v2:172.21.15.100:3300/0 conn(0x7f46540a84a0 0x7f465415be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4653e00640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4654070c00 0x7f465406d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4653400640 1 -- 172.21.15.100:0/2103995323 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4234041949 0 0) 0x7f465406d1d0 con 0x7f4654148080 2024-01-20T08:14:38.341 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4653400640 1 -- 172.21.15.100:0/2103995323 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4634003520 con 0x7f4654148080 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4659800640 1 -- 172.21.15.100:0/2103995323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4654070c00 msgr2=0x7f465406d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4659800640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4654070c00 0x7f465406d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4659800640 1 -- 172.21.15.100:0/2103995323 >> v1:172.21.15.100:6789/0 conn(0x7f4654148080 legacy=0x7f46540c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.338+0000 7f4659800640 1 -- 172.21.15.100:0/2103995323 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46540c2540 con 0x7f46540a84a0 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.339+0000 7f4659800640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46540a84a0 0x7f465415be30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a243bf8b929c7475 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.339+0000 7f4653400640 1 -- 172.21.15.100:0/2103995323 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c02cbd0 con 0x7f46540a84a0 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.339+0000 7f4653400640 1 -- 172.21.15.100:0/2103995323 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464c02cd30 con 0x7f46540a84a0 2024-01-20T08:14:38.342 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.339+0000 7f4653400640 1 -- 172.21.15.100:0/2103995323 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464c02cea0 con 0x7f46540a84a0 2024-01-20T08:14:38.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 -- 172.21.15.100:0/2103995323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46540a84a0 msgr2=0x7f465415be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.343 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46540a84a0 0x7f465415be30 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f464c009d90 tx=0x7f464c02be20 comp rx=0 tx=0).stop 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 -- 172.21.15.100:0/2103995323 shutdown_connections 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f46540a84a0 0x7f465415be30 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 --2- 172.21.15.100:0/2103995323 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4654070c00 0x7f465406d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 -- 172.21.15.100:0/2103995323 >> 172.21.15.100:0/2103995323 conn(0x7f46540c2b00 msgr2=0x7f46540c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 -- 172.21.15.100:0/2103995323 shutdown_connections 2024-01-20T08:14:38.344 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.340+0000 7f465b800640 1 -- 172.21.15.100:0/2103995323 wait complete. 2024-01-20T08:14:38.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.342+0000 7f465b800640 1 Processor -- start 2024-01-20T08:14:38.345 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.342+0000 7f465b800640 1 -- start start 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 0x7f465414f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46540a84a0 0x7f46541502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4654148080 0x7f4654150f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465413ecb0 con 0x7f4654070c00 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4654155920 con 0x7f4654148080 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f465b800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46541eed30 con 0x7f46540a84a0 2024-01-20T08:14:38.347 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 0x7f465414f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 0x7f465414f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55870/0 (socket says 172.21.15.100:55870) 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 -- 172.21.15.100:0/2955377278 learned_addr learned my addr 172.21.15.100:0/2955377278 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4653e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46540a84a0 0x7f46541502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 -- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46540a84a0 msgr2=0x7f46541502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4659800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4654148080 0x7f4654150f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f46540a84a0 0x7f46541502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 -- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4654148080 msgr2=0x7f4654150f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.348 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4654148080 0x7f4654150f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.343+0000 7f4658e00640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c009a70 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f4658e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 0x7f465414f380 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f464400c390 tx=0x7f464400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644005ce0 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4644005e40 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440072f0 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46541ef010 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.344+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654152b80 con 0x7f4654070c00 2024-01-20T08:14:38.349 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.345+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46541522f0 con 0x7f4654070c00 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.346+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4644007450 con 0x7f4654070c00 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4650c00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f462c06aed0 0x7f462c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f46440888d0 con 0x7f4654070c00 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4653e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f462c06aed0 0x7f462c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4650c00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7f462c070dd0 0x7f462c0731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f462c0738a0 con 0x7f462c070dd0 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.347+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f464408d2c0 con 0x7f4654070c00 2024-01-20T08:14:38.351 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.348+0000 7f4659800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7f462c070dd0 0x7f462c0731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.348+0000 7f4653e00640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f462c06aed0 0x7f462c06d390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f465414efa0 tx=0x7f463c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.348+0000 7f4659800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7f462c070dd0 0x7f462c0731f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.352 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.349+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== osd.1 v2:172.21.15.100:6800/1719666364 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f462c0738a0 con 0x7f462c070dd0 2024-01-20T08:14:38.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 --> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4654072670 con 0x7f462c070dd0 2024-01-20T08:14:38.366 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f4650c00640 1 -- 172.21.15.100:0/2955377278 <== osd.1 v2:172.21.15.100:6800/1719666364 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f464c009450 con 0x7f462c070dd0 2024-01-20T08:14:38.366 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:38.366 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:38.366 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7f462c070dd0 msgr2=0x7f462c0731f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6800/1719666364,v1:172.21.15.100:6801/1719666364] conn(0x7f462c070dd0 0x7f462c0731f0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f462c06aed0 msgr2=0x7f462c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f462c06aed0 0x7f462c06d390 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f465414efa0 tx=0x7f463c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 msgr2=0x7f465414f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.364+0000 7f465b800640 1 --2- 172.21.15.100:0/2955377278 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4654070c00 0x7f465414f380 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f464400c390 tx=0x7f464400c850 comp rx=0 tx=0).stop 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.365+0000 7f4659800640 1 -- 172.21.15.100:0/2955377278 reap_dead start 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.365+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 shutdown_connections 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.365+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 >> 172.21.15.100:0/2955377278 conn(0x7f46540c2b00 msgr2=0x7f46540c08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:38.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.365+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 shutdown_connections 2024-01-20T08:14:38.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.365+0000 7f465b800640 1 -- 172.21.15.100:0/2955377278 wait complete. 2024-01-20T08:14:38.385 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-01-20T08:14:38.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.580+0000 7f4d24a00640 1 Processor -- start 2024-01-20T08:14:38.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.580+0000 7f4d24a00640 1 -- start start 2024-01-20T08:14:38.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.582+0000 7f4d24a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.582+0000 7f4d24a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.582+0000 7f4d24a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c154ba0 con 0x7f4d1c06c8d0 2024-01-20T08:14:38.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.582+0000 7f4d24a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c14bb00 con 0x7f4d1c0c1850 2024-01-20T08:14:38.584 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.582+0000 7f4d24a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c155a00 con 0x7f4d1c14b720 2024-01-20T08:14:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.583+0000 7f4d22000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.583+0000 7f4d21600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.583+0000 7f4d22000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3301/0 says I am v2:172.21.15.100:48254/0 (socket says 172.21.15.100:48254) 2024-01-20T08:14:38.585 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.583+0000 7f4d21600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.110:3300/0 says I am v2:172.21.15.100:55164/0 (socket says 172.21.15.100:55164) 2024-01-20T08:14:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.583+0000 7f4d22000640 1 -- 172.21.15.100:0/3075972431 learned_addr learned my addr 172.21.15.100:0/3075972431 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.584+0000 7f4d22000640 1 -- 172.21.15.100:0/3075972431 >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 msgr2=0x7f4d1c0c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:38.586 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.584+0000 7f4d22000640 1 --2- 172.21.15.100:0/3075972431 >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.584+0000 7f4d22000640 1 -- 172.21.15.100:0/3075972431 >> v1:172.21.15.110:6789/0 conn(0x7f4d1c06c8d0 legacy=0x7f4d1c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.584+0000 7f4d22000640 1 -- 172.21.15.100:0/3075972431 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c154df0 con 0x7f4d1c14b720 2024-01-20T08:14:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.584+0000 7f4d21600640 1 --2- 172.21.15.100:0/3075972431 >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:14:38.587 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.585+0000 7f4d22000640 1 --2- 172.21.15.100:0/3075972431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009e50 tx=0x7f4d0c02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a4e36e640ec269 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.586+0000 7f4d20c00640 1 -- 172.21.15.100:0/3075972431 <== mon.2 v2:172.21.15.110:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c02ca70 con 0x7f4d1c14b720 2024-01-20T08:14:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.586+0000 7f4d20c00640 1 -- 172.21.15.100:0/3075972431 <== mon.2 v2:172.21.15.110:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c02cbd0 con 0x7f4d1c14b720 2024-01-20T08:14:38.588 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.586+0000 7f4d20c00640 1 -- 172.21.15.100:0/3075972431 <== mon.2 v2:172.21.15.110:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c0343f0 con 0x7f4d1c14b720 2024-01-20T08:14:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 -- 172.21.15.100:0/3075972431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 msgr2=0x7f4d1c1515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3075972431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c009e50 tx=0x7f4d0c02bed0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 -- 172.21.15.100:0/3075972431 shutdown_connections 2024-01-20T08:14:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3075972431 >> v2:172.21.15.110:3300/0 conn(0x7f4d1c0c1850 0x7f4d1c0c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.589 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3075972431 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c14b720 0x7f4d1c1515b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 -- 172.21.15.100:0/3075972431 >> 172.21.15.100:0/3075972431 conn(0x7f4d1c0c2940 msgr2=0x7f4d1c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 -- 172.21.15.100:0/3075972431 shutdown_connections 2024-01-20T08:14:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.587+0000 7f4d24a00640 1 -- 172.21.15.100:0/3075972431 wait complete. 2024-01-20T08:14:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.589+0000 7f4d24a00640 1 Processor -- start 2024-01-20T08:14:38.590 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.589+0000 7f4d24a00640 1 -- start start 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 0x7f4d1c148b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 0x7f4d1c1edc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c1e7a00 con 0x7f4d1c14b720 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c1ee140 con 0x7f4d1c06c8d0 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d24a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c13ffd0 con 0x7f4d1c0c1850 2024-01-20T08:14:38.592 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:55886/0 (socket says 172.21.15.100:55886) 2024-01-20T08:14:38.593 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22a00640 1 -- 172.21.15.100:0/3268424258 learned_addr learned my addr 172.21.15.100:0/3268424258 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:38.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22000640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 0x7f4d1c148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.594 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d21600640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 0x7f4d1c1edc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22a00640 1 -- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 msgr2=0x7f4d1c1edc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.590+0000 7f4d22a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 0x7f4d1c1edc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d22a00640 1 -- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 msgr2=0x7f4d1c148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d22a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 0x7f4d1c148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d22a00640 1 -- 172.21.15.100:0/3268424258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d04009400 con 0x7f4d1c14b720 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d22000640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 0x7f4d1c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d21600640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 0x7f4d1c1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d22a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c390 tx=0x7f4d1400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.595 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d140052d0 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d14005430 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d14003810 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0c009b30 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.591+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c1480a0 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.593+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c04e970 con 0x7f4d1c14b720 2024-01-20T08:14:38.596 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.594+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4d14003970 con 0x7f4d1c14b720 2024-01-20T08:14:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.595+0000 7f4d1a000640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 0x7f4cf406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.595+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4d140887d0 con 0x7f4d1c14b720 2024-01-20T08:14:38.597 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.595+0000 7f4d22000640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 0x7f4cf406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:38.598 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.596+0000 7f4d22000640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 0x7f4cf406d3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c035000 tx=0x7f4d0c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:38.601 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.600+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4d140539d0 con 0x7f4d1c14b720 2024-01-20T08:14:38.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.791+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d1c155690 con 0x7f4cf406af00 2024-01-20T08:14:38.794 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.792+0000 7f4d1a000640 1 -- 172.21.15.100:0/3268424258 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d0c044090 con 0x7f4cf406af00 2024-01-20T08:14:38.794 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 1 to deep-scrub 2024-01-20T08:14:38.796 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 msgr2=0x7f4cf406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 0x7f4cf406d3c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c035000 tx=0x7f4d0c030000 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 msgr2=0x7f4d1c0bf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c390 tx=0x7f4d1400c850 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 shutdown_connections 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4d1c14b720 0x7f4d1c0bf4e0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4cf406af00 0x7f4cf406d3c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4d1c0c1850 0x7f4d1c1edc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 --2- 172.21.15.100:0/3268424258 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4d1c06c8d0 0x7f4d1c148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:38.797 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.794+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 >> 172.21.15.100:0/3268424258 conn(0x7f4d1c0c2940 msgr2=0x7f4d1c1543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:38.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.795+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 shutdown_connections 2024-01-20T08:14:38.798 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:38.795+0000 7f4d24a00640 1 -- 172.21.15.100:0/3268424258 wait complete. 2024-01-20T08:14:38.815 INFO:tasks.ceph:Scrubbing osd.2 2024-01-20T08:14:38.815 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:39.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.011+0000 7f5c4fc00640 1 Processor -- start 2024-01-20T08:14:39.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.011+0000 7f5c4fc00640 1 -- start start 2024-01-20T08:14:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c48148080 0x7f5c480c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5c48070c00 0x7f5c4806d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480a8ce0 con 0x7f5c48148080 2024-01-20T08:14:39.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c48148460 con 0x7f5c48070c00 2024-01-20T08:14:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4fc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4806d1d0 con 0x7f5c480a84a0 2024-01-20T08:14:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c48148080 0x7f5c480c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4d200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5c48148080 0x7f5c480c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48126/0 (socket says 172.21.15.100:48126) 2024-01-20T08:14:39.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.012+0000 7f5c4d200640 1 -- 172.21.15.100:0/875899207 learned_addr learned my addr 172.21.15.100:0/875899207 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4dc00640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4d200640 1 -- 172.21.15.100:0/875899207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 msgr2=0x7f5c48154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4d200640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4d200640 1 -- 172.21.15.100:0/875899207 >> v2:172.21.15.110:3300/0 conn(0x7f5c48070c00 msgr2=0x7f5c4806d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4d200640 1 --2- 172.21.15.100:0/875899207 >> v2:172.21.15.110:3300/0 conn(0x7f5c48070c00 0x7f5c4806d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.013+0000 7f5c4d200640 1 -- 172.21.15.100:0/875899207 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c480c2540 con 0x7f5c48148080 2024-01-20T08:14:39.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.014+0000 7f5c4d200640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48148080 0x7f5c480c1a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009870 tx=0x7f5c3802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3bed6b63d0c8be2 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.014+0000 7f5c47e00640 1 -- 172.21.15.100:0/875899207 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380317c0 con 0x7f5c48148080 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.014+0000 7f5c47e00640 1 -- 172.21.15.100:0/875899207 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38031920 con 0x7f5c48148080 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.014+0000 7f5c47e00640 1 -- 172.21.15.100:0/875899207 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c38031cb0 con 0x7f5c48148080 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 -- 172.21.15.100:0/875899207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48148080 msgr2=0x7f5c480c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48148080 0x7f5c480c1a10 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f5c38009870 tx=0x7f5c3802b860 comp rx=0 tx=0).stop 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 -- 172.21.15.100:0/875899207 shutdown_connections 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/875899207 >> v2:172.21.15.110:3300/0 conn(0x7f5c48070c00 0x7f5c4806d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/875899207 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48148080 0x7f5c480c1a10 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 -- 172.21.15.100:0/875899207 >> 172.21.15.100:0/875899207 conn(0x7f5c480c2b00 msgr2=0x7f5c480c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 -- 172.21.15.100:0/875899207 shutdown_connections 2024-01-20T08:14:39.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.015+0000 7f5c4fc00640 1 -- 172.21.15.100:0/875899207 wait complete. 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.017+0000 7f5c4fc00640 1 Processor -- start 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.017+0000 7f5c4fc00640 1 -- start start 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 0x7f5c481ee2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c48148080 0x7f5c4813e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.021 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4813e060 con 0x7f5c48070c00 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481ee810 con 0x7f5c48148080 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4fc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4813f520 con 0x7f5c480a84a0 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 0x7f5c481ee2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 0x7f5c481ee2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48132/0 (socket says 172.21.15.100:48132) 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 -- 172.21.15.100:0/4256263568 learned_addr learned my addr 172.21.15.100:0/4256263568 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 -- 172.21.15.100:0/4256263568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 msgr2=0x7f5c48150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5c480a84a0 0x7f5c48150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 -- 172.21.15.100:0/4256263568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c48148080 msgr2=0x7f5c4813e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.022 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5c48148080 0x7f5c4813e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.018+0000 7f5c4d200640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c380094d0 con 0x7f5c48070c00 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c4d200640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 0x7f5c481ee2d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f5c38000c00 tx=0x7f5c380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380329a0 con 0x7f5c48070c00 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c38032b20 con 0x7f5c48070c00 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c380453f0 con 0x7f5c48070c00 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c4813f800 con 0x7f5c48070c00 2024-01-20T08:14:39.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.019+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c481511e0 con 0x7f5c48070c00 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.020+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5c481522f0 con 0x7f5c48070c00 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.021+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5c3804d3f0 con 0x7f5c48070c00 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c45600640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c2006aed0 0x7f5c2006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5c380ab400 con 0x7f5c48070c00 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c3fc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c2006aed0 0x7f5c2006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c45600640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7f5c20070dd0 0x7f5c200731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.025 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5c200738a0 con 0x7f5c20070dd0 2024-01-20T08:14:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.022+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5c380ad9e0 con 0x7f5c48070c00 2024-01-20T08:14:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.023+0000 7f5c4dc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7f5c20070dd0 0x7f5c200731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.023+0000 7f5c3fc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c2006aed0 0x7f5c2006d390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5c4813f0e0 tx=0x7f5c30006c90 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.023+0000 7f5c4dc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7f5c20070dd0 0x7f5c200731f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.026 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.024+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== osd.2 v2:172.21.15.100:6810/194905097 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f5c200738a0 con 0x7f5c20070dd0 2024-01-20T08:14:39.040 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.039+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 --> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5c48072670 con 0x7f5c20070dd0 2024-01-20T08:14:39.041 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.039+0000 7f5c45600640 1 -- 172.21.15.100:0/4256263568 <== osd.2 v2:172.21.15.100:6810/194905097 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5c400079b0 con 0x7f5c20070dd0 2024-01-20T08:14:39.041 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:39.041 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:39.041 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:39.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.039+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7f5c20070dd0 msgr2=0x7f5c200731f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.039+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6810/194905097,v1:172.21.15.100:6812/194905097] conn(0x7f5c20070dd0 0x7f5c200731f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.042 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c2006aed0 msgr2=0x7f5c2006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5c2006aed0 0x7f5c2006d390 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f5c4813f0e0 tx=0x7f5c30006c90 comp rx=0 tx=0).stop 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 msgr2=0x7f5c481ee2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 --2- 172.21.15.100:0/4256263568 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5c48070c00 0x7f5c481ee2d0 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f5c38000c00 tx=0x7f5c380046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4dc00640 1 -- 172.21.15.100:0/4256263568 reap_dead start 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 shutdown_connections 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 >> 172.21.15.100:0/4256263568 conn(0x7f5c480c2b00 msgr2=0x7f5c4806c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 shutdown_connections 2024-01-20T08:14:39.043 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.040+0000 7f5c4fc00640 1 -- 172.21.15.100:0/4256263568 wait complete. 2024-01-20T08:14:39.057 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-01-20T08:14:39.243 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.241+0000 7f6e7a600640 1 Processor -- start 2024-01-20T08:14:39.244 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.241+0000 7f6e7a600640 1 -- start start 2024-01-20T08:14:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e7a600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6e740c24f0 0x7f6e74157da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e7a600640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f6e741550c0 0x7f6e740c1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e7a600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e74071d00 con 0x7f6e74158af0 2024-01-20T08:14:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e7a600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e74154ca0 con 0x7f6e740c24f0 2024-01-20T08:14:39.245 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e7a600640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e74071fa0 con 0x7f6e741550c0 2024-01-20T08:14:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e73400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f6e74158af0 0x7f6e7406e220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50532/0 (socket says 172.21.15.100:50532) 2024-01-20T08:14:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e72a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f6e740c24f0 0x7f6e74157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.246 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.243+0000 7f6e73400640 1 -- 172.21.15.100:0/2684748071 learned_addr learned my addr 172.21.15.100:0/2684748071 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:39.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e73e00640 1 --2- 172.21.15.100:0/2684748071 >> v2:172.21.15.110:3300/0 conn(0x7f6e741550c0 0x7f6e740c1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e72a00640 1 -- 172.21.15.100:0/2684748071 >> v2:172.21.15.110:3300/0 conn(0x7f6e741550c0 msgr2=0x7f6e740c1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e72a00640 1 --2- 172.21.15.100:0/2684748071 >> v2:172.21.15.110:3300/0 conn(0x7f6e741550c0 0x7f6e740c1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e72a00640 1 -- 172.21.15.100:0/2684748071 >> v1:172.21.15.100:6789/0 conn(0x7f6e74158af0 legacy=0x7f6e7406e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.248 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e72a00640 1 -- 172.21.15.100:0/2684748071 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e74072280 con 0x7f6e740c24f0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.244+0000 7f6e72000640 1 -- 172.21.15.100:0/2684748071 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635157549 0 0) 0x7f6e74071d00 con 0x7f6e74158af0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.245+0000 7f6e72a00640 1 --2- 172.21.15.100:0/2684748071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e74157da0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6e74071c50 tx=0x7f6e5c02b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d84947ae04f4314 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.245+0000 7f6e72000640 1 -- 172.21.15.100:0/2684748071 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c031710 con 0x7f6e740c24f0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.245+0000 7f6e72000640 1 -- 172.21.15.100:0/2684748071 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e5c02f050 con 0x7f6e740c24f0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.245+0000 7f6e72000640 1 -- 172.21.15.100:0/2684748071 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e5c031a90 con 0x7f6e740c24f0 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 -- 172.21.15.100:0/2684748071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 msgr2=0x7f6e74157da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 --2- 172.21.15.100:0/2684748071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e74157da0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7f6e74071c50 tx=0x7f6e5c02b7b0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.249 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 -- 172.21.15.100:0/2684748071 shutdown_connections 2024-01-20T08:14:39.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 --2- 172.21.15.100:0/2684748071 >> v2:172.21.15.110:3300/0 conn(0x7f6e741550c0 0x7f6e740c1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 --2- 172.21.15.100:0/2684748071 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e74157da0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 -- 172.21.15.100:0/2684748071 >> 172.21.15.100:0/2684748071 conn(0x7f6e740c2940 msgr2=0x7f6e740c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 -- 172.21.15.100:0/2684748071 shutdown_connections 2024-01-20T08:14:39.250 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.246+0000 7f6e7a600640 1 -- 172.21.15.100:0/2684748071 wait complete. 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.247+0000 7f6e7a600640 1 Processor -- start 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.247+0000 7f6e7a600640 1 -- start start 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e741550c0 0x7f6e741eab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74158af0 0x7f6e740c5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.252 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e74157050 con 0x7f6e740c24f0 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e741ed6d0 con 0x7f6e74158af0 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e7a600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e741ea3a0 con 0x7f6e741550c0 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e73400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48140/0 (socket says 172.21.15.100:48140) 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.248+0000 7f6e73400640 1 -- 172.21.15.100:0/1431978637 learned_addr learned my addr 172.21.15.100:0/1431978637 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 -- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e741550c0 msgr2=0x7f6e741eab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e741550c0 0x7f6e741eab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.253 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 -- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74158af0 msgr2=0x7f6e740c5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74158af0 0x7f6e740c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 -- 172.21.15.100:0/1431978637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c009400 con 0x7f6e740c24f0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e73400640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c4d0 tx=0x7f6e6400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e640074e0 con 0x7f6e740c24f0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e64007660 con 0x7f6e740c24f0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e64004a20 con 0x7f6e740c24f0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.249+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e74157f00 con 0x7f6e740c24f0 2024-01-20T08:14:39.254 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.250+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e741ee6a0 con 0x7f6e740c24f0 2024-01-20T08:14:39.255 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.251+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e7404e970 con 0x7f6e740c24f0 2024-01-20T08:14:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.251+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f6e64004b80 con 0x7f6e740c24f0 2024-01-20T08:14:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.252+0000 7f6e6b400640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.252+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f6e640888d0 con 0x7f6e740c24f0 2024-01-20T08:14:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.253+0000 7f6e72a00640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.256 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.253+0000 7f6e72a00640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 0x7f6e4c06d390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c035000 tx=0x7f6e5c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.258 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.257+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f6e64053a30 con 0x7f6e740c24f0 2024-01-20T08:14:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.449+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e741ee890 con 0x7f6e4c06aed0 2024-01-20T08:14:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.450+0000 7f6e6b400640 1 -- 172.21.15.100:0/1431978637 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f6e741ee890 con 0x7f6e4c06aed0 2024-01-20T08:14:39.452 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 2 to deep-scrub 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 msgr2=0x7f6e4c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 0x7f6e4c06d390 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c035000 tx=0x7f6e5c030000 comp rx=0 tx=0).stop 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 msgr2=0x7f6e741eb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f6e6400c4d0 tx=0x7f6e6400c990 comp rx=0 tx=0).stop 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 shutdown_connections 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f6e74158af0 0x7f6e740c5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.455 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f6e4c06aed0 0x7f6e4c06d390 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f6e741550c0 0x7f6e741eab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 --2- 172.21.15.100:0/1431978637 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6e740c24f0 0x7f6e741eb810 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 >> 172.21.15.100:0/1431978637 conn(0x7f6e740c2940 msgr2=0x7f6e740713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 shutdown_connections 2024-01-20T08:14:39.456 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.453+0000 7f6e7a600640 1 -- 172.21.15.100:0/1431978637 wait complete. 2024-01-20T08:14:39.474 INFO:tasks.ceph:Scrubbing osd.3 2024-01-20T08:14:39.474 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:39.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.684+0000 7f3142e00640 1 Processor -- start 2024-01-20T08:14:39.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.684+0000 7f3142e00640 1 -- start start 2024-01-20T08:14:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3142e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f313c158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3142e00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f313c0c3c30 0x7f313c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3142e00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313c158dd0 con 0x7f313c072500 2024-01-20T08:14:39.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3142e00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f313c0c1830 con 0x7f313c0c3c30 2024-01-20T08:14:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3142e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0c05a0 con 0x7f313c06e0b0 2024-01-20T08:14:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3141000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f313c072500 0x7f313c0c2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50536/0 (socket says 172.21.15.100:50536) 2024-01-20T08:14:39.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3141000640 1 -- 172.21.15.100:0/2875394847 learned_addr learned my addr 172.21.15.100:0/2875394847 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:39.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.686+0000 7f3141a00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f313c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f3142400640 1 --2- 172.21.15.100:0/2875394847 >> v2:172.21.15.110:3300/0 conn(0x7f313c0c3c30 0x7f313c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144038754 0 0) 0x7f3124001110 con 0x7f313c072500 2024-01-20T08:14:39.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f311c003520 con 0x7f313c072500 2024-01-20T08:14:39.691 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2677104172 0 0) 0x7f311c003520 con 0x7f313c072500 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 msgr2=0x7f313c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f313c158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 >> v2:172.21.15.110:3300/0 conn(0x7f313c0c3c30 msgr2=0x7f313c0c4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 --2- 172.21.15.100:0/2875394847 >> v2:172.21.15.110:3300/0 conn(0x7f313c0c3c30 0x7f313c0c4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0c0fb0 con 0x7f313c072500 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3124001800 con 0x7f313c072500 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 >> v1:172.21.15.100:6789/0 conn(0x7f313c072500 legacy=0x7f313c0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f311c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0c1830 con 0x7f311c0047c0 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c0c05a0 con 0x7f311c003970 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.687+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c00b980 con 0x7f313c06e0b0 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141a00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3142400640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f311c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 -- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 msgr2=0x7f311c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.693 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c06e0b0 0x7f311c005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 -- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c003970 msgr2=0x7f311c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f311c003970 0x7f311c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.688+0000 7f3141000640 1 -- 172.21.15.100:0/2875394847 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c003520 con 0x7f311c0047c0 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.689+0000 7f3141000640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f312400c0e0 tx=0x7f311c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a95a5e0db242d34e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.689+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3124005ad0 con 0x7f311c0047c0 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.689+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3124005c30 con 0x7f311c0047c0 2024-01-20T08:14:39.694 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.689+0000 7f313be00640 1 -- 172.21.15.100:0/2875394847 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31240070f0 con 0x7f311c0047c0 2024-01-20T08:14:39.696 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 -- 172.21.15.100:0/2875394847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 msgr2=0x7f311c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 --2- 172.21.15.100:0/2875394847 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f311c004c40 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f312400c0e0 tx=0x7f311c0057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142400640 1 -- 172.21.15.100:0/2875394847 reap_dead start 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 -- 172.21.15.100:0/2875394847 shutdown_connections 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 -- 172.21.15.100:0/2875394847 >> 172.21.15.100:0/2875394847 conn(0x7f313c0c5ba0 msgr2=0x7f313c0c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 -- 172.21.15.100:0/2875394847 shutdown_connections 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.690+0000 7f3142e00640 1 -- 172.21.15.100:0/2875394847 wait complete. 2024-01-20T08:14:39.697 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.692+0000 7f3142e00640 1 Processor -- start 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.692+0000 7f3142e00640 1 -- start start 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f313c1583e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c1e1660 0x7f313c1563f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f313c156930 0x7f313c1ed610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c155fd0 con 0x7f311c0047c0 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1e12b0 con 0x7f313c156930 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3142e00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313c1e0250 con 0x7f313c1e1660 2024-01-20T08:14:39.698 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f313c1583e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f313c1583e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48158/0 (socket says 172.21.15.100:48158) 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 -- 172.21.15.100:0/3207727952 learned_addr learned my addr 172.21.15.100:0/3207727952 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 -- 172.21.15.100:0/3207727952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c1e1660 msgr2=0x7f313c1563f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f313c1e1660 0x7f313c1563f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 -- 172.21.15.100:0/3207727952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f313c156930 msgr2=0x7f313c1ed610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f313c156930 0x7f313c1ed610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.693+0000 7f3141a00640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c155c80 con 0x7f311c0047c0 2024-01-20T08:14:39.699 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3141a00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f313c1583e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f312c011590 tx=0x7f312c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c015870 con 0x7f311c0047c0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f312c0159d0 con 0x7f311c0047c0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f312c015d60 con 0x7f311c0047c0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f313c1e1b80 con 0x7f311c0047c0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.694+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f313c1eaea0 con 0x7f311c0047c0 2024-01-20T08:14:39.700 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.695+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f313c0c07b0 con 0x7f311c0047c0 2024-01-20T08:14:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.696+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f312c01d400 con 0x7f311c0047c0 2024-01-20T08:14:39.701 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3139600640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f311406af00 0x7f311406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f312c089a00 con 0x7f311c0047c0 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3139600640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f3114070e00 0x7f3114073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f31140738d0 con 0x7f3114070e00 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3141000640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f311406af00 0x7f311406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f312c08e2a0 con 0x7f311c0047c0 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.697+0000 7f3142400640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f3114070e00 0x7f3114073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.698+0000 7f3141000640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f311406af00 0x7f311406d3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3124034000 tx=0x7f312402e000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.702 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.698+0000 7f3142400640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f3114070e00 0x7f3114073220 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.703 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.699+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== osd.3 v2:172.21.15.100:6808/37037686 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f31140738d0 con 0x7f3114070e00 2024-01-20T08:14:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.713+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 --> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f313c0c1550 con 0x7f3114070e00 2024-01-20T08:14:39.715 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.713+0000 7f3139600640 1 -- 172.21.15.100:0/3207727952 <== osd.3 v2:172.21.15.100:6808/37037686 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f3134013310 con 0x7f3114070e00 2024-01-20T08:14:39.715 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:39.716 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:39.716 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f3114070e00 msgr2=0x7f3114073220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6808/37037686,v1:172.21.15.100:6809/37037686] conn(0x7f3114070e00 0x7f3114073220 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f311406af00 msgr2=0x7f311406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f311406af00 0x7f311406d3c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3124034000 tx=0x7f312402e000 comp rx=0 tx=0).stop 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 msgr2=0x7f313c1583e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 --2- 172.21.15.100:0/3207727952 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f311c0047c0 0x7f313c1583e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f312c011590 tx=0x7f312c011a50 comp rx=0 tx=0).stop 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142400640 1 -- 172.21.15.100:0/3207727952 reap_dead start 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 shutdown_connections 2024-01-20T08:14:39.717 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 >> 172.21.15.100:0/3207727952 conn(0x7f313c0c5ba0 msgr2=0x7f313c0c5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 shutdown_connections 2024-01-20T08:14:39.718 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.714+0000 7f3142e00640 1 -- 172.21.15.100:0/3207727952 wait complete. 2024-01-20T08:14:39.733 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-01-20T08:14:39.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.933+0000 7f3b44600640 1 Processor -- start 2024-01-20T08:14:39.935 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.933+0000 7f3b44600640 1 -- start start 2024-01-20T08:14:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.934+0000 7f3b44600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b3c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.934+0000 7f3b44600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c154ba0 con 0x7f3b3c0c1850 2024-01-20T08:14:39.936 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.934+0000 7f3b44600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3c155a00 con 0x7f3b3c0c1cd0 2024-01-20T08:14:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.934+0000 7f3b44600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c14bb00 con 0x7f3b3c14b720 2024-01-20T08:14:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b41200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f3b3c0c1850 0x7f3b3c06c8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50546/0 (socket says 172.21.15.100:50546) 2024-01-20T08:14:39.937 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b41200640 1 -- 172.21.15.100:0/3574555683 learned_addr learned my addr 172.21.15.100:0/3574555683 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b41c00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b3c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3017354188 0 0) 0x7f3b3c154ba0 con 0x7f3b3c0c1850 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b1c005730 con 0x7f3b3c0c1850 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 21595377 0 0) 0x7f3b1c005730 con 0x7f3b3c0c1850 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 msgr2=0x7f3b3c1515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b3c1515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.939 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 >> v1:172.21.15.110:6789/0 conn(0x7f3b3c0c1cd0 legacy=0x7f3b3c06cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c154df0 con 0x7f3b3c0c1850 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f3b24001670 con 0x7f3b3c0c1850 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 >> v1:172.21.15.100:6789/0 conn(0x7f3b3c0c1850 legacy=0x7f3b3c06c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.935+0000 7f3b3be00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b1c005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b3be00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b1c0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b3be00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c006f10 0x7f3b1c007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c14bb00 con 0x7f3b1c006180 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c00de20 con 0x7f3b1c006f10 2024-01-20T08:14:39.940 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1c00dfe0 con 0x7f3b3c14b720 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b1c0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41c00640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b1c005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b42600640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c006f10 0x7f3b1c007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 -- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 msgr2=0x7f3b1c005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c14b720 0x7f3b1c005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 -- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c006f10 msgr2=0x7f3b1c007370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c006f10 0x7f3b1c007370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b41200640 1 -- 172.21.15.100:0/3574555683 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b1c005730 con 0x7f3b1c006180 2024-01-20T08:14:39.941 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.936+0000 7f3b42600640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b1c006f10 0x7f3b1c007370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.937+0000 7f3b41200640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b1c0069d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c0e0 tx=0x7f3b1c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25409493d0b316a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b24005ad0 con 0x7f3b1c006180 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b24005c30 con 0x7f3b1c006180 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b3be00640 1 -- 172.21.15.100:0/3574555683 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2402c7d0 con 0x7f3b1c006180 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 -- 172.21.15.100:0/3574555683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 msgr2=0x7f3b1c0069d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 --2- 172.21.15.100:0/3574555683 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b1c0069d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400c0e0 tx=0x7f3b1c007a00 comp rx=0 tx=0).stop 2024-01-20T08:14:39.945 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b42600640 1 -- 172.21.15.100:0/3574555683 reap_dead start 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 -- 172.21.15.100:0/3574555683 shutdown_connections 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 -- 172.21.15.100:0/3574555683 >> 172.21.15.100:0/3574555683 conn(0x7f3b3c0c2940 msgr2=0x7f3b3c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 -- 172.21.15.100:0/3574555683 shutdown_connections 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.938+0000 7f3b44600640 1 -- 172.21.15.100:0/3574555683 wait complete. 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.940+0000 7f3b44600640 1 Processor -- start 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.940+0000 7f3b44600640 1 -- start start 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c0711e0 0x7f3b3c071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.946 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 0x7f3b3c148c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1daef0 con 0x7f3b1c006180 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c1ea330 con 0x7f3b3c148810 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b44600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3c147d10 con 0x7f3b3c0711e0 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48190/0 (socket says 172.21.15.100:48190) 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41c00640 1 -- 172.21.15.100:0/3202609957 learned_addr learned my addr 172.21.15.100:0/3202609957 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b42600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 0x7f3b3c148c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.947 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41c00640 1 -- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c0711e0 msgr2=0x7f3b3c071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41200640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c0711e0 0x7f3b3c071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.941+0000 7f3b41c00640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c0711e0 0x7f3b3c071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b41c00640 1 -- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 msgr2=0x7f3b3c148c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b41c00640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 0x7f3b3c148c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b41c00640 1 -- 172.21.15.100:0/3202609957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3c1ea5f0 con 0x7f3b1c006180 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b42600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 0x7f3b3c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b41c00640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c007f30 tx=0x7f3b2c011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.948 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c00e030 con 0x7f3b1c006180 2024-01-20T08:14:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c016470 con 0x7f3b1c006180 2024-01-20T08:14:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b3c1ea8d0 con 0x7f3b1c006180 2024-01-20T08:14:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c016820 con 0x7f3b1c006180 2024-01-20T08:14:39.949 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.942+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b3c1eae90 con 0x7f3b1c006180 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.943+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b3c1eb050 con 0x7f3b1c006180 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.945+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f3b2c016980 con 0x7f3b1c006180 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.945+0000 7f3b39600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.946+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3b2c00f070 con 0x7f3b1c006180 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.946+0000 7f3b41200640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:39.950 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.946+0000 7f3b41200640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 0x7f3b1406d390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b24034000 tx=0x7f3b24037040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:39.952 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:39.950+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3b2c0554a0 con 0x7f3b1c006180 2024-01-20T08:14:40.134 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.132+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b3c155690 con 0x7f3b1406aed0 2024-01-20T08:14:40.135 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.133+0000 7f3b39600640 1 -- 172.21.15.100:0/3202609957 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3b24001430 con 0x7f3b1406aed0 2024-01-20T08:14:40.135 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 3 to deep-scrub 2024-01-20T08:14:40.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 msgr2=0x7f3b1406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 0x7f3b1406d390 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3b24034000 tx=0x7f3b24037040 comp rx=0 tx=0).stop 2024-01-20T08:14:40.138 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 msgr2=0x7f3b3c152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c007f30 tx=0x7f3b2c011660 comp rx=0 tx=0).stop 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 shutdown_connections 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f3b3c148810 0x7f3b3c148c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f3b1406aed0 0x7f3b1406d390 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f3b3c0711e0 0x7f3b3c071660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 --2- 172.21.15.100:0/3202609957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3b1c006180 0x7f3b3c152070 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 >> 172.21.15.100:0/3202609957 conn(0x7f3b3c0c2940 msgr2=0x7f3b3c0c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 shutdown_connections 2024-01-20T08:14:40.139 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.136+0000 7f3b44600640 1 -- 172.21.15.100:0/3202609957 wait complete. 2024-01-20T08:14:40.155 INFO:tasks.ceph:Scrubbing osd.4 2024-01-20T08:14:40.155 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:40.363 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.361+0000 7f99a6000640 1 Processor -- start 2024-01-20T08:14:40.364 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.362+0000 7f99a6000640 1 -- start start 2024-01-20T08:14:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.363+0000 7f99a6000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99a00a4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.363+0000 7f99a6000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0156710 con 0x7f99a00c4ed0 2024-01-20T08:14:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.363+0000 7f99a6000640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a0155b00 con 0x7f99a00a5240 2024-01-20T08:14:40.365 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.363+0000 7f99a6000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a014fff0 con 0x7f99a014fc10 2024-01-20T08:14:40.367 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.363+0000 7f9997c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f99a00c4ed0 0x7f99a00c3aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50548/0 (socket says 172.21.15.100:50548) 2024-01-20T08:14:40.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f9997c00640 1 -- 172.21.15.100:0/3825492213 learned_addr learned my addr 172.21.15.100:0/3825492213 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:40.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f99a4c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99a00a4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344602759 0 0) 0x7f99a0156710 con 0x7f99a00c4ed0 2024-01-20T08:14:40.368 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9980003520 con 0x7f99a00c4ed0 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2909466921 0 0) 0x7f9980003520 con 0x7f99a00c4ed0 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 msgr2=0x7f99a00a4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99a00a4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 >> v1:172.21.15.110:6789/0 conn(0x7f99a00a5240 legacy=0x7f99a00c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a0155de0 con 0x7f99a00c4ed0 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f9988001670 con 0x7f99a00c4ed0 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 >> v1:172.21.15.100:6789/0 conn(0x7f99a00c4ed0 legacy=0x7f99a00c3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.369 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99800039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.364+0000 7f999fe00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9980003f70 0x7f99800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f999fe00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980004d00 0x7f9980005160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a014fff0 con 0x7f9980003f70 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9980010020 con 0x7f9980004d00 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99800101e0 con 0x7f99a014fc10 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9980003f70 0x7f99800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f99a4c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99800039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.370 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f99a5600640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980004d00 0x7f9980005160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 -- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 msgr2=0x7f99800039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a014fc10 0x7f99800039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 -- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980004d00 msgr2=0x7f9980005160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980004d00 0x7f9980005160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.365+0000 7f9997c00640 1 -- 172.21.15.100:0/3825492213 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9980003520 con 0x7f9980003f70 2024-01-20T08:14:40.371 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.366+0000 7f99a5600640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980004d00 0x7f9980005160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:40.372 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.367+0000 7f9997c00640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9980003f70 0x7f99800047c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9988001050 tx=0x7f99800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c4f937c677bc35e server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.367+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9988005ad0 con 0x7f9980003f70 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.367+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9988005c30 con 0x7f9980003f70 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.367+0000 7f999fe00640 1 -- 172.21.15.100:0/3825492213 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998802c790 con 0x7f9980003f70 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 -- 172.21.15.100:0/3825492213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9980003f70 msgr2=0x7f99800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 --2- 172.21.15.100:0/3825492213 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9980003f70 0x7f99800047c0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f9988001050 tx=0x7f99800057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a5600640 1 -- 172.21.15.100:0/3825492213 reap_dead start 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 -- 172.21.15.100:0/3825492213 shutdown_connections 2024-01-20T08:14:40.373 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 -- 172.21.15.100:0/3825492213 >> 172.21.15.100:0/3825492213 conn(0x7f99a00c5ba0 msgr2=0x7f99a00c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 -- 172.21.15.100:0/3825492213 shutdown_connections 2024-01-20T08:14:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.368+0000 7f99a6000640 1 -- 172.21.15.100:0/3825492213 wait complete. 2024-01-20T08:14:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.370+0000 7f99a6000640 1 Processor -- start 2024-01-20T08:14:40.374 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.370+0000 7f99a6000640 1 -- start start 2024-01-20T08:14:40.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980003f70 0x7f99a00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a0071a00 0x7f99a014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 0x7f99a01529b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00c2140 con 0x7f99a01e9750 2024-01-20T08:14:40.376 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00a7bc0 con 0x7f9980003f70 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a6000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01e92c0 con 0x7f99a0071a00 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 0x7f99a01529b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 0x7f99a01529b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48202/0 (socket says 172.21.15.100:48202) 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.371+0000 7f99a5600640 1 -- 172.21.15.100:0/1389948139 learned_addr learned my addr 172.21.15.100:0/1389948139 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a4c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980003f70 0x7f99a00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f9997c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a0071a00 0x7f99a014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 -- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a0071a00 msgr2=0x7f99a014e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a0071a00 0x7f99a014e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.377 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 -- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980003f70 msgr2=0x7f99a00a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f9980003f70 0x7f99a00a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a01e64e0 con 0x7f99a01e9750 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f9997c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f99a0071a00 0x7f99a014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a5600640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 0x7f99a01529b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f99a006e6f0 tx=0x7f999800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998017070 con 0x7f99a01e9750 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9998006b50 con 0x7f99a01e9750 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a01e8f50 con 0x7f99a01e9750 2024-01-20T08:14:40.378 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9998006d00 con 0x7f99a01e9750 2024-01-20T08:14:40.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.372+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a01e67c0 con 0x7f99a01e9750 2024-01-20T08:14:40.379 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.373+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f99a01563a0 con 0x7f99a01e9750 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.375+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f9998003970 con 0x7f99a01e9750 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.375+0000 7f999d600640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f997806aed0 0x7f997806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f99980889f0 con 0x7f99a01e9750 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f999d600640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7f9978070dd0 0x7f99780731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f99a4c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f997806aed0 0x7f997806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99780738a0 con 0x7f9978070dd0 2024-01-20T08:14:40.380 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f999808d2c0 con 0x7f99a01e9750 2024-01-20T08:14:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f99a4c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f997806aed0 0x7f997806d390 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f99a014ef70 tx=0x7f9990008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.376+0000 7f9997c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7f9978070dd0 0x7f99780731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.377+0000 7f9997c00640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7f9978070dd0 0x7f99780731f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.381 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.380+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== osd.4 v2:172.21.15.110:6824/1116990208 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f99780738a0 con 0x7f9978070dd0 2024-01-20T08:14:40.396 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.394+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 --> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f99a01e9470 con 0x7f9978070dd0 2024-01-20T08:14:40.397 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.395+0000 7f999d600640 1 -- 172.21.15.100:0/1389948139 <== osd.4 v2:172.21.15.110:6824/1116990208 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f99a01e9470 con 0x7f9978070dd0 2024-01-20T08:14:40.397 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:40.398 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:40.398 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7f9978070dd0 msgr2=0x7f99780731f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.110:6824/1116990208,v1:172.21.15.110:6825/1116990208] conn(0x7f9978070dd0 0x7f99780731f0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f997806aed0 msgr2=0x7f997806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f997806aed0 0x7f997806d390 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f99a014ef70 tx=0x7f9990008040 comp rx=0 tx=0).stop 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 msgr2=0x7f99a01529b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 --2- 172.21.15.100:0/1389948139 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f99a01e9750 0x7f99a01529b0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f99a006e6f0 tx=0x7f999800ec10 comp rx=0 tx=0).stop 2024-01-20T08:14:40.399 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a5600640 1 -- 172.21.15.100:0/1389948139 reap_dead start 2024-01-20T08:14:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 shutdown_connections 2024-01-20T08:14:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 >> 172.21.15.100:0/1389948139 conn(0x7f99a00c5ba0 msgr2=0x7f99a0070cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 shutdown_connections 2024-01-20T08:14:40.400 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.396+0000 7f99a6000640 1 -- 172.21.15.100:0/1389948139 wait complete. 2024-01-20T08:14:40.416 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-01-20T08:14:40.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.621+0000 7f3449200640 1 Processor -- start 2024-01-20T08:14:40.623 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.621+0000 7f3449200640 1 -- start start 2024-01-20T08:14:40.624 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3449200640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f344406d2c0 0x7f3444155470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3449200640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f344406d750 con 0x7f34440c0ed0 2024-01-20T08:14:40.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3449200640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34441559b0 con 0x7f34440c4e20 2024-01-20T08:14:40.625 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3449200640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34440c1930 con 0x7f344406d2c0 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3443e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f344406d2c0 0x7f3444155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f343be00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f34440c0ed0 0x7f344406cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50564/0 (socket says 172.21.15.100:50564) 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f343be00640 1 -- 172.21.15.100:0/807147887 learned_addr learned my addr 172.21.15.100:0/807147887 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3443e00640 1 -- 172.21.15.100:0/807147887 >> v1:172.21.15.110:6789/0 conn(0x7f34440c4e20 legacy=0x7f34440aa8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.623+0000 7f3443e00640 1 -- 172.21.15.100:0/807147887 >> v1:172.21.15.100:6789/0 conn(0x7f34440c0ed0 legacy=0x7f344406cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.626 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.624+0000 7f3443e00640 1 -- 172.21.15.100:0/807147887 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344406c160 con 0x7f344406d2c0 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3443e00640 1 --2- 172.21.15.100:0/807147887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f3444155470 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f343c009d90 tx=0x7f343c02e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d466b177f5fc0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3442a00640 1 -- 172.21.15.100:0/807147887 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c02ee70 con 0x7f344406d2c0 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3442a00640 1 -- 172.21.15.100:0/807147887 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f343c036440 con 0x7f344406d2c0 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3442a00640 1 -- 172.21.15.100:0/807147887 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f343c0367d0 con 0x7f344406d2c0 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3449200640 1 -- 172.21.15.100:0/807147887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 msgr2=0x7f3444155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.628 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.625+0000 7f3449200640 1 --2- 172.21.15.100:0/807147887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f3444155470 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f343c009d90 tx=0x7f343c02e0c0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.626+0000 7f3449200640 1 -- 172.21.15.100:0/807147887 shutdown_connections 2024-01-20T08:14:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.626+0000 7f3449200640 1 --2- 172.21.15.100:0/807147887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f3444155470 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.626+0000 7f3449200640 1 -- 172.21.15.100:0/807147887 >> 172.21.15.100:0/807147887 conn(0x7f34440c5ba0 msgr2=0x7f34440c5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.626+0000 7f3449200640 1 -- 172.21.15.100:0/807147887 shutdown_connections 2024-01-20T08:14:40.629 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.626+0000 7f3449200640 1 -- 172.21.15.100:0/807147887 wait complete. 2024-01-20T08:14:40.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.627+0000 7f3449200640 1 Processor -- start 2024-01-20T08:14:40.630 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.627+0000 7f3449200640 1 -- start start 2024-01-20T08:14:40.631 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34440c0ed0 0x7f3444144dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34440c4e20 0x7f3444145310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34441dd870 con 0x7f344406d2c0 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3444153680 con 0x7f34440c0ed0 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.628+0000 7f3449200640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34440a8330 con 0x7f34440c4e20 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48216/0 (socket says 172.21.15.100:48216) 2024-01-20T08:14:40.632 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 -- 172.21.15.100:0/3564011227 learned_addr learned my addr 172.21.15.100:0/3564011227 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 -- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34440c4e20 msgr2=0x7f3444145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34440c4e20 0x7f3444145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 -- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34440c0ed0 msgr2=0x7f3444144dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34440c0ed0 0x7f3444144dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 -- 172.21.15.100:0/3564011227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c009a70 con 0x7f344406d2c0 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f3443400640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f343400b3f0 tx=0x7f343400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.629+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011830 con 0x7f344406d2c0 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.630+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3434011990 con 0x7f344406d2c0 2024-01-20T08:14:40.633 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.630+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3434011d40 con 0x7f344406d2c0 2024-01-20T08:14:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.630+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34440a8820 con 0x7f344406d2c0 2024-01-20T08:14:40.634 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.630+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34441de550 con 0x7f344406d2c0 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.631+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f344404e970 con 0x7f344406d2c0 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.632+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f343401a400 con 0x7f344406d2c0 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.633+0000 7f343b400640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 0x7f341c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.633+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3434089080 con 0x7f344406d2c0 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.633+0000 7f343be00640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 0x7f341c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:40.635 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.634+0000 7f343be00640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 0x7f341c06d3c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f342c000f60 tx=0x7f342c007a80 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:40.638 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.637+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f3434054280 con 0x7f344406d2c0 2024-01-20T08:14:40.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.828+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f344406c3b0 con 0x7f341c06af00 2024-01-20T08:14:40.831 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.828+0000 7f343b400640 1 -- 172.21.15.100:0/3564011227 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f342c0058b0 con 0x7f341c06af00 2024-01-20T08:14:40.831 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 4 to deep-scrub 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.830+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 msgr2=0x7f341c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.830+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 0x7f341c06d3c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f342c000f60 tx=0x7f342c007a80 comp rx=0 tx=0).stop 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.830+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 msgr2=0x7f34441ed940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.830+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f343400b3f0 tx=0x7f343400b8b0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 shutdown_connections 2024-01-20T08:14:40.836 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f341c06af00 0x7f341c06d3c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f34440c4e20 0x7f3444145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f34440c0ed0 0x7f3444144dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 --2- 172.21.15.100:0/3564011227 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f344406d2c0 0x7f34441ed940 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 >> 172.21.15.100:0/3564011227 conn(0x7f34440c5ba0 msgr2=0x7f34440bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 shutdown_connections 2024-01-20T08:14:40.837 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:40.831+0000 7f3449200640 1 -- 172.21.15.100:0/3564011227 wait complete. 2024-01-20T08:14:40.851 INFO:tasks.ceph:Scrubbing osd.5 2024-01-20T08:14:40.851 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:41.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.054+0000 7fc0bac00640 1 Processor -- start 2024-01-20T08:14:41.058 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.055+0000 7fc0bac00640 1 -- start start 2024-01-20T08:14:41.059 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0bac00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc0b414c5a0 0x7fc0b4153020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0bac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406bdb0 0x7fc0b40c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0bac00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b406d0e0 con 0x7fc0b40c1f50 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0bac00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b4153560 con 0x7fc0b414c5a0 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0bac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40aaf10 con 0x7fc0b406bdb0 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0b8c00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc0b40c1f50 0x7fc0b406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50574/0 (socket says 172.21.15.100:50574) 2024-01-20T08:14:41.060 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.056+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2709565763 learned_addr learned my addr 172.21.15.100:0/2709565763 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:41.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406bdb0 0x7fc0b40c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3e00640 1 --2- 172.21.15.100:0/2709565763 >> v2:172.21.15.110:3300/0 conn(0x7fc0b414c5a0 0x7fc0b4153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664462462 0 0) 0x7fc0b406d0e0 con 0x7fc0b40c1f50 2024-01-20T08:14:41.061 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc094003520 con 0x7fc0b40c1f50 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199232845 0 0) 0x7fc094003520 con 0x7fc0b40c1f50 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406bdb0 msgr2=0x7fc0b40c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406bdb0 0x7fc0b40c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 >> v2:172.21.15.110:3300/0 conn(0x7fc0b414c5a0 msgr2=0x7fc0b4153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 --2- 172.21.15.100:0/2709565763 >> v2:172.21.15.110:3300/0 conn(0x7fc0b414c5a0 0x7fc0b4153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b414c980 con 0x7fc0b40c1f50 2024-01-20T08:14:41.064 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7fc0ac0019f0 con 0x7fc0b40c1f50 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 >> v1:172.21.15.100:6789/0 conn(0x7fc0b40c1f50 legacy=0x7fc0b406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc094003970 0x7fc094003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0940047c0 0x7fc094004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc09400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b40aaf10 con 0x7fc094005180 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.057+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400bf70 con 0x7fc0940047c0 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc09400c130 con 0x7fc094003970 2024-01-20T08:14:41.065 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b406bdb0 0x7fc0b40c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc09400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc094003970 msgr2=0x7fc094003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc094003970 0x7fc094003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0940047c0 msgr2=0x7fc094004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0940047c0 0x7fc094004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.058+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2709565763 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc094003520 con 0x7fc094005180 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.059+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc09400b980 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00a790 tx=0x7fc0940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3158befe2d63e556 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.059+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac034630 con 0x7fc094005180 2024-01-20T08:14:41.066 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.059+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ac02f070 con 0x7fc094005180 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.059+0000 7fc0b3400640 1 -- 172.21.15.100:0/2709565763 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac034a30 con 0x7fc094005180 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 -- 172.21.15.100:0/2709565763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 msgr2=0x7fc09400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 --2- 172.21.15.100:0/2709565763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc09400b980 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00a790 tx=0x7fc0940057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2709565763 reap_dead start 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 -- 172.21.15.100:0/2709565763 shutdown_connections 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 -- 172.21.15.100:0/2709565763 >> 172.21.15.100:0/2709565763 conn(0x7fc0b40c2b00 msgr2=0x7fc0b40c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 -- 172.21.15.100:0/2709565763 shutdown_connections 2024-01-20T08:14:41.067 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.060+0000 7fc0bac00640 1 -- 172.21.15.100:0/2709565763 wait complete. 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.062+0000 7fc0bac00640 1 Processor -- start 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.062+0000 7fc0bac00640 1 -- start start 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc0b41edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b40bf6a0 0x7fc0b41556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b4155c00 0x7fc0b4070150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.070 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4142220 con 0x7fc094005180 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b4147dd0 con 0x7fc0b4155c00 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0bac00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b41ee500 con 0x7fc0b40bf6a0 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc0b41edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0b3e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc0b41edfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48232/0 (socket says 172.21.15.100:48232) 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.063+0000 7fc0b3e00640 1 -- 172.21.15.100:0/2824807437 learned_addr learned my addr 172.21.15.100:0/2824807437 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:41.071 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b40bf6a0 0x7fc0b41556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 -- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b40bf6a0 msgr2=0x7fc0b41556c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b4155c00 0x7fc0b4070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b40bf6a0 0x7fc0b41556c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.072 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 -- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b4155c00 msgr2=0x7fc0b4070150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc0b4155c00 0x7fc0b4070150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b4155230 con 0x7fc094005180 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc0b40bf6a0 0x7fc0b41556c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b3e00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc0b41edfc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400e7f0 tx=0x7fc0a400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400eea0 con 0x7fc094005180 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400c8e0 con 0x7fc094005180 2024-01-20T08:14:41.073 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.064+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b4154f30 con 0x7fc094005180 2024-01-20T08:14:41.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.065+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400cc90 con 0x7fc094005180 2024-01-20T08:14:41.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.065+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b4071fe0 con 0x7fc094005180 2024-01-20T08:14:41.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.066+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0b406c870 con 0x7fc094005180 2024-01-20T08:14:41.074 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.067+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc0a4013470 con 0x7fc094005180 2024-01-20T08:14:41.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.067+0000 7fc0b0c00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc08c06af00 0x7fc08c06d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.075 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc0a4089410 con 0x7fc094005180 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc08c06af00 0x7fc08c06d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0b0c00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fc08c070e00 0x7fc08c073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc08c0738d0 con 0x7fc08c070e00 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0a408bad0 con 0x7fc094005180 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.068+0000 7fc0abe00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc08c06af00 0x7fc08c06d3c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc0b414a9b0 tx=0x7fc09c008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.069+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fc08c070e00 0x7fc08c073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.069+0000 7fc0b8c00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fc08c070e00 0x7fc08c073220 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.076 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.072+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== osd.5 v2:172.21.15.110:6808/3843611847 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc08c0738d0 con 0x7fc08c070e00 2024-01-20T08:14:41.089 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.086+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 --> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc0b406c590 con 0x7fc08c070e00 2024-01-20T08:14:41.090 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.087+0000 7fc0b0c00640 1 -- 172.21.15.100:0/2824807437 <== osd.5 v2:172.21.15.110:6808/3843611847 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc0ac0017b0 con 0x7fc08c070e00 2024-01-20T08:14:41.090 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:41.090 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:41.090 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:41.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.087+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fc08c070e00 msgr2=0x7fc08c073220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.087+0000 7fc0bac00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.110:6808/3843611847,v1:172.21.15.110:6809/3843611847] conn(0x7fc08c070e00 0x7fc08c073220 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.092 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc08c06af00 msgr2=0x7fc08c06d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc08c06af00 0x7fc08c06d3c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc0b414a9b0 tx=0x7fc09c008040 comp rx=0 tx=0).stop 2024-01-20T08:14:41.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 msgr2=0x7fc0b41edfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 --2- 172.21.15.100:0/2824807437 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc094005180 0x7fc0b41edfc0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400e7f0 tx=0x7fc0a400ecb0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0b8c00640 1 -- 172.21.15.100:0/2824807437 reap_dead start 2024-01-20T08:14:41.093 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 shutdown_connections 2024-01-20T08:14:41.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 >> 172.21.15.100:0/2824807437 conn(0x7fc0b40c2b00 msgr2=0x7fc0b414b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 shutdown_connections 2024-01-20T08:14:41.094 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.088+0000 7fc0bac00640 1 -- 172.21.15.100:0/2824807437 wait complete. 2024-01-20T08:14:41.109 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-01-20T08:14:41.308 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.305+0000 7f4fa4400640 1 Processor -- start 2024-01-20T08:14:41.309 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.305+0000 7f4fa4400640 1 -- start start 2024-01-20T08:14:41.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa4400640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f9c14b720 0x7f4f9c1515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.310 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa4400640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 0x7f4f9c0c1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa4400640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f9c154ba0 con 0x7f4f9c06c8d0 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa4400640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c14bb00 con 0x7f4f9c14b720 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa4400640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f9c155a00 con 0x7f4f9c0c1850 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f9c14b720 0x7f4f9c1515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa1a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f4f9c14b720 0x7f4f9c1515b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48246/0 (socket says 172.21.15.100:48246) 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.307+0000 7f4fa1a00640 1 -- 172.21.15.100:0/429376696 learned_addr learned my addr 172.21.15.100:0/429376696 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1000640 1 --2- 172.21.15.100:0/429376696 >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 0x7f4f9c0c1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1a00640 1 -- 172.21.15.100:0/429376696 >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 msgr2=0x7f4f9c0c1d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.311 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1a00640 1 --2- 172.21.15.100:0/429376696 >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 0x7f4f9c0c1d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1a00640 1 -- 172.21.15.100:0/429376696 >> v1:172.21.15.110:6789/0 conn(0x7f4f9c06c8d0 legacy=0x7f4f9c06cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1a00640 1 -- 172.21.15.100:0/429376696 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f9c154df0 con 0x7f4f9c14b720 2024-01-20T08:14:41.312 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.308+0000 7f4fa1000640 1 --2- 172.21.15.100:0/429376696 >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 0x7f4f9c0c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.309+0000 7f4fa1a00640 1 --2- 172.21.15.100:0/429376696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1515b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0ac030 tx=0x7f4f8c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4896910807e96a5 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.309+0000 7f4f9be00640 1 -- 172.21.15.100:0/429376696 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c0317e0 con 0x7f4f9c14b720 2024-01-20T08:14:41.313 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.309+0000 7f4f9be00640 1 -- 172.21.15.100:0/429376696 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8c031940 con 0x7f4f9c14b720 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.309+0000 7f4f9be00640 1 -- 172.21.15.100:0/429376696 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8c031cd0 con 0x7f4f9c14b720 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 -- 172.21.15.100:0/429376696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c14b720 msgr2=0x7f4f9c1515b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 --2- 172.21.15.100:0/429376696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1515b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c0ac030 tx=0x7f4f8c02b880 comp rx=0 tx=0).stop 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 -- 172.21.15.100:0/429376696 shutdown_connections 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 --2- 172.21.15.100:0/429376696 >> v2:172.21.15.110:3300/0 conn(0x7f4f9c0c1850 0x7f4f9c0c1d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 --2- 172.21.15.100:0/429376696 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1515b0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 -- 172.21.15.100:0/429376696 >> 172.21.15.100:0/429376696 conn(0x7f4f9c0c2940 msgr2=0x7f4f9c0c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.314 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 -- 172.21.15.100:0/429376696 shutdown_connections 2024-01-20T08:14:41.315 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.310+0000 7f4fa4400640 1 -- 172.21.15.100:0/429376696 wait complete. 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.311+0000 7f4fa4400640 1 Processor -- start 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.312+0000 7f4fa4400640 1 -- start start 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.312+0000 7f4fa4400640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f9c06c8d0 0x7f4f9c0bf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.312+0000 7f4fa4400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa4400640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa4400640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1eeae0 con 0x7f4f9c0c1850 2024-01-20T08:14:41.317 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa4400640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1514f0 con 0x7f4f9c14b720 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa4400640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9c1ea5a0 con 0x7f4f9c06c8d0 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48248/0 (socket says 172.21.15.100:48248) 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 -- 172.21.15.100:0/4082902532 learned_addr learned my addr 172.21.15.100:0/4082902532 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 -- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f9c06c8d0 msgr2=0x7f4f9c0bf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f9c06c8d0 0x7f4f9c0bf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.318 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa2400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 -- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 msgr2=0x7f4f9c1eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1eacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa1000640 1 -- 172.21.15.100:0/4082902532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f8c0094d0 con 0x7f4f9c0c1850 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.313+0000 7f4fa2400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4fa1000640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c7f0 tx=0x7f4f8400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f84007a30 con 0x7f4f9c0c1850 2024-01-20T08:14:41.319 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f84007b90 con 0x7f4f9c0c1850 2024-01-20T08:14:41.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8400ce40 con 0x7f4f9c0c1850 2024-01-20T08:14:41.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9c150970 con 0x7f4f9c0c1850 2024-01-20T08:14:41.320 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.314+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9c151210 con 0x7f4f9c0c1850 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.315+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9c04e970 con 0x7f4f9c0c1850 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.316+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f4f840113f0 con 0x7f4f9c0c1850 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.317+0000 7f4f99600640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 0x7f4f7406d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.317+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4f84089520 con 0x7f4f9c0c1850 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.317+0000 7f4fa1a00640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 0x7f4f7406d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.321 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.318+0000 7f4fa1a00640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 0x7f4f7406d3c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c036000 tx=0x7f4f8c030000 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.324 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.321+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4f84054680 con 0x7f4f9c0c1850 2024-01-20T08:14:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.514+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f9c072960 con 0x7f4f7406af00 2024-01-20T08:14:41.517 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.514+0000 7f4f99600640 1 -- 172.21.15.100:0/4082902532 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4f9c072960 con 0x7f4f7406af00 2024-01-20T08:14:41.518 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 5 to deep-scrub 2024-01-20T08:14:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 msgr2=0x7f4f7406d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 0x7f4f7406d3c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c036000 tx=0x7f4f8c030000 comp rx=0 tx=0).stop 2024-01-20T08:14:41.520 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 msgr2=0x7f4f9c1edb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f4f8400c7f0 tx=0x7f4f8400cbf0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 shutdown_connections 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4f9c14b720 0x7f4f9c1eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f9c0c1850 0x7f4f9c1edb70 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f4f7406af00 0x7f4f7406d3c0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 --2- 172.21.15.100:0/4082902532 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f4f9c06c8d0 0x7f4f9c0bf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 >> 172.21.15.100:0/4082902532 conn(0x7f4f9c0c2940 msgr2=0x7f4f9c06cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 shutdown_connections 2024-01-20T08:14:41.521 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.517+0000 7f4fa4400640 1 -- 172.21.15.100:0/4082902532 wait complete. 2024-01-20T08:14:41.538 INFO:tasks.ceph:Scrubbing osd.6 2024-01-20T08:14:41.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:41.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.744+0000 7fc6f5600640 1 Processor -- start 2024-01-20T08:14:41.747 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.744+0000 7fc6f5600640 1 -- start start 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.745+0000 7fc6f5600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6f0148080 0x7fc6f00c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.745+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0070c00 0x7fc6f006d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.745+0000 7fc6f5600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f006d1d0 con 0x7fc6f00a84a0 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6f5600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f00a8ce0 con 0x7fc6f0148080 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6f5600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0148460 con 0x7fc6f0070c00 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6f0148080 0x7fc6f00c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.749 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6f0148080 0x7fc6f00c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48262/0 (socket says 172.21.15.100:48262) 2024-01-20T08:14:41.750 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 -- 172.21.15.100:0/220614608 learned_addr learned my addr 172.21.15.100:0/220614608 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6ee000640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0070c00 0x7fc6f006d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 -- 172.21.15.100:0/220614608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0070c00 msgr2=0x7fc6f006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0070c00 0x7fc6f006d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 -- 172.21.15.100:0/220614608 >> v1:172.21.15.110:6789/0 conn(0x7fc6f00a84a0 legacy=0x7fc6f0154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.746+0000 7fc6eea00640 1 -- 172.21.15.100:0/220614608 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f00c2540 con 0x7fc6f0148080 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.747+0000 7fc6eea00640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0148080 0x7fc6f00c1a10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009870 tx=0x7fc6e002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab9436b870ee33b server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6ed600640 1 -- 172.21.15.100:0/220614608 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00317c0 con 0x7fc6f0148080 2024-01-20T08:14:41.751 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6ed600640 1 -- 172.21.15.100:0/220614608 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0031920 con 0x7fc6f0148080 2024-01-20T08:14:41.752 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6ed600640 1 -- 172.21.15.100:0/220614608 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e0031cb0 con 0x7fc6f0148080 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 -- 172.21.15.100:0/220614608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0148080 msgr2=0x7fc6f00c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0148080 0x7fc6f00c1a10 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0009870 tx=0x7fc6e002b860 comp rx=0 tx=0).stop 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 -- 172.21.15.100:0/220614608 shutdown_connections 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0070c00 0x7fc6f006d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 --2- 172.21.15.100:0/220614608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0148080 0x7fc6f00c1a10 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.753 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 -- 172.21.15.100:0/220614608 >> 172.21.15.100:0/220614608 conn(0x7fc6f00c2b00 msgr2=0x7fc6f00c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.748+0000 7fc6f5600640 1 -- 172.21.15.100:0/220614608 shutdown_connections 2024-01-20T08:14:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.749+0000 7fc6f5600640 1 -- 172.21.15.100:0/220614608 wait complete. 2024-01-20T08:14:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.750+0000 7fc6f5600640 1 Processor -- start 2024-01-20T08:14:41.754 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.750+0000 7fc6f5600640 1 -- start start 2024-01-20T08:14:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 0x7fc6f00c51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f00a84a0 0x7fc6f01ed380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0148080 0x7fc6f01ed8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.756 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01478a0 con 0x7fc6f0070c00 2024-01-20T08:14:41.759 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f00ab350 con 0x7fc6f00a84a0 2024-01-20T08:14:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6f5600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f014f620 con 0x7fc6f0148080 2024-01-20T08:14:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6eea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 0x7fc6f00c51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6eea00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 0x7fc6f00c51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48266/0 (socket says 172.21.15.100:48266) 2024-01-20T08:14:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.751+0000 7fc6eea00640 1 -- 172.21.15.100:0/2439330479 learned_addr learned my addr 172.21.15.100:0/2439330479 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:41.760 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 -- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0148080 msgr2=0x7fc6f01ed8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6f0148080 0x7fc6f01ed8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 -- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f00a84a0 msgr2=0x7fc6f01ed380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6f00a84a0 0x7fc6f01ed380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e00094d0 con 0x7fc6f0070c00 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6eea00640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 0x7fc6f00c51e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000c00 tx=0x7fc6e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00329a0 con 0x7fc6f0070c00 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e0032b40 con 0x7fc6f0070c00 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.752+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e00453f0 con 0x7fc6f0070c00 2024-01-20T08:14:41.761 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.753+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f01475e0 con 0x7fc6f0070c00 2024-01-20T08:14:41.762 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.753+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f014f320 con 0x7fc6f0070c00 2024-01-20T08:14:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.754+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6f0147460 con 0x7fc6f0070c00 2024-01-20T08:14:41.763 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.755+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc6e004e450 con 0x7fc6f0070c00 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.755+0000 7fc6e6a00640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6c806aed0 0x7fc6c806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc6e00ab9b0 con 0x7fc6f0070c00 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6ee000640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6c806aed0 0x7fc6c806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6e6a00640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7fc6c8070dd0 0x7fc6c80731f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc6c80738a0 con 0x7fc6c8070dd0 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6e00b02a0 con 0x7fc6f0070c00 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.756+0000 7fc6ee000640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6c806aed0 0x7fc6c806d390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006fd0 tx=0x7fc6d8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.764 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.757+0000 7fc6ef400640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7fc6c8070dd0 0x7fc6c80731f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.757+0000 7fc6ef400640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7fc6c8070dd0 0x7fc6c80731f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:41.765 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.759+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== osd.6 v2:172.21.15.110:6800/2895430222 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc6c80738a0 con 0x7fc6c8070dd0 2024-01-20T08:14:41.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.774+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 --> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc6f01522f0 con 0x7fc6c8070dd0 2024-01-20T08:14:41.778 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.775+0000 7fc6e6a00640 1 -- 172.21.15.100:0/2439330479 <== osd.6 v2:172.21.15.110:6800/2895430222 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc6e8006b50 con 0x7fc6c8070dd0 2024-01-20T08:14:41.778 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:41.778 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:41.778 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:41.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.775+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7fc6c8070dd0 msgr2=0x7fc6c80731f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.775+0000 7fc6f5600640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.110:6800/2895430222,v1:172.21.15.110:6801/2895430222] conn(0x7fc6c8070dd0 0x7fc6c80731f0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6c806aed0 msgr2=0x7fc6c806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.779 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc6c806aed0 0x7fc6c806d390 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc6d8006fd0 tx=0x7fc6d8008040 comp rx=0 tx=0).stop 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 msgr2=0x7fc6f00c51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 --2- 172.21.15.100:0/2439330479 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6f0070c00 0x7fc6f00c51e0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fc6e0000c00 tx=0x7fc6e00046c0 comp rx=0 tx=0).stop 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6ef400640 1 -- 172.21.15.100:0/2439330479 reap_dead start 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 shutdown_connections 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 >> 172.21.15.100:0/2439330479 conn(0x7fc6f00c2b00 msgr2=0x7fc6f006c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 shutdown_connections 2024-01-20T08:14:41.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:41.776+0000 7fc6f5600640 1 -- 172.21.15.100:0/2439330479 wait complete. 2024-01-20T08:14:41.796 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-01-20T08:14:42.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.004+0000 7f5d3e800640 1 Processor -- start 2024-01-20T08:14:42.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.004+0000 7f5d3e800640 1 -- start start 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d3e800640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f5d380c4a50 0x7f5d380c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d3e800640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f5d38155290 0x7f5d3806b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d3e800640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d380c9f30 con 0x7f5d38151e40 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d3e800640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3806c5a0 con 0x7f5d380c4a50 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d3e800640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d380c87a0 con 0x7f5d38155290 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d37400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f5d38151e40 0x7f5d38155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50588/0 (socket says 172.21.15.100:50588) 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d37400640 1 -- 172.21.15.100:0/1292427160 learned_addr learned my addr 172.21.15.100:0/1292427160 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:42.010 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d2e800640 1 --2- 172.21.15.100:0/1292427160 >> v2:172.21.15.100:3300/0 conn(0x7f5d380c4a50 0x7f5d380c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d37e00640 1 --2- 172.21.15.100:0/1292427160 >> v2:172.21.15.110:3300/0 conn(0x7f5d38155290 0x7f5d3806b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.006+0000 7f5d36a00640 1 -- 172.21.15.100:0/1292427160 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601194584 0 0) 0x7f5d28001110 con 0x7f5d38151e40 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.007+0000 7f5d36a00640 1 -- 172.21.15.100:0/1292427160 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d18003520 con 0x7f5d38151e40 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.007+0000 7f5d2e800640 1 -- 172.21.15.100:0/1292427160 >> v2:172.21.15.110:3300/0 conn(0x7f5d38155290 msgr2=0x7f5d3806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.007+0000 7f5d2e800640 1 --2- 172.21.15.100:0/1292427160 >> v2:172.21.15.110:3300/0 conn(0x7f5d38155290 0x7f5d3806b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.007+0000 7f5d2e800640 1 -- 172.21.15.100:0/1292427160 >> v1:172.21.15.100:6789/0 conn(0x7f5d38151e40 legacy=0x7f5d38155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.007+0000 7f5d2e800640 1 -- 172.21.15.100:0/1292427160 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d38156410 con 0x7f5d380c4a50 2024-01-20T08:14:42.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.008+0000 7f5d2e800640 1 --2- 172.21.15.100:0/1292427160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d380c4a50 0x7f5d380c8c30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f5d380bdb30 tx=0x7f5d2002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4a88bdaf883674 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.008+0000 7f5d36a00640 1 -- 172.21.15.100:0/1292427160 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2002e070 con 0x7f5d380c4a50 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.008+0000 7f5d36a00640 1 -- 172.21.15.100:0/1292427160 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d200315a0 con 0x7f5d380c4a50 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.008+0000 7f5d36a00640 1 -- 172.21.15.100:0/1292427160 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20031930 con 0x7f5d380c4a50 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 -- 172.21.15.100:0/1292427160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d380c4a50 msgr2=0x7f5d380c8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 --2- 172.21.15.100:0/1292427160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d380c4a50 0x7f5d380c8c30 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f5d380bdb30 tx=0x7f5d2002b840 comp rx=0 tx=0).stop 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 -- 172.21.15.100:0/1292427160 shutdown_connections 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 --2- 172.21.15.100:0/1292427160 >> v2:172.21.15.110:3300/0 conn(0x7f5d38155290 0x7f5d3806b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 --2- 172.21.15.100:0/1292427160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d380c4a50 0x7f5d380c8c30 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 -- 172.21.15.100:0/1292427160 >> 172.21.15.100:0/1292427160 conn(0x7f5d380abde0 msgr2=0x7f5d380ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 -- 172.21.15.100:0/1292427160 shutdown_connections 2024-01-20T08:14:42.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.009+0000 7f5d3e800640 1 -- 172.21.15.100:0/1292427160 wait complete. 2024-01-20T08:14:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.010+0000 7f5d3e800640 1 Processor -- start 2024-01-20T08:14:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 -- start start 2024-01-20T08:14:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d380c4a50 0x7f5d380c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38151e40 0x7f5d381ea970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.016 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381ea550 con 0x7f5d38155290 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381eb3f0 con 0x7f5d38151e40 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.011+0000 7f5d3e800640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d381527b0 con 0x7f5d380c4a50 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48274/0 (socket says 172.21.15.100:48274) 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 -- 172.21.15.100:0/240045351 learned_addr learned my addr 172.21.15.100:0/240045351 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37400640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d380c4a50 0x7f5d380c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d2e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38151e40 0x7f5d381ea970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 -- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d380c4a50 msgr2=0x7f5d380c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d380c4a50 0x7f5d380c6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 -- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38151e40 msgr2=0x7f5d381ea970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38151e40 0x7f5d381ea970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 -- 172.21.15.100:0/240045351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009400 con 0x7f5d38155290 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.012+0000 7f5d37e00640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007e60 tx=0x7f5d3000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.013+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30014420 con 0x7f5d38155290 2024-01-20T08:14:42.018 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.013+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d300145a0 con 0x7f5d38155290 2024-01-20T08:14:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.013+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d30014950 con 0x7f5d38155290 2024-01-20T08:14:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.013+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d38152a90 con 0x7f5d38155290 2024-01-20T08:14:42.019 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.013+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d38153050 con 0x7f5d38155290 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.014+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3804e970 con 0x7f5d38155290 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.015+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f5d30014ab0 con 0x7f5d38155290 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.016+0000 7f5d2fe00640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 0x7f5d1006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.016+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f5d30089cd0 con 0x7f5d38155290 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.016+0000 7f5d37400640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 0x7f5d1006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.020 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.017+0000 7f5d37400640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 0x7f5d1006d390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001270 tx=0x7f5d28009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.023 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.021+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f5d30054e30 con 0x7f5d38155290 2024-01-20T08:14:42.204 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.201+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d380c7ae0 con 0x7f5d1006aed0 2024-01-20T08:14:42.205 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.202+0000 7f5d2fe00640 1 -- 172.21.15.100:0/240045351 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f5d380c7ae0 con 0x7f5d1006aed0 2024-01-20T08:14:42.205 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 6 to deep-scrub 2024-01-20T08:14:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.204+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 msgr2=0x7f5d1006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.204+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 0x7f5d1006d390 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5d28001270 tx=0x7f5d28009040 comp rx=0 tx=0).stop 2024-01-20T08:14:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.204+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 msgr2=0x7f5d381eaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.208 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.204+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f5d30007e60 tx=0x7f5d3000e4b0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 shutdown_connections 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5d38155290 0x7f5d381eaeb0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f5d38151e40 0x7f5d381ea970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f5d1006aed0 0x7f5d1006d390 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 --2- 172.21.15.100:0/240045351 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f5d380c4a50 0x7f5d380c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 >> 172.21.15.100:0/240045351 conn(0x7f5d380abde0 msgr2=0x7f5d380ac1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 shutdown_connections 2024-01-20T08:14:42.209 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.205+0000 7f5d3e800640 1 -- 172.21.15.100:0/240045351 wait complete. 2024-01-20T08:14:42.223 INFO:tasks.ceph:Scrubbing osd.7 2024-01-20T08:14:42.224 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-01-20T08:14:42.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.428+0000 7fc625a00640 1 Processor -- start 2024-01-20T08:14:42.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.429+0000 7fc625a00640 1 -- start start 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc625a00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc620148080 0x7fc6200c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc625a00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 0x7fc62015be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc625a00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62006d1d0 con 0x7fc620070c00 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc625a00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6200a8ce0 con 0x7fc620148080 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc625a00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc620148460 con 0x7fc6200a84a0 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc61ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc620148080 0x7fc6200c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc61ea00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc620148080 0x7fc6200c1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48290/0 (socket says 172.21.15.100:48290) 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.430+0000 7fc61ea00640 1 -- 172.21.15.100:0/135199283 learned_addr learned my addr 172.21.15.100:0/135199283 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61f400640 1 --2- 172.21.15.100:0/135199283 >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 0x7fc62015be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61ea00640 1 -- 172.21.15.100:0/135199283 >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 msgr2=0x7fc62015be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61ea00640 1 --2- 172.21.15.100:0/135199283 >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 0x7fc62015be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61ea00640 1 -- 172.21.15.100:0/135199283 >> v1:172.21.15.110:6789/0 conn(0x7fc620070c00 legacy=0x7fc62006d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61ea00640 1 -- 172.21.15.100:0/135199283 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200c2540 con 0x7fc620148080 2024-01-20T08:14:42.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.431+0000 7fc61f400640 1 --2- 172.21.15.100:0/135199283 >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 0x7fc62015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:14:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc61ea00640 1 --2- 172.21.15.100:0/135199283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc620148080 0x7fc6200c1a10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc610009870 tx=0x7fc61002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa22cf3b7e1e1568 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.439 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc61e000640 1 -- 172.21.15.100:0/135199283 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6100317e0 con 0x7fc620148080 2024-01-20T08:14:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc61e000640 1 -- 172.21.15.100:0/135199283 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc610031940 con 0x7fc620148080 2024-01-20T08:14:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc61e000640 1 -- 172.21.15.100:0/135199283 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc610031cd0 con 0x7fc620148080 2024-01-20T08:14:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc625a00640 1 -- 172.21.15.100:0/135199283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc620148080 msgr2=0x7fc6200c1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.432+0000 7fc625a00640 1 --2- 172.21.15.100:0/135199283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc620148080 0x7fc6200c1a10 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fc610009870 tx=0x7fc61002b880 comp rx=0 tx=0).stop 2024-01-20T08:14:42.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 -- 172.21.15.100:0/135199283 shutdown_connections 2024-01-20T08:14:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 --2- 172.21.15.100:0/135199283 >> v2:172.21.15.110:3300/0 conn(0x7fc6200a84a0 0x7fc62015be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 --2- 172.21.15.100:0/135199283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc620148080 0x7fc6200c1a10 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 -- 172.21.15.100:0/135199283 >> 172.21.15.100:0/135199283 conn(0x7fc6200c2b00 msgr2=0x7fc6200c2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 -- 172.21.15.100:0/135199283 shutdown_connections 2024-01-20T08:14:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.433+0000 7fc625a00640 1 -- 172.21.15.100:0/135199283 wait complete. 2024-01-20T08:14:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.434+0000 7fc625a00640 1 Processor -- start 2024-01-20T08:14:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.434+0000 7fc625a00640 1 -- start start 2024-01-20T08:14:42.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc620070c00 0x7fc62014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 0x7fc620150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc620148080 0x7fc6200c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc620155aa0 con 0x7fc6200a84a0 2024-01-20T08:14:42.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6201e9670 con 0x7fc620070c00 2024-01-20T08:14:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc625a00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc620150e40 con 0x7fc620148080 2024-01-20T08:14:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc615e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 0x7fc620150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc615e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 0x7fc620150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48306/0 (socket says 172.21.15.100:48306) 2024-01-20T08:14:42.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.435+0000 7fc615e00640 1 -- 172.21.15.100:0/458010958 learned_addr learned my addr 172.21.15.100:0/458010958 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc61ea00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc620070c00 0x7fc62014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 -- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc620148080 msgr2=0x7fc6200c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc620148080 0x7fc6200c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.445 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 -- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc620070c00 msgr2=0x7fc62014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc620070c00 0x7fc62014fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100094d0 con 0x7fc6200a84a0 2024-01-20T08:14:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc615e00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 0x7fc620150900 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc60800ba80 tx=0x7fc60800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc60800cc90 con 0x7fc6200a84a0 2024-01-20T08:14:42.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc60800cdf0 con 0x7fc6200a84a0 2024-01-20T08:14:42.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608014680 con 0x7fc6200a84a0 2024-01-20T08:14:42.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.436+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6201510e0 con 0x7fc6200a84a0 2024-01-20T08:14:42.447 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.437+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6201e9ba0 con 0x7fc6200a84a0 2024-01-20T08:14:42.449 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.437+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc6201522f0 con 0x7fc6200a84a0 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.438+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc608007370 con 0x7fc6200a84a0 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.439+0000 7fc617400640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f806af00 0x7fc5f806d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.439+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc608088ef0 con 0x7fc6200a84a0 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.439+0000 7fc617400640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7fc5f8070e00 0x7fc5f8073220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.439+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc5f80738d0 con 0x7fc5f8070e00 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.439+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc60808b4d0 con 0x7fc6200a84a0 2024-01-20T08:14:42.450 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.440+0000 7fc61ea00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f806af00 0x7fc5f806d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.440+0000 7fc61ea00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f806af00 0x7fc5f806d3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc610036000 tx=0x7fc61003d040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.440+0000 7fc61f400640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7fc5f8070e00 0x7fc5f8073220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.441+0000 7fc61f400640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7fc5f8070e00 0x7fc5f8073220 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.451 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.443+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== osd.7 v2:172.21.15.110:6816/419165616 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fc5f80738d0 con 0x7fc5f8070e00 2024-01-20T08:14:42.460 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.458+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 --> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc620072670 con 0x7fc5f8070e00 2024-01-20T08:14:42.461 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc617400640 1 -- 172.21.15.100:0/458010958 <== osd.7 v2:172.21.15.110:6816/419165616 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc61800a9e0 con 0x7fc5f8070e00 2024-01-20T08:14:42.462 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2024-01-20T08:14:42.462 INFO:teuthology.orchestra.run.smithi100.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-01-20T08:14:42.462 INFO:teuthology.orchestra.run.smithi100.stdout:} 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7fc5f8070e00 msgr2=0x7fc5f8073220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.110:6816/419165616,v1:172.21.15.110:6817/419165616] conn(0x7fc5f8070e00 0x7fc5f8073220 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f806af00 msgr2=0x7fc5f806d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc5f806af00 0x7fc5f806d3c0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fc610036000 tx=0x7fc61003d040 comp rx=0 tx=0).stop 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 msgr2=0x7fc620150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.463 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc625a00640 1 --2- 172.21.15.100:0/458010958 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6200a84a0 0x7fc620150900 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fc60800ba80 tx=0x7fc60800bf40 comp rx=0 tx=0).stop 2024-01-20T08:14:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.459+0000 7fc61f400640 1 -- 172.21.15.100:0/458010958 reap_dead start 2024-01-20T08:14:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.460+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 shutdown_connections 2024-01-20T08:14:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.460+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 >> 172.21.15.100:0/458010958 conn(0x7fc6200c2b00 msgr2=0x7fc620142880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.460+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 shutdown_connections 2024-01-20T08:14:42.464 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.460+0000 7fc625a00640 1 -- 172.21.15.100:0/458010958 wait complete. 2024-01-20T08:14:42.478 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-01-20T08:14:42.676 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.673+0000 7f09dfc00640 1 Processor -- start 2024-01-20T08:14:42.677 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.674+0000 7f09dfc00640 1 -- start start 2024-01-20T08:14:42.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dfc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f09d80c8c30 0x7f09d8155290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dfc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d80c9f30 con 0x7f09d8151e40 2024-01-20T08:14:42.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dfc00640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09d80c9040 con 0x7f09d80c4a50 2024-01-20T08:14:42.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dfc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09d806c5a0 con 0x7f09d80c8c30 2024-01-20T08:14:42.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dd200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f09d8151e40 0x7f09d8155d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50592/0 (socket says 172.21.15.100:50592) 2024-01-20T08:14:42.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09dd200640 1 -- 172.21.15.100:0/4126752829 learned_addr learned my addr 172.21.15.100:0/4126752829 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:42.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.675+0000 7f09ddc00640 1 --2- 172.21.15.100:0/4126752829 >> v2:172.21.15.100:3300/0 conn(0x7f09d80c8c30 0x7f09d8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.676+0000 7f09d7400640 1 -- 172.21.15.100:0/4126752829 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2598851477 0 0) 0x7f09c8001110 con 0x7f09d8151e40 2024-01-20T08:14:42.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.676+0000 7f09ddc00640 1 -- 172.21.15.100:0/4126752829 >> v1:172.21.15.110:6789/0 conn(0x7f09d80c4a50 legacy=0x7f09d806b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:42.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.676+0000 7f09ddc00640 1 -- 172.21.15.100:0/4126752829 >> v1:172.21.15.100:6789/0 conn(0x7f09d8151e40 legacy=0x7f09d8155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.676+0000 7f09ddc00640 1 -- 172.21.15.100:0/4126752829 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d81557d0 con 0x7f09d80c8c30 2024-01-20T08:14:42.680 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.677+0000 7f09ddc00640 1 --2- 172.21.15.100:0/4126752829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c8c30 0x7f09d8155290 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009d90 tx=0x7f09d002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47542b6ab0b728c server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.677+0000 7f09d7400640 1 -- 172.21.15.100:0/4126752829 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d002cbd0 con 0x7f09d80c8c30 2024-01-20T08:14:42.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.677+0000 7f09d7400640 1 -- 172.21.15.100:0/4126752829 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d002cd30 con 0x7f09d80c8c30 2024-01-20T08:14:42.681 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.677+0000 7f09d7400640 1 -- 172.21.15.100:0/4126752829 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09d002cea0 con 0x7f09d80c8c30 2024-01-20T08:14:42.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 -- 172.21.15.100:0/4126752829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c8c30 msgr2=0x7f09d8155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 --2- 172.21.15.100:0/4126752829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c8c30 0x7f09d8155290 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009d90 tx=0x7f09d002be20 comp rx=0 tx=0).stop 2024-01-20T08:14:42.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 -- 172.21.15.100:0/4126752829 shutdown_connections 2024-01-20T08:14:42.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 --2- 172.21.15.100:0/4126752829 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c8c30 0x7f09d8155290 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 -- 172.21.15.100:0/4126752829 >> 172.21.15.100:0/4126752829 conn(0x7f09d80abde0 msgr2=0x7f09d80ac1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 -- 172.21.15.100:0/4126752829 shutdown_connections 2024-01-20T08:14:42.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.678+0000 7f09dfc00640 1 -- 172.21.15.100:0/4126752829 wait complete. 2024-01-20T08:14:42.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.680+0000 7f09dfc00640 1 Processor -- start 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.680+0000 7f09dfc00640 1 -- start start 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09d80c8c30 0x7f09d80aad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09d8151e40 0x7f09d814f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80c69c0 con 0x7f09d80c4a50 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80c52c0 con 0x7f09d8151e40 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dfc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09d80c5880 con 0x7f09d80c8c30 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.685 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48324/0 (socket says 172.21.15.100:48324) 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 -- 172.21.15.100:0/1956821557 learned_addr learned my addr 172.21.15.100:0/1956821557 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 -- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09d80c8c30 msgr2=0x7f09d80aad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09d80c8c30 0x7f09d80aad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 -- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09d8151e40 msgr2=0x7f09d814f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09d8151e40 0x7f09d814f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.681+0000 7f09dd200640 1 -- 172.21.15.100:0/1956821557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d0009a70 con 0x7f09d80c4a50 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09dd200640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c430 tx=0x7f09c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.686 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c80074e0 con 0x7f09d80c4a50 2024-01-20T08:14:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09c8007660 con 0x7f09d80c4a50 2024-01-20T08:14:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09c8004a20 con 0x7f09d80c4a50 2024-01-20T08:14:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09d814cee0 con 0x7f09d80c4a50 2024-01-20T08:14:42.687 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.682+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09d80c6250 con 0x7f09d80c4a50 2024-01-20T08:14:42.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.683+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09d804e970 con 0x7f09d80c4a50 2024-01-20T08:14:42.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.684+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f09c8004b80 con 0x7f09d80c4a50 2024-01-20T08:14:42.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.685+0000 7f09d4c00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 0x7f09b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:42.688 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.685+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f09c8089060 con 0x7f09d80c4a50 2024-01-20T08:14:42.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.685+0000 7f09d7e00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 0x7f09b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:42.689 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.686+0000 7f09d7e00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 0x7f09b006d390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f09d80c4e80 tx=0x7f09c00079b0 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:42.692 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.689+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f09c80bc0d0 con 0x7f09d80c4a50 2024-01-20T08:14:42.882 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.879+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f09d8156410 con 0x7f09b006aed0 2024-01-20T08:14:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.880+0000 7f09d4c00640 1 -- 172.21.15.100:0/1956821557 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f09c0005030 con 0x7f09b006aed0 2024-01-20T08:14:42.883 INFO:teuthology.orchestra.run.smithi100.stderr:instructed osd(s) 7 to deep-scrub 2024-01-20T08:14:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 msgr2=0x7f09b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 0x7f09b006d390 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f09d80c4e80 tx=0x7f09c00079b0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.885 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 msgr2=0x7f09d80c5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f09c800c430 tx=0x7f09c800c8f0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 shutdown_connections 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f09d8151e40 0x7f09d814f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f09b006aed0 0x7f09b006d390 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f09d80c8c30 0x7f09d80aad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 --2- 172.21.15.100:0/1956821557 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09d80c4a50 0x7f09d80c5d10 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 >> 172.21.15.100:0/1956821557 conn(0x7f09d80abde0 msgr2=0x7f09d814edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 shutdown_connections 2024-01-20T08:14:42.886 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:42.882+0000 7f09dfc00640 1 -- 172.21.15.100:0/1956821557 wait complete. 2024-01-20T08:14:42.905 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:14:43.114 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.111+0000 7f47ae600640 1 Processor -- start 2024-01-20T08:14:43.115 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.112+0000 7f47ae600640 1 -- start start 2024-01-20T08:14:43.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ae600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47a8072560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ae600640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7f47a8072aa0 0x7f47a8071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ae600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a8158a30 con 0x7f47a8072010 2024-01-20T08:14:43.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ae600640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47a81558b0 con 0x7f47a8072aa0 2024-01-20T08:14:43.116 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ae600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8157e20 con 0x7f47a81554d0 2024-01-20T08:14:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47adc00640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f47a8072010 0x7f47a80c5120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:50596/0 (socket says 172.21.15.100:50596) 2024-01-20T08:14:43.117 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47adc00640 1 -- 172.21.15.100:0/1365586400 learned_addr learned my addr 172.21.15.100:0/1365586400 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:14:43.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f479fc00640 1 --2- 172.21.15.100:0/1365586400 >> v2:172.21.15.100:3300/0 conn(0x7f47a8072aa0 0x7f47a8071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.118 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.113+0000 7f47ad200640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47a8072560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 313463672 0 0) 0x7f47a8158a30 con 0x7f47a8072010 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4788003520 con 0x7f47a8072010 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3706008529 0 0) 0x7f4788003520 con 0x7f47a8072010 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 msgr2=0x7f47a8072560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47a8072560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 >> v2:172.21.15.100:3300/0 conn(0x7f47a8072aa0 msgr2=0x7f47a8071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:43.119 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 --2- 172.21.15.100:0/1365586400 >> v2:172.21.15.100:3300/0 conn(0x7f47a8072aa0 0x7f47a8071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8158100 con 0x7f47a8072010 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f47a00019f0 con 0x7f47a8072010 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f479fc00640 1 --2- 172.21.15.100:0/1365586400 >> v2:172.21.15.100:3300/0 conn(0x7f47a8072aa0 0x7f47a8071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 >> v1:172.21.15.100:6789/0 conn(0x7f47a8072010 legacy=0x7f47a80c5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4788003970 0x7f4788003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47880047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f4788005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81558b0 con 0x7f4788004d00 2024-01-20T08:14:43.120 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8157e20 con 0x7f4788003970 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478800bb00 con 0x7f47a81554d0 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.114+0000 7f47adc00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f4788005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f479fc00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47880047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47ad200640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4788003970 0x7f4788003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47adc00640 1 -- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 msgr2=0x7f47880047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47adc00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81554d0 0x7f47880047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47adc00640 1 -- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4788003970 msgr2=0x7f4788003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47adc00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f4788003970 0x7f4788003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.121 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.115+0000 7f47adc00640 1 -- 172.21.15.100:0/1365586400 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788003520 con 0x7f4788004d00 2024-01-20T08:14:43.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.116+0000 7f47adc00640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f4788005180 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f47a000a790 tx=0x7f47880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12d394a3b661fe8 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:43.124 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.116+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0034630 con 0x7f4788004d00 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.116+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a002f070 con 0x7f4788004d00 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.116+0000 7f47a7e00640 1 -- 172.21.15.100:0/1365586400 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00349f0 con 0x7f4788004d00 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 -- 172.21.15.100:0/1365586400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 msgr2=0x7f4788005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 --2- 172.21.15.100:0/1365586400 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f4788005180 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f47a000a790 tx=0x7f47880057f0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47adc00640 1 -- 172.21.15.100:0/1365586400 reap_dead start 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 -- 172.21.15.100:0/1365586400 shutdown_connections 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 -- 172.21.15.100:0/1365586400 >> 172.21.15.100:0/1365586400 conn(0x7f47a80c3740 msgr2=0x7f47a80c3b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:43.125 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 -- 172.21.15.100:0/1365586400 shutdown_connections 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.117+0000 7f47ae600640 1 -- 172.21.15.100:0/1365586400 wait complete. 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.119+0000 7f47ae600640 1 Processor -- start 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.119+0000 7f47ae600640 1 -- start start 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80a9fc0 0x7f47a81ed6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81edbe0 0x7f47a814da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80ac540 con 0x7f4788004d00 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a806f4f0 con 0x7f47a80a9fc0 2024-01-20T08:14:43.126 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ae600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80aca70 con 0x7f47a81edbe0 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:48346/0 (socket says 172.21.15.100:48346) 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 -- 172.21.15.100:0/2675646253 learned_addr learned my addr 172.21.15.100:0/2675646253 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 -- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81edbe0 msgr2=0x7f47a814da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81edbe0 0x7f47a814da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 -- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80a9fc0 msgr2=0x7f47a81ed6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80a9fc0 0x7f47a81ed6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.127 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.120+0000 7f47ad200640 1 -- 172.21.15.100:0/2675646253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a806d660 con 0x7f4788004d00 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47ad200640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4798011570 tx=0x7f4798011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798015930 con 0x7f4788004d00 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798015a90 con 0x7f4788004d00 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a80ac790 con 0x7f4788004d00 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798015e60 con 0x7f4788004d00 2024-01-20T08:14:43.128 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.121+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a806f180 con 0x7f4788004d00 2024-01-20T08:14:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.122+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a80724e0 con 0x7f4788004d00 2024-01-20T08:14:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.123+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f479801d400 con 0x7f4788004d00 2024-01-20T08:14:43.129 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.124+0000 7f47a5600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 0x7f478006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:14:43.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.124+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f4798089b30 con 0x7f4788004d00 2024-01-20T08:14:43.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.124+0000 7f479fc00640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 0x7f478006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:14:43.130 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.125+0000 7f479fc00640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 0x7f478006d390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47a80a5e20 tx=0x7f479000c350 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:14:43.131 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.128+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f4798054c90 con 0x7f4788004d00 2024-01-20T08:14:43.322 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.319+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f47a80712d0 con 0x7f478006aed0 2024-01-20T08:14:43.325 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.322+0000 7f47a5600640 1 -- 172.21.15.100:0/2675646253 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47866 (secure 0 0 0) 0x7f479000ce00 con 0x7f478006aed0 2024-01-20T08:14:43.326 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:14:43.326 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:14:43.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 msgr2=0x7f478006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 0x7f478006d390 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f47a80a5e20 tx=0x7f479000c350 comp rx=0 tx=0).stop 2024-01-20T08:14:43.328 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 msgr2=0x7f47a806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f4798011570 tx=0x7f4798011a30 comp rx=0 tx=0).stop 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 shutdown_connections 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f478006aed0 0x7f478006d390 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f47a81edbe0 0x7f47a814da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f47a80a9fc0 0x7f47a81ed6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 --2- 172.21.15.100:0/2675646253 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4788004d00 0x7f47a806d120 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 >> 172.21.15.100:0/2675646253 conn(0x7f47a80c3740 msgr2=0x7f47a81546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:14:43.329 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 shutdown_connections 2024-01-20T08:14:43.330 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:14:43.325+0000 7f47ae600640 1 -- 172.21.15.100:0/2675646253 wait complete. 2024-01-20T08:14:43.345 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-01-20T08:14:41.977389+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258808,"kb_used_data":9352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715912,"statfs":{"total":773094113280,"available":772829093888,"internally_reserved":0,"allocated":9576448,"data_stored":4915896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-138,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002405"},"pg_stats":[{"pgid":"1.0","version":"20'117","reported_seq":221,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-01-20T08:14:31.768926+0000","last_change":"2024-01-20T08:10:04.796616+0000","last_active":"2024-01-20T08:14:31.768926+0000","last_peered":"2024-01-20T08:14:31.768926+0000","last_clean":"2024-01-20T08:14:31.768926+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:14:31.768926+0000","last_undegraded":"2024-01-20T08:14:31.768926+0000","last_fullsized":"2024-01-20T08:14:31.768926+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-01-20T08:10:02.651534+0000","last_clean_scrub_stamp":"2024-01-20T08:10:02.651534+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T14:52:25.293899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1642496,"data_stored":1057263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.2410000000000001,"15min":1.244},"min":{"1min":0.63700000000000001,"5min":0.627,"15min":0.627},"max":{"1min":10.865,"5min":10.865,"15min":10.865},"last":1.613},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1759999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4930000000000001,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":0.78700000000000003}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.2190000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.2729999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.577,"5min":11.805,"15min":11.805},"last":1.107}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3169999999999999,"15min":1.2549999999999999},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4059999999999999,"15min":1.4490000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5030000000000001,"5min":6.5030000000000001,"15min":6.5030000000000001},"last":1.4430000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4950000000000001,"15min":1.4610000000000001},"min":{"1min":0.79000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.503,"5min":11.972,"15min":11.972},"last":1.004},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.361,"15min":1.353},"min":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.1900000000000004,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.1779999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.4990000000000001,"15min":1.5609999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":1.345},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.73,"15min":1.724},"min":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":1.5580000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.502,"15min":1.5569999999999999},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":3.6960000000000002,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.855},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.625,"15min":1.609},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.1909999999999998,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.2769999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.90700000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":1.327},{"interface":"front","average":{"1min":3.0259999999999998,"5min":1.9370000000000001,"15min":1.823},"min":{"1min":1.044,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":28.498000000000001,"5min":28.498000000000001,"15min":28.498000000000001},"last":1.722}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0940000000000001,"15min":1.1950000000000001},"min":{"1min":0.628,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4970000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.1899999999999999},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.698,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.242}]},{"osd":1,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2829999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":2.008,"15min":2.008},"last":1.538},{"interface":"front","average":{"1min":1.278,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.754,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":2.004,"15min":2.004},"last":0.71199999999999997}]},{"osd":2,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.163,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.532,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":0.78300000000000003},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.94399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8899999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":0.95299999999999996}]},{"osd":3,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3460000000000001,"15min":1.4179999999999999},"min":{"1min":0.83499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7010000000000001,"5min":2.222,"15min":2.222},"last":1.4350000000000001},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.369,"15min":1.4410000000000001},"min":{"1min":0.98899999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8129999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.4750000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.476,"15min":1.573},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6419999999999999,"5min":2.915,"15min":2.915},"last":1.6819999999999999},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.554,"15min":1.6539999999999999},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.778,"5min":2.718,"15min":2.718},"last":1.5960000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.498,"15min":1.5589999999999999},"min":{"1min":1.0029999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6870000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.3220000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7529999999999999},"min":{"1min":0.91000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.845,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.819}]},{"osd":7,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.6499999999999999,"15min":1.73},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.847,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.7529999999999999},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.673,"15min":1.7569999999999999},"min":{"1min":1.1639999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.1429999999999998,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.643}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.097,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":0.90000000000000002}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.409,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.3},{"interface":"front","average":{"1min":1.145,"5min":1.1419999999999999,"15min":1.133},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.569,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":0.95999999999999996}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2010000000000001,"15min":1.226},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7390000000000001,"5min":1.806,"15min":1.806},"last":0.78800000000000003},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2150000000000001,"15min":1.2549999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5600000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1919999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.292,"15min":1.351},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.569,"5min":1.776,"15min":1.776},"last":1.137},{"interface":"front","average":{"1min":1.232,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5920000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.157}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.347,"15min":1.3859999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5549999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.3580000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.423,"15min":1.4410000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8149999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.0529999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.472,"15min":1.516},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8460000000000001,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":0.995},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.51,"15min":1.556},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8340000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.4099999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.552,"15min":1.5680000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8819999999999999,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.2230000000000001},{"interface":"front","average":{"1min":1.47,"5min":1.645,"15min":1.72},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.911,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.077}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.147,"15min":1.2290000000000001},"min":{"1min":0.59499999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.573,"5min":3.165,"15min":3.165},"last":2.0219999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0329999999999999},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.619,"5min":1.71,"15min":1.71},"last":2.0659999999999998}]},{"osd":1,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7709999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.925},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.224,"15min":1.3600000000000001},"min":{"1min":0.83499999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.9730000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.139,"15min":1.085},"min":{"1min":0.78000000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.48,"5min":1.667,"15min":1.667},"last":1.508},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.256,"15min":1.264},"min":{"1min":0.93200000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.643,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":1.5640000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2430000000000001,"15min":1.2729999999999999},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.484,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.7250000000000001},{"interface":"front","average":{"1min":1.26,"5min":1.335,"15min":1.391},"min":{"1min":0.85299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.649,"5min":2.613,"15min":2.613},"last":1.4470000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.3109999999999999,"15min":1.3320000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6559999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":2.113}]},{"osd":6,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4139999999999999,"15min":1.409},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7370000000000001,"5min":1.919,"15min":1.919},"last":1.3540000000000001},{"interface":"front","average":{"1min":1.327,"5min":1.478,"15min":1.5049999999999999},"min":{"1min":0.73599999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.752,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":2.173}]},{"osd":7,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.5,"15min":1.548},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.736,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":2.2000000000000002},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5860000000000001},"min":{"1min":0.76500000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.825,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.8240000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.79600000000000004,"15min":0.754},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.83899999999999997},"min":{"1min":0.48499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.94199999999999995}]},{"osd":1,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3169999999999999,"5min":1.448,"15min":1.448},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.93400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.506,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":0.44400000000000001}]},{"osd":2,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.089,"15min":1.097},"min":{"1min":0.54300000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.7430000000000001,"5min":3.02,"15min":3.02},"last":0.96899999999999997},{"interface":"front","average":{"1min":1.161,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.2090000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.21,"15min":1.24},"min":{"1min":0.85499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.603,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.621,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.3500000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.294,"15min":1.329},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":2.153,"15min":2.153},"last":1.282},{"interface":"front","average":{"1min":1.214,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.548,"5min":2.359,"15min":2.359},"last":1.1359999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8069999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.4139999999999999},{"interface":"front","average":{"1min":1.365,"5min":1.343,"15min":1.339},"min":{"1min":0.86099999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.696,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":0.91600000000000004}]},{"osd":7,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3979999999999999,"15min":1.419},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8280000000000001,"5min":2.286,"15min":2.286},"last":1.3069999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.98599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.679,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.1799999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84799999999999998,"15min":0.91700000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3049999999999999,"5min":1.712,"15min":1.712},"last":0.748},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.879,"15min":0.94699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.601,"15min":1.601},"last":0.50700000000000001}]},{"osd":1,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97399999999999998,"15min":1.0600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4450000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.90200000000000002,"5min":1.0189999999999999,"15min":1.081},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":0.59399999999999997}]},{"osd":3,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.91300000000000003,"15min":1.056},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.131,"15min":1.2509999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.522,"5min":2.177,"15min":2.177},"last":1.1220000000000001}]},{"osd":4,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.3819999999999999,"15min":1.4950000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.696,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4490000000000001},"min":{"1min":0.69799999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.752,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.0800000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1990000000000001,"15min":1.292},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.208,"5min":1.3799999999999999,"15min":1.514},"min":{"1min":0.79600000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.538,"5min":2.29,"15min":2.29},"last":1.196}]},{"osd":6,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.429,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.6519999999999999,"5min":2.734,"15min":2.734},"last":1.046},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.371,"15min":1.5029999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.762,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.252}]},{"osd":7,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4470000000000001,"15min":1.581},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":0.872},{"interface":"front","average":{"1min":1.278,"5min":1.417,"15min":1.585},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8360000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.1479999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93999999999999995,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.747},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.546,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.075}]},{"osd":2,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.542,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.86799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3899999999999999,"5min":1.444,"15min":1.444},"last":1.04}]},{"osd":3,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":0.96099999999999997},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":1.885,"15min":1.885},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94399999999999995,"15min":0.98599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.5980000000000001,"5min":1.758,"15min":1.758},"last":1.196}]},{"osd":4,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.75800000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.631,"5min":1.905,"15min":1.905},"last":1.526},{"interface":"front","average":{"1min":1.194,"5min":1.248,"15min":1.25},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5449999999999999,"5min":2.069,"15min":2.069},"last":1.252}]},{"osd":5,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.508,"5min":2.052,"15min":2.052},"last":1.2769999999999999},{"interface":"front","average":{"1min":1.202,"5min":1.266,"15min":1.272},"min":{"1min":0.79300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.613,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.2969999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2989999999999999,"15min":1.3129999999999999},"min":{"1min":0.74099999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6279999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.248,"5min":1.3240000000000001,"15min":1.379},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.784,"5min":1.97,"15min":1.97},"last":1.337}]},{"osd":7,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.349},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2,"15min":2},"last":1.379},{"interface":"front","average":{"1min":1.25,"5min":1.341,"15min":1.3819999999999999},"min":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6759999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.401}]}]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32788,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339052,"statfs":{"total":96636764160,"available":96603189248,"internally_reserved":0,"allocated":1642496,"data_stored":1057263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4470000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2689999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":0.94299999999999995}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.86699999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.663,"5min":1.722,"15min":1.722},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.018,"5min":0.995,"15min":0.96299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4079999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.034}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4119999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":1.8149999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.91600000000000004}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1299999999999999,"15min":1.099},"min":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.611,"5min":1.968,"15min":1.968},"last":1.129},{"interface":"front","average":{"1min":1.204,"5min":1.139,"15min":1.123},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":0.84599999999999997}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.71799999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.617,"5min":1.865,"15min":1.865},"last":1.0589999999999999},{"interface":"front","average":{"1min":1.304,"5min":1.238,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8839999999999999,"5min":2.427,"15min":2.427},"last":1.0800000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.323,"15min":1.327},"min":{"1min":0.84799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.802,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2629999999999999,"15min":1.278},"min":{"1min":0.67200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.254}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.349,"15min":1.375},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9830000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.2},{"interface":"front","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":0.98999999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:14:43.349 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-01-20T08:10:02.651534+0000 time.struct_time(tm_year=2024, tm_mon=1, tm_mday=20, tm_hour=8, tm_min=10, tm_sec=2, tm_wday=5, tm_yday=20, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=1, tm_mday=20, tm_hour=8, tm_min=14, tm_sec=36, tm_wday=5, tm_yday=20, tm_isdst=0) 2024-01-20T08:14:43.349 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-01-20T08:15:03.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-01-20T08:15:03.565 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.562+0000 7f231f000640 1 Processor -- start 2024-01-20T08:15:03.566 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.562+0000 7f231f000640 1 -- start start 2024-01-20T08:15:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231f000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f23180abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231f000640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7f2318151f60 0x7f2318070370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231f000640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23180c1670 con 0x7f23180c1b00 2024-01-20T08:15:03.567 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231f000640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23181524b0 con 0x7f2318151f60 2024-01-20T08:15:03.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231f000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c0d40 con 0x7f2318147f20 2024-01-20T08:15:03.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231d000640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f23180c1b00 0x7f23180c2c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47870/0 (socket says 172.21.15.100:47870) 2024-01-20T08:15:03.568 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f231d000640 1 -- 172.21.15.100:0/3055192731 learned_addr learned my addr 172.21.15.100:0/3055192731 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:15:03.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f2317400640 1 --2- 172.21.15.100:0/3055192731 >> v2:172.21.15.110:3300/0 conn(0x7f2318151f60 0x7f2318070370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.571 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f23180abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.564+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727438256 0 0) 0x7f23180c1670 con 0x7f23180c1b00 2024-01-20T08:15:03.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f8003520 con 0x7f23180c1b00 2024-01-20T08:15:03.572 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1927611630 0 0) 0x7f22f8003520 con 0x7f23180c1b00 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 msgr2=0x7f23180abfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f23180abfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 >> v2:172.21.15.110:3300/0 conn(0x7f2318151f60 msgr2=0x7f2318070370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 --2- 172.21.15.100:0/3055192731 >> v2:172.21.15.110:3300/0 conn(0x7f2318151f60 0x7f2318070370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180c1020 con 0x7f23180c1b00 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f2310001670 con 0x7f23180c1b00 2024-01-20T08:15:03.573 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f23180abfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 >> v1:172.21.15.100:6789/0 conn(0x7f23180c1b00 legacy=0x7f23180c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f22f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80047c0 0x7f22f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f22f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181524b0 con 0x7f22f8003970 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c0d40 con 0x7f22f80047c0 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22f800db90 con 0x7f2318147f20 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.565+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f22f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.574 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317e00640 1 -- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 msgr2=0x7f22f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318147f20 0x7f22f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317e00640 1 -- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80047c0 msgr2=0x7f22f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317400640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80047c0 0x7f22f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f22f80047c0 0x7f22f8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.566+0000 7f2317e00640 1 -- 172.21.15.100:0/3055192731 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f8003520 con 0x7f22f8003970 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.567+0000 7f2317e00640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f22f8003d90 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2308007410 tx=0x7f22f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bcc898ad38a034 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.567+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230802cd60 con 0x7f22f8003970 2024-01-20T08:15:03.575 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.567+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308034440 con 0x7f22f8003970 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.567+0000 7f2316a00640 1 -- 172.21.15.100:0/3055192731 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23080347b0 con 0x7f22f8003970 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 -- 172.21.15.100:0/3055192731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 msgr2=0x7f22f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 --2- 172.21.15.100:0/3055192731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f22f8003d90 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f2308007410 tx=0x7f22f80057f0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231d000640 1 -- 172.21.15.100:0/3055192731 reap_dead start 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 -- 172.21.15.100:0/3055192731 shutdown_connections 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 -- 172.21.15.100:0/3055192731 >> 172.21.15.100:0/3055192731 conn(0x7f231806a5e0 msgr2=0x7f231806a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 -- 172.21.15.100:0/3055192731 shutdown_connections 2024-01-20T08:15:03.576 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.568+0000 7f231f000640 1 -- 172.21.15.100:0/3055192731 wait complete. 2024-01-20T08:15:03.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.570+0000 7f231f000640 1 Processor -- start 2024-01-20T08:15:03.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.570+0000 7f231f000640 1 -- start start 2024-01-20T08:15:03.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.570+0000 7f231f000640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.570+0000 7f231f000640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318153b80 0x7f23180aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.579 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f231f000640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2318144390 0x7f23181ea810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f231f000640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2318148a80 con 0x7f22f8003970 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f231f000640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23181ee5f0 con 0x7f2318144390 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f231f000640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23180c64e0 con 0x7f2318153b80 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56118/0 (socket says 172.21.15.100:56118) 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 -- 172.21.15.100:0/3357633501 learned_addr learned my addr 172.21.15.100:0/3357633501 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 -- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318153b80 msgr2=0x7f23180aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318153b80 0x7f23180aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.580 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 -- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2318144390 msgr2=0x7f23181ea810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2318144390 0x7f23181ea810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.571+0000 7f2317e00640 1 -- 172.21.15.100:0/3357633501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23181edd50 con 0x7f22f8003970 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f2317e00640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2308037040 tx=0x7f2308004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308003b90 con 0x7f22f8003970 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2308003cf0 con 0x7f22f8003970 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2308004220 con 0x7f22f8003970 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23181ee030 con 0x7f22f8003970 2024-01-20T08:15:03.581 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.572+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23181ea2f0 con 0x7f22f8003970 2024-01-20T08:15:03.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.573+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23181ea150 con 0x7f22f8003970 2024-01-20T08:15:03.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.574+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f2308004380 con 0x7f22f8003970 2024-01-20T08:15:03.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.576+0000 7f230fe00640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:03.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.576+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f23080ab900 con 0x7f22f8003970 2024-01-20T08:15:03.582 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.576+0000 7f2317400640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:03.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.577+0000 7f2317400640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 0x7f22f006d3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2318153f60 tx=0x7f2300008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:03.583 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.580+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f23181ea150 con 0x7f22f8003970 2024-01-20T08:15:03.771 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.768+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 --> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f231806e860 con 0x7f22f006af00 2024-01-20T08:15:03.777 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.774+0000 7f230fe00640 1 -- 172.21.15.100:0/3357633501 <== mgr.4109 v2:172.21.15.100:6832/3001793226 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+47604 (secure 0 0 0) 0x7f2300006bd0 con 0x7f22f006af00 2024-01-20T08:15:03.778 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:15:03.778 INFO:teuthology.orchestra.run.smithi100.stderr:dumped all 2024-01-20T08:15:03.780 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 msgr2=0x7f22f006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 0x7f22f006d3c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f2318153f60 tx=0x7f2300008040 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 msgr2=0x7f23181ed6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f2308037040 tx=0x7f2308004ab0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 shutdown_connections 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f2318144390 0x7f23181ea810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f22f006af00 0x7f22f006d3c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f2318153b80 0x7f23180aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 --2- 172.21.15.100:0/3357633501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f22f8003970 0x7f23181ed6c0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.777+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 >> 172.21.15.100:0/3357633501 conn(0x7f231806a5e0 msgr2=0x7f2318147350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:03.781 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.778+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 shutdown_connections 2024-01-20T08:15:03.782 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.778+0000 7f231f000640 1 -- 172.21.15.100:0/3357633501 wait complete. 2024-01-20T08:15:03.799 INFO:teuthology.orchestra.run.smithi100.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2024-01-20T08:15:01.982844+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":258792,"kb_used_data":9352,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754715928,"statfs":{"total":773094113280,"available":772829110272,"internally_reserved":0,"allocated":9576448,"data_stored":4915896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":255315505},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003334"},"pg_stats":[{"pgid":"1.0","version":"84'119","reported_seq":232,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-01-20T08:14:43.899357+0000","last_change":"2024-01-20T08:14:43.899433+0000","last_active":"2024-01-20T08:14:43.899357+0000","last_peered":"2024-01-20T08:14:43.899357+0000","last_clean":"2024-01-20T08:14:43.899357+0000","last_became_active":"2024-01-20T08:10:04.795454+0000","last_became_peered":"2024-01-20T08:10:04.795454+0000","last_unstale":"2024-01-20T08:14:43.899357+0000","last_undegraded":"2024-01-20T08:14:43.899357+0000","last_fullsized":"2024-01-20T08:14:43.899357+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"84'119","last_scrub_stamp":"2024-01-20T08:14:43.899175+0000","last_deep_scrub":"84'119","last_deep_scrub_stamp":"2024-01-20T08:14:43.899175+0000","last_clean_scrub_stamp":"2024-01-20T08:14:43.899175+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-01-21T19:38:53.877362+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1642496,"data_stored":1057263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.617,"5min":1.2410000000000001,"15min":1.244},"min":{"1min":0.63700000000000001,"5min":0.627,"15min":0.627},"max":{"1min":10.865,"5min":10.865,"15min":10.865},"last":1.1970000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":1.1599999999999999,"15min":1.1759999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":1.4930000000000001,"5min":6.2759999999999998,"15min":6.2759999999999998},"last":0.85899999999999999}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.5389999999999999,"5min":1.262,"15min":1.2529999999999999},"min":{"1min":0.79700000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":6.4550000000000001,"5min":6.4550000000000001,"15min":6.4550000000000001},"last":1.377},{"interface":"front","average":{"1min":1.155,"5min":1.2729999999999999,"15min":1.262},"min":{"1min":0.56200000000000006,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.577,"5min":11.805,"15min":11.805},"last":1.0589999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.514,"5min":1.3169999999999999,"15min":1.2549999999999999},"min":{"1min":0.73999999999999999,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":6.7110000000000003,"5min":6.7110000000000003,"15min":6.7110000000000003},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.4750000000000001,"5min":1.4059999999999999,"15min":1.4490000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":6.5030000000000001,"5min":6.5030000000000001,"15min":6.5030000000000001},"last":1.444}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.742,"5min":1.4950000000000001,"15min":1.4610000000000001},"min":{"1min":0.79000000000000004,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":11.503,"5min":11.972,"15min":11.972},"last":1.137},{"interface":"front","average":{"1min":1.4490000000000001,"5min":1.361,"15min":1.353},"min":{"1min":0.91000000000000003,"5min":0.82199999999999995,"15min":0.82199999999999995},"max":{"1min":5.1900000000000004,"5min":8.6969999999999992,"15min":8.6969999999999992},"last":1.2729999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.806,"5min":1.4990000000000001,"15min":1.5609999999999999},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":10.814,"5min":10.814,"15min":10.814},"last":1.492},{"interface":"front","average":{"1min":2.1320000000000001,"5min":1.73,"15min":1.724},"min":{"1min":0.60599999999999998,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":13.083,"5min":13.083,"15min":13.083},"last":1.536}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.502,"15min":1.5569999999999999},"min":{"1min":0.56200000000000006,"5min":0.504,"15min":0.504},"max":{"1min":3.6960000000000002,"5min":7.2809999999999997,"15min":7.2809999999999997},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.6359999999999999,"5min":1.625,"15min":1.609},"min":{"1min":0.81299999999999994,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":6.1909999999999998,"5min":14.548999999999999,"15min":14.548999999999999},"last":1.4139999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.6539999999999999,"15min":1.6819999999999999},"min":{"1min":0.90700000000000003,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":8.1890000000000001,"5min":8.1890000000000001,"15min":8.1890000000000001},"last":1.474},{"interface":"front","average":{"1min":3.0259999999999998,"5min":1.9370000000000001,"15min":1.823},"min":{"1min":1.044,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":28.498000000000001,"5min":28.498000000000001,"15min":28.498000000000001},"last":1.3420000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.0940000000000001,"15min":1.1950000000000001},"min":{"1min":0.628,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.4970000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.706},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.1040000000000001,"15min":1.097},"min":{"1min":0.64900000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.698,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.232}]},{"osd":1,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.1970000000000001,"15min":1.2829999999999999},"min":{"1min":0.754,"5min":0.754,"15min":0.754},"max":{"1min":1.6699999999999999,"5min":2.008,"15min":2.008},"last":1.355},{"interface":"front","average":{"1min":1.278,"5min":1.254,"15min":1.2669999999999999},"min":{"1min":0.754,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.7649999999999999,"5min":2.004,"15min":2.004},"last":1.6699999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.163,"15min":1.169},"min":{"1min":0.85399999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.532,"5min":2.6019999999999999,"15min":2.6019999999999999},"last":1.296},{"interface":"front","average":{"1min":1.3220000000000001,"5min":1.2929999999999999,"15min":1.3280000000000001},"min":{"1min":0.94399999999999995,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.8899999999999999,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.5620000000000001}]},{"osd":3,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.288,"5min":1.3460000000000001,"15min":1.4179999999999999},"min":{"1min":0.83499999999999996,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":1.7010000000000001,"5min":2.222,"15min":2.222},"last":1.5109999999999999},{"interface":"front","average":{"1min":1.3240000000000001,"5min":1.369,"15min":1.4410000000000001},"min":{"1min":0.98899999999999999,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.8129999999999999,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.413}]},{"osd":4,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3029999999999999,"5min":1.476,"15min":1.573},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.6419999999999999,"5min":2.915,"15min":2.915},"last":1.631},{"interface":"front","average":{"1min":1.3959999999999999,"5min":1.554,"15min":1.6539999999999999},"min":{"1min":0.67300000000000004,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.778,"5min":2.718,"15min":2.718},"last":1.6060000000000001}]},{"osd":5,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.498,"15min":1.5589999999999999},"min":{"1min":1.0029999999999999,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.6870000000000001,"5min":2.8170000000000002,"15min":2.8170000000000002},"last":1.177},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.619,"15min":1.7529999999999999},"min":{"1min":0.91000000000000003,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.845,"5min":3.0739999999999998,"15min":3.0739999999999998},"last":1.4490000000000001}]},{"osd":7,"last update":"Sat Jan 20 08:14:11 2024","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.6499999999999999,"15min":1.73},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.847,"5min":2.4279999999999999,"15min":2.4279999999999999},"last":1.7330000000000001},{"interface":"front","average":{"1min":1.5529999999999999,"5min":1.673,"15min":1.7569999999999999},"min":{"1min":1.1639999999999999,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.1429999999999998,"5min":3.5880000000000001,"15min":3.5880000000000001},"last":1.4790000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.0069999999999999,"5min":1.0409999999999999,"15min":1.052},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.4750000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.097,"5min":1.071,"15min":1.0660000000000001},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.5760000000000001,"5min":1.5760000000000001,"15min":1.5760000000000001},"last":1.431}]},{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":1.0620000000000001,"15min":1.0980000000000001},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.409,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.542},{"interface":"front","average":{"1min":1.145,"5min":1.1419999999999999,"15min":1.133},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.569,"5min":1.8600000000000001,"15min":1.8600000000000001},"last":1.03}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":1.2010000000000001,"15min":1.226},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.7390000000000001,"5min":1.806,"15min":1.806},"last":0.95699999999999996},{"interface":"front","average":{"1min":1.0740000000000001,"5min":1.2150000000000001,"15min":1.2549999999999999},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.5600000000000001,"5min":2.4249999999999998,"15min":2.4249999999999998},"last":1.1399999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.292,"15min":1.351},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.569,"5min":1.776,"15min":1.776},"last":1.3859999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.3500000000000001,"15min":1.3939999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.5920000000000001,"5min":2.6739999999999999,"15min":2.6739999999999999},"last":1.345}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.228,"5min":1.347,"15min":1.3859999999999999},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.5549999999999999,"5min":2.3069999999999999,"15min":2.3069999999999999},"last":1.4770000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.423,"15min":1.4410000000000001},"min":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"max":{"1min":1.8149999999999999,"5min":2.7949999999999999,"15min":2.7949999999999999},"last":1.51}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.472,"15min":1.516},"min":{"1min":0.62,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.8460000000000001,"5min":4.2220000000000004,"15min":4.2220000000000004},"last":1.0680000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.51,"15min":1.556},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.8340000000000001,"5min":2.8399999999999999,"15min":2.8399999999999999},"last":1.302}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.4419999999999999,"5min":1.552,"15min":1.5680000000000001},"min":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":1.8819999999999999,"5min":2.4990000000000001,"15min":2.4990000000000001},"last":1.595},{"interface":"front","average":{"1min":1.47,"5min":1.645,"15min":1.72},"min":{"1min":0.71199999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.911,"5min":4.1159999999999997,"15min":4.1159999999999997},"last":1.2629999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.147,"15min":1.2290000000000001},"min":{"1min":0.59499999999999997,"5min":0.378,"15min":0.378},"max":{"1min":1.573,"5min":3.165,"15min":3.165},"last":0.91100000000000003},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0549999999999999,"15min":1.0329999999999999},"min":{"1min":0.66600000000000004,"5min":0.623,"15min":0.623},"max":{"1min":1.619,"5min":1.71,"15min":1.71},"last":1.109}]},{"osd":1,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.2929999999999999,"15min":1.4079999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.7709999999999999,"5min":7.3179999999999996,"15min":7.3179999999999996},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.224,"15min":1.3600000000000001},"min":{"1min":0.83499999999999996,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.6819999999999999,"5min":6.7089999999999996,"15min":6.7089999999999996},"last":1.3029999999999999}]},{"osd":2,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.139,"15min":1.085},"min":{"1min":0.78000000000000003,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.48,"5min":1.667,"15min":1.667},"last":1.0580000000000001},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.256,"15min":1.264},"min":{"1min":0.93200000000000005,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.643,"5min":2.3479999999999999,"15min":2.3479999999999999},"last":0.98299999999999998}]},{"osd":3,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":1.2430000000000001,"15min":1.2729999999999999},"min":{"1min":0.70799999999999996,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.484,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.139},{"interface":"front","average":{"1min":1.26,"5min":1.335,"15min":1.391},"min":{"1min":0.85299999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.649,"5min":2.613,"15min":2.613},"last":1.347}]},{"osd":5,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.3109999999999999,"15min":1.3320000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6559999999999999,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.236},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.3320000000000001,"15min":1.3560000000000001},"min":{"1min":0.65000000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.593,"5min":2.6589999999999998,"15min":2.6589999999999998},"last":1.377}]},{"osd":6,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.4139999999999999,"15min":1.409},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.7370000000000001,"5min":1.919,"15min":1.919},"last":1.165},{"interface":"front","average":{"1min":1.327,"5min":1.478,"15min":1.5049999999999999},"min":{"1min":0.73599999999999999,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.752,"5min":2.2429999999999999,"15min":2.2429999999999999},"last":1.282}]},{"osd":7,"last update":"Sat Jan 20 08:14:02 2024","interfaces":[{"interface":"back","average":{"1min":1.357,"5min":1.5,"15min":1.548},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.736,"5min":3.0019999999999998,"15min":3.0019999999999998},"last":1.21},{"interface":"front","average":{"1min":1.4610000000000001,"5min":1.552,"15min":1.5860000000000001},"min":{"1min":0.76500000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.825,"5min":2.7149999999999999,"15min":2.7149999999999999},"last":1.2509999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31914440},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.79600000000000004,"15min":0.754},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.653,"5min":1.653,"15min":1.653},"last":0.746},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.83899999999999997},"min":{"1min":0.48499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.95599999999999996}]},{"osd":1,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.83499999999999996,"15min":0.84299999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3169999999999999,"5min":1.448,"15min":1.448},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.96499999999999997,"5min":0.94599999999999995,"15min":0.93400000000000005},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.506,"5min":1.7529999999999999,"15min":1.7529999999999999},"last":1.109}]},{"osd":2,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.089,"15min":1.097},"min":{"1min":0.54300000000000004,"5min":0.433,"15min":0.433},"max":{"1min":1.7430000000000001,"5min":3.02,"15min":3.02},"last":1.5549999999999999},{"interface":"front","average":{"1min":1.161,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.51100000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.5409999999999999,"5min":2.3959999999999999,"15min":2.3959999999999999},"last":1.526}]},{"osd":4,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.1259999999999999,"5min":1.21,"15min":1.24},"min":{"1min":0.85499999999999998,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.603,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":2.1000000000000001},{"interface":"front","average":{"1min":1.2010000000000001,"5min":1.236,"15min":1.218},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.621,"5min":2.2080000000000002,"15min":2.2080000000000002},"last":1.823}]},{"osd":5,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.2290000000000001,"5min":1.294,"15min":1.329},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":1.665,"5min":2.153,"15min":2.153},"last":1.4299999999999999},{"interface":"front","average":{"1min":1.214,"5min":1.3109999999999999,"15min":1.349},"min":{"1min":0.81000000000000005,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.548,"5min":2.359,"15min":2.359},"last":1.1879999999999999}]},{"osd":6,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.3799999999999999,"15min":1.3839999999999999},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.8069999999999999,"5min":2.4319999999999999,"15min":2.4319999999999999},"last":1.321},{"interface":"front","average":{"1min":1.365,"5min":1.343,"15min":1.339},"min":{"1min":0.86099999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.696,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.2709999999999999}]},{"osd":7,"last update":"Sat Jan 20 08:14:12 2024","interfaces":[{"interface":"back","average":{"1min":1.369,"5min":1.3979999999999999,"15min":1.419},"min":{"1min":0.79300000000000004,"5min":0.77800000000000002,"15min":0.77800000000000002},"max":{"1min":1.8280000000000001,"5min":2.286,"15min":2.286},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.3999999999999999,"15min":1.405},"min":{"1min":0.98599999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.679,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.48}]}]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32208,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339632,"statfs":{"total":96636764160,"available":96603783168,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.84799999999999998,"15min":0.91700000000000004},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.3049999999999999,"5min":1.712,"15min":1.712},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.879,"15min":0.94699999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.1899999999999999,"5min":1.601,"15min":1.601},"last":1.284}]},{"osd":1,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.97399999999999998,"15min":1.0600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.4450000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":0.875},{"interface":"front","average":{"1min":0.90200000000000002,"5min":1.0189999999999999,"15min":1.081},"min":{"1min":0.46999999999999997,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.359,"5min":2.0249999999999999,"15min":2.0249999999999999},"last":1.5649999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.91300000000000003,"15min":1.056},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2869999999999999,"5min":3.3460000000000001,"15min":3.3460000000000001},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.94099999999999995,"5min":1.131,"15min":1.2509999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.522,"5min":2.177,"15min":2.177},"last":1.129}]},{"osd":4,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.3819999999999999,"15min":1.4950000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.696,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":1.349},{"interface":"front","average":{"1min":1.218,"5min":1.345,"15min":1.4490000000000001},"min":{"1min":0.69799999999999995,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.752,"5min":1.9790000000000001,"15min":1.9790000000000001},"last":1.429}]},{"osd":5,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.048,"5min":1.1990000000000001,"15min":1.292},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.458,"5min":1.7969999999999999,"15min":1.7969999999999999},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.208,"5min":1.3799999999999999,"15min":1.514},"min":{"1min":0.79600000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.538,"5min":2.29,"15min":2.29},"last":1.482}]},{"osd":6,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.3160000000000001,"5min":1.429,"15min":1.5349999999999999},"min":{"1min":0.91100000000000003,"5min":0.754,"15min":0.754},"max":{"1min":1.6519999999999999,"5min":2.734,"15min":2.734},"last":1.627},{"interface":"front","average":{"1min":1.2150000000000001,"5min":1.371,"15min":1.5029999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.762,"5min":3.2530000000000001,"15min":3.2530000000000001},"last":1.466}]},{"osd":7,"last update":"Sat Jan 20 08:14:06 2024","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.4470000000000001,"15min":1.581},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.6679999999999999,"5min":2.1680000000000001,"15min":2.1680000000000001},"last":1.679},{"interface":"front","average":{"1min":1.278,"5min":1.417,"15min":1.585},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.8360000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":1.3859999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574910,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32204,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339636,"statfs":{"total":96636764160,"available":96603787264,"internally_reserved":0,"allocated":1048576,"data_stored":466895,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.78700000000000003,"15min":0.80700000000000005},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.93999999999999995,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81100000000000005,"15min":0.79900000000000004},"min":{"1min":0.39800000000000002,"5min":0.317,"15min":0.317},"max":{"1min":1.546,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.099}]},{"osd":2,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.90600000000000003,"15min":0.90400000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":1.542,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.87,"15min":0.86799999999999999},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.3899999999999999,"5min":1.444,"15min":1.444},"last":0.94699999999999995}]},{"osd":3,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.97199999999999998,"15min":0.96099999999999997},"min":{"1min":0.52100000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.4870000000000001,"5min":1.885,"15min":1.885},"last":1.135},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.94399999999999995,"15min":0.98599999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.5980000000000001,"5min":1.758,"15min":1.758},"last":1.1699999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.1619999999999999,"15min":1.1639999999999999},"min":{"1min":0.75800000000000001,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.631,"5min":1.905,"15min":1.905},"last":1.2629999999999999},{"interface":"front","average":{"1min":1.194,"5min":1.248,"15min":1.25},"min":{"1min":0.74299999999999999,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.5449999999999999,"5min":2.069,"15min":2.069},"last":1.081}]},{"osd":5,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.2290000000000001,"15min":1.2669999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.508,"5min":2.052,"15min":2.052},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.202,"5min":1.266,"15min":1.272},"min":{"1min":0.79300000000000004,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":1.613,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":1.7050000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.2989999999999999,"15min":1.3129999999999999},"min":{"1min":0.74099999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.6279999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"last":1.298},{"interface":"front","average":{"1min":1.248,"5min":1.3240000000000001,"15min":1.379},"min":{"1min":0.80800000000000005,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.784,"5min":1.97,"15min":1.97},"last":1.341}]},{"osd":7,"last update":"Sat Jan 20 08:14:13 2024","interfaces":[{"interface":"back","average":{"1min":1.268,"5min":1.3080000000000001,"15min":1.349},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.6679999999999999,"5min":2,"15min":2},"last":1.5},{"interface":"front","average":{"1min":1.25,"5min":1.341,"15min":1.3819999999999999},"min":{"1min":0.68600000000000005,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.6759999999999999,"5min":2.1299999999999999,"15min":2.1299999999999999},"last":1.599}]}]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1604,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1642496,"data_stored":1057263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.77800000000000002,"15min":0.79100000000000004},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.4470000000000001,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.81399999999999995,"15min":0.84099999999999997},"min":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.2689999999999999,"5min":1.6930000000000001,"15min":1.6930000000000001},"last":1.008}]},{"osd":2,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.91300000000000003,"5min":0.89000000000000001,"15min":0.86699999999999999},"min":{"1min":0.54500000000000004,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.663,"5min":1.722,"15min":1.722},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.018,"5min":0.995,"15min":0.96299999999999997},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4079999999999999,"5min":2.0699999999999998,"15min":2.0699999999999998},"last":1.5109999999999999}]},{"osd":3,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.83699999999999997,"15min":0.83099999999999996},"min":{"1min":0.39000000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4119999999999999,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":1.111},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.95999999999999996,"15min":0.98599999999999999},"min":{"1min":0.504,"5min":0.442,"15min":0.442},"max":{"1min":1.8149999999999999,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.3799999999999999}]},{"osd":4,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1379999999999999,"5min":1.1299999999999999,"15min":1.099},"min":{"1min":0.63700000000000001,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.611,"5min":1.968,"15min":1.968},"last":1.272},{"interface":"front","average":{"1min":1.204,"5min":1.139,"15min":1.123},"min":{"1min":0.77500000000000002,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"last":1.329}]},{"osd":5,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1659999999999999},"min":{"1min":0.71799999999999997,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.617,"5min":1.865,"15min":1.865},"last":1.425},{"interface":"front","average":{"1min":1.304,"5min":1.238,"15min":1.2490000000000001},"min":{"1min":0.83299999999999996,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.8839999999999999,"5min":2.427,"15min":2.427},"last":1.2110000000000001}]},{"osd":6,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.361,"5min":1.323,"15min":1.327},"min":{"1min":0.84799999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.802,"5min":2.3639999999999999,"15min":2.3639999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.3109999999999999,"5min":1.2629999999999999,"15min":1.278},"min":{"1min":0.67200000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.8300000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.798}]},{"osd":7,"last update":"Sat Jan 20 08:14:10 2024","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.349,"15min":1.375},"min":{"1min":0.80200000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.9830000000000001,"5min":1.9870000000000001,"15min":1.9870000000000001},"last":1.726},{"interface":"front","average":{"1min":1.294,"5min":1.3149999999999999,"15min":1.3640000000000001},"min":{"1min":0.80200000000000005,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.9259999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.635}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-01-20T08:15:03.801 DEBUG:teuthology.orchestra.run.smithi100:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-01-20T08:15:03.999 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.996+0000 7f84dd600640 1 Processor -- start 2024-01-20T08:15:04.000 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.996+0000 7f84dd600640 1 -- start start 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84dd600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84d81515b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84dd600640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d8154ba0 con 0x7f84d80c1cd0 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84dd600640 1 -- --> v1:172.21.15.110:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d8155a00 con 0x7f84d80c1850 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84dd600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814bb00 con 0x7f84d814b720 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84d7400640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7f84d80c1cd0 0x7f84d806cfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47882/0 (socket says 172.21.15.100:47882) 2024-01-20T08:15:04.001 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.998+0000 7f84d7400640 1 -- 172.21.15.100:0/1715149682 learned_addr learned my addr 172.21.15.100:0/1715149682 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:15:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6a00640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84d81515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.003 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v1:172.21.15.100:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486479125 0 0) 0x7f84d8154ba0 con 0x7f84d80c1cd0 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 --> v1:172.21.15.100:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b8005730 con 0x7f84d80c1cd0 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v1:172.21.15.100:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3558286423 0 0) 0x7f84b8005730 con 0x7f84d80c1cd0 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 msgr2=0x7f84d81515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84d81515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 >> v1:172.21.15.110:6789/0 conn(0x7f84d80c1850 legacy=0x7f84d806c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 --> v1:172.21.15.100:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d8154df0 con 0x7f84d80c1cd0 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v1:172.21.15.100:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1326110582 0 0) 0x7f84d00019f0 con 0x7f84d80c1cd0 2024-01-20T08:15:04.004 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 >> v1:172.21.15.100:6789/0 conn(0x7f84d80c1cd0 legacy=0x7f84d806cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84b8005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b8006180 0x7f84b80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84b8006f10 0x7f84b8007370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814bb00 con 0x7f84b8006f10 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84b800de20 con 0x7f84b8006180 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:03.999+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84b800dfe0 con 0x7f84d814b720 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84b8006f10 0x7f84b8007370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d6a00640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84b8005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.005 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 -- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 msgr2=0x7f84b8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:04.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84d814b720 0x7f84b8005bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 -- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b8006180 msgr2=0x7f84b80069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:04.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84b8006180 0x7f84b80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.006 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.000+0000 7f84d7400640 1 -- 172.21.15.100:0/1715149682 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84b8005730 con 0x7f84b8006f10 2024-01-20T08:15:04.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.001+0000 7f84d7400640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84b8006f10 0x7f84b8007370 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a750 tx=0x7f84b8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d06019e36b6c5f server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.001+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0034630 con 0x7f84b8006f10 2024-01-20T08:15:04.007 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.001+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d002f070 con 0x7f84b8006f10 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.001+0000 7f84d6000640 1 -- 172.21.15.100:0/1715149682 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d00349f0 con 0x7f84b8006f10 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 -- 172.21.15.100:0/1715149682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84b8006f10 msgr2=0x7f84b8007370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 --2- 172.21.15.100:0/1715149682 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84b8006f10 0x7f84b8007370 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a750 tx=0x7f84b8007a00 comp rx=0 tx=0).stop 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84d7400640 1 -- 172.21.15.100:0/1715149682 reap_dead start 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 -- 172.21.15.100:0/1715149682 shutdown_connections 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 -- 172.21.15.100:0/1715149682 >> 172.21.15.100:0/1715149682 conn(0x7f84d80c2940 msgr2=0x7f84d80c2d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:04.008 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 -- 172.21.15.100:0/1715149682 shutdown_connections 2024-01-20T08:15:04.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.002+0000 7f84dd600640 1 -- 172.21.15.100:0/1715149682 wait complete. 2024-01-20T08:15:04.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.004+0000 7f84dd600640 1 Processor -- start 2024-01-20T08:15:04.009 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.004+0000 7f84dd600640 1 -- start start 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b8006f10 0x7f84d81e95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d80ab350 0x7f84d8153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d8153c50 con 0x7f84d8153570 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814e870 con 0x7f84d80ab350 2024-01-20T08:15:04.011 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84dd600640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d814e5d0 con 0x7f84b8006f10 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84d7400640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56130/0 (socket says 172.21.15.100:56130) 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.005+0000 7f84d7400640 1 -- 172.21.15.100:0/3225186018 learned_addr learned my addr 172.21.15.100:0/3225186018 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d6a00640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b8006f10 0x7f84d81e95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84cde00640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d80ab350 0x7f84d8153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 -- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b8006f10 msgr2=0x7f84d81e95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b8006f10 0x7f84d81e95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.012 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 -- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d80ab350 msgr2=0x7f84d8153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d80ab350 0x7f84d8153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 -- 172.21.15.100:0/3225186018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d81528e0 con 0x7f84d8153570 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84d7400640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a870 tx=0x7f84d8155970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0034640 con 0x7f84d8153570 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d00347a0 con 0x7f84d8153570 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d81e9ec0 con 0x7f84d8153570 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.006+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0034b10 con 0x7f84d8153570 2024-01-20T08:15:04.013 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.007+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d814ea60 con 0x7f84d8153570 2024-01-20T08:15:04.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.008+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d80aba00 con 0x7f84d8153570 2024-01-20T08:15:04.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.009+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7f84d0031030 con 0x7f84d8153570 2024-01-20T08:15:04.014 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.009+0000 7f84cf400640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 0x7f84b006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.010+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f84d00ab870 con 0x7f84d8153570 2024-01-20T08:15:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.010+0000 7f84d6a00640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 0x7f84b006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.015 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.010+0000 7f84d6a00640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 0x7f84b006d390 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009a10 tx=0x7f84c8008040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.017 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.014+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7f84d00769d0 con 0x7f84d8153570 2024-01-20T08:15:04.211 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.208+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f84d80aba00 con 0x7f84d8153570 2024-01-20T08:15:04.216 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.213+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v16)=0 v16) v1 ==== 123+0+0 (secure 0 0 0) 0x7f84d0079ff0 con 0x7f84d8153570 2024-01-20T08:15:04.218 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.215+0000 7f84cf400640 1 -- 172.21.15.100:0/3225186018 <== mon.0 v2:172.21.15.100:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f84d00769d0 con 0x7f84d8153570 2024-01-20T08:15:04.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 msgr2=0x7f84b006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.220 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 0x7f84b006d390 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f84c8009a10 tx=0x7f84c8008040 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 msgr2=0x7f84d8141830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f84d000a870 tx=0x7f84d8155970 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 shutdown_connections 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f84d8153570 0x7f84d8141830 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7f84d80ab350 0x7f84d8153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7f84b006aed0 0x7f84b006d390 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 --2- 172.21.15.100:0/3225186018 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7f84b8006f10 0x7f84d81e95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.217+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 >> 172.21.15.100:0/3225186018 conn(0x7f84d80c2940 msgr2=0x7f84d8071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:04.221 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.218+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 shutdown_connections 2024-01-20T08:15:04.222 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.218+0000 7f84dd600640 1 -- 172.21.15.100:0/3225186018 wait complete. 2024-01-20T08:15:04.240 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-01-20T08:15:04.240 DEBUG:teuthology.orchestra.run.smithi100:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-01-20T08:15:04.429 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.426+0000 7fc66bc00640 1 Processor -- start 2024-01-20T08:15:04.430 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.426+0000 7fc66bc00640 1 -- start start 2024-01-20T08:15:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc66bc00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6640a93c0 0x7fc664153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.431 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc66bc00640 1 --2- >> v2:172.21.15.110:3300/0 conn(0x7fc6640aae00 0x7fc6640ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc66bc00640 1 -- --> v1:172.21.15.100:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640a9940 con 0x7fc66414fce0 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc66bc00640 1 -- --> v2:172.21.15.100:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6641500c0 con 0x7fc6640a93c0 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc66bc00640 1 -- --> v2:172.21.15.110:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc664156810 con 0x7fc6640aae00 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc669200640 1 --1- >> v1:172.21.15.100:6789/0 conn(0x7fc66414fce0 0x7fc664152f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.100:6789/0 says I am v1:172.21.15.100:47896/0 (socket says 172.21.15.100:47896) 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc663e00640 1 --2- >> v2:172.21.15.100:3300/0 conn(0x7fc6640a93c0 0x7fc664153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.432 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc669200640 1 -- 172.21.15.100:0/3748412340 learned_addr learned my addr 172.21.15.100:0/3748412340 (peer_addr_for_me v1:172.21.15.100:0/0) 2024-01-20T08:15:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc669c00640 1 --2- 172.21.15.100:0/3748412340 >> v2:172.21.15.110:3300/0 conn(0x7fc6640aae00 0x7fc6640ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc663e00640 1 -- 172.21.15.100:0/3748412340 >> v2:172.21.15.110:3300/0 conn(0x7fc6640aae00 msgr2=0x7fc6640ab2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-01-20T08:15:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc663e00640 1 --2- 172.21.15.100:0/3748412340 >> v2:172.21.15.110:3300/0 conn(0x7fc6640aae00 0x7fc6640ab2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.428+0000 7fc663e00640 1 -- 172.21.15.100:0/3748412340 >> v1:172.21.15.100:6789/0 conn(0x7fc66414fce0 legacy=0x7fc664152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.433 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.429+0000 7fc663e00640 1 -- 172.21.15.100:0/3748412340 --> v2:172.21.15.100:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664156af0 con 0x7fc6640a93c0 2024-01-20T08:15:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.430+0000 7fc663e00640 1 --2- 172.21.15.100:0/3748412340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6640a93c0 0x7fc664153b80 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fc6640c3ae0 tx=0x7fc64c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc85ed2c871722ee server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.430+0000 7fc663400640 1 -- 172.21.15.100:0/3748412340 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031830 con 0x7fc6640a93c0 2024-01-20T08:15:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.430+0000 7fc663400640 1 -- 172.21.15.100:0/3748412340 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc64c031990 con 0x7fc6640a93c0 2024-01-20T08:15:04.434 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.430+0000 7fc663400640 1 -- 172.21.15.100:0/3748412340 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c031d40 con 0x7fc6640a93c0 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.430+0000 7fc66bc00640 1 -- 172.21.15.100:0/3748412340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6640a93c0 msgr2=0x7fc664153b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 --2- 172.21.15.100:0/3748412340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6640a93c0 0x7fc664153b80 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fc6640c3ae0 tx=0x7fc64c02b8d0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 -- 172.21.15.100:0/3748412340 shutdown_connections 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 --2- 172.21.15.100:0/3748412340 >> v2:172.21.15.110:3300/0 conn(0x7fc6640aae00 0x7fc6640ab2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 --2- 172.21.15.100:0/3748412340 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc6640a93c0 0x7fc664153b80 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 -- 172.21.15.100:0/3748412340 >> 172.21.15.100:0/3748412340 conn(0x7fc66406a5e0 msgr2=0x7fc66406a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 -- 172.21.15.100:0/3748412340 shutdown_connections 2024-01-20T08:15:04.435 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.431+0000 7fc66bc00640 1 -- 172.21.15.100:0/3748412340 wait complete. 2024-01-20T08:15:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.433+0000 7fc66bc00640 1 Processor -- start 2024-01-20T08:15:04.436 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.433+0000 7fc66bc00640 1 -- start start 2024-01-20T08:15:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 --2- >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640a93c0 0x7fc6641ec250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 --2- >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 0x7fc66414a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.437 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6640c5e00 con 0x7fc66414fce0 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 -- --> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641459d0 con 0x7fc6640aae00 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc66bc00640 1 -- --> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641ec790 con 0x7fc6640a93c0 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc669c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc669c00640 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:56144/0 (socket says 172.21.15.100:56144) 2024-01-20T08:15:04.438 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.434+0000 7fc669c00640 1 -- 172.21.15.100:0/1757231270 learned_addr learned my addr 172.21.15.100:0/1757231270 (peer_addr_for_me v2:172.21.15.100:0/0) 2024-01-20T08:15:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc663e00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 0x7fc66414a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.440 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669200640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640a93c0 0x7fc6641ec250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 -- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640a93c0 msgr2=0x7fc6641ec250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.441 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640a93c0 0x7fc6641ec250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 -- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 msgr2=0x7fc66414a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 0x7fc66414a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 -- 172.21.15.100:0/1757231270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc64c009400 con 0x7fc66414fce0 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc663e00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 0x7fc66414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc669c00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007e40 tx=0x7fc65c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c014620 con 0x7fc66414fce0 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fc65c00ee90 con 0x7fc66414fce0 2024-01-20T08:15:04.442 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc664152280 con 0x7fc66414fce0 2024-01-20T08:15:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.435+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c014a00 con 0x7fc66414fce0 2024-01-20T08:15:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.436+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6640c5b20 con 0x7fc66414fce0 2024-01-20T08:15:04.443 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.437+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6640c3a30 con 0x7fc66414fce0 2024-01-20T08:15:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.438+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 5) v1 ==== 89198+0+0 (secure 0 0 0) 0x7fc65c014b60 con 0x7fc66414fce0 2024-01-20T08:15:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.439+0000 7fc660c00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 0x7fc63c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-01-20T08:15:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.439+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fc65c089e00 con 0x7fc66414fce0 2024-01-20T08:15:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.439+0000 7fc669200640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 0x7fc63c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-01-20T08:15:04.444 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.440+0000 7fc669200640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 0x7fc63c06d390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc654000f60 tx=0x7fc654009040 comp rx=0 tx=0).ready entity=mgr.4109 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-01-20T08:15:04.446 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.444+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180410 (secure 0 0 0) 0x7fc65c054ed0 con 0x7fc66414fce0 2024-01-20T08:15:04.678 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.675+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc66404e970 con 0x7fc66414fce0 2024-01-20T08:15:04.679 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.676+0000 7fc660c00640 1 -- 172.21.15.100:0/1757231270 <== mon.0 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+3705 (secure 0 0 0) 0x7fc65c0584f0 con 0x7fc66414fce0 2024-01-20T08:15:04.679 INFO:teuthology.orchestra.run.smithi100.stdout: 2024-01-20T08:15:04.679 INFO:teuthology.orchestra.run.smithi100.stdout:{"epoch":57,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4997,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6835/1782464226","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6833","nonce":1782464226},{"type":"v1","addr":"172.21.15.110:6835","nonce":1782464226}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":5347,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.110:6834/1684260213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.110:6832","nonce":1684260213},{"type":"v1","addr":"172.21.15.110:6834","nonce":1684260213}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":42},{"gid":7134,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/3606692265","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":3606692265},{"type":"v1","addr":"172.21.15.100:6837","nonce":3606692265}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":55},{"gid":7230,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/65746580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":65746580},{"type":"v1","addr":"172.21.15.100:6835","nonce":65746580}]},"join_fscid":-1,"export_targets":[],"features":4540701272860131327,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":57}],"filesystems":[]} 2024-01-20T08:15:04.680 INFO:teuthology.orchestra.run.smithi100.stderr:dumped fsmap epoch 57 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.678+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 msgr2=0x7fc63c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.678+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 0x7fc63c06d390 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fc654000f60 tx=0x7fc654009040 comp rx=0 tx=0).stop 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.678+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 msgr2=0x7fc664144aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.678+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fc65c007e40 tx=0x7fc65c00e4b0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 shutdown_connections 2024-01-20T08:15:04.682 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc66414fce0 0x7fc664144aa0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3300/0,v1:172.21.15.110:6789/0] conn(0x7fc6640aae00 0x7fc66414a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.100:6832/3001793226,v1:172.21.15.100:6833/3001793226] conn(0x7fc63c06aed0 0x7fc63c06d390 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 --2- 172.21.15.100:0/1757231270 >> [v2:172.21.15.110:3301/0,v1:172.21.15.110:6790/0] conn(0x7fc6640a93c0 0x7fc6641ec250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 >> 172.21.15.100:0/1757231270 conn(0x7fc66406a5e0 msgr2=0x7fc6640c68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 shutdown_connections 2024-01-20T08:15:04.683 INFO:teuthology.orchestra.run.smithi100.stderr:2024-01-20T08:15:04.679+0000 7fc66bc00640 1 -- 172.21.15.100:0/1757231270 wait complete. 2024-01-20T08:15:04.699 DEBUG:tasks.cephfs.filesystem:already dead... 2024-01-20T08:15:04.700 INFO:teuthology.misc:Shutting down mds daemons... 2024-01-20T08:15:04.700 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-01-20T08:15:04.700 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:04.716 INFO:tasks.ceph.mds.a:Stopped 2024-01-20T08:15:04.716 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-01-20T08:15:04.716 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:04.784 INFO:tasks.ceph.mds.c:Stopped 2024-01-20T08:15:04.784 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-01-20T08:15:04.784 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:04.813 INFO:tasks.ceph.mds.b:Stopped 2024-01-20T08:15:04.813 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-01-20T08:15:04.813 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:04.879 INFO:tasks.ceph.mds.d:Stopped 2024-01-20T08:15:04.879 INFO:teuthology.misc:Shutting down osd daemons... 2024-01-20T08:15:04.880 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-01-20T08:15:04.880 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:04.930 INFO:tasks.ceph.osd.0:Stopped 2024-01-20T08:15:04.930 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-01-20T08:15:04.930 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.006 INFO:tasks.ceph.osd.1:Stopped 2024-01-20T08:15:05.007 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-01-20T08:15:05.007 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.066 INFO:tasks.ceph.osd.2:Stopped 2024-01-20T08:15:05.066 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-01-20T08:15:05.066 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.145 INFO:tasks.ceph.osd.3:Stopped 2024-01-20T08:15:05.145 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-01-20T08:15:05.145 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.195 INFO:tasks.ceph.osd.4:Stopped 2024-01-20T08:15:05.196 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-01-20T08:15:05.196 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.263 INFO:tasks.ceph.osd.5:Stopped 2024-01-20T08:15:05.263 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-01-20T08:15:05.263 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.323 INFO:tasks.ceph.osd.6:Stopped 2024-01-20T08:15:05.324 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-01-20T08:15:05.324 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.387 INFO:tasks.ceph.osd.7:Stopped 2024-01-20T08:15:05.387 INFO:teuthology.misc:Shutting down mgr daemons... 2024-01-20T08:15:05.387 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-01-20T08:15:05.388 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.470 INFO:tasks.ceph.mgr.y:Stopped 2024-01-20T08:15:05.470 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-01-20T08:15:05.471 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.546 INFO:tasks.ceph.mgr.x:Stopped 2024-01-20T08:15:05.547 INFO:teuthology.misc:Shutting down mon daemons... 2024-01-20T08:15:05.547 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-01-20T08:15:05.547 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.594 INFO:tasks.ceph.mon.a:Stopped 2024-01-20T08:15:05.595 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-01-20T08:15:05.595 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.630 INFO:tasks.ceph.mon.b:Stopped 2024-01-20T08:15:05.630 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-01-20T08:15:05.630 INFO:teuthology.orchestra.run:waiting for 300 2024-01-20T08:15:05.716 INFO:tasks.ceph.mon.c:Stopped 2024-01-20T08:15:05.716 INFO:tasks.ceph:Checking cluster log for badness... 2024-01-20T08:15:05.716 DEBUG:teuthology.orchestra.run.smithi100:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-01-20T08:15:05.821 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:15:05.822 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-01-20T08:15:06.076 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:15:06.076 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-01-20T08:15:06.239 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:15:06.240 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-01-20T08:15:06.397 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:15:06.397 DEBUG:teuthology.orchestra.run.smithi100:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-01-20T08:15:06.554 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:15:06.555 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-01-20T08:15:06.812 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:15:06.812 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-01-20T08:15:06.979 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:15:06.979 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-01-20T08:15:07.108 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:07.115 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:07.133 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:15:07.134 DEBUG:teuthology.orchestra.run.smithi110:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-01-20T08:15:07.345 INFO:tasks.ceph:Archiving mon data... 2024-01-20T08:15:07.347 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/data/mon.a.tgz 2024-01-20T08:15:07.347 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2024-01-20T08:15:07.403 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.7b5jhelSZV 2024-01-20T08:15:07.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7b5jhelSZV 2024-01-20T08:15:07.615 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.7b5jhelSZV 2024-01-20T08:15:07.768 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.7b5jhelSZV is 468KB 2024-01-20T08:15:07.876 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.7b5jhelSZV 2024-01-20T08:15:07.930 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/data/mon.b.tgz 2024-01-20T08:15:07.930 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-20T08:15:07.985 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.CCvXuhbYbH 2024-01-20T08:15:07.985 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.CCvXuhbYbH 2024-01-20T08:15:08.231 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.CCvXuhbYbH 2024-01-20T08:15:08.383 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.CCvXuhbYbH is 601KB 2024-01-20T08:15:08.494 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.CCvXuhbYbH 2024-01-20T08:15:08.550 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/data/mon.c.tgz 2024-01-20T08:15:08.550 DEBUG:teuthology.orchestra.run.smithi110:> mktemp 2024-01-20T08:15:08.604 INFO:teuthology.orchestra.run.smithi110.stdout:/tmp/tmp.oGJMMrIlVV 2024-01-20T08:15:08.604 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oGJMMrIlVV 2024-01-20T08:15:08.838 DEBUG:teuthology.orchestra.run.smithi110:> sudo chmod 0666 /tmp/tmp.oGJMMrIlVV 2024-01-20T08:15:08.988 DEBUG:teuthology.orchestra.remote:smithi110:/tmp/tmp.oGJMMrIlVV is 600KB 2024-01-20T08:15:09.102 DEBUG:teuthology.orchestra.run.smithi110:> rm -fr /tmp/tmp.oGJMMrIlVV 2024-01-20T08:15:09.158 INFO:tasks.ceph:Cleaning ceph cluster... 2024-01-20T08:15:09.158 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-20T08:15:09.166 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-01-20T08:15:09.308 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-20T08:15:09.364 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-01-20T08:15:09.365 INFO:tasks.ceph:Archiving crash dumps... 2024-01-20T08:15:09.366 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi100/crash 2024-01-20T08:15:09.367 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-20T08:15:09.463 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi110/crash 2024-01-20T08:15:09.464 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-01-20T08:15:09.560 INFO:tasks.ceph:Shutting down logrotate 2024-01-20T08:15:09.560 DEBUG:teuthology.orchestra.run.smithi100:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:09.568 DEBUG:teuthology.orchestra.run.smithi110:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:09.690 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:09.789 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-01-20T08:15:09.874 INFO:tasks.ceph:Compressing logs... 2024-01-20T08:15:09.875 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-20T08:15:09.882 DEBUG:teuthology.orchestra.run.smithi110:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-01-20T08:15:09.967 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50842.log 2024-01-20T08:15:09.969 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57505.log 2024-01-20T08:15:09.970 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63375.log 2024-01-20T08:15:09.970 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50842.log.gz 2024-01-20T08:15:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.43488.log 2024-01-20T08:15:09.971 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-01-20T08:15:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57505.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.57505.log.gz 2024-01-20T08:15:09.972 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47373.log 2024-01-20T08:15:09.973 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62481.log 2024-01-20T08:15:09.973 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.63375.log.gz 2024-01-20T08:15:09.974 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.47373.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.47373.log.gz 2024-01-20T08:15:09.974 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.testuser.43488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.43488.log.gz 2024-01-20T08:15:09.974 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35902.log 2024-01-20T08:15:09.975 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36062.log 2024-01-20T08:15:09.975 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41350.log 2024-01-20T08:15:09.975 INFO:teuthology.orchestra.run.smithi110.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35902.log.gz 2024-01-20T08:15:09.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.36062.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36062.log.gz 2024-01-20T08:15:09.977 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36102.log 2024-01-20T08:15:09.977 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.41350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42176.log 2024-01-20T08:15:09.977 INFO:teuthology.orchestra.run.smithi110.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41350.log.gz 2024-01-20T08:15:09.978 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48589.log 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62481.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.62481.log.gz 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58106.log 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50232.log 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48589.log.gz 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58106.log.gz 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50294.log 2024-01-20T08:15:09.979 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50232.log.gz 2024-01-20T08:15:09.985 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50294.log.gz 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50632.log 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42831.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz 2024-01-20T08:15:09.986 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58046.log 2024-01-20T08:15:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56693.log 2024-01-20T08:15:09.987 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50632.log.gz 2024-01-20T08:15:09.987 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61729.log 2024-01-20T08:15:09.987 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58046.log.gz 2024-01-20T08:15:09.989 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56693.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56693.log.gz 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58190.log 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48001.log 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61729.log.gz 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58190.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.58190.log.gz 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63123.log 2024-01-20T08:15:09.990 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.36102.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36102.log.gz 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35942.log 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.42176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.40508.log 0.0% 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr: -- replaced with /var/log/ceph/ceph-client.1.42176.log.gz 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35942.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35942.log.gz 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.40508.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.40508.log.gz 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-01-20T08:15:09.991 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41841.log 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.41841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41841.log.gz 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42983.log 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36142.log 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.1.42983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42983.log.gz 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-01-20T08:15:09.992 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.36142.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.36142.log.gz 2024-01-20T08:15:09.993 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-01-20T08:15:09.993 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36022.log 2024-01-20T08:15:09.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-01-20T08:15:09.994 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.36022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35862.log 2024-01-20T08:15:09.994 INFO:teuthology.orchestra.run.smithi110.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36022.log.gz 2024-01-20T08:15:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55552.log 2024-01-20T08:15:09.996 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48001.log.gz 2024-01-20T08:15:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63123.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63123.log.gz 2024-01-20T08:15:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43874.log 2024-01-20T08:15:09.996 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51178.log 2024-01-20T08:15:09.997 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55552.log.gz 2024-01-20T08:15:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43874.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43874.log.gz 2024-01-20T08:15:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61146.log 2024-01-20T08:15:09.997 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51136.log 2024-01-20T08:15:09.997 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51178.log.gz 2024-01-20T08:15:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52738.log 2024-01-20T08:15:09.999 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61146.log.gz 2024-01-20T08:15:09.999 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44690.log 2024-01-20T08:15:09.999 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51136.log.gz 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35982.log 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35862.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35862.log.gz 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.admin.35982.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35982.log.gz 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph.log: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-01-20T08:15:10.001 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-01-20T08:15:10.002 INFO:teuthology.orchestra.run.smithi110.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-20T08:15:10.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50716.log 2024-01-20T08:15:10.004 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52738.log.gz 2024-01-20T08:15:10.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44690.log.gz 2024-01-20T08:15:10.004 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62252.log 2024-01-20T08:15:10.004 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60732.log 2024-01-20T08:15:10.005 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50716.log.gz 2024-01-20T08:15:10.005 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.54649.log 2024-01-20T08:15:10.005 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62252.log.gz 2024-01-20T08:15:10.007 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42658.log 2024-01-20T08:15:10.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-01-20T08:15:10.007 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.42658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.42658.log.gz 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60732.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60732.log.gz 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41194.log 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.testuser.54649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.54649.log.gz 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59645.log 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62000.log 2024-01-20T08:15:10.008 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41194.log.gz 2024-01-20T08:15:10.009 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.41033.log 2024-01-20T08:15:10.011 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47493.log 2024-01-20T08:15:10.011 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.59645.log.gz 2024-01-20T08:15:10.011 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62000.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62000.log.gz 2024-01-20T08:15:10.011 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62565.log 2024-01-20T08:15:10.011 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54346.log 2024-01-20T08:15:10.012 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47493.log.gz 2024-01-20T08:15:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-01-20T08:15:10.013 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-client.1.41033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.41033.log.gz 2024-01-20T08:15:10.014 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46164.log 2024-01-20T08:15:10.014 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.62565.log.gz 2024-01-20T08:15:10.014 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54346.log: gzip -5 --verbose -- 88.6% /var/log/ceph/ceph-client.admin.42446.log 2024-01-20T08:15:10.014 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.54346.log.gz 2024-01-20T08:15:10.016 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41107.log 2024-01-20T08:15:10.016 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46164.log.gz 2024-01-20T08:15:10.016 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60287.log 2024-01-20T08:15:10.016 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42446.log.gz 2024-01-20T08:15:10.017 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61104.log 2024-01-20T08:15:10.017 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41107.log.gz 2024-01-20T08:15:10.018 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60287.log: 88.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.60287.log.gz -5 2024-01-20T08:15:10.018 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.45605.log 2024-01-20T08:15:10.019 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58540.log 2024-01-20T08:15:10.019 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61104.log.gz 2024-01-20T08:15:10.021 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63587.log 2024-01-20T08:15:10.021 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45605.log.gz 2024-01-20T08:15:10.022 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50884.log 2024-01-20T08:15:10.022 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.58540.log.gz 2024-01-20T08:15:10.023 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51819.log 2024-01-20T08:15:10.023 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.63587.log.gz 2024-01-20T08:15:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50884.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50884.log.gz 2024-01-20T08:15:10.024 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2024-01-20T08:15:10.026 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61687.log 2024-01-20T08:15:10.026 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51819.log.gz 2024-01-20T08:15:10.027 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57083.log 2024-01-20T08:15:10.027 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2024-01-20T08:15:10.028 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55762.log 2024-01-20T08:15:10.028 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.61687.log.gz 2024-01-20T08:15:10.029 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57421.log 2024-01-20T08:15:10.029 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57083.log.gz 2024-01-20T08:15:10.030 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60978.log 2024-01-20T08:15:10.031 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.55762.log.gz 2024-01-20T08:15:10.031 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57421.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.57421.log.gz 2024-01-20T08:15:10.032 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61831.log 2024-01-20T08:15:10.032 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53162.log 2024-01-20T08:15:10.033 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60978.log.gz 2024-01-20T08:15:10.034 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 2024-01-20T08:15:10.034 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.61831.log.gz 2024-01-20T08:15:10.035 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47535.log 2024-01-20T08:15:10.035 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53162.log.gz 2024-01-20T08:15:10.036 INFO:teuthology.orchestra.run.smithi110.stderr:/var/log/ceph/ceph-mon.c.log: 92.5% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-01-20T08:15:10.037 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53372.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2024-01-20T08:15:10.037 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61645.log 2024-01-20T08:15:10.038 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45731.log 2024-01-20T08:15:10.039 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47535.log.gz 2024-01-20T08:15:10.039 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41367.log 2024-01-20T08:15:10.039 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61645.log.gz 2024-01-20T08:15:10.040 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56392.log 2024-01-20T08:15:10.040 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45731.log.gz 2024-01-20T08:15:10.041 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57962.log 2024-01-20T08:15:10.041 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41367.log.gz 2024-01-20T08:15:10.042 INFO:teuthology.orchestra.run.smithi110.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-01-20T08:15:10.042 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44396.log 2024-01-20T08:15:10.043 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56392.log.gz 2024-01-20T08:15:10.043 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53288.log 2024-01-20T08:15:10.044 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.57962.log.gz 2024-01-20T08:15:10.045 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50013.log 2024-01-20T08:15:10.045 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44396.log.gz 2024-01-20T08:15:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53288.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53288.log.gz 2024-01-20T08:15:10.046 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41907.log 2024-01-20T08:15:10.047 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56350.log 2024-01-20T08:15:10.047 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50013.log.gz 2024-01-20T08:15:10.048 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62955.log 2024-01-20T08:15:10.048 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.41907.log.gz 2024-01-20T08:15:10.049 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59128.log 2024-01-20T08:15:10.049 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.56350.log.gz 2024-01-20T08:15:10.050 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60774.log 2024-01-20T08:15:10.051 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62955.log.gz 2024-01-20T08:15:10.051 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54712.log 2024-01-20T08:15:10.052 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.59128.log.gz 2024-01-20T08:15:10.053 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59371.log 2024-01-20T08:15:10.053 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60774.log.gz 2024-01-20T08:15:10.054 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47078.log 2024-01-20T08:15:10.054 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54712.log.gz 2024-01-20T08:15:10.055 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2024-01-20T08:15:10.055 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59371.log.gz 2024-01-20T08:15:10.056 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61874.log 2024-01-20T08:15:10.056 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47078.log.gz 2024-01-20T08:15:10.058 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53540.log 2024-01-20T08:15:10.058 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2024-01-20T08:15:10.059 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61874.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61874.log.gz 2024-01-20T08:15:10.059 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60936.log 2024-01-20T08:15:10.060 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54922.log 2024-01-20T08:15:10.060 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53540.log.gz 2024-01-20T08:15:10.061 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54252.log 2024-01-20T08:15:10.061 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.60936.log.gz 2024-01-20T08:15:10.062 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48505.log 2024-01-20T08:15:10.063 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54922.log.gz 2024-01-20T08:15:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54252.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.54252.log.gz 2024-01-20T08:15:10.064 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44927.log 2024-01-20T08:15:10.065 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62523.log 2024-01-20T08:15:10.065 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48505.log.gz 2024-01-20T08:15:10.066 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51545.log 2024-01-20T08:15:10.066 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44927.log.gz 2024-01-20T08:15:10.067 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52029.log 2024-01-20T08:15:10.067 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.62523.log.gz 2024-01-20T08:15:10.068 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.49362.log 2024-01-20T08:15:10.068 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51545.log.gz 2024-01-20T08:15:10.069 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52029.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.52029.log.gz 2024-01-20T08:15:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59002.log 2024-01-20T08:15:10.070 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.testuser.49362.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.49362.log.gz 2024-01-20T08:15:10.071 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62126.log 2024-01-20T08:15:10.072 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-01-20T08:15:10.072 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.59002.log.gz 2024-01-20T08:15:10.073 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58412.log 2024-01-20T08:15:10.073 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62126.log.gz 2024-01-20T08:15:10.074 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60690.log 2024-01-20T08:15:10.075 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58412.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-01-20T08:15:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53456.log 2024-01-20T08:15:10.076 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58412.log.gz 2024-01-20T08:15:10.076 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52155.log 2024-01-20T08:15:10.077 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.60690.log.gz 2024-01-20T08:15:10.077 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35934.log 2024-01-20T08:15:10.078 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53456.log.gz 2024-01-20T08:15:10.079 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36318.log 2024-01-20T08:15:10.079 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52155.log.gz 2024-01-20T08:15:10.080 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.35934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42131.log 2024-01-20T08:15:10.080 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35934.log.gz 2024-01-20T08:15:10.081 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51673.log 2024-01-20T08:15:10.081 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36318.log.gz 2024-01-20T08:15:10.082 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42131.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42131.log.gz 2024-01-20T08:15:10.083 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46994.log 2024-01-20T08:15:10.084 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49719.log 2024-01-20T08:15:10.084 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.51673.log.gz 2024-01-20T08:15:10.085 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44312.log 2024-01-20T08:15:10.085 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46994.log.gz 2024-01-20T08:15:10.086 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47703.log 2024-01-20T08:15:10.087 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49719.log.gz 2024-01-20T08:15:10.088 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44312.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44312.log.gz 2024-01-20T08:15:10.088 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47036.log 2024-01-20T08:15:10.089 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50758.log 2024-01-20T08:15:10.089 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47703.log.gz 2024-01-20T08:15:10.090 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43041.log 2024-01-20T08:15:10.090 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47036.log.gz 2024-01-20T08:15:10.091 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52906.log 2024-01-20T08:15:10.091 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50758.log.gz 2024-01-20T08:15:10.092 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57041.log 2024-01-20T08:15:10.093 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43041.log.gz 2024-01-20T08:15:10.093 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42999.log 2024-01-20T08:15:10.094 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52906.log.gz 2024-01-20T08:15:10.095 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56452.log 2024-01-20T08:15:10.095 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57041.log.gz 2024-01-20T08:15:10.096 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51337.log 2024-01-20T08:15:10.096 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42999.log.gz 2024-01-20T08:15:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56452.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56452.log.gz 2024-01-20T08:15:10.097 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-01-20T08:15:10.098 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48737.log 2024-01-20T08:15:10.098 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51337.log.gz 2024-01-20T08:15:10.099 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46722.log 2024-01-20T08:15:10.099 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-01-20T08:15:10.101 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-01-20T08:15:10.101 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48737.log.gz 2024-01-20T08:15:10.102 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46722.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46722.log.gz 2024-01-20T08:15:10.102 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57547.log 2024-01-20T08:15:10.103 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42130.log 2024-01-20T08:15:10.103 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-01-20T08:15:10.104 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40929.log 2024-01-20T08:15:10.105 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57547.log.gz 2024-01-20T08:15:10.105 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61062.log 2024-01-20T08:15:10.106 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42130.log.gz 2024-01-20T08:15:10.107 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.40929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55678.log 2024-01-20T08:15:10.107 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40929.log.gz 2024-01-20T08:15:10.108 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50464.log 2024-01-20T08:15:10.108 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61062.log.gz 2024-01-20T08:15:10.109 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52618.log 2024-01-20T08:15:10.109 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.55678.log.gz 2024-01-20T08:15:10.110 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48905.log 2024-01-20T08:15:10.110 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50464.log.gz 2024-01-20T08:15:10.111 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.52618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.52618.log.gzgzip 2024-01-20T08:15:10.111 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42957.log 2024-01-20T08:15:10.113 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48905.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48905.log.gz 2024-01-20T08:15:10.113 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48463.log 2024-01-20T08:15:10.114 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44042.log 2024-01-20T08:15:10.114 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-01-20T08:15:10.115 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54838.log 2024-01-20T08:15:10.115 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48463.log.gz 2024-01-20T08:15:10.116 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42123.log 2024-01-20T08:15:10.117 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44042.log.gz 2024-01-20T08:15:10.117 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54838.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54838.log.gz 2024-01-20T08:15:10.118 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55090.log 2024-01-20T08:15:10.118 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49929.log 2024-01-20T08:15:10.119 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42123.log.gz 2024-01-20T08:15:10.120 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44774.log 2024-01-20T08:15:10.120 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55090.log.gz 2024-01-20T08:15:10.121 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55636.log 2024-01-20T08:15:10.121 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49929.log.gz 2024-01-20T08:15:10.122 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44774.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44774.log.gz 2024-01-20T08:15:10.122 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46374.log 2024-01-20T08:15:10.123 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42747.log 2024-01-20T08:15:10.123 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55636.log.gz 2024-01-20T08:15:10.124 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48043.log 2024-01-20T08:15:10.124 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46374.log.gz 2024-01-20T08:15:10.126 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46248.log 2024-01-20T08:15:10.126 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42747.log.gz 2024-01-20T08:15:10.127 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48043.log: 88.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.48043.log.gz 2024-01-20T08:15:10.127 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44210.log 2024-01-20T08:15:10.128 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41569.log 2024-01-20T08:15:10.128 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46248.log.gz 2024-01-20T08:15:10.129 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42705.log 2024-01-20T08:15:10.129 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44210.log.gz 2024-01-20T08:15:10.130 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63543.log 2024-01-20T08:15:10.130 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41569.log.gz 2024-01-20T08:15:10.131 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42705.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42705.log.gz 2024-01-20T08:15:10.132 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59823.log 2024-01-20T08:15:10.132 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52431.log 2024-01-20T08:15:10.133 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63543.log.gz 2024-01-20T08:15:10.134 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62439.log 2024-01-20T08:15:10.134 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59823.log.gz 2024-01-20T08:15:10.135 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52431.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52431.log.gz 2024-01-20T08:15:10.135 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51777.log 2024-01-20T08:15:10.136 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54880.log 2024-01-20T08:15:10.136 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62439.log.gz 2024-01-20T08:15:10.137 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50674.log 2024-01-20T08:15:10.138 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51777.log.gz 2024-01-20T08:15:10.139 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45011.log 2024-01-20T08:15:10.139 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.54880.log.gz 2024-01-20T08:15:10.140 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43167.log 2024-01-20T08:15:10.140 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50674.log.gz 2024-01-20T08:15:10.141 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45011.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-01-20T08:15:10.141 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45011.log.gz 2024-01-20T08:15:10.142 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43167.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43167.log.gz 2024-01-20T08:15:10.143 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49593.log 2024-01-20T08:15:10.143 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52990.log 2024-01-20T08:15:10.145 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-01-20T08:15:10.145 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49593.log.gz 2024-01-20T08:15:10.146 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52990.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52990.log.gz 2024-01-20T08:15:10.146 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-01-20T08:15:10.146 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49761.log 2024-01-20T08:15:10.147 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42789.log 2024-01-20T08:15:10.147 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-01-20T08:15:10.148 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42127.log 2024-01-20T08:15:10.148 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49761.log.gz 2024-01-20T08:15:10.150 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59603.log 2024-01-20T08:15:10.150 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42789.log.gz 2024-01-20T08:15:10.151 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42127.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42127.log.gz 2024-01-20T08:15:10.151 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42119.log 2024-01-20T08:15:10.152 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45918.log 2024-01-20T08:15:10.152 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59603.log.gz 2024-01-20T08:15:10.153 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45773.log 2024-01-20T08:15:10.153 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42119.log.gz 2024-01-20T08:15:10.154 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50097.log 2024-01-20T08:15:10.154 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45918.log.gz 2024-01-20T08:15:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45773.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45773.log.gz 2024-01-20T08:15:10.155 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58318.log 2024-01-20T08:15:10.156 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44480.log 2024-01-20T08:15:10.157 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50097.log.gz 2024-01-20T08:15:10.158 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59561.log 2024-01-20T08:15:10.158 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.58318.log.gz 2024-01-20T08:15:10.159 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55888.log 2024-01-20T08:15:10.159 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44480.log.gz 2024-01-20T08:15:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59561.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59561.log.gz 2024-01-20T08:15:10.160 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51052.log 2024-01-20T08:15:10.161 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56266.log 2024-01-20T08:15:10.161 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55888.log.gz 2024-01-20T08:15:10.162 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44969.log 2024-01-20T08:15:10.162 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51052.log.gz 2024-01-20T08:15:10.163 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53330.log 2024-01-20T08:15:10.164 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.56266.log.gz 2024-01-20T08:15:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44969.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44969.log.gz 2024-01-20T08:15:10.165 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45479.log 2024-01-20T08:15:10.166 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51094.log 2024-01-20T08:15:10.166 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53330.log.gz 2024-01-20T08:15:10.167 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51629.log 2024-01-20T08:15:10.167 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45479.log.gz 2024-01-20T08:15:10.168 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46122.log 2024-01-20T08:15:10.168 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.51094.log.gz 2024-01-20T08:15:10.169 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47451.log 2024-01-20T08:15:10.169 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51629.log.gz 2024-01-20T08:15:10.170 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2024-01-20T08:15:10.170 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46122.log.gz 2024-01-20T08:15:10.171 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47661.log 2024-01-20T08:15:10.172 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47451.log.gz 2024-01-20T08:15:10.173 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53708.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2024-01-20T08:15:10.173 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42118.log 2024-01-20T08:15:10.174 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41739.log 2024-01-20T08:15:10.175 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47661.log.gz 2024-01-20T08:15:10.175 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53894.log 2024-01-20T08:15:10.176 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.42118.log.gz 2024-01-20T08:15:10.176 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50338.log 2024-01-20T08:15:10.177 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41739.log.gz 2024-01-20T08:15:10.178 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53894.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53894.log.gz 2024-01-20T08:15:10.178 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54796.log 2024-01-20T08:15:10.179 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48379.log 2024-01-20T08:15:10.179 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50338.log.gz 2024-01-20T08:15:10.180 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52948.log 2024-01-20T08:15:10.180 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.54796.log.gz 2024-01-20T08:15:10.181 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48379.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48379.log.gz 2024-01-20T08:15:10.182 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55720.log 2024-01-20T08:15:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52948.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.52948.log.gz 2024-01-20T08:15:10.183 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47917.log 2024-01-20T08:15:10.184 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42463.log 2024-01-20T08:15:10.185 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55720.log.gz 2024-01-20T08:15:10.185 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47917.log.gz 2024-01-20T08:15:10.185 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58454.log 2024-01-20T08:15:10.186 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42663.log 2024-01-20T08:15:10.186 INFO:teuthology.orchestra.run.smithi100.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42463.log.gz 2024-01-20T08:15:10.187 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58666.log 2024-01-20T08:15:10.187 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58454.log.gz 2024-01-20T08:15:10.188 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42663.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42663.log.gz 2024-01-20T08:15:10.188 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45647.log 2024-01-20T08:15:10.189 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61477.log 2024-01-20T08:15:10.189 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.58666.log.gz 2024-01-20T08:15:10.190 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62727.log 2024-01-20T08:15:10.190 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45647.log.gz 2024-01-20T08:15:10.191 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61477.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61477.log.gz 2024-01-20T08:15:10.192 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46458.log 2024-01-20T08:15:10.193 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49635.log 2024-01-20T08:15:10.193 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62727.log.gz 2024-01-20T08:15:10.194 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46458.log: gzip 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46458.log.gz -5 2024-01-20T08:15:10.194 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.46586.log 2024-01-20T08:15:10.195 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60455.log 2024-01-20T08:15:10.195 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49635.log.gz 2024-01-20T08:15:10.196 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51987.log 2024-01-20T08:15:10.197 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46586.log.gz 2024-01-20T08:15:10.197 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56056.log 2024-01-20T08:15:10.197 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60455.log.gz 2024-01-20T08:15:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51987.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.51987.log.gz 2024-01-20T08:15:10.199 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55216.log 2024-01-20T08:15:10.200 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44000.log 2024-01-20T08:15:10.200 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56056.log.gz 2024-01-20T08:15:10.201 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55216.log: gzip 88.7% -- replaced with /var/log/ceph/ceph-client.admin.55216.log.gz -5 2024-01-20T08:15:10.201 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51903.log 2024-01-20T08:15:10.202 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44253.log 2024-01-20T08:15:10.202 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44000.log.gz 2024-01-20T08:15:10.203 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2024-01-20T08:15:10.203 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51903.log.gz 2024-01-20T08:15:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44253.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44253.log.gz 2024-01-20T08:15:10.204 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54084.log 2024-01-20T08:15:10.205 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62042.log 2024-01-20T08:15:10.206 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5%/var/log/ceph/ceph-client.admin.54084.log: -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2024-01-20T08:15:10.207 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.54084.log.gz 2024-01-20T08:15:10.207 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52281.log 2024-01-20T08:15:10.208 INFO:teuthology.orchestra.run.smithi110.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-01-20T08:15:10.208 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62042.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.62042.log.gz 2024-01-20T08:15:10.208 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57211.log 2024-01-20T08:15:10.209 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57884.log 2024-01-20T08:15:10.209 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52281.log.gz 2024-01-20T08:15:10.210 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57211.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.57211.log.gz 2024-01-20T08:15:10.210 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-01-20T08:15:10.211 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.57884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.57884.log.gz 2024-01-20T08:15:10.211 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45311.log 2024-01-20T08:15:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59519.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz 2024-01-20T08:15:10.212 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54000.log 2024-01-20T08:15:10.213 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51861.log 2024-01-20T08:15:10.213 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45311.log.gz 2024-01-20T08:15:10.214 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54000.log: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.54000.log.gz 2024-01-20T08:15:10.214 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2024-01-20T08:15:10.215 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57463.log 2024-01-20T08:15:10.215 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.51861.log.gz 2024-01-20T08:15:10.216 INFO:teuthology.orchestra.run.smithi110.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-01-20T08:15:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42873.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2024-01-20T08:15:10.217 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63627.log 2024-01-20T08:15:10.218 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44648.log 2024-01-20T08:15:10.218 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57463.log.gz 2024-01-20T08:15:10.219 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63627.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.63627.log.gz -- 2024-01-20T08:15:10.219 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.53246.log 2024-01-20T08:15:10.220 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43083.log 2024-01-20T08:15:10.220 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44648.log.gz 2024-01-20T08:15:10.221 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50422.log 2024-01-20T08:15:10.221 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53246.log.gz 2024-01-20T08:15:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43083.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43083.log.gz 2024-01-20T08:15:10.222 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47875.log 2024-01-20T08:15:10.223 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50968.log 2024-01-20T08:15:10.223 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50422.log.gz 2024-01-20T08:15:10.224 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47875.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47875.log.gz 2024-01-20T08:15:10.224 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55132.log 2024-01-20T08:15:10.225 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50968.log: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.50968.log.gz 2024-01-20T08:15:10.225 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.63165.log 2024-01-20T08:15:10.226 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59212.log 2024-01-20T08:15:10.226 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55132.log.gz 2024-01-20T08:15:10.227 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63165.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.63165.log.gzgzip 2024-01-20T08:15:10.227 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-01-20T08:15:10.228 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59212.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-01-20T08:15:10.229 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59212.log.gz 2024-01-20T08:15:10.229 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55006.log 2024-01-20T08:15:10.230 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-01-20T08:15:10.231 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55930.log 2024-01-20T08:15:10.232 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55006.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.55006.log.gz 2024-01-20T08:15:10.232 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46782.log 2024-01-20T08:15:10.234 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48337.log 2024-01-20T08:15:10.234 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55930.log.gz 2024-01-20T08:15:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46782.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46782.log.gz 2024-01-20T08:15:10.235 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59254.log 2024-01-20T08:15:10.236 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41823.log 2024-01-20T08:15:10.236 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48337.log.gz 2024-01-20T08:15:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59254.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59254.log.gz 2024-01-20T08:15:10.237 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55510.log 2024-01-20T08:15:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41823.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41823.log.gz 2024-01-20T08:15:10.239 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62294.log 2024-01-20T08:15:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55510.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55510.log.gz 2024-01-20T08:15:10.240 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47577.log 2024-01-20T08:15:10.241 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62294.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.62294.log.gz 2024-01-20T08:15:10.242 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53034.log 2024-01-20T08:15:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47577.log.gz 2024-01-20T08:15:10.243 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47619.log 2024-01-20T08:15:10.244 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41297.log 2024-01-20T08:15:10.244 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53034.log.gz 2024-01-20T08:15:10.245 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47619.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47619.log.gz 2024-01-20T08:15:10.246 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45104.log 2024-01-20T08:15:10.247 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46630.log 2024-01-20T08:15:10.247 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41297.log.gz 2024-01-20T08:15:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45104.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45104.log.gz 2024-01-20T08:15:10.248 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54042.log 2024-01-20T08:15:10.249 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52365.log 2024-01-20T08:15:10.249 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46630.log.gz 2024-01-20T08:15:10.250 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54042.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54042.log.gz 2024-01-20T08:15:10.251 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43251.log 2024-01-20T08:15:10.252 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49551.log 2024-01-20T08:15:10.252 INFO:teuthology.orchestra.run.smithi100.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.52365.log.gz 2024-01-20T08:15:10.253 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43251.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43251.log.gz 2024-01-20T08:15:10.253 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55384.log 2024-01-20T08:15:10.255 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2024-01-20T08:15:10.255 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49551.log.gz 2024-01-20T08:15:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55384.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55384.log.gz 2024-01-20T08:15:10.256 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55048.log 2024-01-20T08:15:10.257 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45227.log 2024-01-20T08:15:10.257 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2024-01-20T08:15:10.259 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51717.log 2024-01-20T08:15:10.259 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55048.log.gz 2024-01-20T08:15:10.260 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57169.log 2024-01-20T08:15:10.260 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45227.log.gz 2024-01-20T08:15:10.261 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47120.log 88.4% 2024-01-20T08:15:10.261 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.51717.log.gz 2024-01-20T08:15:10.262 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52696.log 2024-01-20T08:15:10.263 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57169.log.gz 2024-01-20T08:15:10.263 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47959.log 2024-01-20T08:15:10.264 INFO:teuthology.orchestra.run.smithi100.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47120.log.gz 2024-01-20T08:15:10.265 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62811.log 2024-01-20T08:15:10.265 INFO:teuthology.orchestra.run.smithi100.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.52696.log.gz 2024-01-20T08:15:10.266 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62336.log 2024-01-20T08:15:10.266 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47959.log.gz 2024-01-20T08:15:10.267 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42466.log 2024-01-20T08:15:10.267 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.62811.log.gz 2024-01-20T08:15:10.268 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41697.log 87.8% 2024-01-20T08:15:10.269 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62336.log.gz 2024-01-20T08:15:10.270 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54210.log 2024-01-20T08:15:10.270 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42466.log.gz 2024-01-20T08:15:10.271 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41697.log: gzip 89.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.41697.log.gz -- 2024-01-20T08:15:10.271 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.47833.log 2024-01-20T08:15:10.272 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47745.log 2024-01-20T08:15:10.272 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54210.log.gz 2024-01-20T08:15:10.274 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58274.log 2024-01-20T08:15:10.274 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47833.log.gz 2024-01-20T08:15:10.275 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63501.log 2024-01-20T08:15:10.275 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47745.log.gz 2024-01-20T08:15:10.276 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56182.log 2024-01-20T08:15:10.276 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.58274.log.gz 2024-01-20T08:15:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63501.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.63501.log.gz 2024-01-20T08:15:10.277 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44126.log 2024-01-20T08:15:10.280 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58792.log 2024-01-20T08:15:10.281 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56182.log.gz 2024-01-20T08:15:10.281 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41949.log 2024-01-20T08:15:10.281 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44126.log.gz 2024-01-20T08:15:10.281 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44606.log 2024-01-20T08:15:10.281 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58792.log.gz 2024-01-20T08:15:10.282 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60203.log 2024-01-20T08:15:10.282 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41949.log.gz 2024-01-20T08:15:10.283 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57379.log 2024-01-20T08:15:10.283 INFO:teuthology.orchestra.run.smithi100.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44606.log.gz 2024-01-20T08:15:10.284 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48253.log 2024-01-20T08:15:10.284 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.60203.log.gz 2024-01-20T08:15:10.285 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58148.log 2024-01-20T08:15:10.285 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57379.log.gz 2024-01-20T08:15:10.286 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61309.log 2024-01-20T08:15:10.287 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48253.log.gz 2024-01-20T08:15:10.288 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52113.log 2024-01-20T08:15:10.288 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.58148.log.gz 2024-01-20T08:15:10.289 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56631.log 2024-01-20T08:15:10.289 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.61309.log.gz 2024-01-20T08:15:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52113.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52113.log.gz 2024-01-20T08:15:10.290 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62769.log 2024-01-20T08:15:10.291 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46040.log 2024-01-20T08:15:10.291 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56631.log.gz 2024-01-20T08:15:10.292 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62769.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48085.log 2024-01-20T08:15:10.292 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.62769.log.gz 2024-01-20T08:15:10.293 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63207.log 2024-01-20T08:15:10.294 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46040.log.gz 2024-01-20T08:15:10.295 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50380.log 2024-01-20T08:15:10.295 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48085.log.gz 2024-01-20T08:15:10.296 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48127.log 2024-01-20T08:15:10.296 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63207.log.gz 2024-01-20T08:15:10.297 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55258.log 2024-01-20T08:15:10.297 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50380.log.gz 2024-01-20T08:15:10.298 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49971.log 2024-01-20T08:15:10.298 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48127.log.gz 2024-01-20T08:15:10.299 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2024-01-20T08:15:10.300 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55258.log.gz 2024-01-20T08:15:10.300 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55468.log 2024-01-20T08:15:10.301 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49971.log.gz 2024-01-20T08:15:10.302 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60329.log 2024-01-20T08:15:10.302 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz 2024-01-20T08:15:10.303 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54964.log 2024-01-20T08:15:10.303 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55468.log.gz 2024-01-20T08:15:10.304 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51460.log 2024-01-20T08:15:10.304 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60329.log.gz 2024-01-20T08:15:10.305 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43209.log 2024-01-20T08:15:10.305 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54964.log.gz 2024-01-20T08:15:10.306 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-01-20T08:15:10.306 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51460.log.gz 2024-01-20T08:15:10.307 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43209.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43209.log.gz 2024-01-20T08:15:10.308 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58004.log 2024-01-20T08:15:10.309 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44564.log 2024-01-20T08:15:10.309 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-01-20T08:15:10.310 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60816.log 2024-01-20T08:15:10.310 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.58004.log.gz 2024-01-20T08:15:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44564.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44564.log.gz 2024-01-20T08:15:10.311 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57589.log 2024-01-20T08:15:10.312 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50800.log 2024-01-20T08:15:10.312 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.60816.log.gz 2024-01-20T08:15:10.313 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57589.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-01-20T08:15:10.313 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.57589.log.gz 2024-01-20T08:15:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50506.log 2024-01-20T08:15:10.315 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50800.log.gz 2024-01-20T08:15:10.315 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50590.log 2024-01-20T08:15:10.317 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48821.log 2024-01-20T08:15:10.317 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50506.log.gz 2024-01-20T08:15:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50590.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50590.log.gz 2024-01-20T08:15:10.319 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61267.log 2024-01-20T08:15:10.320 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62913.log 2024-01-20T08:15:10.321 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48821.log.gz 2024-01-20T08:15:10.322 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45054.log 2024-01-20T08:15:10.322 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.61267.log.gz 2024-01-20T08:15:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62913.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62913.log.gz 2024-01-20T08:15:10.323 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52780.log 2024-01-20T08:15:10.324 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56014.log 2024-01-20T08:15:10.325 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45054.log.gz 2024-01-20T08:15:10.326 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2024-01-20T08:15:10.326 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52780.log.gz 2024-01-20T08:15:10.327 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63291.log 2024-01-20T08:15:10.327 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56014.log.gz 2024-01-20T08:15:10.329 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62084.log 2024-01-20T08:15:10.329 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz 2024-01-20T08:15:10.330 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59170.log 2024-01-20T08:15:10.330 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.63291.log.gz 2024-01-20T08:15:10.331 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-01-20T08:15:10.332 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50548.log 2024-01-20T08:15:10.332 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.62084.log.gz 2024-01-20T08:15:10.333 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57295.log 2024-01-20T08:15:10.333 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.59170.log.gz 2024-01-20T08:15:10.334 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46500.log 2024-01-20T08:15:10.334 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50548.log.gz 2024-01-20T08:15:10.335 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57295.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57295.log.gz 2024-01-20T08:15:10.336 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59086.log 2024-01-20T08:15:10.337 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48779.log 2024-01-20T08:15:10.337 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46500.log.gz 2024-01-20T08:15:10.338 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56947.log 2024-01-20T08:15:10.338 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.59086.log.gz 2024-01-20T08:15:10.340 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48779.log: gzip 89.1% -5 -- replaced with /var/log/ceph/ceph-client.admin.48779.log.gz --verbose 2024-01-20T08:15:10.340 INFO:teuthology.orchestra.run.smithi100.stderr: -- /var/log/ceph/ceph-client.admin.48169.log 2024-01-20T08:15:10.341 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63459.log 2024-01-20T08:15:10.341 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56947.log.gz 2024-01-20T08:15:10.342 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45353.log 2024-01-20T08:15:10.343 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48169.log.gz 2024-01-20T08:15:10.344 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.63459.log.gz 2024-01-20T08:15:10.344 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53852.log 2024-01-20T08:15:10.345 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52864.log 2024-01-20T08:15:10.345 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45353.log.gz 2024-01-20T08:15:10.346 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53852.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53852.log.gz 2024-01-20T08:15:10.346 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56098.log 2024-01-20T08:15:10.347 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57631.log 2024-01-20T08:15:10.348 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52864.log.gz 2024-01-20T08:15:10.349 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55972.log 2024-01-20T08:15:10.350 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.56098.log.gz 2024-01-20T08:15:10.350 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51010.log 2024-01-20T08:15:10.351 INFO:teuthology.orchestra.run.smithi100.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.57631.log.gz 2024-01-20T08:15:10.352 INFO:teuthology.orchestra.run.smithi110.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-01-20T08:15:10.352 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49041.log 2024-01-20T08:15:10.353 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55972.log.gz 2024-01-20T08:15:10.353 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51010.log: gzip -5 --verbose 88.2% -- /var/log/ceph/ceph-client.admin.61771.log -- replaced with /var/log/ceph/ceph-client.admin.51010.log.gz 2024-01-20T08:15:10.353 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-20T08:15:10.355 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61603.log 2024-01-20T08:15:10.355 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49041.log.gz 2024-01-20T08:15:10.356 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61771.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.61771.log.gzgzip 2024-01-20T08:15:10.357 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49425.log 2024-01-20T08:15:10.357 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56531.log 2024-01-20T08:15:10.358 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61603.log.gz 2024-01-20T08:15:10.359 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53078.log 2024-01-20T08:15:10.359 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49425.log.gz 2024-01-20T08:15:10.360 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56531.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.56531.log.gz 2024-01-20T08:15:10.361 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46910.log 2024-01-20T08:15:10.362 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59687.log 2024-01-20T08:15:10.362 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53078.log.gz 2024-01-20T08:15:10.363 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53582.log 2024-01-20T08:15:10.363 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46910.log.gz 2024-01-20T08:15:10.364 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59687.log: gzip -5 89.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.59687.log.gz -- 2024-01-20T08:15:10.365 INFO:teuthology.orchestra.run.smithi100.stderr: /var/log/ceph/ceph-client.admin.53624.log 2024-01-20T08:15:10.366 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46868.log 2024-01-20T08:15:10.366 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53582.log.gz 2024-01-20T08:15:10.367 INFO:teuthology.orchestra.run.smithi110.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-01-20T08:15:10.367 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53624.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53624.log.gz 2024-01-20T08:15:10.368 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59729.log 2024-01-20T08:15:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46868.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46868.log.gz 2024-01-20T08:15:10.369 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45521.log 2024-01-20T08:15:10.370 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56991.log 2024-01-20T08:15:10.370 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.59729.log.gz 2024-01-20T08:15:10.371 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59329.log 2024-01-20T08:15:10.372 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45521.log.gz 2024-01-20T08:15:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56991.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.56991.log.gz 2024-01-20T08:15:10.373 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63417.log 2024-01-20T08:15:10.374 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61519.log 2024-01-20T08:15:10.374 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59329.log.gz 2024-01-20T08:15:10.375 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52822.log 2024-01-20T08:15:10.376 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63417.log.gz 2024-01-20T08:15:10.377 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49887.log 2024-01-20T08:15:10.377 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.61519.log.gz 2024-01-20T08:15:10.378 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2024-01-20T08:15:10.378 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52822.log.gz 2024-01-20T08:15:10.379 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49887.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49887.log.gz 2024-01-20T08:15:10.380 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48863.log 2024-01-20T08:15:10.381 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47186.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.29956.log 2024-01-20T08:15:10.381 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2024-01-20T08:15:10.382 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46206.log 2024-01-20T08:15:10.382 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48863.log.gz 2024-01-20T08:15:10.383 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.tmp-client.admin.29956.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.29956.log.gz 2024-01-20T08:15:10.384 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60413.log 2024-01-20T08:15:10.385 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46206.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46206.log.gz 2024-01-20T08:15:10.385 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55300.log 2024-01-20T08:15:10.386 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46952.log 2024-01-20T08:15:10.386 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.60413.log.gz 2024-01-20T08:15:10.388 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50926.log 2024-01-20T08:15:10.388 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55300.log.gz 2024-01-20T08:15:10.389 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58918.log 2024-01-20T08:15:10.389 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46952.log.gz 2024-01-20T08:15:10.390 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51503.log 2024-01-20T08:15:10.390 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50926.log.gz 2024-01-20T08:15:10.392 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49845.log 2024-01-20T08:15:10.392 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.58918.log.gz 2024-01-20T08:15:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51503.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51503.log.gz 2024-01-20T08:15:10.393 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52071.log 2024-01-20T08:15:10.394 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51418.log 2024-01-20T08:15:10.394 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49845.log.gz 2024-01-20T08:15:10.396 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56861.log 2024-01-20T08:15:10.396 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52071.log.gz 2024-01-20T08:15:10.397 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47789.log 2024-01-20T08:15:10.397 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.51418.log.gz 2024-01-20T08:15:10.398 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45689.log 2024-01-20T08:15:10.399 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.56861.log.gz 2024-01-20T08:15:10.400 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.47789.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-01-20T08:15:10.400 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47789.log.gz 2024-01-20T08:15:10.401 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41477.log 2024-01-20T08:15:10.401 INFO:teuthology.orchestra.run.smithi100.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.45689.log.gz 2024-01-20T08:15:10.402 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51257.log 2024-01-20T08:15:10.404 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2024-01-20T08:15:10.404 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41477.log.gz 2024-01-20T08:15:10.405 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61188.log 2024-01-20T08:15:10.406 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51257.log.gz 2024-01-20T08:15:10.407 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48295.log 2024-01-20T08:15:10.407 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2024-01-20T08:15:10.409 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61188.log: gzip -5 --verbose 88.3% -- -- replaced with /var/log/ceph/ceph-client.admin.61188.log.gz /var/log/ceph/ceph-client.admin.58362.log 2024-01-20T08:15:10.409 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-20T08:15:10.410 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45184.log 2024-01-20T08:15:10.411 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48295.log.gz 2024-01-20T08:15:10.411 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58362.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58362.log.gz 2024-01-20T08:15:10.411 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49803.log 2024-01-20T08:15:10.413 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60648.log 2024-01-20T08:15:10.413 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45184.log.gz 2024-01-20T08:15:10.414 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49803.log: 89.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42458.log 2024-01-20T08:15:10.414 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49803.log.gz 2024-01-20T08:15:10.415 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56224.log 2024-01-20T08:15:10.415 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.60648.log.gz 2024-01-20T08:15:10.416 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42458.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42458.log.gz 2024-01-20T08:15:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63039.log 2024-01-20T08:15:10.417 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49509.log 2024-01-20T08:15:10.418 INFO:teuthology.orchestra.run.smithi100.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.56224.log.gz 2024-01-20T08:15:10.419 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63039.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.63039.log.gzgzip 2024-01-20T08:15:10.419 INFO:teuthology.orchestra.run.smithi100.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.55846.log 2024-01-20T08:15:10.420 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49509.log: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-01-20T08:15:10.420 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49509.log.gz 2024-01-20T08:15:10.420 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41865.log 2024-01-20T08:15:10.421 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55174.log 2024-01-20T08:15:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55846.log: /var/log/ceph/ceph-client.admin.41865.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55846.log.gz 2024-01-20T08:15:10.422 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62997.log 2024-01-20T08:15:10.423 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41865.log.gz 2024-01-20T08:15:10.423 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56777.log 2024-01-20T08:15:10.424 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55174.log.gz 2024-01-20T08:15:10.425 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61393.log 2024-01-20T08:15:10.425 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62997.log.gz 2024-01-20T08:15:10.426 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50139.log 2024-01-20T08:15:10.426 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.56777.log.gz 2024-01-20T08:15:10.427 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44168.log 2024-01-20T08:15:10.427 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.61393.log.gz 2024-01-20T08:15:10.428 INFO:teuthology.orchestra.run.smithi110.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-01-20T08:15:10.428 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42460.log 2024-01-20T08:15:10.429 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50139.log.gz 2024-01-20T08:15:10.429 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44168.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44168.log.gz 2024-01-20T08:15:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51587.log 2024-01-20T08:15:10.430 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58624.log 2024-01-20T08:15:10.431 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42460.log.gz 2024-01-20T08:15:10.432 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51587.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.51587.log.gz 2024-01-20T08:15:10.432 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46680.log 2024-01-20T08:15:10.433 INFO:teuthology.orchestra.run.smithi110.stderr: 2024-01-20T08:15:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:real 0m0.501s 2024-01-20T08:15:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:user 0m1.879s 2024-01-20T08:15:10.433 INFO:teuthology.orchestra.run.smithi110.stderr:sys 0m0.300s 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42453.log 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.58624.log.gz 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46680.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46680.log.gz 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44522.log 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60606.log 2024-01-20T08:15:10.435 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42453.log.gz 2024-01-20T08:15:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44522.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44522.log.gz 2024-01-20T08:15:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53498.log 2024-01-20T08:15:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54754.log 2024-01-20T08:15:10.438 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.60606.log.gz 2024-01-20T08:15:10.438 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53498.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.53498.log.gz 2024-01-20T08:15:10.439 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44438.log 2024-01-20T08:15:10.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54754.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54754.log.gz 2024-01-20T08:15:10.440 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44816.log 2024-01-20T08:15:10.440 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44438.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44438.log.gz 2024-01-20T08:15:10.440 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41026.log 2024-01-20T08:15:10.441 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52197.log 2024-01-20T08:15:10.441 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44816.log.gz 2024-01-20T08:15:10.442 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41026.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.41026.log.gz 2024-01-20T08:15:10.442 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51945.log 2024-01-20T08:15:10.443 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41425.log 2024-01-20T08:15:10.443 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52197.log.gz 2024-01-20T08:15:10.444 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.51945.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.51945.log.gz 2024-01-20T08:15:10.444 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-01-20T08:15:10.445 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54126.log 2024-01-20T08:15:10.445 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41425.log.gz 2024-01-20T08:15:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46332.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-01-20T08:15:10.446 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62871.log 2024-01-20T08:15:10.447 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43725.log 2024-01-20T08:15:10.448 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54126.log.gz 2024-01-20T08:15:10.448 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62871.log: gzip -5 --verbose -- 88.8% /var/log/ceph/ceph-client.admin.60858.log 2024-01-20T08:15:10.448 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.62871.log.gz 2024-01-20T08:15:10.449 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.0.43725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.43725.log.gz 2024-01-20T08:15:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-01-20T08:15:10.450 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60858.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.60858.log.gz 2024-01-20T08:15:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61020.log 2024-01-20T08:15:10.451 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41781.log 2024-01-20T08:15:10.453 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61020.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61020.log.gz 2024-01-20T08:15:10.453 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60515.log 2024-01-20T08:15:10.454 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52323.log 2024-01-20T08:15:10.455 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41781.log.gz 2024-01-20T08:15:10.455 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60515.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.60515.log.gz 2024-01-20T08:15:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57337.log 2024-01-20T08:15:10.456 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53750.log 2024-01-20T08:15:10.457 INFO:teuthology.orchestra.run.smithi100.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52323.log.gz 2024-01-20T08:15:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57337.log.gz 2024-01-20T08:15:10.458 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2024-01-20T08:15:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53750.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53750.log.gz 2024-01-20T08:15:10.459 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56903.log 2024-01-20T08:15:10.461 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56735.log 2024-01-20T08:15:10.461 INFO:teuthology.orchestra.run.smithi100.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2024-01-20T08:15:10.462 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56903.log: gzip -5 --verbose 88.2% -- -- replaced with /var/log/ceph/ceph-client.admin.56903.log.gz /var/log/ceph/ceph-client.admin.55342.log 2024-01-20T08:15:10.462 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-20T08:15:10.463 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56735.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56735.log.gz 2024-01-20T08:15:10.464 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42121.log 2024-01-20T08:15:10.465 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48211.log 2024-01-20T08:15:10.465 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.55342.log.gz 2024-01-20T08:15:10.466 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42121.log: 88.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.42121.log.gz -5 2024-01-20T08:15:10.466 INFO:teuthology.orchestra.run.smithi100.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43958.log 2024-01-20T08:15:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48211.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48211.log.gz 2024-01-20T08:15:10.467 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57125.log 2024-01-20T08:15:10.468 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43125.log 2024-01-20T08:15:10.469 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43958.log.gz 2024-01-20T08:15:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57125.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.57125.log.gz 2024-01-20T08:15:10.470 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60245.log 2024-01-20T08:15:10.471 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.43125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61435.log 2024-01-20T08:15:10.472 INFO:teuthology.orchestra.run.smithi100.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43125.log.gz 2024-01-20T08:15:10.473 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60245.log: 88.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55594.log 2024-01-20T08:15:10.473 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60245.log.gz 2024-01-20T08:15:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61435.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61435.log.gz 2024-01-20T08:15:10.474 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53204.log 2024-01-20T08:15:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-01-20T08:15:10.476 INFO:teuthology.orchestra.run.smithi100.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55594.log.gz 2024-01-20T08:15:10.476 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53204.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.53204.log.gz 2024-01-20T08:15:10.477 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48695.log 2024-01-20T08:15:10.477 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58834.log 2024-01-20T08:15:10.478 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-01-20T08:15:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48695.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48695.log.gz 2024-01-20T08:15:10.479 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-01-20T08:15:10.480 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61916.log 2024-01-20T08:15:10.480 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58834.log.gz 2024-01-20T08:15:10.481 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45563.log 2024-01-20T08:15:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61916.log: 86.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-01-20T08:15:10.482 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61958.log 2024-01-20T08:15:10.483 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61916.log.gz 2024-01-20T08:15:10.484 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45563.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-01-20T08:15:10.484 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45563.log.gz 2024-01-20T08:15:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61958.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.61958.log.gz 2024-01-20T08:15:10.485 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-01-20T08:15:10.486 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-01-20T08:15:10.488 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42459.log 2024-01-20T08:15:10.488 INFO:teuthology.orchestra.run.smithi100.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz 2024-01-20T08:15:10.489 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46542.log 2024-01-20T08:15:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42459.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42459.log.gz 2024-01-20T08:15:10.491 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52239.log 2024-01-20T08:15:10.492 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46542.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46542.log.gz 2024-01-20T08:15:10.493 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48947.log 2024-01-20T08:15:10.494 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.52239.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.52239.log.gz 2024-01-20T08:15:10.495 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58232.log 2024-01-20T08:15:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48947.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48947.log.gz 2024-01-20T08:15:10.496 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58582.log 2024-01-20T08:15:10.498 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58232.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58232.log.gz 91.5% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-01-20T08:15:10.498 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-20T08:15:10.499 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44084.log 2024-01-20T08:15:10.499 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58582.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58582.log.gz 2024-01-20T08:15:10.500 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59044.log 2024-01-20T08:15:10.501 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45960.log 2024-01-20T08:15:10.501 INFO:teuthology.orchestra.run.smithi100.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44084.log.gz 2024-01-20T08:15:10.503 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.59044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63669.log 2024-01-20T08:15:10.503 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.59044.log.gz 2024-01-20T08:15:10.504 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36189.log 2024-01-20T08:15:10.504 INFO:teuthology.orchestra.run.smithi100.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45960.log.gz 2024-01-20T08:15:10.506 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58960.log 2024-01-20T08:15:10.506 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.63669.log.gz 2024-01-20T08:15:10.507 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.36189.log: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50055.log 2024-01-20T08:15:10.507 INFO:teuthology.orchestra.run.smithi100.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36189.log.gz 2024-01-20T08:15:10.508 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63333.log 2024-01-20T08:15:10.509 INFO:teuthology.orchestra.run.smithi100.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.58960.log.gz 2024-01-20T08:15:10.510 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50055.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50055.log.gz 2024-01-20T08:15:10.510 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48547.log 2024-01-20T08:15:10.511 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63333.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.63333.log.gz 2024-01-20T08:15:10.512 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46290.log 2024-01-20T08:15:10.514 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57697.log 2024-01-20T08:15:10.514 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48547.log.gz 2024-01-20T08:15:10.515 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46290.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46290.log.gz 2024-01-20T08:15:10.516 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57697.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57697.log.gz 2024-01-20T08:15:10.517 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61351.log 2024-01-20T08:15:10.518 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.testuser.60126.log 2024-01-20T08:15:10.520 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41152.log 2024-01-20T08:15:10.520 INFO:teuthology.orchestra.run.smithi100.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.61351.log.gz 2024-01-20T08:15:10.521 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.testuser.60126.log: 0.0% -- replaced with /var/log/ceph/ceph-client.testuser.60126.log.gz 2024-01-20T08:15:10.522 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41152.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41152.log.gz 2024-01-20T08:15:10.523 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44354.log 2024-01-20T08:15:10.524 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57253.log 2024-01-20T08:15:10.526 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.44354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56140.log 2024-01-20T08:15:10.526 INFO:teuthology.orchestra.run.smithi100.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.44354.log.gz 2024-01-20T08:15:10.527 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.57253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.57253.log.gz 2024-01-20T08:15:10.528 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56140.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.56140.log.gz 2024-01-20T08:15:10.529 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62168.log 2024-01-20T08:15:10.530 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58496.log 2024-01-20T08:15:10.532 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45269.log 2024-01-20T08:15:10.532 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.62168.log.gz 2024-01-20T08:15:10.533 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42467.log 2024-01-20T08:15:10.533 INFO:teuthology.orchestra.run.smithi100.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58496.log.gz 2024-01-20T08:15:10.535 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61561.log 2024-01-20T08:15:10.535 INFO:teuthology.orchestra.run.smithi100.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45269.log.gz 2024-01-20T08:15:10.536 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60371.log 2024-01-20T08:15:10.536 INFO:teuthology.orchestra.run.smithi100.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42467.log.gz 2024-01-20T08:15:10.537 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.61561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41655.log 2024-01-20T08:15:10.538 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.61561.log.gz 2024-01-20T08:15:10.539 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.60371.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60371.log.gz 2024-01-20T08:15:10.540 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41655.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41655.log.gz 2024-01-20T08:15:10.541 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62396.log 2024-01-20T08:15:10.542 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63081.log 2024-01-20T08:15:10.543 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42125.log 2024-01-20T08:15:10.544 INFO:teuthology.orchestra.run.smithi100.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.62396.log.gz 2024-01-20T08:15:10.545 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.63081.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63081.log.gz 2024-01-20T08:15:10.546 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.42125.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42125.log.gz 2024-01-20T08:15:10.547 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56308.log 2024-01-20T08:15:10.548 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45395.log 2024-01-20T08:15:10.550 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.56308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55426.log 2024-01-20T08:15:10.550 INFO:teuthology.orchestra.run.smithi100.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.56308.log.gz 2024-01-20T08:15:10.551 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.45395.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45395.log.gz 2024-01-20T08:15:10.552 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55426.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.55426.log.gz 2024-01-20T08:15:10.553 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55804.log 2024-01-20T08:15:10.554 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62210.log 2024-01-20T08:15:10.556 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.55804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46826.log 2024-01-20T08:15:10.556 INFO:teuthology.orchestra.run.smithi100.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55804.log.gz 2024-01-20T08:15:10.557 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62210.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.62210.log.gz 2024-01-20T08:15:10.558 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.46826.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46826.log.gz 2024-01-20T08:15:10.559 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58708.log 2024-01-20T08:15:10.560 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49467.log 2024-01-20T08:15:10.561 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58708.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-01-20T08:15:10.562 INFO:teuthology.orchestra.run.smithi100.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.58708.log.gz 2024-01-20T08:15:10.563 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49467.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49467.log.gz 2024-01-20T08:15:10.565 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41237.log 2024-01-20T08:15:10.567 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49677.log 2024-01-20T08:15:10.569 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.41237.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41237.log.gz 2024-01-20T08:15:10.569 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53120.log 2024-01-20T08:15:10.571 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.49677.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49677.log.gz 2024-01-20T08:15:10.572 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.53120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50182.log 2024-01-20T08:15:10.572 INFO:teuthology.orchestra.run.smithi100.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.53120.log.gz 2024-01-20T08:15:10.573 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63249.log 2024-01-20T08:15:10.575 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.50182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50182.log.gz 2024-01-20T08:15:10.576 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48421.log/var/log/ceph/ceph-client.admin.63249.log: 2024-01-20T08:15:10.576 INFO:teuthology.orchestra.run.smithi100.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.63249.log.gz 2024-01-20T08:15:10.577 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58750.log 2024-01-20T08:15:10.579 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.48421.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48421.log.gz 2024-01-20T08:15:10.580 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54168.log 2024-01-20T08:15:10.581 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.58750.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.58750.log.gz 2024-01-20T08:15:10.581 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62685.log 2024-01-20T08:15:10.583 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.54168.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.54168.log.gz 2024-01-20T08:15:10.584 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/ceph-client.admin.62685.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.62685.log.gz 2024-01-20T08:15:10.591 INFO:teuthology.orchestra.run.smithi100.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-01-20T08:15:10.606 INFO:teuthology.orchestra.run.smithi100.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-01-20T08:15:10.639 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-01-20T08:15:10.731 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-01-20T08:15:10.832 INFO:teuthology.orchestra.run.smithi100.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-01-20T08:15:10.870 INFO:teuthology.orchestra.run.smithi100.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-01-20T08:15:10.874 INFO:teuthology.orchestra.run.smithi100.stderr: 2024-01-20T08:15:10.874 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.947s 2024-01-20T08:15:10.874 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m2.283s 2024-01-20T08:15:10.874 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m1.461s 2024-01-20T08:15:10.875 INFO:tasks.ceph:Archiving logs... 2024-01-20T08:15:10.876 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi100/log 2024-01-20T08:15:10.877 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-20T08:15:11.611 DEBUG:teuthology.misc:Transferring archived files from smithi110:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi110/log 2024-01-20T08:15:11.611 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /var/log/ceph -- . 2024-01-20T08:15:11.957 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-01-20T08:15:11.965 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-01-20T08:15:11.966 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-20T08:15:11.974 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-01-20T08:15:12.129 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-01-20T08:15:12.138 INFO:teuthology.task.clock:Checking final clock skew... 2024-01-20T08:15:12.138 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T08:15:12.146 DEBUG:teuthology.orchestra.run.smithi110:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-01-20T08:15:12.193 INFO:teuthology.orchestra.run.smithi100.stderr:bash: line 1: ntpq: command not found 2024-01-20T08:15:12.199 INFO:teuthology.orchestra.run.smithi110.stderr:bash: line 1: ntpq: command not found 2024-01-20T08:15:12.202 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T08:15:12.203 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2024-01-20T08:15:12.203 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 38 -500us[ -500us] +/- 88ms 2024-01-20T08:15:12.203 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -1621us[-1614us] +/- 75ms 2024-01-20T08:15:12.203 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +2073us[+2073us] +/- 77ms 2024-01-20T08:15:12.203 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:=============================================================================== 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 37 -474us[ -474us] +/- 88ms 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:^* hv02.front.sepia.ceph.com 3 6 377 37 -1607us[-1584us] +/- 75ms 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 35 +2105us[+2105us] +/- 77ms 2024-01-20T08:15:12.209 INFO:teuthology.orchestra.run.smithi110.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-01-20T08:15:12.210 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-01-20T08:15:12.219 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-01-20T08:15:12.220 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-01-20T08:15:12.229 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-20T08:15:12.459 DEBUG:teuthology.orchestra.run.smithi110:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-01-20T08:15:12.668 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T08:15:12.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:15:12.770 DEBUG:teuthology.orchestra.run.smithi110:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-01-20T08:15:12.871 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:15:12.872 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-01-20T08:15:12.881 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-01-20T08:15:12.890 INFO:teuthology.task.internal:Duration was 835.343927 seconds 2024-01-20T08:15:12.891 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-01-20T08:15:12.899 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-01-20T08:15:12.899 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-20T08:15:12.907 DEBUG:teuthology.orchestra.run.smithi110:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-01-20T08:15:13.060 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T08:15:13.070 INFO:teuthology.orchestra.run.smithi110.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-01-20T08:15:13.483 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-01-20T08:15:13.484 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2024-01-20T08:15:13.484 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-20T08:15:13.543 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi110.front.sepia.ceph.com 2024-01-20T08:15:13.543 DEBUG:teuthology.orchestra.run.smithi110:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-01-20T08:15:13.617 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-01-20T08:15:13.618 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-20T08:15:13.626 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-01-20T08:15:13.717 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-01-20T08:15:13.717 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-20T08:15:13.722 DEBUG:teuthology.orchestra.run.smithi110:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-01-20T08:15:13.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-01-20T08:15:13.919 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-01-20T08:15:13.919 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-20T08:15:14.012 DEBUG:teuthology.orchestra.run.smithi110:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-01-20T08:15:14.111 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-01-20T08:15:14.122 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-20T08:15:14.130 DEBUG:teuthology.orchestra.run.smithi110:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-01-20T08:15:14.230 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2024-01-20T08:15:14.238 INFO:teuthology.orchestra.run.smithi110.stdout:kernel.core_pattern = core 2024-01-20T08:15:14.289 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-20T08:15:14.338 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:15:14.339 DEBUG:teuthology.orchestra.run.smithi110:> test -e /home/ubuntu/cephtest/archive/coredump 2024-01-20T08:15:14.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-01-20T08:15:14.391 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-01-20T08:15:14.401 INFO:teuthology.task.internal:Transferring archived files... 2024-01-20T08:15:14.402 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi100 2024-01-20T08:15:14.402 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-20T08:15:14.502 DEBUG:teuthology.misc:Transferring archived files from smithi110:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412/remote/smithi110 2024-01-20T08:15:14.503 DEBUG:teuthology.orchestra.run.smithi110:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-01-20T08:15:14.607 INFO:teuthology.task.internal:Removing archive directory... 2024-01-20T08:15:14.607 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-20T08:15:14.615 DEBUG:teuthology.orchestra.run.smithi110:> rm -rf -- /home/ubuntu/cephtest/archive 2024-01-20T08:15:14.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-01-20T08:15:14.680 INFO:teuthology.task.internal:Not uploading archives. 2024-01-20T08:15:14.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-01-20T08:15:14.716 INFO:teuthology.task.internal:Tidying up after the test... 2024-01-20T08:15:14.716 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-20T08:15:14.724 DEBUG:teuthology.orchestra.run.smithi110:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-01-20T08:15:14.773 INFO:teuthology.orchestra.run.smithi100.stdout: 393242 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 20 08:15 /home/ubuntu/cephtest 2024-01-20T08:15:14.781 INFO:teuthology.orchestra.run.smithi110.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jan 20 08:15 /home/ubuntu/cephtest 2024-01-20T08:15:14.784 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-01-20T08:15:14.793 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-01-20T08:15:14.815 INFO:teuthology.nuke:Checking targets against current locks 2024-01-20T08:15:14.840 DEBUG:teuthology.nuke:shortname: smithi100 2024-01-20T08:15:14.841 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T08:15:14.866 DEBUG:teuthology.nuke:shortname: smithi110 2024-01-20T08:15:14.866 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-01-20T08:15:14.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.272212', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlrLNzBn88jFP2X1n6kxVC2c1uK3V5PoWfN2hhwa0xRva16SJ8jrcjQlFqFAsBr4NLSNKsS8NQpDYCRXpV392Y='} 2024-01-20T08:15:14.889 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi110.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-01-19_15:24:44-fs-main-distro-default-smithi/7522412', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-01-20 07:52:05.273389', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBFT2tsvTwJsCuCnLOw6OilTH6tN0pKxMSQvbzBE+jougwKWG72e6msyNu/hF5UnlGcrh3L0ZQb1wrDbW+/Hw5I='} 2024-01-20T08:15:14.923 INFO:teuthology.orchestra.console.smithi100:Power off 2024-01-20T08:15:14.924 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T08:15:14.938 INFO:teuthology.orchestra.console.smithi110:Power off 2024-01-20T08:15:14.938 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-01-20T08:15:14.948 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2024-01-20T08:15:14.948 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:14.960 DEBUG:teuthology.orchestra.console.smithi110:power off output: Chassis Power Control: Down/Off 2024-01-20T08:15:14.961 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:14.972 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-20T08:15:14.989 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-20T08:15:18.974 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:18.990 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:19.086 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2024-01-20T08:15:19.102 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is on 2024-01-20T08:15:23.089 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:23.102 DEBUG:teuthology.orchestra.console.smithi110:pexpect command: ipmitool -H smithi110.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-01-20T08:15:23.201 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2024-01-20T08:15:23.212 DEBUG:teuthology.orchestra.console.smithi110:check power output: Chassis Power is off 2024-01-20T08:15:23.303 INFO:teuthology.orchestra.console.smithi100:Power off completed 2024-01-20T08:15:23.313 INFO:teuthology.orchestra.console.smithi110:Power off completed 2024-01-20T08:15:23.418 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 client.1-kernel-sha1: 06652275eb934672217aaf9d4180f4a90395eb16 description: fs/multifs/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-2c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore-ec/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down mon-debug} tasks/multifs-auth} duration: 835.3439269065857 failure_reason: 'Test failure: test_r_with_fsname_and_no_path_in_cap (tasks.cephfs.test_multifs_auth.TestMDSCaps)' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=d0094e5e521b41b3a0c442752d7e9d09 status: fail success: false 2024-01-20T08:15:23.419 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-01-20T08:15:23.661 INFO:teuthology.run:FAIL